WO2022176037A1 - Dispositif de réglage, système de réglage, dispositif d'affichage, dispositif de surveillance de passager et procédé de réglage - Google Patents

Dispositif de réglage, système de réglage, dispositif d'affichage, dispositif de surveillance de passager et procédé de réglage Download PDF

Info

Publication number
WO2022176037A1
WO2022176037A1 PCT/JP2021/005785 JP2021005785W WO2022176037A1 WO 2022176037 A1 WO2022176037 A1 WO 2022176037A1 JP 2021005785 W JP2021005785 W JP 2021005785W WO 2022176037 A1 WO2022176037 A1 WO 2022176037A1
Authority
WO
WIPO (PCT)
Prior art keywords
angle
display device
occupant
search area
imaging
Prior art date
Application number
PCT/JP2021/005785
Other languages
English (en)
Japanese (ja)
Inventor
雄城 煤孫
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to JP2023500164A priority Critical patent/JP7258262B2/ja
Priority to PCT/JP2021/005785 priority patent/WO2022176037A1/fr
Publication of WO2022176037A1 publication Critical patent/WO2022176037A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems

Definitions

  • the present disclosure is for detecting an occupant set on a captured image of the vehicle interior captured by an imaging device mounted on a display device with a variable angle and changing the imaging direction according to the angle of the display device.
  • an area that is assumed to include an occupant is set on an image captured by an imaging device capable of imaging a plurality of occupants in a vehicle interior, and the occupants detected within the area are identified as vehicle occupants.
  • a technique for determining is known (for example, Patent Document 1).
  • an imaging device for imaging the interior of a vehicle an imaging device mounted on a display device and integrated with the display device is known from the viewpoint of space saving.
  • the imaging direction of the imaging device changes according to the angle of the display device.
  • the imaging direction of the imaging device changes according to the angle of the display device. Accordingly, the imaging range is also changed, and there is a problem that the occupant may not be detected in the area where the occupant is supposed to be included.
  • the present disclosure has been made in order to solve the above-described problems. It is an object of the present invention to provide an adjustment device capable of reducing undetected occupants in areas assumed to be included.
  • the adjustment device is an image pickup device that is mounted on a display device with a variable angle and changes the image pickup direction according to the angle of the display device.
  • An adjustment device for adjusting a search area for detecting the angle change detection unit for detecting that the angle of the display device has been changed, and the angle change detection unit detects that the angle of the display device has been changed A search area adjuster is provided that, upon detection, moves the search area based on the amount of change in the angle of the display device.
  • the adjusting device adjusts the position of the occupant in the area assumed to include the occupant in the vehicle interior on the captured image captured by the imaging device whose imaging direction changes according to the angle of the display device with a variable angle. can be reduced.
  • FIG. 1 is a diagram showing a configuration example of an adjusting device and an occupant monitoring device according to Embodiment 1.
  • FIG. 4 is a diagram for explaining an image of an example of an installation position of the display device according to Embodiment 1;
  • FIG. 3 is a diagram for explaining an example of an image of an imaging range of an imaging device when a display device is installed as shown in FIG. 2;
  • 4 is a diagram for explaining an example of a captured image captured by the imaging device when the imaging range of the imaging device is the range shown in FIG. 3 in the first embodiment;
  • FIG. 6 is a diagram for explaining an example of a captured image captured by the imaging device when the imaging range of the imaging device is the range shown in FIG. 5 ;
  • the angle of the display device is changed so that the display device faces the driver's seat side as shown in FIG.
  • FIG. 1 An image of an example of the orientation of the display device when the angle of the display device is changed in various directions and the face search area moved according to the change in the angle of the display device in the first embodiment will be described. It is a figure for doing.
  • FIG. 4 is a flowchart for explaining the operation of the adjustment device according to Embodiment 1; 4 is a flowchart for explaining the operation of the occupant monitoring device according to Embodiment 1; FIG. 4 is a diagram for explaining an example of an image of an occupant search area set on a captured image in Embodiment 1; 12A and 12B are diagrams showing an example of the hardware configuration of the adjusting device according to Embodiment 1.
  • FIG. FIG. 10 is a diagram showing a configuration example of an adjustment device according to Embodiment 2; 9 is a flowchart for explaining the operation of the adjustment device according to Embodiment 2; FIG.
  • the adjusting device includes an occupant of the vehicle, which is preset on the captured image captured by the imaging device whose imaging direction changes according to the angle of the display device whose angle is variable. Adjust the area (hereinafter referred to as the “search area”) that is assumed to exist.
  • the search area is assumed to include the face of the vehicle occupant (hereinafter referred to as "face search area"). Details of the face search area will be described later.
  • the occupants of the vehicle include the driver, the occupants in the front passenger seats, and the occupants in the rear seats.
  • the imaging device is configured with a wide-angle camera or the like, and is installed at a position capable of simultaneously imaging a plurality of occupants in the vehicle interior.
  • the imaging device may be, for example, a visible light camera or an infrared camera.
  • the imaging device may, for example, be shared with a so-called "Driver Monitoring System (DMS)".
  • DMS Driver Monitoring System
  • the imaging device monitors the occupants inside the vehicle.
  • the imaging device is mounted on a display device with a variable angle, and the imaging direction changes according to the angle of the display device.
  • the display device is a touch panel display or the like, and is mounted in a navigation device, for example. Note that by mounting the imaging device on the display device and integrating the imaging device and the display device, it is possible to share some parts such as circuits, mechanisms, or electricity, or to save space in the vehicle interior. It has the effect of being able to
  • the angle of the display is variable in different directions. This allows the occupant to change the angle of the display device, for example, in a direction that is easy for the occupant to visually recognize.
  • the angle of the display device refers to the angle of the display device with respect to the installation surface of the display device.
  • the display device has, for example, a rotation mechanism capable of rotating the display device in vertical and horizontal directions, and the angle of the display device is variable by the rotation mechanism.
  • the angle of the display device can be changed in various ways, but it is not assumed that the installation position of the display device is variable, such as in the width direction of the vehicle or in the longitudinal direction with respect to the traveling direction of the vehicle.
  • the direction of the optical axis of the imaging device is also changed by the change amount of the angle of the display device along with the change in the angle of the display device. That is, as the orientation of the display device is changed, the imaging direction of the imaging device is changed, and the imaging range is changed. Note that the angle of view of the imaging device does not change.
  • the adjustment device detects this and moves the face search area on the captured image based on the amount of change in the angle of the display device. When the face search area is moved, the adjustment device outputs information about the face search area after the movement to the occupant monitoring device that monitors the condition of the occupant.
  • the face search area is used when the occupant monitoring device monitors the occupant.
  • an area is set in advance where it is assumed that the faces of the passengers are positioned even when the passengers of various physiques are seated in various seat states.
  • an administrator or the like conducts a test in which persons of various physiques are seated in different seat states in the driver's seat in advance, and an imaging device installed in the initial position images the interior of the vehicle. I do.
  • an area in which the faces of all persons can be detected on the captured image captured by the imaging device is set as the driver's face search area.
  • an administrator or the like extracts an area in which each person's face is captured on the captured image.
  • the administrator or the like sets a rectangular area surrounding the area where each person's face is captured on the captured image. Then, the administrator or the like sets a minimum rectangular area including all the set rectangular areas, and sets the set minimum rectangular area as the driver's face search area.
  • the face search area is represented, for example, by the coordinates of each vertex of the rectangle on the captured image.
  • the driver's face search area has been described. area, and a face search area assumed to include the face of the passenger in the rear seat.
  • the face search area is a rectangular area, but the face search area is not limited to a rectangular area, and may be an area having an appropriate shape.
  • the occupant monitoring device is mounted on a vehicle, detects the face of the occupant based on the captured image captured by the imaging device, and monitors the condition of the occupant based on the information regarding the detected face of the occupant.
  • the state of the occupant monitored based on the information regarding the occupant's face is, for example, the state in which the occupant is dozing off or the state in which the occupant is looking aside.
  • the occupant monitoring device detects the face of the occupant not on the entire area of the captured image but on a face search area on the captured image. By setting the face search area on the captured image, the occupant monitoring device can shorten the time required to search for the occupant's face.
  • FIG. 1 is a diagram showing a configuration example of an adjusting device 1 and an occupant monitoring device 3 according to Embodiment 1.
  • the adjusting device 1 is connected to an imaging device 21 , a display device 2 equipped with the imaging device 21 , and an occupant monitoring device 3 .
  • the occupant monitoring device 3 is connected to the imaging device 21 and the display device 2 on which the imaging device 21 is mounted.
  • An adjustment system 100 is configured by the adjustment device 1 , the display device 2 and the occupant monitoring device 3 .
  • the adjustment device 1 includes an angle change detection section 11 and a search area adjustment section 12 .
  • the angle change detection unit 11 detects that the angle of the display device 2 has been changed. Specifically, for example, the angle change detection unit 11 constantly acquires information about the angle of the display device 2 (hereinafter referred to as “angle information”) from an angle detection sensor (not shown) included in the display device 2, Based on the obtained angle information, it is detected that the angle of the display device 2 has been changed. Further, for example, the angle change detection unit 11 acquires a pulse signal from a stepping motor (not shown) included in the display device 2, and detects that the angle of the display device 2 has been changed from the acquired pulse signal.
  • angle information information about the angle of the display device 2
  • the angle change detection unit 11 constantly acquires the captured image captured by the imaging device 21, targets the structure captured in the captured image, and calculates how many pixels the structure has moved. , it may detect that the angle of the display device 2 has been changed.
  • the target structure is, for example, the edge of the B-pillar or the roof structure. Which structure is to be the target structure is determined in advance.
  • the angle change detection unit 11 may use a known image recognition technique for the captured image to identify the target structure.
  • the angle change detection unit 11 acquires the amount of change in the angle of the display device 2 (hereinafter referred to as “angle change amount”).
  • the angle change amount is information indicating in what direction and how much the angle of the display device 2 has been changed.
  • the angle change detection unit 11 may acquire the angle change amount from the angle information or the pulse signal. Further, the angle change detection unit 11 may acquire the angle change amount by calculating how many pixels the target structure has moved on the captured image. In addition, information associated with how much and in which direction the angle of the display device 2 is changed when the target structure moves in which direction and how many pixels on the captured image is set in advance. It is assumed that there is
  • angle change information information indicating that the angle of the display device 2 has been changed
  • the angle change information includes information about the angle change amount.
  • the search area adjustment unit 12 adjusts the angle change amount. Based on this, the face search area on the captured image is moved. It is predetermined in which direction and how much the face search area is moved on the captured image when the display device 2 is changed in which direction and how much.
  • the search area adjustment unit 12 outputs information about the face search area after movement (hereinafter referred to as “post-movement search area information”) to the occupant monitoring device 3 .
  • FIG. 1 the functions of the angle change detection unit 11 and the search area adjustment unit 12 in the adjustment device 1 will be described with specific examples using FIGS. 2 to 6.
  • FIG. 1 the functions of the angle change detection unit 11 and the search area adjustment unit 12 in the adjustment device 1 will be described with specific examples using FIGS. 2 to 6.
  • FIG. 2 is a diagram for explaining an image of an example of the installation position of the display device 2 according to the first embodiment.
  • the display device 2 is installed, for example, at the center of the vehicle in the width direction of an instrument panel (hereinafter referred to as "instrument panel") of the vehicle.
  • instrument panel an instrument panel
  • the center in the width direction of the vehicle does not have to be strictly the center, and the term "center” also includes "substantially the center”.
  • the installation position of the display device 2 shown in FIG. 2 is merely an example, and the display device 2 is installed at a position where the imaging device 21 mounted on the display device 2 can image a plurality of occupants of the vehicle.
  • the installation position of the display device 2 is in the initial state.
  • the angle of the display device 2 with respect to the installation surface of the display device 2 in other words, the surface of the instrument panel is 0 degrees.
  • FIG. 3 is a diagram for explaining an image of an imaging range of the imaging device 21 when the display device 2 is installed as shown in FIG. Note that FIG. 3 is an image of the front seats of the vehicle viewed from above.
  • the imaging range of the imaging device 21 includes the front seats of the vehicle, in other words, the driver's seat and the passenger's seat.
  • the imaging range of the imaging device 21 is indicated by 401 .
  • 402a denotes the driver's seat
  • 402 denotes the driver seated in the driver's seat 402a.
  • 403a denotes a passenger seat
  • 403 denotes an occupant seated on the passenger seat 403a.
  • FIG. 4 is a diagram for explaining an example of a captured image captured by the imaging device 21 when the imaging range 401 of the imaging device 21 is the range shown in FIG. 3 in the first embodiment. is.
  • the captured image is indicated by 200.
  • a driver 402 and an occupant 403 in the front passenger seat are captured.
  • the vehicle is a right-hand drive vehicle, but this is only an example, and the vehicle may be a left-hand drive vehicle.
  • face search areas 404 and 405 set on the captured image 200 are also illustrated in the captured image 200 .
  • a face search area 404 is the face search area of the driver 402 on the captured image 200
  • a face search area 405 is the face search area of the occupant 403 in the passenger seat on the captured image 200 .
  • FIG. 5 shows the state in which the display device 2 is installed as shown in FIG. 2, and the angle of the display device 2 is changed by a predetermined angle so that the display device 2 faces the driver's seat 402a.
  • 4 is a diagram for explaining an example of an image of an imaging range 401 of the imaging device 21.
  • FIG. 5 is an image of the front seats of the vehicle viewed from above, as is the case with FIG. In FIG. 5, for example, the display device 2 is rotated by 45 degrees around the longitudinal axis of the rotating mechanism of the display device 2 so as to face the driver's seat 402a.
  • the angle change detection unit 11 detects that the angle of the display device 2 has been changed by 45 degrees about the longitudinal axis of the rotation mechanism so that it faces the driver's seat 402a. Then, the angle change detection unit 11 outputs to the search area adjustment unit 12 angle change information indicating that the angle of the display device 2 has been changed by 45 degrees in the horizontal direction so that the angle of the display device 2 faces the driver's seat 402a.
  • FIG. 6 is a diagram for explaining an example of a captured image 200 captured by the imaging device 21 when the imaging range 401 of the imaging device 21 is the range shown in FIG.
  • the picked-up image is indicated by 200 as in FIG.
  • the positions of the faces of the driver 402 and the passenger 403 in the front passenger seat 403a on the captured image 200 are changed.
  • the positions of the faces of the driver 402 and the passenger 403 in the front passenger seat 403a on the captured image 200 move rightward in FIG.
  • the region of the face of the driver 402 is no longer included in the face search region 404 of the driver 402 set on the imaging range 401, and the region of the face of the passenger 403 in the passenger seat 403a is not included on the imaging range 401. is not included in the face search area 405 of the occupant 403 on the front passenger seat 403a set in .
  • the search area adjustment unit 12 moves the face search area on the captured image based on the angle change amount.
  • FIG. 7 shows how the search area adjustment unit 12 moves the face search area on the captured image 200 when the angle of the display device 2 is changed so that the display device 2 faces the driver's seat side as shown in FIG.
  • FIG. 10 is a diagram for explaining an example of an image of a captured image 200 after being captured; As shown in FIG. 7, the search area adjustment unit 12 moves the face search areas 404 and 405 rightward in FIG. 7 according to the angle change amount.
  • the area of the face of the driver 402 is included in the driver's face search area 404 set on the captured image, and the area of the face of the occupant 403 in the front passenger seat 403a is set on the captured image.
  • the face search area 405 of the occupant 403 in the front passenger seat 403a is set on the captured image.
  • the angle of the display device 2 is changed toward the driver's seat so that the display device 2 faces the driver's seat. It is not limited to this.
  • the angle of the display device 2 can be changed in various directions.
  • the adjustment device 1 moves the face search area in various directions on the captured image in accordance with the change in the angle of the display device 2 .
  • FIG. 8 shows the orientation of the display device 2 when the angle of the display device 2 is changed in various directions, and the face search area moved according to the change in the angle of the display device 2 in the first embodiment. It is a figure for demonstrating the image of an example.
  • the upper left diagram in FIG. 8 is a diagram showing an image of an example of the orientation of the display device 2 when the angle of the display device 2 is changed in various directions
  • the upper right diagram in FIG. FIG. 10 is a diagram showing an image of an example of a face search area that has moved according to a change in the angle of the display device 2;
  • the imaging range includes the driver and the passenger in the front passenger seat, but for convenience of explanation, in the right diagram, only one passenger is imaged. It is an image of an image.
  • the angle of the display device 2 is represented, for example, by the vertical and horizontal axes.
  • 81 and 82 indicate the tilt of the display device 2 when the angle of the display device 2 is changed with the horizontal axis as the rotation axis
  • 83 and 84 indicate the vertical axis.
  • the inclination of the display device 2 is shown when the angle of the display device 2 is changed with .
  • the image of the captured image 200 becomes like the image of the captured image 200 shown in (d) of the right side of FIG.
  • the face search area 91a on the captured image 200 moves as indicated by 91d.
  • the image of the captured image 200 becomes like the image of the captured image 200 shown in (e) in the right diagram of FIG. .
  • the face search area 91a on the captured image 200 moves as indicated by 91e.
  • the image of the captured image 200 becomes like the image of the captured image 200 shown in (c) in the right diagram of FIG. .
  • the face search area 91a on the captured image 200 moves as indicated by 91c.
  • the image of the captured image 200 becomes like the image of the captured image 200 shown in (b) in the right diagram of FIG. .
  • the face search area 91a on the captured image 200 moves as indicated by 91b.
  • the occupant monitoring device 3 includes a captured image acquisition section 31 and an occupant state determination section 32 .
  • the captured image acquisition unit 31 acquires a captured image of the interior of the vehicle from the imaging device 21 .
  • the captured image acquisition section 31 outputs the acquired captured image to the occupant state determination section 32 .
  • the adjustment device 1 when the angle change detection unit 11 detects that the angle of the display device 2 has been changed based on the captured image, the captured image acquisition unit 31 transmits the captured image to the angle change detection unit 11. You may make it output.
  • the occupant state determination unit 32 detects the occupant in the face search area set on the captured image acquired by the captured image acquisition unit 31, and determines the detected occupant state. More specifically, the occupant state determination unit 32 detects the occupant's face in the face search area and determines the occupant state. In the adjustment device 1, when the search area adjustment unit 12 moves the face search area, the occupant state determination unit 32 adjusts the face search area after movement based on the post-movement search area information output from the search area adjustment unit 12. to detect the face of the occupant.
  • FIG. 9 is a flow chart for explaining the operation of the adjusting device 1 according to the first embodiment.
  • the angle change detection unit 11 detects that the angle of the display device 2 has been changed in the display device 2 (step ST1).
  • the angle change detection unit 11 outputs angle change information to the search area adjustment unit 12 .
  • step ST2 When the angle change detection unit 11 detects that the angle of the display device 2 has been changed in step ST1, in other words, when angle change information is output from the angle change detection unit 11, the search area adjustment unit 12 Based on the angle change amount, the face search area on the captured image is moved (step ST2).
  • the search area adjustment unit 12 outputs information about the face search area after movement (hereinafter referred to as “post-movement search area information”) to the occupant monitoring device 3 .
  • the adjustment device 1 moves the face search area on the captured image captured by the imaging device 21 mounted on the display device 2 whose angle is variable and whose imaging direction changes according to the angle of the display device 2 . Therefore, the adjusting device 1 can reduce the possibility that the occupant is not detected in the area where the occupant is supposed to be included in the vehicle compartment. As a result, the adjusting device 1 enables the occupant monitoring device 3 to detect the occupant's face in a short period of time.
  • FIG. 10 is a flow chart for explaining the operation of the occupant monitoring device 3 according to the first embodiment.
  • the captured image acquisition unit 31 acquires a captured image of the interior of the vehicle from the imaging device 21 (step ST21).
  • the captured image acquisition section 31 outputs the acquired captured image to the occupant state determination section 32 .
  • the occupant state determination unit 32 detects the occupant in the face search area set on the captured image acquired by the captured image acquisition unit 31 in step ST21, and determines the detected occupant state (step ST22).
  • the occupant monitoring device 3 detects the occupant's face in the face search area instead of the entire captured image. As a result, the occupant monitoring device 3 can detect the face of the occupant in a short period of time.
  • the search area is assumed to be a face search area, but this is merely an example.
  • the search area may be an area that includes the body of the occupant and is for detecting the occupant (hereinafter referred to as "occupant search area").
  • FIG. 11 is a diagram for explaining an example of an image of the occupant search area set on the captured image in the first embodiment.
  • the occupant search area is set in the captured image 200 as described with reference to FIG.
  • occupant search areas are indicated by 406 and 407 .
  • An occupant search area 406 is an occupant search area for the driver 402
  • an occupant search area 407 is an occupant search area for the occupant 403 in the passenger seat 403a.
  • FIG. 11 shows the face search area 404 of the driver 402 and the face search area 405 of the passenger 403 in the front passenger seat 403a.
  • Passenger search areas 406 and 407 are areas wider than face search areas 404 and 405 .
  • the occupant search areas 406, 407 include a portion of the occupant's body and are configured, for example, to suppress false detection of persons or other occupants outside the vehicle.
  • the occupant search area 406 of the driver 402 includes an area that is wider than the face search area 404, includes the upper body of the driver 402, and does not include the occupant 403 in the passenger seat 403a or people outside the vehicle. set.
  • the occupant search areas 406 and 407 are set in advance by an administrator or the like in the same manner as the face search areas 404 and 405 .
  • the occupant search areas 406 and 407 are, for example, rectangular areas on the captured image 200 , and the position of the occupant search area 406 is represented by the coordinates of each vertex of the rectangle on the captured image 200 .
  • the occupant search areas 406 and 407 are rectangular areas, but the occupant search areas 406 and 407 are not limited to rectangular areas, and may be areas of any shape.
  • the search area adjustment unit 12 of the adjustment device 1 adjusts the angle based on the angle change amount. , the occupant search area on the captured image can be moved.
  • the occupant state determination unit 32 of the occupant monitoring device 3 detects the occupant in the occupant search area set on the captured image acquired by the captured image acquisition unit 31, and determines the detected occupant state. For example, the occupant state determination unit 32 may detect whether or not the occupant is dozing off by detecting the face of the occupant, or may detect the posture of the occupant and detect whether or not the body of the occupant is tilted. You may
  • both the face search area and the occupant search area may be set on the captured image.
  • the search area adjustment unit 12 of the adjustment device 1 searches for the face search area and the occupant on the captured image based on the angle change amount. Make the area move.
  • the occupant state determination unit 32 of the occupant monitoring device 3 detects the occupant in at least one of the face search area and the occupant search area set on the captured image acquired by the captured image acquisition unit 31, and determines the detected occupant state. judge.
  • the search area may include a face search area and an occupant search area.
  • the adjusting device 1 may be mounted on the occupant monitoring device 3 . Further, for example, the adjustment device 1 may be mounted on the display device 2 . Further, for example, the occupant monitoring device 3 may be mounted on the display device 2 . Further, for example, the adjusting device 1, the display device 2, and the occupant monitoring device 3 may be integrated as one device.
  • the adjustment device 1 and the occupant monitoring device 3 are in-vehicle devices mounted on a vehicle, and the angle change detection unit 11, the search area adjustment unit 12, the captured image acquisition unit 31, and the occupant state determination unit
  • the unit 32 is provided in the in-vehicle device.
  • a part or all of them shall be mounted on the in-vehicle device of the vehicle, and other may be provided in a server connected to the in-vehicle device via a network, and the in-vehicle device and the server may constitute an adjustment system.
  • FIG. 12A and 12B are diagrams showing an example of the hardware configuration of the adjustment device 1 according to Embodiment 1.
  • the functions of the angle change detection section 11 and the search area adjustment section 12 are implemented by the processing circuit 1201 . That is, the adjustment device 1 includes a processing circuit 1201 for performing control to move the search area on the captured image when detecting that the angle of the display device 2 has been changed.
  • the processing circuit 1201 may be dedicated hardware, as shown in FIG. 12A, or a processor 1204 executing a program stored in memory, as shown in FIG. 12B.
  • the processing circuit 1201 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination thereof.
  • ASIC Application Specific Integrated Circuit
  • FPGA Field-Programmable Gate Array
  • the functions of the angle change detection unit 11 and the search area adjustment unit 12 are realized by software, firmware, or a combination of software and firmware.
  • Software or firmware is written as a program and stored in memory 1205 .
  • the processor 1204 reads and executes programs stored in the memory 1205 to perform the functions of the angle change detection unit 11 and the search area adjustment unit 12 .
  • the adjustment device 1 comprises a memory 1205 for storing a program that, when executed by the processor 1204, results in the execution of steps ST1 to ST2 of FIG. 9 described above. It can also be said that the program stored in the memory 1205 causes a computer to execute the procedures or methods of the angle change detection unit 11 and the search area adjustment unit 12 .
  • the memory 1205 is a non-volatile or volatile memory such as RAM, ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory).
  • RAM random access memory
  • ROM Read Only Memory
  • flash memory EPROM (Erasable Programmable Read Only Memory)
  • EEPROM Electrically Erasable Programmable Read-Only Memory
  • a semiconductor memory, a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, a DVD (Digital Versatile Disc), or the like is applicable.
  • the adjustment device 1 also includes a device such as the display device 2 or the occupant monitoring device 3, and an input interface device 1202 and an output interface device 1203 that perform wired or wireless communication.
  • the processing circuit 1201 implements the functions of the captured image acquisition unit 31 and the passenger state determination unit 32 . That is, the occupant monitoring device 3 includes a processing circuit 1201 for performing control to determine the state of the occupant based on the captured image.
  • the processing circuit 1201 may be dedicated hardware, as shown in FIG. 12A, or a processor 1204 executing a program stored in memory, as shown in FIG. 12B.
  • the processing circuit 1201 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination thereof.
  • ASIC Application Specific Integrated Circuit
  • FPGA Field-Programmable Gate Array
  • the processing circuit is the processor 1204, the functions of the captured image acquisition unit 31 and the occupant state determination unit 32 are realized by software, firmware, or a combination of software and firmware.
  • Software or firmware is written as a program and stored in memory 1205 .
  • the processor 1204 reads and executes programs stored in the memory 1205 to perform the functions of the captured image acquisition unit 31 and the passenger state determination unit 32 . That is, the occupant monitoring device 3 has a memory 1205 for storing a program that, when executed by the processor 1204, results in the execution of steps ST21 to ST22 in FIG. 10 described above. It can also be said that the program stored in the memory 1205 causes the computer to execute the procedures or methods of the captured image acquisition unit 31 and the passenger state determination unit 32 .
  • the memory 1205 is a non-volatile or volatile memory such as RAM, ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory).
  • RAM random access memory
  • ROM Read Only Memory
  • flash memory EPROM (Erasable Programmable Read Only Memory)
  • EEPROM Electrically Erasable Programmable Read-Only Memory
  • a semiconductor memory, a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, a DVD (Digital Versatile Disc), or the like is applicable.
  • the functions of the captured image acquisition unit 31 and the occupant state determination unit 32 may be partly realized by dedicated hardware and partly by software or firmware.
  • the function of the captured image acquisition unit 31 is realized by a processing circuit 1201 as dedicated hardware, and the occupant state determination unit 32 is implemented by the processor 1204 reading and executing a program stored in the memory 1205. It is possible to implement functions.
  • the occupant monitoring device 3 includes a device such as the display device 2 or the adjustment device 1, and an input interface device 1202 and an output interface device 1203 that perform wired or wireless communication.
  • the adjusting device 1 captures an image of the interior of the vehicle by the imaging device 21 mounted on the display device 2 whose angle is variable and whose imaging direction changes according to the angle of the display device 2.
  • An adjustment device 1 for adjusting a search area for detecting a passenger in a vehicle interior set on an image comprising an angle change detection unit 11 for detecting that the angle of a display device 2 has been changed;
  • a search area adjuster 12 that moves the search area based on the amount of change in the angle of the display device 2 when the detection unit 11 detects that the angle of the display device 2 has been changed. Therefore, the adjustment device 1 can detect the occupant in an area assumed to include the occupant in the vehicle interior on the captured image captured by the imaging device whose imaging direction changes according to the angle of the display device whose angle is variable. loss can be reduced.
  • the adjusting device may have a function of setting the angle of the display device to an angle previously set by the occupant in accordance with the occupant of the vehicle.
  • FIG. 13 is a diagram showing a configuration example of the adjusting device 1a according to the second embodiment.
  • the same reference numerals are given to the same configurations as those of the adjusting device 1 described in the first embodiment with reference to FIG. 1, and redundant descriptions are omitted.
  • An adjustment device 1a according to Embodiment 2 differs from adjustment device 1 according to Embodiment 1 described with reference to FIG.
  • the adjusting device 1a, the display device 2, and the occupant monitoring device 3 constitute an adjusting system 100a.
  • the specific configurations of the display device 2 and the occupant monitoring device 3 are the same as the specific configurations of the display device 2 and the occupant monitoring device 3, respectively, described using FIG. 1 in the first embodiment.
  • the same reference numerals are assigned to the respective components, and redundant descriptions are omitted.
  • the occupant identification unit 13 will be described.
  • the occupant identification unit 13 functions when, for example, the occupant gets into the vehicle and turns on the engine, or when the occupant sits on the seat of the vehicle and wears the seatbelt. I assume. For example, if the occupant identification unit 13 determines that the occupant has entered the vehicle and turned on the engine based on vehicle control information output from an ECU (Engine Control Unit; not shown) mounted on the vehicle. good. Further, the occupant identification unit 13 may determine, for example, that the occupant is seated on the seat of the vehicle and fastened the seatbelt based on seatbelt wearing information output from a seatbelt sensor (not shown).
  • ECU Engine Control Unit
  • the occupant identification unit 13 identifies an occupant in the vehicle compartment. Specifically, for example, the occupant identifying unit 13 acquires a captured image from the imaging device 21, performs a known image recognition process on the acquired captured image, and detects the face of the occupant, and the previously set storage unit. The occupant is identified based on the occupant authentication information stored in (not shown).
  • the occupant authentication information is, for example, information in which information that can identify a occupant, such as an ID, is associated with a facial image of the occupant (hereinafter referred to as "authentication facial image").
  • authentication facial image a facial image of the occupant
  • the occupant identifying unit 13 identifies the occupant by matching the face of the occupant detected based on the captured image with the authentication face image included in the occupant authentication information.
  • the occupant identification unit 13 may acquire the facial image of the occupant from the occupant state determination unit 32 of the occupant monitoring device 3 . Further, for example, the occupant identification unit 13 may receive information from the occupant that can identify the occupant. For example, when an occupant gets into a vehicle and turns on the engine, the occupant operates the display device 2 to input information that can identify the occupant. Note that the display device 2 is assumed to be a touch panel display.
  • the occupant identification unit 13 identifies the occupant based on the information input by the occupant from the display device 2 and capable of identifying the occupant.
  • the occupant identification unit 13 outputs information about the identified occupant (hereinafter referred to as “occupant information”) to the angle setting unit 14 .
  • the occupant information includes information that can identify the occupant.
  • the occupant information may include a facial image of
  • the angle setting unit 14 sets the angle of the display device 2 to the angle corresponding to the occupant specified by the occupant specifying unit 13 based on the occupant information output from the occupant specifying unit 13 and the set angle information.
  • the set angle information is information in which information that can identify the occupant is associated with the angle of the display device set by the occupant in the past.
  • the setting angle information may be associated with the facial image of the passenger.
  • the set angle information is generated when the occupant changes the angle of the display device 2 by the control section (not shown) of the adjustment device 1a, and is stored in the storage section.
  • the passenger presses an angle recording button displayed on the display device 2 to input an instruction to store the changed angle of the display device 2 .
  • the occupant also inputs information that can identify the occupant.
  • the control unit associates information indicating the changed angle of the display device 2 (hereinafter referred to as "past set angle") with the acquired information that can identify the occupant.
  • the set angle information is generated and stored in the storage unit.
  • the control unit may acquire the face image of the passenger based on the captured image currently captured by the imaging device 21 and include the face image in the set angle information. .
  • control section may acquire the face image of the passenger from the passenger state determination section 32 of the passenger monitoring device 3 .
  • the control unit acquires the face of the passenger based on the captured image, and the acquired face image and the passenger By performing matching with authentication information, it is possible to acquire information that can identify the passenger.
  • the previously set angle is represented, for example, by an angle relative to the initial value of the angle of the display device 2 .
  • the angle setting unit 14 compares information that can identify the occupant, for example, based on the occupant information and the set angle information output from the occupant identification unit 13 . In addition, the angle setting unit 14 matches the facial images of the occupants based on the occupant information and the set angle information, for example. The angle setting unit 14 sets the angle of the display device 2 corresponding to the occupant based on the information indicating the previously set angle associated with the occupant's face image or the information that can identify the occupant in the associated set angle information. do. Then, the angle setting unit 14 outputs to the display device 2 angle control information for controlling the angle of the display device 2 so as to achieve the set angle of the display device 2 corresponding to the occupant. The display device 2 changes the angle according to the angle control information.
  • the passenger authentication information and the set angle information are generated for a plurality of passengers. For example, when there are a plurality of occupants in the vehicle interior and the occupant identification unit 13 does not receive information that can identify the occupant from the occupants, the occupant identification unit 13 gives priority to the occupant of which seat among the plurality of occupants. can be specified or set as appropriate.
  • the angle setting unit 14 changes the angle of the display device 2 to an angle corresponding to the occupant identified with priority by the occupant identification unit 13 .
  • FIG. 14 is a flow chart for explaining the operation of the adjusting device 1a according to the second embodiment.
  • the adjusting device 1a performs the following operations explained using the flowchart of FIG. 14 in addition to the operations explained using the flowchart shown in FIG. 9 in the first embodiment.
  • the occupant identification unit 13 identifies the occupant in the vehicle (step ST13).
  • the occupant identification unit 13 outputs occupant information regarding the identified occupant to the angle setting unit 14 .
  • the angle setting unit 14 sets the angle of the display device 2 to the angle corresponding to the occupant specified by the occupant specifying unit 13 based on the occupant information output from the occupant specifying unit 13 in step ST13 and the set angle information. (Step ST14).
  • the adjustment device 1a can set the angle of the display device 2 to the angle set in the past by the passenger. Thereby, the adjusting device 1 a can improve the convenience of the display device 2 .
  • the flow chart of FIG. 14 is performed, and then the operation described with the flow chart of FIG. 9 is performed until the engine of the vehicle is turned off. .
  • the search area may include the face search area and the occupant search area.
  • the adjusting device 1a may be mounted on the occupant monitoring device 3.
  • FIG. Moreover, the adjustment device 1 a may be mounted on the display device 2 .
  • the occupant monitoring device 3 may be mounted on the display device 2 .
  • the adjusting device 1a, the display device 2, and the occupant monitoring device 3 may be integrated as one device.
  • the adjustment device 1a and the occupant monitoring device 3 are in-vehicle devices mounted on a vehicle, and the angle change detection unit 11, the search area adjustment unit 12, the occupant identification unit 13, and the angle setting unit 14 , the captured image acquisition unit 31 and the occupant state determination unit 32 are assumed to be provided in the in-vehicle device.
  • the adjustment system may be configured by the in-vehicle apparatus and the server, which is installed in the in-vehicle apparatus and the others are installed in the server connected to the in-vehicle apparatus via a network.
  • the hardware configuration of the adjusting device 1a according to the second embodiment is the same as the hardware configuration of the adjusting device 1 described with reference to FIGS. 12A and 12B in the first embodiment, so illustration thereof is omitted.
  • the processing circuit 1201 implements the functions of the angle change detection unit 11 , the search area adjustment unit 12 , the occupant identification unit 13 , and the angle setting unit 14 . That is, when the adjustment device 1a detects that the angle of the display device 2 has been changed, the adjustment device 1a moves the search area on the captured image, and controls the angle of the display device 2 to an angle according to the occupant.
  • a processing circuit 1201 is provided.
  • the processing circuit 1201 reads and executes programs stored in the memory 1205 to perform the functions of the angle change detection unit 11, the search area adjustment unit 12, the occupant identification unit 13, and the angle setting unit . That is, the adjustment device 1a, when executed by the processing circuit 1201, produces a program that results in execution of steps ST1 to ST2 in FIG. 4 and steps ST13 to ST14 in FIG.
  • a memory 1205 is provided for storing. It can also be said that the program stored in the memory 1205 causes a computer to execute the procedures or methods of the angle change detection unit 11, the search area adjustment unit 12, the occupant identification unit 13, and the angle setting unit 14.
  • the adjustment device 1a includes a device such as the display device 2 or the occupant monitoring device 3, and an input interface device 1202 and an output interface device 1203 that perform wired or wireless communication.
  • the adjusting device 1a according to the second embodiment has the same configuration as that of the adjusting device 1 according to the first embodiment.
  • the angle of the display device 2 is determined by the occupant identification unit based on the information about the occupant identified by the occupant identification unit and the set angle information in which the occupant information that can identify the occupant is associated with the angle of the display device 2 set in the past by the occupant It is configured to have an angle setting unit 14 that sets an angle corresponding to the occupant identified by 13 . Therefore, the adjustment device 1a can detect the occupant in the area assumed to include the occupant in the vehicle interior on the captured image captured by the imaging device whose imaging direction changes according to the angle of the display device whose angle is variable. The angle of the display device 2 according to the occupant can be reproduced while being able to reduce the disappearance.
  • the adjustment device may have a function of preventing deterioration of visibility due to reflection of sunlight on the display device.
  • FIG. 15 is a diagram showing a configuration example of the adjusting device 1b according to the third embodiment.
  • the same reference numerals are assigned to the same configurations as those of the adjusting device 1 described in the first embodiment with reference to FIG. 1, and redundant descriptions are omitted.
  • the adjustment device 1b according to Embodiment 3 differs from the adjustment device 1 according to Embodiment 1 described with reference to FIG.
  • the adjusting device 1b, the display device 2, and the occupant monitoring device 3 constitute an adjusting system 100b.
  • the specific configurations of the display device 2 and the occupant monitoring device 3 are the same as the specific configurations of the display device 2 and the occupant monitoring device 3, respectively, described using FIG. 1 in the first embodiment.
  • the same reference numerals are assigned to the respective components, and redundant descriptions are omitted.
  • the incident direction determination unit 15 determines the incident direction of sunlight to the display device 2 when the sunlight is reflected on the display device 2 . Specifically, first, the incident direction determination unit 15 determines whether or not the sunlight is reflected on the display device 2 . For example, the incident direction determination unit 15 acquires a captured image from the imaging device 21 and determines whether sunlight is reflected on the display device 2 based on the luminance value of each pixel of the captured image. For example, when the brightness value of each pixel of the captured image is greater than a predetermined threshold value (hereinafter referred to as “brightness determination threshold value”), the incident direction determination unit 15 determines that the portion of the pixel reflects sunlight.
  • a predetermined threshold value hereinafter referred to as “brightness determination threshold value”
  • the incident direction determining unit 15 determines whether the sunlight is determine the direction of incidence of For example, in advance, what is the angle of the display device 2 and what direction the sunlight is incident on, and what range of areas on the captured image corresponds to the brightness value of the pixel. It is assumed that information (hereinafter referred to as "incident direction determination information") associated with the above is generated and stored.
  • the incident direction determination unit 15 determines the incident direction of the sunlight based on the area in which the luminance value of the pixel is equal to or higher than the threshold value for luminance determination, the angle of the display device 2, and the information for determining the incident direction. judge.
  • the incident direction determining unit 15 outputs information indicating that the sunlight is reflected on the display device 2 and information regarding the incident direction of the sunlight to the angle changing unit 16 .
  • the angle changing unit 16 changes the angle of the display device 2 based on the incident direction of the sunlight determined by the incident direction determining unit 15. change. Specifically, the angle changer 16 changes the angle of the display device 2 in a direction in which sunlight is less likely to enter the display device 2 . At this time, for example, when the angle of the display device 2 is the angle after the angle of the display device 2 is changed, the angle changing unit 16 changes the angle of the display device 2 from the initial position of the display device 2 to the The angle of the display device 2 is changed within the range up to the angle at which the angle of the display device 2 can be changed with respect to the direction in which the angle of is changed.
  • the angle changer 16 changes the angle of the display device 2 from the initial position of the display device 2 to the angle at which the display device 2 can be changed toward the driver's seat.
  • the angle of the display device 2 is changed in a direction in which light is less likely to enter.
  • FIG. 16 is a flow chart for explaining the operation of the adjusting device 1b according to the third embodiment.
  • the adjusting device 1b performs the following operations explained using the flowchart of FIG. 16 in addition to the operations explained using the flowchart shown in FIG. 9 in the first embodiment.
  • the incident direction determination unit 15 determines the incident direction of the sunlight to the display device 2 when the sunlight is reflected on the display device 2 (step ST113).
  • the incident direction determining unit 15 outputs information indicating that the sunlight is reflected on the display device 2 and information regarding the incident direction of the sunlight to the angle changing unit 16 .
  • the angle changing unit 16 changes the angle of the display device 2 based on the incident direction of sunlight determined by the incident direction determining unit 15 (step ST114).
  • the adjusting device 1b changes the angle of the display device 2 based on the incident direction of the sunlight when the sunlight is reflected on the display device 2. Therefore, the display device 2 can prevent deterioration in visibility due to reflection of sunlight on the display device 2 .
  • the search area may include the face search area and the occupant search area.
  • the adjusting device 1b may be mounted on the occupant monitoring device 3.
  • the adjustment device 1b may be mounted on the display device 2 .
  • the occupant monitoring device 3 may be mounted on the display device 2 .
  • the adjusting device 1b, the display device 2, and the occupant monitoring device 3 may be integrated as one device.
  • the adjustment device 1b and the occupant monitoring device 3 are in-vehicle devices mounted on a vehicle, and the angle change detection unit 11, the search area adjustment unit 12, the incident direction determination unit 15, and the angle change unit 16, the captured image acquisition unit 31, and the occupant state determination unit 32 are assumed to be provided in the in-vehicle device.
  • the angle change detection unit 11, the search area adjustment unit 12, the incident direction determination unit 15, the angle change unit 16, the captured image acquisition unit 31, and the occupant state determination unit 32 a part or all of the vehicle , and the others may be installed in a server connected to the in-vehicle device via a network, and the in-vehicle device and the server may constitute an adjustment system.
  • the hardware configuration of the adjusting device 1b according to the third embodiment is the same as the hardware configuration of the adjusting device 1 described with reference to FIGS. 12A and 12B in the first embodiment, so the illustration is omitted.
  • the processing circuit 1201 implements the functions of the angle change detection unit 11 , the search area adjustment unit 12 , the incident direction determination unit 15 , and the angle change unit 16 . That is, when the adjustment device 1b detects that the angle of the display device 2 has been changed, the adjustment device 1b moves the search area on the captured image and controls the angle of the display device 2 to be changed based on the incident direction of the sunlight.
  • a processing circuit 1201 is provided for performing.
  • the processing circuit 1201 reads out and executes programs stored in the memory 1205 to perform the functions of the angle change detection unit 11, the search area adjustment unit 12, the incident direction determination unit 15, and the angle change unit 16. . That is, the adjustment device 1b, when executed by the processing circuit 1201, executes a program that results in the execution of steps ST1 to ST2 in FIG. 4 and steps ST113 to ST114 in FIG. A memory 1205 is provided for storing. It can also be said that the program stored in the memory 1205 causes a computer to execute the procedures or methods of the angle change detection unit 11, the search area adjustment unit 12, the incident direction determination unit 15, and the angle change unit 16. .
  • the adjustment device 1b includes a device such as the display device 2 or the occupant monitoring device 3, and an input interface device 1202 and an output interface device 1203 that perform wired or wireless communication.
  • the adjustment device 1b according to Embodiment 3 has the same configuration as that of the adjustment device 1 according to Embodiment 1.
  • the adjustment device has a function of notifying the occupant when the occupant is out of the imaging range of the imaging device due to the change in the angle of the display device. You may do so.
  • FIG. 17 is a diagram showing a configuration example of an adjustment device 1c according to the fourth embodiment.
  • the same reference numerals are assigned to the same configurations as those of the adjusting device 1 described in the first embodiment with reference to FIG. 1, and redundant descriptions are omitted.
  • An adjustment device 1c according to Embodiment 4 differs from adjustment device 1 according to Embodiment 1 described with reference to FIG.
  • the adjusting device 1c, the display device 2, and the occupant monitoring device 3 constitute an adjusting system 100c.
  • the specific configurations of the display device 2 and the occupant monitoring device 3 are the same as the specific configurations of the display device 2 and the occupant monitoring device 3, respectively, described using FIG. 1 in the first embodiment.
  • the same reference numerals are assigned to the respective components, and redundant descriptions are omitted.
  • the imaging availability determination unit 17 determines that the imaging range of the imaging device 21 cannot detect the occupant when the angle of the display device 2 has been changed. Determine whether or not the range is reached.
  • the imaging availability determination unit 17 may acquire the angle change information from the angle change detection unit 11 via the search area adjustment unit 12 . This is merely an example, and the image capturing availability determination unit 17 may directly acquire the angle change information from the angle change detection unit 11 . Note that in FIG. 17 , illustration of an arrow from the angle change detection unit 11 to the imaging availability determination unit 17 is omitted.
  • an angle change amount indicating how much the angle of the display device 2 has been changed and information indicating whether or not the occupant in the vehicle cabin is no longer included in the imaging range of the imaging device 21 in that case are stored in advance.
  • Associated information (hereinafter referred to as "detection failure determination information") is created and stored in the storage unit.
  • the non-detection determination information may be further associated with information indicating which seat occupant is not included in the imaging range of the imaging device 21 when the occupant is not included in the imaging range.
  • the imaging availability determination unit 17 determines whether or not the imaging range of the imaging device 21 has reached a range in which the passenger cannot be detected.
  • the driver 402 greatly changes the angle of the display device 2 so that the display device 2 faces the driver's seat.
  • the function for the front passenger seat 403a such as personal authentication or doze detection is unnecessary, or when only the driver 402 exists in the vehicle interior and the function of detecting other passengers is unnecessary.
  • the angle of the display device 2 is greatly changed by the driver 402 .
  • the imaging range of the imaging device 21 may not include the occupant 403 in the passenger seat 403a. That is, the imaging range of the imaging device 21 may become a range in which the occupant 403 on the front passenger seat 403a cannot be detected.
  • the image capture availability determination unit 17 determines that the image capturing range of the image capturing device 21 has become a range in which the passenger cannot be detected in a state where the angle of the display device 2 has been changed.
  • the imaging availability determination unit 17 determines that the imaging range of the imaging device 21 is a range in which the occupant cannot be detected. Information to the effect that it has become is output to the notification unit 18 .
  • the imaging availability determination unit 17 outputs to the notification unit 18 information indicating that the imaging range of the imaging device 21 has become a range in which the occupant cannot be detected, and information indicating in which seat the occupant has become undetectable. good too.
  • the notification unit 18 detects that the imaging range of the imaging device 21 detects the passenger from the imaging availability determination unit 17.
  • the imaging device 21 notifies that the occupant cannot be imaged.
  • the notification unit 18 causes the display device 2 to display an icon that notifies that the imaging range of the imaging device 21 has become a range in which the passenger cannot be detected.
  • the notification unit 18 may display the icon on a display device other than the display device 2 .
  • a display device other than the display device 2 is, for example, a meter panel provided in front of the driver's seat 402a or a sub-monitor provided in the navigation device.
  • the notification unit 18 causes an audio output device (not shown) mounted on the vehicle to output the fact that the imaging range of the imaging device 21 has become a range in which the passenger cannot be detected by sound or voice. good too.
  • the imaging range of the imaging device 21 does not become a range in which the occupant cannot be detected, such as the imaging device 21 being able to detect both the driver's seat and the passenger's seat.
  • a method of widening the angle of view of the image capturing device 21 or mounting two image capturing devices 21 on the display device 2 may be considered.
  • these methods have problems such as the need to increase the number of pixels of the image sensor (not shown) provided in the imaging device 21 or the complicated structure of the display device 2 .
  • FIG. 18 is a flow chart for explaining the operation of the adjusting device 1c according to the fourth embodiment.
  • the specific operations of steps ST1111 and ST1112 are the same as the specific operations of steps ST1 and ST2 of FIG. omitted.
  • step ST1111 when the angle change detection unit 11 detects that the angle of the display device 2 has been changed, the imaging availability determination unit 17 determines the imaging range of the imaging device 21 in a state in which the angle of the display device 2 has been changed. is within the range where the passenger cannot be detected (step ST1113).
  • the imaging range of the imaging device 21 is determined to be a range in which the occupant cannot be detected in a state where the angle of the display device 2 is changed
  • the imaging availability determination unit 17 determines that the imaging range of the imaging device 21 is a range in which the occupant cannot be detected. Information to the effect that it has become is output to the notification unit 18 .
  • the notification unit 18 detects that the imaging range of the imaging device 21 detects the passenger from the imaging availability determination unit 17.
  • the imaging device 21 notifies that the passenger cannot be imaged (step ST1114).
  • the adjustment device 1c determines that the imaging range of the imaging device 21 has become a range in which the occupant cannot be detected while the angle of the display device 2 has been changed, the adjustment device 1c notifies that effect. Therefore, the adjustment device 1c can inform the passenger that the change in the angle of the display device 2 has made it impossible for the passenger to be detected.
  • the operation of the adjustment device 1c is performed in the order of steps ST1112 to ST1114, but this is only an example.
  • the operation of step ST1112 and the operation of steps ST1113 to ST1114 may be performed in parallel.
  • the search area may include the face search area and the occupant search area.
  • the adjusting device 1c may be mounted on the occupant monitoring device 3.
  • the adjustment device 1c may be mounted on the display device 2 .
  • the occupant monitoring device 3 may be mounted on the display device 2 .
  • the adjusting device 1c, the display device 2, and the occupant monitoring device 3 may be integrated as one device.
  • the adjusting device 1c and the occupant monitoring device 3 are in-vehicle devices mounted in a vehicle, and the angle change detection unit 11, the search area adjustment unit 12, the imaging availability determination unit 17, and the notification unit 18 , the captured image acquisition unit 31 and the occupant state determination unit 32 are assumed to be provided in the in-vehicle device.
  • the adjustment system may be configured by the in-vehicle apparatus and the server, which is installed in the in-vehicle apparatus and the others are installed in the server connected to the in-vehicle apparatus via a network.
  • the hardware configuration of the adjustment device 1c according to Embodiment 4 is the same as the hardware configuration of the adjustment device 1 described with reference to FIGS. 12A and 12B in Embodiment 1, so the illustration is omitted.
  • the processing circuit 1201 implements the functions of the angle change detection unit 11 , the search area adjustment unit 12 , the imaging availability determination unit 17 , and the notification unit 18 . That is, when the adjusting device 1b detects that the angle of the display device 2 has been changed, the adjustment device 1b moves the search area on the captured image, and also changes the imaging range of the imaging device 21 by changing the angle of the display device 2.
  • a processing circuit 1201 is provided for performing control for notifying that when the occupant cannot be detected.
  • the processing circuit 1201 reads and executes programs stored in the memory 1205 to perform the functions of the angle change detection unit 11 , the search area adjustment unit 12 , the imaging availability determination unit 17 , and the notification unit 18 .
  • adjustment device 1c includes memory 1205 for storing a program that, when executed by processing circuit 1201, results in execution of steps ST1111 to ST1114 in FIG. 18 described above. It can also be said that the program stored in the memory 1205 causes a computer to execute the procedures or methods of the angle change detection unit 11, the search area adjustment unit 12, the imaging availability determination unit 17, and the notification unit .
  • the adjustment device 1c includes a device such as the display device 2 or the occupant monitoring device 3, and an input interface device 1202 and an output interface device 1203 that perform wired or wireless communication.
  • the adjusting device 1c according to the fourth embodiment has the same configuration as the adjusting device 1 according to the first embodiment, and the angle change detection unit 11 detects that the angle of the display device 2 has been changed.
  • the imaging availability determination unit 17 determines whether or not the imaging range of the imaging device 21 becomes a range in which the occupant cannot be detected in a state where the angle of the display device 2 is changed, and the imaging availability determination unit 17 performs the imaging device.
  • the imaging device 21 is configured to include a notification unit 18 that notifies that the occupant cannot be imaged.
  • the adjustment device 1c can detect the occupant in the area assumed to include the occupant in the vehicle interior on the captured image captured by the imaging device whose imaging direction changes according to the angle of the display device whose angle is variable. In addition, it is possible to notify the occupant that the occupant cannot be detected due to the change in the angle of the display device 2 .
  • the adjustment device detects an occupant in an area assumed to include an occupant inside the vehicle on an image captured by an imaging device whose imaging direction changes according to the angle of a display device with a variable angle. It is possible to reduce the number of

Abstract

La présente invention comprend : une unité de détection de changement d'angle (11) pour détecter un changement de l'angle d'un dispositif d'affichage à angle variable (2) sur lequel est monté un dispositif d'imagerie (21), dans lequel une direction d'imagerie est modifiée conjointement avec l'angle du dispositif d'affichage (2) ; et une unité de réglage de région de recherche (12) qui, lorsque l'unité de détection de changement d'angle (11) a détecté un changement de l'angle du dispositif d'affichage (2), déplace une région de recherche sur la base d'une grandeur de changement de l'angle du dispositif d'affichage (2).
PCT/JP2021/005785 2021-02-17 2021-02-17 Dispositif de réglage, système de réglage, dispositif d'affichage, dispositif de surveillance de passager et procédé de réglage WO2022176037A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2023500164A JP7258262B2 (ja) 2021-02-17 2021-02-17 調整装置、調整システム、表示装置、乗員監視装置、および、調整方法
PCT/JP2021/005785 WO2022176037A1 (fr) 2021-02-17 2021-02-17 Dispositif de réglage, système de réglage, dispositif d'affichage, dispositif de surveillance de passager et procédé de réglage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/005785 WO2022176037A1 (fr) 2021-02-17 2021-02-17 Dispositif de réglage, système de réglage, dispositif d'affichage, dispositif de surveillance de passager et procédé de réglage

Publications (1)

Publication Number Publication Date
WO2022176037A1 true WO2022176037A1 (fr) 2022-08-25

Family

ID=82931246

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/005785 WO2022176037A1 (fr) 2021-02-17 2021-02-17 Dispositif de réglage, système de réglage, dispositif d'affichage, dispositif de surveillance de passager et procédé de réglage

Country Status (2)

Country Link
JP (1) JP7258262B2 (fr)
WO (1) WO2022176037A1 (fr)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005132341A (ja) * 2003-07-24 2005-05-26 Delphi Technologies Inc 車両システムにアクセスするための方法及び装置
JP2008117334A (ja) * 2006-11-08 2008-05-22 Toyota Motor Corp 車両用表示装置
JP2008249648A (ja) * 2007-03-30 2008-10-16 Aisin Aw Co Ltd 車載機器の誤操作防止装置および誤操作防止方法
JP2009113621A (ja) * 2007-11-06 2009-05-28 Toyota Motor Corp 乗員画像撮像装置、運転支援装置
JP2010013090A (ja) * 2008-07-04 2010-01-21 Hyundai Motor Co Ltd 運転者状態監視システム
JP2011502885A (ja) * 2007-11-13 2011-01-27 ティーケー ホールディングス インコーポレーテッド 車両通信システムおよび方法
JP2017033320A (ja) * 2015-08-01 2017-02-09 Ntn株式会社 電気自動車の調整装置

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019172200A (ja) 2018-03-29 2019-10-10 トヨタ自動車株式会社 車載表示装置防眩システム
JP2021160681A (ja) 2020-04-03 2021-10-11 株式会社デンソー 車両用表示装置

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005132341A (ja) * 2003-07-24 2005-05-26 Delphi Technologies Inc 車両システムにアクセスするための方法及び装置
JP2008117334A (ja) * 2006-11-08 2008-05-22 Toyota Motor Corp 車両用表示装置
JP2008249648A (ja) * 2007-03-30 2008-10-16 Aisin Aw Co Ltd 車載機器の誤操作防止装置および誤操作防止方法
JP2009113621A (ja) * 2007-11-06 2009-05-28 Toyota Motor Corp 乗員画像撮像装置、運転支援装置
JP2011502885A (ja) * 2007-11-13 2011-01-27 ティーケー ホールディングス インコーポレーテッド 車両通信システムおよび方法
JP2010013090A (ja) * 2008-07-04 2010-01-21 Hyundai Motor Co Ltd 運転者状態監視システム
JP2017033320A (ja) * 2015-08-01 2017-02-09 Ntn株式会社 電気自動車の調整装置

Also Published As

Publication number Publication date
JP7258262B2 (ja) 2023-04-14
JPWO2022176037A1 (fr) 2022-08-25

Similar Documents

Publication Publication Date Title
US11508165B2 (en) Digital mirror systems for vehicles and methods of operating the same
US10843628B2 (en) Onboard display device, control method for onboard display device, and control program for onboard display device
US7370970B2 (en) Eyeglass detection method
JP5093611B2 (ja) 車両周辺確認装置
JP6960995B2 (ja) 状態判定装置および状態判定方法
WO2017159510A1 (fr) Dispositif d'aide au stationnement, caméras embarquées, véhicule et procédé d'aide au stationnement
US11582425B2 (en) Driver monitoring system using camera with adjustable mirror
US20110122520A1 (en) Vehicle mirror adjustment method and system
US10306154B2 (en) Image display device
US11034305B2 (en) Image processing device, image display system, and image processing method
JP2020157938A (ja) 車載監視制御装置
JP2008120142A (ja) 自動車用情報表示システム
JP7258262B2 (ja) 調整装置、調整システム、表示装置、乗員監視装置、および、調整方法
WO2021245730A1 (fr) Dispositif de commande d'imagerie embarqué, système de commande d'imagerie embarqué, et procédé de commande d'imagerie
JP2006253787A (ja) 画像入力装置及びこの装置を備えた車両の乗員監視装置
JP6594595B2 (ja) 運転不能状態判定装置および運転不能状態判定方法
JP2023030736A (ja) カメラ制御装置、カメラ制御プログラム、および、ドライバモニタリングシステム
JP4999748B2 (ja) サイドミラー装置
WO2021199157A1 (fr) Dispositif de détermination d'état d'occupant et procédé de détermination d'état d'occupant
JP7003332B2 (ja) 運転者監視装置及び運転者監視方法
JP2022143854A (ja) 乗員状態判定装置および乗員状態判定方法
US20230060049A1 (en) Face detection device
WO2021240668A1 (fr) Dispositif de détection de geste et procédé de détection de geste
JP7204941B2 (ja) 乗員監視装置、乗員監視システム、及び乗員監視方法
KR102497614B1 (ko) 적응형 범용 감시 시스템 및 그 구동방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21926477

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2023500164

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21926477

Country of ref document: EP

Kind code of ref document: A1