WO2023058145A1 - 乗員検知装置および撮像装置 - Google Patents

乗員検知装置および撮像装置 Download PDF

Info

Publication number
WO2023058145A1
WO2023058145A1 PCT/JP2021/036939 JP2021036939W WO2023058145A1 WO 2023058145 A1 WO2023058145 A1 WO 2023058145A1 JP 2021036939 W JP2021036939 W JP 2021036939W WO 2023058145 A1 WO2023058145 A1 WO 2023058145A1
Authority
WO
WIPO (PCT)
Prior art keywords
display unit
imaging unit
vehicle
detection device
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/036939
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
雄城 煤孫
太郎 熊谷
東錫 朴
敬 春日
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Corp
Original Assignee
Mitsubishi Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Corp filed Critical Mitsubishi Electric Corp
Priority to US18/682,851 priority Critical patent/US20240351544A1/en
Priority to JP2023552468A priority patent/JP7630057B2/ja
Priority to PCT/JP2021/036939 priority patent/WO2023058145A1/ja
Publication of WO2023058145A1 publication Critical patent/WO2023058145A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • B60R21/01—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
    • B60R21/015—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
    • B60R21/01512—Passenger detection systems
    • B60R21/0153—Passenger detection systems using field detection presence sensors
    • B60R21/01538—Passenger detection systems using field detection presence sensors for image processing, e.g. cameras or sensor arrays
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/02—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
    • B60R11/0229—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof for displays, e.g. cathodic tubes
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/04—Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R2011/0001—Arrangements for holding or mounting articles, not otherwise provided for characterised by position
    • B60R2011/0003—Arrangements for holding or mounting articles, not otherwise provided for characterised by position inside the vehicle
    • B60R2011/0005—Dashboard

Definitions

  • the present disclosure relates to an occupant detection device and an imaging device for detecting the state of an occupant in a vehicle.
  • the imaging device be provided at a position capable of capturing an image of the occupant in the vehicle with high accuracy, in other words, at a position capable of capturing an image of at least the face of the occupant in the vehicle.
  • a display device is provided at a position that is preferable as an installation position of the imaging device as described above so that the passenger can easily view it. Therefore, there is known a technique of installing an imaging device in a position adjacent to a display device in a vehicle.
  • a camera is provided on the instrument panel outside the display provided on the instrument panel and adjacent to the rear of the display in the front-rear direction of the vehicle, and the camera captures an image of the driver.
  • An occupant imaging device is disclosed.
  • the display device and the imaging device have separate structures. It is provided in a component of a vehicle such as an instrument panel. That is, in the conventional technology, there is a problem that it is necessary to secure a space for installing the display device and a space for installing the imaging device in the vehicle.
  • An object of the present invention is to provide an occupant detection device which is provided at a preferable installation position.
  • An occupant detection device includes a display unit mounted on a vehicle and provided inside the vehicle, and an imaging unit detachably attached to the display unit and capturing an image of at least a range in which the face of an occupant should exist inside the vehicle. is provided.
  • the imaging device in a vehicle, can be installed at a preferable installation position without requiring a space for installing the display device and a space for installing the imaging device.
  • FIG. 2 is a diagram for explaining an installation example of the occupant detection device according to Embodiment 1 in a vehicle; 1 is a diagram for explaining an outline of an occupant detection device according to Embodiment 1; FIG. 4A and 4B are diagrams for explaining an example of attachment of imaging units having different specifications to a display unit in the occupant detection device according to Embodiment 1; FIG. 4A and 4B are diagrams for explaining an example of the display area of the imaging unit and notification information displayed in the display area in the occupant detection device according to Embodiment 1.
  • FIG. FIG. 5A is a diagram for explaining an example of an occupant detection device equipped with a frame according to Embodiment 1, and FIG.
  • FIG. 5A is a perspective view of the occupant detection device mounted on a vehicle as seen from the front side;
  • FIG. 5B is a perspective view of the occupant detection device mounted on the vehicle, viewed from the rear side.
  • FIG. 6A is a diagram for explaining an example of attaching an imaging unit to a display unit in the occupant detection device according to Embodiment 1
  • FIG. 6A is a diagram illustrating an example in which the imaging unit is attached from the upper surface side of the display unit
  • 6B is a diagram showing an example in which the imaging unit is attached from the right side of the display unit
  • FIG. 6C is a diagram showing an example in which the imaging unit is attached from the left side of the display unit
  • FIG. It is a figure which shows the example which an imaging part is attached from the bottom face side of a display part.
  • Embodiment 1 The occupant detection device according to Embodiment 1 is mounted on a vehicle and used to monitor the condition of occupants in a so-called "Driver Monitoring System (DMS)".
  • the occupants whose status is monitored by the driver monitoring system (hereinafter referred to as “monitored occupants") are the driver in the driver's seat, the occupant in the front passenger seat (hereinafter referred to as the “passenger seat occupant”), or the rear seat occupant. (hereinafter referred to as “rear seat occupants”).
  • FIG. 1 is a diagram for explaining an installation example of an occupant detection device 1 according to Embodiment 1 in a vehicle.
  • FIG. 2 is a diagram for explaining the outline of the occupant detection device 1 according to the first embodiment.
  • FIG. 1 is an overall front view of an instrument panel (hereinafter referred to as “instrument panel”) 3 as seen from inside a vehicle 100.
  • instrument panel hereinafter referred to as “instrument panel”
  • FIG. 1 is a right-hand drive vehicle, this is merely an example. Vehicle 100 may be a left-hand drive vehicle.
  • illustration of the outline of the occupant detection device 1 is omitted. An outline of the occupant detection device 1 will be described later with reference to FIG.
  • an instrument panel 3 extending in the vehicle width direction is provided in the front part of the passenger compartment below a windshield (not shown).
  • the occupant detection device 1 is provided at the central portion of the instrument panel 3 in the vehicle width direction.
  • the center in the vehicle width direction does not have to be strictly the center, but includes the approximate center.
  • the occupant detection device 1 is erected, for example, at the central portion of the instrument panel 3 in the vehicle width direction.
  • the display unit 20 (see FIG. 2) is at a position that is easily visible to both the driver and the front passenger
  • the imaging unit 10 is at a position where it is easy to capture images of both the driver's face and the front passenger's face. Because there is
  • the occupant detection device 1 includes an imaging section 10 and a display section 20 .
  • the imaging unit 10 alone functions as an imaging device.
  • the display unit 20 alone functions as a display device.
  • a portion indicated by C in FIG. 2 will be described later.
  • FIG. 2 is a front view of the occupant detection device 1.
  • FIG. 2 shows the front surfaces of the imaging unit 10 and the display unit 20 .
  • the imaging unit 10 has a front surface, a rear surface, a top surface, a bottom surface, a right side surface, and a left side surface.
  • the front surface of the imaging unit 10 is one surface on which the face of the passenger should be present when the imaging unit 10 is installed in the vehicle 100 .
  • the back surface of the imaging unit 10 is the surface facing the front surface of the imaging unit 10, that is, the surface opposite to the side where the face of the occupant should be present when the imaging unit 10 is installed in the vehicle 100.
  • the upper surface of the imaging unit 10 is the upper surface when the imaging unit 10 is installed in the vehicle 100 .
  • the bottom surface of the imaging unit 10 is the surface facing the top surface of the imaging unit 10 , that is, the bottom surface when the imaging unit 10 is installed in the vehicle 100 .
  • the right side surface of the imaging unit 10 is the right side surface of the imaging unit 10 when the imaging unit 10 is installed in the vehicle 100 and viewed from the vehicle interior.
  • the left side surface of the imaging unit 10 is the left side surface of the imaging unit 10 when the imaging unit 10 is installed in the vehicle 100 and viewed from the vehicle interior.
  • the display unit 20 has a front surface, a rear surface, a top surface, a bottom surface, a right side surface, and a left side surface.
  • the front surface of the display unit 20 is one surface on which the face of the passenger should be present when the display unit 20 is provided in the vehicle 100 .
  • the back surface of the display unit 20 is the surface facing the front surface of the display unit 20, that is, the surface opposite to the side where the face of the occupant should be present when the display unit 20 is installed in the vehicle 100.
  • the upper surface of the display unit 20 is the upper surface when the display unit 20 is provided on the vehicle 100 .
  • the bottom surface of the display unit 20 is the surface facing the top surface of the display unit 20 , that is, the bottom surface when the display unit 20 is provided on the vehicle 100 .
  • the right side surface of the display unit 20 is the right side surface of the display unit 20 when the display unit 20 is installed in the vehicle 100 and viewed from the vehicle interior.
  • the left side surface of the display unit 20 is the left side surface of the display unit 20 when the display unit 20 is installed in the vehicle 100 and viewed from the vehicle interior.
  • the image capturing unit 10 captures an image of a range within the vehicle 100 where the face of the passenger should be present. More specifically, the imaging unit 10 has a camera lens 11 and an illumination unit 12 .
  • the illumination unit 12 irradiates a subject, in other words, a passenger, with light and images the object through the camera lens 11 .
  • the lighting unit 12 is configured by, for example, an LED (Light Emitting Diode).
  • the illumination unit 12 is provided to illuminate the interior of the vehicle 100 in which the imaging unit 10 is provided.
  • a captured image captured by the imaging unit 10 is output to a control unit (not shown).
  • the control unit is provided in, for example, the imaging unit 10 and detects the state of the occupant captured in the captured image based on the captured image captured by the imaging unit 10 . Specifically, the control unit detects whether or not the passenger is looking aside or whether or not the passenger is dozing off. Note that the control unit may detect the state of the occupant by detecting the state of the occupant's face, such as the orientation of the face, the line of sight, or the degree of opening and closing of the eyes, using a known image recognition technique. Note that the control unit is not limited to being provided in the imaging unit 10 . For example, the control unit may be provided in the display unit 20, or may be provided in a server (not shown) provided in the driver monitoring system.
  • the display unit 20 has, for example, a touch panel type display in which a touch screen is provided on the front surface of a flat display such as a liquid crystal display or an organic EL display.
  • the display unit 20 displays various information. For example, the display unit 20 displays information based on the state of the occupant detected by the control unit. Information based on the occupant's state is, for example, a message warning that the occupant is looking aside or a message warning that the occupant is dozing off. Moreover, the display unit 20 may display various information such as map information, route information, or audio information.
  • the display unit 20 may be shared with, for example, a car navigation device (not shown).
  • the occupant detection device 1 is erected at the central portion of the instrument panel 3 in the vehicle width direction, but this is only an example.
  • the occupant detection device 1 may be fitted in an opening formed in the instrument panel 3 at the center in the vehicle width direction and on the surface of the instrument panel 3 on the rear side in the front-rear direction of the vehicle 100 .
  • the location where the occupant detection device 1 is provided in the vehicle 100 is not limited to the central portion of the instrument panel 3 in the vehicle width direction.
  • the occupant detection device 1 may be provided, for example, on a meter panel (not shown).
  • a meter panel not shown.
  • the imaging unit 10 and the display unit 20 can easily capture an image of the driver's face. 20 is located almost in front of the driver, which is easily visible from the driver. That is, the imaging unit 10 and the display unit 20 are provided at preferable positions.
  • the occupant detection device 1 may be provided above a headrest (not shown), such as an overhead console (not shown).
  • the occupants to be detected may include the driver, front passenger, and rear seat occupants.
  • the occupant detection device 1 is provided above the headrest, so that the occupant detection device 1, more specifically, the imaging unit 10 and the display unit 20 can be used by the driver, the passenger in the front passenger seat, and the The face of the rear seat occupant can be easily imaged, and the display unit 20 is positioned at a location where the driver, the front passenger seat passenger, and the rear seat occupant can easily view the image. That is, the imaging unit 10 and the display unit 20 are provided at preferable positions.
  • the occupant detection device 1 may be provided on a dashboard (not shown), for example.
  • the occupants to be detected may be limited to occupants in the front passenger seat.
  • the occupant detection device 1, more specifically, the imaging unit 10 and the display unit 20 are provided on the dashboard, so that the occupant detection device 1, more specifically, the imaging unit 10 and the display unit 20
  • the imaging unit 10 can easily image the face of the passenger in the front passenger seat, and the display unit 20 can be easily seen by the passenger in the front passenger seat, and is positioned almost in front of the passenger in the front passenger seat. That is, the imaging unit 10 and the display unit 20 are provided at preferable positions.
  • the imaging unit 10 is physically separate from the display unit 20 and is detachably attached to the display unit 20 .
  • the occupant detection device 1 shown in FIGS. 1 and 2 is in a state in which the imaging unit 10 is attached to the display unit 20, in other words, the occupant detection device 1 in a state in which the imaging unit 10 and the display unit 20 are connected. is.
  • the occupant detection device 1 has an integrated configuration in which the imaging unit 10 is attached to the display unit 20 .
  • the occupant detection device 1 is mounted on the vehicle 100 with the imaging unit 10 attached to the display unit 20 .
  • the vehicle 100 is mounted with the display unit 20 and the imaging unit 10 , in other words, the occupant detection device 1 is provided in the vehicle 100 .
  • the imaging unit 10 is attached to the display unit 20 provided in the vehicle 100.
  • the detection device 1 may be provided in a vehicle.
  • the occupant detection device 1 solves the problem that the display unit 20 is provided at a position that is preferable as an installation position for the imaging unit 10 by integrating the imaging unit 10 with the display unit 20.
  • the unit 10 and the display unit 20 are provided at positions that are preferable as installation positions for both the imaging unit 10 and the display unit 20 . Since the occupant detection device 1 is mounted on the vehicle 100, it is not necessary to secure a space for installing the display unit 20 and a space for installing the imaging unit 10 in the vehicle 100. . For example, in the case of the occupant detection device 1 shown in FIG.
  • the space for installing the display unit 20 and the space for installing the imaging unit 10 are required. It is possible to solve the problem that it is necessary to secure space and space respectively.
  • the imaging unit 10 and the display unit 20 in the occupant detection device 1 are simply configured as a non-detachable integrated unit, the imaging unit 10 may not be able to capture an optimal captured image for detecting the state of the occupant. The problem arises that there is
  • the display unit 20 is provided at a position assumed to be preferable as an installation position within the vehicle 100, but the position assumed to be preferable varies depending on the specifications of the vehicle 100, for example.
  • the specifications of the vehicle 100 are assumed to be, for example, the vehicle type, the grade of the vehicle 100, or the orientation of the display unit 20 when the display unit 20 is provided in the vehicle 100.
  • FIG. To give a specific example, for example, when the occupants to be detected are a driver and an occupant in the front passenger seat, the optimum position for installing the display unit 20 in the vehicle 100 is usually assumed to be the central portion of the instrument panel 3 in the vehicle width direction. be.
  • the optimal position may be located far closer to the driver's seat side or the passenger's seat side than the central portion due to constraints such as the design of the instrument panel 3 .
  • the imaging unit 10 attached to the display unit 20 installed in the central portion of the instrument panel 3 in the vehicle width direction and the imaging unit 10 attached to the display unit 20 installed on the dashboard have the same imaging range.
  • the captured image captured by any of the imaging units 10 may not capture the driver or the front passenger who is the target passenger. For example, an event may occur in which the face of the occupant to be detected is cut off in the captured image, or the eyes of the occupant to be detected cannot be recognized.
  • the imaging unit 10 configured to be capable of imaging the driver and the front passenger seat occupant from the central portion of the instrument panel 3 in the vehicle width direction when mounted on the vehicle 100. and an occupant detection device 1 integrated with a display unit 20 installed on the instrument panel 3; It is necessary to manufacture the occupant detection device 1 integrated with the display unit 20 mounted on the dashboard. Note that the manufacturer or the like can make the display unit 20 common to each occupant detection device 1 .
  • the detection target occupants may be switched between the driver and the front passenger seat occupant, or limited to the driver.
  • the imaging range required for the imaging unit 10 attached to the display unit 20 differs depending on the grade.
  • the grade of the vehicle 100 is a grade in which the occupants to be detected are the driver and the front passenger seat
  • the preferred positions for the installation positions of the occupant detection device 1, more specifically the imaging unit 10 and the display unit 20 are in the vehicle width direction.
  • the imaging unit 10 is required to include the driver and the front passenger, who are the occupants to be detected, in the imaging range from the central portion.
  • a preferable position as the installation position of the occupant detection device 1 is a position facing the driver, such as a meter panel. It is sufficient if the driver can be included in the imaging range from the position. Therefore, the manufacturer or the like manufactures the occupant detection device 1 in which the display unit 20 and the imaging unit 10 having the required imaging range, in other words, the imaging unit 10 having the required angle of view are integrated according to the grade of the vehicle 100. There is a need. Note that the manufacturer or the like can make the display unit 20 common to each occupant detection device 1 .
  • the display unit 20 has various installation angles within the vehicle 100 , in addition to the assumed preferable installation positions within the vehicle 100 , depending on the specifications of the vehicle 100 .
  • the optimum installation position of the display unit 20 in the vehicle 100 has a height relative to the range in which the face of the occupant should be present. It can be different. In this case, if the orientation of the imaging unit 10 attached to the display unit 20 is uniform regardless of the height of the display unit 20 to which the imaging unit 10 is attached with respect to the range in which the face of the occupant should exist, the imaging unit In the captured image captured by 10, the detection target passenger may not be captured.
  • the manufacturer or the like according to the vehicle type, the display unit 20 and the imaging unit 10 whose optical axis is set in consideration of the height of the display unit 20 with respect to the range where the passenger's face should be present. It is necessary to manufacture the occupant detection device 1 integrated with. The manufacturer or the like also needs to set the irradiation range of the illumination unit 12 in consideration of the installation angle when the display unit 20 is installed in the vehicle 100 . Note that the manufacturer or the like can make the display unit 20 common to each occupant detection device 1 .
  • the optimum installation angle of the display unit 20 may differ depending on the type of vehicle.
  • the manufacturer or the like may choose between the display unit 20 and the imaging unit 10 whose optical axis is set in consideration of the installation angle when the display unit 20 is installed in the vehicle 100 according to the vehicle type. It is necessary to manufacture an integrated occupant detection device 1 .
  • the manufacturer or the like also needs to set the irradiation range of the illumination unit 12 in consideration of the installation angle when the display unit 20 is installed in the vehicle 100 . Note that the manufacturer or the like can make the display unit 20 common to each occupant detection device 1 .
  • the manufacturer or the like may be able to share the display unit 20. Regardless, each occupant detection device 1 must be designed or manufactured in accordance with the specifications of the vehicle 100 so that the imaging unit 10 in the state where the occupant detection device 1 is mounted on the vehicle 100 is the required imaging unit 10 . A problem arises. In other words, the number of types of occupant detection devices 1 including the display unit 20 is increased, and manufacturers and the like require labor and the like to design or manufacture the occupant detection devices 1 .
  • the imaging unit 10 is detachably attached to the display unit 20 as described above. Accordingly, the manufacturer or the like can manufacture the imaging unit 10 according to the specifications of the vehicle 100 and provide the occupant detection device 1 in which the imaging unit 10 is freely combined with the common display unit 20 . Since the display unit 20 can be shared regardless of the specifications of the vehicle 100 , the manufacturer can reduce the labor required for designing or manufacturing the occupant detection device 1 .
  • the imaging unit 10 is attached to the display unit 20 by an appropriate method.
  • the imaging unit 10 and the display unit 20 may be attached by being screwed on the back side of the display unit 20, or may be connected to each other by a plug and a jack.
  • FIG. 3 is a diagram for explaining an example of attachment of the imaging unit 10 having different specifications to the display unit 20 in the occupant detection device 1 according to the first embodiment.
  • the specifications of the imaging unit 10 refer to the imaging range of the imaging unit 10, in other words, the angle of view, the orientation of the optical axis of the imaging unit 10, the presence or absence of a display area, or information to be displayed in the display area. type, etc. The details of the display area that the imaging unit 10 can have will be described later.
  • FIG. 3 illustrates, as an example, attachment of two imaging units 10 (imaging unit 10a or imaging unit 10b) having different angles of view to the display unit 20.
  • the imaging unit 10a has a camera lens 11a and an illumination unit 12a.
  • the illumination unit 12a irradiates a subject with light, and an image is captured through the camera lens 11a.
  • the angle of view of the imaging unit 10a is 60 degrees horizontally.
  • the imaging unit 10a is assumed to be the imaging unit 10 included in the occupant detection device 1, for example, when the occupant to be detected is limited to the driver.
  • the imaging unit 10b has a camera lens 11b and an illumination unit 12b.
  • the illumination unit 12b irradiates a subject with light, and an image is captured through the camera lens 11b.
  • the angle of view of the imaging unit 10b is 120 degrees horizontally.
  • the imaging unit 10b is assumed to be the imaging unit 10 provided in the occupant detection device 1, for example, when the occupants to be detected are the driver and
  • FIG. 3 shows an example in which the imaging units 10 (imaging unit 10a or imaging unit 10b) having different angles of view can be attached to the display unit 20, this is merely an example.
  • the imaging unit 10 with a different optical axis direction can be attached to the display unit 20 .
  • the occupant detection device 1 has an integrated structure in which the imaging unit 10 is attached to the display unit 20 and is detachable from the display unit 20 and is compatible with the specifications of the vehicle 100 in which the display unit 20 is mounted.
  • the front surface of the imaging unit 10 is covered with a panel (hereinafter referred to as "first panel”).
  • the front surface of the display unit 20 is covered with a panel (hereinafter referred to as "second panel”).
  • the first panel and the second panel are made of the same material.
  • the material of the first panel and the second panel is polycarbonate or glass, for example.
  • the first panel and the second panel are made of the same material, so that the occupant detection device 1 can give a sense of unity between the imaging unit 10 and the display unit 20 .
  • the occupant detection device 1 when the imaging unit 10 is attached to the display unit 20, one side of the imaging unit 10 attached to the display unit 20 and one side of the display unit 20 attached to the imaging unit 10 (see C in FIG. 2) is less than or equal to the set distance.
  • the set distance may be, for example, about 1 mm or less, as long as the distance does not impair the sense of unity between the imaging unit 10 and the display unit 20 . Thereby, the occupant detection device 1 can give a sense of unity between the imaging unit 10 and the display unit 20 .
  • the imaging section 10 can have a display area on the front side.
  • Information (hereinafter referred to as “notification information”) for calling the attention of the occupant is displayed in the display area of the imaging unit 10 .
  • 4A and 4B illustrate an example of display areas 101a, 102a, 101b, and 102b of imaging unit 10 and notification information displayed in the display areas in occupant detection device 1 according to Embodiment 1. It is a diagram for
  • the imaging unit 10a shown in FIG. 4A has, for example, a display area 101a for displaying a clock and a display area 102a for displaying a telltale.
  • a seat belt non-fastening sign is displayed as a tell tale.
  • the imaging unit 10a assumes, for example, the imaging unit 10 in a case where the occupant whose state is to be detected using the occupant detection device 1 is limited to the driver. Secondly, it is a telltale that encourages the wearing of seatbelts.
  • the imaging unit 10b shown in FIG. 4B has, for example, a display area 101b that displays a telltale and a display area 102b that displays a clock.
  • a seat belt non-fastening sign is displayed as a tell tale.
  • the imaging unit 10b assumes, for example, the imaging unit 10 when the occupants whose states are to be detected using the occupant detection device 1 are the driver and the passenger in the front passenger seat. This is a tell tale that encourages the driver or front passenger to wear the seat belt.
  • the imaging unit 10a shown in FIG. 4A and the imaging unit 10b shown in FIG. 4B each have two display areas, but this is merely an example.
  • the imaging unit 10 may have one display area, or may have three or more display areas.
  • the content of the notification information displayed in the display area of the imaging unit 10 can be set as appropriate.
  • the control unit may control the display of notification information in the display area of the imaging unit 10 .
  • the imaging unit 10 has a display area, and by enabling notification information to be displayed in the display area, the passenger can be made to recognize necessary display.
  • the imaging unit 10 is attached to the display unit 20, so that the imaging unit 10 is provided at a position facing the detection target occupant, in other words, at a preferable position as the installation position of the imaging unit 10. .
  • the imaging unit 10 is provided at a position where the face of the occupant can be optimally imaged. From the viewpoint of the passenger, it can be said that the imaging unit 10 is provided at a position facing the passenger so that the passenger can easily turn his/her face.
  • the display area is located at a position where it is easy for the passenger to visually recognize the notification information.
  • the occupant detection device 1 can also include a frame that covers the entire periphery of the display unit 20 and the imaging unit 10 in a state where the imaging unit 10 is attached to the display unit 20, for example.
  • the occupant detection device 1 is configured such that, in a state in which the imaging unit 10 is attached to the display unit 20, both side surfaces of the display unit 20 and the imaging unit 10, A frame that covers the bottom surface of the display unit 20 and the top surface of the imaging unit 10 can be provided.
  • the occupant detection device 1 may include a frame that covers the entire peripheries of the display unit 20 and the imaging unit 10 except for the bottom surface when the imaging unit 10 is attached to the display unit 20 .
  • the occupant detection device 1 is configured such that, with the imaging unit 10 attached to the display unit 20, both side surfaces of the display unit 20 and the imaging unit 10 and A frame that covers the upper surface of the imaging unit 10 may be provided.
  • the material of the frame can be any suitable material.
  • the thickness of the frame is thinner than the thickness of the imaging unit 10 and the display unit 20 . As a result, the occupant detection device 1 can make the thickness of the combined imaging unit 10 and display unit 20 appear thin to the occupant or the like.
  • FIG. 5 is a diagram for explaining an example of the occupant detection device 1 to which the frame 4 is attached in the first embodiment.
  • 5A is a perspective view of the occupant detection device 1 seen from the front side
  • FIG. 5B is a perspective view of the occupant detection device 1 seen from the rear side.
  • the frame 4 is a frame that covers the display unit 20 and the imaging unit 10 in a state where the imaging unit 10 is attached to the display unit 20 . More specifically, in FIG. 5, the frame 4 is a state in which the imaging unit 10 is coupled to the upper surface of the display unit 20, and the left side, the upper surface, and the right side of the imaging unit 10, the right side of the display unit 20, and the right side of the display unit 20.
  • a frame covers the bottom and left side.
  • the thickness of the imaging unit 10 and the thickness of the display unit 20 do not need to be the same. However, in the occupant detection device 1, the imaging unit 10 and the display unit 20 are combined, and the first panel of the imaging unit 10 and the second panel of the display unit 20 are on the same plane.
  • the imaging unit 10 is attached to the display unit 20 from the upper surface side of the display unit 20 provided in the vehicle 100, but this is an example. Not too much.
  • the imaging unit 10 is provided on the vehicle 100, and the image pickup unit 10 is provided on the vehicle 100.
  • the image pickup unit 10 can display the image from the upper surface side of the display unit 20, the left side surface of the display unit 20, the right side surface of the display unit 20, or the bottom surface side of the display unit 20. Attached to portion 20 .
  • the occupant detection device 1 can position the imaging unit 10 with respect to the display unit 20 at a position where an optimum captured image can be obtained according to the specifications of the vehicle 100 in which the occupant detection device 1 is mounted.
  • FIG. 6 is a diagram for explaining an example of attachment of the imaging unit 10 to the display unit 20 in the occupant detection device 1 according to the first embodiment.
  • 6A is a diagram showing an example in which the imaging unit 10 is attached from the upper surface side of the display unit 20
  • FIG. 6B is a diagram showing an example in which the imaging unit 10 is attached from the right side surface side of the display unit 20
  • FIG. 6C is a diagram showing an example in which the imaging section 10 is attached from the left side of the display section 20
  • FIG. 6D is a diagram showing an example in which the imaging section 10 is attached from the bottom side of the display section 20.
  • FIG. The occupant detection device 1 shown in FIG. 6 is viewed from the front.
  • the occupant detection device 1 is integrated with the imaging unit 10 attached to the display unit 20 from the bottom surface side. It is mounted on the vehicle 100 in this state.
  • the vehicle 100 may be provided with the imaging unit 10 first, and the occupant detection device 1 may be integrated with the imaging unit 10 provided in the vehicle 100 by attaching the display unit 20 thereto. .
  • the imaging unit 10 (see FIG. 6B) attached from the right side of the display unit 20 has the face of the occupant blocked by the steering wheel. face may not be imaged. Therefore, in this case, in the occupant detection device 1 , the imaging unit 10 should be attached to the display unit 20 from a direction other than the right side of the display unit 20 . The face of the occupant can be imaged with higher accuracy than that obtained by the conventional method. Conversely, when the vehicle 100 is a left-hand drive vehicle, the imaging unit 10 in the occupant detection device 1 should be attached to the display unit 20 from a direction other than the left side of the display unit 20 . The occupant's face can be imaged with higher accuracy than when the display unit 20 is attached from the face side.
  • the imaging section 10 is attached to the display section 20 from a direction other than the bottom side of the display section 20 rather than attached to the display section 20 from the bottom side of the display section 20 . Also, the face of the occupant can be imaged with higher accuracy.
  • the imaging unit 10 has one illumination unit 12 (see FIG. 2), but this is merely an example.
  • the imaging unit 10 may have, for example, a plurality of illumination units 12 .
  • the illumination unit 12 may be provided outside the imaging unit 10 .
  • the installation position of the illumination unit 12 and the installation position of the imaging unit 10 should not be too far apart. is preferred. If the installation position of the illumination unit 12 and the installation position of the imaging unit 10 are far apart, for example, a shadow will be formed on the occupant to be imaged by the imaging unit 10, and the accuracy of the captured image will be reduced.
  • the lighting unit 12 and the imaging unit 10 need to be installed so as not to be separated from each other by a large distance.
  • the imaging unit 10 has the illumination unit 12 , so that the illumination unit 12 and the imaging unit 10 are provided without being separated from each other. It is possible to capture an image of the occupant illuminated by the light with high accuracy. Further, in the occupant detection device 1 according to Embodiment 1, since the imaging unit 10 has the lighting unit 12, devices necessary for imaging the occupant are integrated in the imaging unit 10, and the size can be reduced.
  • the imaging unit 10 captures an image of the range in which the face of the occupant should exist in the vehicle 100 while the occupant detection device 1 is mounted on the vehicle 100.
  • the imaging unit 10 may take an image of not only the face of the occupant in the vehicle 100 but also the range where the head or body should exist.
  • the occupant detection device 1 detects, for example, the posture or head position of the occupant based on the captured image captured by the imaging unit 10, and determines whether the driver is in a state suitable for driving. or a sudden change in the physical condition of the occupant.
  • the imaging unit 10 only has to be capable of imaging at least the range in which the face of the occupant in the vehicle 100 should exist when the occupant detection device 1 is mounted on the vehicle 100 .
  • the occupant detection device 1 is mounted on the vehicle 100, and is detachably attached to the display unit 20 provided inside the vehicle 100. and an imaging unit 10 for imaging at least a range in which a face should exist. Therefore, in the vehicle 100, the occupant detection device 1 does not require a space for installing the display unit 20 (display device) and a space for installing the imaging unit 10 (imaging device). 10 (imaging device) can be provided at a preferred position as an installation position.
  • the manufacturer or the like can design or manufacture the image capturing unit 10 according to the specifications of the vehicle 100 in advance, and a common display can be displayed. It is possible to provide the occupant detection device 1 in which the imaging unit 10 is freely combined with the unit 20 . Since the display unit 20 can be shared regardless of the specifications of the vehicle 100 , the manufacturer can reduce the labor required for designing or manufacturing the occupant detection device 1 .
  • the imaging unit 10 is configured to have an angle of view according to the specifications of the vehicle 100 in which the imaging unit 10 is provided. Therefore, a manufacturer or the like can design or manufacture the imaging unit 10 according to the specifications of the vehicle 100 in advance, and provide the occupant detection device 1 in which the imaging unit 10 is freely combined with the common display unit 20 . Since the display unit 20 can be shared regardless of the specifications of the vehicle 100 , the manufacturer can reduce the labor required for designing or manufacturing the occupant detection device 1 .
  • the orientation of the optical axis of the imaging unit 10 is configured to have an orientation according to the specifications of the vehicle 100 in which the imaging unit 10 is provided. Therefore, a manufacturer or the like can design or manufacture the imaging unit 10 according to the specifications of the vehicle 100 in advance, and provide the occupant detection device 1 in which the imaging unit 10 is freely combined with the common display unit 20 . Since the display unit 20 can be shared regardless of the specifications of the vehicle 100 , the manufacturer can reduce the labor required for designing or manufacturing the occupant detection device 1 .
  • the imaging unit 10 is configured to have an illumination unit 12 for illuminating the interior of the vehicle 100 in which the imaging unit 10 is provided. Therefore, the occupant detection device 1 can be miniaturized by consolidating equipment necessary for imaging the occupant in the imaging unit 10 .
  • the front surface of the imaging unit 10 is covered with the first panel
  • the front surface of the display unit 20 is covered with the second panel
  • the first panel and the second panel are covered. It is made of the same material as the panel. Therefore, the occupant detection device 1 can give a sense of unity between the imaging unit 10 and the display unit 20 .
  • the occupant detection device 1 when the imaging unit 10 is attached to the display unit 20, one side of the imaging unit 10 attached to the display unit 20 and the imaging unit 10 of the display unit 20 The distance from the side to which it is attached is less than or equal to the set distance. Therefore, the occupant detection device 1 can give a sense of unity between the imaging unit 10 and the display unit 20 .
  • the imaging unit 10 is configured to have a display area on the front surface. Therefore, the occupant detection device 1 can make the occupant recognize the necessary display.
  • the occupant detection device 1 is configured to include a frame that covers the entire periphery of the display unit 20 and the imaging unit 10 in a state where the imaging unit 10 is attached to the display unit 20 . Therefore, the occupant detection device 1 can make the combined imaging unit 10 and display unit 20 appear thin to the occupant or the like.
  • the imaging unit 10 is arranged on the upper surface side of the display unit 20, the left side surface of the display unit 20, the right side surface of the display unit 20, or the bottom surface side of the display unit 20. is attached to the display unit 20 from above. Therefore, the occupant detection device 1 can set the position of the imaging unit 10 with respect to the display unit 20 to a position where an optimum captured image can be obtained according to the specifications of the vehicle 100 in which the occupant detection device 1 is mounted.
  • the occupant detection device does not require a space for installing a display device and a space for installing an imaging device in a vehicle, so that the imaging device can be installed at a preferable position as an installation position. can be done.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
PCT/JP2021/036939 2021-10-06 2021-10-06 乗員検知装置および撮像装置 Ceased WO2023058145A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US18/682,851 US20240351544A1 (en) 2021-10-06 2021-10-06 Occupant detection device and image capturing device
JP2023552468A JP7630057B2 (ja) 2021-10-06 2021-10-06 乗員検知装置および撮像装置
PCT/JP2021/036939 WO2023058145A1 (ja) 2021-10-06 2021-10-06 乗員検知装置および撮像装置

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/036939 WO2023058145A1 (ja) 2021-10-06 2021-10-06 乗員検知装置および撮像装置

Publications (1)

Publication Number Publication Date
WO2023058145A1 true WO2023058145A1 (ja) 2023-04-13

Family

ID=85803296

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/036939 Ceased WO2023058145A1 (ja) 2021-10-06 2021-10-06 乗員検知装置および撮像装置

Country Status (3)

Country Link
US (1) US20240351544A1 (https=)
JP (1) JP7630057B2 (https=)
WO (1) WO2023058145A1 (https=)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10232135A (ja) * 1997-02-20 1998-09-02 Sony Corp 画像データ収集方法、画像データ提供方法、地図作成方法、位置データ提供方法、ナビゲーション装置及び車両
JP2002071356A (ja) * 2000-08-31 2002-03-08 Sony Corp カーナビゲーション装置
JP2014094647A (ja) * 2012-11-08 2014-05-22 Honda Motor Co Ltd 車両表示装置
WO2017183128A1 (ja) * 2016-04-20 2017-10-26 日産自動車株式会社 端末装置位置推定方法、情報表示方法、及び端末装置位置推定装置

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000071356A (ja) * 1998-08-27 2000-03-07 Tanakaya Inc エンボス貼合紙の製法と装置
WO2001064481A2 (en) * 2000-03-02 2001-09-07 Donnelly Corporation Video mirror systems incorporating an accessory module
JP3873232B2 (ja) * 2001-10-29 2007-01-24 Ｋｄｄｉ株式会社 多用途一体型映像伝送装置
JP2003312360A (ja) * 2002-04-17 2003-11-06 Ichikoh Ind Ltd モニタ付きルームミラー
JP2008140334A (ja) * 2006-12-05 2008-06-19 Asahi Research Kk 撮影画像記録再生装置
CA2621686A1 (en) * 2007-02-16 2008-08-16 Intellectual Solutions, Inc. Portable wireless baby monitor
US20090002487A1 (en) * 2007-06-26 2009-01-01 Martin Poulin Portable Vehicle Mounted Monitoring System
US20090096870A1 (en) * 2007-10-10 2009-04-16 Edward Zheng GPS with back up camera
JP2009265842A (ja) * 2008-04-23 2009-11-12 Toyota Motor Corp 車両用警告装置、警告方法
US9071740B1 (en) * 2011-10-28 2015-06-30 Google Inc. Modular camera system
US20150109441A1 (en) * 2013-10-23 2015-04-23 Fuhu, Inc. Baby Monitoring Camera
CN105025210B (zh) * 2015-07-03 2018-11-27 广东欧珀移动通信有限公司 拍摄装置及终端
US10075405B2 (en) * 2015-09-21 2018-09-11 Johnny Michael Computer message indicator
US9788620B1 (en) * 2016-07-12 2017-10-17 Ideo Plastics Inc. Electronic device cover
CN106790778B (zh) * 2016-11-16 2019-06-25 Oppo广东移动通信有限公司 一种移动终端的摄像头安装结构及移动终端
CN107415602A (zh) * 2017-07-06 2017-12-01 上海小蚁科技有限公司 用于车辆的监测方法、设备和系统、计算机可读存储介质
JP2019077283A (ja) * 2017-10-23 2019-05-23 矢崎総業株式会社 車載撮影装置
CN110557468B (zh) * 2018-05-31 2021-05-07 Oppo广东移动通信有限公司 移动终端
WO2020158602A1 (ja) * 2019-01-30 2020-08-06 日本精機株式会社 車両用表示装置
CN110778892B (zh) * 2019-10-24 2020-12-22 山东勤成健康科技股份有限公司 一种基于家庭医生的智能终端
JP7475045B2 (ja) * 2019-11-26 2024-04-26 株式会社ユピテル 車両用ルームミラー

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10232135A (ja) * 1997-02-20 1998-09-02 Sony Corp 画像データ収集方法、画像データ提供方法、地図作成方法、位置データ提供方法、ナビゲーション装置及び車両
JP2002071356A (ja) * 2000-08-31 2002-03-08 Sony Corp カーナビゲーション装置
JP2014094647A (ja) * 2012-11-08 2014-05-22 Honda Motor Co Ltd 車両表示装置
WO2017183128A1 (ja) * 2016-04-20 2017-10-26 日産自動車株式会社 端末装置位置推定方法、情報表示方法、及び端末装置位置推定装置

Also Published As

Publication number Publication date
JP7630057B2 (ja) 2025-02-17
US20240351544A1 (en) 2024-10-24
JPWO2023058145A1 (https=) 2023-04-13

Similar Documents

Publication Publication Date Title
US9218057B2 (en) Vehicular display system
JP6825903B2 (ja) ドライバー撮像装置
EP1386786A1 (en) In-vehicle occupant image pickup apparatus
US12342106B2 (en) Vehicular driver monitoring system
US12304391B2 (en) Vehicular driver monitoring system with driver monitoring camera and near IR light emitter at interior rearview mirror assembly
US20190001891A1 (en) Vehicle roof mounted system
CN109693620A (zh) 车载摄影装置
JP5740665B2 (ja) 車載用電子機器
JP2016052814A (ja) 車両周辺認知支援システム
US20200353865A1 (en) Passenger imaging device
JP5352772B2 (ja) ルームミラー装置
JP7630057B2 (ja) 乗員検知装置および撮像装置
US20250263016A1 (en) Vehicle side mirror and lower unit thereof
CN213292144U (zh) 车辆的外部环境观察系统以及车辆
US20060203091A1 (en) Switching on/off concept for an automobile night vision system
JP7375621B2 (ja) 車載用表示装置
JP7439623B2 (ja) 車室撮像装置
JP6617752B2 (ja) 撮像装置及び車両用表示装置
EP4523941B1 (en) DRIVER MONITORING SYSTEM
JP7544273B2 (ja) 乗員撮像装置
WO2023047506A1 (ja) ドライバモニタリング装置
JP5879569B2 (ja) 車載用電子機器
KR20260020037A (ko) 차량의 클러스터
US20250001941A1 (en) Vehicle
JP2011225125A (ja) カメラ取付用補助部材

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21959887

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023552468

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 18682851

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21959887

Country of ref document: EP

Kind code of ref document: A1