WO2021124548A1 - 車内監視装置、車内監視システム、及び車内監視方法 - Google Patents

車内監視装置、車内監視システム、及び車内監視方法 Download PDF

Info

Publication number
WO2021124548A1
WO2021124548A1 PCT/JP2019/050091 JP2019050091W WO2021124548A1 WO 2021124548 A1 WO2021124548 A1 WO 2021124548A1 JP 2019050091 W JP2019050091 W JP 2019050091W WO 2021124548 A1 WO2021124548 A1 WO 2021124548A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
area
determination unit
infant
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2019/050091
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
大輔 森本
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Corp
Original Assignee
Mitsubishi Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Corp filed Critical Mitsubishi Electric Corp
Priority to DE112019007988.3T priority Critical patent/DE112019007988B4/de
Priority to JP2021565284A priority patent/JP7154443B2/ja
Priority to PCT/JP2019/050091 priority patent/WO2021124548A1/ja
Publication of WO2021124548A1 publication Critical patent/WO2021124548A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/593—Recognising seat occupancy

Definitions

  • This disclosure relates to an in-vehicle monitoring device, an in-vehicle monitoring system, and an in-vehicle monitoring method.
  • the conventional in-vehicle monitoring device When the vehicle is parked, the conventional in-vehicle monitoring device performs image processing on the image of the inside of the vehicle captured by the camera to extract the contour of the occupant, and detects the infant remaining in the vehicle based on the extracted contour. (See, for example, Patent Document 1).
  • the camera alone had blind spots such as hidden parts in the seat, so the in-vehicle monitoring device could not detect the infant in the blind spot.
  • This disclosure was made to solve the above problems, and aims to detect infants in the car.
  • the in-vehicle monitoring device is an in-vehicle monitoring device that detects an occupant when the vehicle stops, and is provided by a first data acquisition unit that acquires the first data acquired by the first sensor and a second sensor.
  • the occupant who is in the vehicle is an infant using the second data acquisition unit that acquires the acquired second data and the first data acquired by the first data acquisition unit when the vehicle stops.
  • the first determination unit that determines whether or not the vehicle is stopped and the second data acquired by the second data acquisition unit when the vehicle is stopped, it is determined whether or not the occupant in the vehicle is an infant.
  • the in-vehicle monitoring device uses a plurality of sensors, it is possible to detect an infant in the vehicle.
  • FIGS. 1A and 1B are block diagrams showing a configuration example of an in-vehicle monitoring system according to the first embodiment. It is a figure which shows the installation example of a camera and a millimeter wave sensor in a vehicle. It is a figure which shows the example of the image pickup range of a camera, and the detection range of a millimeter wave sensor.
  • 4A, 4B, and 4C are diagrams showing an example of the positional relationship between the rear seats and the first area, the second area, and the third area, and FIG. 4D shows the front seats, the fourth area, and the third area. It is a figure which shows the example of the positional relationship with 5 areas.
  • FIG. 7A and 7B are diagrams showing a hardware configuration example of the in-vehicle monitoring device according to the first embodiment. It is a figure which shows the positional relationship between a front seat and a 1st area, a 2nd area, and a 3rd area.
  • FIG. 1A is a block diagram showing a configuration example of the in-vehicle monitoring system 20 according to the first embodiment.
  • the in-vehicle monitoring system 20 includes a first sensor 1, a second sensor 2, and an in-vehicle monitoring device 10.
  • the first sensor 1, the second sensor 2, and the notification unit 21 are connected to the in-vehicle monitoring device 10.
  • the first sensor 1, the second sensor 2, and the in-vehicle monitoring device 10 are mounted on the vehicle 30 (see FIG. 2).
  • the notification unit 21 may be at least one of a speaker or a display mounted on the vehicle 30, a mobile terminal or the like possessed by an occupant in the vehicle 30, or the vehicle 30. It may be a mounted hazard lamp, horn (horn), or the like.
  • the first sensor 1 and the second sensor 2 are sensors capable of detecting an occupant in the vehicle, and are, for example, a camera (visible light camera or a camera having a specific electromagnetic wave filter), an electrocardiographic sensor (EKG or ECG), and a photoelectric type. Volumetric pulse wave recording (photopretismography) sensing, brain wave measuring instrument (EEG), lung activity meter, respiratory activity measuring device, TOF (Time-of-Flight) sensor, millimeter wave sensor, millimeter wave radar, pulse oximeter, thermo With graphers, thermal imagers, infrared imagers, facial muscle movement detectors, skin temperature conductance sensors, skin resistance sensors, sweating amount sensors, near-infrared spectrometers, computer tomography (CT), voice sensors, etc. is there.
  • the first sensor 1 and the second sensor 2 are different types of sensors.
  • the in-vehicle monitoring device 10 includes a first data acquisition unit 11, a second data acquisition unit 12, a first determination unit 13, a second determination unit 14, and an estimation result output unit 15.
  • the first data acquisition unit 11 acquires the first data acquired by the first sensor 1 and outputs the acquired first data to the first determination unit 13.
  • the second data acquisition unit 12 acquires the second data acquired by the second sensor 2 and outputs the acquired second data to the second determination unit 14.
  • the first determination unit 13 detects the occupants in each seat of the vehicle 30 by using the first data acquired by the first data acquisition unit 11.
  • the second determination unit 14 detects the occupants in each seat of the vehicle 30 by using the second data acquired by the second data acquisition unit 12.
  • the occupant detection performed by the first determination unit 13 and the second determination unit 14 may be performed by analyzing the acquired data, or by comparing the acquired data with the data prepared in advance, the threshold value, or the like. Good. Further, the first determination unit 13 and the second determination unit 14 may perform occupant detection by combining the data acquired while the vehicle 30 is running and the data acquired after the vehicle 30 is stopped. The occupant detection includes determination of whether or not the occupant in the vehicle 30 is an infant.
  • the timing of occupant detection may be the moment when the vehicle 30 is stopped, or may be after a certain time has elapsed from the moment when the vehicle 30 is stopped.
  • the stop of the vehicle 30 may be a temporary stop (that is, a stop) or a continuous stop (that is, parking).
  • the in-vehicle monitoring device 10 may acquire information indicating whether or not the vehicle 30 has stopped, such as information on a shift lever or a parking brake, from the vehicle 30.
  • the estimation result output unit 15 receives the determination result from the first determination unit 13 and also receives the determination result from the second determination unit 14. The estimation result output unit 15 estimates the riding of the infant based on the received determination result, and outputs the estimation result. When the estimation result output unit 15 determines that the infant is on board by at least one of the first determination unit 13 and the second determination unit 14, it is estimated that the infant is on the vehicle 30.
  • the in-vehicle monitoring device 10 detects an infant in the vehicle by using a plurality of different types of sensors, the in-vehicle monitoring device 10 more reliably detects the infant in the vehicle as compared with the case where the infant in the vehicle is detected by using only one sensor. be able to.
  • the first sensor 1 is a camera and the second sensor is a Doppler sensor such as a millimeter wave sensor will be described, but the embodiments shown below are examples, and the present disclosure is based on these embodiments. It is not limited.
  • FIG. 1B is a block diagram showing a configuration example of the vehicle interior monitoring device 10 according to the first embodiment, in which a camera 1A is used as the first sensor 1 and a millimeter wave sensor 2A is used as the second sensor 2. is there.
  • the first data acquisition unit 11 is referred to as an image acquisition unit 11A for acquiring image data captured by the camera 1A
  • the second data acquisition unit 12 is a distance for acquiring the distance data measured by the millimeter wave sensor 2A. It is referred to as acquisition unit 12A.
  • FIG. 2 is a diagram showing an installation example of the camera 1A and the millimeter wave sensor 2A in the vehicle 30.
  • FIG. 3 is a diagram showing an example of an imaging range 1a of the camera 1A and a detection range 2a of the millimeter wave sensor 2A.
  • an adult 34 is seated in the front seat 31.
  • an auxiliary device for infants 33 (hereinafter referred to as CRS33; CRS: Child Restraint System) is attached to the rear seat 32, and the infant 35 is seated on the CRS 33.
  • CRS33 CRS: Child Restraint System
  • the CRS 33 in the illustrated example is a backward type, it may be a forward type.
  • the camera 1A is installed on an overhead console or the like in front of the vehicle and images the front seats 31 and the rear seats 32.
  • the imaging range 1a of the camera 1A there are blind spots such as a portion hidden by the front seat 31 and the inside of the trunk 36, and the vehicle interior monitoring device 10 cannot detect an occupant existing in the blind spot.
  • the in-vehicle monitoring device 10 cannot detect an occupant whose whole body is covered with a blanket or the like.
  • the millimeter wave sensor 2A is installed near the ceiling at the rear of the vehicle, transmits millimeter waves to the rear seats 32, and receives the reflected waves reflected by the moving object. Then, the millimeter wave sensor 2A measures the distance from the installation position of the millimeter wave sensor 2A to the moving object to which the millimeter wave is reflected by using the transmission / reception result of the millimeter wave. Further, the millimeter wave sensor 2A may transmit a millimeter wave to the trunk 36 in addition to the rear seat 32 to measure the distance of a moving object in the trunk 36.
  • a Doppler sensor such as the millimeter wave sensor 2A, the in-vehicle monitoring device 10 can detect the occupant from the movement of the chest or the heartbeat (movement of the heart) due to breathing.
  • the millimeter-wave sensor 2A is an image captured by the camera 1A, such as an occupant blocked by a front seat 31, CRS33 or a sunshade (not shown), an occupant whose whole body is covered with a blanket or the like, and an occupant trapped in the trunk 36. Can react to occupants who do not appear in the image.
  • the millimeter wave sensor 2A also reacts to moving dolls and water swaying in PET bottles, it is difficult to distinguish between dolls and occupants. Therefore, it is difficult for the in-vehicle monitoring device 10 to accurately detect the occupant only by the millimeter wave sensor 2A, and there is a possibility that the occupant may be erroneously detected even though the vehicle 30 has no occupant.
  • the in-vehicle monitoring system 20 combines the camera 1A and the millimeter wave sensor 2A to complement each other's weaknesses, and aims to improve the robustness of occupant detection and the detection accuracy.
  • the in-vehicle monitoring device 10 includes an image acquisition unit 11A, a distance acquisition unit 12A, a first determination unit 13, a second determination unit 14, and an estimation result output unit 15.
  • the image acquisition unit 11A acquires image data obtained by the camera 1A capturing the inside of the vehicle 30 from the camera 1A.
  • the image acquisition unit 11A outputs the image data acquired from the camera 1A to the first determination unit 13.
  • the distance acquisition unit 12A acquires the distance data obtained by the millimeter wave sensor 2A measuring the distance to each object in the vehicle 30 from the millimeter wave sensor 2A.
  • the distance acquisition unit 12A outputs the distance data acquired from the millimeter wave sensor 2A to 14.
  • the first determination unit 13 detects the occupants in the front seats 31 and the rear seats 32 by using the image data acquired by the image acquisition unit 11A, and of each of the detected occupants. Determine your physique. The first determination unit 13 determines whether each occupant is an adult or an infant based on the physique determination result of each occupant. The first determination unit 13 outputs the determination result to the estimation result output unit 15. For example, in the first embodiment, an adult is a occupant having a physique that allows him / her to go out of the vehicle by himself / herself even if he / she is left behind in the vehicle 30, and an infant is an occupant who can go out of the vehicle by himself / herself when left in the vehicle 30.
  • the criteria for determining whether each occupant is an adult or a child is not limited to the above example, and can be arbitrarily set by the user. For example, even if the occupant has a physique that allows him / her to get out of the vehicle by himself / herself, if the physique of a child is an age at which he / she is obliged to wear a child seat or the like, it can be set to be judged as an infant.
  • the second determination unit 14 detects the occupants in the rear seat 32 by using the distance data acquired by the distance acquisition unit 12A, and whether each of the detected occupants is an adult or an infant. To judge. The second determination unit 14 outputs the determination result to the estimation result output unit 15. The second determination unit 14 may detect an occupant in the trunk 36 by using the distance data acquired by the distance acquisition unit 12A. The arrows for outputting information from the first determination unit 13 to the second determination unit 14 shown in FIGS. 1A and 1B will be described later.
  • FIG. 4A, 4B, and 4C are diagrams showing an example of the positional relationship between the rear seat 32 and the first area 41, the second area 42, and the third area 43.
  • FIG. 4A shows an example in which an adult 37 is seated in the rear seat 32.
  • FIG. 4B shows an example in which the infant 35 is seated on the forward-facing type CRS 33 mounted on the rear seat 32.
  • FIG. 4C shows an example in which the infant 35 is seated on the rear-facing type CRS 33 mounted on the rear seat 32.
  • the millimeter wave sensor 2A is installed above the rear seat 32 and transmits millimeter waves toward the bottom of the front seat 31.
  • the second determination unit 14 sets the detection range 2a of the millimeter wave sensor 2A to the first area 41 closer to the installation position of the millimeter wave sensor 2A, the second area 42 farther from the installation position than the first area 41, and the second. It is divided into a third area 43, which is farther from the installation position than the area 42. Information indicating the distances between the first area 41, the second area 42, and the third area 43 is held in advance by the second determination unit 14.
  • the first area 41 is an area including the headrest of the rear seat 32.
  • the second area 42 is an area including the backrest of the rear seat 32, and the seat surface of the rear seat 32 serves as a boundary surface between the second area 42 and the third area 43.
  • the third area 43 is an area including the feet of the rear seats 32.
  • the second determination unit 14 classifies the distance data measured by the millimeter wave sensor 2A into the first area 41, the second area 42, and the third area 43.
  • the second determination unit 14 when the distance data is classified into all of the first area 41, the second area 42, and the third area 43, that is, the millimeter wave transmitted by the millimeter wave sensor 2A is the first area 41.
  • the reflection is performed in all of the second area 42 and the third area 43, it is determined that the adult 37 is seated in the rear seat 32.
  • the second determination unit 14 when the distance data is not classified into the first area 41 and the third area 43 but is classified into the second area 42, that is, the millimeter wave transmitted by the millimeter wave sensor 2A is the second.
  • the reflection occurs in the area 42, it is determined that the infant 35 is seated on the CRS 33 mounted on the rear seat 32. Further, in the second determination unit 14, when the distance data is not classified into the first area 41 and the second area 42 but is classified into the third area 43, that is, the millimeter wave transmitted by the millimeter wave sensor 2A is the third. When the reflection occurs in the area 43, it is determined that there is an infant (not shown) at the foot of the rear seat 32.
  • FIG. 4D is a diagram showing an example of the positional relationship between the front seat 31 and the fourth area 44 and the fifth area 45.
  • FIG. 4D shows an example in which an adult 34 is seated on the driver's seat side of the front seat 31 and an infant 38 is seated on a forward-facing type CRS 33 mounted on the passenger seat side of the front seat 31.
  • a fourth area 44 (seat portion of the front seat 31) and a fifth area 45 (foot portion of the front seat 31) are set on the front seat 31 side of the third area 43.
  • the second determination unit 14 determines that the adult 34 is seated in the front seat 31. Further, the second determination unit 14 determines that the infant 38 is seated on the CRS 33 mounted on the front seat 31 when the distance data is classified into the fourth area 44. Further, the second determination unit 14 determines that there is an infant (not shown) at the foot of the front seat 31 when the distance data is classified into the fifth area 45. In the example of FIG. 4D, since not only the infant 38 but also the adult 34 is seated in the front seat 31, the distance data is classified into the third area 43, the fourth area 44, and the fifth area 45. , It is determined that the adult 34 is seated.
  • FIG. 5 is a reference example for assisting the understanding of the in-vehicle monitoring system 20 according to the first embodiment, and shows an example in which the millimeter wave sensor 2A is installed in front of the rear seat 32.
  • the millimeter wave sensor 2A is installed on the ceiling in front of the rear seat 32 and transmits millimeter waves toward the rear seat 32.
  • the detection range 2a of the millimeter wave sensor 2A is divided into a first area 41 and a second area 42 according to the distance from the installation position of the millimeter wave sensor 2A. .. Therefore, it is difficult to determine whether the occupant seated in the rear seat 32 is an infant 35 or an adult 37 only by the distance data of the millimeter wave sensor 2A.
  • the estimation result output unit 15 receives the determination result from the first determination unit 13 and also receives the determination result from the second determination unit 14. The estimation result output unit 15 estimates the riding of the infant based on the received determination result, and outputs the estimation result to the notification unit 21. When the estimation result output unit 15 determines that the infant is on board by at least one of the first determination unit 13 and the second determination unit 14, it is estimated that the infant is on board.
  • the notification unit 21 notifies based on the estimation result output by the estimation result output unit 15. For example, when the estimation result that the infant is on board is input from the estimation result output unit 15, the notification unit 21 notifies that the infant remains in the vehicle 30 by voice or display, and the infant is notified. If the estimation result that the vehicle is not on board is input from the estimation result output unit 15, no notification is given. As a result, the in-vehicle monitoring system 20 can notify the occupant that the infant is in the vehicle, so that the infant can be prevented from being left behind.
  • FIG. 6 is a flowchart showing an operation example of the in-vehicle monitoring device 10 according to the first embodiment.
  • the in-vehicle monitoring device 10 operates after step ST2, and when the vehicle 30 is running (step ST1 "NO"), until the vehicle 30 is stopped. The operation of step ST1 is repeated.
  • step ST2 the image acquisition unit 11A acquires image data from the camera 1A.
  • step ST3 the first determination unit 13 detects the occupants of the front seats 31 and the rear seats 32 using the image data, and determines whether or not the detected occupants are infants.
  • step ST4 the distance acquisition unit 12A acquires distance data from the millimeter wave sensor 2A.
  • step ST5 the second determination unit 14 classifies the distance data into the first area 41, the second area 42, and the third area 43, and the occupants of the front seat 31 and the rear seat 32 are infants based on the classification result. Determine if it exists.
  • the operations of steps ST2 and ST3 and the operations of steps ST4 and ST5 are performed in parallel.
  • step ST6 the estimation result output unit 15 estimates the riding of the infant based on the determination results received from the first determination unit 13 and the second determination unit 14, and outputs the estimation result.
  • step ST7 the notification unit 21 notifies based on the estimation result output by the estimation result output unit 15. Then, the in-vehicle monitoring device 10 ends the operation shown in the flowchart of FIG.
  • FIG. 7A and 7B are diagrams showing a hardware configuration example of the in-vehicle monitoring device 10 according to the first embodiment.
  • the functions of the image acquisition unit 11A, the distance acquisition unit 12A, the first determination unit 13, the second determination unit 14, and the estimation result output unit 15 in the in-vehicle monitoring device 10 are realized by the processing circuit. That is, the in-vehicle monitoring device 10 includes a processing circuit for realizing the above functions.
  • the processing circuit may be a processing circuit 100 as dedicated hardware, or a processor 101 that executes a program stored in the memory 102.
  • the processing circuit 100 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, or an ASIC (Application Specific Integrated Circuit). ), FPGA (Field Processor Gate Array), or a combination thereof.
  • the functions of the image acquisition unit 11A, the distance acquisition unit 12A, the first determination unit 13, the second determination unit 14, and the estimation result output unit 15 may be realized by a plurality of processing circuits 100, or the functions of each unit may be integrated. It may be realized by one processing circuit 100.
  • the functions of the image acquisition unit 11A, the distance acquisition unit 12A, the first determination unit 13, the second determination unit 14, and the estimation result output unit 15 are software. , Firmware, or a combination of software and firmware.
  • the software or firmware is described as a program and stored in the memory 102.
  • the processor 101 realizes the functions of each part by reading and executing the program stored in the memory 102. That is, the in-vehicle monitoring device 10 includes a memory 102 for storing a program in which the step shown in the flowchart of FIG. 6 is eventually executed when executed by the processor 101. Further, it can be said that this program causes the computer to execute the procedure or method of the image acquisition unit 11A, the distance acquisition unit 12A, the first determination unit 13, the second determination unit 14, and the estimation result output unit 15.
  • the processor 101 is a CPU (Central Processing Unit), a processing device, an arithmetic unit, a microprocessor, or the like.
  • the memory 102 may be a non-volatile or volatile semiconductor memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), an EPROM (Erasable Program ROM), or a flash memory, and may be a non-volatile or volatile semiconductor memory such as a hard disk or a flexible disk. It may be an optical disc such as a CD (Compact Disc) or a DVD (Digital Versaille Disc).
  • the processing circuit in the in-vehicle monitoring device 10 can realize the above-mentioned functions by hardware, software, firmware, or a combination thereof.
  • the in-vehicle monitoring device 10 includes an image acquisition unit 11A, a distance acquisition unit 12A, a first determination unit 13, a second determination unit 14, and an estimation result output unit 15.
  • the image acquisition unit 11A acquires image data obtained by the camera 1A capturing the inside of the vehicle.
  • the distance acquisition unit 12A acquires distance data obtained by measuring the distance to a moving object in the vehicle by the millimeter wave sensor 2A.
  • the first determination unit 13 determines whether or not the occupant seated in the vehicle 30 is an infant or not by using the image data acquired by the image acquisition unit 11A.
  • the second determination unit 14 determines whether or not the occupant seated in the vehicle 30 is an infant or not by using the distance data acquired by the distance acquisition unit 12A.
  • the estimation result output unit 15 instructs the notification unit 21 to output a warning when at least one of the first determination unit 13 and the second determination unit 14 determines that the infant is on board.
  • the millimeter wave sensor 2A of the first embodiment is provided above the rear seat 32 and transmits millimeter waves toward the feet of the rear seat 32.
  • the second determination unit 14 uses the distance data acquired by the distance acquisition unit 12A as the first area 41 closer to the installation position of the millimeter wave sensor 2A, the second area 42 farther from the installation position than the first area 41, and the second area 42. It is classified into the third area 43, which is farther from the installation position than the second area 42. Then, the second determination unit 14 determines that there is an adult in the rear seat 32 when the distance data is classified into all of the first area 41, the second area 42, and the third area 43.
  • the second determination unit 14 determines that there is an infant in the rear seat 32 when the distance data is not classified into the first area 41 but is classified into at least one of the second area 42 or the third area 43. With this configuration, the second determination unit 14 can distinguish between an adult and an infant by using the distance data measured by the millimeter wave sensor 2A.
  • the notification unit 21 of the first embodiment is configured to notify the ride of the infant when the estimation result that the infant is on board is input from the estimation result output unit 15, but the configuration of the notification unit 21 Is not limited to this.
  • the estimation result output unit 15 estimates that an adult and an infant are on board when the first determination unit 13 determines that an adult is on board and the second determination unit 14 determines that an infant is on board.
  • the notification unit 21 not only the estimation result that the infant is on board but also the estimation result that the adult is on board is input.
  • the notification unit 21 may be configured not to notify the ride of an infant when the estimation result that an adult is on board is input. This is because notification is required when only infants are left in the vehicle 30, and notification is not required when an adult is on board.
  • the in-vehicle monitoring device 10 when it is determined that one or more adults are in the vehicle 30 based on the image data of the camera 1A, the in-vehicle monitoring device 10 notifies even if there is an infant in the blind spot of the camera 1A. Since it can be done, unnecessary notifications can be reduced. Further, for example, when the second determination unit 13 detects the occupant in the trunk 36, the estimation result output unit 15 may output the estimation result that the occupant is in the trunk 36 to the notification unit 21. The notification unit 21 notifies when the estimation result that there is an occupant in the trunk 36 is input.
  • FIG. 8 is a diagram showing the positional relationship between the front seat 31 and the first area 41, the second area 42, and the third area 43. As shown in FIG. 8, in the third area 43, the feet of the rear seats 32 and the front seats 31 are at the same distance. Therefore, when there is an adult 34 in the front seat 31, there is a possibility that the second determination unit 14 erroneously determines that there is an infant at the foot of the rear seat 32 even though there is no infant at the foot of the rear seat 32. is there.
  • the determination result is transmitted to the second determination unit 14 in addition to the estimation result output unit 15. Output.
  • the second determination unit 14 invalidates the third area 43.
  • the second determination unit 14 determines that there is an adult in the rear seat 32 when the distance data is classified into both the first area 41 and the second area 42, and the distance data is classified into the first area 41.
  • it is classified into the second area 42 it is determined that there is an infant in the rear seat 32.
  • the in-vehicle monitoring device 10 can accurately detect the infant left in the vehicle 30.
  • the application of the in-vehicle monitoring system 20 according to the first embodiment is not limited to the application of detecting an infant in the vehicle 30 when the vehicle 30 is stopped.
  • the in-vehicle monitoring device 10 may have a function of determining whether or not the occupant is wearing a seatbelt.
  • the first determination unit 13 and the second determination unit 14 detect the presence or absence of occupants in each seat.
  • the above function determines whether or not each occupant detected by the first determination unit 13 and the second determination unit 14 is wearing a seatbelt based on the information from the seatbelt sensor of each seat.
  • the estimation result output unit 15 outputs the wearing result of each occupant's seatbelt, and the notification unit 21 gives a notification based on the wearing result output by the estimation result output unit 15.
  • the in-vehicle monitoring device 10 may have a function of switching whether or not the airbag is activated.
  • the first determination unit 13 and the second determination unit 14 detect the presence or absence of occupants in each seat and determine the physique of each detected occupant. The above-mentioned function switches whether or not the airbag of each seat is activated according to the physique of each occupant determined by the first determination unit 13 and the second determination unit 14.
  • the functions of the image acquisition unit 11A, the distance acquisition unit 12A, the first determination unit 13, the second determination unit 14, and the estimation result output unit 15 are mounted on the vehicle 30.
  • all or part of the functions may be in the server device on the network.
  • any component of the embodiment can be modified or any component of the embodiment can be omitted in the present disclosure.
  • the in-vehicle monitoring system determines whether an infant is on board, it is suitable for use in an in-vehicle monitoring system or the like that prevents the infant from being left behind.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Geophysics And Detection Of Objects (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • Radar Systems Or Details Thereof (AREA)
  • Traffic Control Systems (AREA)
PCT/JP2019/050091 2019-12-20 2019-12-20 車内監視装置、車内監視システム、及び車内監視方法 Ceased WO2021124548A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
DE112019007988.3T DE112019007988B4 (de) 2019-12-20 2019-12-20 Fahrzeuginnenraum-Überwachungsvorrichtung, Fahrzeuginnenraum-Überwachungssystem und Fahrzeuginnenraum-Überwachungsverfahren
JP2021565284A JP7154443B2 (ja) 2019-12-20 2019-12-20 車内監視装置、車内監視システム、及び車内監視方法
PCT/JP2019/050091 WO2021124548A1 (ja) 2019-12-20 2019-12-20 車内監視装置、車内監視システム、及び車内監視方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2019/050091 WO2021124548A1 (ja) 2019-12-20 2019-12-20 車内監視装置、車内監視システム、及び車内監視方法

Publications (1)

Publication Number Publication Date
WO2021124548A1 true WO2021124548A1 (ja) 2021-06-24

Family

ID=76478376

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/050091 Ceased WO2021124548A1 (ja) 2019-12-20 2019-12-20 車内監視装置、車内監視システム、及び車内監視方法

Country Status (3)

Country Link
JP (1) JP7154443B2 (https=)
DE (1) DE112019007988B4 (https=)
WO (1) WO2021124548A1 (https=)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114202751A (zh) * 2021-11-04 2022-03-18 一汽奔腾轿车有限公司 一种车内遗留物品检测系统
WO2023127072A1 (ja) * 2021-12-28 2023-07-06 三菱電機株式会社 置き去り検知装置及び置き去り検知方法
WO2023152936A1 (ja) * 2022-02-14 2023-08-17 三菱電機株式会社 置き去り警報装置、置き去り警報システム、および置き去り警報方法
WO2023195060A1 (ja) * 2022-04-05 2023-10-12 三菱電機株式会社 乗員検知装置および乗員検知方法
JPWO2024134815A1 (https=) * 2022-12-22 2024-06-27
CN120853309A (zh) * 2025-08-18 2025-10-28 润芯微科技(江苏)有限公司 一种基于多传感器融合的车辆防生物入侵智能监测方法

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025062496A1 (ja) * 2023-09-19 2025-03-27 日産自動車株式会社 乗員検知方法及び乗員検知装置

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016062414A (ja) * 2014-09-19 2016-04-25 クラリオン株式会社 車内監視装置及び車内監視システム
JP2019168379A (ja) * 2018-03-26 2019-10-03 アイシン精機株式会社 生体検知システム
JP2019199153A (ja) * 2018-05-16 2019-11-21 株式会社Ｊｖｃケンウッド 映像出力装置、映像出力方法、及びコンピュータプログラム

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10158415C2 (de) 2001-11-29 2003-10-02 Daimler Chrysler Ag Verfahren zur Überwachung des Innenraums eines Fahrzeugs, sowie ein Fahrzeug mit mindestens einer Kamera im Fahrzeuginnenraum
JP2008296777A (ja) 2007-05-31 2008-12-11 Toyota Motor Corp 車両用開閉制御装置
WO2016149746A1 (en) 2015-03-24 2016-09-29 Penna Taleese Vehicle safety system and method
JP2019123354A (ja) * 2018-01-16 2019-07-25 株式会社デンソー 乗員検知装置
JP2019217830A (ja) * 2018-06-15 2019-12-26 アイシン精機株式会社 乗員認識装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016062414A (ja) * 2014-09-19 2016-04-25 クラリオン株式会社 車内監視装置及び車内監視システム
JP2019168379A (ja) * 2018-03-26 2019-10-03 アイシン精機株式会社 生体検知システム
JP2019199153A (ja) * 2018-05-16 2019-11-21 株式会社Ｊｖｃケンウッド 映像出力装置、映像出力方法、及びコンピュータプログラム

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114202751A (zh) * 2021-11-04 2022-03-18 一汽奔腾轿车有限公司 一种车内遗留物品检测系统
WO2023127072A1 (ja) * 2021-12-28 2023-07-06 三菱電機株式会社 置き去り検知装置及び置き去り検知方法
JP7599589B2 (ja) 2022-02-14 2024-12-13 三菱電機株式会社 置き去り警報装置、置き去り警報システム、および置き去り警報方法
JPWO2023152936A1 (https=) * 2022-02-14 2023-08-17
WO2023152936A1 (ja) * 2022-02-14 2023-08-17 三菱電機株式会社 置き去り警報装置、置き去り警報システム、および置き去り警報方法
US12570212B2 (en) 2022-02-14 2026-03-10 Mitsubishi Electric Corporation Occupant-left-unattended warning device, occupant-left-unattended warning system, and occupant-left-unattended warning method
WO2023195060A1 (ja) * 2022-04-05 2023-10-12 三菱電機株式会社 乗員検知装置および乗員検知方法
JPWO2023195060A1 (https=) * 2022-04-05 2023-10-12
JP7499997B2 (ja) 2022-04-05 2024-06-14 三菱電機株式会社 乗員検知装置および乗員検知方法
JPWO2024134815A1 (https=) * 2022-12-22 2024-06-27
WO2024134815A1 (ja) * 2022-12-22 2024-06-27 三菱電機株式会社 情報処理装置、検知センサ、情報処理システム、および、情報処理方法
JP7756815B2 (ja) 2022-12-22 2025-10-20 三菱電機株式会社 情報処理装置、検知センサ、情報処理システム、および、情報処理方法
CN120853309A (zh) * 2025-08-18 2025-10-28 润芯微科技(江苏)有限公司 一种基于多传感器融合的车辆防生物入侵智能监测方法

Also Published As

Publication number Publication date
JP7154443B2 (ja) 2022-10-17
DE112019007988T5 (de) 2022-10-13
DE112019007988B4 (de) 2023-06-29
JPWO2021124548A1 (https=) 2021-06-24

Similar Documents

Publication Publication Date Title
WO2021124548A1 (ja) 車内監視装置、車内監視システム、及び車内監視方法
US12145596B2 (en) Cabin-inside detection device and cabin-inside detection method
EP4333699B1 (en) Multi-sensor system for cardiovascular and respiratory tracking
JP7399283B2 (ja) 乗員検出装置、子供置き去り警報システム、乗員検出方法および子供置き去り警報方法
JPWO2021124548A5 (https=)
EP1669251A1 (en) Child seat detection system
US20050232460A1 (en) Safety device for a vehicle
KR102338204B1 (ko) 생체 신호 감지 장치 및 이를 포함하는 생체 신호 감지 시스템
JP7518443B2 (ja) 異常検知装置及び乗り物
US20200231111A1 (en) Vehicle footwell reflector
US20060126901A1 (en) Device for determining the age of a person by measuring pupil size
JP2019137169A (ja) 誘導装置、誘導システムおよびプログラム
US10882418B2 (en) Method for classifying an occupant and providing the occupant classification for a safety device in a motor vehicle
JP7499997B2 (ja) 乗員検知装置および乗員検知方法
US12518613B2 (en) In-vehicle monitoring device, in-vehicle monitoring system, and in-vehicle monitoring method
JP6597524B2 (ja) 生体情報記録装置
KR102908997B1 (ko) 알코올 인터락 제어 장치 및 방법
JP7615903B2 (ja) 生体検知装置
JP7509157B2 (ja) ドライバ監視装置、ドライバ監視用コンピュータプログラム及びドライバ監視方法
JP6558343B2 (ja) 生体センサ
WO2026018692A1 (ja) 生体検出装置、生体検出方法
JP2026036010A (ja) 移動体の乗員の生体情報を検知するシステム
US20250314758A1 (en) Method for monitoring the inner space of a vehicle, control unit, and sensor device
WO2024194907A1 (ja) 乗員検知装置、および、乗員検知方法
JP2025150734A (ja) 乗員検知装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19956630

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2021565284

Country of ref document: JP

122 Ep: pct application non-entry in european phase

Ref document number: 19956630

Country of ref document: EP

Kind code of ref document: A1