JPWO2021240769A5 - Occupant Detection Device, Child Abandoned Alarm System, Occupant Detection Method and Child Abandoned Alarm Method - Google Patents

Occupant Detection Device, Child Abandoned Alarm System, Occupant Detection Method and Child Abandoned Alarm Method Download PDF

Info

Publication number
JPWO2021240769A5
JPWO2021240769A5 JP2022527432A JP2022527432A JPWO2021240769A5 JP WO2021240769 A5 JPWO2021240769 A5 JP WO2021240769A5 JP 2022527432 A JP2022527432 A JP 2022527432A JP 2022527432 A JP2022527432 A JP 2022527432A JP WO2021240769 A5 JPWO2021240769 A5 JP WO2021240769A5
Authority
JP
Japan
Prior art keywords
occupant
living body
vehicle
detected
face
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2022527432A
Other languages
Japanese (ja)
Other versions
JPWO2021240769A1 (en
Filing date
Publication date
Application filed filed Critical
Priority claimed from PCT/JP2020/021303 external-priority patent/WO2021240769A1/en
Publication of JPWO2021240769A1 publication Critical patent/JPWO2021240769A1/ja
Publication of JPWO2021240769A5 publication Critical patent/JPWO2021240769A5/en
Pending legal-status Critical Current

Links

Description

本開示に係る乗員検出装置は、車両内を撮影した画像である車内画像を取得する車内画像取得部と、車内画像から人物の顔を探索し、検出された顔の位置を特定する顔検出部と、電磁波センサにより検出された車両内の生体情報を取得する生体情報取得部と、生体情報に基づいて車両内に存在する生体を探索し、検出された生体の位置およびサイズを特定する生体検出部と、人物の顔の位置又は生体の位置およびサイズに基づいて、車両の座席の乗員の有無および座席にいる乗員の属性を判断する乗員判断部と、を備え、乗員判断部は、人物の顔が検出されなかった座席で生体が検出された場合に、その座席の乗員の属性を生体のサイズに基づいて判断する。

The occupant detection device according to the present disclosure includes an in-vehicle image acquisition unit that acquires an in-vehicle image that is an image of the inside of the vehicle, and a face detection unit that searches for a person's face from the in-vehicle image and identifies the position of the detected face. a biometric information acquisition unit that acquires biometric information in the vehicle detected by the electromagnetic wave sensor; and a biometric detection that searches for a biometric entity present in the vehicle based on the biometric information and identifies the position and size of the detected biometric entity. and an occupant determination unit that determines the presence or absence of an occupant in a seat of a vehicle and the attributes of the occupant in the seat based on the position of the person's face or the position and size of the living body , the occupant determination unit determines the attributes of the occupant of the seat based on the size of the living body when the living body is detected in the seat where the human face is not detected .

Claims (14)

車両内を撮影した画像である車内画像を取得する車内画像取得部と、
前記車内画像から人物の顔を探索し、検出された顔の位置を特定する顔検出部と、
電磁波センサにより検出された前記車両内の生体情報を取得する生体情報取得部と、
前記生体情報に基づいて前記車両内に存在する生体を探索し、検出された生体の位置およびサイズを特定する生体検出部と、
前記人物の顔の位置又は前記生体の位置およびサイズに基づいて、前記車両の座席の乗員の有無および座席にいる乗員の属性を判断する乗員判断部と、
を備え、
前記乗員判断部は、前記人物の顔が検出されなかった座席で前記生体が検出された場合に、その座席の乗員の属性を前記生体のサイズに基づいて判断する、
乗員検出装置。
an in-vehicle image acquisition unit that acquires an in-vehicle image that is an image of the inside of the vehicle;
a face detection unit that searches for a person's face from the in-vehicle image and identifies the position of the detected face;
a biological information acquisition unit that acquires biological information in the vehicle detected by an electromagnetic wave sensor;
a living body detection unit that searches for a living body existing in the vehicle based on the living body information and specifies the position and size of the detected living body;
an occupant determination unit that determines the presence or absence of an occupant in the seat of the vehicle and attributes of the occupant in the seat based on the position of the person's face or the position and size of the living body;
with
When the living body is detected in a seat where the face of the person is not detected, the occupant determination unit determines the attribute of the occupant of the seat based on the size of the living body.
Occupant detection device.
車両内を撮影した画像である車内画像を取得する車内画像取得部と、
前記車内画像から人物の顔を探索し、検出された顔の位置を特定する顔検出部と、
電磁波センサにより検出された前記車両内の生体情報を取得する生体情報取得部と、
前記生体情報に基づいて前記車両内に存在する生体を探索し、検出された生体の位置およびサイズを特定する生体検出部と、
前記人物の顔の位置又は前記生体の位置およびサイズに基づいて、前記車両の座席の乗員の有無および座席にいる乗員の属性を判断する乗員判断部と、
を備え、
前記乗員判断部は、前記人物の顔が検出された座席で前記生体が検出されなかった場合、その座席は空席と判断する、
乗員検出装置。
an in-vehicle image acquisition unit that acquires an in-vehicle image that is an image of the inside of the vehicle;
a face detection unit that searches for a person's face from the in-vehicle image and identifies the position of the detected face;
a biological information acquisition unit that acquires biological information in the vehicle detected by an electromagnetic wave sensor;
a living body detection unit that searches for a living body existing in the vehicle based on the living body information and specifies the position and size of the detected living body;
an occupant determination unit that determines the presence or absence of an occupant in the seat of the vehicle and attributes of the occupant in the seat based on the position of the person's face or the position and size of the living body;
with
The occupant determination unit determines that the seat is vacant if the living body is not detected in the seat where the person's face is detected.
Occupant detection device.
車両内を撮影した画像である車内画像を取得する車内画像取得部と、
前記車内画像から人物の顔を探索し、検出された顔の位置を特定する顔検出部と、
電磁波センサにより検出された前記車両内の生体情報を取得する生体情報取得部と、
前記生体情報に基づいて前記車両内に存在する生体を探索し、検出された生体の位置およびサイズを特定する生体検出部と、
前記人物の顔の位置又は前記生体の位置およびサイズに基づいて、前記車両の座席の乗員の有無および座席にいる乗員の属性を判断する乗員判断部と、
前記人物の顔の変化を監視することで当該人物の表情の変化を検出する表情変化検出部と、
を備え、
前記乗員判断部は、前記人物の表情に一定時間以上変化がない場合、その人物の顔が検出された座席の乗員の属性を、前記人物の画像ではなく、前記生体のサイズに基づいて判断する、
乗員検出装置。
an in-vehicle image acquisition unit that acquires an in-vehicle image that is an image of the inside of the vehicle;
a face detection unit that searches for a person's face from the in-vehicle image and identifies the position of the detected face;
a biological information acquisition unit that acquires biological information in the vehicle detected by an electromagnetic wave sensor;
a living body detection unit that searches for a living body existing in the vehicle based on the living body information and specifies the position and size of the detected living body;
an occupant determination unit that determines the presence or absence of an occupant in the seat of the vehicle and attributes of the occupant in the seat based on the position of the person's face or the position and size of the living body;
an expression change detection unit that detects changes in facial expression of the person by monitoring changes in the person's face;
with
The occupant determination unit determines the attribute of the occupant of the seat where the person's face is detected based on the size of the living body instead of the image of the person when the facial expression of the person does not change for a predetermined period of time or more. ,
Occupant detection device.
前記乗員判断部は、前記車内画像から前記人物の顔が検出された座席で前記生体が検出された場合、その人物の顔が検出された座席の乗員の属性を、前記車内画像に基づいて判断することに加え、前記生体情報に基づいて判断する、 The occupant determining unit determines, based on the in-vehicle image, the attribute of the occupant in the seat where the person's face is detected when the living body is detected in the seat where the person's face is detected from the in-vehicle image. In addition to doing, making a decision based on the biometric information;
請求項1から請求項3のいずれか一項に記載の乗員検出装置。The occupant detection device according to any one of claims 1 to 3.
前記生体検出部は、前記生体情報に含まれるバイタルサインの検出点の分布に基づいて前記生体の位置およびサイズを判断する、
請求項1から請求項4のいずれか一項に記載の乗員検出装置。
The living body detection unit determines the position and size of the living body based on a distribution of detection points of vital signs included in the biological information.
The occupant detection device according to any one of claims 1 to 4 .
前記乗員判断部は、前記人物の顔が検出された座席の乗員の属性を、前記車内画像に基づき当該人物の年齢を推定することで判断する、
請求項1から請求項5のいずれか一項に記載の乗員検出装置。
The occupant determination unit determines the attribute of the occupant of the seat where the person's face is detected by estimating the age of the person based on the in-vehicle image .
The occupant detection device according to any one of claims 1 to 5 .
前記乗員判断部は、前記人物の顔の特徴から当該人物の年齢を推定する、
請求項に記載の乗員検出装置。
The occupant determination unit estimates the age of the person from the facial features of the person,
The occupant detection device according to claim 6 .
前記乗員判断部は、前記人物の骨格の特徴から当該人物の年齢を推定する、
請求項に記載の乗員検出装置。
The occupant determination unit estimates the age of the person from the skeletal features of the person.
The occupant detection device according to claim 6 .
チャイルドシートが設置された座席を検出するチャイルドシート検出部をさらに備え、
前記乗員判断部は、前記チャイルドシートが設置された座席で前記生体が検出された場合、その座席に子供がいると判断する、
請求項1から請求項8のいずれか一項に記載の乗員検出装置。
Further equipped with a child seat detection unit that detects the seat where the child seat is installed,
The occupant determination unit determines that there is a child in the seat when the living body is detected in the seat in which the child seat is installed.
The occupant detection device according to any one of claims 1 to 8 .
請求項1から請求項9のいずれか一項に記載の乗員検出装置と、 an occupant detection device according to any one of claims 1 to 9;
前記乗員判断部による乗員の属性の判断結果に基づいて、前記車両内の乗員が子供だけの状態であることが検出された場合に、警報を発する警報出力部と、 an alarm output unit that issues an alarm when it is detected that the occupants in the vehicle are children only, based on the judgment result of the occupant attributes by the occupant judgment unit;
を備える、comprising
子供置き去り警報システム。Child Abandonment Alarm System.
乗員検出装置の車内画像取得部が、車両内を撮影した画像である車内画像を取得し、
前記乗員検出装置の顔検出部が、前記車内画像から人物の顔を探索し、検出された顔の位置を特定し、
前記乗員検出装置の生体情報取得部が、電磁波センサにより検出された前記車両内の生体情報を取得し、
前記乗員検出装置の生体検出部が、前記生体情報に基づいて前記車両内に存在する生体を探索し、検出された生体の位置およびサイズを特定し、
前記乗員検出装置の乗員判断部が、前記人物の顔の位置又は前記生体の位置およびサイズに基づいて、前記車両の座席の乗員の有無および座席にいる乗員の属性を判断
前記乗員判断部は、前記人物の顔が検出されなかった座席で前記生体が検出された場合に、その座席の乗員の属性を前記生体のサイズに基づいて判断する、
乗員検出方法。
an in-vehicle image acquisition unit of the occupant detection device acquires an in-vehicle image, which is an image of the interior of the vehicle;
The face detection unit of the occupant detection device searches for a person's face from the in-vehicle image and identifies the position of the detected face,
The biological information acquisition unit of the occupant detection device acquires biological information in the vehicle detected by an electromagnetic wave sensor,
a living body detection unit of the occupant detection device searches for a living body present in the vehicle based on the living body information, and identifies the position and size of the detected living body;
The occupant determination unit of the occupant detection device determines the presence or absence of an occupant in the seat of the vehicle and the attribute of the occupant in the seat based on the position of the person's face or the position and size of the living body;
When the living body is detected in a seat where the face of the person is not detected, the occupant determination unit determines the attribute of the occupant of the seat based on the size of the living body.
Occupant detection method.
乗員検出装置の車内画像取得部が、車両内を撮影した画像である車内画像を取得し、
前記乗員検出装置の顔検出部が、前記車内画像から人物の顔を探索し、検出された顔の位置を特定し、
前記乗員検出装置の生体情報取得部が、電磁波センサにより検出された前記車両内の生体情報を取得し、
前記乗員検出装置の生体検出部が、前記生体情報に基づいて前記車両内に存在する生体を探索し、検出された生体の位置およびサイズを特定し、
前記乗員検出装置の乗員判断部が、前記人物の顔の位置又は前記生体の位置およびサイズに基づいて、前記車両の座席の乗員の有無および座席にいる乗員の属性を判断
前記乗員判断部は、前記人物の顔が検出された座席で前記生体が検出されなかった場合、その座席は空席と判断する、
乗員検出方法。
an in-vehicle image acquisition unit of the occupant detection device acquires an in-vehicle image, which is an image of the interior of the vehicle;
The face detection unit of the occupant detection device searches for a person's face from the in-vehicle image and identifies the position of the detected face,
The biological information acquisition unit of the occupant detection device acquires biological information in the vehicle detected by an electromagnetic wave sensor,
a living body detection unit of the occupant detection device searches for a living body present in the vehicle based on the living body information, and identifies the position and size of the detected living body;
The occupant determination unit of the occupant detection device determines the presence or absence of an occupant in the seat of the vehicle and the attribute of the occupant in the seat based on the position of the person's face or the position and size of the living body;
The occupant determination unit determines that the seat is vacant if the living body is not detected in the seat where the person's face is detected.
Occupant detection method.
乗員検出装置の車内画像取得部が、車両内を撮影した画像である車内画像を取得し、
前記乗員検出装置の顔検出部が、前記車内画像から人物の顔を探索し、検出された顔の位置を特定し、
前記乗員検出装置の生体情報取得部が、電磁波センサにより検出された前記車両内の生体情報を取得し、
前記乗員検出装置の生体検出部が、前記生体情報に基づいて前記車両内に存在する生体を探索し、検出された生体の位置およびサイズを特定し、
前記乗員検出装置の乗員判断部が、前記人物の顔の位置又は前記生体の位置およびサイズに基づいて、前記車両の座席の乗員の有無および座席にいる乗員の属性を判断
前記乗員検出装置の表情変化検出部が、前記人物の顔の変化を監視することで当該人物の表情の変化を検出し、
前記乗員判断部は、前記人物の表情に一定時間以上変化がない場合、その人物の顔が検出された座席の乗員の属性を、前記人物の画像ではなく、前記生体のサイズに基づいて判断する、
乗員検出方法。
an in-vehicle image acquisition unit of the occupant detection device acquires an in-vehicle image, which is an image of the interior of the vehicle;
The face detection unit of the occupant detection device searches for a person's face from the in-vehicle image and identifies the position of the detected face,
The biological information acquisition unit of the occupant detection device acquires biological information in the vehicle detected by an electromagnetic wave sensor,
a living body detection unit of the occupant detection device searches for a living body present in the vehicle based on the living body information, and identifies the position and size of the detected living body;
The occupant determination unit of the occupant detection device determines the presence or absence of an occupant in the seat of the vehicle and the attribute of the occupant in the seat based on the position of the person's face or the position and size of the living body;
The expression change detection unit of the occupant detection device detects changes in the person's facial expression by monitoring changes in the person's face,
The occupant determination unit determines the attribute of the occupant of the seat where the person's face is detected based on the size of the living body instead of the image of the person when the facial expression of the person does not change for a predetermined period of time or more. ,
Occupant detection method.
請求項11から請求項13のいずれか一項に記載の乗員検出方法により前記車両の座席の乗員の有無および座席にいる乗員の属性を判断し、 determining the presence or absence of an occupant in the seat of the vehicle and the attribute of the occupant in the seat by the occupant detection method according to any one of claims 11 to 13;
前記乗員判断部による乗員の属性の判断結果に基づいて、前記車両内の乗員が子供だけの状態であることが検出された場合に、子供置き去り警報システムの警報出力部が警報を発する、 When it is detected that the occupant in the vehicle is a child alone based on the judgment result of the occupant attribute by the occupant judgment unit, the alarm output unit of the child abandonment alarm system issues an alarm.
子供置き去り警報方法。Child abandonment alert method.
JP2022527432A 2020-05-29 Occupant Detection Device, Child Abandoned Alarm System, Occupant Detection Method and Child Abandoned Alarm Method Pending JPWO2021240769A5 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/021303 WO2021240769A1 (en) 2020-05-29 2020-05-29 Passenger detection device and passenger detection method

Publications (2)

Publication Number Publication Date
JPWO2021240769A1 JPWO2021240769A1 (en) 2021-12-02
JPWO2021240769A5 true JPWO2021240769A5 (en) 2022-09-02

Family

ID=

Similar Documents

Publication Publication Date Title
US11383721B2 (en) System and method for responding to driver state
EP3158392B1 (en) System and method for responding to driver state
JP4400624B2 (en) Dozing prevention device and method
US9105172B2 (en) Drowsiness-estimating device and drowsiness-estimating method
JPWO2021240777A5 (en) Occupant Detection Device, Child Abandoned Alarm System, Occupant Detection Method and Child Abandoned Alarm Method
WO2020235306A1 (en) Control system and presentation system
JP6701951B2 (en) Driving support device
CN110562003A (en) In-vehicle device control device
JPWO2021240769A5 (en) Occupant Detection Device, Child Abandoned Alarm System, Occupant Detection Method and Child Abandoned Alarm Method
JP2012093867A (en) Notification system
JP6772775B2 (en) Driving support device and driving support method
KR102613180B1 (en) Vehicle and control method for the same
CN206938601U (en) A kind of vehicle-mounted loudspeaker device and vehicle
JP2020013554A (en) Arousal level determination device
JP2001097070A (en) Person recognizing device for vehicle
Victoreia et al. Driver fatigue monitoring system using eye closure
FR2998180A1 (en) Method for managing sleep of driver of car, involves generating stimuli based on measured indicator of heart rate and alertness of driver, where generation of stimuli is automatically adapted according to heart rate of driver
GB2556410A (en) System for managing alertness of a driver
JP2022155398A (en) Occupant state detection system
TWM624732U (en) Biological sensing device for vehicles
Durgaa Chandrakala et al. Proactive integrated detection of eye blinking & yawning to identify sleepy driver and alert based auto-braking system for speed control
JP2021175418A (en) Sleepiness determination device and sleepiness determination method