CN214084149U

CN214084149U - Passenger monitoring system and vehicle

Info

Publication number: CN214084149U
Application number: CN202022836201.9U
Authority: CN
Inventors: 陈婷; 刘涛; 成元祎
Original assignee: Zeifu Automotive Technology Shanghai Co ltd
Current assignee: Zeifu Automotive Technology Shanghai Co ltd
Priority date: 2020-12-01
Filing date: 2020-12-01
Publication date: 2021-08-31
Anticipated expiration: 2030-12-01

Abstract

The utility model relates to a driving safety technical field provides a passenger monitoring system and vehicle. An occupant monitoring system includes: the driving detection device is used for detecting the driving state of the vehicle; and the passenger detection device is arranged in a passenger cabin of the vehicle, comprises a camera component and a radar, wherein the detection range covers the passenger cabin and at least partially overlaps the camera component, and is connected with the driving detection device and used for acquiring the information of passengers in the passenger cabin under the triggering of the driving state. The utility model discloses a detection range covers passenger cabin and camera module and radar that at least part overlaps realize the accurate detection to passenger cabin, improve the detection accuracy; and trigger passenger detection device through driving state, realize detecting according to driving state in good time, applicable passenger in the parking state leaves over the monitoring, and the risk is in time foreseen, improves driving safety.

Description

Passenger monitoring system and vehicle

Technical Field

The utility model relates to a driving safety technical field, specifically speaking relates to a passenger monitoring system and vehicle.

Background

For driving safety, the existing vehicles are provided with sensors in the passenger compartment to monitor passengers and predict risks.

For example, the existing solutions usually provide a cushion sensor on the seat, and determine whether there is a person in the vehicle and the classification of the occupant by sensing the weight and the distribution of the weight.

The monitoring scheme has the defects that people and objects cannot be distinguished, and the false alarm rate is high. And the accuracy rate of passenger classification is low, and can't accurate judgement passenger be children or adult, if realize accurate judgement, then need install the cushion sensor that the cost is high additional, be unfavorable for popularizing and applying.

It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present invention and therefore may include information that does not constitute prior art known to a person of ordinary skill in the art.

SUMMERY OF THE UTILITY MODEL

In view of this, the utility model provides a passenger monitoring system and vehicle can realize the comprehensive detection in passenger cabin and passenger's accurate discernment.

An aspect of the utility model provides a passenger monitoring system, include: the driving detection device is used for detecting the driving state of the vehicle; and the passenger detection device is arranged in a passenger cabin of the vehicle, comprises a camera component and a radar, wherein the detection range covers the passenger cabin and at least partially overlaps the camera component, and the passenger detection device is connected with the driving detection device and is used for acquiring passenger information in the passenger cabin under the triggering of the driving state.

In some embodiments, the camera assembly comprises: the first TOF camera is rotatably arranged in a front row area of the passenger cabin, and the detection range of the first TOF camera at least movably covers a front row seat area of the passenger cabin; and the second TOF camera is rotatably arranged in the middle or rear area of the passenger cabin, and the detection range of the second TOF camera at least movably covers the rear seat area of the passenger cabin.

In some embodiments, the radar includes one or more, and a detection range of the radar covers the passenger compartment.

In some embodiments, the occupant detection device is connected to the traffic detection device through an electronic control unit of the vehicle.

In some embodiments, the camera assembly is connected to the electronic control unit through an image processor, and the radar and the driving detection device are connected to the electronic control unit through a CAN module.

In some embodiments, the driving detection device includes: an engine sensor for detecting an engine state of the vehicle; a vehicle speed sensor for detecting a vehicle speed state of the vehicle; a door sensor for detecting a door state of the vehicle.

In some embodiments, the occupant monitoring system further comprises: and the reminding device is connected with the driving detection device and the passenger detection device through an electronic control unit of the vehicle and is used for sending out a reminder under the triggering of the electronic control unit.

In some embodiments, the reminder device comprises: the vehicle-mounted component comprises a vehicle-mounted display screen and a vehicle-mounted sound box; the vehicle body component is connected with the electronic control unit through a vehicle body control module of the vehicle; and the mobile equipment is connected with the electronic control unit through a wireless communication module of the vehicle.

In some embodiments, the body components include doors, windows, air conditioners, speakers, and headlights of the vehicle.

Another aspect of the present invention provides a vehicle equipped with the occupant monitoring system of any of the above embodiments.

Compared with the prior art, the utility model beneficial effect include at least:

the camera assembly and the radar which cover the passenger cabin in the detection range and are at least partially overlapped are used, so that the detection of the camera assembly and the detection of the radar are mutually fused to jointly make more comprehensive and more accurate judgment, and the detection of the camera assembly and the detection of the radar can be mutually redundant in a specific scene and are mutually verified, so that the accurate monitoring of all passengers in the whole passenger cabin is realized, the missing identification is prevented, and the detection precision is improved;

triggering passenger detection device through driving state, realizing detecting according to driving state in good time, applicable passenger in the parking state leaves over the monitoring, and the risk is in time foreseen, improves driving safety.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention as claimed.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention. It is obvious that the drawings described below are only some embodiments of the invention, and that for a person skilled in the art, other drawings can be obtained from these drawings without inventive effort.

Fig. 1 is a schematic diagram showing the main components of an occupant monitoring system according to an embodiment of the present invention;

fig. 2 is a schematic view showing the arrangement structure of an occupant detection device according to an embodiment of the present invention;

fig. 3 and 4 show schematic diagrams of rotating a second TOF camera to monitor a particular region in an embodiment of the invention;

fig. 5 shows a specific composition structure and a data transmission diagram of an occupant monitoring system according to an embodiment of the present invention;

fig. 6 is a schematic step diagram illustrating a method for reminding a passenger leaving behind in an embodiment of the present invention;

fig. 7 is a schematic view of a monitoring flow of a scene left by a child during parking in an embodiment of the present invention;

fig. 8 shows a schematic monitoring flow diagram of a scene left by an adult during parking in the embodiment of the present invention.

Detailed Description

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art.

Furthermore, the drawings are merely schematic illustrations of the present invention, which are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.

The step numbers in the following embodiments are merely used to indicate different execution contents, and the execution order between the steps is not strictly limited. The use of "first," "second," and similar terms in the detailed description is not intended to imply any order, quantity, or importance, but rather is used to distinguish one element from another. It should be noted that features of the embodiments and different embodiments of the present invention may be combined with each other without conflict.

Fig. 1 shows the main constituent structure of an occupant monitoring system in the embodiment, and referring to fig. 1, the occupant monitoring system in the embodiment includes: a driving detection device 110 for detecting a driving state of the vehicle; and the passenger detection device 120 is arranged in a passenger compartment of the vehicle, comprises a camera assembly 121 and a radar 122, wherein the detection range covers the passenger compartment and is at least partially overlapped, and the passenger detection device 120 is connected with the driving detection device 110 and is used for acquiring passenger information in the passenger compartment under the triggering of the driving state.

According to the passenger monitoring system of the embodiment, the detection range covers the passenger cabin, the camera assembly 121 and the radar 122 are at least partially overlapped, so that the detection of the camera assembly 121 and the detection of the radar 122 are mutually fused to make more comprehensive and accurate judgment, the detection of the camera assembly and the detection of the radar can be mutually redundant in a specific scene and are verified mutually, the accurate monitoring of all passengers in the whole passenger cabin is realized, the missing recognition is prevented, and the detection accuracy is improved; and the passenger detection device 120 is triggered through the driving state, so that timely detection according to the driving state is realized, the passenger detection device is suitable for monitoring the leaving of passengers in the parking state, the risk is predicted in time, and the driving safety is improved.

Because the detection area of a common camera is limited, even if a wide-angle camera is adopted, the whole passenger compartment is difficult to cover, and when the body part of a passenger exceeds the field angle of the camera (for example, a child is positioned on a foot pad and leans against a side car door), missing identification is easy to occur; in a living body recognition scene, when the camera and a passenger are shielded (such as a passenger covers a blanket and wears a hat), or the distance between the passenger and the passenger is too close, the common camera is easy to miss recognition. Therefore, the following embodiments achieve comprehensive accurate detection of the passenger compartment through the TOF camera and radar combination.

Fig. 2 shows a configuration structure of an occupant detection device in the embodiment, and as described with reference to fig. 2, in one specific example, an image pickup assembly includes: a first TOF camera 1211 rotatably provided in a front row area of the passenger compartment 200, a detection range 121a of the first TOF camera 1211 at least movably covering a front row seat area of the passenger compartment 200; and the second TOF camera 1212 is rotatably arranged in the middle or rear area of the passenger compartment 200, and the detection range 121b of the second TOF camera 1212 at least movably covers the rear seat area of the passenger compartment 200.

The TOF (Time of flight) technology can realize 3D imaging and monitor the space in the vehicle, is not influenced by ambient light, and can normally work in strong light and dark environments. The TOF technology can obtain accurate and stable depth data, human body recognition is achieved, and meanwhile, the risk of privacy disclosure is avoided. The occupant identification algorithm based on the 3D image can accurately identify and determine the number, location, and classification of occupants within the passenger compartment 200, which will be described in detail below in connection with the occupant carry-over reminder method.

In this embodiment, the front-row seat area and the rear-row seat area are monitored in real time by two TOF cameras. Of course, the layout of the image capturing assemblies is not limited as shown in fig. 2, and in other examples, the positions, the number, and the like of the image capturing assemblies may be adjusted in combination with the spatial position of the passenger compartment 200 to achieve a wider detection angle of view by the rotatable TOF camera, covering the detection of the entire passenger compartment 200.

The rotatable TOF camera can also accurately monitor a particular region. Fig. 3 and 4 illustrate a scenario in which a second TOF camera is rotated to monitor a particular region, and in conjunction with fig. 2 and 3, in the conventional scenario illustrated in fig. 2, a first TOF camera 1211 monitors the front row seat region and additionally monitors the middle rear seat region, and a second TOF camera 1212 monitors the rear row seat region. Controlling the second TOF camera 1212 to rotate to align with the rear left seat 201 allows for targeted monitoring of the occupant condition of the rear left seat 201. Of course, if the second TOF camera 1212 is controlled to rotate to align with other seat areas, such as the right rear seat, the middle rear seat, etc., then the occupant condition of the other seat areas can be monitored specifically. Referring to FIG. 4, the second TOF camera 1212 can also be rotated downward to monitor the back row footpad area 202; the front row seat back can now be rotated forward to avoid obscuring the rear row footpad area 202. Further, the front seat may also be moved backward, the front seatback rotated backward, and the second TOF camera 1212 rotated forward to monitor the front foot pad area, and the front seat and the seatback may be adjusted back to the initial position after the monitoring is completed.

Of course, fig. 3 and 4 are illustrative of rotating the second TOF camera 1212 to monitor a particular region. In other examples, targeted monitoring of a particular region may also be achieved by rotating the first TOF camera 1211, which is not repeated here.

Further, referring to fig. 2, the radar 122 may be disposed in the middle, front, middle, rear, or both sides of the passenger compartment 200, the radar 122 may include one or more, and is not limited to the illustration in fig. 2, and the detection range 1220 of the radar 122 covers the passenger compartment 200. The radar 122 has a high in vivo detection accuracy, typically > 99%, and is not disturbed by a non-metallic cover. Through the integrated design of the radar 122 and the first TOF camera 1211 and the second TOF camera 1212, the radar and the TOF camera make full use of the advantages of each other, are redundant to each other, and verify each other, so that a higher safety level is provided for the vehicle, especially for the automatic driving vehicle.

In one embodiment, the occupant detection device is connected to the driving detection device through an Electronic Control Unit (ECU) of the vehicle, so as to analyze the driving parameters detected by the driving detection device and the occupant information detected by the occupant detection device through the ECU. Further, the ECU may transmit the analysis result to a Body Control Module (BCM) of the vehicle to Control related components of the vehicle, thereby implementing safety intervention.

Fig. 5 shows a specific composition structure and a data transmission flow of the occupant monitoring system in the embodiment, and in combination with fig. 2 and 5, the driving detection device 110 specifically includes: an engine sensor 111 for detecting an engine state of the vehicle; a vehicle speed sensor 112 for detecting a vehicle speed state of the vehicle; a door sensor 113 for detecting a door state of the vehicle; the driving state comprises a transmitter state, a vehicle speed state and a vehicle door state. The driving detection device 110 and the occupant detection device 120 are both connected to the electronic control unit 130. The camera assembly 121 may be connected to the electronic control unit 130 through an image processor 310, and the image processor 310 may include a TOF driving module and an image processing module, and process an original image acquired by the camera assembly 121 to obtain occupant information including the number, position, classification, body posture, joint information, and the like of the occupants, and transmit the occupant information to the electronic control unit 130. The radar 122 and the traffic detection device 110 are connected to the electronic control unit 130 via a CAN module 320. The CAN module 320 is included in the electronic control unit 130 for processing CAN signals. The driving detection device 110 transmits the collected driving parameters including the engine state, the vehicle speed state and the vehicle door state to the electronic control unit 130 through the CAN module 320, and the radar 122 transmits the collected passenger information including the number, position, classification, respiration/heartbeat, etc. of the passengers to the electronic control unit 130 through the CAN module 320. Therefore, the electronic control unit 130 determines the current scene of the passenger according to the driving parameters and the passenger information, and performs the safety intervention. The specific logic of the electronic control unit 130 will be described below in conjunction with the occupant leaving alert method.

Further, the occupant monitoring system further comprises: reminder 140 is connected to driving detection device 110 and occupant detection device 120 through electronic control unit 130, and reminder 140 is configured to issue a reminder under the trigger of electronic control unit 130.

The reminding device 140 specifically includes: the vehicle-mounted component 141 comprises a vehicle-mounted display screen 1411 and a vehicle-mounted sound box 1412 and can issue in-vehicle reminders; the in-vehicle display screen 1411 may further receive the infrared image and the depth image generated by the image processor 310 for real-time display. A body member 142 connected to the electronic control unit 130 through a body control module 330; the body components 142 specifically include doors, windows, air conditioners, speakers, and headlights for sending body alerts. And a mobile device 143 connected to the electronic control unit 130 through a Vehicle wireless communication module (Vehicle to X, abbreviated as V2X)340 for issuing a remote reminder. The mobile device 143 is, for example, a cell phone of a driver and/or an occupant in a vehicle, and the wireless communication module 340 can also Call an E-Call emergency rescue in case of an emergency.

The utility model also provides a vehicle, this vehicle dispose the passenger monitoring system that above-mentioned arbitrary embodiment described. As described above, the vehicle equipped with the occupant monitoring system can realize accurate monitoring of all occupants in the whole occupant compartment through the camera module and the radar which cover the occupant compartment in the detection range and are at least partially overlapped; triggering passenger detection device through driving state, realizing detecting according to driving state in good time, applicable passenger in the parking state leaves over the monitoring, and the risk is in time foreseen, improves driving safety.

The utility model also provides a passenger leaves over and reminds method, can be carried out by the passenger monitoring system that above-mentioned arbitrary embodiment described, mainly be by the electronic control unit to the driving parameter and the passenger information analysis that the collection obtained to combine the relevant part of automobile body control module control to realize safe intervention, main data transmission process can be as shown in fig. 5. Of course, in some embodiments, the occupant leave-behind alert method may also be performed by a separate control module that may communicate with the relevant components of the vehicle and predict risks and take safety interventions.

Fig. 6 shows the main steps of the occupant leaving behind reminding method in the embodiment, and referring to fig. 6, the occupant leaving behind reminding method in the embodiment includes: in step S410, in response to a parking signal of the vehicle, occupant information in the occupant compartment is obtained; in step S420, determining a legacy scene based on at least occupant information; and in step S430, sending out a reminder according to the legacy scene.

The parking signal of the vehicle is sent out when the vehicle speed is detected to be zero, and the parking signal can be sent out under the conditions that the vehicle is in a P gear, the vehicle is flamed out and the like, so that the detection of the left-over scene is started. The passenger state when the vehicle is parked can be accurately identified by the passenger information obtained in response to the parking signal of the vehicle; of course, the passengers can be monitored in real time during the running process of the vehicle.

The process of determining the legacy scenario specifically includes: obtaining first occupant information acquired by a camera assembly of the vehicle and second occupant information acquired by a radar of the vehicle; and determining whether a living body is left in the passenger compartment according to the first passenger information and the second passenger information. Through the TOF camera combined with the assistance of the radar, whether a living body is left in the passenger compartment or not and the number and the positions of the living bodies can be accurately identified, and passengers can be further classified (adults/children). The occupant classification can be performed by using the existing technology, for example, by body type judgment, and the present invention does not limit the technology.

When determining whether the left living body exists in the passenger cabin, the first passenger information and the second passenger information are subjected to fusion processing, and redundancy check is performed under specific conditions, so that whether the left living body exists in the passenger cabin is comprehensively and accurately judged according to the first passenger information and the second passenger information.

After the living bodies left in the passenger cabin are determined, the left scenes can be determined and corresponding reminding information can be sent out by combining specific driving parameters/passenger information, so that safe intervention can be realized.

The following specifically describes the passenger leaving reminding method in combination with the three leaving scenes. Except that three kinds listed below leave over the scene, the utility model discloses a passenger leaves over warning method and can also be applied to other scene judgement and the warning of leaving over.

The first type of left-over scene is a scene left over by children, the scene left over by children in a parking state can be determined by combining engine/vehicle speed/vehicle door logic, and classification reminding meeting the requirements of regulations is performed on the left-over children, so that the safety of the children is ensured.

Specifically, in a child left scene, a process of sending out a reminder according to the left scene includes: when it is determined that the legacy children exist in the passenger compartment, including the situation that the children and the adults are legacy at the same time, generating a first legacy scene; monitoring a door state of the vehicle in response to the first legacy scenario; in the first preset time that the door is opened, a first prompt is sent out through a vehicle-mounted assembly of the vehicle. The first preset time is 10 seconds, for example, and in the first preset time when the vehicle door is opened, other passengers may be in a getting-off state or not far away from the vehicle, so that the vehicle-mounted component sends out a first prompt to prompt the other passengers to avoid forgetting the left children in the passenger compartment. The vehicle-mounted component comprises a vehicle-mounted display screen and a vehicle-mounted sound box and can give out visual reminding and auditory reminding.

Further, after sending out first warning through the on-vehicle subassembly, still include: continuously monitoring the first legacy scenario; and when the duration of the first left-over scene exceeds a second preset time, sending a second prompt through a body part of the vehicle and a mobile device associated with the vehicle. The first left-over scenario is continuously monitored by continuously collecting occupant information in the occupant compartment and determining whether a child is left over. The second preset time is usually less than 90 seconds, and the continuous monitoring after parking is realized by continuously monitoring the first left-over scene.

The manner of sending the second reminder by the vehicle body part and the mobile device specifically includes one or more of the following measures: the sound and light signals with the same frequency as the distress signal are sent out by a horn and a headlight of the vehicle so as to attract passers-by to save the left children; reminder information is pushed to a mobile device, such as a driver's cell phone or the like, at a first frequency. And when a second reminding mode of pushing reminding information to the mobile equipment is adopted, continuously sending out a second reminding and monitoring the feedback of the mobile equipment at the same time until the confirmation feedback of the mobile equipment is received, and stopping the second reminding.

Further, when the duration of the first legacy scenario exceeds a third preset time, which is 5 minutes for example, a third reminder is issued, which includes one or more of the following measures: initiating an emergency Call for the vehicle, such as dialing an E-Call emergency rescue, to notify personnel associated with an organization, such as a rescue center, to save the legacy child in the future; reducing the windows of the vehicle and/or starting the air conditioner of the vehicle to realize the air circulation in the vehicle; pushing reminding information to the mobile equipment at a second frequency higher than the first frequency; and the position of the mobile device is monitored until the mobile device enters the sensing distance range of the vehicle, for example, one meter distance range of the vehicle, when the user of the mobile device is ensured to reach the vicinity of the vehicle and can immediately save the left-over children, the third reminding is stopped, and rescue release information is sent to mechanisms such as a rescue center.

Fig. 7 shows a monitoring process of a scene left by a child during parking in a specific example, which specifically includes: after the occupant monitoring function is turned on, S710-11, detecting that the vehicle is parked, such as the vehicle speed is reduced to zero, the vehicle is in P-gear, the vehicle is turned off, and the like; s710-22, obtaining passenger information in a passenger compartment; s720, judging whether at least one child is left in the passenger compartment, if so, generating a first left scene, otherwise, ending the monitoring process of the child left scene. S730-11, monitoring the state of the vehicle door of the vehicle, and judging whether the vehicle door is opened; and S730-22, sending a first prompt through the vehicle-mounted assembly within 10 seconds of opening the vehicle door. S730-33, continuously monitoring the first left-over scene, namely repeatedly obtaining passenger information in the passenger cabin and judging whether left-over children exist in the passenger cabin; and S730-44, when the judgment is yes, namely the child is still left in the passenger compartment, sending a second prompt through the vehicle body part and the mobile equipment within 90 seconds. S730-55, continuously monitoring the first left-over scene, namely repeatedly obtaining passenger information in the passenger cabin and judging whether left-over children exist in the passenger cabin; and S730-66, when the judgment is yes, namely the child still remains in the passenger compartment, activating, for example, an E-Call after 5 minutes from the triggering of the first reminding, and sending out a third reminding through the vehicle body part and the mobile equipment. Therefore, safety intervention under the scene that children leave behind is achieved through three-level reminding by combining the vehicle and the mobile device, and safety of the children is guaranteed.

The second type leaves over the scene and leaves over the scene only for the adult, can combine the respiratory frequency monitoring of radar, whether analysis passenger is in the sleep state to carry out hierarchical warning to passenger's sleep state, in order to avoid the long-time car that is detained of passenger after the parking.

Specifically, in an adult legacy scenario, the process of sending out the reminder according to the legacy scenario includes: when only adults are left in the passenger compartment, judging whether the left adults are in a sleeping state; if so, generating a second legacy scene, and continuously monitoring the second legacy scene; and when the duration of the second legacy scene exceeds the first set time, for example, 10 minutes, a wake-up reminder is sent out. The wake-up reminder specifically includes one or more of the following measures: the vehicle-mounted sound system sends out voice reminding, mobile equipment in the vehicle sends out ring reminding, and a seat and/or a safety belt sends out vibration reminding and the like to assist a passenger to wake up independently.

Further, after the wake-up reminder is sent out, the method further includes: when the duration of the second left scene exceeds a second set time, for example, 30 minutes, it indicates that the wake-up reminder for assisting the passenger to wake up autonomously is not effective, so that the windows of the vehicle are lowered and/or the air conditioner of the vehicle is turned on to purify the air in the vehicle; and meanwhile, the emergency call of the vehicle is started, so that the detained passengers are ensured to be rescued in time.

Fig. 8 shows a monitoring process of an adult left scene during parking in a specific example, which specifically includes: after the passenger monitoring function is started, S810-11, detecting that the vehicle is parked; s810-22, obtaining passenger information in a passenger compartment; and S820, judging whether adults exist in the passenger compartment or not and only leave the adults, if so, generating a second left scene and continuously monitoring the second left scene, and if not, finishing the monitoring process of the adult left scene. And S830-11, sending out a wake-up reminder after the adult stays in the vehicle for 10 minutes. After the wake-up reminder is sent out, whether the vehicle is flamed out or not can be further judged through S830-22, if yes, the wake-up reminder is continuously sent out, and if not, the vehicle is parked at the moment, namely the vehicle speed is zero, but the vehicle is not flamed out, so that S830-33 is executed to flameout the vehicle, the phenomenon that the health is endangered due to long-time starting of the internal circulation is avoided, and a second left-over scene is continuously monitored. S830-44, continuously monitoring a second remaining scene, namely repeatedly obtaining the passenger information in the passenger compartment and judging whether the passenger compartment has the adult remaining and only the adult remaining; and S830-55, if the judgment is yes, namely the person still remains in the passenger compartment, activating, for example, E-Call after 30 minutes, and purifying the air in the passenger compartment by lowering a vehicle window, starting an air conditioner and the like. Therefore, safety intervention under adult leaving scenes is achieved through awakening reminding and external force reminding.

And the third left scene is a scene after parking, and the scene is left by passengers when the parking signal is removed, so that the information of the passengers after parking and when the parking signal is removed can be contrasted and analyzed by combining the logic of an engine/vehicle speed and a vehicle door, and whether the passengers leave over is judged.

Specifically, the step of determining the left-behind scene when the parking signal is released further includes: obtaining a first number of occupants in a passenger compartment; when the door of the vehicle is opened and the parking signal is released, acquiring the number of second passengers in the passenger compartment; comparing the first number of passengers with the second number of passengers; when the second number of occupants is less than the first number of occupants, a third carry-over scenario is generated. The third legacy scenario is used to indicate that the number of occupants when the vehicle is restarted is less than the original number of occupants, and to prompt potential missing occupants in time.

Further, in the third legacy scenario, the process of sending out the reminder according to the legacy scenario includes: acquiring a first face set corresponding to the first number of passengers and a second face set corresponding to the second number of passengers; comparing the first face set with the second face set to determine the left-behind passengers; and pushing the face information of the left passenger to a vehicle-mounted display screen of the vehicle. Through the face information, passengers in the vehicle can accurately and quickly determine the left passengers. Of course, the acquisition of the face information may be performed with the permission of the occupant. For example, after a passenger gets on the vehicle, a face information acquisition prompt can be pushed to the mobile device of the passenger, and the face information acquisition can be carried out after the passenger authorizes and permits.

After the on-vehicle display screen of people's face information propelling movement to the vehicle will leave over, still include: pushing a recovery prompt to mobile equipment of a left passenger in response to recovery operation triggered by a vehicle-mounted display screen; and acquiring first position information of the vehicle and second position information of the mobile equipment of the left-behind passenger, and pushing the first position information and a navigation route from the second position information to the first position information to the mobile equipment of the left-behind passenger so as to remind and assist the left-behind passenger to timely return to the vehicle.

In summary, the method for reminding the leaving of the passenger described in each embodiment can accurately judge whether the passenger is left after the vehicle is parked by combining the driving parameters and the passenger information, determine the leaving scene and timely send out the reminding, thereby realizing the safety intervention and improving the driving safety.

The foregoing is a more detailed description of the present invention, taken in conjunction with the specific preferred embodiments thereof, and it is not intended that the invention be limited to the specific embodiments shown and described. To the utility model belongs to the technical field of ordinary technical personnel, do not deviate from the utility model discloses under the prerequisite of design, can also make a plurality of simple deductions or replacement, all should regard as belonging to the utility model discloses a protection scope.

Claims

1. An occupant monitoring system, comprising:

the driving detection device is used for detecting the driving state of the vehicle; and

the passenger detection device is arranged in a passenger cabin of the vehicle, comprises a camera component and a radar, wherein the detection range covers the passenger cabin and at least partially overlaps the camera component, and the passenger detection device is connected with the driving detection device and used for acquiring passenger information in the passenger cabin under the triggering of the driving state.

2. The occupant monitoring system of claim 1, wherein the camera assembly comprises:

the first TOF camera is rotatably arranged in a front row area of the passenger cabin, and the detection range of the first TOF camera at least movably covers a front row seat area of the passenger cabin;

and the second TOF camera is rotatably arranged in the middle or rear area of the passenger cabin, and the detection range of the second TOF camera at least movably covers the rear seat area of the passenger cabin.

3. The occupant monitoring system of claim 1, wherein the radar includes one or more, and a detection range of the radar covers the occupant compartment.

4. The occupant monitoring system of claim 1, wherein the occupant detection device is coupled to the traffic detection device via an electronic control unit of the vehicle.

5. The occupant monitoring system according to claim 4, wherein the camera assembly is connected to the electronic control unit through an image processor, and the radar and the traffic detection device are connected to the electronic control unit through a CAN module.

6. The occupant monitoring system of claim 1, wherein the traffic detection device comprises:

an engine sensor for detecting an engine state of the vehicle;

a vehicle speed sensor for detecting a vehicle speed state of the vehicle;

a door sensor for detecting a door state of the vehicle.

7. The occupant monitoring system of claim 1, further comprising:

and the reminding device is connected with the driving detection device and the passenger detection device through an electronic control unit of the vehicle and is used for sending out a reminder under the triggering of the electronic control unit.

8. The occupant monitoring system of claim 7, wherein the reminder device includes:

the vehicle-mounted component comprises a vehicle-mounted display screen and a vehicle-mounted sound box;

the vehicle body component is connected with the electronic control unit through a vehicle body control module of the vehicle;

and the mobile equipment is connected with the electronic control unit through a wireless communication module of the vehicle.

9. The occupant monitoring system of claim 8, wherein the body components include doors, windows, air conditioners, speakers, and headlamps of the vehicle.

10. A vehicle, characterized in that the vehicle is provided with an occupant monitoring system according to any one of claims 1-9.