CN112208475A - Safety protection system for vehicle occupants, vehicle and corresponding method and medium - Google Patents
Safety protection system for vehicle occupants, vehicle and corresponding method and medium Download PDFInfo
- Publication number
- CN112208475A CN112208475A CN201910616972.6A CN201910616972A CN112208475A CN 112208475 A CN112208475 A CN 112208475A CN 201910616972 A CN201910616972 A CN 201910616972A CN 112208475 A CN112208475 A CN 112208475A
- Authority
- CN
- China
- Prior art keywords
- occupant
- vehicle
- relationship
- another
- seating area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R21/02—Occupant safety arrangements or fittings, e.g. crash pads
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9536—Search customisation based on social or collaborative filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/0202—Child monitoring systems using a transmitter-receiver system carried by the parent and the child
- G08B21/0205—Specific application combined with child monitoring using a transmitter-receiver system
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/0202—Child monitoring systems using a transmitter-receiver system carried by the parent and the child
- G08B21/028—Communication between parent and child units via remote transmission means, e.g. satellite network
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Child & Adolescent Psychology (AREA)
- Databases & Information Systems (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Library & Information Science (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Mechanical Engineering (AREA)
- Alarm Systems (AREA)
Abstract
A safety protection system for a vehicle occupant, a vehicle including the same, and a corresponding safety protection method and computer-readable storage medium for a vehicle occupant are provided. The system comprises: an image acquisition unit configured to acquire images of two or more occupants within a vehicle; an image analysis unit that acquires, based on image analysis, identity information, a seating area, and a position at which a body part is located of each occupant in the vehicle, and detects whether the body part of at least one occupant is located in the seating area of another occupant; the passenger identity relationship judging unit is used for judging whether the social relationship between the at least one passenger and the other passenger belongs to a trust relationship or a non-trust relationship according to the identity information of the at least one passenger and the other passenger; and a safety protection triggering unit for triggering the safety protection measures. By utilizing the scheme of the invention, the invasion/disturbance event can be automatically judged and the safety protection measures can be triggered to be taken so as to ensure the safety of passengers.
Description
Technical Field
The present invention relates to the field of vehicle technology, and more particularly, to a safety protection system for a vehicle occupant, a vehicle including the same, and a corresponding safety protection method and computer-readable storage medium for a vehicle occupant.
Background
The sharing economy has extended into the vehicle field. Now, more and more people have the opportunity to take the same vehicle for travel, and the people may not know each other but only travel with the same vehicle. In these cases, it is possible that an attack, such as a disturbance, of one occupant on another person may occur. This is particularly likely to occur in the case of an unmanned taxi.
In the prior art, a solution for real-time video monitoring of the interior of a vehicle exists, but such a solution can monitor all passengers in the vehicle in real time, which on one hand can violate the privacy of the passengers, and on the other hand can cause the passengers to be uncomfortable due to the existence of video monitoring, thereby affecting the traveling experience. In addition, specialized personnel are required to closely monitor real-time video.
Accordingly, there is a need for a safety protection system that can automatically determine an intrusion/nuisance event and trigger the taking of safety protection measures to ensure occupant safety.
Disclosure of Invention
In order to solve the technical problem, the invention provides a safety protection scheme for a vehicle passenger, which aims to automatically judge an invasion event possibly occurring in a vehicle and trigger safety protection measures to be taken so as to ensure the safety of the passenger.
Specifically, according to a first aspect of the present invention, there is provided a safety protection system for a vehicle occupant, the system comprising:
an image acquisition unit configured to acquire images of two or more occupants within a vehicle;
an image analysis unit configured to acquire identity information, a seating area, and a position of a body part of each occupant in the vehicle based on an analysis of the image acquired by the image acquisition unit, and further detect whether the body part of at least one occupant is located in the seating area of another occupant;
an occupant identification relationship determination unit configured to determine, when it is detected that a body part of at least one occupant is located in a seating area of another occupant, whether a social relationship between the at least one occupant and the another occupant belongs to a trusted relationship or an untrusted relationship, based on identification information of the at least one occupant and the another occupant; and
a safety protection triggering unit configured to trigger taking of a safety protection measure when it is detected that a body part of at least one occupant is located in a seating area of another occupant and it is determined that a social relationship between the at least one occupant and the another occupant belongs to an untrusted relationship.
In one embodiment, the identity information includes a social network identification.
In one embodiment, the occupant identification relationship determination unit determines whether the social relationship between the at least one occupant and the another occupant belongs to a trusted relationship or a non-trusted relationship based on social network interactions associated with the social network identification.
In one embodiment, triggering the taking of the security precautions includes at least one of:
wirelessly transmitting an alert signal to a remote server; and
the image captured by the image capture unit is wirelessly transmitted to a remote server.
In one embodiment, the system further comprises a response unit that performs security measures in response to feedback from the remote server.
In one embodiment, the security measures include at least one of:
guiding the vehicle to stop at the side;
guiding the vehicle to a designated destination; and
a visual and/or audible alarm is issued.
According to a second aspect of the invention, a vehicle is provided comprising a safety protection system for a vehicle occupant according to the first aspect of the invention.
According to a third aspect of the present invention, there is provided a method of safety protection for a vehicle occupant, the method comprising:
capturing images of two or more occupants within a vehicle;
acquiring identity information, a seating area and a position of a body part of each occupant in the vehicle based on analysis of the acquired images, and further detecting whether the body part of at least one occupant is located in the seating area of another occupant;
upon detecting that a body part of at least one occupant is located in a seating area of another occupant, determining whether a social relationship between the at least one occupant and the another occupant belongs to a trusted relationship or a non-trusted relationship based on identity information of the at least one occupant and the another occupant; and
triggering a safety precaution action to be taken upon detecting that a body part of at least one occupant is located in a seating area of another occupant and determining that a social relationship between the at least one occupant and the another occupant belongs to an untrusted relationship.
In one embodiment, the identity information includes a social network identification.
In one embodiment, whether the social relationship between the at least one occupant and the another occupant is a trusted relationship or an untrusted relationship is determined based on social network interactions associated with the social network identification.
In one embodiment, triggering the taking of the security precautions includes at least one of:
wirelessly transmitting an alert signal to a remote server; and
the captured images are wirelessly transmitted to a remote server.
In one embodiment, the method further comprises performing security measures in response to feedback from the remote server.
In one embodiment, the security measures include at least one of:
guiding the vehicle to stop at the side;
guiding the vehicle to a designated destination; and
a visual and/or audible alarm is issued.
According to a fourth aspect of the invention, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method according to the third aspect of the invention.
By utilizing the scheme of the invention, the invasion event can be automatically judged and the safety protection measures can be triggered to be taken aiming at the possible invasion event in the vehicle, so that the safety of passengers is ensured; in some embodiments, the security and safety systems/methods of the present invention do not rely on real-time video surveillance, thereby ensuring occupant safety without violating occupant privacy.
Drawings
Non-limiting and non-exhaustive embodiments of the present invention are described by way of example with reference to the following drawings, in which:
FIG. 1 illustrates a safety protection system for a vehicle occupant according to an embodiment of the present invention; and
fig. 2 illustrates a method of safety protection for a vehicle occupant according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
Fig. 1 illustrates a safety protection system 100 for a vehicle occupant according to an embodiment of the present invention.
The exemplary safety protection system 100 for a vehicle occupant includes an image acquisition unit 110, an image analysis unit 120, an occupant identification relationship determination unit 130, and a safety protection triggering unit 140. The image capture unit 110 may be configured to capture images of two or more occupants within the vehicle. The image capture unit 110 may comprise any image capture device capable of capturing a single image frame or multiple consecutive image frames (e.g., video), and may be disposed anywhere that is capable/convenient to capture images of two or more occupants within the vehicle, e.g., at an interior rearview mirror, at an interior ceiling, at a seat, or at a rear window of the vehicle. In particular, in embodiments disposed at an interior ceiling, the image capture unit 110 may capture images of two or more occupants within the vehicle in a "bird's eye" manner.
The image capturing unit 110 is communicably connected (wired or wireless) with the image analyzing unit 120, and transmits the captured images of the occupants in the vehicle to the image analyzing unit 120 for processing and analysis. The image analysis unit 120 may acquire the identity information, seating area, and body part location of each occupant in the vehicle based on the analysis of the image acquired by the image acquisition unit 110, and further detect whether the body part of at least one occupant is located in the seating area of another occupant.
In some embodiments, obtaining identity information for each occupant in the vehicle based on analysis of the images captured by the image capture unit 110 may include performing facial recognition on the occupants included in the images and looking up identity information corresponding to the recognized faces (facial features) in a local (in-vehicle) database. In some embodiments, the identity information corresponding to the identified face (facial features) may be looked up from a more specialized database or a database with higher access rights (even a database of a government agency or law enforcement agency) stored in a remote server by wirelessly transmitting the identified face (facial features) to such a database. In addition to obtaining identity information by image analysis and processing, the identity information may be obtained in a variety of ways, for example, the identity of a user may be identified and obtained by means of a fingerprint recognizer provided on the vehicle, or the occupant may establish a communication connection with the vehicle via his mobile device (e.g., a mobile phone) to provide the identity information. The image analysis unit 120 may acquire the seating area of each occupant in the vehicle based on analysis of the image captured by the image capture unit 110. In particular, a preset seating area may be stored in a storage device (not shown) of the image analysis unit 120, and when an occupant is detected at an appropriate time (e.g., for the first time), the area may be marked as the seating area of the occupant. Alternatively, the seating area may be specified from the captured occupant image. Those skilled in the art understand that the preset seating area or the designated seating area cannot overlap with each other. The seating area is preferably rectangular, but may be other shapes, such as oval. In addition, the seating area size of each occupant may be different. In particular, women and children are apt to become targets of invasion, and therefore, a large seating area can be specified/set for women and children.
The image analysis unit 120 may acquire a position of a body part (e.g., a hand, a head, an arm, a leg, etc.) of each occupant in the vehicle based on an analysis of the image captured by the image capture unit 110, and further detect whether the body part of at least one occupant is located in a seating area of another occupant. After the seating area of each occupant is obtained, it is possible to detect whether a body part of at least one occupant is located in the seating area of another occupant by detecting whether an image of the other occupant is present in the seating area. In some cases (e.g., fewer occupants in the vehicle or more space in the vehicle), the seating area may be set or designated to be larger such that even if a body part of one occupant is farther from another occupant, it is considered to have an invasive intent. Conversely, in the case where there are many occupants in the vehicle or the space in the vehicle is small, the seating area may be set small. In some cases, if a body part of one occupant is located within a defined proximity of the seating area of another occupant, it may be deemed that the body part of the one occupant is within the seating area of the other occupant, which may trigger an intent to take safety precautions to deter injury, or increase the level of protection. The occupant identification relationship determination unit 130 may determine whether the social relationship between the at least one occupant and the other occupant belongs to the trusted relationship or the untrusted relationship based on the identification information of the at least one occupant and the other occupant when it is detected that the body part of the at least one occupant is located in the seating area of the other occupant. The social relationship between the at least one occupant and the another occupant may be evaluated to give a confidence score and at the same time a confidence threshold is set. And when the trust score is higher than the trust threshold value, judging that the social relationship between the at least one passenger and the other passenger belongs to the trust relationship, and otherwise, judging that the social relationship belongs to the non-trust relationship. Evaluating social relationships can be based on a variety of criteria. For example, where the system has access to or utilizes a database of a governmental or law enforcement agency, the relative/social relationship of the two occupants may be determined from his/her identification card information and/or passport information. In the present invention, identity information should be understood in a broad sense and may refer to any identity information (including an identification number, passport number, social security number, cell phone number, identification information registered with an organization and/or organization, etc.) that is capable of indicating the degree of trust in the relationship between occupants. In one embodiment, the identity information may include a social network identification, including any account numbers or the like for which the occupant registers and conducts social activities on the social network, and the occupant identity relationship determination unit 130 determines whether the social relationship between the at least one occupant and the another occupant belongs to a trusted relationship or an untrusted relationship based on social network interactions with the social network identification. The occupant identification relationship determination unit 130 may analyze the social relationship between occupants, either locally or by way of communication with a remote server/database. For example, the identity information may include social software accounts, and the occupant identity relationship determination unit 130 wirelessly communicates with a remote server that may search and evaluate interactions between occupant social software accounts on a social network based on the social software accounts. For example, if two occupants are found to be friends of each other, a higher trust score may be given to determine that they belong to a trusted relationship, whereas a lower trust score may be given to determine that they belong to an untrusted relationship. Such determination of social relationships may be evaluated in various ways, considering evaluation of various kinds of identity information at the same time.
The safety protection triggering unit 140 may trigger taking of a safety protection measure when it is detected that a body part of at least one occupant is located in a seating area of another occupant and it is determined that a social relationship between the at least one occupant and the another occupant belongs to an untrusted relationship. As described above, the present invention does not require the continuous transmission of real-time video to a remote server for monitoring by a dedicated person, but rather triggers the taking of safety precautions upon detecting that a body part of at least one occupant is located in the seating area of another occupant and determining that the social relationship between the at least one occupant and the another occupant is an untrusted relationship. It should be noted that determining that the social relationship between the at least one occupant and the another occupant is an untrusted relationship may occur prior to detecting whether a body part of the at least one occupant is located in a seating area of the another occupant. Detecting that a body part of at least one occupant is located in the seating area of another occupant may be considered that the at least one occupant is too close to another occupant, or is/is about to intrude on another person. In such a case, the security protection triggering unit 140 triggers the taking of security protection measures.
In some embodiments, triggering the taking of the safeguards comprises at least one of: wirelessly (e.g., via a mobile network, Wi-Fi, Bluetooth, etc.) sending an alert signal to a remote server; and wirelessly transmitting the captured images to a remote server for evaluation and processing by a specific person (e.g., an operator, police, etc.). In some embodiments, triggering the taking of safety precautions may include sending location and/or navigation information of the vehicle to a remote server to enable locating and tracking of the vehicle. In some embodiments, the system 100 may further include a response unit that performs security measures in response to feedback from the remote server. In some embodiments, the security protection measures include at least one of: guiding the vehicle to park sideways (e.g., automatically controlling steering and braking to park, and opening the doors); directing the vehicle to a designated destination (e.g., re-calculating a route and navigating to a police department); and issuing a visual and/or audible alarm (e.g., issuing a visual and/or audible alarm to the exterior/interior of the vehicle to deterrent the offending person or to inform the vehicle that an external insult is occurring).
The system 100 may be used in vehicles where a driver is present, even to protect passengers from the driver, but the invention is particularly useful in vehicles without a driver (e.g., unmanned taxis) to automatically determine an intrusion/nuisance event and trigger a safety protection system that takes safety protection measures to ensure the safety of the occupants. In addition, the above units are respectively illustrated for convenience of description, but those skilled in the art will appreciate that the above units may be combined into a smaller unit or divided into more units according to needs and implementations, all of which are within the scope of the present disclosure.
According to a second aspect of the invention, there is also provided a vehicle, for example and in particular an autonomously driven vehicle, comprising a safety protection system for a vehicle occupant as described above.
According to a third aspect of the invention, there is also provided a method of safety protection for a vehicle occupant. Fig. 2 shows a flow chart of a safety protection method S200 for a vehicle occupant according to an embodiment of the invention.
As shown in fig. 2, a safety protection method S200 for a vehicle occupant includes:
s210: capturing images of two or more occupants within a vehicle;
s220: acquiring identity information, a seating area and a position of a body part of each occupant in the vehicle based on analysis of the acquired images, and further detecting whether the body part of at least one occupant is located in the seating area of another occupant;
s230: upon detecting that a body part of at least one occupant is located in a seating area of another occupant, determining whether a social relationship between the at least one occupant and the another occupant belongs to a trusted relationship or a non-trusted relationship based on identity information of the at least one occupant and the another occupant; and
s240: triggering a safety precaution action to be taken upon detecting that a body part of at least one occupant is located in a seating area of another occupant and determining that a social relationship between the at least one occupant and the another occupant belongs to an untrusted relationship.
It will be appreciated that the above description of various aspects of a safety protection system for a vehicle occupant may lead to or represent various aspects of a control method for assisting safe driving. For example, in one example of method S200, the identity information includes a social network identification. In another example of method S200, the method includes: determining whether the social relationship between the at least one occupant and the other occupant is a trusted relationship or a non-trusted relationship based on social network interactions related to the social network identification. In yet another example of method S200, triggering the taking of the security protection measures includes at least one of: wirelessly transmitting an alert signal to a remote server; and wirelessly transmitting the captured image to a remote server. In yet another example of the method S200, the method further comprises: security measures are performed in response to feedback from the remote server. In yet another example of the method S200, the security protection measures include at least one of: guiding the vehicle to stop at the side; guiding the vehicle to a designated destination; and issuing a visual and/or audible alarm.
The fourth aspect of the present invention also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of the above-described embodiments. For example, the computer program, when executed by a processor, is capable of instructing the processor and/or the respective component to carry out the steps of: capturing images of two or more occupants within a vehicle; acquiring identity information, a seating area and a position of a body part of each occupant in the vehicle based on analysis of the acquired images, and further detecting whether the body part of at least one occupant is located in the seating area of another occupant; upon detecting that a body part of at least one occupant is located in a seating area of another occupant, determining whether a social relationship between the at least one occupant and the another occupant belongs to a trusted relationship or a non-trusted relationship based on identity information of the at least one occupant and the another occupant; and upon detecting that a body part of at least one occupant is located in a seating area of another occupant and determining that the social relationship between the at least one occupant and the another occupant is an untrusted relationship, triggering a safety precaution to be taken.
In addition, it should be understood that the respective units in the above-described safety protection system 100 for a vehicle occupant may be entirely or partially implemented by software, hardware, and a combination thereof. The units can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the units.
In an embodiment, a computer device is provided, comprising a memory and a processor, the memory having stored thereon a computer program operable on the processor, the processor implementing the steps of the method in any of the above embodiments when executing the computer program. The computer device may be a server or a vehicle-mounted terminal. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement the vehicle driving assist method of the invention.
It will be appreciated by those skilled in the art that the schematic diagram of the safety protection system 100 for a vehicle occupant shown in fig. 1 is merely a block diagram of a portion of the structure associated with the present application and does not constitute a limitation on the computer apparatus to which the present application is applied, and a particular computer apparatus may include more or fewer components than shown in the drawings, or may combine certain components, or have a different arrangement of components.
It will be understood by those skilled in the art that all or part of the steps in implementing the methods according to the above embodiments of the present invention may be instructed to be performed by the relevant hardware by a computer program, which may be stored in a non-volatile computer-readable storage medium, and which, when executed, may include the steps of the above embodiments of the methods. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
While the present invention has been described in connection with the embodiments, it is to be understood by those skilled in the art that the foregoing description and drawings are merely illustrative and not restrictive of the broad invention, and that this invention not be limited to the disclosed embodiments. Various modifications and variations are possible without departing from the spirit of the invention.
Claims (14)
1. A safety protection system for a vehicle occupant, the system comprising:
an image acquisition unit configured to acquire images of two or more occupants within a vehicle;
an image analysis unit configured to acquire identity information, a seating area, and a position of a body part of each occupant in the vehicle based on an analysis of the image acquired by the image acquisition unit, and further detect whether the body part of at least one occupant is located in the seating area of another occupant;
an occupant identification relationship determination unit configured to determine, when it is detected that a body part of at least one occupant is located in a seating area of another occupant, whether a social relationship between the at least one occupant and the another occupant belongs to a trusted relationship or an untrusted relationship, based on identification information of the at least one occupant and the another occupant; and
a safety protection triggering unit configured to trigger taking of a safety protection measure when it is detected that a body part of at least one occupant is located in a seating area of another occupant and it is determined that a social relationship between the at least one occupant and the another occupant belongs to an untrusted relationship.
2. The system of claim 1, wherein the identity information comprises a social network identification.
3. The system of claim 2, wherein the occupant identity relationship determination unit determines whether the social relationship between the at least one occupant and the another occupant is a trusted relationship or an untrusted relationship based on social network interactions associated with a social network identification.
4. The system of any of claims 1-3, wherein triggering a security measure comprises at least one of:
wirelessly transmitting an alert signal to a remote server; and
the image captured by the image capture unit is wirelessly transmitted to a remote server.
5. The system according to any one of claims 1-3, further comprising a response unit that performs security measures in response to feedback from a remote server.
6. The system of claim 5, wherein the security measures comprise at least one of:
guiding the vehicle to stop at the side;
guiding the vehicle to a designated destination; and
a visual and/or audible alarm is issued.
7. A vehicle, characterized in that it comprises a safety protection system for a vehicle occupant according to any one of claims 1-6.
8. A method of safety protection for a vehicle occupant, the method comprising:
capturing images of two or more occupants within a vehicle;
acquiring identity information, a seating area and a position of a body part of each occupant in the vehicle based on analysis of the acquired images, and further detecting whether the body part of at least one occupant is located in the seating area of another occupant;
upon detecting that a body part of at least one occupant is located in a seating area of another occupant, determining whether a social relationship between the at least one occupant and the another occupant belongs to a trusted relationship or a non-trusted relationship based on identity information of the at least one occupant and the another occupant; and
triggering a safety precaution action to be taken upon detecting that a body part of at least one occupant is located in a seating area of another occupant and determining that a social relationship between the at least one occupant and the another occupant belongs to an untrusted relationship.
9. The method of claim 8, wherein the identity information comprises a social network identification.
10. The method of claim 9, wherein determining whether the social relationship between the at least one occupant and the another occupant is a trusted relationship or an untrusted relationship is based on social network interactions associated with a social network identification.
11. The method according to any of claims 8-10, wherein triggering a security measure comprises at least one of:
wirelessly transmitting an alert signal to a remote server; and
the captured images are wirelessly transmitted to a remote server.
12. The method of any of claims 8-10, further comprising performing security measures in response to feedback from a remote server.
13. The method of claim 12, wherein the security measures comprise at least one of:
guiding the vehicle to stop at the side;
guiding the vehicle to a designated destination; and
a visual and/or audible alarm is issued.
14. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method of any one of claims 8 to 13.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910616972.6A CN112208475B (en) | 2019-07-09 | 2019-07-09 | Safety protection system for vehicle occupants, vehicle and corresponding method and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910616972.6A CN112208475B (en) | 2019-07-09 | 2019-07-09 | Safety protection system for vehicle occupants, vehicle and corresponding method and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112208475A true CN112208475A (en) | 2021-01-12 |
| CN112208475B CN112208475B (en) | 2023-02-03 |
Family
ID=74048675
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910616972.6A Active CN112208475B (en) | 2019-07-09 | 2019-07-09 | Safety protection system for vehicle occupants, vehicle and corresponding method and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112208475B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023124384A1 (en) * | 2021-12-31 | 2023-07-06 | 上海商汤智能科技有限公司 | Methods and apparatuses for determining seat of occupant inside vehicle and for vehicle control, electronic device, medium, and program product |
Citations (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE19832212A1 (en) * | 1998-07-17 | 2000-01-27 | Rolf Hugo | Safety device to protect taxi driver against violence from passenger has gas nozzles located in passenger area and connected via supply line to accumulator filled with numbing gas |
| CN1451572A (en) * | 2003-04-24 | 2003-10-29 | 李松涛 | Vehicle antirobbing device, system thereby and use method thereof |
| CN101100168A (en) * | 2007-07-20 | 2008-01-09 | 王继军 | Automobile anti-fatigue driving automatic alarming protection system |
| WO2012043373A1 (en) * | 2010-09-28 | 2012-04-05 | 日本電気株式会社 | Information processing system, information processing method, and information processing program |
| US20120256769A1 (en) * | 2011-04-07 | 2012-10-11 | GM Global Technology Operations LLC | System and method for real-time detection of an emergency situation occuring in a vehicle |
| US20140294257A1 (en) * | 2013-03-28 | 2014-10-02 | Kevin Alan Tussy | Methods and Systems for Obtaining Information Based on Facial Identification |
| CN104794852A (en) * | 2014-01-16 | 2015-07-22 | 程裕繁 | Passenger personal and property protection method based on driver abnormal behavior detection and warning |
| US20170113687A1 (en) * | 2015-10-27 | 2017-04-27 | International Business Machines Corporation | Controlling Spacing of Self-Driving Vehicles Based on Social Network Relationships |
| CN106776619A (en) * | 2015-11-20 | 2017-05-31 | 百度在线网络技术（北京）有限公司 | Method and apparatus for determining the attribute information of destination object |
| CN107103310A (en) * | 2017-06-01 | 2017-08-29 | 鄂尔多斯市普渡科技有限公司 | The passenger behavior monitor system and method for a kind of unmanned taxi |
| JP2017175220A (en) * | 2016-03-18 | 2017-09-28 | パナソニックＩｐマネジメント株式会社 | Recording apparatus and recording method |
| CN107341438A (en) * | 2017-01-24 | 2017-11-10 | 问众智能信息科技（北京）有限公司 | The method and apparatus of in-car safety monitoring based on computer vision |
| CN107735795A (en) * | 2015-07-02 | 2018-02-23 | 北京市商汤科技开发有限公司 | Method and system for social relationships identification |
| US9953210B1 (en) * | 2017-05-30 | 2018-04-24 | Gatekeeper Inc. | Apparatus, systems and methods for improved facial detection and recognition in vehicle inspection security systems |
| WO2018094375A1 (en) * | 2016-11-21 | 2018-05-24 | Nio Usa, Inc. | Method and system for vehicle data optimization |
| CN108304830A (en) * | 2018-03-09 | 2018-07-20 | 西安艾润物联网技术服务有限责任公司 | Personnel identity on-line monitoring method, device and storage medium in vehicle |
| CN108369645A (en) * | 2018-02-08 | 2018-08-03 | 深圳前海达闼云端智能科技有限公司 | Taxi operation monitoring method, device, storage medium and system |
| CN108556733A (en) * | 2017-12-22 | 2018-09-21 | 北汽福田汽车股份有限公司 | Prevent occupant from stretching out protective device, vehicle window and the vehicle with it of vehicle window mouth |
| CN108737968A (en) * | 2018-05-07 | 2018-11-02 | 成都天佑飞天科技有限公司 | A method of passing through wireless technology sensing passengers abnormal behaviour |
| CN109389107A (en) * | 2019-01-15 | 2019-02-26 | 深兰人工智能芯片研究院（江苏）有限公司 | Vehicle safety processing method, device and computer readable storage medium |
| US20190065872A1 (en) * | 2017-08-25 | 2019-02-28 | Toyota Jidosha Kabushiki Kaisha | Behavior recognition apparatus, learning apparatus, and method and program therefor |
| CN109785214A (en) * | 2019-03-01 | 2019-05-21 | 宝能汽车有限公司 | Safety alarming method and device based on car networking |
| CN109886209A (en) * | 2019-02-25 | 2019-06-14 | 成都旷视金智科技有限公司 | Anomaly detection method and device, mobile unit |
| CN109902575A (en) * | 2019-01-24 | 2019-06-18 | 平安科技（深圳）有限公司 | Anti- based on automatic driving vehicle abducts method, apparatus and relevant device |
-
2019
- 2019-07-09 CN CN201910616972.6A patent/CN112208475B/en active Active
Patent Citations (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE19832212A1 (en) * | 1998-07-17 | 2000-01-27 | Rolf Hugo | Safety device to protect taxi driver against violence from passenger has gas nozzles located in passenger area and connected via supply line to accumulator filled with numbing gas |
| CN1451572A (en) * | 2003-04-24 | 2003-10-29 | 李松涛 | Vehicle antirobbing device, system thereby and use method thereof |
| CN101100168A (en) * | 2007-07-20 | 2008-01-09 | 王继军 | Automobile anti-fatigue driving automatic alarming protection system |
| WO2012043373A1 (en) * | 2010-09-28 | 2012-04-05 | 日本電気株式会社 | Information processing system, information processing method, and information processing program |
| US20120256769A1 (en) * | 2011-04-07 | 2012-10-11 | GM Global Technology Operations LLC | System and method for real-time detection of an emergency situation occuring in a vehicle |
| US20140294257A1 (en) * | 2013-03-28 | 2014-10-02 | Kevin Alan Tussy | Methods and Systems for Obtaining Information Based on Facial Identification |
| CN104794852A (en) * | 2014-01-16 | 2015-07-22 | 程裕繁 | Passenger personal and property protection method based on driver abnormal behavior detection and warning |
| CN107735795A (en) * | 2015-07-02 | 2018-02-23 | 北京市商汤科技开发有限公司 | Method and system for social relationships identification |
| US20170113687A1 (en) * | 2015-10-27 | 2017-04-27 | International Business Machines Corporation | Controlling Spacing of Self-Driving Vehicles Based on Social Network Relationships |
| CN106776619A (en) * | 2015-11-20 | 2017-05-31 | 百度在线网络技术（北京）有限公司 | Method and apparatus for determining the attribute information of destination object |
| JP2017175220A (en) * | 2016-03-18 | 2017-09-28 | パナソニックＩｐマネジメント株式会社 | Recording apparatus and recording method |
| WO2018094375A1 (en) * | 2016-11-21 | 2018-05-24 | Nio Usa, Inc. | Method and system for vehicle data optimization |
| CN107341438A (en) * | 2017-01-24 | 2017-11-10 | 问众智能信息科技（北京）有限公司 | The method and apparatus of in-car safety monitoring based on computer vision |
| CN107729870A (en) * | 2017-01-24 | 2018-02-23 | 问众智能信息科技（北京）有限公司 | The method and apparatus of in-car safety monitoring based on computer vision |
| US9953210B1 (en) * | 2017-05-30 | 2018-04-24 | Gatekeeper Inc. | Apparatus, systems and methods for improved facial detection and recognition in vehicle inspection security systems |
| CN107103310A (en) * | 2017-06-01 | 2017-08-29 | 鄂尔多斯市普渡科技有限公司 | The passenger behavior monitor system and method for a kind of unmanned taxi |
| US20190065872A1 (en) * | 2017-08-25 | 2019-02-28 | Toyota Jidosha Kabushiki Kaisha | Behavior recognition apparatus, learning apparatus, and method and program therefor |
| CN108556733A (en) * | 2017-12-22 | 2018-09-21 | 北汽福田汽车股份有限公司 | Prevent occupant from stretching out protective device, vehicle window and the vehicle with it of vehicle window mouth |
| CN108369645A (en) * | 2018-02-08 | 2018-08-03 | 深圳前海达闼云端智能科技有限公司 | Taxi operation monitoring method, device, storage medium and system |
| CN108304830A (en) * | 2018-03-09 | 2018-07-20 | 西安艾润物联网技术服务有限责任公司 | Personnel identity on-line monitoring method, device and storage medium in vehicle |
| CN108737968A (en) * | 2018-05-07 | 2018-11-02 | 成都天佑飞天科技有限公司 | A method of passing through wireless technology sensing passengers abnormal behaviour |
| CN109389107A (en) * | 2019-01-15 | 2019-02-26 | 深兰人工智能芯片研究院（江苏）有限公司 | Vehicle safety processing method, device and computer readable storage medium |
| CN109902575A (en) * | 2019-01-24 | 2019-06-18 | 平安科技（深圳）有限公司 | Anti- based on automatic driving vehicle abducts method, apparatus and relevant device |
| CN109886209A (en) * | 2019-02-25 | 2019-06-14 | 成都旷视金智科技有限公司 | Anomaly detection method and device, mobile unit |
| CN109785214A (en) * | 2019-03-01 | 2019-05-21 | 宝能汽车有限公司 | Safety alarming method and device based on car networking |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023124384A1 (en) * | 2021-12-31 | 2023-07-06 | 上海商汤智能科技有限公司 | Methods and apparatuses for determining seat of occupant inside vehicle and for vehicle control, electronic device, medium, and program product |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112208475B (en) | 2023-02-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11436846B1 (en) | Image analysis technologies for identifying abnormal vehicle conditions | |
| US9679210B2 (en) | Using passive driver identification and other input for providing real-time alerts or actions | |
| CN108454567B (en) | Object detection for a vehicle | |
| CN105243838B (en) | Vehicle driving safety monitoring method and device, system | |
| EP4032728A1 (en) | Recording video of an operator and a surrounding visual field | |
| CN109466488B (en) | Automatic vehicle collision rescue alarm system | |
| US20170076396A1 (en) | Monitoring system and method | |
| US11557125B2 (en) | Method for monitoring the environment of a vehicle | |
| US20070159309A1 (en) | Information processing apparatus and information processing method, information processing system, program, and recording media | |
| CN115225678A (en) | Driver identity online monitoring method and device and storage medium | |
| WO2017155448A1 (en) | Method and system for theft detection in a vehicle | |
| CN106740476A (en) | A kind of car steering environment control method, device and automobile | |
| CN111753711A (en) | Electric vehicle, control method and device thereof, electronic equipment and storage medium | |
| CN110288796A (en) | Vehicle monitoring method and device, storage medium, electronic device | |
| CN112208475B (en) | Safety protection system for vehicle occupants, vehicle and corresponding method and medium | |
| KR20160028542A (en) | an emergency management and crime prevention system for cars and the method thereof | |
| KR101437406B1 (en) | an emergency management and crime prevention system for cars and the method thereof | |
| CN115613914A (en) | Control system, method and equipment for automobile door | |
| JP2018177216A (en) | Device for enabling vehicle to automatically start to move again | |
| WO2022157538A1 (en) | A method and system for determining a possible road safety violation | |
| JP2018060447A (en) | On-vehicle storage device | |
| KR102331937B1 (en) | Apparatus for vehicle emergency rescue based on the analysis of the driving state risk and the driver state and method thereof | |
| KR101224889B1 (en) | Ship crew fatigue measurement method and equipment | |
| JP2024052217A (en) | Security systems and programs, etc. | |
| CN117513884A (en) | Safety control method and system for door lock and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |