CN113815562A - Vehicle unlocking method and device based on panoramic camera and storage medium - Google Patents
Vehicle unlocking method and device based on panoramic camera and storage medium Download PDFInfo
- Publication number
- CN113815562A CN113815562A CN202111125613.4A CN202111125613A CN113815562A CN 113815562 A CN113815562 A CN 113815562A CN 202111125613 A CN202111125613 A CN 202111125613A CN 113815562 A CN113815562 A CN 113815562A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- unlocking
- panoramic camera
- information
- face information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 59
- 238000001514 detection method Methods 0.000 claims abstract description 30
- 238000004891 communication Methods 0.000 claims description 9
- 238000013459 approach Methods 0.000 abstract 2
- 230000008569 process Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 238000012790 confirmation Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 230000006855 networking Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 210000001503 joint Anatomy 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/20—Means to switch the anti-theft system on or off
- B60R25/25—Means to switch the anti-theft system on or off using biometry
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/10—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles actuating a signalling device
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/30—Detection related to theft or to other events relevant to anti-theft systems
- B60R25/305—Detection related to theft or to other events relevant to anti-theft systems using a camera
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/10—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles actuating a signalling device
- B60R2025/1013—Alarm systems characterised by the type of warning signal, e.g. visual, audible
- B60R2025/1016—Remote signals alerting owner or authorities, e.g. radio signals
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Human Computer Interaction (AREA)
- Lock And Its Accessories (AREA)
Abstract
The invention discloses a vehicle unlocking method, equipment and a storage medium based on a panoramic camera, wherein the method comprises the following steps: detecting face information in a preset detection range, and comparing the detected face information with face information of a person who allows to start a vehicle; if the comparison is passed, detecting the direction of the person passing the comparison in a preset unlocking range, and if the direction is the main driving direction of the vehicle, unlocking the vehicle and actively opening a main driving door of the vehicle; and sending prompt information to the vehicle owner after the vehicle door is closed, allowing the vehicle to be subsequently operated after the vehicle owner confirms the information of the personnel who have opened the vehicle, and otherwise, locking the vehicle. Therefore, the approach of the vehicle owner is recognized and the vehicle is unlocked in advance when the distance is far, and the vehicle door is actively opened when the vehicle owner approaches the main cab, so that the waiting time is saved. And the panoramic camera of the original vehicle can be directly used without additionally installing other cameras, so that the cost of the vehicle owner is saved. On the premise of not updating hardware, the user experience is improved with zero cost.
Description
Technical Field
The invention relates to the field of vehicle unlocking, in particular to a vehicle unlocking method and device based on a panoramic camera and a computer readable storage medium.
Background
Most of the current vehicle unlocking door opening modes are that the vehicle door is pulled open by the vehicle owner after unlocking, but when the vehicle owner holds articles in both hands, the articles in the hands need to be put down, so that the unlocking door opening is realized, and the operation is inconvenient. Moreover, most of the existing face recognition unlocking systems are arranged on the A column, namely a camera is additionally arranged on the column between the windshield and the left and right front doors, so that the cost is increased, a master station is required to unlock the vehicle in front of the vehicle for several seconds, and the unlocking efficiency is low.
Disclosure of Invention
The invention mainly aims to provide a vehicle unlocking method based on a panoramic camera, and aims to solve the technical problems of slow vehicle unlocking, inconvenience in unlocking and low efficiency in the prior art.
In order to achieve the above object, the present invention provides a vehicle unlocking method based on a panoramic camera, which includes:
the method comprises the steps that actual face information is detected in a preset detection range of a vehicle based on a panoramic camera of the vehicle, and the actual face information is compared with standard face information of a person who allows to start the vehicle;
if the comparison is passed, detecting the direction of the person passing the comparison in a preset unlocking range, and if the direction is the main driving direction of the vehicle, unlocking the vehicle and actively opening a main driving door of the vehicle;
and sending prompt information to the vehicle owner terminal after the vehicle door is closed, allowing the vehicle to be subjected to subsequent operation after the vehicle owner terminal confirms the information of the personnel who have opened the vehicle, and otherwise, locking the vehicle and not allowing the vehicle to be subjected to subsequent operation.
Optionally, the step of obtaining the standard face information of the vehicle personnel allowed to be started comprises:
and receiving and storing the uploaded standard face information of the vehicle personnel allowed to be started in advance, and carrying out identity binding associated information on the uploaded standard face information of the vehicle personnel allowed to be started.
Optionally, the panoramic camera-based vehicle unlocking method further includes:
and after the car door is closed, the video recording is stopped, and the recorded video is uploaded.
Optionally, after the step of sending the prompt message to the vehicle owner terminal after closing the vehicle door, the method further includes:
the recorded video and/or the compared actual face information in a preset detection range are/is sent to a vehicle owner terminal so that the vehicle owner terminal can confirm the information of the people who start the vehicle;
and if the fact that the owner terminal selects not to check the recorded video and/or the actual face information passing the comparison in the preset detection range is detected, judging that the owner terminal confirms the information of the personnel who start the vehicle.
Optionally, after the step of detecting the direction of the person passing the comparison in the preset unlocking range, the method further includes:
and if the direction of the compared personnel is not the main driving direction of the vehicle, only unlocking the vehicle and not actively opening the vehicle door in the direction.
Optionally, after the step of locking the vehicle, the method further comprises:
after the vehicle is locked, if the received unlocking password is determined to be correct, the locked vehicle is unlocked.
Optionally, the panoramic camera-based vehicle unlocking method further includes:
and optimizing the face recognition algorithm by using the face information which is compared and confirmed by the vehicle owner, and issuing the updated and iterated face recognition algorithm to the vehicle.
Optionally, the panoramic camera-based vehicle unlocking method further includes:
an interface for extending the camera is provided, allowing increased access to the camera.
In addition, to achieve the above object, the present invention further provides a vehicle unlocking apparatus based on a panoramic camera, including: the vehicle unlocking method based on the panoramic camera comprises the panoramic camera, a panoramic 360 controller, a cloud storage, a vehicle-mounted wireless communication device, a storage, a processor and a vehicle unlocking program based on the panoramic camera, wherein the vehicle unlocking program based on the panoramic camera is stored in the storage and can run on the processor, and when being executed by the processor, the steps of the vehicle unlocking method based on the panoramic camera are realized.
In addition, to achieve the above object, the present invention further provides a computer readable storage medium, having a vehicle unlocking program based on a panoramic camera stored thereon, where the vehicle unlocking program based on a panoramic camera implements the steps of the vehicle unlocking method based on a panoramic camera as described above when being executed by a processor.
According to the vehicle unlocking method and device based on the panoramic camera and the computer readable storage medium, the existing panoramic camera of the vehicle is used for recognizing the face in the preset detection range and recognizing the direction in the preset unlocking range, so that the face information can be recognized no matter which direction the vehicle-opening person is allowed to go from, the master station does not need to wait in front of the vehicle and then manually open the door, and the door can be opened without sensing. In addition, the panoramic camera is used for shooting videos and face information of the personnel starting the vehicle and sending the pictures to the vehicle owner, so that the vehicle owner confirms the personnel entering the vehicle, and the effect of safe unlocking is achieved. Moreover, the video and the face information acquired by each successful vehicle unlocking are utilized to iterate the existing unlocking software, so that the unlocking experience of a user is improved, and a time-saving, quick, safe, efficient and convenient vehicle unlocking method is provided for the user.
Drawings
FIG. 1 is a schematic diagram of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of an embodiment of a vehicle unlocking method based on a panoramic camera according to the present invention;
fig. 3 is a schematic structural diagram of an unlocking device according to an embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In order to better understand the technical solution, the technical solution will be described in detail with reference to the drawings and the specific embodiments.
As shown in fig. 1, fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present invention.
The operation equipment of the embodiment of the invention can be a PC, and can also be a mobile terminal equipment with a display function, such as a smart phone, a tablet computer, an electronic book reader, a portable computer and the like.
As shown in fig. 1, the operation device may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Optionally, the operation device may further include a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, a WiFi module, and the like. Such as light sensors, motion sensors, and other sensors. In particular, the light sensor may include an ambient light sensor and a proximity sensor. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the mobile device is stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration) for recognizing the attitude of the mobile device, and related functions (such as pedometer and tapping) for vibration recognition; of course, the mobile operation device may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, and the like, which are not described herein again.
Those skilled in the art will appreciate that the operational equipment configuration shown in FIG. 1 does not constitute a limitation of the operational equipment, and may include more or fewer components than shown, or some components in combination, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a panorama camera-based vehicle unlocking program.
In the operating device shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to invoke the panoramic camera based vehicle unlock program stored in the memory 1005 and perform the following operations:
the method comprises the steps that actual face information is detected in a preset detection range of a vehicle based on a panoramic camera of the vehicle, and the actual face information is compared with standard face information of a person who allows to start the vehicle;
if the comparison is passed, detecting the direction of the person passing the comparison in a preset unlocking range, and if the direction is the main driving direction of the vehicle, unlocking the vehicle and actively opening a main driving door of the vehicle;
and sending prompt information to the vehicle owner terminal after the vehicle door is closed, allowing the vehicle to be subjected to subsequent operation after the vehicle owner terminal confirms the information of the personnel who have opened the vehicle, and otherwise, locking the vehicle and not allowing the vehicle to be subjected to subsequent operation.
Further, the processor 1001 may call the panoramic camera based vehicle unlocking program stored in the memory 1005, and also perform the following operations:
and receiving and storing the uploaded standard face information allowing the vehicle personnel to be started in advance, and the associated information for binding the identity of the standard face information.
Further, the processor 1001 may call the panoramic camera based vehicle unlocking program stored in the memory 1005, and also perform the following operations:
and after the car door is closed, the video recording is stopped, and the recorded video is uploaded.
Further, the processor 1001 may call the panoramic camera based vehicle unlocking program stored in the memory 1005, and also perform the following operations:
the recorded video and/or the compared actual face information in a preset detection range are/is sent to a vehicle owner terminal so that the vehicle owner terminal can confirm the information of the people who start the vehicle;
and if the fact that the owner terminal selects not to check the recorded video and/or the actual face information passing the comparison in the preset detection range is detected, judging that the owner terminal confirms the information of the personnel who start the vehicle.
Further, the processor 1001 may call the panoramic camera based vehicle unlocking program stored in the memory 1005, and also perform the following operations:
and if the direction of the compared personnel is not the main driving direction of the vehicle, only unlocking the vehicle and not actively opening the vehicle door in the direction.
Further, the processor 1001 may call the panoramic camera based vehicle unlocking program stored in the memory 1005, and also perform the following operations:
after the vehicle is locked, if the received unlocking password is determined to be correct, the locked vehicle is unlocked.
Further, the processor 1001 may call the panoramic camera based vehicle unlocking program stored in the memory 1005, and also perform the following operations:
and optimizing the face recognition algorithm by using the face information which is compared and confirmed by the vehicle owner, and issuing the updated and iterated face recognition algorithm to the vehicle.
Further, the processor 1001 may call the panoramic camera based vehicle unlocking program stored in the memory 1005, and also perform the following operations:
an interface for extending the camera is provided, allowing increased access to the camera.
Referring to fig. 2, the present invention provides a vehicle unlocking method based on a panoramic camera, and in an embodiment of the vehicle unlocking method based on the panoramic camera, the vehicle unlocking process includes:
and step S10, detecting actual face information in a preset detection range of the vehicle based on the panoramic camera of the vehicle, and comparing the actual face information with standard face information of a person allowed to start the vehicle.
In one embodiment of the invention, the existing panoramic camera of the vehicle is utilized to unlock the vehicle. The four cameras for realizing the panoramic image are respectively arranged at the front, the rear, the left and the right positions of the vehicle, and under the condition that no additional camera is arranged, the existing camera of the vehicle is utilized to realize the embodiment of the invention. In addition, in the embodiment of the present invention, the implementation manner of the panoramic image is not limited, the number of cameras used for the panoramic image is not limited, and the installation position of the cameras is not limited. In an embodiment of the invention, the preset retrieval range is 2 meters, the panoramic camera collects face information within the range of 2 meters, the panoramic camera is always in an open state, and the face information is uninterruptedly searched all day long. And comparing the face information detected within the range of 2 meters with the face information of the person who is allowed to start the vehicle and is pre-stored in the cloud storage, if the comparison is not passed, namely when the person who is allowed to start the vehicle does not exist within the range of 2 meters, the vehicle does not respond, and the comparison of the face information is continued until the comparison is passed. In an embodiment of the present invention, the object detected by the panoramic camera within the preset detection range may be one or more of face information, iris information, joint motion model information, or body posture information; or the vehicle to be unlocked supports the keyless entry function, and when the vehicle key is detected in the preset detection range, the detection of the key position is added on the basis of the existing detection object. In summary, in the embodiment of the present invention, the detection object in the preset detection range is not limited, and the identity information that can be recognized by the panoramic camera and/or the device that can be uniquely connected to the vehicle to be unlocked, and the information that can be recognized by the sensor in the vehicle to be unlocked, such as the sound information, are included in the detection object in the embodiment of the present invention.
And step S20, if the comparison is passed, detecting the direction of the person passing the comparison in a preset unlocking range, and if the direction is the main driving direction of the vehicle, unlocking the vehicle and actively opening the main driving door.
In an embodiment of the present invention, if the comparison of the face information indicates that the person who is allowed to unlock the vehicle is close to the vehicle to be unlocked, it is further determined whether the person who is allowed to unlock the vehicle is within the preset unlocking range. And if the unlocking range is not within the preset unlocking range, continuing to detect. If the vehicle unlocking range is within the preset unlocking range, the direction of the vehicle unlocking allowing personnel relative to the vehicle to be unlocked is determined by acquiring the position of the vehicle unlocking allowing personnel within the preset unlocking range. In one embodiment of the invention, the direction of a person who is allowed to start the vehicle is identified through a controller of the vehicle to be unlocked; or the direction of a person who is allowed to start the vehicle is identified in the video or the photo by using a video recording or photo taking method through a panoramic camera of the vehicle to be unlocked. In the embodiment of the present invention, the direction recognition method for the person who is allowed to turn on the vehicle is not limited. In one embodiment of the invention, the preset unlocking range is 0.5 m, and when the condition that a person allowing the vehicle to be unlocked is located in the main driving direction of the vehicle to be unlocked is determined within 0.5 m, the vehicle is unlocked and the main driving door is actively opened. In the embodiment of the present invention, the method of obtaining the direction of the person who is allowed to unlock the vehicle with respect to the vehicle to be unlocked is not limited. In addition, in another embodiment of the invention, the walking speed of the vehicle-opening allowed personnel is obtained, a mapping table of the walking speed of the vehicle-opening allowed personnel and the opening angle and the opening speed of the main driving door is maintained in advance, and the faster the walking speed of the vehicle-opening allowed personnel is, the faster the opening angle and the opening speed of the main driving door are, the positive correlation is formed. Of course, the opening angle and the opening speed of the main driving door are safe angles and safe speeds which do not affect the persons and pedestrians who are allowed to open the vehicle, the vehicle to be unlocked and the like. In the embodiment of the invention, the opening parameter for actively opening the main driving door is not limited on the premise of ensuring safety.
And step S30, sending a prompt message to the owner terminal after the door is closed, allowing subsequent operation on the vehicle after the owner terminal confirms the information of the person who has opened the vehicle, and otherwise, locking the vehicle and not allowing the subsequent operation on the vehicle.
In one embodiment of the invention, when a person who opens a vehicle is allowed to pass the comparison of face detection and the vehicle door is closed after the person enters the vehicle, the vehicle machine sends a request to the vehicle APP of the mobile phone of the vehicle owner, the vehicle APP pops up a popup window to prompt that the vehicle is unlocked, and the vehicle owner is inquired whether to approve the unlocking of the vehicle at this time; or the vehicle machine sends a request to the vehicle APP of the mobile phone of the vehicle owner, the vehicle APP prompts that the vehicle is unlocked in a vibration or ring mode, and the vehicle owner is inquired whether to agree with the unlocking of the vehicle at this time; or the vehicle machine sends a request to the vehicle APP of the mobile phone of the vehicle owner, and the vehicle APP performs voice conversation interaction with the vehicle owner in a voice broadcasting mode to prompt that the vehicle is unlocked and inquire whether the vehicle owner agrees to unlocking the vehicle at this time; or the vehicle machine sends a short message to the mobile phone of the vehicle owner to prompt that the vehicle is unlocked and inquire whether the vehicle owner agrees to unlocking the vehicle at this time. The vehicle APP in the vehicle owner mobile phone is bound and connected with the vehicle to be unlocked in advance, and networking information interaction is carried out. In the embodiment of the invention, the prompt mode that the vehicle is unlocked from the vehicle owner by the vehicle owner is not limited, and the networking information interaction equipment which is bound and connected with the vehicle to be unlocked in advance and used for receiving the prompt information by the vehicle owner is not limited. And after the vehicle owner receives the prompt message and confirms the information of the personnel who have opened the vehicle, allowing the personnel who have opened the vehicle to perform subsequent further operation on the vehicle to be unlocked. However, when the owner receives the prompt message and rejects the information of the person who has opened the vehicle, the vehicle to be unlocked is immediately locked, the door of the vehicle is locked, and subsequent operation of the vehicle is not allowed. In the embodiment of the present invention, the follow-up action after the door is locked is not limited.
In this embodiment, the panoramic camera through waiting to unblock the vehicle detects the face information around waiting to unblock vehicle constantly in predetermineeing detection range, compares with the face information that allows to open vehicle personnel and type in advance for when the personnel through the comparison are close waiting to unblock vehicle owner and drive the direction, the unblock vehicle just initiatively opens the owner and drives the door. And sending prompt information to the vehicle owner after the vehicle door is closed, allowing the vehicle to be unlocked to perform subsequent operation after the vehicle owner confirms the information of the personnel who have opened the vehicle, and otherwise, locking the vehicle. The realization is just discerned when the distance is far away and is allowed to open vehicle personnel, and the door is opened in advance in the unblock, practices thrift the latency of unblock vehicle, promotes user experience and feels. And for the behavior of entering the vehicle that the owner does not agree, in time guarantee the owner's interests, improve and use the car security.
Optionally, the step of obtaining the standard face information of the vehicle personnel allowed to be started comprises:
and receiving and storing the uploaded standard face information allowing the vehicle personnel to be started in advance, and the associated information for binding the identity of the standard face information.
For the acquisition of face information of a person allowed to start a vehicle, identifying and inputting the face information in a vehicle APP of a mobile phone of a vehicle owner in advance by using a camera of the mobile phone; or the vehicle APP using the mobile phone of the vehicle owner utilizes the camera of the vehicle to perform remote control identification and input; or the vehicle APP of the owner's mobile phone is used for identification and entry by using the photos or videos in the local gallery. And storing the received face information of the vehicle-opening-allowed personnel in a cloud storage in a picture format. In an embodiment of the present invention, the recognition entry method for allowing the vehicle personnel to start the face information is not limited. And the uploaded face information is bound with the identity, the face information associated with the unique identity of the owner is determined according to the submitted association information of the face and the identity, and other face information except the owner is bound with other persons allowed to start the vehicle identity to determine the face information associated with other identities. In the embodiment of the invention, the identity bound by other face information is not limited.
Optionally, the panoramic camera-based vehicle unlocking method further includes:
and after the car door is closed, the video recording is stopped, and the recorded video is uploaded.
When the fact that the vehicle personnel are allowed to start is detected within the preset detection range, the video recording function is started until relevant signals that the vehicle door is closed are received, the video recording is stopped, and the recorded video is uploaded to the cloud storage. When the owner confirms the information of the personnel who have started the vehicle, when the owner chooses to look up the video, the video is sent to the owner, so that the owner can further judge the personnel who enter the vehicle.
Optionally, the step of confirming the information of the person who has opened the vehicle by the vehicle owner includes:
after the step of sending the prompt message to the vehicle owner terminal after closing the vehicle door, the method further comprises the following steps:
the recorded video and/or the compared actual face information in a preset detection range are/is sent to a vehicle owner terminal so that the vehicle owner terminal can confirm the information of the people who start the vehicle;
and if the fact that the owner terminal selects not to check the recorded video and/or the actual face information passing the comparison in the preset detection range is detected, judging that the owner terminal confirms the information of the personnel who start the vehicle.
The prompting information is sent to the vehicle owner after the vehicle door is closed, when the vehicle owner directly selects and confirms the behavior of opening the vehicle, the video recorded before the vehicle door is closed after the human face information is compared and/or the human face information is sent to the vehicle owner within a preset detection range, namely the vehicle owner selects not to check the video or the human face information temporarily, and then the confirmation information made by the vehicle owner to the prompting information is received. Or sending prompt information to the vehicle owner after the vehicle door is closed, and sending a video which is recorded before the vehicle door is closed after the human face information is compared to the vehicle owner when the vehicle owner needs to confirm the information of the personnel who have opened the vehicle; or sending prompt information to the vehicle owner after the vehicle door is closed, and sending face information which is compared within a preset detection range to the vehicle owner when the vehicle owner needs to confirm the information of the personnel who have opened the vehicle; or sending prompt information to the vehicle owner after the vehicle door is closed, and sending video recorded before the vehicle door is closed after the human face information is compared and sending the human face information which is compared in a preset detection range to the vehicle owner when the vehicle owner needs to confirm the information of the personnel who have opened the vehicle. If the owner immediately checks the recorded video, the video starts to be played; and if the owner selects to view the recorded video later, marking the recorded video as unread. In the embodiment of the present invention, the data type and the data acquisition method for the personnel information confirmation of the opened vehicle sent to the vehicle owner are not limited.
Optionally, after the step of detecting the direction of the person passing the comparison in the preset unlocking range, the method further includes:
and if the direction of the compared personnel is not the main driving direction of the vehicle, only unlocking the vehicle and not actively opening the vehicle door in the direction.
In an embodiment of the present invention, if the face information detected in the preset detection range passes the comparison, the direction of the person passing the comparison with respect to the vehicle to be unlocked is detected in the preset unlocking range, that is, in the range of 0.5 m. If the direction of the person who is compared through the face information is the main driving direction of the vehicle to be unlocked, actively opening a main driving door while unlocking the vehicle to be unlocked; if the direction of the person who is compared through the face information is not the main driving direction of the vehicle to be unlocked, such as the auxiliary driving direction, the rear row direction or the tail door direction, only the vehicle to be unlocked is unlocked, and the vehicle door in the direction of the person who is compared through the face information, such as the auxiliary driving door, the rear row door or the tail door, is not opened actively. The purpose of this arrangement is to prevent such an extreme situation: if the person who compares the face information allows the person who opens the vehicle to detour to the main driver from the assistant driver side through the tail of the vehicle within the preset range of the vehicle to be unlocked, if the person who compares the face information passes through the assistant driver and/or the tail of the vehicle, the vehicle is unlocked and the assistant driver and/or the tail of the vehicle are opened, when the person who opens the vehicle is allowed to enter the vehicle to be unlocked to perform subsequent operation on the vehicle, the person who opens the vehicle needs to get off the vehicle again to close the assistant driver and/or the tail of the vehicle, and unnecessary operation is increased, so that waste and trouble are caused. Therefore, in another embodiment of the present invention, if a person who performs face information comparison, that is, a person who allows the vehicle to be opened, needs to open the front passenger and/or rear row and/or rear car door within a preset range of the vehicle to be unlocked, the person who performs face information comparison waits for time within the preset unlocking range of the front passenger and/or rear row and/or rear car door, or performs a specific action within the preset unlocking range of the front passenger and/or rear row and/or rear car door, or performs voice recognition or voice interaction within the preset unlocking range of the front passenger and/or rear row and/or rear car door, so as to open the corresponding front passenger and/or rear row and/or rear car door.
Optionally, after the step of locking the vehicle, the method further comprises:
after the vehicle is locked, if the received unlocking password is determined to be correct, the locked vehicle is unlocked.
And after the owner receives the prompt information that the vehicle to be unlocked is unlocked and confirms the information of the personnel who have opened the vehicle, allowing the personnel who have opened the vehicle to perform subsequent further operation on the vehicle to be unlocked. However, when the owner receives the prompt information that the vehicle to be unlocked is unlocked and the information of the person who has opened the vehicle is denied, the vehicle to be unlocked is immediately locked, the door of the vehicle is locked, and subsequent operation of the vehicle is not allowed. At the moment, the vehicle owner can communicate with the people in the vehicle with uncertain identity by using the sensor of the vehicle to be unlocked through the camera in the vehicle or through the mobile phone vehicle APP and the like. When the owner determines that the person entering the vehicle to be unlocked is a normal trusted person, the locked vehicle is unlocked after a preset unlocking password is input in the mobile phone vehicle APP. If the owner confirms that the person entering the vehicle to be unlocked is an abnormal distrust person, a one-key alarm is selected from the mobile phone APP, vehicle information such as vehicle positioning, license plate, vehicle type and vehicle body color is sent, and a video recorded before the door of the vehicle is closed after the face information comparison and the face information which passes the comparison in a preset detection range are sent to an police service system. In one embodiment of the invention, the butt joint with the police system is realized, and the alarm mode of the abnormal distrusted personnel and the alarm data sent to the police system are not limited.
Optionally, the panoramic camera-based vehicle unlocking method further includes:
and optimizing the face recognition algorithm by using the face information which is compared and confirmed by the vehicle owner, and issuing the updated and iterated face recognition algorithm to the vehicle.
The face information is detected in a preset detection range, face information comparison is carried out every time, the face information of a vehicle owner confirming the information of the opened vehicle personnel is used after a vehicle door is closed, a face recognition algorithm of the vehicle to be unlocked is optimized, different vehicles to be unlocked use face recognition algorithms corresponding to different parameters and settings, the face information of the vehicle personnel allowed to be opened is used for optimizing the face recognition algorithm of the corresponding vehicle after face information comparison and vehicle owner confirmation every time, the face recognition algorithm of each vehicle to be unlocked aims at the vehicle personnel allowed to be opened corresponding to the vehicle to be unlocked, the most reasonable optimization is carried out, time-saving and efficient face recognition is achieved, the face recognition algorithm subjected to updating iteration is issued to the corresponding vehicle to be unlocked, and vehicle using experience of a user is improved.
Optionally, the panoramic camera-based vehicle unlocking method further includes:
an interface for extending the camera is provided, allowing increased access to the camera.
In one embodiment of the invention, the existing panoramic camera of the vehicle is utilized to unlock the vehicle. Wherein, four cameras for realizing panoramic images are respectively arranged at the front, the back, the left and the right positions of the vehicle. In addition, the vehicle to be unlocked also opens an interface for expanding the camera, and besides the camera of the vehicle to be unlocked which leaves the factory, the camera can be externally connected with the camera purchased by the user, for example, a vehicle data recorder purchased by the user can be accessed as the camera for assisting unlocking, so that the cost is saved, the unlocking precision is improved, and the unlocking by the user is facilitated.
In addition, an embodiment of the present invention further provides a vehicle unlocking device based on a panoramic camera, where the vehicle unlocking device based on the panoramic camera includes: the vehicle unlocking method based on the panoramic camera comprises the panoramic camera, a panoramic 360 controller, a cloud storage, a vehicle-mounted wireless communication device, a storage, a processor and a vehicle unlocking program based on the panoramic camera, wherein the vehicle unlocking program based on the panoramic camera is stored in the storage and can run on the processor, and when being executed by the processor, the steps of the vehicle unlocking method based on the panoramic camera are realized.
In addition, an embodiment of the present invention further provides a computer-readable storage medium, where a vehicle unlocking program based on a panoramic camera is stored on the computer-readable storage medium, and when the vehicle unlocking program based on the panoramic camera is executed by a processor, the steps of the vehicle unlocking method based on the panoramic camera as described above are implemented.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A vehicle unlocking method based on a panoramic camera is characterized by comprising the following steps:
the method comprises the steps that actual face information is detected in a preset detection range of a vehicle based on a panoramic camera of the vehicle, and the actual face information is compared with standard face information of a person who allows to start the vehicle;
if the comparison is passed, detecting the direction of the person passing the comparison in a preset unlocking range, and if the direction is the main driving direction of the vehicle, unlocking the vehicle and actively opening a main driving door of the vehicle;
and sending prompt information to the vehicle owner terminal after the vehicle door is closed, allowing the vehicle to be subjected to subsequent operation after the vehicle owner terminal confirms the information of the personnel who have opened the vehicle, and otherwise, locking the vehicle and not allowing the vehicle to be subjected to subsequent operation.
2. The panoramic camera-based vehicle unlocking method according to claim 1, wherein the step of obtaining the standard face information of the vehicle-opening-allowed person comprises:
and receiving and storing the uploaded standard face information allowing the vehicle personnel to be started and the associated information for binding the standard face information in identity in advance.
3. The panoramic camera-based vehicle unlocking method of claim 1, further comprising:
and after the car door is closed, the video recording is stopped, and the recorded video is uploaded.
4. The panoramic camera-based vehicle unlocking method according to claim 3, further comprising, after the step of sending a prompt message to the owner terminal after closing the door:
the recorded video and/or the compared actual face information in a preset detection range are/is sent to a vehicle owner terminal so that the vehicle owner terminal can confirm the information of the people who start the vehicle;
and if the fact that the owner terminal selects not to check the recorded video and/or the actual face information passing the comparison in the preset detection range is detected, judging that the owner terminal confirms the information of the personnel who start the vehicle.
5. The panoramic camera-based vehicle unlocking method according to claim 1, further comprising, after the step of detecting the direction of the person passing the comparison within the preset unlocking range:
and if the direction of the compared personnel is not the main driving direction of the vehicle, only unlocking the vehicle and not actively opening the vehicle door in the direction.
6. The panoramic camera-based vehicle unlocking method of claim 1, further comprising, after the step of locking the vehicle:
after the vehicle is locked, if the received unlocking password is determined to be correct, the locked vehicle is unlocked.
7. The panoramic camera-based vehicle unlocking method of claim 1, further comprising:
and optimizing the face recognition algorithm by using the face information which is compared and confirmed by the vehicle owner, and issuing the updated and iterated face recognition algorithm to the vehicle.
8. The panoramic camera-based vehicle unlocking method of claim 1, further comprising:
an interface for extending the camera is provided, allowing increased access to the camera.
9. The utility model provides a vehicle unblock equipment based on panorama camera which characterized in that, vehicle unblock equipment based on panorama camera includes: the vehicle unlocking method based on the panoramic camera comprises the steps of the panoramic camera, a panoramic 360 controller, a cloud storage, a vehicle-mounted wireless communication device, a memory, a processor and a vehicle unlocking program based on the panoramic camera, wherein the vehicle unlocking program based on the panoramic camera is stored on the memory and can run on the processor, and when the vehicle unlocking program based on the panoramic camera is executed by the processor, the vehicle unlocking program based on the panoramic camera realizes the steps of the vehicle unlocking method based on the panoramic camera according to any one of claims 1 to 8.
10. A computer readable storage medium, wherein the computer readable storage medium has stored thereon a panoramic camera based vehicle unlocking program, which when executed by a processor, implements the steps of the panoramic camera based vehicle unlocking method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111125613.4A CN113815562A (en) | 2021-09-24 | 2021-09-24 | Vehicle unlocking method and device based on panoramic camera and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111125613.4A CN113815562A (en) | 2021-09-24 | 2021-09-24 | Vehicle unlocking method and device based on panoramic camera and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113815562A true CN113815562A (en) | 2021-12-21 |
Family
ID=78915469
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111125613.4A Pending CN113815562A (en) | 2021-09-24 | 2021-09-24 | Vehicle unlocking method and device based on panoramic camera and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113815562A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115050201A (en) * | 2022-05-11 | 2022-09-13 | 小马易行科技(上海)有限公司 | Autonomous vehicle service method, system, computer device, and storage medium |
| CN115257628A (en) * | 2022-07-20 | 2022-11-01 | 小米汽车科技有限公司 | Vehicle control method, device, storage medium, vehicle and chip |
| CN115320540A (en) * | 2022-08-04 | 2022-11-11 | 重庆长安汽车股份有限公司 | Vehicle control method, device, system, electronic device, storage medium and vehicle |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20080010026A (en) * | 2006-07-25 | 2008-01-30 | (주)영신전자 | Security system and method for automobile using multimedia data |
| CN106394491A (en) * | 2016-12-09 | 2017-02-15 | 大陆汽车电子(长春)有限公司 | Keyless starting system and polling method |
| TW201710119A (en) * | 2015-09-04 | 2017-03-16 | Shun-He Hong | Door opening anti-collision device for vehicle and method thereof capable of achieving the purpose of anti-collision and avoiding the pause feeling and inconvenience in opening the vehicle door |
| CN108327680A (en) * | 2018-01-04 | 2018-07-27 | 惠州市德赛西威汽车电子股份有限公司 | A kind of control method for vehicle, apparatus and system |
| CN109249895A (en) * | 2017-07-13 | 2019-01-22 | 上海荆虹电子科技有限公司 | A kind of automobile and management control system and method based on living things feature recognition |
| CN110027509A (en) * | 2019-04-10 | 2019-07-19 | 上海工程技术大学 | A kind of vehicular theft-prevention monitoring device and method based on recognition of face |
| CN110298945A (en) * | 2019-06-14 | 2019-10-01 | 武汉格罗夫氢能汽车有限公司 | Based on automobile data recorder face recognition unlocking method of vehicle, equipment and storage medium |
| CN110930547A (en) * | 2019-02-28 | 2020-03-27 | 上海商汤临港智能科技有限公司 | Vehicle door unlocking method, vehicle door unlocking device, vehicle door unlocking system, electronic equipment and storage medium |
| JP2020060008A (en) * | 2018-10-09 | 2020-04-16 | 三菱自動車工業株式会社 | Vehicle door control device |
| AU2020101134A4 (en) * | 2020-06-25 | 2020-07-30 | Hubei university of science and technology | A Vehicle Anti-Theft System Based on Facial Expression Action Recognition |
| CN111516640A (en) * | 2020-04-24 | 2020-08-11 | 上海商汤临港智能科技有限公司 | Vehicle door control method, vehicle, system, electronic device, and storage medium |
| CN111959419A (en) * | 2020-08-25 | 2020-11-20 | 惠州华阳通用电子有限公司 | Vehicle-mounted device starting method and storage medium |
-
2021
- 2021-09-24 CN CN202111125613.4A patent/CN113815562A/en active Pending
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20080010026A (en) * | 2006-07-25 | 2008-01-30 | (주)영신전자 | Security system and method for automobile using multimedia data |
| TW201710119A (en) * | 2015-09-04 | 2017-03-16 | Shun-He Hong | Door opening anti-collision device for vehicle and method thereof capable of achieving the purpose of anti-collision and avoiding the pause feeling and inconvenience in opening the vehicle door |
| CN106394491A (en) * | 2016-12-09 | 2017-02-15 | 大陆汽车电子(长春)有限公司 | Keyless starting system and polling method |
| CN109249895A (en) * | 2017-07-13 | 2019-01-22 | 上海荆虹电子科技有限公司 | A kind of automobile and management control system and method based on living things feature recognition |
| CN108327680A (en) * | 2018-01-04 | 2018-07-27 | 惠州市德赛西威汽车电子股份有限公司 | A kind of control method for vehicle, apparatus and system |
| JP2020060008A (en) * | 2018-10-09 | 2020-04-16 | 三菱自動車工業株式会社 | Vehicle door control device |
| US20210009080A1 (en) * | 2019-02-28 | 2021-01-14 | Shanghai Sensetime Lingang Intelligent Technology Co., Ltd. | Vehicle door unlocking method, electronic device and storage medium |
| CN110930547A (en) * | 2019-02-28 | 2020-03-27 | 上海商汤临港智能科技有限公司 | Vehicle door unlocking method, vehicle door unlocking device, vehicle door unlocking system, electronic equipment and storage medium |
| CN110027509A (en) * | 2019-04-10 | 2019-07-19 | 上海工程技术大学 | A kind of vehicular theft-prevention monitoring device and method based on recognition of face |
| CN110298945A (en) * | 2019-06-14 | 2019-10-01 | 武汉格罗夫氢能汽车有限公司 | Based on automobile data recorder face recognition unlocking method of vehicle, equipment and storage medium |
| CN111516640A (en) * | 2020-04-24 | 2020-08-11 | 上海商汤临港智能科技有限公司 | Vehicle door control method, vehicle, system, electronic device, and storage medium |
| AU2020101134A4 (en) * | 2020-06-25 | 2020-07-30 | Hubei university of science and technology | A Vehicle Anti-Theft System Based on Facial Expression Action Recognition |
| CN111959419A (en) * | 2020-08-25 | 2020-11-20 | 惠州华阳通用电子有限公司 | Vehicle-mounted device starting method and storage medium |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115050201A (en) * | 2022-05-11 | 2022-09-13 | 小马易行科技(上海)有限公司 | Autonomous vehicle service method, system, computer device, and storage medium |
| CN115257628A (en) * | 2022-07-20 | 2022-11-01 | 小米汽车科技有限公司 | Vehicle control method, device, storage medium, vehicle and chip |
| CN115320540A (en) * | 2022-08-04 | 2022-11-11 | 重庆长安汽车股份有限公司 | Vehicle control method, device, system, electronic device, storage medium and vehicle |
| CN115320540B (en) * | 2022-08-04 | 2024-03-08 | 重庆长安汽车股份有限公司 | Vehicle control method, device, system, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113815562A (en) | Vehicle unlocking method and device based on panoramic camera and storage medium | |
| CN110807178B (en) | Vehicle authorization management method and device, terminal and server | |
| KR101586228B1 (en) | Method and apparatus for controlling vehicle using motion recognition with face recognition | |
| CN108357462B (en) | Vehicle unlocking method and vehicle | |
| US20170147887A1 (en) | Method and apparatus for interior/exterior vehicular environment alerts | |
| JP2006193919A (en) | Remote control system and vehicle with remote control device | |
| CN110392082B (en) | Vehicle control method and system | |
| EP3023943B1 (en) | Controller, control method, and computer-readable recording medium | |
| JP2007145199A (en) | Theft prevention device and burglary prevention system | |
| JP2014120095A (en) | Vehicle monitoring system | |
| EP3737080A1 (en) | Doorbell, key management system, and intercom system | |
| JP2017223068A (en) | Authentication method and authentication device | |
| JP2011172195A (en) | Onboard machine, portable device, and control program | |
| CN113297873A (en) | Vehicle anti-theft method, system and device based on face recognition | |
| JP4604776B2 (en) | Remote control device | |
| CN113696853B (en) | Intelligent automobile central control system based on Internet of things | |
| JP3736725B2 (en) | Vehicle anti-theft system | |
| KR101947040B1 (en) | System and method for operating tail gate | |
| JP4591189B2 (en) | Remote control device | |
| CN109903441B (en) | Mechanical garage parking method, device and system and storage medium | |
| CN116486520A (en) | Vehicle trunk control method, device and system | |
| JP2001063525A (en) | Vehicle antitheft system | |
| US20210370867A1 (en) | Vehicle control system, server, and vehicle control method | |
| EP3349191A1 (en) | Method and system for automatically activating a closing element of a closable opening of a vehicle | |
| CN114715075A (en) | Vehicle authentication system and method based on BLE and fingerprint mode |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211221 |