WO2021164380A1 - 车门解锁方法、装置、系统、电子设备和存储介质 - Google Patents
车门解锁方法、装置、系统、电子设备和存储介质 Download PDFInfo
- Publication number
- WO2021164380A1 WO2021164380A1 PCT/CN2020/134272 CN2020134272W WO2021164380A1 WO 2021164380 A1 WO2021164380 A1 WO 2021164380A1 CN 2020134272 W CN2020134272 W CN 2020134272W WO 2021164380 A1 WO2021164380 A1 WO 2021164380A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- distance
- vehicle
- face recognition
- threshold
- response
- Prior art date
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/30—Detection related to theft or to other events relevant to anti-theft systems
- B60R25/34—Detection related to theft or to other events relevant to anti-theft systems of conditions of vehicle components, e.g. of windows, door locks or gear selectors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/20—Means to switch the anti-theft system on or off
- B60R25/25—Means to switch the anti-theft system on or off using biometry
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/30—Detection related to theft or to other events relevant to anti-theft systems
- B60R25/31—Detection related to theft or to other events relevant to anti-theft systems of human presence inside or outside the vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
- G06F1/3231—Monitoring the presence, absence or movement of users
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
Definitions
- the present disclosure relates to the field of vehicle technology, and in particular to a method, device, system, electronic equipment, and storage medium for unlocking a vehicle door.
- the present disclosure provides a technical solution for unlocking a vehicle door.
- a method for unlocking a vehicle door including:
- At least one door of the vehicle is controlled to be unlocked and/or opened.
- the continuously acquiring the distance between the object outside the vehicle and the infrared distance measuring sensor through the infrared distance measuring sensor provided outside the vehicle outdoor includes:
- the distance between an object outside the vehicle and the infrared distance sensor is continuously acquired by an infrared distance measuring sensor arranged outside the vehicle.
- the capture module captures the video stream, including:
- the awakened face recognition module controls the image acquisition module to collect video streams
- the face recognition module installed in the vehicle is awakened ;
- the awakened face recognition module controls the image acquisition module to acquire a video stream.
- the first distance threshold includes a first predetermined distance value and a second predetermined distance value, and the first predetermined distance value is greater than the second predetermined distance value;
- waking up and controlling the image acquisition module provided in the vehicle to collect the video stream includes:
- the awakened face recognition module controls the image acquisition module to collect a video stream
- the second distance threshold includes a third predetermined distance value and a fourth predetermined distance value, wherein the third predetermined distance value is greater than the fourth predetermined distance value;
- the distance gradually decreasing and in the process that the distance is less than or equal to the second distance threshold, the distance is maintained for a fixed duration to reach the second time threshold, awakening and controlling the image acquisition module to collect Video streaming, including:
- the awakened face recognition module controls the image acquisition module to collect Video streaming.
- the method further includes:
- the face recognition module is controlled to enter the dormant state.
- a vehicle door unlocking device including:
- An acquiring module configured to continuously acquire the distance between an object outside the vehicle and the infrared distance measuring sensor through an infrared distance measuring sensor arranged outside the vehicle's exterior;
- a face recognition module configured to perform face recognition based on at least one image in the video stream
- the control module is used to control the unlocking and/or opening of at least one door of the vehicle in response to successful face recognition.
- the acquisition module is used to:
- the distance between an object outside the vehicle and the infrared distance sensor is continuously acquired by an infrared distance measuring sensor arranged outside the vehicle.
- the wake-up module is used to:
- the awakened face recognition module controls the image acquisition module to collect video streams
- the face recognition module installed in the vehicle is awakened ;
- the awakened face recognition module controls the image acquisition module to acquire a video stream.
- the first distance threshold includes a first predetermined distance value and a second predetermined distance value, and the first predetermined distance value is greater than the second predetermined distance value;
- the wake-up module is used for:
- the awakened face recognition module controls the image acquisition module to collect a video stream
- the second distance threshold includes a third predetermined distance value and a fourth predetermined distance value, wherein the third predetermined distance value is greater than the fourth predetermined distance value;
- the wake-up module is used for:
- the awakened face recognition module controls the image acquisition module to collect Video streaming.
- the device further includes:
- the sleep module is used for controlling the face recognition module to enter the sleep state if the face image is not collected within the preset time, or the face recognition is not passed within the preset time.
- a vehicle door unlocking system which includes an infrared ranging sensor, a main control chip, a face recognition module, and an image acquisition module; the main control chip is connected to the infrared ranging sensor and The face recognition module is connected, and the image acquisition module is connected to the face recognition module; the infrared ranging sensor is used to continuously obtain the distance between an object outside the vehicle and the infrared ranging sensor
- the main control chip responds to the distance gradually decreases, and the duration of the distance less than or equal to the first distance threshold reaches the first time threshold, or, in response to the distance gradually decreases, and in the
- the distance is less than or equal to the second distance threshold, the distance is maintained for a fixed duration and reaches the second time threshold, the face recognition module is awakened, and the image acquisition module is awakened through the face recognition module
- the image acquisition module is used to collect a video stream; the face recognition module performs face recognition based on at least one image in the video stream;
- the control module is used to collect
- an electronic device including: one or more processors; a memory for storing executable instructions; wherein the one or more processors are configured to call the memory to store The executable instructions to perform the above method.
- a computer-readable storage medium having computer program instructions stored thereon, and the computer program instructions implement the above-mentioned method when executed by a processor.
- a computer program including computer readable code, and when the computer readable code is executed in an electronic device, a processor in the electronic device executes for realizing the above method.
- the distance between the object outside the vehicle and the infrared distance sensor is continuously acquired by the infrared distance sensor provided outside the vehicle, and the distance is gradually reduced in response to the distance, and the distance
- the duration less than or equal to the first distance threshold reaches the first duration threshold, wakes up and controls the image acquisition module set in the car to collect a video stream, performs face recognition based on at least one image in the video stream, and
- at least one door of the car is controlled to be unlocked and/or opened, so that the infrared range sensor can be used as a wake-up source to wake up the image acquisition module used for face unlocking the door, so that both
- the infrared ranging sensor has accurate ranging and fast ranging speed, so the response speed can be improved.
- the infrared ranging sensor has a low price and
- Fig. 1 shows a flowchart of a method for unlocking a vehicle door provided by an embodiment of the present disclosure.
- Fig. 2 shows a schematic diagram of the ranging principle of the infrared ranging sensor in an embodiment of the present disclosure.
- Fig. 3 shows a block diagram of a vehicle door unlocking system provided by an embodiment of the present disclosure.
- Fig. 4 shows a block diagram of a vehicle door unlocking device provided by an embodiment of the present disclosure.
- FIG. 5 shows a block diagram of an electronic device 800 provided by an embodiment of the present disclosure.
- FIG. 6 shows a block diagram of an electronic device 1900 provided by an embodiment of the present disclosure.
- Fig. 1 shows a flowchart of a method for unlocking a vehicle door provided by an embodiment of the present disclosure.
- the execution subject of the vehicle door unlocking method may be a vehicle door unlocking device.
- the method for unlocking the vehicle door may be executed by an in-vehicle device or other processing device.
- the method for unlocking the vehicle door may be implemented by a processor invoking a computer-readable instruction stored in a memory. As shown in FIG. 1, the method for unlocking the vehicle door includes steps S11 to S14.
- step S11 the distance between the object outside the vehicle and the infrared distance measuring sensor is continuously acquired by the infrared distance measuring sensor provided outside the vehicle exterior.
- the infrared ranging sensor may be installed in at least one of the following positions: a B-pillar of the vehicle, at least one door, and at least one rearview mirror.
- the vehicle door in the embodiment of the present disclosure may include a vehicle door through which people enter and exit (for example, a left front door, a right front door, a left rear door, and a right rear door), and may also include a trunk door of the vehicle.
- Fig. 2 shows a schematic diagram of the ranging principle of the infrared ranging sensor in an embodiment of the present disclosure.
- the transmitter of the infrared ranging sensor can emit infrared light at a preset frequency.
- the infrared light will It is reflected back and received by the receiver of the infrared ranging sensor.
- the infrared ranging sensor can send the acquired distance to the main control chip, and the main control chip can save the distance information according to the time of receiving the distance from the infrared ranging sensor, that is, the distance information saved by the main control chip can include the correspondence between the receiving time and the distance Therefore, according to the distance information, the distance value obtained by the infrared ranging sensor at each time can be determined.
- the main control chip may be an MCU (Micro Controller Unit, Micro Control Unit) or the like.
- the infrared light emitted by the transmitter of the infrared ranging sensor will not be reflected back. In this case, the infrared ranging sensor will not be able to measure the distance value, or, The distance value acquired by the infrared range sensor is null. In the case that the infrared distance measuring sensor cannot measure the distance value or the distance value obtained by the infrared distance measuring sensor is empty, the infrared distance measuring sensor may not send distance information to the main control chip.
- infrared ranging sensors The power consumption of infrared ranging sensors is low, usually at uA level, while the power consumption of ultrasonic radar is relatively high, usually at mA level. Therefore, compared with ultrasonic radar, infrared ranging sensor can greatly reduce power consumption.
- the embodiment of the present disclosure uses an infrared ranging sensor to obtain the distance between an object outside the vehicle and the infrared ranging sensor to wake up the image acquisition module. This does not require the user to carry a mobile terminal with Bluetooth function (such as a mobile phone), and does not require the user to confirm on the mobile terminal with Bluetooth function, so the user experience can be improved.
- infrared ranging sensors also have high ranging accuracy.
- the continuously acquiring the distance between the object outside the vehicle and the infrared distance measuring sensor through the infrared distance measuring sensor provided outside the vehicle outdoor includes: when the vehicle is in a dormant state Or when the vehicle is in a dormant state and the vehicle door is not unlocked, the distance between the object outside the vehicle and the infrared distance sensor is continuously acquired through the infrared distance measuring sensor arranged outside the vehicle exterior.
- the sleep state of the car may indicate the sleep state of all modules in the car except the infrared ranging sensor and the main control chip.
- the driver can usually operate to control the unlocking of the door.
- the distance between the object outside the vehicle and the infrared distance sensor can be continuously obtained through the infrared distance sensor only when the vehicle is in the dormant state or in the dormant state and the door is not unlocked.
- the car is not in a dormant state or in a dormant state but the door is not unlocked, there is no need to use an infrared ranging sensor to measure distance, thereby reducing power consumption.
- step S12 in response to the distance gradually decreasing, and the duration of the distance being less than or equal to the first distance threshold reaches the first duration threshold, wake up and control the image acquisition module installed in the vehicle to collect the video stream Or, in response to the distance being gradually reduced, and in the process that the distance is less than or equal to the second distance threshold, the distance is maintained for a fixed duration to reach the second time threshold, wake up and control the image acquisition module Capture video stream.
- the distance in the process when the distance is less than or equal to the second distance threshold, the distance is maintained for a fixed duration to reach the second time length threshold, which may mean that in the process when the distance is less than or equal to the second distance threshold, The distance remains the same for a duration that reaches the second duration threshold.
- the distance in the process when the distance is less than or equal to the second distance threshold, the distance is maintained for a fixed duration to reach the second time threshold, which may mean that the dispersion degree of the distance in any time period is less than or equal to the predetermined distance.
- the distances in the time period are all less than or equal to the second distance threshold, and the length of the time period is greater than or equal to the second duration threshold.
- the degree of dispersion can be measured by standard deviation or variance, for example, the standard deviation can be used as the degree of dispersion.
- the main control chip can save the distance information and determine whether the distance is gradually decreasing. If the distance is gradually decreasing, it can be determined whether the duration of the distance less than or equal to the first distance threshold reaches the preset first distance. One-time threshold, or it can be judged whether the fixed duration of the distance in the process of being less than or equal to the second distance threshold reaches the second-time threshold, if yes, it can be judged as intentional opening, otherwise it can be judged as unintentional opening, for example It may be a pedestrian passing by, an obstacle drifting by, etc. According to the embodiments of the present disclosure, it is possible to reduce the possibility of unlocking the door of the vehicle when the user unintentionally opens the door, so that the safety of the vehicle can be improved.
- the image set on the car is awakened and controlled
- the collection module collects the video stream, including: in response to the distance gradually decreasing, and the duration of the distance being less than or equal to the first distance threshold reaches the first time threshold, waking up the face recognition module installed in the vehicle
- the awakened face recognition module controls the image acquisition module to collect video streams.
- the face recognition module may be in a sleep state before the condition that "the distance is gradually reduced, and the duration of the distance less than or equal to the first distance threshold reaches the first time threshold" is satisfied. Maintain low-power operation, which can reduce the operating power consumption of the way of brushing the face and opening the door.
- wake up And controlling the image capture module to capture the video stream including: responding to the distance gradually decreasing, and in the process that the distance is less than or equal to a second distance threshold, the distance is maintained for a fixed duration to reach the second duration
- the threshold is used to wake up the face recognition module set in the car; the waked up face recognition module controls the image acquisition module to collect video streams.
- the person The face recognition module can be in a sleep state to maintain low-power operation, which can reduce the operating power consumption of the way of brushing the face and driving the door.
- the first distance threshold includes a first predetermined distance value and a second predetermined distance value, and the first predetermined distance value is greater than the second predetermined distance value;
- the distance gradually decreases, and the duration of the distance less than or equal to the first distance threshold reaches the first time threshold, waking up and controlling the image acquisition module provided in the vehicle to collect the video stream, including: responding to the distance Gradually decrease, and the distance is less than or equal to the first predetermined distance value, wake up the face recognition module installed in the car; respond to the duration of the distance less than or equal to the second predetermined distance value
- the awakened face recognition module controls the image acquisition module to collect a video stream.
- the second predetermined distance value may be the maximum allowable distance value between the user and the car when performing face recognition.
- the first predetermined distance value may be determined according to the second predetermined distance value and the wake-up distance.
- the first predetermined distance value may be equal to the sum of the second predetermined distance value and the wake-up distance, or the first predetermined distance value may be set slightly larger than the first predetermined distance value. 2.
- the wake-up distance may be equal to the product of the wake-up duration of the face recognition module and the average walking speed, and the wake-up duration of the face recognition module may represent the length of time required for the face recognition module to switch from a sleep state to a working state.
- the face recognition module can be in a sleep state to maintain low power consumption before the condition that "the distance is gradually reduced, and the distance is less than or equal to the first predetermined distance value" is satisfied , So as to reduce the operating power consumption of the face-sweeping driving door mode; when the condition that "the distance is gradually reduced and the distance is less than or equal to the first predetermined distance value" is met, the face recognition module is awakened, This enables the face recognition module to be in a working state before the user arrives at the door, so that when "the duration of the distance less than or equal to the second predetermined distance reaches the first time threshold", it is determined that the user has arrived In the car door, the image capture module can immediately perform face recognition through the awakened face recognition module after the video stream is collected.
- Facial recognition efficiency improves user experience.
- the user has no perception during the wake-up process, which can further improve the user experience.
- the image capture module may not capture the video stream, thereby not only reducing power It can also reduce the possibility of unlocking the door by mistake, thereby improving the safety of unlocking the door. Therefore, this implementation can not only meet the requirements of low-power operation, but also meet the requirements of fast opening doors, thereby providing a way to better balance the power saving of the face recognition module, user experience, and safety. Aspects of the solution.
- the second distance threshold includes a third predetermined distance value and a fourth predetermined distance value, wherein the third predetermined distance value is greater than the fourth predetermined distance value; the response When the distance is gradually reduced, and the distance is maintained for a fixed duration during the process that the distance is less than or equal to the second distance threshold and reaches the second time threshold, wake up and control the image acquisition module to collect the video stream,
- the method includes: in response to the distance gradually decreasing, and the distance is less than or equal to the third predetermined distance value, waking up a face recognition module provided in the vehicle; and in response to the distance being less than or equal to the first During the four-predetermined distance value process, the distance is maintained for a fixed duration and reaches the second duration threshold, and the awakened face recognition module controls the image acquisition module to collect video streams.
- the third predetermined distance value may be equal to or not equal to the first predetermined distance value; the fourth predetermined distance value may be equal to or not equal to the second predetermined distance value.
- the fourth predetermined distance value may be the maximum allowable distance value between the user and the car when performing face recognition.
- the third predetermined distance value may be determined according to the fourth predetermined distance value and the wake-up distance.
- the third predetermined distance value may be equal to the sum of the fourth predetermined distance value and the wake-up distance, or the third predetermined distance value may be set slightly larger than the first 4. The sum of the predetermined distance value and the wake-up distance.
- the face recognition module can be in a sleep state to maintain low power consumption before the condition that "the distance is gradually reduced, and the distance is less than or equal to the third predetermined distance value" is satisfied , So as to reduce the operating power consumption of the face-sweeping driving door mode; when the condition of “the distance is gradually reduced and the distance is less than or equal to the third predetermined distance value” is met, the face recognition module is awakened, This enables the face recognition module to be in a working state before the user arrives at the door, so that "the distance is maintained for a fixed duration in the process when the distance is less than or equal to the fourth predetermined distance value to reach the second Time threshold", that is, when the user arrives at the car door, the image capture module can immediately use the awakened face recognition module to recognize the car door after collecting the video stream, without requiring the user to wait for the face recognition after the user arrives at the car door The module is awakened, which can increase the efficiency of face recognition and improve the user experience.
- the image capture module may not capture video until the condition that "the distance remains fixed for a duration that reaches the second duration threshold in the process when the distance is less than or equal to the fourth predetermined distance value" is satisfied.
- This not only reduces power consumption, but also reduces the possibility of unlocking the door by mistake, thereby improving the safety of unlocking the door. Therefore, this implementation can not only meet the requirements of low-power operation, but also meet the requirements of fast opening doors, thereby providing a good balance between the power saving of the face recognition module, user experience, and safety. Aspects of the solution.
- the image acquisition module can be installed outside the car. By controlling the image acquisition module installed outside the car to collect the video stream outside the car, the car can be detected based on the video stream outside the car. The intention of outsiders to board the car.
- the image acquisition module may be installed in at least one of the following positions: the B-pillar of the vehicle, at least one door, and at least one rearview mirror.
- the image acquisition module can be installed 130 cm to 160 cm above the ground on the B-pillar, which is not limited here.
- the image capture module can be installed on the two B-pillars and the trunk of the car.
- each B-pillar can be installed with an image acquisition module facing the front passenger (driver or co-driver) boarding position and an image acquisition module facing the rear passenger boarding position.
- the method further includes: if no face image is collected within a preset time, or at a preset time If the face recognition is not passed, the face recognition module is controlled to enter the dormant state.
- This implementation method controls the face recognition module to enter the dormant state when the face image is not collected within a preset time after waking up the face recognition module, or the face recognition module does not pass the person within a preset time after waking up the face recognition module.
- the face recognition module is controlled to enter a sleep state, thereby reducing power consumption.
- step S13 face recognition is performed based on at least one image in the video stream.
- face recognition may be performed based on the first image in the video stream to obtain a face recognition result.
- the first image may include at least a part of a human face.
- the first image can be an image selected from a video stream, where the image can be selected from the video stream in a variety of ways.
- the first image is an image selected from a video stream that meets a preset quality condition.
- the preset quality condition may include one or any combination of the following: whether it contains a human face, and whether the human face is located in the image The central area of the face, whether the face is completely contained in the image, the proportion of the face in the image, the state of the face (such as the angle of the face), the image sharpness, the image exposure, etc., the embodiments of the present disclosure are This is not limited.
- the face recognition includes face authentication; the performing face recognition based on at least one image in the video stream includes: based on at least one image in the video stream Perform face authentication with pre-registered facial features.
- face authentication is used to extract facial features in the collected images, and compare the facial features in the collected images with pre-registered facial features to determine whether they belong to the same person's facial features For example, it can be judged whether the facial features in the collected images belong to the facial features of the car owner or temporary user (such as a friend of the car owner or a courier, etc.).
- the face recognition further includes living body detection; the performing face recognition based on at least one image in the video stream includes: via a depth sensor in the image acquisition module Collecting a first depth map corresponding to the first image in the video stream; performing live detection based on the first image and the first depth map.
- the living body detection is used to verify whether it is a living body, for example, it can be used to verify whether it is a human body.
- the first depth map corresponds to the first image.
- the first depth map and the first image are respectively acquired by the depth sensor and the image sensor for the same scene, or the first depth map and the first image are acquired by the depth sensor and the image sensor for the same target area at the same time , but the embodiment of the present disclosure does not limit this.
- the image sensor can be an RGB sensor or an infrared sensor.
- the depth sensor refers to a sensor used to collect depth information.
- the embodiments of the present disclosure do not limit the working principle and working band of the depth sensor.
- the depth sensor may be a binocular infrared sensor, a TOF sensor, or a structured light sensor.
- the face recognition further includes authorization authentication;
- the performing face recognition based on at least one image in the video stream includes: based on at least one image in the video stream Acquire door-opening authority information of the object outside the vehicle; perform authority authentication based on the door-opening authority information of the object outside the vehicle.
- different door opening authority information can be set for different users, so that the safety of the vehicle can be improved.
- the door opening authority information of the object outside the vehicle includes one or more of the following: information about the door of the object outside the vehicle that has the authority to open the door, and the object outside the vehicle that has the authority to open the door. Time, the number of door opening permissions corresponding to the object outside the vehicle.
- the information of the doors for which the object outside the vehicle has the authority to open doors may be all doors or trunk doors.
- the doors for which the owner or his family or friends have the authority to open the doors may be all doors
- the doors for which the courier or property staff has the authority to open the doors may be the trunk doors.
- the vehicle owner can set the door information for other personnel with the permission to open the door.
- the time when the object outside the vehicle has the right to open the door may be all times, or may be a preset time period.
- the time when the car owner or the car owner's family has the authority to open the door may be all the time.
- the owner can set the time for other personnel with the authority to open the door. For example, in an application scenario where a friend of a car owner borrows a car from the car owner, the car owner can set the time for the friend to have the permission to open the door to two days. For another example, after the courier contacts the car owner, the car owner can set the time for the courier to open the door to 13:00-14:00 on January 20, 2020.
- the number of door opening permissions corresponding to objects outside the vehicle may be an unlimited number of times or a limited number of times.
- the number of door opening permissions corresponding to the car owner or the family or friends of the car owner may be an unlimited number of times.
- the number of times the door-opening authority corresponding to the courier may be a limited number of times, for example, one time.
- step S14 in response to successful face recognition, at least one door of the vehicle is controlled to be unlocked and/or opened.
- the door of the driver's seat in response to successful face recognition, can be controlled to unlock and/or open.
- the door corresponding to the image capture module that captures the video stream in response to successful face recognition, can be controlled to unlock and/or open, for example, if the status information of the door is unlocked , The door is controlled to unlock or the door is controlled to be unlocked and opened; if the status information of the door is unlocked and not opened, the door is controlled to open, which can automatically open the door for the user based on face recognition without The user pulls the car door manually to improve the convenience of using the car.
- the door corresponding to the image capture module that captures the video stream may be determined according to the position of the image capture module.
- the door corresponding to the image acquisition module that collects the video stream may be the left front door
- the door corresponding to the image acquisition module that collects the video stream may be the left rear door
- the door corresponding to the image acquisition module that collects the video stream may be the right front door
- the door corresponding to the image acquisition module that collects the video stream can be the right rear door
- the video The stream is collected by the image acquisition module installed on the trunk door, and the door corresponding to the image acquisition module that collects the video stream may be the trunk door.
- the method further includes: in response to a face recognition failure, activating a password set in the car Unlock the module to start the password unlocking process.
- password unlocking is an alternative to face recognition unlocking.
- the reason for the failure of face recognition may include at least one of the result of the living body detection being a human prosthesis, the failure of face authentication, the failure of image collection (for example, the failure of the camera), and the number of recognition times exceeding a predetermined number.
- the password unlocking process is initiated.
- the password entered by the user can be obtained through the touch screen on the B-pillar.
- the password unlocking will become invalid, for example, M is equal to 5.
- the method further includes: performing object detection on at least one image in the video stream to determine the object carrying information of an object outside the vehicle; in response to the successful face recognition, controlling The unlocking and/or opening of the at least one door of the vehicle includes: in response to successful face recognition and the object carrying information is a carrying object, controlling the at least one door of the vehicle to open.
- the object-carrying information of the object outside the vehicle may represent the information of the object carried by the object outside the vehicle.
- the object carrying information may indicate whether the object is carried; for another example, the object carrying information may indicate the category of the carried object.
- an object detection network may be used to perform object detection on at least one image in the video stream, where the object detection network may be based on a deep learning architecture.
- the categories of objects that can be recognized by the object detection network may not be limited, and those skilled in the art can flexibly set the categories of objects that can be recognized by the object detection network according to actual application scenarios.
- the categories of objects that can be identified by the object detection network include umbrellas, trolley boxes, strollers, strollers, handbags, shopping bags, and so on.
- the user when it is inconvenient for the user to open the door (for example, the user carries a handbag, shopping bag, trolley case, umbrella, etc.), the user automatically pops the door (for example, the left front door, right front door, left rear door, right side of the car). Back door, trunk door), which can greatly facilitate the user to get on the car and place items in the trunk in scenes such as users carrying items or raining.
- the face recognition process when the user approaches the vehicle, the face recognition process can be automatically triggered without deliberate actions (such as touching a button or making a gesture), so that the door can be automatically opened for the user without the user having to free up his hand to unlock or open The door can improve the user experience of getting on the car and placing items in the trunk.
- the bounding box of the human body in at least one image in the video stream can be detected, object detection is performed on the area corresponding to the bounding box, and the object detection result is obtained, and based on the object detection result, it is determined Objects outside the vehicle carry information.
- the bounding box of the human body in the first image of the video stream can be detected; object detection is performed on the area corresponding to the bounding box in the first image.
- the area corresponding to the bounding box may represent the area defined by the bounding box.
- determining the object-carrying information of the object outside the vehicle may include: if the object detection result is that the object is detected, acquiring the distance between the object and the hand of the object outside the vehicle Based on the distance, determine the object carrying information of the object outside the vehicle.
- the distance is less than the preset distance, it may be determined that the object carried information of the object outside the vehicle is a carried object.
- the information carried by the object of the object outside the vehicle only the distance between the object and the hand of the object outside the vehicle may be considered, without considering the size of the object.
- the determining the object-carrying information of the object outside the vehicle based on the object detection result may further include: if the object detection result is that the object is detected, acquiring the size of the object; Based on the distance, determining the object-carrying information of the object outside the vehicle includes: determining the object-carrying information of the object outside the vehicle based on the distance and the size.
- the distance between the object and the hand of the object outside the vehicle and the size of the object can be considered at the same time.
- the determining the object carrying information of the object outside the vehicle based on the distance and the size may include: if the distance is less than or equal to a preset distance, and the size is greater than or equal to a preset size, Then it is determined that the object carried information of the object outside the vehicle is a carried object.
- the preset distance may be zero, or the preset distance may be set to be greater than zero.
- the determining the object-carrying information of the object outside the vehicle based on the object detection result may include: if the object detection result is that the object is detected, acquiring the size of the object; The size of the object that determines the object outside the car carries information.
- the size of the object when determining the information carried by the object of the object outside the vehicle, only the size of the object may be considered, without considering the distance between the object and the hand of the object outside the vehicle. For example, if the size is greater than the preset size, it is determined that the object carried information of the object outside the vehicle is a carried object.
- the method further includes: performing object detection on at least one image in the video stream to determine the object carrying information of an object outside the vehicle; in response to the successful face recognition, controlling The unlocking and/or opening of at least one door of the vehicle includes: in response to successful face recognition and the object carrying information is an object carrying a preset category, controlling the trunk door of the vehicle to open.
- the preset category may indicate the category of objects suitable for storage in the trunk.
- the preset category may include trolley boxes and so on.
- the trunk door can be automatically opened for the user when the user carries an object of a preset category, so that he can place objects in the trunk without the user needing to open the trunk door manually.
- controlling at least one door of the vehicle to unlock and/or open may include: responding to successful face recognition and the object outside the vehicle is not For the driver, control the unlocking and/or opening of at least one non-driver's door of the vehicle. According to this implementation, it is possible to automatically unlock and/or open the door corresponding to the seat suitable for the non-driver.
- the object outside the vehicle in response to the successful face recognition, the object outside the vehicle is not the driver, and the object outside the vehicle carries the object, control the opening of at least one non-driver's door of the vehicle .
- the door corresponding to the seat suitable for the non-driver can be automatically opened for the non-driver.
- controlling the opening of at least one door of the vehicle may include: acquiring state information of the vehicle door; if the state information of the vehicle door is not unlocked, controlling the vehicle door to be unlocked and opened; And/or, if the state information of the vehicle door is unlocked and not opened, control the vehicle door to open.
- controlling the door to open may refer to controlling the door to pop open so that the user can enter the vehicle through an automatically opened door (such as a front door or a rear door), or through an automatically opened door (such as a trunk door or a rear door) Place items.
- an automatically opened door such as a front door or a rear door
- an automatically opened door such as a trunk door or a rear door
- the method further includes: controlling the vehicle door to close, or controlling the vehicle door to close and lock when the conditions for automatic door closing are met.
- controlling the vehicle door to close when the conditions for automatic door closing are met, or controlling the vehicle door to close and lock the safety of the vehicle can be improved.
- the automatic door-closing condition may include: the time period for unlocking or opening the vehicle door reaches a preset time period.
- the main control chip can send door unlocking instructions, opening instructions, and closing instructions to a body control module (BCM, Body Control Model) to control the door.
- BCM Body Control Model
- the method further includes one or both of the following: performing user registration based on the facial image collected by the image capture module; performing remotely based on the facial image collected or uploaded by the first terminal Register and send registration information to the vehicle, where the first terminal is a terminal corresponding to the vehicle owner, and the registration information includes collected or uploaded facial images.
- the registration of the car owner based on the face image collected by the image acquisition module includes: when it is detected that the registration button on the touch screen is clicked, requesting the user to enter a password, and after the password verification is passed, starting the image acquisition module
- the RGB camera acquires the face image, and registers it according to the acquired face image, and extracts the facial features in the face image as the pre-registered face features for subsequent face authentication based on the pre-registered face Feature for face comparison.
- remote registration is performed based on the face image collected or uploaded by the first terminal, and the registration information is sent to the car, where the registration information includes the collected or uploaded face image.
- a user such as a car owner
- the face image collected by the first terminal may be the face image of the user (the owner), and the face image uploaded by the first terminal may be the user (the owner), the user's friend, or the courier, etc.
- TSP cloud sends the registration request to the on-board T-Box (Telematics Box, telematics processor) of the door control device, and the on-board T-Box activates the facial recognition function according to the registration request, and the person carried in the registration request
- the facial features in the face image are used as pre-registered facial features to perform face comparison based on the pre-registered facial features during subsequent face authentication.
- the face image uploaded by the first terminal includes the face image sent by the second terminal to the first terminal, and the second terminal is a terminal corresponding to a temporary user; the registration information It also includes door-opening authority information corresponding to the uploaded face image.
- the temporary user may be a courier or the like.
- the car owner can set door opening authority information for temporary users such as couriers.
- the method further includes: acquiring information about seat adjustments by a occupant of the vehicle; generating or updating the seat corresponding to the occupant according to the information about adjusting the seat by the occupant Preference information.
- the seat preference information corresponding to the occupant may reflect the preference information of adjusting the seat when the occupant rides in the vehicle.
- by generating or updating the seat preference information corresponding to the occupant the next time the occupant rides in the car, it can be automatically based on the seat preference information corresponding to the occupant.
- the seat adjustment is performed to improve the riding experience of the occupants.
- the generating or updating the seat preference information corresponding to the occupant according to the information about the seat adjustment of the occupant includes: according to the position information of the seat where the occupant is seated , And the seat adjustment information of the occupant, generating or updating seat preference information corresponding to the occupant.
- the seat preference information corresponding to the occupant may not only be associated with the seat adjustment information of the occupant, but also may be associated with the position information of the seat where the occupant is seated, that is, The seat preference information corresponding to seats in different positions can be recorded for the occupants, so that the riding experience of the user can be further improved.
- the method further includes: obtaining seat preference information corresponding to a passenger based on the result of face recognition; The seat where the person sits is adjusted.
- the seat information is automatically adjusted for the occupants according to the seat preference information corresponding to the occupants without manual adjustment by the occupants, thereby improving the experience of the occupants in driving or riding. .
- one or more of the height, front and rear, backrest and temperature of the seat can be adjusted.
- the position information of the seat where the passenger is seated can be determined; according to the position information of the seat where the passenger is seated, and the seat preference information corresponding to the passenger, Adjust the seat on which the occupant sits.
- the seat information is automatically adjusted for the occupant without manual adjustment by the occupant according to the position information of the seat where the occupant is seated and the seat preference information corresponding to the occupant , So as to improve the experience of driving or riding a car.
- the distance between the object outside the vehicle and the infrared distance sensor is continuously acquired by the infrared distance sensor provided outside the vehicle, and the distance is gradually reduced in response to the distance, and the distance
- the duration less than or equal to the first distance threshold reaches the first duration threshold, wakes up and controls the image acquisition module set in the car to collect a video stream, performs face recognition based on at least one image in the video stream, and
- at least one door of the car is controlled to be unlocked and/or opened, so that the infrared range sensor can be used as a wake-up source to wake up the image acquisition module used for face unlocking the door, so that both
- the infrared ranging sensor has accurate ranging and fast ranging speed, so the response speed can be improved.
- the infrared ranging sensor has a low price and
- the writing order of the steps does not mean a strict execution order but constitutes any limitation on the implementation process.
- the specific execution order of each step should be based on its function and possibility.
- the inner logic is determined.
- the present disclosure also provides a vehicle door unlocking device, system, electronic equipment, computer-readable storage medium, and program, all of which can be used to implement any of the vehicle door unlocking methods provided in the present disclosure.
- vehicle door unlocking device system, electronic equipment, computer-readable storage medium, and program, all of which can be used to implement any of the vehicle door unlocking methods provided in the present disclosure.
- Fig. 3 shows a block diagram of a vehicle door unlocking system provided by an embodiment of the present disclosure.
- the door unlocking system includes an infrared distance measuring sensor 31, a main control chip 32, a face recognition module 33, and an image acquisition module 34; the main control chip 32 and the infrared distance measuring sensor are respectively 31 is connected to the face recognition module 33, and the image acquisition module 34 is connected to the face recognition module 33; the infrared distance measurement sensor 31 is used to continuously acquire objects outside the vehicle and the infrared measurement The distance from the sensor 31; the main control chip 32 responds to the distance gradually decreasing, and the duration of the distance less than or equal to the first distance threshold reaches the first time threshold, or, in response to the distance Gradually decrease, and when the distance is less than or equal to the second distance threshold, the distance is maintained for a fixed duration to reach the second time threshold, wake up the face recognition module 33, and pass the face recognition The module 33 wakes up the image capture module 34; the image capture module 34 is used to capture a
- Fig. 4 shows a block diagram of a vehicle door unlocking device provided by an embodiment of the present disclosure.
- the vehicle door unlocking device includes: an acquiring module 41, configured to continuously acquire the distance between an object outside the vehicle and the infrared ranging sensor through an infrared ranging sensor disposed outside the vehicle's exterior; and waking up
- the module 42 is configured to wake up and control the image acquisition module installed in the vehicle to collect the video stream in response to the distance gradually decreasing, and the duration of the distance being less than or equal to the first distance threshold reaches the first time threshold.
- the distance in response to the distance being gradually reduced, and in the process that the distance is less than or equal to the second distance threshold, the distance is maintained for a fixed duration to reach the second time threshold, wake up and control the image acquisition module Capture video stream; face recognition module 43, used to perform face recognition based on at least one image in the video stream; control module 44, used to control the unlocking of at least one door of the car in response to successful face recognition And/or open.
- the acquiring module 41 is used to continuously acquire the exterior of the vehicle through an infrared distance measuring sensor arranged outside the exterior of the vehicle when the vehicle is in a dormant state or in a dormant state and the door is not unlocked. The distance between the object and the infrared ranging sensor.
- the wake-up module 42 is configured to: in response to the distance gradually decreasing, and the duration of the distance less than or equal to the first distance threshold reaches the first time threshold, the wake-up is set at all The face recognition module of the vehicle; the awakened face recognition module controls the image acquisition module to collect a video stream; or, in response to the distance being gradually reduced, and when the distance is less than or equal to the first In the process of the second distance threshold, the distance is maintained for a fixed duration and reaches the second time threshold, and the face recognition module installed in the car is awakened; the awakened face recognition module controls the image acquisition module Capture video stream.
- the first distance threshold includes a first predetermined distance value and a second predetermined distance value, and the first predetermined distance value is greater than the second predetermined distance value; the wake-up module 42 uses In response to: in response to the distance gradually decreasing, and the distance is less than or equal to the first predetermined distance value, wake up the face recognition module provided in the vehicle; in response to the distance being less than or equal to the first 2.
- the duration of the predetermined distance value reaches the first time threshold, and the awakened face recognition module controls the image acquisition module to collect the video stream; or, the second distance threshold includes the third predetermined distance value and the first time threshold; Four predetermined distance values, wherein the third predetermined distance value is greater than the fourth predetermined distance value; the wake-up module 42 is configured to: respond to the distance gradually decreasing, and the distance is less than or equal to the first Three predetermined distance values, wake up the face recognition module installed in the car; in response to the distance being less than or equal to the fourth predetermined distance value, the distance is maintained for a fixed duration to reach the second time length threshold, The awakened face recognition module controls the image acquisition module to acquire a video stream.
- the device further includes: a sleep module, configured to control the person if the face image is not collected within a preset time, or if the face recognition is not passed within the preset time
- the face recognition module enters a sleep state.
- the distance between the object outside the vehicle and the infrared distance sensor is continuously acquired by the infrared distance sensor provided outside the vehicle, and the distance is gradually reduced in response to the distance, and the distance
- the duration less than or equal to the first distance threshold reaches the first duration threshold, wakes up and controls the image acquisition module set in the car to collect a video stream, performs face recognition based on at least one image in the video stream, and
- at least one door of the car is controlled to be unlocked and/or opened, so that the infrared range sensor can be used as a wake-up source to wake up the image acquisition module used for face unlocking the door, so that both
- the infrared ranging sensor has accurate ranging and fast ranging speed, so the response speed can be improved.
- the infrared ranging sensor has a low price and
- the functions or modules contained in the device provided in the embodiments of the present disclosure can be used to execute the methods described in the above method embodiments.
- the functions or modules contained in the device provided in the embodiments of the present disclosure can be used to execute the methods described in the above method embodiments.
- the embodiments of the present disclosure also provide a computer-readable storage medium on which computer program instructions are stored, and the computer program instructions implement the foregoing method when executed by a processor.
- the computer-readable storage medium may be a non-volatile computer-readable storage medium, or may be a volatile computer-readable storage medium.
- the embodiment of the present disclosure also provides a computer program, including computer readable code, when the computer readable code is executed in an electronic device, the processor in the electronic device is executed to implement the above method.
- the embodiments of the present disclosure also provide another computer program product, which is used to store computer-readable instructions, and when the instructions are executed, the computer executes the operation of the door unlocking method provided by any of the foregoing embodiments.
- An embodiment of the present disclosure also provides an electronic device, including: one or more processors; a memory for storing executable instructions; wherein the one or more processors are configured to call the executable stored in the memory Instructions to perform the above method.
- the electronic device can be provided as a terminal, server or other form of device.
- the terminal may be a vehicle-mounted device or other processing device.
- FIG. 5 shows a block diagram of an electronic device 800 provided by an embodiment of the present disclosure.
- the electronic device 800 may be a vehicle-mounted device, a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and other terminals.
- the electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, and a sensor component 814 , And communication component 816.
- the processing component 802 generally controls the overall operations of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations.
- the processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the foregoing method.
- the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components.
- the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.
- the memory 804 is configured to store various types of data to support operations in the electronic device 800. Examples of these data include instructions for any application or method to operate on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc.
- the memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable and Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic Disk or Optical Disk.
- SRAM static random access memory
- EEPROM electrically erasable programmable read-only memory
- EPROM erasable and Programmable Read Only Memory
- PROM Programmable Read Only Memory
- ROM Read Only Memory
- Magnetic Memory Flash Memory
- Magnetic Disk Magnetic Disk or Optical Disk.
- the power supply component 806 provides power for various components of the electronic device 800.
- the power supply component 806 may include a power management system, one or more power supplies, and other components associated with the generation, management, and distribution of power for the electronic device 800.
- the multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user.
- the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user.
- the touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation.
- the multimedia component 808 includes a front camera and/or a rear camera. When the electronic device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
- the audio component 810 is configured to output and/or input audio signals.
- the audio component 810 includes a microphone (MIC), and when the electronic device 800 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal.
- the received audio signal may be further stored in the memory 804 or transmitted via the communication component 816.
- the audio component 810 further includes a speaker for outputting audio signals.
- the I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module.
- the above-mentioned peripheral interface module may be a keyboard, a click wheel, a button, and the like. These buttons may include, but are not limited to: home button, volume button, start button, and lock button.
- the sensor component 814 includes one or more sensors for providing the electronic device 800 with various aspects of state evaluation.
- the sensor component 814 can detect the on/off status of the electronic device 800 and the relative positioning of the components.
- the component is the display and the keypad of the electronic device 800.
- the sensor component 814 can also detect the electronic device 800 or the electronic device 800.
- the position of the component changes, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration/deceleration of the electronic device 800, and the temperature change of the electronic device 800.
- the sensor component 814 may include a proximity sensor configured to detect the presence of nearby objects when there is no physical contact.
- the sensor component 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
- the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
- the communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices.
- the electronic device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 2G, 3G, 4G/LTE, 5G, or a combination thereof.
- the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel.
- the communication component 816 further includes a near field communication (NFC) module to facilitate short-range communication.
- the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
- RFID radio frequency identification
- IrDA infrared data association
- UWB ultra-wideband
- Bluetooth Bluetooth
- the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field-available A programmable gate array (FPGA), controller, microcontroller, microprocessor, or other electronic components are implemented to implement the above methods.
- ASIC application-specific integrated circuits
- DSP digital signal processors
- DSPD digital signal processing devices
- PLD programmable logic devices
- FPGA field-available A programmable gate array
- controller microcontroller, microprocessor, or other electronic components are implemented to implement the above methods.
- a non-volatile computer-readable storage medium such as the memory 804 including computer program instructions, which can be executed by the processor 820 of the electronic device 800 to complete the foregoing method.
- FIG. 6 shows a block diagram of an electronic device 1900 provided by an embodiment of the present disclosure.
- the electronic device 1900 may be provided as a server. 6
- the electronic device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by the memory 1932, for storing instructions executable by the processing component 1922, such as application programs.
- the application program stored in the memory 1932 may include one or more modules each corresponding to a set of instructions.
- the processing component 1922 is configured to execute instructions to perform the above-described methods.
- the electronic device 1900 may also include a power supply component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input output (I/O) interface 1958 .
- the electronic device 1900 can operate based on an operating system stored in the memory 1932, such as Windows Mac OS Or similar.
- a non-volatile computer-readable storage medium is also provided, such as the memory 1932 including computer program instructions, which can be executed by the processing component 1922 of the electronic device 1900 to complete the foregoing method.
- the present disclosure may be a system, method and/or computer program product.
- the computer program product may include a computer-readable storage medium loaded with computer-readable program instructions for enabling a processor to implement various aspects of the present disclosure.
- the computer-readable storage medium may be a tangible device that can hold and store instructions used by the instruction execution device.
- the computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing.
- Non-exhaustive list of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) Or flash memory), static random access memory (SRAM), portable compact disk read-only memory (CD-ROM), digital versatile disk (DVD), memory stick, floppy disk, mechanical encoding device, such as a printer with instructions stored thereon
- RAM random access memory
- ROM read-only memory
- EPROM erasable programmable read-only memory
- flash memory flash memory
- SRAM static random access memory
- CD-ROM compact disk read-only memory
- DVD digital versatile disk
- memory stick floppy disk
- mechanical encoding device such as a printer with instructions stored thereon
- the computer-readable storage medium used here is not interpreted as the instantaneous signal itself, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (for example, light pulses through fiber optic cables), or through wires Transmission of electrical signals.
- the computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to various computing/processing devices, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and/or a wireless network.
- the network may include copper transmission cables, optical fiber transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers.
- the network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network, and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing/processing device .
- the computer program instructions used to perform the operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or in one or more programming languages.
- Source code or object code written in any combination, the programming language includes object-oriented programming languages such as Smalltalk, C++, etc., and conventional procedural programming languages such as "C" language or similar programming languages.
- Computer-readable program instructions can be executed entirely on the user's computer, partly on the user's computer, executed as a stand-alone software package, partly on the user's computer and partly executed on a remote computer, or entirely on the remote computer or server implement.
- the remote computer can be connected to the user's computer through any kind of network-including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to connect to the user's computer) connect).
- LAN local area network
- WAN wide area network
- an electronic circuit such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), can be customized by using the status information of the computer-readable program instructions.
- the computer-readable program instructions are executed to realize various aspects of the present disclosure.
- These computer-readable program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine that makes these instructions when executed by the processor of the computer or other programmable data processing device , A device that implements the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams is produced. It is also possible to store these computer-readable program instructions in a computer-readable storage medium. These instructions make computers, programmable data processing apparatuses, and/or other devices work in a specific manner, so that the computer-readable medium storing the instructions includes An article of manufacture, which includes instructions for implementing various aspects of the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams.
- each block in the flowchart or block diagram may represent a module, program segment, or part of an instruction, and the module, program segment, or part of an instruction contains one or more components for realizing the specified logical function.
- Executable instructions may also occur in a different order from the order marked in the drawings. For example, two consecutive blocks can actually be executed substantially in parallel, or they can sometimes be executed in the reverse order, depending on the functions involved.
- each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart can be implemented by a dedicated hardware-based system that performs the specified functions or actions Or it can be realized by a combination of dedicated hardware and computer instructions.
- the computer program product can be specifically implemented by hardware, software, or a combination thereof.
- the computer program product is specifically embodied as a computer storage medium.
- the computer program product is specifically embodied as a software product, such as a software development kit (SDK), etc. Wait.
- SDK software development kit
Abstract
Description
Claims (11)
- 一种车门解锁方法,其特征在于,包括:通过设置于车的室外部的红外测距传感器持续获取车外的对象与所述红外测距传感器之间的距离;响应于所述距离逐渐减小,且所述距离小于或等于第一距离阈值的持续时长达到第一时长阈值,唤醒并控制设置于所述车的图像采集模组采集视频流;或者,响应于所述距离逐渐减小,且在所述距离小于或等于第二距离阈值的过程中所述距离维持固定的持续时长达到第二时长阈值,唤醒并控制所述图像采集模组采集视频流;基于所述视频流中的至少一张图像进行人脸识别;响应于人脸识别成功,控制所述车的至少一车门解锁和/或打开。
- 根据权利要求1所述的方法,其特征在于,所述通过设置于车的室外部的红外测距传感器持续获取车外的对象与所述红外测距传感器之间的距离,包括:在所述车处于休眠状态或处于休眠且车门未解锁状态时,通过设置于车的室外部的红外测距传感器持续获取车外的对象与所述红外测距传感器之间的距离。
- 根据权利要求1或2所述的方法,其特征在于,所述响应于所述距离逐渐减小,且所述距离小于或等于第一距离阈值的持续时长达到第一时长阈值,唤醒并控制设置于所述车的图像采集模组采集视频流,包括:响应于所述距离逐渐减小,且所述距离小于或等于第一距离阈值的持续时长达到第一时长阈值,唤醒设置于所述车的人脸识别模组;经唤醒的所述人脸识别模组控制所述图像采集模组采集视频流;或者,所述响应于所述距离逐渐减小,且在所述距离小于或等于第二距离阈值的过程中所述距离维持固定的持续时长达到第二时长阈值,唤醒并控制所述图像采集模组采集视频流,包括:响应于所述距离逐渐减小,且在所述距离小于或等于第二距离阈值的过程中所述距离维持固定的持续时长达到第二时长阈值,唤醒设置于所述车的人脸识别模组;经唤醒的所述人脸识别模组控制所述图像采集模组采集视频流。
- 根据权利要求1或2所述的方法,其特征在于,所述第一距离阈值包括第一预定距离值和第二预定距离值,所述第一预定距离值大于所述第二预定距离值;所述响应于所述距离逐渐减小,且所述距离小于或等于第一距离阈值的持续时长达到第一时长阈值,唤醒并控制设置于所述车的图像采集模组采集视频流,包括:响应于所述距离逐渐减小,且所述距离小于或等于所述第一预定距离值,唤醒设置于所述车的人脸识别模组;响应于所述距离小于或等于所述第二预定距离值的持续时长达到第一时长阈值,经唤醒的所述人脸识别模组控制所述图像采集模组采集视频流;或者,所述第二距离阈值包括第三预定距离值和第四预定距离值,其中,所述第三预定距离值大于所述第四预定距离值;所述响应于所述距离逐渐减小,且在所述距离小于或等于第二距离阈值的过程中所述距离维持固定的持续时长达到第二时长阈值,唤醒并控制所述图像采集模组采集视频流,包括:响应于所述距离逐渐减小,且所述距离小于或等于所述第三预定距离值,唤醒设置于所述车的人脸识别模组;响应于所述距离小于或等于所述第四预定距离值的过程中所述距离维持固定的持续时长达到第二时长阈值,经唤醒的所述人脸识别模组控制所述图像采集模组采集视频流。
- 根据权利要求3或4所述的方法,其特征在于,在所述唤醒设置于所述车的人脸识别模组之后,所述方法还包括:若在预设时间内未采集到人脸图像,或者在预设时间内未通过人脸识别,则控制所述人脸识别模组进入休眠状态。
- 一种车门解锁装置,其特征在于,包括:获取模块,用于通过设置于车的室外部的红外测距传感器持续获取车外的对象与所述红外测距传感器之间的距离;唤醒模块,用于响应于所述距离逐渐减小,且所述距离小于或等于第一距离阈值的持续时长达到第一时长阈值,唤醒并控制设置于所述车的图像采集模组采集视频流;或者,响应于所述距离逐渐减小,且在所述距离小于或等于第二距离阈值的过程中所述距离维持固定的持续时长达到第二时长阈值,唤醒并控制所述图像采集模组采集视频流;人脸识别模块,用于基于所述视频流中的至少一张图像进行人脸识别;控制模块,用于响应于人脸识别成功,控制所述车的至少一车门解锁和/或打开。
- 根据权利要求6所述的装置,其特征在于,所述第一距离阈值包括第一预定距离值和第二预定距离值,所述第一预定距离值大于所述第二预定距离值;所述唤醒模块用于:响应于所述距离逐渐减小,且所述距离小于或等于所述第一预定距离值,唤醒设置于所述车的人脸识别模组;响应于所述距离小于或等于所述第二预定距离值的持续时长达到第一时长阈值,经唤醒的所述人脸识别模组控制所述图像采集模组采集视频流;或者,所述第二距离阈值包括第三预定距离值和第四预定距离值,其中,所述第三预定距离值大于所述第四预定距离值;所述唤醒模块用于:响应于所述距离逐渐减小,且所述距离小于或等于所述第三预定距离值,唤醒设置于所述车的人脸识别模组;响应于所述距离小于或等于所述第四预定距离值的过程中所述距离维持固定的持续时长达到第二时长阈值,经唤醒的所述人脸识别模组控制所述图像采集模组采集视频流。
- 一种车门解锁系统,其特征在于,包括红外测距传感器、主控芯片、人脸识别模组和图像采集模组;所述主控芯片分别与所述红外测距传感器和所述人脸识别模组连接,所述图像采集模组与所 述人脸识别模组连接;所述红外测距传感器用于持续获取车外的对象与所述红外测距传感器之间的距离;所述主控芯片响应于所述距离逐渐减小,且所述距离小于或等于第一距离阈值的持续时长达到第一时长阈值,或者,响应于所述距离逐渐减小,且在所述距离小于或等于第二距离阈值的过程中所述距离维持固定的持续时长达到第二时长阈值,唤醒所述人脸识别模组,并通过所述人脸识别模组唤醒所述图像采集模组;所述图像采集模组用于采集视频流;所述人脸识别模组基于所述视频流中的至少一张图像进行人脸识别;所述主控芯片响应于人脸识别成功,向车身控制模块发送车门解锁指令。
- 一种电子设备,其特征在于,包括:一个或多个处理器;用于存储可执行指令的存储器;其中,所述一个或多个处理器被配置为调用所述存储器存储的可执行指令,以执行权利要求1至5中任意一项所述的方法。
- 一种计算机可读存储介质,其上存储有计算机程序指令,其特征在于,所述计算机程序指令被处理器执行时实现权利要求1至5中任意一项所述的方法。
- 一种计算机程序,包括计算机可读代码,其特征在于,当所述计算机可读代码在电子设备中运行时,所述电子设备中的处理器执行用于实现权利要求1至5中的任一权利要求所述的方法。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2021550214A JP7106768B2 (ja) | 2020-02-19 | 2020-12-07 | 車両のドアロック解除方法、装置、システム、電子機器及び記憶媒体 |
KR1020217034084A KR20210135608A (ko) | 2020-02-19 | 2020-12-07 | 차량의 도어 잠금 해제 방법, 장치, 시스템, 전자 기기 및 기억 매체 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010101756.0A CN111332252B (zh) | 2020-02-19 | 2020-02-19 | 车门解锁方法、装置、系统、电子设备和存储介质 |
CN202010101756.0 | 2020-02-19 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021164380A1 true WO2021164380A1 (zh) | 2021-08-26 |
Family
ID=71175806
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/134272 WO2021164380A1 (zh) | 2020-02-19 | 2020-12-07 | 车门解锁方法、装置、系统、电子设备和存储介质 |
Country Status (4)
Country | Link |
---|---|
JP (1) | JP7106768B2 (zh) |
KR (1) | KR20210135608A (zh) |
CN (1) | CN111332252B (zh) |
WO (1) | WO2021164380A1 (zh) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114954354A (zh) * | 2022-04-02 | 2022-08-30 | 阿维塔科技(重庆)有限公司 | 车门解锁方法、装置、设备及计算机可读存储介质 |
CN115123143A (zh) * | 2022-06-22 | 2022-09-30 | 重庆长安汽车股份有限公司 | 车辆个性化迎宾方法、系统、车辆及介质 |
CN115158223A (zh) * | 2022-07-26 | 2022-10-11 | 东风柳州汽车有限公司 | 一种车辆控制器的防拆控制方法、装置及系统 |
CN115214536A (zh) * | 2021-12-09 | 2022-10-21 | 广州汽车集团股份有限公司 | 一种车机启动方法、装置及存储介质 |
CN115848296A (zh) * | 2022-12-28 | 2023-03-28 | 润芯微科技(江苏)有限公司 | 一种基于图像识别的汽车智能迎宾系统的识别方法 |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111332252B (zh) * | 2020-02-19 | 2022-11-29 | 上海商汤临港智能科技有限公司 | 车门解锁方法、装置、系统、电子设备和存储介质 |
CN112015479A (zh) * | 2020-08-28 | 2020-12-01 | 深圳市科莱德电子有限公司 | 一种车载导航无线唤醒方法及装置 |
CN112148105B (zh) * | 2020-09-14 | 2023-12-12 | 浙江大华技术股份有限公司 | 一种门禁系统唤醒方法及装置 |
CN112716117B (zh) * | 2020-12-28 | 2023-07-14 | 维沃移动通信有限公司 | 智能手环及其控制方法 |
CN113160463B (zh) * | 2021-05-26 | 2023-06-27 | 北京旗偲智能科技有限公司 | 一种开启车辆的用户识别装置的方法、装置及汽车控制云 |
CN113581070A (zh) * | 2021-06-11 | 2021-11-02 | 广汽本田汽车有限公司 | 汽车提示音设置系统、方法、运行控制装置及存储介质 |
CN113641415B (zh) * | 2021-10-14 | 2022-02-11 | 浙江舜宇智领技术有限公司 | 基于人脸识别的解锁方法及装置 |
CN114084095B (zh) * | 2021-10-26 | 2023-10-20 | 一汽奔腾轿车有限公司 | 一种车辆无钥匙解锁方法、装置、终端及存储介质 |
CN114312669B (zh) * | 2022-02-15 | 2022-08-05 | 远峰科技股份有限公司 | 一种基于人脸识别的智能座舱显示系统 |
CN115079164A (zh) * | 2022-06-10 | 2022-09-20 | 中国第一汽车股份有限公司 | 一种车外检测系统、方法、车辆及存储介质 |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160300410A1 (en) * | 2015-04-10 | 2016-10-13 | Jaguar Land Rover Limited | Door Access System for a Vehicle |
CN107231797A (zh) * | 2017-04-19 | 2017-10-03 | 深圳市汇顶科技股份有限公司 | 一种车辆解锁方法及车辆解锁系统 |
CN108394378A (zh) * | 2018-03-29 | 2018-08-14 | 成都惠网远航科技有限公司 | 汽车开关门感应装置的自动控制方法 |
CN207902380U (zh) * | 2018-01-24 | 2018-09-25 | 新日(无锡)发展有限公司 | 基于人脸识别的电动汽车开锁控制系统 |
CN109389083A (zh) * | 2018-10-08 | 2019-02-26 | 信利光电股份有限公司 | 一种汽车智能解锁方法、装置、设备及存储介质 |
CN209248624U (zh) * | 2019-02-28 | 2019-08-13 | 上海商汤视觉科技有限公司 | 车及车载人脸解锁系统 |
CN110765936A (zh) * | 2019-10-22 | 2020-02-07 | 上海商汤智能科技有限公司 | 车门控制方法及装置、系统、车、电子设备和存储介质 |
CN111332252A (zh) * | 2020-02-19 | 2020-06-26 | 上海商汤临港智能科技有限公司 | 车门解锁方法、装置、系统、电子设备和存储介质 |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3216586B2 (ja) * | 1997-09-17 | 2001-10-09 | トヨタ自動車株式会社 | 車両用遠隔操作制御装置およびそのシステム |
DE10341691A1 (de) * | 2003-09-08 | 2005-03-31 | Kiekert Ag | Tragbarer elektronischer Schlüssel eines Kraftfahrzeug-Schließsystems |
DE102011111600A1 (de) * | 2011-08-25 | 2013-02-28 | Audi Ag | n einer Klappe eines Fahrzeugs und zugehöriges Fahrzeug |
CN202394343U (zh) * | 2011-12-12 | 2012-08-22 | 浙江金刚汽车有限公司 | 一种用于出租车防遗忘物品的语音提示系统 |
CN106527429B (zh) * | 2016-10-25 | 2019-10-29 | 北京小米移动软件有限公司 | 行李箱控制方法及装置 |
CN206954183U (zh) * | 2017-05-10 | 2018-02-02 | 深圳了然视觉科技有限公司 | 一种汽车车门解锁系统 |
CN108733420B (zh) * | 2018-03-21 | 2022-04-29 | 北京猎户星空科技有限公司 | 智能设备的唤醒方法、装置、智能设备和存储介质 |
US10604115B2 (en) * | 2018-03-29 | 2020-03-31 | Omar Mustafa Kamal Ahmad | NFC system for unlocking a vehicle via smartphone biometric authentication |
CN108583504B (zh) * | 2018-04-28 | 2021-05-14 | 北京新能源汽车股份有限公司 | 一种汽车车门锁控制方法、装置及汽车 |
CN108846924A (zh) * | 2018-05-31 | 2018-11-20 | 上海商汤智能科技有限公司 | 车辆及车门解锁控制方法、装置和车门解锁系统 |
WO2020047868A1 (zh) * | 2018-09-07 | 2020-03-12 | 华为技术有限公司 | 一种业务处理方法及设备 |
CN110930547A (zh) * | 2019-02-28 | 2020-03-27 | 上海商汤临港智能科技有限公司 | 车门解锁方法及装置、系统、车、电子设备和存储介质 |
CN110297536B (zh) * | 2019-06-30 | 2021-05-18 | 联想(北京)有限公司 | 一种控制方法及电子设备 |
-
2020
- 2020-02-19 CN CN202010101756.0A patent/CN111332252B/zh active Active
- 2020-12-07 WO PCT/CN2020/134272 patent/WO2021164380A1/zh active Application Filing
- 2020-12-07 JP JP2021550214A patent/JP7106768B2/ja active Active
- 2020-12-07 KR KR1020217034084A patent/KR20210135608A/ko not_active Application Discontinuation
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160300410A1 (en) * | 2015-04-10 | 2016-10-13 | Jaguar Land Rover Limited | Door Access System for a Vehicle |
CN107231797A (zh) * | 2017-04-19 | 2017-10-03 | 深圳市汇顶科技股份有限公司 | 一种车辆解锁方法及车辆解锁系统 |
CN207902380U (zh) * | 2018-01-24 | 2018-09-25 | 新日(无锡)发展有限公司 | 基于人脸识别的电动汽车开锁控制系统 |
CN108394378A (zh) * | 2018-03-29 | 2018-08-14 | 成都惠网远航科技有限公司 | 汽车开关门感应装置的自动控制方法 |
CN109389083A (zh) * | 2018-10-08 | 2019-02-26 | 信利光电股份有限公司 | 一种汽车智能解锁方法、装置、设备及存储介质 |
CN209248624U (zh) * | 2019-02-28 | 2019-08-13 | 上海商汤视觉科技有限公司 | 车及车载人脸解锁系统 |
CN110765936A (zh) * | 2019-10-22 | 2020-02-07 | 上海商汤智能科技有限公司 | 车门控制方法及装置、系统、车、电子设备和存储介质 |
CN111332252A (zh) * | 2020-02-19 | 2020-06-26 | 上海商汤临港智能科技有限公司 | 车门解锁方法、装置、系统、电子设备和存储介质 |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115214536A (zh) * | 2021-12-09 | 2022-10-21 | 广州汽车集团股份有限公司 | 一种车机启动方法、装置及存储介质 |
CN115214536B (zh) * | 2021-12-09 | 2023-11-17 | 广州汽车集团股份有限公司 | 一种车机启动方法、装置及存储介质 |
CN114954354A (zh) * | 2022-04-02 | 2022-08-30 | 阿维塔科技(重庆)有限公司 | 车门解锁方法、装置、设备及计算机可读存储介质 |
CN115123143A (zh) * | 2022-06-22 | 2022-09-30 | 重庆长安汽车股份有限公司 | 车辆个性化迎宾方法、系统、车辆及介质 |
CN115123143B (zh) * | 2022-06-22 | 2024-02-27 | 重庆长安汽车股份有限公司 | 车辆个性化迎宾方法、系统、车辆及介质 |
CN115158223A (zh) * | 2022-07-26 | 2022-10-11 | 东风柳州汽车有限公司 | 一种车辆控制器的防拆控制方法、装置及系统 |
CN115158223B (zh) * | 2022-07-26 | 2023-07-07 | 东风柳州汽车有限公司 | 一种车辆控制器的防拆控制方法、装置及系统 |
CN115848296A (zh) * | 2022-12-28 | 2023-03-28 | 润芯微科技(江苏)有限公司 | 一种基于图像识别的汽车智能迎宾系统的识别方法 |
Also Published As
Publication number | Publication date |
---|---|
KR20210135608A (ko) | 2021-11-15 |
JP7106768B2 (ja) | 2022-07-26 |
CN111332252B (zh) | 2022-11-29 |
CN111332252A (zh) | 2020-06-26 |
JP2022524731A (ja) | 2022-05-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021164380A1 (zh) | 车门解锁方法、装置、系统、电子设备和存储介质 | |
WO2021212860A1 (zh) | 车门控制方法、车辆、系统、电子设备和存储介质 | |
WO2021077738A1 (zh) | 车门控制方法及装置、系统、车、电子设备和存储介质 | |
JP7428993B2 (ja) | 車両のドアロック解除方法及び装置、システム、車両、電子機器並びに記憶媒体 | |
WO2021159630A1 (zh) | 交通工具通勤控制方法及装置、电子设备、介质和车辆 | |
US20150180999A1 (en) | Automated social network interaction system for a vehicle | |
WO2021258656A1 (zh) | 车辆的交互方法及装置、电子设备、存储介质和车辆 | |
CN112026790B (zh) | 车载机器人的控制方法及装置、车辆、电子设备和介质 | |
WO2022062658A1 (zh) | 基于酒精检测的智能驾驶控制方法及装置 | |
WO2022057212A1 (zh) | 后备箱的控制方法及装置、车辆、电子设备和存储介质 | |
CN106814750A (zh) | 无人机飞行控制方法及装置 | |
WO2022041669A1 (zh) | 遗留物品的提醒方法及装置、电子设备和存储介质 | |
JP2018027731A (ja) | 車載装置、車載装置の制御方法およびコンテンツ提供システム | |
EP3511865A1 (en) | Imaging processing method for smart mirror, and smart mirror | |
US20210370867A1 (en) | Vehicle control system, server, and vehicle control method | |
KR101947040B1 (ko) | 테일 게이트 작동 시스템 및 그 방법 | |
CN113911054A (zh) | 车辆个性化配置方法及装置、电子设备和存储介质 | |
CN112937479A (zh) | 车辆控制方法及装置、电子设备和存储介质 | |
CN106379261A (zh) | 车窗控制方法及装置 | |
US20210370873A1 (en) | Entry support system, entry support method, and storage medium | |
CN114663864A (zh) | 车窗的控制方法、装置、电子设备及存储介质 | |
CN117565817A (zh) | 智能车辆控制方法、装置、电子设备以及存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2021550214 Country of ref document: JP Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20920554 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 20217034084 Country of ref document: KR Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20920554 Country of ref document: EP Kind code of ref document: A1 |