JP7106768B2 - VEHICLE DOOR UNLOCK METHOD, APPARATUS, SYSTEM, ELECTRONIC DEVICE, AND STORAGE MEDIUM - Google Patents

Description

(Cross reference to related applications)
This application is filed with the State Intellectual Property Office of China on February 19, 2020, with application number 202010101756.0 and titled "Vehicle door unlocking method, device, system, electronic device and storage medium , the entire content of which is incorporated herein by reference.

TECHNICAL FIELD The present disclosure relates to vehicle technology, and more particularly to a vehicle door unlocking method, device, system, electronic device, and storage medium.

With the development of artificial intelligence technology, computer vision has been widely applied in car electronics such as smart cockpit, which is a typical application. For the smart cockpit, the method of unlocking the door is one of the important development directions.

The present disclosure provides a technical means for unlocking the door of a vehicle.
According to one aspect of the present disclosure, continuously obtaining a distance between an object outside the vehicle and the infrared ranging sensor by an infrared ranging sensor installed outside the vehicle; and the duration for which the distance is less than or equal to a first distance threshold reaches a first time threshold, or the distance gradually decreases and the distance is less than or equal to a second distance threshold waking up and controlling an image acquisition module installed in the vehicle to acquire a video stream in response to the time duration being kept constant reaching a second time threshold; performing facial recognition based on at least one image of the stream; and controlling to unlock and/or open at least one door of the vehicle in response to successful facial recognition. To provide a vehicle door unlocking method including:
In one possible implementation, continuously acquiring the distance between an object outside the vehicle and said infrared ranging sensor by means of an infrared ranging sensor installed outside the vehicle interior is performed when said vehicle is in a sleep state. or when the vehicle is in a sleep state and the door is not unlocked, an infrared ranging sensor installed outside the vehicle interior continuously measures the distance between an object outside the vehicle and the infrared ranging sensor. Including getting.
In one possible implementation, the distance gradually decreases and the duration for which the distance is less than or equal to a first distance threshold reaches a first time threshold to collect a video stream. Waking up and controlling an image acquisition module installed in the vehicle is responsive to the distance gradually decreasing and the duration of the distance being less than or equal to the first distance threshold reaching a first time threshold. waking up a facial recognition module installed in the vehicle; and controlling the image acquisition module to acquire a video stream with the awakened facial recognition module; or said image acquisition such that said distance is gradually decreased and a video stream is acquired in response to reaching a second time threshold for the duration that said distance remains constant at or below a second distance threshold. waking up and controlling the module is responsive to the duration of said distance gradually decreasing and said distance being maintained constant at or below a second distance threshold reaching a second time threshold; waking up a face recognition module installed in the vehicle; and controlling the image collecting module to collect a video stream by the waked up face recognition module.
In one possible implementation, said first distance threshold comprises a first predetermined distance value and a second predetermined distance value, said first predetermined distance value being greater than said second predetermined distance value, said distance gradually increasing. waking up an image acquisition module located in the vehicle to acquire a video stream in response to the duration of decreasing and the distance being less than or equal to the first distance threshold reaching a first time threshold; waking up a face recognition module installed in the vehicle in response to the distance gradually decreasing and the distance becoming equal to or less than the first predetermined distance value; controlling the image acquisition module to acquire a video stream by the awakened face recognition module in response to reaching a first time threshold for a duration of less than or equal to the second predetermined distance value. and, alternatively, said second distance threshold comprises a third predetermined distance value and a fourth predetermined distance value, wherein said third predetermined distance value is greater than said fourth predetermined distance value and said distance gradually increases waking up the image acquisition module to acquire a video stream in response to the duration of decreasing and the distance remaining constant at or below the second distance threshold reaching a second time threshold; waking up a face recognition module installed in the vehicle in response to the distance gradually decreasing and the distance becoming equal to or less than the third predetermined distance value; remains constant at or below the fourth predetermined distance value reaches a second time threshold, with the face recognition module awakened by the image acquisition module to acquire a video stream. and controlling to.
In one possible implementation, after waking up the face recognition module installed in the vehicle, if no face image is collected within a preset time, or if face recognition is successful within a preset time. If not, the facial recognition module is controlled to enter a sleep state.
According to one aspect of the present disclosure, an acquisition module for continuously acquiring a distance between an object outside the vehicle and the infrared ranging sensor installed outside the vehicle compartment; in response to the distance gradually decreasing and the duration of said distance being less than or equal to a first distance threshold reaching a first time threshold, or said distance gradually decreasing and said distance increasing to a second distance for waking up and controlling an image acquisition module located in the vehicle to acquire a video stream in response to reaching a second time threshold for the duration of being held constant below the threshold; a wake-up module, a face recognition module for performing face recognition based on at least one image of said video stream, and, depending on successful face recognition, unlocking and/or door at least one door of said vehicle. and a control module for controlling opening.
In one possible implementation, when the vehicle is in a sleep state, or in a sleep state and the doors are unlocked, the acquisition module can detect outside the vehicle by means of an infrared ranging sensor installed outside the vehicle. is used to continuously acquire the distance between the object and the infrared ranging sensor.
In one possible implementation, the wake-up module is configured to wake up the vehicle in response to the distance gradually decreasing and the duration of the distance being less than or equal to the first distance threshold reaching a first time threshold. used to wake up an installed face recognition module and control the image acquisition module to acquire a video stream by the waked up face recognition module, or the distance gradually decreases; and waking up a facial recognition module installed in the vehicle in response to a duration of time that the distance remains constant at or below a second distance threshold reaches a second time threshold; It is used to control the image collection module to collect the video stream with the face recognition module turned up.
In one possible implementation, said first distance threshold comprises a first predetermined distance value and a second predetermined distance value, said first predetermined distance value being greater than said second predetermined distance value, said wake-up module comprising waking up a facial recognition module installed in the vehicle in response to the distance gradually decreasing and the distance being less than or equal to the first predetermined distance value; used to control the image acquisition module to acquire a video stream by the facial recognition module being woken up in response to a duration of less than or equal to a distance value reaching a first time threshold; or , the second distance threshold comprises a third predetermined distance value and a fourth predetermined distance value, wherein the third predetermined distance value is greater than the fourth predetermined distance value, and the wake-up module causes the distance to gradually increase decreasing and waking up a face recognition module installed in the vehicle in response to the distance becoming equal to or less than the third predetermined distance value; and wherein the distance remains constant at or below the fourth predetermined distance value. It is used to control the image acquisition module to acquire a video stream with the facial recognition module being woken up in response to the sustained duration reaching a second time threshold.
In one possible implementation, the device puts the face recognition module to sleep if no face image is collected within a preset time or if face recognition is not successful within a preset time. Further includes a sleep module to be controlled to enter.
According to one aspect of the present disclosure, it includes an infrared ranging sensor, a main control chip, a face recognition module, and an image acquisition module, wherein the main control chip controls the infrared ranging sensor and the face recognition module respectively. wherein the image acquisition module is connected to the face recognition module, and the infrared ranging sensor is for continuously acquiring the distance between an object outside the vehicle and the infrared ranging sensor; , the main control chip responds to the distance gradually decreasing and the duration for which the distance is less than or equal to a first distance threshold reaches a first time threshold; and waking up the face recognition module in response to reaching a second time threshold for a duration of time during which the distance remains constant at or below a second distance threshold, causing the face recognition module to wake up the image acquisition module. wherein the image collection module is for collecting a video stream; and the face recognition module performs face recognition based on at least one image of the video stream. and the main control chip provides a vehicle door unlocking system for sending a door unlocking command to the vehicle body control module according to successful face recognition.
According to one aspect of the present disclosure, it includes one or more processors and a memory for storing executable commands, the one or more processors storing executable commands stored in the memory. to perform the above method.
According to one aspect of the present disclosure, a computer readable storage medium having computer program commands stored thereon, said computer program commands, when executed by a processor, effecting the method described above. provide a medium.
According to one aspect of the present disclosure, a computer program comprising computer readable code which, when run on an electronic device, commands a processor of the electronic device to implement the above method. Provide a computer program for execution.
In an embodiment of the present disclosure, an infrared ranging sensor installed outside the vehicle interior continuously acquires the distance between an object outside the vehicle and the infrared ranging sensor, the distance gradually decreases, and waking up and controlling an image acquisition module installed in the vehicle to acquire a video stream in response to the duration of the distance being less than or equal to the first distance threshold reaching a first time threshold. , performing facial recognition based on at least one image of said video stream, and controlling to unlock and/or open at least one door of said vehicle in response to successful facial recognition; An infrared ranging sensor can be used as a wake-up source to wake up an image acquisition module used for face unlocking. This can solve the inconvenience of having to carry a car key or a mobile phone and always turn on Bluetooth (registered trademark), and solve the problem of high power consumption of the ultrasonic method. can. Here, since the infrared ranging sensor can measure the distance accurately and has a high ranging speed, it is possible to improve the response speed. Infrared ranging sensors are also inexpensive, environmentally insensitive, and have high feasibility and practicality.

It should be noted that the foregoing general description and the following detailed description are exemplary and interpretive only and are not limiting of the present disclosure.

Other features and aspects of the present disclosure will become apparent from the following detailed description of illustrative embodiments with reference to the drawings.
Here, the drawings incorporated as part of the present specification are suitable for the embodiments of the present disclosure and are used together with the description to describe the technical solutions of the present disclosure.

4 shows a flowchart of a vehicle door unlocking method according to an embodiment of the present disclosure; FIG. 2 shows a schematic diagram of the ranging principle of an infrared ranging sensor in an embodiment of the present disclosure; 1 shows a block diagram of a vehicle door unlocking system according to an embodiment of the present disclosure; FIG. 1 shows a block diagram of a vehicle door unlocking device according to an embodiment of the present disclosure; FIG. FIG. 8 shows a block diagram of an electronic device 800 according to an embodiment of the disclosure. FIG. 19 shows a block diagram of an electronic device 1900 according to an embodiment of the disclosure.

Various illustrative embodiments, features, and aspects of the disclosure are described in detail below with reference to the drawings. The same reference numerals in the drawings indicate elements of the same or similar function. Although the drawings show various aspects of the embodiments, they need not be drawn to scale unless otherwise indicated.
As used herein, the term "exemplary" means "serving as an example, example, or illustration." Any embodiment described herein as "exemplary" is not to be construed as preferred or superior to other embodiments.
As used herein, the term "and/or" simply describes a related relationship with a related subject and indicates that there can be three relationships, e.g., A and/or B means that A only We may indicate three cases where there is, both A and B are present, and only B is present. Also, the term "at least one" herein refers to any one of a plurality or any combination of at least two of a plurality, e.g., at least one of A, B, C Including may indicate including any one or more elements selected from the set consisting of A, B and C.
Also, various specific details are set forth in the specific embodiments below in order to more effectively describe the present disclosure. It should be understood by one of ordinary skill in the art that the present disclosure may equally be practiced without some of the specific details. In some embodiments, detailed descriptions of methods, means, elements and circuits that are familiar to those of ordinary skill in the art are not provided in order to emphasize the spirit of the present disclosure.
FIG. 1 shows a flowchart of a vehicle door unlocking method according to an embodiment of the present disclosure. The vehicle door unlocking method may be performed by a vehicle door unlocking device. For example, the vehicle door unlocking method may be executed by an in-vehicle device or another processing device. In some possible implementations, the vehicle door unlocking method may be implemented by a processor invoking computer readable commands stored in memory. As shown in FIG. 1, the vehicle door unlocking method includes steps S11 to S14.

In step S11, the distance between an object outside the vehicle and the infrared range-finding sensor is continuously obtained by an infrared range-finding sensor installed outside the vehicle.

In one possible implementation, the infrared ranging sensor may be mounted on at least one of a B-pillar, at least one door and at least one rearview mirror of the vehicle. Doors in embodiments of the present disclosure may include doors for entry and exit (eg, left front door, right front door, left rear door, right rear door), and may include a trunk door of a vehicle, and the like.

FIG. 2 shows a schematic diagram of the ranging principle of an infrared ranging sensor in an embodiment of the present disclosure. In embodiments of the present disclosure, the transmitter of the infrared ranging sensor can emit infrared radiation at a preset frequency, and objects outside the vehicle (e.g., users, pedestrians, obstacles, etc.) , the infrared rays are reflected back and received by the receiver of the infrared ranging sensor. Based on the propagation time of the infrared rays, the distance from the object outside the vehicle to the infrared ranging sensor can be calculated, for example, the distance between the object outside the vehicle and the infrared ranging sensor = the propagation time of the infrared rays/2 × is the speed of light. The infrared ranging sensor transmits the acquired distance to the main control chip, and the main control chip outputs distance information that can include a correspondence relationship between the reception time and the distance according to the reception time of the distance from the infrared ranging sensor. can be memorized. Thereby, based on the distance information, the distance value acquired by the infrared ranging sensor at each time can be determined. Here, the main control chip may be an MCU (Micro Controller Unit) or the like.

In the embodiment of the present disclosure, when there is no object outside the vehicle, the infrared rays emitted from the transmitter of the infrared ranging sensor are reflected and do not return. Either the value cannot be measured or the obtained distance value is null. If the infrared ranging sensor cannot measure the distance value or the obtained distance value is null, it may not send the distance information to the main control chip.

The power consumption of infrared ranging sensors is low, typically at the uA level, whereas the power consumption of ultrasonic radars is high, typically at the mA level. Therefore, the infrared ranging sensor can significantly reduce power consumption compared to the ultrasonic radar. Compared to the method of performing face recognition by waking up the camera and collecting images via Bluetooth (registered trademark), the embodiment of the present disclosure uses an infrared ranging sensor to detect an object outside the vehicle and the infrared ranging sensor. By acquiring the distance between and waking up the image acquisition module, the user does not need to wear a mobile terminal (such as a mobile phone) with Bluetooth (registered trademark) function and check with the mobile terminal. Therefore, the user experience can be improved. Furthermore, infrared ranging sensors have high ranging accuracy.

In one possible implementation, continuously acquiring the distance between an object outside the vehicle and said infrared ranging sensor by means of an infrared ranging sensor installed outside the vehicle interior is performed when said vehicle is in a sleep state. or when the vehicle is in a sleep state and the door is not unlocked, an infrared ranging sensor installed outside the vehicle interior continuously measures the distance between an object outside the vehicle and the infrared ranging sensor. Including getting.

In this implementation, the sleep state of the vehicle may indicate that all modules in the vehicle other than the infrared ranging sensor and the main control chip are asleep. When the vehicle is not in the sleep state, the driver is normally in the vehicle. Therefore, when the vehicle is not in the sleep state, the driver can normally control unlocking of the doors of the vehicle. In this embodiment, only when the vehicle is in a sleep state or in a sleep state and the door lock is not released, the infrared ranging sensor detects the distance between the object outside the vehicle and the infrared ranging sensor. The distance can be obtained continuously, but when the vehicle is not asleep, or is asleep but not unlocked, there is no need to measure the distance by the infrared ranging sensor, thereby: Power consumption can be reduced.

Of course, other possible implementations are not only when the vehicle is asleep or asleep and the doors are unlocked, but also when the vehicle is not asleep or asleep. The distance between an object outside the vehicle and the infrared range-finding sensor may be continuously acquired by the infrared range-finding sensor even when the door is not unlocked.

In step S12, in response to the distance gradually decreasing and the duration of the distance being less than or equal to the first distance threshold reaching a first time threshold, or in response to the distance gradually decreasing and the waking up an image acquisition module located in the vehicle to acquire a video stream in response to reaching a second time threshold for the duration of which the distance remains constant at or below a second distance threshold; to control.

Here, the second distance threshold may or may not be equal to the first distance threshold. The second time threshold may or may not be equal to the first time threshold.

In one example, reaching a second time threshold for the duration that the distance remains constant at or below the second distance threshold means that the distance remains the same while the distance is at or below the second distance threshold. may indicate that the duration of time has reached a second time threshold. In another example, the duration for which the distance is maintained constant at or below the second distance threshold reaches the second time threshold means that the degree of dispersion of the distance in any period of time is at or below a predetermined value, and It may indicate that all distances in the time period are less than or equal to a second distance threshold and the length of the time period is greater than or equal to a second time threshold. Here, the degree of dispersion can be evaluated by standard deviation, dispersion, or the like. For example, the standard deviation may be used as the degree of dispersion.

In an embodiment of the present disclosure, the main control chip can store the distance information and determine whether the distance is gradually decreasing, and if the distance is gradually decreasing, the distance is less than or equal to the first distance threshold; It can be determined whether a duration of time has reached a preset first time threshold, or the duration of which the distance is maintained constant at or below a second distance threshold has reached a second time threshold. If so, it determines that there is an intention to open the door; It can be determined that there is no intention to release the Embodiments of the present disclosure can improve vehicle safety by reducing the possibility of door unlocking when the user does not intend to open the door.

In one possible implementation, the distance gradually decreases and the duration for which the distance is less than or equal to a first distance threshold reaches a first time threshold to collect a video stream. Waking up and controlling an image acquisition module installed in the vehicle is responsive to the distance gradually decreasing and the duration of the distance being less than or equal to the first distance threshold reaching a first time threshold. waking up a facial recognition module installed in the vehicle; and controlling the image gathering module to acquire a video stream by the awakened facial recognition module. In this implementation, the face recognition module is put to sleep until the condition that the distance gradually decreases and the duration for which the distance is less than or equal to the first distance threshold reaches a first time threshold is met. Since the low power consumption operation can be maintained, the operating power consumption of the door opening method using face authentication can be reduced.

In one possible implementation, the video stream is collected in response to the duration of said distance gradually decreasing and said distance remaining constant below a second distance threshold reaching a second time threshold. waking up and controlling the image acquisition module to cause the distance to gradually decrease and the duration for which the distance remains constant below a second distance threshold reaches a second time threshold; waking up a facial recognition module installed in the vehicle in response to the action, and controlling the image gathering module to acquire a video stream by the awakened facial recognition module. include. In this implementation, the face recognition module is continuously controlled until the condition that the distance gradually decreases and the duration for which the distance remains constant below a second distance threshold reaches a second time threshold is met. can maintain the low power consumption operation as a sleep state, thereby reducing the operating power consumption of the door opening method based on face authentication.

In another possible implementation, the first distance threshold comprises a first predetermined distance value and a second predetermined distance value, wherein the first predetermined distance value is greater than the second predetermined distance value, and the distance is gradually and waking up an image acquisition module located in the vehicle to acquire a video stream in response to reaching a first time threshold for the duration of the distance being less than or equal to the first distance threshold. waking up a face recognition module installed in the vehicle in response to the distance gradually decreasing and the distance becoming equal to or less than the first predetermined distance value; Controlling the image acquisition module to acquire a video stream with the facial recognition module being awakened in response to a first time threshold for which the distance is less than or equal to the second predetermined distance value. including

Here, the second predetermined distance value may be a maximum allowable distance value between the user and the vehicle when performing face recognition. The first predetermined distance value may be determined based on the second predetermined distance value and the wakeup distance. For example, the first predetermined distance value may be set equal to or slightly larger than the sum of the second predetermined distance value and the wakeup distance. Here, the wake-up distance may be equal to the product of the wake-up time of the face recognition module and the average walking speed, and the wake-up time of the face recognition module is the time required for the face recognition module to switch from sleep state to working state. You may indicate the required time.

In this implementation, the face recognition module is put into a sleep state to maintain low power consumption operation until the condition that the distance gradually decreases and the distance is less than or equal to the first predetermined distance value is met. As a result, it is possible to reduce the operating power consumption of the door opening method using face authentication. When the condition "the distance gradually decreases and the distance is equal to or less than the first predetermined distance value" is met, wake up the face recognition module, and before the user reaches the door, the face recognition module can be enabled so that the user does not have to wait for the facial recognition module to wake up after arriving at the door, and that "the first If the time threshold is reached, i.e. the user has arrived at the door, as soon as the image acquisition module collects the video stream, the awakened face recognition module performs face recognition to open the door. can improve face recognition efficiency and improve user experience. Also, since the user does not feel wake-up, the user experience can be further improved. The implementation reduces power consumption because the image acquisition module does not acquire a video stream until the condition "the duration of which the distance is less than or equal to the second predetermined distance value reaches a first time threshold" is met. In addition, the possibility of erroneous unlocking of the door can be reduced, and the safety of unlocking the door of the vehicle can be improved. Therefore, the implementation can meet both low power consumption operation and fast unlocking, so that the power saving, user experience and security aspects of the facial recognition module module are well balanced. offers a solution.

In another possible implementation, said second distance threshold comprises a third predetermined distance value and a fourth predetermined distance value, said third predetermined distance value being greater than said fourth predetermined distance value, said distance gradually and waking up the image acquisition module to acquire a video stream in response to reaching a second time threshold for the duration that the distance remains constant at or below a second distance threshold. waking up a face recognition module installed in the vehicle in response to the distance gradually decreasing and the distance becoming equal to or less than the third predetermined distance value; remains constant at or below the fourth predetermined distance value reaches a second time threshold, with the face recognition module awakened by the image acquisition module to acquire a video stream. and controlling to.

Here, the third predetermined distance value may or may not be equal to the first predetermined distance value. The fourth predetermined distance value may or may not be equal to the second predetermined distance value. The fourth predetermined distance value may be a maximum allowable distance value between the user and the vehicle when performing face recognition. A third predetermined distance value may be determined based on the fourth predetermined distance value and the wakeup distance. For example, the third predetermined distance value may be set equal to or slightly larger than the sum of the fourth predetermined distance value and the wakeup distance.

In this implementation, the face recognition module is put into a sleep state to maintain low power consumption operation until the condition that the distance gradually decreases and the distance is less than or equal to the third predetermined distance value is met. As a result, it is possible to reduce the operating power consumption of the door opening method using face authentication. When the condition "the distance gradually decreases and the distance is less than or equal to the third predetermined distance value" is met, wake up the face recognition module, and before the user reaches the door, the face recognition module can be enabled so that the user does not have to wait for the facial recognition module to wake up after arriving at the door, saying "said distance is maintained constant at or below said fourth predetermined distance value duration reaches the second time threshold", i.e. the user has arrived at the door, as soon as the image acquisition module collects the video stream, the awakened face recognition module performs face recognition. Since the door can be opened, the face recognition efficiency can be improved and the user experience can be improved. Also, since the user does not feel wake-up, the user experience can be further improved. Because, in this implementation, the image acquisition module does not acquire a video stream until the condition "the duration of which said distance remains constant at or below said fourth predetermined distance value reaches a second time threshold" is met. , not only can power consumption be reduced, but also the possibility of the door being unlocked by mistake can be reduced, and the safety of unlocking the door of the vehicle can be improved. Therefore, the implementation can meet both low power consumption operation and fast unlocking, so that the power saving, user experience and security aspects of the facial recognition module module are well balanced. offers a solution.

In embodiments of the present disclosure, the image acquisition module may be mounted outside the vehicle cabin. By controlling the image acquisition module installed outside the vehicle to collect the video stream outside the vehicle, the boarding intention of people outside the vehicle can be detected based on the video stream outside the vehicle. In one possible implementation, the image acquisition module may be mounted on at least one of a B-pillar, at least one door and at least one rearview mirror of said vehicle. For example, the image acquisition module may be mounted 130cm to 160cm above the ground on the B-pillar, but is not limited here. In one example, the image acquisition modules may be mounted on two B-pillars and the trunk of the vehicle. Here, an image acquisition module directed toward the boarding position of the front seat occupant (driver or co-driver) and an image acquisition module directed toward the boarding position of the rear seat passenger may be attached to each B pillar.

In one possible implementation, the method includes, after waking up a facial recognition module installed in the vehicle, if no facial image is collected within a preset time, or within a preset time. Further comprising controlling the face recognition module to enter a sleep state if the face recognition is not successful. The implementation detects if no facial image has been collected within a preset time after waking up the facial recognition module or if no facial image has been collected within a preset time after waking up the facial recognition module. If recognition is not successful, power consumption can be reduced by controlling the face recognition module to enter a sleep state.

In step S13, face recognition is performed based on at least one image of the video stream.

For example, face recognition may be performed based on the first image of the video stream to obtain a face recognition result. Here, the first image may include at least part of a face. The first image may be an image selected from a video stream. Here, images can be selected from the video stream in several ways. In one embodiment, the first image is an image selected from the video stream that satisfies a preset quality condition, the preset quality condition being whether the face is included and whether the face is in the center of the image. one of whether the face is located in an area, whether the face is completely included in the image, the proportion of the face in the image, the state of the face (e.g. the angle of the face), the sharpness of the image, the exposure of the image, etc. or any combination, although embodiments of the present disclosure are not so limited.

In one possible implementation, said facial recognition comprises facial recognition, and performing facial recognition based on at least one image of said video stream comprises at least one image of said video stream and a pre-registered Including performing facial recognition based on facial features. In this implementation, facial recognition extracts the facial features of the collected images, matches the facial features of the collected images with pre-registered facial features, and determines whether they belong to the same person. It can be used, for example, to determine whether the facial features of the collected image belong to the facial features of the vehicle owner or the virtual user (eg, a friend of the vehicle owner, a delivery man, etc.).

In one possible implementation, said face recognition further comprises liveness detection, and performing face recognition based on at least one image of said video stream is performed by detecting a first image of said video stream by a depth sensor of said image acquisition module. Acquiring a first depth map corresponding to an image; and performing liveness detection based on the first image and the first depth map. In this implementation, the liveness detection is for verifying whether the object is living or not, and may be for verifying whether it is a human body, for example. Here, the first depth map corresponds to the first image. For example, the first depth map and the first image were acquired of the same scene by the depth sensor and the image sensor, respectively, or the first depth map and the first image were acquired by the depth sensor and the image sensor at the same time. Although collected for a region of interest, embodiments of the present disclosure are not so limited. Here, the image sensor may be an RGB sensor, an infrared sensor, or the like. A depth sensor indicates a sensor for collecting depth information. Embodiments of the present disclosure do not limit the operating principle and operating band of the depth sensor. For example, the depth sensor may be a twin-lens infrared sensor, a TOF sensor, a structured light sensor, or the like.

In one possible implementation, said facial recognition further comprises authorization, and performing facial recognition based on at least one image of said video stream comprises said Acquiring unlocking authority information for an object outside the vehicle, and performing authority authentication based on the unlocking authority information for the object outside the vehicle. According to this implementation mode, it is possible to set different unlocking authority information for each user, and it is possible to improve the safety of the vehicle.

As an example of the implementation mode, the unlocking authority information for the object outside the vehicle includes information on the door that the object outside the vehicle has the unlocking authority, the time that the object outside the vehicle has the unlocking authority, Contains one or more of the object's corresponding unlock authorization counts.

For example, the information about doors that the object outside the vehicle has unlocking authority may be all doors or trunk doors. For example, all the doors may be unlocked by the vehicle owner or their family members or friends, and the trunk doors may be unlocked by the delivery person or the staff of the real estate management company. . Here, the vehicle owner can set the information of the doors that other people have the authority to unlock.

For example, the time during which an object outside the vehicle has unlocking authority may be the entire time or a preset period. For example, the time during which the vehicle owner or the vehicle owner's family has unlocking authority may be all hours. The vehicle owner can set the hours when others have unlocking authority. For example, in an application scenario where the vehicle owner's friend rents a vehicle from the vehicle owner, the vehicle owner can set the time that the friend has the unlocking authority for two days. Also, for example, the vehicle owner can set the time during which the delivery person has unlocking authority to January 20, 2020 from 13:00 to 14:00 after being contacted by the delivery person.

For example, the number of corresponding unlock authorizations for objects outside the vehicle may be unlimited or limited. For example, the number of times of unlocking authority corresponding to the vehicle owner or the vehicle owner's family and friends may be unlimited. Also, for example, the number of unlocking authorizations corresponding to the delivery person may be a limited number of times, such as one.

In step S14, control is performed to unlock and/or open at least one door of the vehicle according to success of face recognition.

In one possible implementation, the unlocking and/or opening of the driver's door can be controlled in response to successful facial recognition.

In other possible implementations, the unlocking and/or opening of the door corresponding to the image acquisition module collecting the video stream can be controlled depending on the successful facial recognition, e.g. is not unlocked, unlock the door or unlock the door to open the door, and the door status information is unlocked and not opened In this case, by controlling the door to open, the door can be automatically opened based on face recognition without the user manually pulling the door to open it, which is convenient for using the vehicle. improve. Here, the door corresponding to the image acquisition module collecting the video stream may be determined based on the position of the image acquisition module. For example, if the video stream was collected by an image acquisition module mounted on the left B-pillar and directed towards the riding position of the front seat occupant, the door corresponding to the image acquisition module collecting said video stream would be the left front door. and the door corresponding to the image acquisition module that acquires the video stream, if the video stream is acquired by an image acquisition module mounted on the left B-pillar and facing the riding position of the rear seat occupants. may be the left rear door, and if the video stream is collected by an image collection module mounted on the right B-pillar and directed toward the riding position of the front seat occupant, to the image collection module collecting the video stream The corresponding door may be the right front door, and collects the video stream if it was collected by an image acquisition module mounted on the right B-pillar and directed toward the riding position of the rear seat occupants. The door corresponding to the image acquisition module may be the right rear door, and the door corresponding to the image acquisition module that acquires the video stream if the video stream is acquired by the image acquisition module attached to the trunk door. can be a trunk door.

In one possible implementation, the method performs face recognition based on at least one image of the video stream and, in response to face recognition failure, activating a password unlocking module installed in the vehicle. and activating the password unlock flow. In this implementation, unlocking by password is an alternative to unlocking by face recognition. The causes of face recognition failure are at least the fact that the detection result of the living body is fake, face recognition failure, image collection failure (e.g. camera failure), and the number of recognition times exceeding a predetermined number. including one. If a person fails facial recognition, trigger the password unlock flow. For example, the password entered by the user may be obtained through the B-pillar touch screen. In one example, if the password is entered incorrectly M times, for example five times in a row, the password unlock may expire.

In one possible implementation, the method further comprises performing object detection on at least one image of the video stream to determine possessed object information of an object outside the vehicle, wherein successful facial recognition is achieved. In response, controlling to unlock and/or open at least one door of the vehicle indicates that the face recognition is successful and the possessed object information indicates that the object is in possession. In response, controlling to open at least one door of the vehicle.

Here, the possessed object information of the object outside the vehicle may indicate the information of the object possessed by the object outside the vehicle. For example, the possessed object information may indicate whether or not an object is possessed, and may indicate the category of the possessed object.

In this implementation, an object detection network based on a deep learning architecture may be employed to perform object detection on at least one image of the video stream. The implementation does not need to limit the category of objects that can be recognized by the object detection network, and those skilled in the art can flexibly set the category of objects that can be recognized by the object detection network according to the needs of the actual application scene. be able to. For example, categories of objects recognizable by the object detection network include umbrellas, trolley cases, carts, strollers, handbags, shopping bags, and the like. By employing an object detection network to perform object detection on at least one image of a video stream, the accuracy and speed of object detection can be improved.

According to this implementation, if it is inconvenient for the user to open the door (e.g. if the user is carrying items such as handbags, shopping bags, trolley cases, umbrellas, etc.), the door (e.g. the left front door of the vehicle) , the right front door, the left rear door, the right rear door, and the trunk door) can be automatically opened to prevent the user from getting in the car in situations such as when the user is holding items in his hand or when it is raining. And it is very easy to put items in the trunk. By adopting this implementation, when the user approaches the vehicle, the facial recognition flow can be automatically triggered without intentional action (e.g. button touches or gestures), automatically opening the door. The user does not need to release the hand to unlock or open the door, which improves the user's experience of boarding and placing items in the trunk.

In this implementation, detecting a bounding box of a human body in at least one image of the video stream, performing object detection on a region corresponding to the bounding box to obtain an object detection result, and using the object detection result as Based on this, the possessed object information of the object outside the vehicle can be determined. For example, a bounding box of a human body in a first image of the video stream may be detected, and object detection may be performed on the area corresponding to the bounding box in the first image. Here, the area corresponding to the bounding box may indicate an area limited by the bounding box. In the implementation, by detecting a bounding box of a human body in at least one image of a video stream and performing object detection on a region corresponding to the bounding box, object detection based on a background portion of an image of the video stream is performed. interference can be reduced, and the accuracy of object detection can be improved.

Here, determining the possessed object information of the object outside the vehicle based on the object detection result means that if the object detection result indicates that the object is detected, the object and the hand of the object outside the vehicle are determined. and determining possession information of the out-of-vehicle object based on the distance.

In one example, if the distance is less than a preset distance, it can be determined that the possessed object information of the object outside the vehicle is carrying an object. In this example, without considering the dimensions of the object, only the distance between the object and the hand of the out-of-vehicle object can be considered when determining the possessed-object information of the out-of-vehicle object.

In another example, determining possessed object information of an object outside the vehicle based on the object detection result includes obtaining dimensions of the object if the object detection result indicates that an object has been detected. It may contain further. Determining possessed object information of the object outside the vehicle based on the distance includes determining possessed object information of the object outside the vehicle based on the distance and the dimension. In this example, the distance between the object and the hand of the out-of-vehicle object and the dimensions of the object can be simultaneously considered when determining the possessed-object information of the out-of-vehicle object.

Here, determining the possessed object information of the object outside the vehicle based on the distance and the dimension means that the distance is less than or equal to a preset distance and the dimension is greater than or equal to a preset dimension. In some cases, determining that the possessed object information of the object outside the vehicle is possessing an object.

In this example, the preset distance may be 0 or may be set greater than 0.

In another example, determining possessed object information of an object outside the vehicle based on the object detection result includes obtaining dimensions of the object if the object detection result indicates that the object is detected. and determining possession information for an object outside the vehicle based on the dimensions. In this example, without considering the distance between the object and the hand of the out-of-vehicle object, only the dimensions of the object can be considered when determining the possessed-object information of the out-of-vehicle object. For example, when the dimension is larger than a preset dimension, it is determined that the possessed object information of the object outside the vehicle indicates that the object is in possession.

In one possible implementation, the method further comprises performing object detection on at least one image of the video stream to determine possessed object information of an object outside the vehicle, wherein successful facial recognition is achieved. In response, controlling to unlock and/or open at least one door of the vehicle means that the face recognition is successful and the object in the category for which the possessed object information is preset is possessed. controlling the trunk door of the vehicle to open in response to the presence of the vehicle. Here, the preset category may indicate a category of objects suitable for placing in the trunk. For example, preset categories may include trolley cases and the like. According to the implementation, when the user carries an object of a preset category, the trunk door is automatically opened to allow the object to enter the trunk without the user manually opening the trunk door. can be easily placed.

In one possible implementation, controlling the unlocking and/or opening of at least one door of the vehicle in response to successful facial recognition is performed by the successful facial recognition and the object outside the vehicle. It may comprise controlling to unlock and/or open at least one door other than the driver's seat of the vehicle in response to the object not being the driver. According to this implementation, it is possible to automatically unlock and/or open doors corresponding to seats suitable for persons other than the driver.

In one possible realization, at least one other than the driver's seat of the vehicle in response to successful face recognition, that the exterior object is not a driver, and that the exterior object is in possession of an object. can be controlled to open the door of According to this implementation, a door corresponding to a seat suitable for a person other than the driver can be automatically opened.

In one possible implementation, controlling the opening of at least one door of the vehicle comprises obtaining state information of the door; and if the state information of the door is unlocked, the controlling to unlock and open the door; and/or controlling to open the door if the status information of the door is unlocked and not opened. good.

Here, the state information of the door may be unlocked, unlocked, unlocked, or opened. In such implementations, controlling the doors to open may allow the user to enter the vehicle through an automatically opened door (e.g., front door or rear door) or through an automatically opened door (e.g., For example, the trunk door or the rear door) may be indicated to control the door to be flipped open so that an item can be placed there. By controlling the door to open automatically, the user does not have to manually pull the door to open it after unlocking the door of the vehicle.

In one possible implementation, the method further comprises controlling the door to close or controlling the door to close and lock if a door auto-close condition is met. . The implementation improves vehicle safety by controlling the door to close or controlling the door to close and lock when a door automatic closing condition is met. can be done. In one example, the door auto-close condition may include reaching a preset time for unlocking or opening the door.

In one possible implementation, door unlock, open and close commands can be sent to the Body Control Model (BCM) via the main control chip to control the doors.

In one possible implementation, the method comprises registering a user based on facial images collected by the image collection module; performing remote registration and transmitting registration information, including collected or uploaded facial images, to the vehicle.

In one example, registering a vehicle owner based on facial images collected by the image collection module requires the user to enter a password and verifies the password upon detecting that a register button on the touch screen has been clicked. After succeeding in , by activating the RGB camera of the image acquisition module to acquire a facial image, registering based on the acquired facial image, and extracting the facial features of the facial image as pre-registered facial features, performing face matching based on the pre-registered facial features during subsequent face authentication.

In one example, remote registration is performed based on facial images collected or uploaded by the first terminal, and registration information including the collected or uploaded facial images is sent to the vehicle. In the example, a user (e.g. vehicle owner) can send a registration request to the TSP (Telematics Service Provider) cloud via a mobile phone App (Application), where the registration request is , the facial image collected or uploaded by the first terminal can be carried. For example, the facial image collected by the first terminal may be the facial image of the user himself (vehicle owner), and the facial image uploaded by the first terminal may be the user himself (vehicle owner), the user's friend or It may be a face image of a delivery person, etc. The TSP cloud sends a registration request to the door control device's in-vehicle T-Box (Telematics Box, remote information processor), and the in-vehicle T-Box, based on the registration request By activating the face recognition function and setting the face features of the face image included in the registration request to the pre-registered face features, face collation is performed based on the pre-registered face features at the time of subsequent face authentication.

As an example of this implementation mode, the facial image uploaded by the first terminal includes the facial image transmitted from the second terminal to the first terminal, the second terminal is a terminal corresponding to the temporary user, and the registration The information further includes unlocking authority information corresponding to the uploaded face image. For example, a temporary user may be a delivery person or the like. In this example, a vehicle owner can set unlocking authority information for a virtual user, such as a delivery person.

In one possible implementation, the method comprises obtaining seat adjustment information of an occupant of the vehicle and generating seat preference information corresponding to the occupant based on the information of the occupant adjusting the seat. and updating. Here, the seat preference information corresponding to the passenger can reflect preference information for adjusting the seat when the passenger boards the vehicle. In the implementation, seat preference information corresponding to the occupant is generated or updated so that the next time the occupant enters the vehicle, the seat is automatically adjusted based on the seat preference information corresponding to the occupant. can improve the passenger's riding experience.

In one possible implementation, generating or updating seat preference information corresponding to the occupant based on the information that the occupant adjusts the seat includes position information of the seat in which the occupant is seated and generating or updating seat preference information corresponding to the occupant based on the information for adjusting the . In such implementations, the seat preference information corresponding to the occupant may be associated not only with information about the occupant's adjustment of the seat, but also with information about the position of the seat on which the occupant is seated, i.e., different seat preference information for each occupant. Seat preference information corresponding to the seat of the position can be recorded, and the user's riding experience can be further improved.

In one possible implementation, the method includes: obtaining seat preference information corresponding to the occupant based on facial recognition results; and adjusting. The implementation enhances the occupant's driving or riding experience by automatically adjusting the occupant's seat information based on the seat preference information corresponding to the occupant without requiring manual adjustment by the occupant. be able to.

In one example, one or more of seat height, fore/aft, backrest and temperature can be adjusted.

As an example of this implementation, the position information of the seat on which the passenger is seated is determined, and the seat on which the passenger is seated is adjusted based on the position information of the seat on which the passenger is seated and the seat preference information corresponding to the passenger. You may make it In the example, by automatically adjusting the seat information of the occupant based on the position information of the seat on which the occupant is seated and the seat preference information corresponding to the occupant, without requiring manual adjustment by the occupant, the occupant can enhance the driving or riding experience of

In other possible implementations, based on the face recognition result, other personalized information corresponding to the occupant, such as light information, temperature information, air conditioner wind information, music information, etc., is obtained, and the obtained personalized It may be set automatically based on the information.

In an embodiment of the present disclosure, an infrared ranging sensor installed outside the vehicle interior continuously acquires the distance between an object outside the vehicle and the infrared ranging sensor, the distance gradually decreases, and waking up and controlling an image acquisition module installed in the vehicle to acquire a video stream in response to the duration of the distance being less than or equal to the first distance threshold reaching a first time threshold. , performing facial recognition based on at least one image of said video stream, and controlling to unlock and/or open at least one door of said vehicle in response to successful facial recognition; The infrared ranging sensor can be used as a wake-up source to wake up the image acquisition module used for unlocking the door with the face. This can solve the inconvenience of having to carry a car key or a mobile phone and always turn on Bluetooth (registered trademark), and solve the problem of high power consumption of the ultrasonic method. can. Here, since the infrared ranging sensor can measure the distance accurately and has a high ranging speed, it is possible to improve the response speed. Infrared ranging sensors are also inexpensive, environmentally insensitive, and have high feasibility and practicality.

It should be understood that the embodiments of each of the above methods referred to in this disclosure can be combined with each other to form embodiments without violating principle and logic. A description thereof is omitted in the disclosure.

Those skilled in the art will appreciate that the order of steps described in the above method of specific embodiments does not limit the implementation procedure to that exact order. It will be appreciated that the specific order of execution of each step will depend on the function and possible underlying logic of each step.

The present disclosure further provides a vehicle door unlocking device, a system, an electronic device, a computer-readable storage medium, and a program, any of which can be any of the vehicle door unlocking methods provided in the present disclosure. The corresponding technical means and descriptions can be referred to the corresponding descriptions of the methods, which are omitted here.

FIG. 3 illustrates a block diagram of a vehicle door unlocking system according to an embodiment of the present disclosure. As shown in FIG. 3, the vehicle door unlocking system includes an infrared ranging sensor 31, a main control chip 32, a face recognition module 33 and an image acquisition module 34, wherein the main control chip 32 is: The infrared ranging sensor 31 and the face recognition module 33 are respectively connected, the image acquisition module 34 is connected to the face recognition module 33, and the infrared ranging sensor 31 is connected to an object outside the vehicle and the infrared ranging. The main control chip 32 is used to continuously acquire the distance between the sensor 31, and the main control chip 32 controls that the distance is gradually decreased and the duration of the distance is less than or equal to the first distance threshold is a first time. in response to reaching a threshold or in response to reaching a second time threshold for a duration of time during which said distance is gradually decreased and said distance remains constant at or below a second distance threshold; used to wake up the face recognition module 33 and wake up the image collection module 34 by the face recognition module 33, the image collection module 34 being used to collect a video stream, the face recognition The module 33 is used to perform face recognition based on at least one image of the video stream, and the main control chip 32 sends a door unlock command to the vehicle body control module according to successful face recognition. do.

FIG. 4 shows a block diagram of a vehicle door unlocking device according to an embodiment of the present disclosure. As shown in FIG. 4, the vehicle door unlocking device continuously acquires the distance between an object outside the vehicle and the infrared ranging sensor installed outside the vehicle cabin. and in response to the distance gradually decreasing and the duration of the distance being less than or equal to the first distance threshold reaching a first time threshold, or the distance gradually decreasing and an image acquisition module installed in the vehicle to acquire a video stream in response to the duration of the distance being maintained constant at or below a second distance threshold reaching a second time threshold. a wake-up module 42 for waking up and controlling; a face recognition module 43 for performing face recognition based on at least one image of said video stream; and a control module 44 for controlling the unlocking and/or opening of one door.

In one possible implementation, the acquisition module 41 is configured by an infrared ranging sensor installed outside the vehicle cabin when the vehicle is in a sleep state or in a sleep and door unlocked state. It is used to continuously acquire the distance between an object outside the vehicle and the infrared ranging sensor.

In one possible implementation, the wake-up module 42 wakes up the vehicle in response to the distance gradually decreasing and the duration of the distance being less than or equal to the first distance threshold reaching a first time threshold. and used to control the image acquisition module to acquire a video stream by the awakened face recognition module, or the distance gradually increases waking up a facial recognition module located in the vehicle in response to reaching a second time threshold for a duration of time that the distance has decreased and the distance remains constant at or below a second distance threshold; It is used to control the image collection module to collect the video stream by the waked up face recognition module.

In one possible implementation, said first distance threshold comprises a first predetermined distance value and a second predetermined distance value, said first predetermined distance value being greater than said second predetermined distance value, and said wake-up module 42 waking up a facial recognition module installed in the vehicle in response to the distance gradually decreasing and the distance becoming equal to or less than the first predetermined distance value; used to control the image acquisition module to acquire a video stream with the facial recognition module being awakened in response to reaching a first time threshold for a duration of less than or equal to a predetermined distance value; Alternatively, the second distance threshold comprises a third predetermined distance value and a fourth predetermined distance value, wherein the third predetermined distance value is greater than the fourth predetermined distance value, and the wakeup module 42 determines that the distance is gradually decreasing and waking up a face recognition module installed in the vehicle in response to the distance being less than or equal to the third predetermined distance value; and when the distance is less than or equal to the fourth predetermined distance value. It is used to control the image acquisition module to acquire a video stream with the face recognition module being woken up in response to the time duration being kept constant reaching a second time threshold.

In one possible implementation, the device puts the face recognition module to sleep if no face image is collected within a preset time or if face recognition is not successful within a preset time. Further includes a sleep module to be controlled to enter.

In an embodiment of the present disclosure, an infrared ranging sensor installed outside the vehicle interior continuously acquires the distance between an object outside the vehicle and the infrared ranging sensor, the distance gradually decreases, and waking up and controlling an image acquisition module installed in the vehicle to acquire a video stream in response to the duration of the distance being less than or equal to the first distance threshold reaching a first time threshold. , performing facial recognition based on at least one image of said video stream, and controlling to unlock and/or open at least one door of said vehicle in response to successful facial recognition; With the infrared ranging sensor as the wake-up source, it can wake up the image acquisition module used to unlock the door by face, and be sure to wear the car key or mobile phone and turn on Bluetooth It is possible to solve the inconvenience of doing so, and it is also possible to solve the problem that the power consumption of the ultrasonic method is large. Here, since the infrared ranging sensor can measure the distance accurately and has a high ranging speed, it is possible to improve the response speed. Infrared ranging sensors are also inexpensive, environmentally insensitive, and have high feasibility and practicality.

In some embodiments, the functions or modules provided in the apparatus provided in the embodiments of the present disclosure can be used to perform the methods described in the above method embodiments, the specific implementation of which is described in Please refer to the description of the above method embodiments, and for the sake of brevity, redundant descriptions are omitted here.

An embodiment of the present disclosure is a computer readable storage medium having computer program commands stored therein which, when executed by a processor, cause the above methods to be implemented. Offer more. Here, the computer-readable storage medium may be a non-volatile computer-readable storage medium or a volatile computer-readable storage medium.

An embodiment of the present disclosure is a computer program product comprising computer readable code that, when run on an electronic device, causes a processor of the electronic device to execute commands to implement the method. A computer program is further provided.

An embodiment of the present disclosure is a computer program product in which computer readable commands are stored which, when executed, cause a computer to execute a vehicle door unlocking method according to any one of the above embodiments. Further provided is another computer program product that causes the operations of

Embodiments of the present disclosure include one or more processors and a memory for storing executable commands, the one or more processors calling executable commands stored in the memory. There is further provided an electronic device configured to perform the above method with.

An electronic device may be provided as a terminal, server, or other form of device. For example, the terminal may be an in-vehicle device or other processing device.

FIG. 5 shows a block diagram of an electronic device 800 according to an embodiment of the disclosure. For example, the electronic device 800 may be a terminal such as an in-vehicle device, a mobile phone, a computer, a digital broadcast terminal, a message transmission/reception device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like.

Referring to FIG. 5, electronic device 800 includes processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component. 816 may be included.

The processing component 802 typically controls the overall operation of the electronic device 800, such as operations related to display, telephone calls, data communications, camera operations and recording operations. Processing component 802 may include one or more processors 820 that execute instructions to perform all or part of the steps of the methods described above. Processing component 802 may also include one or more modules for interaction with other components. For example, processing component 802 may include multimedia modules for interaction with multimedia component 808 .

Memory 804 is configured to store various types of data to support operations in electronic device 800 . These data include, by way of example, instructions for any application programs or methods that operate on electronic device 800, contact data, phonebook data, messages, pictures, videos, and the like. Memory 804 may be, for example, static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable programmable read only memory (EPROM), programmable read only memory (PROM), read only memory (ROM ), magnetic memory, flash memory, magnetic disk or optical disk, or any combination thereof.

Power supply component 806 provides power to each component of electronic device 800 . Power supply components 806 may include a power management system, one or more power supplies, and other components related to power generation, management, and distribution for electronic device 800 .

Multimedia component 808 includes a screen that provides an output interface between electronic device 800 and a user. In some examples, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, it may be implemented as a touch screen that receives input signals from the user. A touch panel includes one or more touch sensors to detect touches, slides, and gestures on the touch panel. The touch sensor may detect not only the boundaries of touch or slide movement, but also the duration and pressure associated with the touch or slide operation. In some examples, multimedia component 808 includes a front-facing camera and/or a rear-facing camera. The front camera and/or the rear camera may receive external multimedia data when the electronic device 800 is in an operational mode, such as a photographing mode or imaging mode. Each front and rear camera may have a fixed optical lens system or a focal length and optical zoom capability.

Audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a microphone (MIC) that receives external audio signals when the electronic device 800 is in operational modes, such as call mode, recording mode and voice recognition mode. configured as The received audio signals may also be stored in memory 804 or transmitted via communication component 816 . In some examples, audio component 810 further includes a speaker for outputting audio signals.

I/O interface 812 provides an interface between processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, and the like. These buttons may include, but are not limited to, home button, volume button, start button and lock button.

Sensor component 814 includes one or more sensors for assessing the condition of various aspects of electronic device 800 . For example, the sensor component 814 can detect the on/off state of the electronic device 800, the relative positioning of components such as the display and keypad of the electronic device 800, and the sensor component 814 can further detect the electronic device 800 or the electronic device 800. Changes in the position of a certain component, presence or absence of contact between the user and the electronic device 800, orientation or acceleration/deceleration of the electronic device 800, and temperature changes of the electronic device 800 can be detected. Sensor component 814 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. Sensor component 814 may also include optical sensors for use in imaging applications, such as CMOS or CCD image sensors. In some examples, the sensor component 814 may further include an acceleration sensor, a gyro sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

Communication component 816 is configured to provide wired or wireless communication between electronic device 800 and other devices. The electronic device 800 can access wireless networks based on communication standards, such as WiFi, 2G, 3G, 4G/LTE, 5G, or combinations thereof. In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate near field communication. For example, the NFC module can be implemented by Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT®) technology and other technologies.

In an exemplary embodiment, electronic device 800 includes one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processors (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( FPGA), controller, microcontroller, microprocessor or other electronic component, and can be used to perform the above methods.

The exemplary embodiment further provides a non-volatile computer-readable storage medium, e.g., memory 804, containing computer program instructions, which, when executed by processor 820 of electronic device 800, perform the methods described above. can be made

FIG. 6 shows a block diagram of an electronic device 1900 according to an embodiment of the disclosure. For example, electronic device 1900 may be provided as a server. Referring to FIG. 6, electronic device 1900 includes a processing component 1922, which includes one or more processors, and memory resources, typically memory 1932, for storing instructions executable by processing component 1922, such as application programs. include. An application program stored in memory 1932 may include one or more modules each corresponding to a set of instructions. The processing component 1922 is also configured to perform the method by executing instructions.

Electronic device 1900 further includes a power component 1926 configured to perform power management of electronic device 1900, a wired or wireless network interface 1950 configured to connect electronic device 1900 to a network, and an input/output (I/O) interface 1950 configured to connect electronic device 1900 to a network. O) may include an interface 1958; Electronic device 1900 may run an operating system stored in memory 1932, such as Windows Server®, Mac OS X®, Unix®, Linux®, FreeBSD®, or similar. You can act on things.

The exemplary embodiment further provides a non-volatile computer-readable storage medium, e.g., memory 1932, containing computer program instructions, which are executed by the processing component 1922 of the electronic device 1900 to perform the method. can be made

The present disclosure may be systems, methods and/or computer program products. The computer program product may include a computer readable storage medium having computer readable program instructions for causing a processor to implement aspects of the present disclosure.

A computer-readable storage medium may be a tangible device capable of storing and storing instructions for use with an instruction execution device. A computer readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (non-exhaustive list) of computer readable storage media include portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash) memory), static random access memory (SRAM), portable compact disc read only memory (CD-ROM), digital versatile disc (DVD), memory stick, floppy disc, e.g. Including mechanical encoding devices such as endoprotrusions, and any suitable combination of the above. Computer-readable storage media, as used herein, refers to instantaneous signals themselves, such as radio waves or other freely propagating electromagnetic waves, or electromagnetic waves propagated through waveguides or other transmission media (e.g., passing through fiber optic cables). pulsed light), or as an electrical signal transmitted over wires.

The computer readable program instructions described herein may be downloaded from a computer readable storage medium to each computing/processing device, or may be downloaded externally via networks such as the Internet, local area networks, wide area networks and/or wireless networks. It may be downloaded to a computer or external storage device. A network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. A network adapter card or network interface within each computing/processing device receives computer-readable program instructions from the network and transfers the computer-readable program instructions for storage on a computer-readable storage medium within each computing/processing device.

Computer program instructions for performing operations of the present disclosure may be assembly instructions, Instruction Set Architecture (ISA) instructions, machine language instructions, machine dependent instructions, microcode, firmware instructions, state setting data, or object oriented instructions such as Smalltalk, C++, etc. The source or target code may be written in any combination of one or more programming languages, including programming languages and common procedural programming languages such as the "C" language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, executed as a stand-alone software package, partially on the user's computer and partially on the user's computer. It may be executed entirely on a remote computer, or may be executed entirely on a remote computer or server. When involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or (e.g. Internet service It may be connected to an external computer (via the Internet using a provider). In some embodiments, state information in computer readable program instructions is used to personalize an electronic circuit, such as a programmable logic circuit, field programmable gate array (FPGA), or programmable logic array (PLA), such that the electronic circuit Aspects of the present disclosure may be implemented by executing computer readable program instructions.

Aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure; It is to be understood that any combination of blocks in the flowchart and/or block diagrams can be implemented by computer readable program instructions.

These computer readable program instructions are provided to a processor of a general purpose computer, special purpose computer or other programmable data processing apparatus, and when these instructions are executed by the processor of the computer or other programmable data processing apparatus, the flowcharts and/or A device may be manufactured to implement the functions/acts specified in one or more of the blocks in the block diagrams. These computer readable program instructions may be stored on a computer readable storage medium and cause computers, programmable data processing devices and/or other devices to operate in a specific manner. Accordingly, the computer-readable storage medium having the instructions stored thereon comprises an article of manufacture having instructions for implementing aspects of the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.

Computer readable program instructions are loaded into a computer, other programmable data processing device, or other machine and executed by the computer by causing the computer, other programmable data processing device, or other machine to perform a series of operational steps. A process may be generated. As such, instructions executed on a computer, other programmable data processing device, or other machine implement the functions/acts specified in one or more blocks of the flowchart illustrations and/or block diagrams.

The flowcharts and block diagrams in the drawings illustrate possible system architectures, functionality, and operation of systems, methods and computer program products according to embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram can represent a portion of a module, program segment, or instruction, which is a single unit for implementing a specified logical function. Contains one or more executable instructions. In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two consecutive blocks may be executed substantially in parallel, or may be executed in reverse order depending on the functionality involved. It should be noted that each block in the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, may be implemented by a dedicated system based on hardware that performs the specified functions or operations, or may be implemented by a dedicated system. It should also be noted that the implementation may be a combination of hardware and computer instructions.

This computer program product can be embodied in hardware, software, or a combination thereof. In one optional embodiment, the computer program product is embodied as a computer storage medium. In another optional embodiment, the computer program product is embodied as a software product, such as a Software Development Kit (SDK).

While embodiments of the present disclosure have been described above, the above description is illustrative only and is not intended to be exhaustive or limited to the embodiments shown. Various modifications and alterations will be apparent to those skilled in the art without departing from the scope and spirit of each described embodiment. The terms chosen herein are used to suitably interpret the principle, practical application, or improvement over existing technology of each embodiment, or to allow others skilled in the art to understand each embodiment presented herein. It is.

Claims (11)

Continuously obtaining a distance between an object outside the vehicle and the infrared ranging sensor installed outside the vehicle compartment;
in response to the distance gradually decreasing and the duration for which the distance is less than or equal to a first distance threshold reaches a first time threshold; or in response to the distance gradually decreasing and the distance decreasing to a second distance threshold. waking up and controlling an image acquisition module located in the vehicle to acquire a video stream in response to reaching a second time threshold for the duration of the constant stay below the distance threshold; When,
performing face recognition based on at least one image of the video stream;
controlling to unlock and/or open at least one door of the vehicle in response to successful facial recognition;
A vehicle door unlocking method characterized by: Continuously acquiring the distance between an object outside the vehicle and the infrared ranging sensor by an infrared ranging sensor installed outside the vehicle compartment includes:
When the vehicle is in a sleep state or in a sleep state and the doors are not unlocked, an infrared ranging sensor installed outside the vehicle interior detects an object outside the vehicle and the infrared ranging sensor. including continuously obtaining the distance of
2. The method of claim 1, wherein: an image capture device positioned on the vehicle to capture a video stream in response to the distance gradually decreasing and the duration of the distance being less than or equal to the first distance threshold reaching a first time threshold. Waking up and controlling a module is
waking up a facial recognition module installed in the vehicle in response to the distance gradually decreasing and the duration of the distance being less than or equal to the first distance threshold reaching a first time threshold;
controlling the image acquisition module to acquire a video stream with the facial recognition module being awakened;
or,
said image acquisition such that said distance is gradually decreased and a video stream is acquired in response to reaching a second time threshold for the duration that said distance remains constant at or below a second distance threshold. Waking up and controlling a module is
waking a face recognition module located in the vehicle in response to the distance gradually decreasing and the duration of the distance being maintained constant at or below a second distance threshold reaching a second time threshold; up and
controlling the image acquisition module to acquire a video stream with the facial recognition module being awakened;
3. A method according to claim 1 or 2, characterized in that: the first distance threshold comprises a first predetermined distance value and a second predetermined distance value, wherein the first predetermined distance value is greater than the second predetermined distance value;
an image capture device positioned on the vehicle to capture a video stream in response to the distance gradually decreasing and the duration of the distance being less than or equal to the first distance threshold reaching a first time threshold. Waking up and controlling a module is
waking up a face recognition module installed in the vehicle in response to the distance gradually decreasing and the distance being less than or equal to the first predetermined distance value;
responsive to the duration of the distance being less than or equal to the second predetermined distance value reaching a first time threshold, the awakened face recognition module controlling the image acquisition module to acquire a video stream; including and
or,
the second distance threshold comprises a third predetermined distance value and a fourth predetermined distance value, wherein the third predetermined distance value is greater than the fourth predetermined distance value;
the image acquisition module to acquire a video stream in response to the distance gradually decreasing and the duration for which the distance remains constant below a second distance threshold reaches a second time threshold; Waking up and controlling the
waking up a facial recognition module installed in the vehicle in response to the distance gradually decreasing and the distance being equal to or less than the third predetermined distance value;
responsive to the facial recognition module being awakened in response to reaching a second time threshold for a duration of time that the distance remains constant at or below the fourth predetermined distance value, causing the image acquisition module to generate a video stream; controlling to collect;
3. A method according to claim 1 or 2, characterized in that: After waking up the facial recognition module installed in the vehicle,
further comprising controlling the face recognition module to enter a sleep state if no facial image is collected within a preset time or if face recognition is not successful within a preset time;
5. A method according to claim 3 or 4, characterized in that: an acquisition module for continuously acquiring a distance between an object outside the vehicle and the infrared ranging sensor by an infrared ranging sensor installed outside the vehicle;
in response to the distance gradually decreasing and the duration for which the distance is less than or equal to a first distance threshold reaches a first time threshold; or in response to the distance gradually decreasing and the distance decreasing to a second distance threshold. for waking up and controlling an image acquisition module located in the vehicle to acquire a video stream in response to reaching a second time threshold for the duration of being kept constant below the distance threshold; and a wakeup module for
a face recognition module for performing face recognition based on at least one image of said video stream;
a control module for controlling the unlocking and/or opening of at least one door of the vehicle in response to successful face recognition;
A vehicle door unlocking device characterized by: the first distance threshold comprises a first predetermined distance value and a second predetermined distance value, wherein the first predetermined distance value is greater than the second predetermined distance value;
The wakeup module is
waking up a face recognition module installed in the vehicle in response to the distance gradually decreasing and the distance being less than or equal to the first predetermined distance value;
responsive to the duration of the distance being less than or equal to the second predetermined distance value reaching a first time threshold, the awakened face recognition module controlling the image acquisition module to acquire a video stream; used to
or,
the second distance threshold comprises a third predetermined distance value and a fourth predetermined distance value, wherein the third predetermined distance value is greater than the fourth predetermined distance value;
The wakeup module is
waking up a facial recognition module installed in the vehicle in response to the distance gradually decreasing and the distance being equal to or less than the third predetermined distance value;
responsive to the facial recognition module being awakened in response to reaching a second time threshold for a duration of time that the distance remains constant at or below the fourth predetermined distance value, causing the image acquisition module to generate a video stream; Used to control to collect,
7. Apparatus according to claim 6, characterized in that: comprising an infrared ranging sensor, a main control chip, a face recognition module and an image acquisition module, wherein the main control chip is connected to the infrared ranging sensor and the face recognition module respectively, and the image acquisition module comprises: Connected to the face recognition module, the infrared ranging sensor is for continuously obtaining the distance between an object outside the vehicle and the infrared ranging sensor, and the main control chip is configured to: gradually decreases and the duration for which the distance is less than or equal to a first distance threshold reaches a first time threshold, or the distance gradually decreases and the distance is less than or equal to a second distance threshold for waking up said facial recognition module and for waking up said image acquisition module by said facial recognition module in response to reaching a second time threshold for a duration kept constant by: , the image collection module is for collecting a video stream, the face recognition module is for performing face recognition based on at least one image of the video stream, and the main control chip is configured to: Send door unlock command to car body control module according to successful face recognition,
A vehicle door unlocking system characterized by: one or more processors;
a memory for storing executable commands;
The one or more processors are configured to invoke executable commands stored in the memory to perform the method of any one of claims 1-5,
An electronic device characterized by: A computer readable storage medium having computer program commands stored thereon,
The computer program commands, when executed by a processor, implement the method of any one of claims 1-5,
A computer-readable storage medium characterized by: A computer program comprising computer readable code,
The computer readable code, when run on an electronic device, causes a processor of the electronic device to execute commands for implementing the method of any one of claims 1 to 5,
A computer program characterized by:

Images