WO2022048119A1 - Procédé et appareil de commande de véhicule, dispositif électronique, support de stockage et véhicule - Google Patents

Procédé et appareil de commande de véhicule, dispositif électronique, support de stockage et véhicule Download PDF

Info

Publication number
WO2022048119A1
WO2022048119A1 PCT/CN2021/078679 CN2021078679W WO2022048119A1 WO 2022048119 A1 WO2022048119 A1 WO 2022048119A1 CN 2021078679 W CN2021078679 W CN 2021078679W WO 2022048119 A1 WO2022048119 A1 WO 2022048119A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
information
face information
current occupant
face
Prior art date
Application number
PCT/CN2021/078679
Other languages
English (en)
Chinese (zh)
Inventor
黎建平
王俊越
孙牵宇
许亮
刘卫龙
Original Assignee
上海商汤临港智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 上海商汤临港智能科技有限公司 filed Critical 上海商汤临港智能科技有限公司
Publication of WO2022048119A1 publication Critical patent/WO2022048119A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00—Individual registration on entry or exit
    • G07C9/00174—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00563—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00—Individual registration on entry or exit
    • G07C9/00174—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00571—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys operated by interacting with a central unit

Definitions

  • the present disclosure relates to the technical field of vehicles, and in particular, to a vehicle control method and device, an electronic device, a storage medium, and a vehicle.
  • the door can be unlocked by means of face recognition. For example, after Person A unlocks the car door through face recognition, Person B can drive the vehicle, resulting in a greater safety hazard.
  • the present disclosure provides a technical solution for vehicle control.
  • a vehicle control method comprising:
  • the first target face information represents the face information of the person who successfully unlocked the door
  • the vehicle In response to the successful matching between the face image of the current occupant and the first target face information, the vehicle is controlled according to the manipulation behavior of the current occupant.
  • the face information of the person who successfully unlocks the vehicle door includes:
  • the vehicle in response to the successful matching between the face image of the current occupant and the first target face information, the vehicle is controlled according to the manipulation behavior of the current occupant, including: :
  • An alarm prompt is provided for the manipulation behavior of the current occupant outside the operating authority range.
  • acquiring the operation authority scope of the current occupant includes:
  • the operation authority range of the current occupant is determined according to the age information of the current occupant.
  • acquiring the operation authority scope of the current occupant includes:
  • the acquiring the face image of the current occupant and the first target face information includes: in response to detecting that the current occupant starts the vehicle maneuvering behavior, acquiring the face image of the current occupant and the first target face information;
  • the controlling operation of the vehicle according to the manipulation behavior of the current occupant in response to the successful matching between the face image of the current occupant and the first target face information includes: responding to a person of the current occupant The face image is successfully matched with the first target face information, and the vehicle is controlled to start.
  • the method further includes:
  • first prompt information is generated, wherein the first prompt information is used to prompt illegal intrusion.
  • the method further includes:
  • control information that controls at least one of the vehicle, instrument panel, display screen, speaker, and vibration module of the vehicle to issue the first prompt information
  • the first prompt information is sent to the owner terminal of the vehicle.
  • the face image of the current occupant is collected by a first camera installed in the cabin, and the first target face information is collected by a second camera installed outside the cabin.
  • the method further includes:
  • the second target face information represents the face information of the person who successfully started the vehicle last time
  • second prompt information is generated, wherein the second prompt information is used to prompt illegal intrusion.
  • the matching of the current driver's face image with the second target face information includes:
  • the method further includes:
  • the registered face information of the vehicle is managed according to the registration management request of the face information.
  • the method further includes:
  • third prompt information is generated, wherein the third prompt information is used to prompt the driver to concentrate on driving.
  • the preset static state includes at least one of the following: the gear position of the vehicle is P gear, the gear position of the vehicle is N gear, and the vehicle speed of the vehicle is 0.
  • the method further includes:
  • fourth prompt information is generated, wherein the fourth prompt information is used to prompt that the face information corresponding to the face registration request has been registered.
  • Registration one of the face information corresponding to the face registration request and the registered face information is collected by the first camera installed in the cabin, and the other is collected by the second camera installed outside the cabin collection.
  • a vehicle control device comprising:
  • a first acquisition module configured to acquire the face image of the current occupant and the first target face information, wherein the first target face information represents the face information of the person who successfully unlocked the door;
  • a first matching module configured to match the face image of the current occupant with the first target face information
  • a control operation module configured to control the vehicle according to the manipulation behavior of the current occupant in response to the successful matching between the face image of the current occupant and the first target face information.
  • a vehicle comprising:
  • the first camera installed in the cabin, is used to collect the face image of the current occupant
  • a controller connected with the first camera, for acquiring the face image of the current occupant and the first target face information, and matching the face image of the current occupant with the first target face information , in response to the successful matching between the face image of the current occupant and the first target face information, control the vehicle according to the manipulation behavior of the current occupant, wherein the first target face information represents Face information of the person who successfully unlocked the door.
  • it also includes:
  • the second camera connected with the controller, is installed outside the cabin, and is used to collect video streams outside the cabin.
  • an electronic device comprising: one or more processors; a memory for storing executable instructions; wherein the one or more processors are configured to invoke the memory storage executable instructions to perform the above method.
  • a computer-readable storage medium having computer program instructions stored thereon, the computer program instructions implementing the above method when executed by a processor.
  • a computer program comprising computer-readable code, which when the computer-readable code is executed in an electronic device, is executed by a processor in the electronic device for implementing the above method.
  • the vehicle by acquiring the face image of the current occupant and the first target face information, wherein the first target face information represents the face information of the person who successfully unlocked the door, the current occupant's face
  • the face image is matched with the first target face information, and in response to the successful matching between the face image of the current occupant and the first target face information, the vehicle is adjusted according to the manipulation behavior of the current occupant.
  • the control operation is performed, whereby the vehicle is controlled and operated according to the manipulation behavior of the current occupant only when the current occupant is successfully matched with the person who successfully unlocks the door, thereby improving the safety of the vehicle and reducing potential safety hazards.
  • FIG. 1 shows a flowchart of a vehicle control method provided by an embodiment of the present disclosure.
  • FIG. 2 shows a block diagram of a vehicle provided by an embodiment of the present disclosure.
  • FIG. 3 shows another block diagram of a vehicle provided by an embodiment of the present disclosure.
  • FIG. 4 shows a block diagram of a vehicle control apparatus provided by an embodiment of the present disclosure.
  • FIG. 5 shows a block diagram of an electronic device 800 provided by an embodiment of the present disclosure.
  • Embodiments of the present disclosure provide a vehicle control method and device, an electronic device, a storage medium, and a vehicle, by acquiring a face image of a current occupant and first target face information, wherein the first target face information indicates success face information of the person unlocking the door, matching the face image of the current occupant with the first target face information, and responding to the face image of the current occupant and the first target face information If the matching is successful, the vehicle is controlled and operated according to the manipulation behavior of the current occupant, so that the vehicle is controlled and operated according to the manipulation behavior of the current occupant only when the current occupant is successfully matched with the person who successfully unlocked the door. , so as to effectively control the safety of the vehicle operation and reduce the potential safety hazards.
  • FIG. 1 shows a flowchart of a vehicle control method provided by an embodiment of the present disclosure.
  • the executing subject of the vehicle control method may be a vehicle control device.
  • the vehicle control method may be performed by a terminal device or other processing device.
  • the terminal device may be a vehicle-mounted device, a user equipment (User Equipment, UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a Personal Digital Assistant (PDA), a handheld device, a computing device, or a wearable devices, etc.
  • UE user equipment
  • PDA Personal Digital Assistant
  • the in-vehicle device can be a controller, a domain controller, a car machine or a processor in the cabin, and can also be used in a DMS (Driver Monitor System, driver monitoring system) or OMS (Occupant Monitoring System, occupant monitoring system). It is used for the device host that performs data processing operations such as images.
  • the vehicle control method may be implemented by a processor invoking computer-readable instructions stored in a memory. As shown in FIG. 1 , the vehicle control method includes steps S11 to S13.
  • step S11 the face image of the current occupant and the first target face information are acquired, wherein the first target face information represents the face information of the person who successfully unlocks the door of the vehicle.
  • the occupant of the vehicle may be any person who rides the vehicle.
  • the occupants may include at least one of a driver, a non-driver, a passenger, an adult, an elderly person, a child, a front-seat occupant, a rear-seat occupant, and the like, boarding the vehicle.
  • the current occupant may represent a person currently riding the vehicle.
  • part or all of the face images of the current occupant may be acquired.
  • only the face image of the current driver can be acquired.
  • only the face image of the person currently in the passenger seat may be acquired.
  • the face image of the current driver and the face image of the person currently in the passenger seat may be acquired.
  • face images of all occupants in the current cabin may be acquired.
  • the face image of the current occupant may be acquired from the video stream in the vehicle cabin.
  • the video stream in the vehicle cabin may be collected by a first camera, and the video stream in the vehicle cabin may be acquired from the first camera, so as to obtain the video stream in the vehicle cabin from the first camera.
  • the face image of the current occupant is obtained from the video stream.
  • the first camera may include a DMS camera and/or an OMS camera, and the like.
  • the number of the first cameras may be one or more.
  • the first camera can be installed anywhere in the cabin.
  • the first camera may be installed in at least one of the following positions: an A-pillar, a dashboard, a dome light, an interior rearview mirror, a center console, and a front windshield.
  • the first target face information may include at least one of a face image, face feature, identity information, and the like of a person who successfully unlocks the vehicle door.
  • the first target face information may be obtained based on a video stream outside the vehicle cabin.
  • the video stream outside the vehicle cabin may be collected by a second camera, and the video stream outside the vehicle cabin may be acquired from the second camera.
  • the number of the second cameras may be one or more.
  • the second camera may be installed on at least one of the following positions: at least one B-pillar, at least one vehicle door, at least one exterior rearview mirror, and a cross member.
  • the second camera may be mounted on the B-pillar on the main driver's seat side of the vehicle.
  • the second camera may be installed on the B-pillar on the left side of the vehicle.
  • the second camera may be installed on the two B-pillars and the trunk door.
  • the second camera may use a ToF (Time of Flight, time of flight) camera, a binocular camera, or the like.
  • ToF Time of Flight, time of flight
  • the current occupant may also be a person who is detected based on a video stream outside the vehicle cabin and has an intention to enter the vehicle cabin.
  • the face image of the current occupant may be obtained from the Captured in the video stream outside the cabin. For example, based on the video stream outside the vehicle cabin, it can be detected whether a person enters the vehicle cabin from outside the vehicle cabin. For the current occupant, the face image of the person is obtained from the video stream outside the vehicle cabin as the face image of the current occupant.
  • the person can be detected whether a person opens the door from outside the vehicle, and if so, it can be determined that the person has an intention to enter the vehicle cabin, and the person can be regarded as the current occupant , and obtain the face image of the person from the video stream outside the vehicle cabin as the face image of the current occupant. Further, it can be further judged according to the registration information whether the person with the intention to enter the cabin is allowed to enter the cabin, and if the person with the intention to enter the cabin is allowed to enter the cabin, the person can be regarded as the current status of the vehicle. occupant.
  • a video stream outside the vehicle cabin may be acquired, face recognition is performed according to the video stream outside the vehicle cabin, a face recognition result outside the vehicle cabin may be obtained, and a response to the vehicle cabin may be obtained.
  • the external face recognition result is that the face recognition is successful, the door is controlled to be unlocked and/or opened, and according to at least one video frame in the video stream outside the vehicle cabin and/or the face recognition result outside the vehicle cabin, obtain the first target face information.
  • the first target face information may be obtained according to at least one video frame in the video stream outside the vehicle cabin used for obtaining the face recognition result outside the vehicle cabin.
  • the video frame used to obtain the face recognition result outside the vehicle cabin may represent the person corresponding to the face recognition result in the video stream outside the vehicle cabin.
  • the video frame where the face appears For example, the faces corresponding to the face recognition results outside the vehicle cabin appear in the video frames F 1 to F N in the video stream outside the vehicle cabin, then the video frames F 1 to F N are outside the vehicle cabin.
  • part or all of the video frames in the video stream outside the vehicle cabin used to obtain the face recognition result outside the vehicle cabin may be used as the first target face information.
  • the first target face information may include a face image of a person who successfully unlocks the vehicle door, and the face image of the person who successfully unlocks the vehicle door may be included in the video stream outside the vehicle cabin for Part or all of the video frames of the face recognition result outside the vehicle cabin are obtained.
  • a face image may be intercepted from a video stream outside the vehicle cabin, part or all of the video frames used to obtain the face recognition result outside the vehicle cabin, as the first target person face information.
  • the first target face information may include a face image of a person who successfully unlocks the vehicle door
  • the face image of the person who successfully unlocks the vehicle door may include a video stream from outside the vehicle cabin, using A face image captured from a part or all of the video frames from which the face recognition result outside the vehicle cabin is obtained.
  • the facial features in part or all of the video frames used to obtain the facial recognition result outside the vehicle cabin in the video stream outside the vehicle cabin may be extracted as the first target person face information.
  • the first target face information may include the face feature of the person who successfully unlocks the vehicle door
  • the face feature of the person who successfully unlocks the vehicle door may include a video stream from outside the vehicle cabin, using The facial features extracted from some or all of the video frames from which the facial recognition results outside the vehicle cabin are obtained.
  • the identity information corresponding to the face recognition result outside the vehicle cabin may be used as the first target face information.
  • the first target face information may include the identity information of the person who successfully unlocked the vehicle door
  • the identity information of the person who successfully unlocked the vehicle door may include the identity information corresponding to the face recognition result outside the vehicle cabin .
  • step S12 the face image of the current occupant is matched with the first target face information.
  • the face image of the current occupant by matching the face image of the current occupant with the first target face information, it can be determined whether the current occupant is a person who successfully unlocks the vehicle door.
  • the first target face information includes a face image of a person who successfully unlocks the vehicle door. If the similarity between the face image of the current occupant and the face image of the person who successfully unlocked the door is greater than or equal to a first threshold, it can be determined that the face image of the current occupant and the first target face Information matching is successful; if the similarity between the face image of the current occupant and the face image of the person who successfully unlocked the door is less than the first threshold, it can be determined that the face image of the current occupant and the first target Face information matching failed.
  • the first target face information includes face features of a person who successfully unlocks the vehicle door.
  • the facial features of the current occupant's face image can be obtained by performing facial feature extraction on the current occupant's facial image. If the similarity between the facial features of the current occupant's face image and the facial features of the person who successfully unlocked the door is greater than or equal to the second threshold, it can be determined that the current occupant's facial image is the same as the first occupant's face image.
  • a target face information is successfully matched; if the similarity between the face feature of the current occupant's face image and the face feature of the person who successfully unlocked the door is less than the second threshold, it can be determined that the current occupant's face The face image fails to match the first target face information.
  • the first target face information includes identity information of a person who successfully unlocks the vehicle door.
  • the identity information corresponding to the face image of the current occupant can be obtained, that is, the identity information of the current occupant can be determined. If the identity information corresponding to the face image of the current occupant is successfully matched with the identity information of the person who successfully unlocked the door, it can be determined that the face image of the current occupant is successfully matched with the first target face information; If the identity information corresponding to the face image of the current occupant fails to match with the identity information of the person who successfully unlocked the door, it may be determined that the match between the face image of the current occupant and the first target face information fails.
  • step S13 in response to the successful matching between the face image of the current occupant and the first target face information, the vehicle is controlled according to the manipulation behavior of the current occupant.
  • the manipulation behavior of the current occupant may refer to the behavior of the current occupant to manipulate the vehicle.
  • the current occupant's manipulation behavior may include at least one of starting the vehicle, manipulating the in-vehicle entertainment system (eg, playing audio, video, etc.), adjusting the air conditioner, raising and lowering the windows, adjusting the rearview mirror, and the like.
  • the current occupant when the face image of the current occupant is successfully matched with the first target face information, the current occupant may be allowed to control the vehicle; when the face image of the current occupant matches the first target face information When the matching of the face information of the first target fails, the current occupant may be prohibited from operating the vehicle.
  • the manipulation behavior of the current occupant is to start the vehicle
  • the vehicle can be started in response to the successful matching between the face image of the current occupant and the first target face information, and the face image of the current occupant can be matched with the The first target face information matching fails, and the vehicle is prohibited from starting.
  • the vehicle by acquiring the face image of the current occupant and the first target face information, wherein the first target face information represents the face information of the person who successfully unlocked the door, the current occupant's face
  • the face image is matched with the first target face information, and in response to the successful matching between the face image of the current occupant and the first target face information, the vehicle is adjusted according to the manipulation behavior of the current occupant.
  • Control operation is performed, so that when the current occupant is successfully matched with the person who successfully unlocks the door, the vehicle is controlled and operated according to the control behavior of the current occupant, so that the control of the vehicle can be effectively controlled safely, reducing safety. hidden danger.
  • the method further includes: in response to a failure to match the face image of the current occupant with the first target face information, generating first prompt information, wherein the first prompt The information is used to prompt illegal intrusion.
  • first prompt information in response to a failure to match the face image of the current occupant with the first target face information, it can play a role of warning illegal intruders.
  • the method further includes: generating at least one of a vehicle engine, an instrument panel, a display screen, a speaker, and a vibration module that controls the vehicle to send out the Describe the control information of the first prompt information.
  • at least one of the vehicle engine, instrument panel, display screen, speaker, and vibration module of the vehicle may issue the first prompt information under the control of the control information, thereby enabling the The role of alerting the current occupant.
  • the current occupant is the current driver, and according to this example, the current driver can be alerted.
  • the first prompt information may include text information, and the text information in the first prompt information may be displayed through at least one of a vehicle engine, an instrument panel, and a display screen of the vehicle.
  • the first prompt information may include text information of "Illegal intrusion is found, please get off the bus as soon as possible”.
  • the first prompt information may include animation information, and the animation information in the first prompt information may be displayed through at least one of a vehicle engine, an instrument panel, and a display screen of the vehicle.
  • the first prompt information may include voice information, and the voice information in the first prompt information may be played through a speaker of the vehicle.
  • the first prompt information may include the voice information of "Illegal intrusion is found, please get out of the car as soon as possible”.
  • the vibration module may be controlled to vibrate while displaying the text information in the first prompt information and/or playing the voice information in the first prompt information, so as to further warn illegal intruders.
  • the method further includes: sending the first prompt information to the owner terminal of the vehicle.
  • the vehicle owner by sending the first prompt information to the vehicle owner terminal, the vehicle owner can discover the illegal intrusion in time, thereby improving the safety of the vehicle.
  • the first prompt information may be sent to the vehicle owner terminal by means of a short message, a phone call, an APP (Application, application), or the like.
  • the identification information of the vehicle owner terminal may be stored in advance, and after the first prompt information is generated, the first prompt information is sent to the vehicle owner terminal according to the identification information of the vehicle owner terminal.
  • the identification information of the vehicle owner terminal may be the phone number of the vehicle owner terminal, the ID (Identity Document, identity identification account) of the APP, and the like.
  • the TBox (remote control system) of the vehicle may communicate with the vehicle owner terminal, and send the first prompt information to the vehicle owner terminal.
  • the first prompt information may include a photo and/or video of the current occupant.
  • the photo and/or video of the current occupant may be obtained according to the video stream in the vehicle cabin collected by the first camera. For example, one or more video frames in the video stream in the vehicle cabin may be used as the photo of the current occupant.
  • the face area may be intercepted from one or more video frames in the video stream in the vehicle cabin to obtain the photo of the current occupant.
  • a video clip may be intercepted from the video stream in the vehicle cabin as the video of the current occupant.
  • the method further includes: in response to receiving the confirmation information from the vehicle owner terminal, closing the prompt information in the vehicle , wherein the confirmation information is used to determine that the current occupant does not belong to an illegal occupant, for example, it can be used to determine that the current driver does not belong to an illegal driver.
  • closing the prompt information in the vehicle may refer to no longer sending out the first prompt information through the vehicle's locomotive, instrument panel, display screen, speaker, vibration module, and the like.
  • the face image of the current occupant fails to match the first target face information
  • no operation may be performed, for example, the first prompt may not be generated. information, and do not control the vehicle according to the current occupant's manipulation behavior.
  • the face information of the person who successfully unlocked the vehicle door includes: the face information of the person who successfully unlocked the vehicle door last time.
  • the vehicle in response to the successful matching between the face image of the current occupant and the face information of the person who successfully unlocked the vehicle door last time, the vehicle is controlled according to the manipulation behavior of the current occupant, thereby When the current occupant is the person who successfully unlocked the door for the last time, the vehicle is controlled and operated according to the manipulation behavior of the current occupant, thereby further improving the safety of the vehicle and reducing potential safety hazards.
  • the face image of the current driver may be matched with the face information of the person who successfully unlocked the vehicle door last time in response to If successful, the vehicle is started, so that the vehicle is started only when the person currently in the main driver's seat is successfully matched with the person who successfully unlocked the vehicle door last time, thereby further improving the safety of the vehicle.
  • the first prompt information may be generated in response to a failure to match the face image of the current occupant with the face information of the person who successfully unlocked the vehicle door last time. According to this example, it is possible to prompt if the current occupant is not the person who successfully unlocked the door last time.
  • the face information of the person who successfully unlocks the vehicle door includes: the face information of the person who successfully unlocked the vehicle door last time when the main driver's seat is unoccupied.
  • the vehicle in response to the successful matching between the face image of the current occupant and the face information of the person who successfully unlocked the vehicle door last time in the state where the main driver's seat is unoccupied, according to the current occupant's manipulation behavior The vehicle performs a control operation, so that when the current occupant is the person who successfully unlocked the vehicle door last time in a state where the main driver's seat is unmanned, the vehicle is controlled and operated according to the manipulation behavior of the current occupant, Thereby, the safety of the vehicle can be further improved and the hidden danger of safety can be reduced.
  • the driver's face information can be used as the face information of the person with the control authority (ie, the first target face information), so that the control authority of the vehicle can be given priority Attributable to the driver, to control the risk of non-driver operating the vehicle.
  • occupant A is the first occupant to board
  • occupant B is the second occupant to board
  • occupant C is the third occupant to board.
  • the face information of the person who successfully unlocked the car door last time in the state where the main driver's seat is unmanned (that is, the first target face information) Update the face information of occupant B (that is, the current driver).
  • the face information of the person who successfully unlocked the door last time ie the first target face information
  • the face image of occupant B can be compared with the person who successfully unlocked the vehicle door last time when the driver's seat is unoccupied.
  • the face information is matched, and the vehicle can be started in response to the successful matching between the face image of the occupant B and the face information of the person who successfully unlocked the vehicle door last time when the driver's seat is unoccupied.
  • occupant B that is, the current driver
  • other occupants such as occupant C
  • occupant C that is, the current driver
  • Still have permission to control the vehicle eg start the vehicle.
  • the first prompt message may be generated in response to a failure to match the face image of the current occupant with the face information of the person who successfully unlocked the vehicle door last time in a state where the main driver's seat is unoccupied . According to this example, it is possible to prompt when the current occupant is not the person who successfully unlocked the vehicle door last time when the driver's seat is unoccupied.
  • the vehicle in response to the successful matching between the face image of the current occupant and the first target face information, the vehicle is controlled according to the manipulation behavior of the current occupant, including: : in response to the successful matching between the face image of the current occupant and the first target face information, obtain the operating authority range of the current occupant; control operation of the vehicle; and/or, alarm and prompt for the manipulation behavior of the current occupant outside the operating authority range.
  • the operation authority range of the current occupant may be determined according to at least one of the identity information of the current occupant, belonging group information, age information, and the like.
  • the operation authority range of the occupant may be pre-configured and associated with at least one of the occupant's identity information, belonging group information, age information, and the like. After obtaining the face image of the current occupant, at least one of personal attribute recognition such as identity recognition, belonging group recognition, and age recognition can be performed according to the current occupant's face image, and then the corresponding operation authority scope can be determined according to the personal attribute recognition result. .
  • the safety of the vehicle can be further improved. The current occupant can be reminded to operate the vehicle within the operating authority by giving an alarm and prompting for the manipulation behavior of the current occupant outside the operating authority range.
  • the obtaining the operation authority range of the current occupant in response to the successful matching between the face image of the current occupant and the first target face information includes: responding to the current occupant The face image of 1 is successfully matched with the first target face information, and the age information of the current occupant is determined; according to the age information of the current occupant, the operation authority range of the current occupant is determined.
  • age recognition may be performed on the face image of the current occupant to determine the age information of the current occupant, or the pre-stored age of the current occupant may be acquired according to the identity information of the current occupant information.
  • the corresponding relationship between the age condition and the operating authority range may be established in advance, and the operating authority range of the current occupant is determined according to the corresponding relationship and the age information of the current occupant.
  • the scope of operation authority corresponding to the age of 18 or more includes starting the vehicle, adjusting the rearview mirror, operating the car entertainment system (such as playing audio, video, etc.), adjusting the air conditioner, raising and lowering the windows, etc.; the scope of operation authority corresponding to the age of less than 18 It can include controlling the car entertainment system, adjusting the air conditioner, raising and lowering the windows, etc. Among them, the scope of operation authority corresponding to the age of less than 18 does not include starting the vehicle.
  • the age information of the current occupant is determined by responding to the successful matching between the face image of the current occupant and the first target face information, and the current occupant's age information is determined according to the age information of the current occupant.
  • the scope of the occupant's operating authority can reduce the safety hazards caused by minors driving the vehicle.
  • the obtaining the operation authority range of the current occupant in response to the successful matching between the face image of the current occupant and the first target face information includes: in response to the current occupant's face image The face image of the occupant is successfully matched with the first target face information, and the time period to which the current time belongs is determined; the operation authority range of the time period to which the current occupant belongs at the current time is obtained.
  • the operation authority range of the same occupant in different time periods may be different.
  • the vehicle is an operating vehicle such as a bus, train, subway, etc., and the current occupant is the driver of the operating vehicle.
  • all The scope of operation authority of the current occupant in the time period to which the current time belongs may include starting the vehicle. If the time period to which the current time belongs is not the on-duty time period of the current occupant, the current occupant is in the current The operation authority range of the time period to which the time belongs may not include starting the vehicle. According to this example, the safety of the operating vehicle can be improved, and the management of the operating vehicle can be facilitated.
  • the face image of the current occupant is successfully matched with the first target face information, it is set by default that the current occupant has all the operation permissions of the vehicle, and according to the The current occupant's manipulation behavior controls the vehicle. In this implementation manner, it may not be necessary to obtain the operation authority range of the current occupant.
  • the acquiring the face image of the current occupant and the first target face information includes: in response to detecting that the current occupant starts the vehicle manipulation behavior, acquiring the face of the current occupant image and first target face information; the control operation of the vehicle according to the manipulation behavior of the current occupant in response to the successful matching between the face image of the current occupant and the first target face information, including : control the vehicle to start in response to the successful matching between the face image of the current occupant and the first target face information.
  • the current occupant may be the current driver, and after the current driver manually triggers the start of the vehicle, it may be determined whether the current driver and the person who successfully unlocked the door are the same person, and then determine whether to control the vehicle start, thereby further improving the safety of the vehicle.
  • the driver can manually trigger the start of the vehicle through a key, a start button, voice, gesture, and the like.
  • the current driver's manipulation behavior of starting the vehicle may include at least one of the following: turning the key to the starting position, pressing the starting button, issuing a voice instruction to start the vehicle, and executing a gesture to start the vehicle.
  • the acquiring the face image of the current occupant and the first target face information includes: in response to detecting that the current occupant starts a maneuvering behavior of the vehicle, and the gear position of the vehicle is For the preset gear, obtain the face image of the current occupant and the first target face information, wherein the preset gear is P gear (Park gear, parking gear) and/or N gear (Neutral gear) , neutral); the controlling operation of the vehicle according to the manipulation behavior of the current occupant in response to the successful matching between the face image of the current occupant and the first target face information includes: responding to the The face image of the current occupant is successfully matched with the first target face information, and the vehicle is controlled to start.
  • the face image of the current occupant is collected by a first camera installed in the cabin, and the first target face information is collected by a second camera installed outside the cabin.
  • the second camera used for swiping the face to open the door can be linked with the first camera used for occupant monitoring, and the face image of the current occupant collected by the first camera can be linked with the success obtained based on the second camera.
  • the face information of the person who unlocks the door is compared, and only when the face image of the current occupant collected by the first camera matches the face information of the person who has successfully unlocked the door obtained based on the second camera, the current occupant is
  • the control behavior of the vehicle is controlled and operated, so that multiple cameras set in the vehicle cabin are flexibly used to perform occupant identity verification and vehicle operation authority control, thereby improving the safety of the vehicle and reducing potential safety hazards.
  • the current occupant is the current driver.
  • the second camera used for swiping the face to open the door can be linked with the first camera used for driver monitoring, and the current driver collected by the first camera can be linked.
  • the face image of the person in the driver's seat is compared with the face information of the person who has successfully unlocked the door based on the second camera, and the face image of the person currently in the driver's seat collected by the first camera and the successful unlocking based on the second camera. Only when the face information of the person at the door is successfully matched will the vehicle be started, which can reduce the potential safety hazard of another person driving the vehicle after one person brushes his face to open the door.
  • the method further includes: acquiring a face image of the current driver and second target face information, wherein the second target face information indicates the latest successful start of the vehicle.
  • the face information of the person; the face image of the current driver is matched with the second target face information; in response to the failure of matching the face image of the current driver with the second target face information , and generate second prompt information, wherein the second prompt information is used to prompt illegal intrusion.
  • the current driver may represent the person currently driving the vehicle.
  • the first camera may be installed near the main driver's seat to capture the video stream of the driving area.
  • the face image of the current driver can be obtained.
  • one or more video frames in the video stream of the driving area may be used as the face image of the current driver.
  • a face region may be intercepted from one or more video frames of the video stream of the driving region to obtain a face image of the current driver.
  • the face information of the person who successfully started the vehicle last time may represent the face information of the driver who successfully started the vehicle last time.
  • the face information of the person who successfully started the vehicle for the last time may include at least one of the following: a face image of the person who successfully started the vehicle last time, the facial features of the person who successfully started the vehicle last time, and the person who successfully started the vehicle last time.
  • the second target face information may be obtained according to at least one video frame in the video stream of the driving area when the vehicle was successfully started last time.
  • At least one video frame in the video stream of the driving area when the vehicle is successfully started last time may be used as the second target face information.
  • the second target face information may include the face image of the person who successfully started the vehicle last time, and the face image of the person who successfully started the vehicle last time may include the last time the vehicle was successfully started.
  • at least one video frame in the video stream of the driving area may be used as the second target face information.
  • a face image may be intercepted from at least one video frame in the video stream of the driving area when the vehicle is successfully started last time, as the second target face information.
  • the second target face information may include the face image of the person who successfully started the vehicle last time, and the face image of the person who successfully started the vehicle last time may include the last time the vehicle was successfully started.
  • the face feature of at least one video frame in the video stream of the driving area when the vehicle is successfully started last time may be extracted as the second target face information.
  • the second target face information may include the face feature of the person who successfully started the vehicle last time
  • the face feature of the person who successfully started the vehicle last time may include the last time the vehicle was successfully started.
  • face recognition may be performed on at least one video frame in the video stream of the driving area when the vehicle is successfully started the last time to obtain the driver's identity information as the second target face information.
  • the second target face information may include the identity information of the person who successfully started the vehicle last time
  • the identity information of the person who successfully started the vehicle last time may include the information about the last successful start of the vehicle
  • the identity information of the driver is obtained by performing face recognition on at least one video frame in the video stream of the driving area.
  • the second prompt information is generated in response to the failure of matching between the current driver's face image and the second target face information, which can play a role of warning illegal intruders.
  • driver A gets out of the car temporarily after starting the car, but forgets to turn off the ignition and lock the car.
  • this The implementation method is to find out the current driver in time by comparing the face image of the current driver (for example, the face image of driver B) with the face information of the person who successfully started the vehicle last time (for example, the face information of driver A).
  • the person in the driver's seat for example, driver B
  • driver A is inconsistent with the person who successfully started the vehicle last time (for example, driver A), so that the safety of the vehicle can be improved.
  • the method further includes: generating at least one of a vehicle engine, an instrument panel, a display screen, a speaker, and a vibration module that controls the vehicle to send out the control information of the second prompt information; and/or sending the second prompt information to the owner terminal of the vehicle.
  • the matching the face image of the current driver with the second target face information includes: matching the face image of the current driver with the second target face information every preset time period.
  • the second target face information is matched.
  • the preset duration may be 10 seconds.
  • driver identification is performed at regular intervals, so that it is possible to continuously detect whether the driver has changed, reducing the safety hazard caused by changing the driver after the vehicle starts (for example, when waiting for a traffic light), thereby improving the safety of the vehicle. safety.
  • the method further includes: in response to receiving a registration management request for face information, acquiring driving status information of the vehicle; in response to determining the driving status of the vehicle according to the driving status information
  • the state belongs to a preset static state, and the registered face information of the vehicle is managed according to the registration management request of the face information.
  • a precondition for managing the registered face information of the vehicle is that the driving state information of the vehicle belongs to a preset stationary state, thereby improving driving safety.
  • the registration management request for face information may include at least one of the following: a face registration request, a request for deleting registered face information, and a request for modifying registered face information.
  • an operation interface for registration management of face information can be displayed through the vehicle.
  • the method further includes: in response to determining according to the driving state information that the driving state of the vehicle does not belong to the preset stationary state state, and generate third prompt information, wherein the third prompt information is used to prompt the driver to concentrate on driving.
  • the driving state information of the vehicle does not belong to the preset stationary state, such as when the vehicle is driving, registration management of face information is not allowed, for example, face registration is not allowed, deletion of registered faces is not allowed face information, modify the registered face information, etc., so as to improve the safety of driving.
  • the method further includes: generating at least one of a vehicle engine, an instrument panel, a display screen, a speaker, and a vibration module that controls the vehicle to send out the third prompt message. control information of the prompt information; and/or, sending the third prompt information to the owner terminal of the vehicle.
  • the third prompt information may include text information, and the text information in the third prompt information may be displayed through at least one of a vehicle engine, an instrument panel, and a display screen of the vehicle.
  • the third prompt information may include text information of "please concentrate on driving and register your face after parking".
  • the third prompt information may include animation information, and the animation information in the third prompt information may be displayed through at least one of a vehicle engine, an instrument panel, and a display screen of the vehicle.
  • the third prompt information may include voice information, and the voice information in the third prompt information may be played through a speaker of the vehicle.
  • the third prompt information may include voice information of "please concentrate on driving and register your face after parking".
  • the preset static state includes at least one of the following: the gear position of the vehicle is P gear, the gear position of the vehicle is N gear, and the vehicle speed of the vehicle is 0.
  • the preset stationary state may include: the gear position of the vehicle is P gear and the vehicle speed is 0, or the vehicle gear position is N gear and the vehicle speed is 0.
  • the method further includes: acquiring a face registration request; in response to the face information corresponding to the face registration request belonging to the registered face information, generating fourth prompt information, wherein, The fourth prompt information is used to prompt that the face information corresponding to the face registration request has been registered; one of the face information corresponding to the face registration request and the registered face information is installed in the car.
  • the first camera in the cabin is captured, and the other is captured by the second camera installed outside the cabin.
  • a fourth prompt message can be generated to remind the user that the face information has been registered;
  • a fourth prompt message may be generated to remind the user that the face information has been registered.
  • the face information registered through the first camera can be associated with the face information registered through the second camera, so as to realize more flexible management of registered face information and security authentication based on face information.
  • the face information registered through the first camera can also be used for face recognition through the second camera, so that the face can be opened to open the door.
  • the face information registered through the second camera can also be used for face recognition through the first camera. recognition, so that the face recognition of the occupants can be realized.
  • the registered face information may be stored in the controller.
  • the controller may simultaneously save the face information registered through the first camera and the face information registered through the second camera.
  • the method further includes: generating at least one of a vehicle engine, an instrument panel, a display screen, a speaker, and a vibration module that controls the vehicle to send out the control information of the fourth prompt information; and/or sending the fourth prompt information to the owner terminal of the vehicle.
  • the fourth prompt information may include text information, and the text information in the fourth prompt information may be displayed through at least one of a vehicle engine, an instrument panel, and a display screen of the vehicle.
  • the fourth prompt information may include text information of "you have already registered, please do not register again".
  • the fourth prompt information may include animation information, and the animation information in the fourth prompt information may be displayed through at least one of a vehicle engine, an instrument panel, and a display screen of the vehicle.
  • the fourth prompt information may include voice information, and the voice information in the fourth prompt information may be played through a speaker of the vehicle.
  • the fourth prompt information may include voice information of "you have already registered, please do not register again".
  • the second camera installed on the B-pillar can capture the video stream outside the cabin.
  • the controller can perform face recognition according to the video stream outside the vehicle cabin, obtain the face recognition result outside the vehicle cabin, and control the door unlocking and/or control in response to the face recognition result outside the vehicle cabin being that the face recognition is successful. or open.
  • the controller may obtain the first target face according to at least one video frame in the video stream outside the vehicle cabin and/or the face recognition result outside the vehicle cabin when the main driver's seat is unmanned information.
  • the first camera installed in the cabin can capture the video stream in the cabin.
  • the controller may, in response to detecting the manipulation behavior of the current driver starting the vehicle, obtain the face image of the current driver from the video stream in the cabin, and compare the face image of the current driver with the face image of the current driver. The first target face information is matched.
  • the controller may control the vehicle to start in response to the successful matching between the current driver's face image and the first target face information.
  • the controller can match the face image of the current driver with the face information of the person who successfully started the vehicle last time every preset time period, and respond to the face image of the current driver and the The face information of the person who successfully started the vehicle last time fails to match, and second prompt information is generated, which can play a role of warning illegal intruders.
  • the present disclosure also provides a vehicle, a vehicle control device, an electronic device, a computer-readable storage medium, and a program, all of which can be used to implement any vehicle control method provided by the present disclosure, and the corresponding technical solutions and technical effects can be found in the method section The corresponding records will not be repeated.
  • FIG. 2 shows a block diagram of a vehicle provided by an embodiment of the present disclosure.
  • the vehicle includes: a first camera 21 , which is installed in the cabin and is used to collect the face image of the current occupant; a controller 22 , connected to the first camera 21 , used to obtain the The face image of the current occupant and the first target face information, the face image of the current occupant is matched with the first target face information, and the face image of the current occupant is matched with the first target face information.
  • the target face information is successfully matched, and the vehicle is controlled according to the current occupant's manipulation behavior, wherein the first target face information represents the face information of the person who successfully unlocks the door of the vehicle.
  • the controller 22 can interact with other modules through a CAN (Controller Area Network, controller 22 local area network) bus, Ethernet and other means.
  • the other modules may include at least one of a vehicle engine, an instrument panel, a display screen, a speaker, a vibration module, a body control module (Body Control Module, BCM), and the like.
  • FIG. 3 shows another block diagram of a vehicle provided by an embodiment of the present disclosure.
  • the vehicle further includes: a second camera 23 , which is connected to the controller 22 , is installed outside the vehicle cabin, and is used to collect video streams outside the vehicle cabin.
  • FIG. 4 shows a block diagram of a vehicle control apparatus provided by an embodiment of the present disclosure.
  • the vehicle control device includes: a first acquisition module 41 for acquiring the face image of the current occupant and the first target face information, wherein the first target face information indicates that the door is successfully unlocked The face information of the person; the first matching module 42 is used to match the face image of the current occupant with the first target face information; the control operation module 43 is used to respond to the current occupant's face information. The face image is successfully matched with the first target face information, and the vehicle is controlled according to the current occupant's manipulation behavior.
  • the face information of the person who successfully unlocks the vehicle door includes: the face information of the person who successfully unlocked the vehicle door last time; face information of the person.
  • control operation module 43 is configured to: in response to the successful matching between the face image of the current occupant and the first target face information, obtain the operation authority scope of the current occupant; Control and operate the vehicle according to the manipulation behavior of the current occupant within the operating authority range; and/or provide an alarm prompt for the current occupant's manipulation behavior outside the operating authority range.
  • control operation module 43 is configured to: in response to the successful matching between the face image of the current occupant and the first target face information, determine the age information of the current occupant; according to The age information of the current occupant determines the operation authority range of the current occupant.
  • control operation module 43 is configured to: in response to the successful matching between the face image of the current occupant and the first target face information, determine the time period to which the current time belongs; The operation authority range of the time period to which the current occupant belongs at the current time.
  • the first obtaining module 41 is configured to: in response to detecting that the current occupant starts the vehicle manipulation behavior, obtain the face image of the current occupant and the first target face information;
  • the control operation module 43 is configured to control the vehicle to start in response to the successful matching between the face image of the current occupant and the first target face information.
  • the apparatus further includes: a first generation module, configured to generate first prompt information in response to a failure to match the face image of the current occupant with the first target face information, Wherein, the first prompt information is used to prompt illegal intrusion.
  • the apparatus further includes: a second generating module, configured to generate at least one of a vehicle engine, an instrument panel, a display screen, a speaker, and a vibration module that controls the vehicle to emit the first Control information of prompt information; and/or, a sending module, configured to send the first prompt information to the owner terminal of the vehicle.
  • a second generating module configured to generate at least one of a vehicle engine, an instrument panel, a display screen, a speaker, and a vibration module that controls the vehicle to emit the first Control information of prompt information
  • a sending module configured to send the first prompt information to the owner terminal of the vehicle.
  • the face image of the current occupant is collected by a first camera installed in the cabin, and the first target face information is collected by a second camera installed outside the cabin.
  • the device further includes: a second acquisition module, configured to acquire a face image of the current driver and second target face information, wherein the second target face information indicates the most recent The face information of the person who successfully started the vehicle once; the second matching module is used to match the face image of the current driver with the second target face information; the third generation module is used to respond When the face image of the current driver fails to match with the second target face information, second prompt information is generated, wherein the second prompt information is used to prompt illegal intrusion.
  • a second acquisition module configured to acquire a face image of the current driver and second target face information, wherein the second target face information indicates the most recent The face information of the person who successfully started the vehicle once
  • the second matching module is used to match the face image of the current driver with the second target face information
  • the third generation module is used to respond
  • the face image of the current driver fails to match with the second target face information second prompt information is generated, wherein the second prompt information is used to prompt illegal intrusion.
  • the second matching module is configured to: match the face image of the current driver with the second target face information every preset time period.
  • the apparatus further includes: a third obtaining module, configured to obtain the driving state information of the vehicle in response to receiving a registration management request for face information; a management module, configured to respond to the It is determined according to the driving state information that the driving state of the vehicle belongs to a preset stationary state, and the registered face information of the vehicle is managed according to the registration management request of the face information.
  • the apparatus further includes: a fourth generating module, configured to generate a third Prompt information, wherein the third prompt information is used to prompt the driver to concentrate on driving.
  • the preset static state includes at least one of the following: the gear position of the vehicle is P gear, the gear position of the vehicle is N gear, and the speed of the vehicle is 0.
  • the device further includes: a fourth acquisition module, configured to acquire a face registration request; a fifth generation module, configured to respond to the face registration request corresponding to the face information belonging to the The registered face information generates fourth prompt information, wherein the fourth prompt information is used to prompt that the face information corresponding to the face registration request has been registered; the face information corresponding to the face registration request and all One item of the registered face information is collected by a first camera installed in the cabin, and the other item is collected by a second camera installed outside the cabin.
  • the vehicle by acquiring the face image of the current occupant and the first target face information, wherein the first target face information represents the face information of the person who successfully unlocked the door, the current occupant's face
  • the face image is matched with the first target face information, and in response to the successful matching between the face image of the current occupant and the first target face information, the vehicle is adjusted according to the manipulation behavior of the current occupant.
  • the control operation is performed, whereby the vehicle is controlled and operated according to the manipulation behavior of the current occupant only when the current occupant is successfully matched with the person who successfully unlocks the door, thereby improving the safety of the vehicle and reducing potential safety hazards.
  • the functions or modules included in the apparatus provided in the embodiments of the present disclosure may be used to execute the methods described in the above method embodiments, and the specific implementation and technical effects may refer to the above method embodiments. It is concise and will not be repeated here.
  • Embodiments of the present disclosure further provide a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the foregoing method is implemented.
  • the computer-readable storage medium may be a non-volatile computer-readable storage medium, or may be a volatile computer-readable storage medium.
  • Embodiments of the present disclosure further provide a computer program, including computer-readable codes, when the computer-readable codes are executed in an electronic device, the processor in the electronic device executes the above method.
  • Embodiments of the present disclosure further provide another computer program product for storing computer-readable instructions, which, when executed, cause the computer to execute the operations of the vehicle control method provided by any of the foregoing embodiments.
  • Embodiments of the present disclosure further provide an electronic device, including: one or more processors; a memory for storing executable instructions; wherein the one or more processors are configured to invoke executable instructions stored in the memory instruction to execute the above method.
  • the electronic device may be provided as a terminal, server or other form of device.
  • the electronic device may be a domain controller, a controller, a vehicle machine or a processor in the cabin, and may also be a device host in a DMS or an OMS for performing data processing operations such as images.
  • FIG. 5 shows a block diagram of an electronic device 800 provided by an embodiment of the present disclosure.
  • electronic device 800 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, fitness device, personal digital assistant, etc. terminal.
  • electronic device 800 may include one or more of the following components: processing component 802, memory 804, power supply component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814 , and the communication component 816 .
  • the processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations.
  • the processing component 802 can include one or more processors 820 to execute instructions to perform all or some of the steps of the methods described above.
  • processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components.
  • processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.
  • Memory 804 is configured to store various types of data to support operation at electronic device 800 . Examples of such data include instructions for any application or method operating on electronic device 800, contact data, phonebook data, messages, pictures, videos, and the like. Memory 804 may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read only memory
  • EPROM erasable Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Magnetic or Optical Disk Magnetic Disk
  • Power supply assembly 806 provides power to various components of electronic device 800 .
  • Power supply components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 800 .
  • Multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user.
  • the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user.
  • the touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe action.
  • the multimedia component 808 includes a front-facing camera and/or a rear-facing camera. When the electronic device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each of the front and rear cameras can be a fixed optical lens system or have focal length and optical zoom capability.
  • Audio component 810 is configured to output and/or input audio signals.
  • audio component 810 includes a microphone (MIC) that is configured to receive external audio signals when electronic device 800 is in operating modes, such as calling mode, recording mode, and voice recognition mode.
  • the received audio signal may be further stored in memory 804 or transmitted via communication component 816 .
  • audio component 810 also includes a speaker for outputting audio signals.
  • the I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to: home button, volume buttons, start button, and lock button.
  • Sensor assembly 814 includes one or more sensors for providing status assessment of various aspects of electronic device 800 .
  • the sensor assembly 814 can detect the on/off state of the electronic device 800, the relative positioning of the components, such as the display and the keypad of the electronic device 800, the sensor assembly 814 can also detect the electronic device 800 or one of the electronic device 800 Changes in the position of components, presence or absence of user contact with the electronic device 800 , orientation or acceleration/deceleration of the electronic device 800 and changes in the temperature of the electronic device 800 .
  • Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact.
  • Sensor assembly 814 may also include a light sensor, such as a complementary metal oxide semiconductor (CMOS) or charge coupled device (CCD) image sensor, for use in imaging applications.
  • CMOS complementary metal oxide semiconductor
  • CCD charge coupled device
  • the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • Communication component 816 is configured to facilitate wired or wireless communication between electronic device 800 and other devices.
  • the electronic device 800 can access a wireless network based on communication standards, such as wireless network (Wi-Fi), second generation mobile communication technology (2G), third generation mobile communication technology (3G), fourth generation mobile communication technology (4G) )/Long Term Evolution (LTE) of Universal Mobile Communications Technology, Fifth Generation Mobile Communications Technology (5G), or a combination thereof.
  • the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication.
  • the NFC module may be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • electronic device 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmed gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation is used to perform the above method.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGA field programmable A programmed gate array
  • controller microcontroller, microprocessor or other electronic component implementation is used to perform the above method.
  • a non-volatile computer-readable storage medium such as a memory 804 comprising computer program instructions executable by the processor 820 of the electronic device 800 to perform the above method is also provided.
  • the present disclosure may be a system, method and/or computer program product.
  • the computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the present disclosure.
  • a computer-readable storage medium may be a tangible device that can hold and store instructions for use by the instruction execution device.
  • the computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing.
  • Non-exhaustive list of computer readable storage media include: portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM) or flash memory), static random access memory (SRAM), portable compact disk read only memory (CD-ROM), digital versatile disk (DVD), memory sticks, floppy disks, mechanically coded devices, such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above.
  • RAM random access memory
  • ROM read only memory
  • EPROM erasable programmable read only memory
  • flash memory static random access memory
  • SRAM static random access memory
  • CD-ROM compact disk read only memory
  • DVD digital versatile disk
  • memory sticks floppy disks
  • mechanically coded devices such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above.
  • Computer-readable storage media are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (eg, light pulses through fiber optic cables), or through electrical wires transmitted electrical signals.
  • the computer readable program instructions described herein may be downloaded to various computing/processing devices from a computer readable storage medium, or to an external computer or external storage device over a network such as the Internet, a local area network, a wide area network, and/or a wireless network.
  • the network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers.
  • a network adapter card or network interface in each computing/processing device receives computer-readable program instructions from a network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .
  • Computer program instructions for carrying out operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or instructions in one or more programming languages.
  • Source or object code written in any combination, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as the "C" language or similar programming languages.
  • the computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement.
  • the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through the Internet connect).
  • LAN local area network
  • WAN wide area network
  • custom electronic circuits such as programmable logic circuits, field programmable gate arrays (FPGAs), or programmable logic arrays (PLAs) can be personalized by utilizing state information of computer readable program instructions.
  • Computer readable program instructions are executed to implement various aspects of the present disclosure.
  • These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer or other programmable data processing apparatus to produce a machine that causes the instructions when executed by the processor of the computer or other programmable data processing apparatus , resulting in means for implementing the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.
  • These computer readable program instructions can also be stored in a computer readable storage medium, these instructions cause a computer, programmable data processing apparatus and/or other equipment to operate in a specific manner, so that the computer readable medium on which the instructions are stored includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.
  • Computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other equipment to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other equipment to produce a computer-implemented process , thereby causing instructions executing on a computer, other programmable data processing apparatus, or other device to implement the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more functions for implementing the specified logical function(s) executable instructions.
  • the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions.
  • the computer program product can be specifically implemented by hardware, software or a combination thereof.
  • the computer program product is embodied as a computer storage medium, and in another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK), etc. Wait.
  • a software development kit Software Development Kit, SDK

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Lock And Its Accessories (AREA)

Abstract

L'invention concerne un procédé et un appareil de commande de véhicule, un dispositif électronique, un support de stockage et un véhicule. Le procédé consiste à : obtenir une image de visage d'un occupant actuel et des premières informations de visage cible, les premières informations de visage cible indiquant des informations de visage d'une personne qui déverrouille avec succès une portière de véhicule (S11); mettre en correspondance l'image de visage de l'occupant actuel avec les premières informations de visage cible (S12); et en réponse à une correspondance réussie entre l'image de visage de l'occupant actuel et les premières informations de visage cible, réaliser une opération de commande sur le véhicule en fonction d'un comportement de commande de l'occupant actuel (S13).
PCT/CN2021/078679 2020-09-03 2021-03-02 Procédé et appareil de commande de véhicule, dispositif électronique, support de stockage et véhicule WO2022048119A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010917459.3A CN112037380B (zh) 2020-09-03 2020-09-03 车辆控制方法及装置、电子设备、存储介质和车辆
CN202010917459.3 2020-09-03

Publications (1)

Publication Number Publication Date
WO2022048119A1 true WO2022048119A1 (fr) 2022-03-10

Family

ID=73592292

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/078679 WO2022048119A1 (fr) 2020-09-03 2021-03-02 Procédé et appareil de commande de véhicule, dispositif électronique, support de stockage et véhicule

Country Status (2)

Country Link
CN (1) CN112037380B (fr)
WO (1) WO2022048119A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114724122A (zh) * 2022-03-29 2022-07-08 北京卓视智通科技有限责任公司 一种目标追踪方法、装置、电子设备及存储介质
CN115257630A (zh) * 2022-08-19 2022-11-01 中国第一汽车股份有限公司 车辆控制方法、装置和车辆
CN115431919A (zh) * 2022-08-31 2022-12-06 中国第一汽车股份有限公司 一种控制车辆的方法、装置、电子设备及存储介质
CN115520201A (zh) * 2022-10-26 2022-12-27 深圳曦华科技有限公司 车辆主驾驶位功能动态响应方法及相关装置
CN117697248A (zh) * 2023-12-27 2024-03-15 广东粤海富海投资发展有限公司 电焊机智慧管理系统

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112037380B (zh) * 2020-09-03 2022-06-24 上海商汤临港智能科技有限公司 车辆控制方法及装置、电子设备、存储介质和车辆
CN114633720B (zh) * 2020-12-15 2023-08-18 博泰车联网科技(上海)股份有限公司 智能开启后备箱的方法、装置、存储介质及车辆
CN114655160A (zh) * 2021-01-28 2022-06-24 北京新能源汽车股份有限公司 一种控制车辆启动的方法及装置
CN113090134B (zh) * 2021-05-07 2022-07-12 广东金力变速科技股份有限公司 安全锁车的方法
CN113742688A (zh) * 2021-08-31 2021-12-03 广州朗国电子科技股份有限公司 一种解锁权限处理方法及系统
CN114312666A (zh) * 2021-11-22 2022-04-12 江铃汽车股份有限公司 基于人脸识别的车辆控制方法、装置、存储介质及设备
CN114333119A (zh) * 2021-12-31 2022-04-12 上海商汤临港智能科技有限公司 车辆解锁方法、管理方法、终端、系统、设备及存储介质
CN114619993B (zh) * 2022-03-16 2023-06-16 上海齐感电子信息科技有限公司 基于人脸识别汽车控制方法及其系统、设备及存储介质
CN115098715A (zh) * 2022-06-24 2022-09-23 重庆长安汽车股份有限公司 一种香氛匹配方法、系统、设备、介质及汽车
CN115324444B (zh) * 2022-08-15 2024-06-21 长城汽车股份有限公司 一种车盖控制方法、装置、车载终端及存储介质
CN115393990A (zh) * 2022-08-30 2022-11-25 上汽通用五菱汽车股份有限公司 车辆解锁方法、装置、设备以及存储介质

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103693012A (zh) * 2013-12-23 2014-04-02 杭州电子科技大学 一种汽车防盗系统
US20150009010A1 (en) * 2013-07-03 2015-01-08 Magna Electronics Inc. Vehicle vision system with driver detection
CN105882605A (zh) * 2016-04-21 2016-08-24 东风汽车公司 一种基于人脸识别的车辆防盗系统及方法
CN106394492A (zh) * 2015-07-21 2017-02-15 百利得汽车主动安全系统（苏州）有限公司 车用动态人脸识别安全控制系统及其控制方法
CN108082124A (zh) * 2017-12-18 2018-05-29 奇瑞汽车股份有限公司 一种利用生物识别控制车辆的方法和装置
CN108327680A (zh) * 2018-01-04 2018-07-27 惠州市德赛西威汽车电子股份有限公司 一种车辆控制方法、装置及系统
CN108819900A (zh) * 2018-06-04 2018-11-16 上海商汤智能科技有限公司 车辆控制方法和系统、车载智能系统、电子设备、介质
CN108846924A (zh) * 2018-05-31 2018-11-20 上海商汤智能科技有限公司 车辆及车门解锁控制方法、装置和车门解锁系统
CN109249895A (zh) * 2017-07-13 2019-01-22 上海荆虹电子科技有限公司 一种基于生物特征识别的汽车及管理控制系统和方法
WO2020057513A1 (fr) * 2018-09-19 2020-03-26 Byton Limited Systèmes hybrides de reconnaissance d'utilisateurs pour accéder à des véhicules et les commander
CN112037380A (zh) * 2020-09-03 2020-12-04 上海商汤临港智能科技有限公司 车辆控制方法及装置、电子设备、存储介质和车辆

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102013114394A1 (de) * 2013-12-18 2015-06-18 Huf Hülsbeck & Fürst Gmbh & Co. Kg Verfahren zur Authentifizierung eines Fahrers in einem Kraftfahrzeug
CN110182172A (zh) * 2018-02-23 2019-08-30 福特环球技术公司 车辆驾驶员认证系统及方法
CN109002757A (zh) * 2018-06-04 2018-12-14 上海商汤智能科技有限公司 驾驶管理方法和系统、车载智能系统、电子设备、介质

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150009010A1 (en) * 2013-07-03 2015-01-08 Magna Electronics Inc. Vehicle vision system with driver detection
CN103693012A (zh) * 2013-12-23 2014-04-02 杭州电子科技大学 一种汽车防盗系统
CN106394492A (zh) * 2015-07-21 2017-02-15 百利得汽车主动安全系统（苏州）有限公司 车用动态人脸识别安全控制系统及其控制方法
CN105882605A (zh) * 2016-04-21 2016-08-24 东风汽车公司 一种基于人脸识别的车辆防盗系统及方法
CN109249895A (zh) * 2017-07-13 2019-01-22 上海荆虹电子科技有限公司 一种基于生物特征识别的汽车及管理控制系统和方法
CN108082124A (zh) * 2017-12-18 2018-05-29 奇瑞汽车股份有限公司 一种利用生物识别控制车辆的方法和装置
CN108327680A (zh) * 2018-01-04 2018-07-27 惠州市德赛西威汽车电子股份有限公司 一种车辆控制方法、装置及系统
CN108846924A (zh) * 2018-05-31 2018-11-20 上海商汤智能科技有限公司 车辆及车门解锁控制方法、装置和车门解锁系统
CN108819900A (zh) * 2018-06-04 2018-11-16 上海商汤智能科技有限公司 车辆控制方法和系统、车载智能系统、电子设备、介质
WO2020057513A1 (fr) * 2018-09-19 2020-03-26 Byton Limited Systèmes hybrides de reconnaissance d'utilisateurs pour accéder à des véhicules et les commander
CN112037380A (zh) * 2020-09-03 2020-12-04 上海商汤临港智能科技有限公司 车辆控制方法及装置、电子设备、存储介质和车辆

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114724122A (zh) * 2022-03-29 2022-07-08 北京卓视智通科技有限责任公司 一种目标追踪方法、装置、电子设备及存储介质
CN114724122B (zh) * 2022-03-29 2023-10-17 北京卓视智通科技有限责任公司 一种目标追踪方法、装置、电子设备及存储介质
CN115257630A (zh) * 2022-08-19 2022-11-01 中国第一汽车股份有限公司 车辆控制方法、装置和车辆
CN115431919A (zh) * 2022-08-31 2022-12-06 中国第一汽车股份有限公司 一种控制车辆的方法、装置、电子设备及存储介质
CN115520201A (zh) * 2022-10-26 2022-12-27 深圳曦华科技有限公司 车辆主驾驶位功能动态响应方法及相关装置
CN117697248A (zh) * 2023-12-27 2024-03-15 广东粤海富海投资发展有限公司 电焊机智慧管理系统

Also Published As

Publication number Publication date
CN112037380A (zh) 2020-12-04
CN112037380B (zh) 2022-06-24

Similar Documents

Publication Publication Date Title
WO2022048119A1 (fr) Procédé et appareil de commande de véhicule, dispositif électronique, support de stockage et véhicule
CN111332252B (zh) 车门解锁方法、装置、系统、电子设备和存储介质
CN111516640B (zh) 车门控制方法、车辆、系统、电子设备和存储介质
WO2022041670A1 (fr) Procédé et appareil de détection d'occupant dans un habitacle de véhicule, dispositif électronique et support d'enregistrement
US9807196B2 (en) Automated social network interaction system for a vehicle
WO2022041671A1 (fr) Procédé et appareil de détection d'absence des mains posées sur le volant de direction, dispositif électronique et support de stockage
CN112026790B (zh) 车载机器人的控制方法及装置、车辆、电子设备和介质
WO2023273064A1 (fr) Procédé et appareil de détection de parole d'objet, dispositif électronique et support de stockage
JP2017502410A (ja) 車載カメラ及び警報システム
WO2022041669A1 (fr) Procédé et appareil pour fournir un rappel concernant un article oublié, et dispositif et support de stockage
CN111717083B (zh) 一种车辆交互方法和一种车辆
KR20220002550A (ko) 차량의 인터랙션 방법 및 장치, 전자 기기, 기억 매체 및 차량
WO2022142331A1 (fr) Procédé de commande et appareil pour écran d'affichage monté sur véhicule, dispositif électronique et support de stockage
CN113734045B (zh) 车辆控制系统和车辆控制方法
CN113488043B (zh) 乘员说话检测方法及装置、电子设备和存储介质
EP3471067A1 (fr) Système et procédé de sécurité
CN114407630A (zh) 车门控制方法及装置、电子设备和存储介质
WO2023273060A1 (fr) Procédé et appareil d'identification d'action dangereuse, dispositif électronique et support de stockage
CN107139925A (zh) 车辆起步控制方法及装置、车辆、存储介质
CN114332941A (zh) 基于乘车对象检测的报警提示方法、装置及电子设备
CN114170586A (zh) 安全提示方法及装置、电子设备和存储介质
WO2023071175A1 (fr) Procédé et appareil pour associer une personne à un objet dans un véhicule, et dispositif électronique et support de stockage
CN113911054A (zh) 车辆个性化配置方法及装置、电子设备和存储介质
JP7410796B2 (ja) 車両制御システム、及び車両制御方法
CN113313857A (zh) 车门控制方法、装置及介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21863190

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21863190

Country of ref document: EP

Kind code of ref document: A1