CN111516640A - Vehicle door control method, vehicle, system, electronic device, and storage medium - Google Patents

Vehicle door control method, vehicle, system, electronic device, and storage medium Download PDF

Info

Publication number
CN111516640A
CN111516640A CN202010334140.8A CN202010334140A CN111516640A CN 111516640 A CN111516640 A CN 111516640A CN 202010334140 A CN202010334140 A CN 202010334140A CN 111516640 A CN111516640 A CN 111516640A
Authority
CN
China
Prior art keywords
vehicle
control unit
micro control
processing chip
video processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010334140.8A
Other languages
Chinese (zh)
Other versions
CN111516640B (en
Inventor
周群艳
黎建平
黄程
曾珊优
李轲
许亮
张宣彪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Sensetime Lingang Intelligent Technology Co Ltd
Original Assignee
Shanghai Sensetime Lingang Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Sensetime Lingang Intelligent Technology Co Ltd filed Critical Shanghai Sensetime Lingang Intelligent Technology Co Ltd
Priority to CN202010334140.8A priority Critical patent/CN111516640B/en
Publication of CN111516640A publication Critical patent/CN111516640A/en
Priority to KR1020217038721A priority patent/KR20220002519A/en
Priority to JP2021556981A priority patent/JP2022533885A/en
Priority to PCT/CN2020/134304 priority patent/WO2021212860A1/en
Application granted granted Critical
Publication of CN111516640B publication Critical patent/CN111516640B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
    • B60R25/01—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles operating on vehicle systems or fittings, e.g. on doors, seats or windscreens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
    • B60R25/20—Means to switch the anti-theft system on or off
    • B60R25/25—Means to switch the anti-theft system on or off using biometry
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3231—Monitoring the presence, absence or movement of users
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Mechanical Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurology (AREA)
  • Artificial Intelligence (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Lock And Its Accessories (AREA)
  • Power-Operated Mechanisms For Wings (AREA)

Abstract

The present disclosure relates to a vehicle door control method, a vehicle, a system, an electronic apparatus, and a storage medium. The method is applied to a vehicle, the vehicle comprises a vehicle main body, a vehicle cabin domain controller and a camera installed outside the vehicle cabin, the vehicle cabin domain controller comprises a video processing chip and a micro control unit which are connected with each other, the video processing chip is also connected with the camera, the micro control unit is also connected with the vehicle main body, and the method comprises the following steps: controlling a camera to collect video streams; the video processing chip carries out face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the cabin; the video processing chip responds to the face recognition result that the face recognition is successful, generates a vehicle door unlocking instruction and/or a vehicle door opening instruction, and sends the vehicle door unlocking instruction and/or the vehicle door opening instruction to the micro control unit; and the micro control unit controls the vehicle body to unlock and/or open the vehicle door according to the vehicle door unlocking instruction and/or the vehicle door opening instruction.

Description

Vehicle door control method, vehicle, system, electronic device, and storage medium
Technical Field
The present disclosure relates to the field of vehicle technologies, and in particular, to a vehicle door control method, a vehicle, a system, an electronic device, and a storage medium.
Background
The traditional car key has the defects of easy loss, easy damage, low door opening efficiency and low safety. At present, there is a PEPS (Passive Entry Passive Start) system, which works according to the following principle: 1. when a car button or a sliding door handle is pressed, the car receives an ignition signal or an unlocking signal and sends the signal to a low-frequency antenna; 2. the low-frequency antenna can send out a low-frequency trigger signal to a vehicle key after receiving an ignition signal or an unlocking signal; 3. after receiving the low-frequency trigger signal, the vehicle key sends out a high-frequency unlocking signal; 4. and the high-frequency receiver receives the high-frequency unlocking signal, and the whole vehicle completes unlocking or ignition. The disadvantage of this approach is that the vehicle key must be carried with it and cannot be unlocked properly if the vehicle key is low or dead.
Disclosure of Invention
The present disclosure provides a vehicle door control technical scheme.
According to one aspect of the present disclosure, a vehicle door control method is provided, where the method is applied to a vehicle, the vehicle includes a vehicle main body, a vehicle cabin domain controller and a camera installed outside a vehicle cabin, the vehicle cabin domain controller includes a video processing chip and a micro control unit, the video processing chip is further connected to the camera, the micro control unit is further connected to the vehicle main body, and the method includes:
controlling the camera to collect video stream;
the video processing chip performs face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the cabin;
the video processing chip responds to the fact that the face recognition result is that the face recognition is successful, generates a vehicle door unlocking instruction and/or a vehicle door opening instruction, and sends the vehicle door unlocking instruction and/or the vehicle door opening instruction to the micro control unit;
and the micro control unit controls the vehicle body to unlock and/or open the vehicle door according to the vehicle door unlocking instruction and/or the vehicle door opening instruction.
In the embodiment of the disclosure, the camera is controlled to collect a video stream, the video processing chip performs face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the vehicle cabin, and at least one door of the vehicle is controlled to be unlocked and/or opened in response to the face recognition result indicating that the face recognition is successful, so that the vehicle door can be opened by brushing the face.
In one possible implementation form of the method,
the video processing chip includes: a neural network processing unit storing a plurality of neural network models;
the video processing chip performs face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the cabin, and the face recognition result comprises the following steps: the video processing chip runs at least one of the plurality of neural network models through the neural network processing unit to perform face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the cabin.
In this implementation, the neural network processing unit is used to perform face recognition on at least one image in the video stream, so that the speed and accuracy of face recognition can be improved.
In one possible implementation form of the method,
the vehicle main body includes: the vehicle body control module is connected with the micro control unit;
the little the control unit according to door unblock instruction and/or the door opening instruction, control the car owner body unblock door and/or open the door, include: the micro control unit sends the vehicle door unlocking instruction and/or the vehicle door opening instruction to the vehicle body control module through a controller local area network bus; and the vehicle body control module unlocks and/or opens the vehicle door according to the vehicle door unlocking instruction and/or the vehicle door opening instruction.
In this implementation, the micro-control unit may control the body control module based on at least one of CAN and CAN-FD (Controller Area network with Flexible Data-rate).
In one possible implementation form of the method,
the vehicle further includes: the micro switch is connected with the micro control unit;
the controlling the camera to collect the video stream includes: the micro control unit responds to the touch of the micro switch and wakes up the video processing chip in a dormant state; and the video processing chip after awakening controls the camera to acquire the video stream.
In this implementation, before the micro switch is touched, the video processing chip may be in a sleep state to keep operating with low power consumption, so that the power consumption of the operation in the face-brushing and door-opening manner can be reduced.
In one possible implementation form of the method,
the vehicle further includes: a distance sensor connected with the micro control unit;
the controlling the camera to collect the video stream includes: the micro control unit controls the distance sensor to continuously acquire the distance between an object outside the cabin and the distance sensor; the micro control unit responds to the fact that the distance sensor detects that a person approaches the vehicle and wakes up the video processing chip in a dormant state; and the video processing chip after awakening controls the camera to acquire the video stream.
In this implementation, the video processing chip may be in a sleep state to maintain low power consumption operation before detecting that a person approaches the vehicle, so that operation power consumption in a face-brushing and door-opening manner can be reduced.
In one possible implementation, the distance sensor includes: and the infrared distance measuring sensor is connected with the micro control unit.
The power consumption of the infrared ranging sensor is low, typically in the uA class, while the power consumption of the ultrasonic radar is high, typically in the mA class. Therefore, the infrared distance measuring sensor can greatly reduce power consumption compared to the ultrasonic radar. Compared with a bluetooth awakening mode, the example adopts the infrared ranging sensor to acquire the distance between the object outside the cabin and the infrared ranging sensor so as to awaken the video processing chip, so that a user does not need to carry a mobile terminal (such as a mobile phone and the like) with a bluetooth function, and the user does not need to confirm the mobile terminal with the bluetooth function, and therefore the user experience can be improved. Meanwhile, the infrared distance measuring sensor also has higher distance measuring precision.
In one possible implementation, the micro control unit controls the distance sensor to continuously obtain the distance between the object outside the cabin and the distance sensor, and the method includes:
and the micro control unit controls the distance sensor to continuously acquire the distance between an object outside the cabin and the distance sensor when the vehicle is in a dormant state or in a dormant state and the door is not unlocked.
According to the implementation mode, the power consumption of the mode of brushing the face and opening the vehicle door can be further reduced.
In one possible implementation, the micro control unit wakes up the video processing chip in a sleep state in response to the distance sensor detecting that a person approaches the vehicle, including:
the micro control unit responds to the gradual reduction of the distance, and the duration of the distance which is less than or equal to a first distance threshold value reaches a first time threshold value, and wakes up the video processing chip in a dormant state;
and/or the presence of a gas in the gas,
and the micro control unit responds to the gradual reduction of the distance, and awakens the video processing chip in the dormant state when the distance maintains a fixed duration to reach a second duration threshold in the process that the distance is less than or equal to the second distance threshold.
According to this embodiment, the possibility of unlocking the door when the user opens the door unintentionally can be reduced, and the safety of the vehicle can be improved.
In one possible implementation form of the method,
the micro control unit awakens the video processing chip in a dormant state in response to detecting that a person approaches the vehicle, including: the micro control unit responds to the gradual reduction of the distance, and the distance is smaller than or equal to a third distance threshold value, and awakens the video processing chip in a dormant state;
the video processing chip after awakening controls the camera to collect video streams, and the method comprises the following steps: and the video processing chip after awakening controls the camera to acquire the video stream in response to the fact that the duration of the distance smaller than or equal to a fourth distance threshold reaches a third time threshold, wherein the fourth distance threshold is smaller than the third distance threshold.
In this implementation, before a condition that "the distance is gradually decreased and the distance is less than or equal to the third distance threshold" is satisfied, the video processing chip may be in a sleep state to keep operating with low power consumption, so that the power consumption of the operation in the face-brushing and door-opening mode can be reduced; when the condition that the distance is gradually reduced and is less than or equal to the third distance threshold is met, the micro control unit wakes up the video processing chip, so that the video processing chip can be in a working state before a user arrives at the vehicle door, the duration of the distance is less than or equal to the fourth distance threshold reaches the third time threshold, namely when the user arrives at the vehicle door, the camera can immediately perform face recognition vehicle door opening through the awakened video processing chip after acquiring the video stream, and the user does not need to wait for the video processing chip to be awakened after the user arrives at the vehicle door, so that the face recognition efficiency can be improved, and the user experience is improved. In addition, the user does not feel in the awakening process, so that the user experience can be further improved. In this example, before the condition that "the duration of the distance less than or equal to the fourth distance threshold reaches the third duration threshold" is met, the camera may not collect a video stream, so that not only power consumption can be reduced, but also the possibility of mistakenly unlocking the vehicle door can be reduced, and thus the safety of unlocking the vehicle door can be improved. Therefore, the example can meet the requirements of low-power-consumption operation and rapid door opening, and a solution capable of well balancing power consumption saving, user experience, safety and the like of the video processing chip is provided.
In one possible implementation form of the method,
the micro control unit awakens the video processing chip in a dormant state in response to detecting that a person approaches the vehicle, including: the micro control unit responds to the gradual reduction of the distance, and the distance is smaller than or equal to a fifth distance threshold value, and awakens the video processing chip in a dormant state;
the video processing chip after awakening controls the camera to collect video streams, and the method comprises the following steps: and the video processing chip after awakening responds to the fact that the distance is maintained to be fixed for a duration time reaching a fourth time threshold value in the process that the distance is smaller than or equal to a sixth distance threshold value, and controls the camera to acquire the video stream, wherein the sixth distance threshold value is smaller than the fifth distance threshold value.
Before the condition that the distance is gradually reduced and is less than or equal to the fifth distance threshold value is met, the video processing chip can be in a dormant state to keep low-power-consumption operation, so that the operation power consumption of a face-brushing and door-opening mode can be reduced; when the condition that the distance is gradually reduced and is smaller than or equal to the fifth distance threshold value is met, the video processing chip is awakened, so that the video processing chip can be in a working state before a user arrives at the vehicle door, the distance is maintained for a fixed duration to reach the fourth time threshold value in the process that the distance is smaller than or equal to the sixth distance threshold value, namely when the user arrives at the vehicle door, the camera can immediately perform face recognition on the vehicle door through the awakened video processing chip after acquiring the video stream, the user does not need to wait for the video processing chip to be awakened after the user arrives at the vehicle door, the face recognition efficiency can be improved, and the user experience is improved. In addition, the user does not feel in the awakening process, so that the user experience can be further improved. In this example, before a condition that "the duration of the distance maintaining fixation reaches a fourth time threshold value in the process that the distance is less than or equal to the sixth distance threshold value" is satisfied, the camera may not collect a video stream, so that not only power consumption can be reduced, but also the possibility of mistakenly unlocking the vehicle door can be reduced, and thus the safety of unlocking the vehicle door can be improved. Therefore, the example can meet the requirements of low-power-consumption operation and rapid door opening, and a solution capable of well balancing power consumption saving, user experience, safety and the like of the video processing chip is provided.
In one possible implementation manner, the vehicle main body further includes a power supply circuit, the power supply circuit is respectively connected to the video processing chip and the micro control unit, the vehicle cabin area controller further includes a capacitor circuit, the capacitor circuit is respectively connected to the video processing chip and the micro control unit, and the method further includes:
the micro control unit responds to the abnormal power failure state of the power supply circuit and controls the capacitor circuit to discharge so as to supply power to the video processing chip;
and the video processing chip stores at least part of video data from the camera acquired before the power supply circuit is in an abnormal power-down state into a memory in the discharging process of the capacitor circuit.
In the implementation mode, the micro control unit responds to that a power supply circuit of a vehicle is in an abnormal power failure state, the capacitive circuit of the vehicle cabin area controller is controlled to discharge, so that power is supplied to the video processing chip, in the discharging process of the capacitive circuit, the video processing chip stores at least part of video data from the camera, which is acquired before the power supply circuit is in the abnormal power failure state, in a storage, therefore, when the power supply circuit is in the abnormal power failure state, the capacitive circuit can be used for providing electric quantity required by video data storage for the video processing chip, and the video data in the time often plays an important role in abnormal power failure analysis.
In one possible implementation, the method further comprises at least one of:
the micro control unit controls the capacitor circuit to charge or not to discharge in response to monitoring that the power supply circuit is in a normal power-off state;
and the micro control unit controls the capacitor circuit not to be charged in the system starting process of the vehicle and controls the capacitor circuit to be charged after the system is started.
In the implementation mode, the capacitor circuit is controlled not to discharge in response to the fact that the power supply circuit is monitored to be in a normal power-off state, so that the system can rapidly enter a sleep state, and the system cannot delay sleep due to the fact that the capacitor circuit discharges; by controlling the capacitor circuit not to be charged during the system start-up of the vehicle, voltage fluctuation and/or system start-up time extension caused by charging the capacitor circuit are avoided. After the system is started, the capacitor circuit is controlled to be charged, so that preparation can be made for abnormal power failure.
In one possible implementation form of the method,
the capacitor circuit comprises a first switch circuit, a second switch circuit, a first capacitor and a second capacitor, wherein the capacity of the first capacitor is greater than that of the second capacitor, the first end of the first switch circuit is connected with the power supply circuit, the enable end of the first switch circuit is connected with the micro control unit, the second end of the first switch circuit is connected with the first end of the second switch circuit, one end of the first capacitor is grounded, the other end of the first capacitor is connected with the second end of the first switch circuit and the first end of the second switch circuit, the enable end of the second switch circuit is connected with the micro control unit, one end of the second capacitor is grounded, the other end of the second capacitor is connected with the enable end of the second switch circuit, and the second end of the second switch circuit is connected with the video processing chip;
the micro control unit controls the capacitor circuit to discharge in response to monitoring that the power supply circuit is in an abnormal power-down state, and the method comprises the following steps: the micro control unit responds to the condition that the power supply circuit is monitored to be in an abnormal power failure state, and keeps an enabling end of a first switch circuit and an enabling end of a second switch circuit in the capacitor circuit in an effective state; and/or the micro control unit controls the capacitor circuit to be charged or not to be discharged in response to monitoring that the power supply circuit is in a normal power-off state, and the method comprises the following steps: the micro control unit controls an enabling end of a first switch circuit and an enabling end of a second switch circuit in the capacitor circuit to be in an invalid state in response to monitoring that the power supply circuit is in a normal power-off state; and/or the micro control unit controls the capacitor circuit not to be charged in the system starting process of the vehicle, and controls the capacitor circuit to be charged after the system is started, and the method comprises the following steps: the micro control unit keeps an enabling end of a first switch circuit and an enabling end of a second switch circuit in the capacitor circuit in an invalid state in the system starting process of the vehicle, and controls the enabling end of the first switch circuit and the enabling end of the second switch circuit to be in an valid state after the system starting is completed.
In the implementation mode, the micro control unit responds to the situation that the power supply circuit is monitored to be in an abnormal power-down state, the enabling end of the first switch circuit and the enabling end of the second switch circuit in the capacitor circuit are kept in an effective state, so that the capacitor circuit can be controlled to discharge, power can be supplied to the video processing chip, and the video processing chip can store at least part of video data from the camera, which are acquired before the power supply circuit is in the abnormal power-down state. The micro control unit responds to the situation that the power supply circuit is monitored to be in a normal power-off state, the enable end of the first switch circuit and the enable end of the second switch circuit are controlled to be in an invalid state, the first capacitor and the second capacitor are enabled not to be charged or discharged, and therefore the system can be enabled to enter a sleep state quickly, and the system cannot be delayed to sleep due to the fact that the first capacitor and the second capacitor are discharged. The micro control unit keeps the enabling end of the first switch circuit and the enabling end of the second switch circuit in an invalid state during the system starting process of the vehicle, namely, the first capacitor and the second capacitor are not charged during the system starting process, so that voltage fluctuation and/or system starting time extension caused by charging the first capacitor and the second capacitor are avoided.
According to one aspect of the present disclosure, a vehicle is provided, the vehicle including a vehicle main body, a vehicle cabin domain controller and a camera mounted outside the vehicle cabin, the vehicle cabin domain controller including a video processing chip and a micro control unit connected to each other, the video processing chip being further connected to the camera, the micro control unit being further connected to the vehicle main body;
the video processing chip is used for: controlling the camera to collect video stream; performing face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the cabin; responding to the face recognition result that the face recognition is successful, generating a vehicle door unlocking instruction and/or a vehicle door opening instruction, and sending the vehicle door unlocking instruction and/or the vehicle door opening instruction to the micro control unit;
the micro control unit is used for: and controlling the vehicle body to unlock and/or open the vehicle door according to the vehicle door unlocking instruction and/or the vehicle door opening instruction.
In one possible implementation form of the method,
the video processing chip includes: a neural network processing unit storing a plurality of neural network models;
the video processing chip is used for: and running at least one neural network model in the plurality of neural network models through the neural network processing unit to perform face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the cabin.
In one possible implementation form of the method,
the vehicle main body includes: the vehicle body control module is connected with the micro control unit;
the micro control unit is used for: sending the vehicle door unlocking instruction and/or the vehicle door opening instruction to the vehicle body control module;
the vehicle body control module is used for: and the vehicle door unlocking command and/or the vehicle door opening command unlock and/or open the vehicle door.
In one possible implementation form of the method,
the vehicle further includes: the micro switch is connected with the micro control unit;
the micro control unit is used for: responding to the micro switch being touched, waking up the video processing chip in a dormant state;
the video processing chip is used for: and after awakening, controlling the camera to acquire the video stream.
In one possible implementation form of the method,
the vehicle further includes: a distance sensor connected with the micro control unit;
the micro control unit is used for: controlling the distance sensor to continuously acquire the distance between an object outside the vehicle cabin and the distance sensor; waking up the video processing chip in a sleep state in response to the distance sensor detecting that a person is approaching the vehicle;
the video processing chip is used for: and after awakening, controlling the camera to acquire the video stream.
In one possible implementation, the distance sensor includes: and the infrared distance measuring sensor is connected with the micro control unit.
In one possible implementation, the micro control unit is configured to:
and when the vehicle is in a dormant state or in a dormant state and the door of the vehicle is not unlocked, controlling the distance sensor to continuously acquire the distance between an object outside the vehicle cabin and the distance sensor.
In one possible implementation, the micro control unit is configured to:
responding to the gradual reduction of the distance and the fact that the duration of the distance which is smaller than or equal to a first distance threshold reaches a first time threshold, and waking up the video processing chip in a dormant state;
and/or the presence of a gas in the gas,
responding to the gradual reduction of the distance, and awakening the video processing chip in the dormant state when the distance is maintained to be fixed for a duration reaching a second duration threshold in the process that the distance is smaller than or equal to the second distance threshold.
In one possible implementation form of the method,
the micro control unit is used for: responding to the gradual reduction of the distance, and the distance is smaller than or equal to a third distance threshold value, and waking up the video processing chip in a dormant state;
the video processing chip is used for: after awakening, in response to that the duration of the distance smaller than or equal to a fourth distance threshold reaches a third duration threshold, controlling the camera to acquire a video stream, wherein the fourth distance threshold is smaller than the third distance threshold.
In one possible implementation form of the method,
the micro control unit is used for: responding to the gradual reduction of the distance, and the distance is smaller than or equal to a fifth distance threshold value, and waking up the video processing chip in a sleep state;
the video processing chip is used for: after awakening, in response to the fact that the duration of the distance maintaining fixation reaches a fourth time threshold in the process that the distance is smaller than or equal to a sixth distance threshold, controlling the camera to collect the video stream, wherein the sixth distance threshold is smaller than the fifth distance threshold.
In a possible implementation manner, the vehicle main body further includes a power supply circuit, the power supply circuit is respectively connected with the video processing chip and the micro control unit, the vehicle cabin area controller further includes a capacitor circuit, and the capacitor circuit is respectively connected with the video processing chip and the micro control unit;
the micro control unit is further configured to: in response to the power supply circuit being in an abnormal power-down state, controlling the capacitor circuit to discharge so as to supply power to the video processing chip;
the video processing chip is further configured to: and storing at least part of video data from the camera acquired before the power supply circuit is in an abnormal power-down state into a memory in the discharging process of the capacitor circuit.
In one possible implementation, the micro control unit is further configured to at least one of:
controlling the capacitor circuit to charge or not discharge in response to monitoring that the power supply circuit is in a normal power-off state;
and in the process of starting the system of the vehicle, controlling the capacitor circuit not to be charged, and controlling the capacitor circuit to be charged after the system is started.
In one possible implementation form of the method,
the capacitor circuit comprises a first switch circuit, a second switch circuit, a first capacitor and a second capacitor, wherein the capacity of the first capacitor is greater than that of the second capacitor, the first end of the first switch circuit is connected with the power supply circuit, the enable end of the first switch circuit is connected with the micro control unit, the second end of the first switch circuit is connected with the first end of the second switch circuit, one end of the first capacitor is grounded, the other end of the first capacitor is connected with the second end of the first switch circuit and the first end of the second switch circuit, the enable end of the second switch circuit is connected with the micro control unit, one end of the second capacitor is grounded, the other end of the second capacitor is connected with the enable end of the second switch circuit, and the second end of the second switch circuit is connected with the video processing chip;
the micro control unit is further configured to at least one of: in response to monitoring that the power supply circuit is in an abnormal power-down state, keeping an enabling end of a first switch circuit and an enabling end of a second switch circuit in the capacitor circuit in an effective state; in response to monitoring that the power supply circuit is in a normal power-down state, controlling an enabling end of a first switch circuit and an enabling end of a second switch circuit in the capacitor circuit to be in an invalid state; the method comprises the steps of keeping an enabling end of a first switch circuit and an enabling end of a second switch circuit in the capacitor circuit in an invalid state in the process of starting a system of the vehicle, and controlling the enabling ends of the first switch circuit and the second switch circuit to be in an valid state after the system is started.
According to one aspect of the disclosure, a vehicle door control system is provided, which includes a vehicle, a user terminal and a server, wherein the vehicle includes a vehicle main body, a vehicle cabin domain controller, a camera and a remote information processor, the camera and the remote information processor are installed outside a vehicle cabin, the vehicle cabin domain controller includes a video processing chip and a micro control unit which are connected with each other, the video processing chip is further connected with the camera and the remote information processor respectively, the micro control unit is further connected with the vehicle main body, and the server is connected with the remote information processor and the user terminal respectively;
the user terminal is used for registering the face image and/or the face characteristics of the user of the vehicle to the server;
the remote information processor is used for acquiring a human face image and/or human face characteristics of a user of the vehicle from the server;
the video processing chip is used for carrying out face recognition according to at least one image in the video stream acquired by the camera and the face image and/or the face characteristics of the user of the vehicle to obtain a face recognition result of an object outside the vehicle cabin, generating a vehicle door unlocking instruction and/or a vehicle door opening instruction in response to the face recognition result that the face recognition is successful, and sending the vehicle door unlocking instruction and/or the vehicle door opening instruction to the micro control unit;
and the micro control unit is used for controlling the vehicle body to unlock and/or open the vehicle door according to the vehicle door unlocking instruction and/or the vehicle door opening instruction.
According to an aspect of the present disclosure, there is provided an electronic device including: one or more processors; a memory for storing executable instructions; wherein the one or more processors are configured to invoke the memory-stored executable instructions to perform the above-described method.
According to an aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the above-described method.
In the embodiment of the disclosure, a video stream is acquired by controlling the camera, a video processing chip performs face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside a vehicle cabin, the video processing chip generates a vehicle door unlocking instruction and/or a vehicle door opening instruction in response to the face recognition result that the face recognition is successful, and sends the vehicle door unlocking instruction and/or the vehicle door opening instruction to the micro control unit, and the micro control unit controls the vehicle body to unlock a vehicle door and/or open the vehicle door according to the vehicle door unlocking instruction and/or the vehicle door opening instruction, so that the vehicle door can be opened by brushing the face.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments, which proceeds with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure.
Fig. 1 shows a flowchart of a vehicle door control method provided by an embodiment of the present disclosure.
Fig. 2 shows a schematic diagram of a distance measurement principle of an infrared distance measurement sensor in an embodiment of the present disclosure.
Fig. 3 shows a schematic diagram of a capacitor circuit provided in an embodiment of the disclosure.
Fig. 4 shows a block diagram of a vehicle door control system provided by an embodiment of the present disclosure.
FIG. 5 shows a block diagram of a vehicle provided by an embodiment of the present disclosure.
Fig. 6 illustrates a block diagram of an electronic device 800 provided by an embodiment of the disclosure.
Fig. 7 shows a block diagram of an electronic device 1900 provided by an embodiment of the disclosure.
Detailed Description
Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. In the drawings, like reference numbers can indicate functionally identical or similar elements. While the various aspects of the embodiments are presented in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.
The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.
The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality, for example, including at least one of A, B, C, and may mean including any one or more elements selected from the group consisting of A, B and C.
Furthermore, in the following detailed description, numerous specific details are set forth in order to provide a better understanding of the present disclosure. It will be understood by those skilled in the art that the present disclosure may be practiced without some of these specific details. In some instances, methods, means, elements and circuits that are well known to those skilled in the art have not been described in detail so as not to obscure the present disclosure.
Fig. 1 shows a flowchart of a vehicle door control method provided by an embodiment of the present disclosure. The execution subject of the vehicle door control method may be a vehicle door control device. For example, the door control method may be performed by an in-vehicle device or other processing device. The vehicle door control method is applied to a vehicle, the vehicle comprises a vehicle main body, a vehicle cabin domain controller and a camera installed outside a vehicle cabin, the vehicle cabin domain controller comprises a video processing chip and a Micro Control Unit (MCU) which are connected with each other, the video processing chip is further connected with the camera, and the micro control unit is further connected with the vehicle main body. In some possible implementations, the door control method may be implemented by a processor calling computer readable instructions stored in a memory. As shown in fig. 1, the door control method includes steps S11 through S14.
In step S11, the camera is controlled to capture a video stream.
In the embodiment of the present disclosure, the micro control unit may monitor the wake-up signal, and wake up the video processing chip in response to monitoring the wake-up signal, so that the video processing chip controls the camera to capture the video stream. For example, the wake-up signal may be a distance sensing signal from a distance sensor, or the wake-up signal may be a trigger action signal from a micro switch.
In one possible implementation, the vehicle further includes: the micro switch is connected with the micro control unit; the controlling the camera to collect the video stream includes: the micro control unit responds to the touch of the micro switch and wakes up the video processing chip in a dormant state; and the video processing chip after awakening controls the camera to acquire the video stream.
As an example of this implementation, the microswitch is mounted in at least one of the following positions: at least one door handle of a vehicle door, a B-pillar of the vehicle.
As an example of this implementation, the micro switch may send a trigger action signal to the micro control unit upon detection of being touched. The micro control unit may wake up the video processing chip in response to the trigger action signal.
In this implementation, before the micro switch is touched, the video processing chip may be in a sleep state to keep operating with low power consumption, so that the power consumption of the operation in the face-brushing and door-opening manner can be reduced.
In one possible implementation, the vehicle further includes: a distance sensor connected with the micro control unit; the controlling the camera to collect the video stream includes: the micro control unit controls the distance sensor to continuously acquire the distance between an object outside the cabin and the distance sensor; the micro control unit responds to the fact that the distance sensor detects that a person approaches the vehicle and wakes up the video processing chip in a dormant state; and the video processing chip after awakening controls the camera to acquire the video stream.
As an example of this implementation, the distance sensor is mounted in at least one of the following locations: a B-pillar of the vehicle, at least one door, at least one rearview mirror, and an interior of the vehicle.
In this implementation, the video processing chip may be in a sleep state to maintain low power consumption operation before detecting that a person approaches the vehicle, so that operation power consumption in a face-brushing and door-opening manner can be reduced.
As one example of this implementation, the distance sensor includes: and the infrared distance measuring sensor is connected with the micro control unit.
In this example, an infrared ranging sensor may be used as the wake-up source. The camera used for unlocking the car door by the human face is awakened by taking the infrared distance measuring sensor as an awakening source, so that the problem of inconvenience of carrying a car key or a mobile phone with the car or opening the Bluetooth is solved, and the problem of large power consumption of an ultrasonic mode can be solved. Wherein, infrared distance measuring sensor range finding is accurate, and range finding is fast, consequently can improve response speed. In addition, the infrared distance measuring sensor is low in price, is not influenced by the environment, and has high feasibility and practicability. Wherein the infrared ranging sensor may be installed at least one of: a B-pillar of the vehicle, at least one door, at least one rearview mirror. The vehicle door in the embodiment of the present disclosure may include a door for people to get in and out (e.g., a left front door, a right front door, a left rear door, and a right rear door), and may also include a trunk door of a vehicle, and the like.
Fig. 2 shows a schematic diagram of a distance measurement principle of an infrared distance measurement sensor in an embodiment of the present disclosure. In the embodiment of the present disclosure, the transmitter 211 of the infrared distance measuring sensor 21 may emit infrared light according to a predetermined frequency, and when an object 22 (e.g., a user, a pedestrian, an obstacle, etc.) outside the vehicle cabin approaches the infrared distance measuring sensor 21, the infrared light is reflected back and received by the receiver 212 of the infrared distance measuring sensor 21. From the time of propagation of the infrared light, the distance from the object 22 outside the vehicle cabin to the infrared distance measuring sensor 21 can be calculated, for example, the distance between the object 22 outside the vehicle cabin and the infrared distance measuring sensor 21 is the infrared light propagation time/2 × the speed of light. The infrared ranging sensor 21 may transmit the acquired distance to the micro control unit, and the micro control unit may store distance information according to the time of receiving the distance from the infrared ranging sensor 21, that is, the distance information stored by the micro control unit may include a corresponding relationship of the receiving time and the distance, so that, according to the distance information, the distance value acquired by the infrared ranging sensor 21 at each time may be determined.
In this example, if there is no object outside the vehicle cabin, the infrared light emitted by the emitter of the infrared ranging sensor will not be reflected back, in which case the infrared ranging sensor will not measure the distance value, or the distance value acquired by the infrared ranging sensor is empty. Under the condition that the infrared ranging sensor cannot measure the distance value or the distance value acquired by the infrared ranging sensor is empty, the infrared ranging sensor does not send distance information to the micro control unit.
The power consumption of the infrared ranging sensor is low, typically in the uA class, while the power consumption of the ultrasonic radar is high, typically in the mA class. Therefore, the infrared distance measuring sensor can greatly reduce power consumption compared to the ultrasonic radar. Compared with a bluetooth awakening mode, the example adopts the infrared ranging sensor to acquire the distance between the object outside the cabin and the infrared ranging sensor so as to awaken the video processing chip, so that a user does not need to carry a mobile terminal (such as a mobile phone and the like) with a bluetooth function, and the user does not need to confirm the mobile terminal with the bluetooth function, and therefore the user experience can be improved. Meanwhile, the infrared distance measuring sensor also has higher distance measuring precision.
As an example of this implementation, the controlling, by the micro control unit, the distance sensor to continuously obtain the distance between the object outside the cabin and the distance sensor includes: and the micro control unit controls the distance sensor to continuously acquire the distance between an object outside the cabin and the distance sensor when the vehicle is in a dormant state or in a dormant state and the door is not unlocked.
In this example, the sleep state of the vehicle may represent a state in which modules in the vehicle other than the micro control unit and the distance sensor and/or the micro switch are all asleep. When the vehicle is not in the dormant state, a driver is usually in the vehicle, so when the vehicle is not in the dormant state, the unlocking of the vehicle door can be controlled by the operation of the driver. In this example, the distance between the object outside the cabin and the distance sensor may be continuously acquired by the distance sensor only when the vehicle is in the sleeping state or in the sleeping and door-unlocked state, and the distance measurement by the distance sensor is not required when the vehicle is not in the sleeping state or in the sleeping and door-unlocked state, whereby power consumption can be reduced.
As an example of this implementation, the micro control unit waking up the video processing chip in a sleep state in response to the distance sensor detecting that a person is approaching the vehicle, includes: and the micro control unit responds to the gradual reduction of the distance, and the duration of the distance which is less than or equal to the first distance threshold reaches a first time threshold, and awakens the video processing chip in the dormant state.
In this example, the micro control unit may store the distance information and determine whether the distance gradually decreases, and if the distance gradually decreases, it may determine whether the duration of the distance less than or equal to the first distance threshold reaches a preset first duration threshold, and if so, it may determine that the door is opened intentionally, otherwise, it may determine that the door is opened unintentionally, for example, it may be the case that a pedestrian passes by, an obstacle floats, or the like. According to this example, the possibility of unlocking the door in the case where the user opens the door unintentionally can be reduced, and the safety of the vehicle can be improved.
As an example of this implementation, the micro control unit waking up the video processing chip in a sleep state in response to the distance sensor detecting that a person is approaching the vehicle, includes: and the micro control unit responds to the gradual reduction of the distance, and awakens the video processing chip in the dormant state when the distance maintains a fixed duration to reach a second duration threshold in the process that the distance is less than or equal to the second distance threshold.
In one example, the distance being maintained for a fixed duration of time to reach the second duration threshold while the distance is less than or equal to the second distance threshold may refer to the distance being maintained for the same duration of time to reach the second duration threshold while the distance is less than or equal to the second distance threshold. In another example, the duration that the distance is kept fixed during the period that the distance is less than or equal to the second distance threshold reaches the second time threshold may mean that the degree of dispersion of the distance in any time period is less than or equal to a preset value, the distances in the time period are less than or equal to the second distance threshold, and the length of the time period is greater than or equal to the second time threshold. The degree of dispersion may be measured by a standard deviation or a variance, and the standard deviation may be used as the degree of dispersion, for example.
In this example, the mcu may store the distance information and determine whether the distance gradually decreases, and if the distance gradually decreases, it may determine whether the duration of the distance maintaining the fixed distance during the period of the distance being less than or equal to the second distance threshold reaches the second duration threshold, if so, it may determine to open the door intentionally, otherwise, it may determine to open the door unintentionally, for example, it may be the case that a pedestrian passes by, an obstacle floats, etc. According to this example, the possibility of unlocking the door in the case where the user opens the door unintentionally can be reduced, and the safety of the vehicle can be improved.
As an example of this implementation, the micro control unit waking up the video processing chip in a sleep state in response to detecting a person approaching the vehicle, includes: the micro control unit responds to the gradual reduction of the distance, and the distance is smaller than or equal to a third distance threshold value, and awakens the video processing chip in a dormant state; the video processing chip after awakening controls the camera to collect video streams, and the method comprises the following steps: and the video processing chip after awakening controls the camera to acquire the video stream in response to the fact that the duration of the distance smaller than or equal to a fourth distance threshold reaches a third time threshold, wherein the fourth distance threshold is smaller than the third distance threshold.
The fourth distance threshold may be a maximum allowable distance value between the user and the vehicle when performing face recognition. The third distance threshold may be determined based on the fourth distance threshold and the wake-up distance, e.g., the third distance threshold may be equal to the sum of the fourth distance threshold and the wake-up distance, or the third distance threshold may be set slightly larger than the sum of the fourth distance threshold and the wake-up distance. The wake-up distance may be equal to a product of the wake-up duration of the video processing chip and the average walking speed, and the wake-up duration of the video processing chip may represent a time length required for the video processing chip to be converted from the sleep state to the working state.
In this example, before the condition that "the distance is gradually decreased and the distance is less than or equal to the third distance threshold" is satisfied, the video processing chip may be in a sleep state to keep operating with low power consumption, so that the power consumption of the operation in the face-brushing and door-opening manner can be reduced; when the condition that the distance is gradually reduced and is less than or equal to the third distance threshold is met, the micro control unit wakes up the video processing chip, so that the video processing chip can be in a working state before a user arrives at the vehicle door, the duration of the distance is less than or equal to the fourth distance threshold reaches the third time threshold, namely when the user arrives at the vehicle door, the camera can immediately perform face recognition vehicle door opening through the awakened video processing chip after acquiring the video stream, and the user does not need to wait for the video processing chip to be awakened after the user arrives at the vehicle door, so that the face recognition efficiency can be improved, and the user experience is improved. In addition, the user does not feel in the awakening process, so that the user experience can be further improved. In this example, before the condition that "the duration of the distance less than or equal to the fourth distance threshold reaches the third duration threshold" is met, the camera may not collect a video stream, so that not only power consumption can be reduced, but also the possibility of mistakenly unlocking the vehicle door can be reduced, and thus the safety of unlocking the vehicle door can be improved. Therefore, the example can meet the requirements of low-power-consumption operation and rapid door opening, and a solution capable of well balancing power consumption saving, user experience, safety and the like of the video processing chip is provided.
As an example of this implementation, the micro control unit waking up the video processing chip in a sleep state in response to detecting a person approaching the vehicle, includes: the micro control unit responds to the gradual reduction of the distance, and the distance is smaller than or equal to a fifth distance threshold value, and awakens the video processing chip in a dormant state; the video processing chip after awakening controls the camera to collect video streams, and the method comprises the following steps: and the video processing chip after awakening responds to the fact that the distance is maintained to be fixed for a duration time reaching a fourth time threshold value in the process that the distance is smaller than or equal to a sixth distance threshold value, and controls the camera to acquire the video stream, wherein the sixth distance threshold value is smaller than the fifth distance threshold value.
The fifth distance threshold may be equal to the third distance threshold, or may not be equal to the third distance threshold; the sixth distance threshold may or may not be equal to the fourth distance threshold. The sixth distance threshold may be a maximum allowable distance value between the user and the vehicle when performing the face recognition. The fifth distance threshold may be determined based on the sixth distance threshold and the wake-up distance, e.g., the fifth distance threshold may be equal to the sum of the sixth distance threshold and the wake-up distance, or the fifth distance threshold may be set slightly larger than the sum of the sixth distance threshold and the wake-up distance.
In this example, before the condition that "the distance is gradually decreased and the distance is less than or equal to the fifth distance threshold" is satisfied, the video processing chip may be in a sleep state to keep low power consumption operation, so that the power consumption of the operation in the face-brushing and door-opening manner can be reduced; when the condition that the distance is gradually reduced and is smaller than or equal to the fifth distance threshold value is met, the video processing chip is awakened, so that the video processing chip can be in a working state before a user arrives at the vehicle door, the distance is maintained for a fixed duration to reach the fourth time threshold value in the process that the distance is smaller than or equal to the sixth distance threshold value, namely when the user arrives at the vehicle door, the camera can immediately perform face recognition on the vehicle door through the awakened video processing chip after acquiring the video stream, the user does not need to wait for the video processing chip to be awakened after the user arrives at the vehicle door, the face recognition efficiency can be improved, and the user experience is improved. In addition, the user does not feel in the awakening process, so that the user experience can be further improved. In this example, before a condition that "the duration of the distance maintaining fixation reaches a fourth time threshold value in the process that the distance is less than or equal to the sixth distance threshold value" is satisfied, the camera may not collect a video stream, so that not only power consumption can be reduced, but also the possibility of mistakenly unlocking the vehicle door can be reduced, and thus the safety of unlocking the vehicle door can be improved. Therefore, the example can meet the requirements of low-power-consumption operation and rapid door opening, and a solution capable of well balancing power consumption saving, user experience, safety and the like of the video processing chip is provided.
In the embodiment of the present disclosure, the camera may be installed outside the vehicle, and the video stream outside the cabin is captured by controlling the camera provided outside the vehicle, whereby the boarding intention of the person outside the cabin can be detected based on the video stream outside the cabin. In one possible implementation, the camera may be mounted in at least one of the following positions: a B-pillar of the vehicle, at least one door, at least one rearview mirror. For example, the camera may be mounted on the B-pillar at a distance of 130cm to 160cm from the ground, which is not limited herein. In one example, the cameras may be mounted on both the B-pillars and the trunk of the vehicle. Wherein, each B-pillar can be provided with a camera facing the boarding position of front row passengers (drivers or co-drivers) and a camera facing the boarding position of rear row passengers.
In one possible implementation, after waking up the video processing chip in a sleep state, the method further includes: and if the face image is not acquired within the preset time or the face image is not identified within the preset time, controlling the video processing chip to enter a dormant state. According to the implementation mode, the video processing chip is controlled to enter the dormant state when the face image is not collected within the preset time after the video processing chip is awakened, or the video processing chip is controlled to enter the dormant state when the face image is not identified within the preset time after the video processing chip is awakened, so that the power consumption can be reduced.
In step S12, the video processing chip performs face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the cabin.
In the embodiment of the disclosure, the camera may send the acquired video stream to the video processing chip, and the video processing chip may perform face recognition based on at least one image in the video stream to obtain a face recognition result of an object outside the cabin.
In one possible implementation, the face recognition includes face authentication; the video processing chip performs face recognition according to at least one image in the video stream, and the face recognition method comprises the following steps: and the video processing chip performs face authentication according to at least one image in the video stream and the pre-registered face features. The pre-registered facial features may include facial features of a owner and/or a borrower of the vehicle. In this implementation manner, the face authentication is used to extract the face features in the acquired image, compare the face features in the acquired image with the pre-registered face features, and determine whether the face features belong to the face features of the same person, for example, whether the face features in the acquired image belong to the face features of an owner or a borrower.
In a possible implementation manner, the camera may include a ToF (Time of Flight) camera, and the face recognition may include living body detection, so that 3D (3 Dimensions) face recognition may be implemented by using an image acquired by the ToF camera, and safety of the face recognition may be improved.
In a possible implementation manner, before the video processing chip performs face recognition according to at least one image in the video stream, the method further includes: acquiring a face image and/or a face feature of a vehicle owner and/or a borrower of the vehicle from a service end or a terminal of the vehicle owner of the vehicle, wherein the face image and/or the face feature of the vehicle owner and/or the borrower are/is added to user information of the vehicle through the terminal of the vehicle owner of the vehicle in advance, and/or the face image and/or the face feature of the borrower are/is registered with the service end through the terminal of the borrower of the vehicle in advance; the video processing chip performs face recognition according to at least one image in the video stream, and the face recognition method comprises the following steps: and performing face recognition based on at least one image in the video stream and face images and/or face features of an owner and/or borrower of the vehicle.
In this implementation, an owner of the vehicle may log in the system through a terminal App (Application), and after the login is successful, the owner may manage information (e.g., add, delete, query, authority management, etc.) of a user of the vehicle, where the user of the vehicle may include the owner of the vehicle and/or a borrower of the vehicle, and accordingly, the information of the user of the vehicle may include information of the owner and/or information of the borrower of the vehicle. For example, when the vehicle owner loans the vehicle to another person for use, the face image of the borrower can be uploaded to the server through the terminal App, the server can send the face image of the borrower and/or the face features extracted from the face image to a vehicle-mounted T-Box (Telematics Box), and the vehicle-mounted T-Box can use the face features in the face image as pre-registered face features to perform face comparison based on the pre-registered face features during subsequent face authentication. Or the terminal of the owner can communicate with the domain controller in a wired or wireless mode, and the human face image of the borrower and/or the human face features extracted from the human face image are led into the domain controller. The borrower of the shared vehicle can log in the system through the terminal App, after the login is successful, the borrower of the shared vehicle can select one vehicle, and the right of use is obtained through face registration. The server side can manage the user account and the password, and allows the user to log in through the correct account and the password, so that the user login is managed. The background database of the server side can manage the storage of user information (including face images and/or face characteristics, and also including the authority information of borrowers). The server can also realize storage, inquiry, addition, deletion and authority setting of the user information of the vehicle according to the instruction of the user. According to the implementation mode, information management of a user of the vehicle can be achieved, so that the vehicle door can be unlocked through the face when a subsequent vehicle owner and/or a borrower uses the vehicle.
As an example of this implementation, the server may be a TSP (Telematics service provider) cloud.
In a possible implementation manner, the video processing chip performs face recognition according to at least one image in the video stream to obtain identity information of an object outside a vehicle cabin, obtains borrowing time information of the object outside the vehicle cabin when the identity information of the object outside the vehicle cabin belongs to a borrower of the vehicle, and determines a face recognition result according to the borrowing time of the object outside the vehicle cabin.
In this implementation, if the face recognition result indicates that the object outside the vehicle cabin belongs to the borrower of the vehicle, and the borrowing time of the object outside the vehicle cabin, which does not belong to the current time, is determined according to the borrowing time information of the object outside the vehicle cabin, unlocking may be rejected. In this embodiment, the safety of the vehicle can be further improved by controlling the door in accordance with the borrowing time of the borrower.
In the application scenario of private car borrowing, the car owner can set borrowing time for the borrower. For example, in an application scenario in which a friend of the vehicle owner borrows the vehicle from the vehicle owner, the vehicle owner may set the borrowing time period for the friend to be two days, and may set a specific borrowing time range. In an application scenario where the borrower of the vehicle is a temporary borrower, for example, the temporary borrower is a courier or a property worker, the owner of the vehicle may set borrowing time for the temporary borrower. For example, after the courier contacts the owner of the vehicle, the owner of the vehicle can set borrowing time for the courier to 13:00-14:00 in 2 months and 22 days of 2020. In the borrowing scenario of the shared vehicle, the server side can determine the borrowing time of the borrower according to the borrowing time set by the borrower of the shared vehicle.
In a possible implementation manner, the video processing chip generates a door unlocking instruction and/or a door opening instruction in response to that the face recognition result is that the face recognition is successful, including: acquiring information of a vehicle door of which an object outside the vehicle cabin has door opening authority; and generating a vehicle door unlocking instruction and/or a vehicle door opening instruction according to the information of the vehicle door of which the object outside the vehicle cabin has the door opening authority.
For example, the information of the doors of the objects outside the cabin, which have the door opening authority, may be all the doors or the trunk door. For example, all doors may be used as the vehicle owner or the doors having the door opening authority by family members and friends of the vehicle owner, all doors may be used as the doors having the door opening authority by borrowers sharing the vehicle, and the doors having the door opening authority by temporary borrowers such as couriers or property workers may be trunk doors. Wherein, the car owner can set up the information of the door that has the authority of opening the door for other personnel.
In step S13, the video processing chip generates a door unlock instruction and/or a door open instruction in response to the face recognition result being that the face recognition is successful, and sends the door unlock instruction and/or the door open instruction to the micro control unit.
The door unlocking instruction can be used for controlling unlocking of the door, and the door opening instruction can be used for controlling opening of the door.
In one possible implementation, the door unlock command and/or the door open command may be used to control the unlocking and/or opening of the door of the driver's seat.
In another possible implementation manner, the door unlocking instruction and/or the door opening instruction may be used to control unlocking and/or opening of a door corresponding to a camera that collects the video stream, for example, if the status information of the door is not unlocked, the door is controlled to be unlocked or the door is controlled to be unlocked and opened; if the state information of the vehicle door is unlocked and not opened, the vehicle door is controlled to be opened, so that the vehicle door can be automatically opened for a user based on face recognition without manually opening the vehicle door by the user, and the convenience of using the vehicle is improved. The vehicle door corresponding to the camera for collecting the video stream can be determined according to the position of the camera. For example, if the video stream is captured by a camera mounted on the left B-pillar and facing the boarding position of the front row passengers, the door corresponding to the camera capturing the video stream may be the left front door; if the video stream is acquired through a camera which is arranged on a left B column and faces to the boarding position of a rear passenger, a vehicle door corresponding to the camera for acquiring the video stream can be a left rear door; if the video stream is acquired by a camera which is arranged on the right B column and faces the getting-on position of the front row passengers, the vehicle door corresponding to the camera for acquiring the video stream can be a right front door; if the video stream is acquired through a camera which is arranged on a right B column and faces to the boarding position of a rear passenger, a vehicle door corresponding to the camera for acquiring the video stream can be a right rear door; if the video stream is acquired through a camera mounted on a trunk door, a door corresponding to the camera for acquiring the video stream may be the trunk door.
In a possible implementation manner, the generating, by the video processing chip, a door unlocking instruction and/or a door opening instruction in response to the face recognition result being that the face recognition is successful may include: the video processing chip acquires the state information of the vehicle door; if the state information of the vehicle door is not unlocked, generating a vehicle door unlocking instruction and a vehicle door opening instruction; and/or if the state information of the vehicle door is unlocked and not opened, generating a vehicle door opening instruction.
The state information of the vehicle door can be unlocked, unopened and opened. In this implementation, the door opening command may be used to control the door to pop open so that a user may enter the vehicle through an automatically opened door (e.g., a front door or a rear door), or may place an item through an automatically opened door (e.g., a trunk door or a rear door). The door is automatically opened by controlling, so that a user does not need to manually pull the door after the door is unlocked.
In step S14, the micro control unit controls the vehicle body to unlock and/or open the vehicle door according to the door unlocking command and/or the door opening command.
In an embodiment of the disclosure, the micro control unit may send the door unlocking instruction and/or the door opening instruction to the vehicle body through a Controller Area Network (CAN) bus, so as to control the vehicle body to unlock and/or open the door.
The embodiment of the disclosure can be applied to borrowing scenes of private vehicles, for example, owners of the private vehicles lend the vehicles to friends, relatives and the like; the embodiment of the disclosure can also be applied to borrowing scenes of shared vehicles, so that the operation efficiency of shared vehicle products can be improved. Of course, the embodiment of the present disclosure may also be applied to the scene of the vehicle owner using the vehicle.
In one possible implementation, the video processing chip includes: a neural network processing unit storing a plurality of neural network models; the video processing chip performs face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the cabin, and the face recognition result comprises the following steps: the video processing chip runs at least one of the plurality of neural network models through the neural network processing unit to perform face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the cabin.
In this implementation, the neural network processing unit is used to perform face recognition on at least one image in the video stream, so that the speed and accuracy of face recognition can be improved.
In one possible implementation, the vehicle main body includes: the vehicle body control module is connected with the micro control unit; the little the control unit according to door unblock instruction and/or the door opening instruction, control the car owner body unblock door and/or open the door, include: the micro control unit sends the vehicle door unlocking instruction and/or the vehicle door opening instruction to the vehicle body control module through a controller local area network bus; and the vehicle body control module unlocks and/or opens the vehicle door according to the vehicle door unlocking instruction and/or the vehicle door opening instruction.
In this implementation, the micro-control unit may control the body control module based on at least one of CAN and CAN-FD (Controller Area network with Flexible Data-rate).
In one possible implementation manner, the vehicle main body further includes a power supply circuit, the power supply circuit is respectively connected to the video processing chip and the micro control unit, the vehicle cabin area controller further includes a capacitor circuit, the capacitor circuit is respectively connected to the video processing chip and the micro control unit, and the method further includes: the micro control unit responds to the abnormal power failure state of the power supply circuit and controls the capacitor circuit to discharge so as to supply power to the video processing chip; and the video processing chip stores at least part of video data from the camera acquired before the power supply circuit is in an abnormal power-down state into a memory in the discharging process of the capacitor circuit.
In the implementation mode, the micro control unit responds to that a power supply circuit of a vehicle is in an abnormal power failure state, the capacitive circuit of the vehicle cabin area controller is controlled to discharge, so that power is supplied to the video processing chip, in the discharging process of the capacitive circuit, the video processing chip stores at least part of video data from the camera, which is acquired before the power supply circuit is in the abnormal power failure state, in a storage, therefore, when the power supply circuit is in the abnormal power failure state, the capacitive circuit can be used for providing electric quantity required by video data storage for the video processing chip, and the video data in the time often plays an important role in abnormal power failure analysis.
As an example of this implementation, the micro control unit may determine the operating state of the power supply circuit by monitoring the voltage of the power supply circuit. By monitoring the working state of the power supply circuit of the vehicle, the abnormal working state (such as abnormal power-down state) of the power supply circuit can be found in time. In the discharging process of the capacitor circuit, at least part of video data, which is obtained by the video processing chip before the power supply circuit is in an abnormal power failure state and is from a camera installed on the vehicle, is stored in a nonvolatile memory, so that the video data before abnormal power failure can be stored, and a video data basis can be provided for subsequent abnormal power failure analysis.
Fig. 3 shows a schematic diagram of a capacitor circuit provided in an embodiment of the disclosure. As shown in fig. 3, the capacitance circuit includes a first switching circuit, a second switching circuit, a first capacitance and a second capacitance, wherein the capacity of the first capacitor is larger than that of the second capacitor, the first end of the first switch circuit is connected with the power circuit, the enable end of the first switch circuit is connected with the micro control unit, the second end of the first switch circuit is connected with the first end of the second switch circuit, one end of the first capacitor is grounded, the other end of the first capacitor is connected with the second end of the first switch circuit and the first end of the second switch circuit, the enabling end of the second switch circuit is connected with the micro control unit, one end of the second capacitor is grounded, the other end of the second capacitor is connected with the enabling end of the second switch circuit, and the second end of the second switch circuit is connected with the video processing chip.
As an example of this implementation, the controlling, by the micro control unit, the discharging of the capacitor circuit in response to monitoring that the power supply circuit is in an abnormal power-down state includes: and the micro control unit responds to the condition that the power supply circuit is monitored to be in an abnormal power-down state, and keeps the enabling end of the first switch circuit and the enabling end of the second switch circuit in the capacitor circuit in an effective state.
In this example, in response to monitoring that the power supply circuit is in an abnormal power-down state, the micro control unit maintains the enable end of the first switch circuit and the enable end of the second switch circuit in the capacitor circuit in an effective state, so that the capacitor circuit can be controlled to discharge, power can be supplied to the video processing chip, and the video processing chip can store at least part of video data from the camera acquired before the power supply circuit is in the abnormal power-down state.
As an example of this implementation, the method further comprises at least one of: the micro control unit controls the capacitor circuit to charge or not to discharge in response to monitoring that the power supply circuit is in a normal power-off state; and the micro control unit controls the capacitor circuit not to be charged in the system starting process of the vehicle and controls the capacitor circuit to be charged after the system is started.
In the example, the capacitor circuit is controlled not to discharge in response to the condition that the power supply circuit is monitored to be in a normal power-off state, so that the system can be quickly put into a sleep state without delaying the sleep of the system due to the discharge of the capacitor circuit; by controlling the capacitor circuit not to be charged during the system start-up of the vehicle, voltage fluctuation and/or system start-up time extension caused by charging the capacitor circuit are avoided. After the system is started, the capacitor circuit is controlled to be charged, so that preparation can be made for abnormal power failure.
In one example, the micro control unit controls the capacitor circuit to charge or not discharge in response to monitoring that the power supply circuit is in a normal power down state, including: and the micro control unit controls the enabling end of the first switch circuit and the enabling end of the second switch circuit in the capacitor circuit to be in an invalid state in response to monitoring that the power supply circuit is in a normal power-off state.
In this example, the enabling terminal of the first switch circuit and the enabling terminal of the second switch circuit are controlled to be in an invalid state by the micro control unit in response to the detection that the power supply circuit is in a normal power-down state, so that the first capacitor and the second capacitor are neither charged nor discharged, and therefore the system can be quickly put into a sleep state without delaying the sleep of the system due to the discharge of the first capacitor and the second capacitor.
In one example, the micro control unit controls the capacitor circuit not to be charged during system start of the vehicle and controls the capacitor circuit to be charged after the system start is completed, including: the micro control unit keeps an enabling end of a first switch circuit and an enabling end of a second switch circuit in the capacitor circuit in an invalid state in the system starting process of the vehicle, and controls the enabling end of the first switch circuit and the enabling end of the second switch circuit to be in an valid state after the system starting is completed.
In this example, the enable terminal of the first switching circuit and the enable terminal of the second switching circuit are kept in an inactive state by the microcontroller unit during system start-up of the vehicle, i.e. the first capacitor and the second capacitor are not charged during system start-up, so that voltage fluctuations and/or an extension of the system start-up time due to charging of the first capacitor and the second capacitor are not caused.
In one possible implementation, the method further includes: and controlling the vehicle door to be closed or controlling the vehicle door to be closed and locked when the automatic door closing condition is met. In this embodiment, when the automatic door closing condition is satisfied, the door is controlled to be closed, or the door is controlled to be closed and locked, whereby the safety of the vehicle can be improved. In one example, the automatic door-closing condition may include: the unlocking or opening time of the vehicle door reaches the preset time.
In one possible implementation manner, after obtaining the face recognition result of the object outside the vehicle cabin, the method further includes: and responding to the face recognition failure, and sending unlocking failure information to the server. In this implementation manner, the server may store a record of the unlocking failure, so that a subsequent owner may query the unlocking history of the vehicle through the record stored by the server.
In this implementation manner, the unlocking failure information may include at least one image acquired in the face recognition process. The unlocking failure information may further include time and/or location information of the face recognition.
In the implementation mode, after receiving the unlocking failure information, the server side can send the unlocking failure information to the vehicle owner terminal, so that the vehicle owner can find the attacked condition in time.
In one possible implementation manner, after obtaining the face recognition result of the object outside the vehicle cabin, the method further includes: and responding to the success of the face recognition, and sending unlocking success information to the server. In an implementation mode, the server can store the record of successful unlocking, so that a subsequent owner can inquire the unlocking history of the vehicle through the record stored by the server. For example, after the vehicle is stolen, the information of the vehicle stealer can be checked through the record stored by the server.
In this implementation manner, the unlocking success information may include at least one image acquired in the face recognition process. The unlocking success information can also comprise the time and/or the place information of the unlocking.
In the embodiment of the disclosure, the camera is controlled to collect a video stream, the video processing chip performs face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the vehicle cabin, and at least one door of the vehicle is controlled to be unlocked and/or opened in response to the face recognition result indicating that the face recognition is successful, so that the vehicle door can be opened by brushing the face. The unlocking of the non-contact mode of the vehicle door is realized through face recognition, the interaction is comfortable, the operation is convenient, the safety is high, the durability is strong, and the practicability is high.
It is understood that the above-mentioned method embodiments of the present disclosure can be combined with each other to form a combined embodiment without departing from the logic of the principle, which is limited by the space, and the detailed description of the present disclosure is omitted.
It will be understood by those skilled in the art that in the method of the present invention, the order of writing the steps does not imply a strict order of execution and any limitations on the implementation, and the specific order of execution of the steps should be determined by their function and possible inherent logic.
In addition, the present disclosure also provides a vehicle door control system, a vehicle, an electronic device, a computer-readable storage medium, and a program, which can be used to implement any one of the vehicle door control methods provided by the present disclosure, and the corresponding technical solutions and descriptions and corresponding descriptions in the method sections are not repeated.
Fig. 4 shows a block diagram of a vehicle door control system provided by an embodiment of the present disclosure. As shown in fig. 4, the vehicle door control system includes a vehicle 100, a user terminal 200 and a service end 300, where the vehicle 100 includes a vehicle main body, a vehicle cabin domain controller, a camera and a remote information processor installed outside the vehicle cabin, the vehicle cabin domain controller includes a video processing chip and a micro control unit connected to each other, the video processing chip is further connected to the camera and the remote information processor, respectively, the micro control unit is further connected to the vehicle main body, and the service end is connected to the remote information processor and the user terminal, respectively; the user terminal 200 is configured to register a face image and/or a face feature of a user of the vehicle with the server 300; the telematics processor is used for acquiring a human face image and/or human face characteristics of a user of the vehicle 100 from the server 300; the video processing chip is used for carrying out face recognition according to at least one image in the video stream acquired by the camera and the face image and/or the face characteristics of the user of the vehicle to obtain a face recognition result of an object outside the vehicle cabin, generating a vehicle door unlocking instruction and/or a vehicle door opening instruction in response to the face recognition result that the face recognition is successful, and sending the vehicle door unlocking instruction and/or the vehicle door opening instruction to the micro control unit; and the micro control unit is used for controlling the vehicle body to unlock and/or open the vehicle door according to the vehicle door unlocking instruction and/or the vehicle door opening instruction.
The vehicle door control system provided by the embodiment of the disclosure can realize the face brushing of the user of the vehicle to open the vehicle door, thereby facilitating the opening of the vehicle door.
FIG. 5 shows a block diagram of a vehicle provided by an embodiment of the present disclosure. As shown in fig. 5, the vehicle includes a vehicle body 110, a vehicle cabin area controller 120 and a camera 130 installed outside the vehicle cabin, the vehicle cabin area controller 120 includes a video processing chip 121 and a micro control unit 122 connected to each other, the video processing chip 121 is further connected to the camera 130, and the micro control unit 122 is further connected to the vehicle body 110; the video processing chip 121 is configured to: controlling the camera 130 to collect a video stream; performing face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the cabin; in response to the face recognition result being that the face recognition is successful, generating a door unlocking instruction and/or a door opening instruction, and sending the door unlocking instruction and/or the door opening instruction to the micro control unit 122; the micro control unit 122 is configured to: and controlling the vehicle body 110 to unlock and/or open the vehicle door according to the vehicle door unlocking instruction and/or the vehicle door opening instruction.
In one possible implementation manner, the video processing chip 121 includes: a neural network processing unit storing a plurality of neural network models; the video processing chip 121 is configured to: and running at least one neural network model in the plurality of neural network models through the neural network processing unit to perform face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the cabin.
In one possible implementation, the vehicle body 110 includes: a vehicle body control module connected to the micro control unit 122; the micro control unit 122 is configured to: sending the vehicle door unlocking instruction and/or the vehicle door opening instruction to the vehicle body control module through a controller local area network bus; the vehicle body control module is used for: and the vehicle door unlocking command and/or the vehicle door opening command unlock and/or open the vehicle door.
In one possible implementation, the vehicle further includes: a microswitch connected to the micro control unit 122; the micro control unit 122 is configured to: waking up the video processing chip 121 in a sleep state in response to the micro switch being touched; the video processing chip 121 is configured to: after waking up, controlling the camera 130 to collect video stream.
In one possible implementation, the vehicle further includes: a distance sensor connected to the micro control unit 122; the micro control unit 122 is configured to: controlling the distance sensor to continuously acquire the distance between an object outside the vehicle cabin and the distance sensor; waking up the video processing chip 121 in a sleep state in response to the distance sensor detecting that a person approaches the vehicle; the video processing chip 121 is configured to: after waking up, controlling the camera 130 to collect video stream.
In one possible implementation, the distance sensor includes: and an infrared distance measuring sensor connected with the micro control unit 122.
In one possible implementation, the micro control unit 122 is configured to: and when the vehicle is in a dormant state or in a dormant state and the door of the vehicle is not unlocked, controlling the distance sensor to continuously acquire the distance between an object outside the vehicle cabin and the distance sensor.
In one possible implementation, the micro control unit 122 is configured to: responding to the gradual reduction of the distance and the duration of the distance which is less than or equal to the first distance threshold value reaching the first time threshold value, waking up the video processing chip 121 in the dormant state; and/or awakening the video processing chip 121 in a sleep state in response to the distance gradually decreasing and the distance maintaining fixed duration reaching a second duration threshold in the process that the distance is less than or equal to the second distance threshold.
In one possible implementation, the micro control unit 122 is configured to: responding to the distance gradually reducing and the distance being less than or equal to a third distance threshold, waking up the video processing chip 121 in a sleep state; the video processing chip 121 is configured to: after waking up, in response to that the duration of the distance less than or equal to a fourth distance threshold reaches a third duration threshold, controlling the camera 130 to acquire a video stream, where the fourth distance threshold is less than the third distance threshold.
In one possible implementation, the micro control unit 122 is configured to: responding to the distance gradually reducing and the distance being less than or equal to a fifth distance threshold, waking up the video processing chip 121 in a sleep state; the video processing chip 121 is configured to: after waking up, in response to that the duration of the distance maintaining fixation reaches a fourth time threshold in the process that the distance is less than or equal to a sixth distance threshold, controlling the camera 130 to acquire a video stream, wherein the sixth distance threshold is less than the fifth distance threshold.
In a possible implementation manner, the vehicle main body 110 further includes a power circuit, the power circuit is respectively connected to the video processing chip 121 and the micro control unit 122, and the vehicle cabin area controller 120 further includes a capacitor circuit, the capacitor circuit is respectively connected to the video processing chip 121 and the micro control unit 122; the micro control unit 122 is further configured to: in response to the power supply circuit being in an abnormal power-down state, controlling the capacitor circuit to discharge so as to supply power to the video processing chip 121; the video processing chip 121 is further configured to: in the process of discharging the capacitor circuit, at least part of the video data from the camera 130, which is acquired before the power supply circuit is in the abnormal power-down state, is stored in a memory.
In a possible implementation, the micro control unit 122 is further configured to at least one of: controlling the capacitor circuit to charge or not discharge in response to monitoring that the power supply circuit is in a normal power-off state; and in the process of starting the system of the vehicle, controlling the capacitor circuit not to be charged, and controlling the capacitor circuit to be charged after the system is started.
In one possible implementation, the capacitance circuit includes a first switch circuit, a second switch circuit, a first capacitance and a second capacitance, wherein the capacity of the first capacitor is larger than that of the second capacitor, the first end of the first switch circuit is connected with the power circuit, the enable end of the first switch circuit is connected with the micro control unit, the second end of the first switch circuit is connected with the first end of the second switch circuit, one end of the first capacitor is grounded, the other end of the first capacitor is connected with the second end of the first switch circuit and the first end of the second switch circuit, the enabling end of the second switch circuit is connected with the micro control unit, one end of the second capacitor is grounded, the other end of the second capacitor is connected with the enabling end of the second switch circuit, and the second end of the second switch circuit is connected with the video processing chip; the micro control unit 122 is further configured to at least one of: in response to monitoring that the power supply circuit is in an abnormal power-down state, keeping an enabling end of a first switch circuit and an enabling end of a second switch circuit in the capacitor circuit in an effective state; in response to monitoring that the power supply circuit is in a normal power-down state, controlling an enabling end of a first switch circuit and an enabling end of a second switch circuit in the capacitor circuit to be in an invalid state; the method comprises the steps of keeping an enabling end of a first switch circuit and an enabling end of a second switch circuit in the capacitor circuit in an invalid state in the process of starting a system of the vehicle, and controlling the enabling ends of the first switch circuit and the second switch circuit to be in an valid state after the system is started.
In some embodiments, functions of or modules included in the apparatus provided in the embodiments of the present disclosure may be used to execute the method described in the above method embodiments, and specific implementation thereof may refer to the description of the above method embodiments, and for brevity, will not be described again here.
Embodiments of the present disclosure also provide a computer-readable storage medium having stored thereon computer program instructions, which when executed by a processor, implement the above-described method. The computer-readable storage medium may be a non-volatile computer-readable storage medium, or may be a volatile computer-readable storage medium.
The disclosed embodiments also provide a computer program product comprising computer readable code, when the computer readable code runs on a device, a processor in the device executes instructions for implementing the vehicle door control method provided by any of the above embodiments.
The disclosed embodiments also provide another computer program product for storing computer readable instructions that, when executed, cause a computer to perform the operations of the vehicle door control method provided by any of the above embodiments.
An embodiment of the present disclosure further provides an electronic device, including: one or more processors; a memory for storing executable instructions; wherein the one or more processors are configured to invoke the memory-stored executable instructions to perform the above-described method.
The electronic device may be provided as a terminal, server, or other form of device.
Fig. 6 illustrates a block diagram of an electronic device 800 provided by an embodiment of the disclosure. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like terminal.
Referring to fig. 6, electronic device 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816.
The processing component 802 generally controls overall operation of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operations at the electronic device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power supply component 806 provides power to the various components of the electronic device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 800.
The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the electronic device 800 is in an operation mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the electronic device 800. For example, the sensor assembly 814 may detect an open/closed state of the electronic device 800, the relative positioning of components, such as a display and keypad of the electronic device 800, the sensor assembly 814 may also detect a change in the position of the electronic device 800 or a component of the electronic device 800, the presence or absence of user contact with the electronic device 800, orientation or acceleration/deceleration of the electronic device 800, and a change in the temperature of the electronic device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 may access a wireless network based on a communication standard, such as Wi-Fi, 2G, 3G, 4G/LTE, 5G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the electronic device 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer-readable storage medium, such as the memory 804, is also provided that includes computer program instructions executable by the processor 820 of the electronic device 800 to perform the above-described methods.
Fig. 7 shows a block diagram of an electronic device 1900 provided by an embodiment of the disclosure. For example, the electronic device 1900 may be provided as a server. Referring to fig. 7, electronic device 1900 includes a processing component 1922 further including one or more processors and memory resources, represented by memory 1932, for storing instructions, e.g., applications, executable by processing component 1922. The application programs stored in memory 1932 may include one or more modules that each correspond to a set of instructions. Further, the processing component 1922 is configured to execute instructions to perform the above-described method.
The electronic device 1900 may also include a power component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input/output (I/O) interface 1958. The electronic device 1900 may operate based on an operating system, such as Windows, stored in memory 1932
Figure BDA0002466000930000211
Mac OS
Figure BDA0002466000930000212
Figure BDA0002466000930000213
Or the like.
In an exemplary embodiment, a non-transitory computer readable storage medium, such as the memory 1932, is also provided that includes computer program instructions executable by the processing component 1922 of the electronic device 1900 to perform the above-described methods.
The present disclosure may be systems, methods, and/or computer program products. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied thereon for causing a processor to implement various aspects of the present disclosure.
The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.
The computer program instructions for carrying out operations of the present disclosure may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry that can execute the computer-readable program instructions implements aspects of the present disclosure by utilizing the state information of the computer-readable program instructions to personalize the electronic circuitry, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA).
Various aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The computer program product may be embodied in hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied in a computer storage medium, and in another alternative embodiment, the computer program product is embodied in a Software product, such as a Software Development Kit (SDK), or the like.
Having described embodiments of the present disclosure, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims (17)

1. A vehicle door control method is applied to a vehicle, the vehicle comprises a vehicle main body, a vehicle cabin domain controller and a camera installed outside a vehicle cabin, the vehicle cabin domain controller comprises a video processing chip and a micro control unit which are connected with each other, the video processing chip is also connected with the camera, the micro control unit is also connected with the vehicle main body, and the method comprises the following steps:
controlling the camera to collect video stream;
the video processing chip performs face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the cabin;
the video processing chip responds to the fact that the face recognition result is that the face recognition is successful, generates a vehicle door unlocking instruction and/or a vehicle door opening instruction, and sends the vehicle door unlocking instruction and/or the vehicle door opening instruction to the micro control unit;
and the micro control unit controls the vehicle body to unlock and/or open the vehicle door according to the vehicle door unlocking instruction and/or the vehicle door opening instruction.
2. The method of claim 1,
the video processing chip includes: a neural network processing unit storing a plurality of neural network models;
the video processing chip performs face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the cabin, and the face recognition result comprises the following steps: the video processing chip runs at least one of the plurality of neural network models through the neural network processing unit to perform face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the cabin.
3. The method according to claim 1 or 2,
the vehicle main body includes: the vehicle body control module is connected with the micro control unit;
the little the control unit according to door unblock instruction and/or the door opening instruction, control the car owner body unblock door and/or open the door, include: the micro control unit sends the vehicle door unlocking instruction and/or the vehicle door opening instruction to the vehicle body control module through a controller local area network bus; and the vehicle body control module unlocks and/or opens the vehicle door according to the vehicle door unlocking instruction and/or the vehicle door opening instruction.
4. The method according to any one of claims 1 to 3,
the vehicle further includes: the micro switch is connected with the micro control unit;
the controlling the camera to collect the video stream includes: the micro control unit responds to the touch of the micro switch and wakes up the video processing chip in a dormant state; and the video processing chip after awakening controls the camera to acquire the video stream.
5. The method according to any one of claims 1 to 4,
the vehicle further includes: a distance sensor connected with the micro control unit;
the controlling the camera to collect the video stream includes: the micro control unit controls the distance sensor to continuously acquire the distance between an object outside the cabin and the distance sensor; the micro control unit responds to the fact that the distance sensor detects that a person approaches the vehicle and wakes up the video processing chip in a dormant state; and the video processing chip after awakening controls the camera to acquire the video stream.
6. The method of claim 5, wherein the distance sensor comprises: and the infrared distance measuring sensor is connected with the micro control unit.
7. The method according to claim 5 or 6, wherein the micro control unit controls the distance sensor to continuously acquire the distance between the object outside the vehicle cabin and the distance sensor, comprising:
and the micro control unit controls the distance sensor to continuously acquire the distance between an object outside the cabin and the distance sensor when the vehicle is in a dormant state or in a dormant state and the door is not unlocked.
8. The method of any one of claims 5 to 7, wherein the micro control unit wakes up the video processing chip in a sleep state in response to the distance sensor detecting a person approaching the vehicle, comprising:
the micro control unit responds to the gradual reduction of the distance, and the duration of the distance which is less than or equal to a first distance threshold value reaches a first time threshold value, and wakes up the video processing chip in a dormant state;
and/or the presence of a gas in the gas,
and the micro control unit responds to the gradual reduction of the distance, and awakens the video processing chip in the dormant state when the distance maintains a fixed duration to reach a second duration threshold in the process that the distance is less than or equal to the second distance threshold.
9. The method according to any one of claims 5 to 7,
the micro control unit awakens the video processing chip in a dormant state in response to detecting that a person approaches the vehicle, including: the micro control unit responds to the gradual reduction of the distance, and the distance is smaller than or equal to a third distance threshold value, and awakens the video processing chip in a dormant state;
the video processing chip after awakening controls the camera to collect video streams, and the method comprises the following steps: and the video processing chip after awakening controls the camera to acquire the video stream in response to the fact that the duration of the distance smaller than or equal to a fourth distance threshold reaches a third time threshold, wherein the fourth distance threshold is smaller than the third distance threshold.
10. The method according to any one of claims 5 to 7,
the micro control unit awakens the video processing chip in a dormant state in response to detecting that a person approaches the vehicle, including: the micro control unit responds to the gradual reduction of the distance, and the distance is smaller than or equal to a fifth distance threshold value, and awakens the video processing chip in a dormant state;
the video processing chip after awakening controls the camera to collect video streams, and the method comprises the following steps: and the video processing chip after awakening responds to the fact that the distance is maintained to be fixed for a duration time reaching a fourth time threshold value in the process that the distance is smaller than or equal to a sixth distance threshold value, and controls the camera to acquire the video stream, wherein the sixth distance threshold value is smaller than the fifth distance threshold value.
11. The method of any one of claims 1 to 10, wherein the vehicle body further comprises a power circuit, the power circuit being connected to the video processing chip and the micro control unit, respectively, the vehicle cabin zone controller further comprising a capacitive circuit, the capacitive circuit being connected to the video processing chip and the micro control unit, respectively, the method further comprising:
the micro control unit responds to the abnormal power failure state of the power supply circuit and controls the capacitor circuit to discharge so as to supply power to the video processing chip;
and the video processing chip stores at least part of video data from the camera acquired before the power supply circuit is in an abnormal power-down state into a memory in the discharging process of the capacitor circuit.
12. The method of claim 11, further comprising at least one of:
the micro control unit controls the capacitor circuit to charge or not to discharge in response to monitoring that the power supply circuit is in a normal power-off state;
and the micro control unit controls the capacitor circuit not to be charged in the system starting process of the vehicle and controls the capacitor circuit to be charged after the system is started.
13. The method according to claim 11 or 12,
the capacitor circuit comprises a first switch circuit, a second switch circuit, a first capacitor and a second capacitor, wherein the capacity of the first capacitor is greater than that of the second capacitor, the first end of the first switch circuit is connected with the power supply circuit, the enable end of the first switch circuit is connected with the micro control unit, the second end of the first switch circuit is connected with the first end of the second switch circuit, one end of the first capacitor is grounded, the other end of the first capacitor is connected with the second end of the first switch circuit and the first end of the second switch circuit, the enable end of the second switch circuit is connected with the micro control unit, one end of the second capacitor is grounded, the other end of the second capacitor is connected with the enable end of the second switch circuit, and the second end of the second switch circuit is connected with the video processing chip;
the micro control unit controls the capacitor circuit to discharge in response to monitoring that the power supply circuit is in an abnormal power-down state, and the method comprises the following steps: the micro control unit responds to the condition that the power supply circuit is monitored to be in an abnormal power failure state, and keeps an enabling end of a first switch circuit and an enabling end of a second switch circuit in the capacitor circuit in an effective state; and/or the micro control unit controls the capacitor circuit to be charged or not to be discharged in response to monitoring that the power supply circuit is in a normal power-off state, and the method comprises the following steps: the micro control unit controls an enabling end of a first switch circuit and an enabling end of a second switch circuit in the capacitor circuit to be in an invalid state in response to monitoring that the power supply circuit is in a normal power-off state; and/or the micro control unit controls the capacitor circuit not to be charged in the system starting process of the vehicle, and controls the capacitor circuit to be charged after the system is started, and the method comprises the following steps: the micro control unit keeps an enabling end of a first switch circuit and an enabling end of a second switch circuit in the capacitor circuit in an invalid state in the system starting process of the vehicle, and controls the enabling end of the first switch circuit and the enabling end of the second switch circuit to be in an valid state after the system starting is completed.
14. A vehicle is characterized by comprising a vehicle main body, a vehicle cabin domain controller and a camera arranged outside a vehicle cabin, wherein the vehicle cabin domain controller comprises a video processing chip and a micro control unit which are connected with each other, the video processing chip is also connected with the camera, and the micro control unit is also connected with the vehicle main body;
the video processing chip is used for: controlling the camera to collect video stream; performing face recognition according to at least one image in the video stream to obtain a face recognition result of an object outside the cabin; responding to the face recognition result that the face recognition is successful, generating a vehicle door unlocking instruction and/or a vehicle door opening instruction, and sending the vehicle door unlocking instruction and/or the vehicle door opening instruction to the micro control unit;
the micro control unit is used for: and controlling the vehicle body to unlock and/or open the vehicle door according to the vehicle door unlocking instruction and/or the vehicle door opening instruction.
15. A vehicle door control system is characterized by comprising a vehicle, a user terminal and a server side, wherein the vehicle comprises a vehicle main body, a vehicle cabin domain controller, a camera and a remote information processor, the camera and the remote information processor are installed outside a vehicle cabin, the vehicle cabin domain controller comprises a video processing chip and a micro control unit which are connected with each other, the video processing chip is also connected with the camera and the remote information processor respectively, the micro control unit is also connected with the vehicle main body, and the server side is connected with the remote information processor and the user terminal respectively;
the user terminal is used for registering the face image and/or the face characteristics of the user of the vehicle to the server;
the remote information processor is used for acquiring a human face image and/or human face characteristics of a user of the vehicle from the server;
the video processing chip is used for carrying out face recognition according to at least one image in the video stream acquired by the camera and the face image and/or the face characteristics of the user of the vehicle to obtain a face recognition result of an object outside the vehicle cabin, generating a vehicle door unlocking instruction and/or a vehicle door opening instruction in response to the face recognition result that the face recognition is successful, and sending the vehicle door unlocking instruction and/or the vehicle door opening instruction to the micro control unit;
and the micro control unit is used for controlling the vehicle body to unlock and/or open the vehicle door according to the vehicle door unlocking instruction and/or the vehicle door opening instruction.
16. An electronic device, comprising:
one or more processors;
a memory for storing executable instructions;
wherein the one or more processors are configured to invoke the memory-stored executable instructions to perform the method of any one of claims 1 to 13.
17. A computer readable storage medium having computer program instructions stored thereon, which when executed by a processor implement the method of any one of claims 1 to 13.
CN202010334140.8A 2020-04-24 2020-04-24 Vehicle door control method, vehicle, system, electronic device, and storage medium Active CN111516640B (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN202010334140.8A CN111516640B (en) 2020-04-24 2020-04-24 Vehicle door control method, vehicle, system, electronic device, and storage medium
KR1020217038721A KR20220002519A (en) 2020-04-24 2020-12-07 Vehicle door control method, vehicle, system, electronic device and storage medium
JP2021556981A JP2022533885A (en) 2020-04-24 2020-12-07 Vehicle door control method, vehicle, system, electronic device and storage medium
PCT/CN2020/134304 WO2021212860A1 (en) 2020-04-24 2020-12-07 Vehicle door control method, vehicle, system, electronic device, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010334140.8A CN111516640B (en) 2020-04-24 2020-04-24 Vehicle door control method, vehicle, system, electronic device, and storage medium

Publications (2)

Publication Number Publication Date
CN111516640A true CN111516640A (en) 2020-08-11
CN111516640B CN111516640B (en) 2022-01-04

Family

ID=71903332

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010334140.8A Active CN111516640B (en) 2020-04-24 2020-04-24 Vehicle door control method, vehicle, system, electronic device, and storage medium

Country Status (4)

Country Link
JP (1) JP2022533885A (en)
KR (1) KR20220002519A (en)
CN (1) CN111516640B (en)
WO (1) WO2021212860A1 (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112291704A (en) * 2020-09-30 2021-01-29 辉创电子科技(苏州)有限公司 Positioning system based on BLE and UWB technologies
CN112959960A (en) * 2021-02-26 2021-06-15 北京车和家信息技术有限公司 Abnormal vehicle use detection method and device, medium, equipment, vehicle and server
CN113160463A (en) * 2021-05-26 2021-07-23 北京旗偲智能科技有限公司 Method and device for starting user identification device of vehicle and automobile control cloud
WO2021212506A1 (en) * 2020-04-24 2021-10-28 上海商汤临港智能科技有限公司 Vehicle, visual domain controller, video data processing method and device, and medium
WO2021212504A1 (en) * 2020-04-24 2021-10-28 上海商汤临港智能科技有限公司 Vehicle and cabin area controller
WO2021212860A1 (en) * 2020-04-24 2021-10-28 上海商汤临港智能科技有限公司 Vehicle door control method, vehicle, system, electronic device, and storage medium
CN113815562A (en) * 2021-09-24 2021-12-21 上汽通用五菱汽车股份有限公司 Vehicle unlocking method and device based on panoramic camera and storage medium
CN114633720A (en) * 2020-12-15 2022-06-17 博泰车联网科技(上海)股份有限公司 Method and device for intelligently opening trunk, storage medium and vehicle
CN114889554A (en) * 2022-05-24 2022-08-12 东风汽车集团股份有限公司 Automobile intelligent entering and starting system based on face recognition
CN115158221A (en) * 2022-06-27 2022-10-11 重庆长安汽车股份有限公司 Intelligent automobile interaction method, device, equipment and storage medium
CN115182662A (en) * 2022-07-25 2022-10-14 上海集成电路制造创新中心有限公司 Door control method, system, equipment and medium
CN115450526A (en) * 2022-08-11 2022-12-09 岚图汽车科技有限公司 Tail gate opening method and system, electronic equipment and computer storage medium

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114233140B (en) * 2021-11-08 2023-11-07 岚图汽车科技有限公司 Vehicle trunk control method, device, storage medium and equipment
CN114302341B (en) * 2021-11-26 2024-06-25 华人运通(上海)云计算科技有限公司 Control method, device, equipment and medium for state mode of vehicle
CN114575701B (en) * 2022-02-24 2024-09-06 智己汽车科技有限公司 Control method and system for opening and closing vehicle door, vehicle and storage medium
CN115506677A (en) * 2022-08-23 2022-12-23 重庆长安汽车股份有限公司 Electric door opening control method and device, control equipment, vehicle and storage medium
CN116291067B (en) * 2023-04-20 2024-05-28 重庆赛力斯新能源汽车设计院有限公司 Intelligent opening and closing control method and device for door lock

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201313539Y (en) * 2008-09-18 2009-09-23 深圳市翰乾电子科技有限公司 Anti-theft device for automotive trunk
CN103693012A (en) * 2013-12-23 2014-04-02 杭州电子科技大学 Automobile anti-theft system
CN104021093A (en) * 2014-06-24 2014-09-03 浪潮集团有限公司 Power-down protection method for memory device based on NVDIMM (non-volatile dual in-line memory module)
CN108229533A (en) * 2017-11-22 2018-06-29 深圳市商汤科技有限公司 Image processing method, model pruning method, device and equipment
EP3505404A1 (en) * 2016-08-29 2019-07-03 KYOCERA Corporation Determination apparatus, imaging apparatus, driver confirmation system, movable body, and determination method
CN209248624U (en) * 2019-02-28 2019-08-13 上海商汤视觉科技有限公司 Vehicle and vehicle-mounted face system for unlocking
CN110765936A (en) * 2019-10-22 2020-02-07 上海商汤智能科技有限公司 Vehicle door control method, vehicle door control device, vehicle door control system, vehicle, electronic equipment and storage medium
CN110930547A (en) * 2019-02-28 2020-03-27 上海商汤临港智能科技有限公司 Vehicle door unlocking method, vehicle door unlocking device, vehicle door unlocking system, electronic equipment and storage medium

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160300410A1 (en) * 2015-04-10 2016-10-13 Jaguar Land Rover Limited Door Access System for a Vehicle
CN105972832B (en) * 2016-07-05 2021-12-31 广东万家乐燃气具有限公司 Electric water heater water outlet power-off control system capable of preventing misoperation
CN108846924A (en) * 2018-05-31 2018-11-20 上海商汤智能科技有限公司 Vehicle and car door solution lock control method, device and car door system for unlocking
CN108819900A (en) * 2018-06-04 2018-11-16 上海商汤智能科技有限公司 Control method for vehicle and system, vehicle intelligent system, electronic equipment, medium
CN109177924A (en) * 2018-09-20 2019-01-11 安徽信息工程学院 Vehicle recognition of face system for unlocking
CN111516640B (en) * 2020-04-24 2022-01-04 上海商汤临港智能科技有限公司 Vehicle door control method, vehicle, system, electronic device, and storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201313539Y (en) * 2008-09-18 2009-09-23 深圳市翰乾电子科技有限公司 Anti-theft device for automotive trunk
CN103693012A (en) * 2013-12-23 2014-04-02 杭州电子科技大学 Automobile anti-theft system
CN104021093A (en) * 2014-06-24 2014-09-03 浪潮集团有限公司 Power-down protection method for memory device based on NVDIMM (non-volatile dual in-line memory module)
EP3505404A1 (en) * 2016-08-29 2019-07-03 KYOCERA Corporation Determination apparatus, imaging apparatus, driver confirmation system, movable body, and determination method
CN108229533A (en) * 2017-11-22 2018-06-29 深圳市商汤科技有限公司 Image processing method, model pruning method, device and equipment
CN209248624U (en) * 2019-02-28 2019-08-13 上海商汤视觉科技有限公司 Vehicle and vehicle-mounted face system for unlocking
CN110930547A (en) * 2019-02-28 2020-03-27 上海商汤临港智能科技有限公司 Vehicle door unlocking method, vehicle door unlocking device, vehicle door unlocking system, electronic equipment and storage medium
CN110765936A (en) * 2019-10-22 2020-02-07 上海商汤智能科技有限公司 Vehicle door control method, vehicle door control device, vehicle door control system, vehicle, electronic equipment and storage medium

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021212506A1 (en) * 2020-04-24 2021-10-28 上海商汤临港智能科技有限公司 Vehicle, visual domain controller, video data processing method and device, and medium
WO2021212504A1 (en) * 2020-04-24 2021-10-28 上海商汤临港智能科技有限公司 Vehicle and cabin area controller
WO2021212860A1 (en) * 2020-04-24 2021-10-28 上海商汤临港智能科技有限公司 Vehicle door control method, vehicle, system, electronic device, and storage medium
CN112291704A (en) * 2020-09-30 2021-01-29 辉创电子科技(苏州)有限公司 Positioning system based on BLE and UWB technologies
CN114633720B (en) * 2020-12-15 2023-08-18 博泰车联网科技(上海)股份有限公司 Method and device for intelligently opening trunk, storage medium and vehicle
CN114633720A (en) * 2020-12-15 2022-06-17 博泰车联网科技(上海)股份有限公司 Method and device for intelligently opening trunk, storage medium and vehicle
CN112959960A (en) * 2021-02-26 2021-06-15 北京车和家信息技术有限公司 Abnormal vehicle use detection method and device, medium, equipment, vehicle and server
CN113160463A (en) * 2021-05-26 2021-07-23 北京旗偲智能科技有限公司 Method and device for starting user identification device of vehicle and automobile control cloud
CN113815562A (en) * 2021-09-24 2021-12-21 上汽通用五菱汽车股份有限公司 Vehicle unlocking method and device based on panoramic camera and storage medium
CN114889554A (en) * 2022-05-24 2022-08-12 东风汽车集团股份有限公司 Automobile intelligent entering and starting system based on face recognition
CN115158221A (en) * 2022-06-27 2022-10-11 重庆长安汽车股份有限公司 Intelligent automobile interaction method, device, equipment and storage medium
CN115158221B (en) * 2022-06-27 2023-10-31 重庆长安汽车股份有限公司 Intelligent automobile interaction method, device, equipment and storage medium
CN115182662A (en) * 2022-07-25 2022-10-14 上海集成电路制造创新中心有限公司 Door control method, system, equipment and medium
CN115182662B (en) * 2022-07-25 2024-05-03 上海集成电路制造创新中心有限公司 Door control method, system, equipment and medium
CN115450526A (en) * 2022-08-11 2022-12-09 岚图汽车科技有限公司 Tail gate opening method and system, electronic equipment and computer storage medium

Also Published As

Publication number Publication date
KR20220002519A (en) 2022-01-06
WO2021212860A1 (en) 2021-10-28
CN111516640B (en) 2022-01-04
JP2022533885A (en) 2022-07-27

Similar Documents

Publication Publication Date Title
CN111516640B (en) Vehicle door control method, vehicle, system, electronic device, and storage medium
CN111332252B (en) Vehicle door unlocking method, device, system, electronic equipment and storage medium
JP7428993B2 (en) Vehicle door unlocking method and device, system, vehicle, electronic device, and storage medium
WO2021000587A1 (en) Vehicle door unlocking method and device, system, vehicle, electronic equipment and storage medium
CN110765936B (en) Vehicle door control method, vehicle door control device, vehicle door control system, vehicle, electronic equipment and storage medium
WO2022048119A1 (en) Vehicle control method and apparatus, electronic device, storage medium, and vehicle
CN110807178B (en) Vehicle authorization management method and device, terminal and server
CN108600202B (en) Information processing method and device and computer readable storage medium
WO2022057212A1 (en) Trunk control method and apparatus, vehicle, electronic device, and storage medium
EP3396982B1 (en) Method and apparatus for vehicle heat dissipation
CN105644501A (en) Method, device and terminal for remote control of automobile
CN114655159A (en) Vehicle control method and device, electronic equipment and vehicle
CN111340665A (en) Help seeking method, help seeking terminal and computer readable storage medium
KR20140111138A (en) System and method for operating tail gate
WO2022222412A1 (en) Smart door lock, audio module control method and apparatus, and storage medium
CN112313601B (en) Vehicle, vision domain controller, video data processing method, apparatus and medium
JP7445207B2 (en) Information processing device, information processing method and program
CN113313857A (en) Vehicle door control method, device and medium
US20240059248A1 (en) Method and apparatus for controlling welcoming of vehicle, medium, device, and vehicle
CN117690167A (en) Fingerprint identification method and electronic equipment
CN118528744A (en) Vehicle door control method and device and vehicle
CN116095469A (en) Method, system, equipment set and storage medium for vehicle monitoring
CN117233500A (en) Intelligent key electric quantity detection method and device, electronic equipment and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant