CN116883977A - Passenger state monitoring method and device, terminal equipment and vehicle - Google Patents
Passenger state monitoring method and device, terminal equipment and vehicle Download PDFInfo
- Publication number
- CN116883977A CN116883977A CN202310879084.XA CN202310879084A CN116883977A CN 116883977 A CN116883977 A CN 116883977A CN 202310879084 A CN202310879084 A CN 202310879084A CN 116883977 A CN116883977 A CN 116883977A
- Authority
- CN
- China
- Prior art keywords
- target
- passenger
- passengers
- vehicle
- remote device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 116
- 238000000034 method Methods 0.000 title claims abstract description 68
- 238000001514 detection method Methods 0.000 claims description 27
- 238000004590 computer program Methods 0.000 claims description 19
- 230000009471 action Effects 0.000 claims description 10
- 238000012806 monitoring device Methods 0.000 claims description 10
- 238000006073 displacement reaction Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 description 8
- 238000013461 design Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000009434 installation Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 206010011469 Crying Diseases 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 230000008451 emotion Effects 0.000 description 2
- 210000000887 face Anatomy 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 210000000707 wrist Anatomy 0.000 description 2
- 206010054196 Affect lability Diseases 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002996 emotional effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 210000004709 eyebrow Anatomy 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 239000000295 fuel oil Substances 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification techniques
- G10L17/06—Decision making techniques; Pattern matching strategies
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Business, Economics & Management (AREA)
- Game Theory and Decision Science (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
The application relates to the technical field of intelligent automobiles, and provides a passenger state monitoring method, a device, terminal equipment and a vehicle, wherein the method comprises the following steps: when a vehicle to be monitored is in a power-on state, acquiring user information in an automobile cabin of the vehicle to be monitored; determining whether a main driver and a target passenger exist in the automobile seat cabin according to the user information; the target passengers are passengers with riding positions being rear seats of the vehicle to be monitored and the ages within a preset age range; when a main driver and a target passenger exist in the automobile cabin, sending a real-time monitoring video of the target passenger to a remote device so as to monitor the passenger state of the target passenger by using the remote device. The method can efficiently and conveniently monitor the passenger state of the target passenger on the vehicle to be monitored.
Description
Technical Field
The present application relates to the field of intelligent automobiles, and in particular, to a method and apparatus for monitoring a passenger status, a terminal device, and a vehicle.
Background
With the improvement of the living standard of people and the rapid development of intelligent automobile technology, driving vehicles to go out becomes one of the common modes of people to go out daily. The passenger status of other passengers in the car cabin may affect the driving status of the driver while driving the vehicle; for example, when there are child passengers in the car cabin, the driving state of the driver is affected by the child's emotional instability, crying, dangerous movements, etc.
In the prior art, when the child state affects the driving safety, a driver manually operates and opens the monitoring device, establishes communication connection with the remote device, and sends the monitoring video to the remote device, and the remote device monitors the child passengers in the vehicle or performs user intervention, but the technical scheme has a complex operation process.
Therefore, how to efficiently and conveniently monitor the status of passengers is a technical problem that needs to be solved by those skilled in the art.
Disclosure of Invention
The application aims to provide a passenger state monitoring method, a device, a terminal device, a vehicle and a computer readable storage medium, which aim to efficiently and conveniently monitor the passenger state.
In a first aspect, the present application provides a method for monitoring a passenger condition. The method comprises the following steps:
when a vehicle to be monitored is in a power-on state, acquiring user information in an automobile cabin of the vehicle to be monitored;
determining whether a main driver and a target passenger exist in the automobile cabin according to the user information; the target passengers are passengers with riding positions being rear seats of the vehicle to be monitored and the ages within a preset age range;
And when the main driver and the target passengers exist in the automobile cabin, sending real-time monitoring video of the target passengers to remote equipment so as to monitor the passenger states of the target passengers by using the remote equipment.
In one embodiment, when the main driver and the target passenger exist in the automobile cabin, sending a real-time monitoring video of the target passenger to a remote device so as to monitor the passenger state of the target passenger by using the remote device, and the method comprises the following steps:
determining the number of passengers of the target passenger when the main driver and the target passenger are present in the car cabin;
and if the number of the passengers is in the preset number range, sending real-time monitoring videos corresponding to the target passengers to a remote device, and displaying the target passengers on the remote device in a split screen mode according to the number of the passengers so as to monitor the passenger state of the target passengers by using the remote device.
In one embodiment, the sending, to the remote device, a real-time monitoring video corresponding to each of the target passengers, and displaying, on the remote device, each of the target passengers in a split screen manner according to the number of passengers, so as to monitor a passenger status of each of the target passengers by using the remote device includes:
If the number of the passengers is in the preset number range, capturing target images corresponding to the target passengers respectively from the real-time monitoring video;
transmitting target images respectively corresponding to the target passengers to a remote device, and displaying the target images on a split screen of the remote device;
determining whether the center points of face frames in the target images of the same target passenger, which are adjacent to each other, are displaced or not according to a preset time interval;
and if the displacement occurs, re-determining the target image of the target passenger, and sending the updated target image to the remote equipment so as to monitor the passenger state of each target passenger by using the remote equipment.
In one embodiment, the passenger status monitoring method further comprises:
and if the number of the passengers is not in the preset number range, cutting the shot picture according to the display proportion of the remote equipment to obtain the real-time monitoring video.
In one embodiment, the user information includes image information and voiceprint information in the vehicle to be monitored; the determining whether a main driver and a target passenger exist in the automobile cabin according to the user information comprises the following steps:
Determining whether a main driver and rear seat passengers exist in the automobile cabin according to the image information;
and determining whether the rear seat passenger is a target passenger according to the image information and the voiceprint information.
In one embodiment, the determining whether a main driver and a rear seat passenger are present in the car cabin according to the image information includes:
when the detection target is in the shooting range of the image acquisition equipment, acquiring image information of the detection target;
and carrying out face recognition on the image information to determine whether a main driver and rear seat passengers exist in the automobile cabin.
In one embodiment, when the main driver and the target passenger exist in the automobile cabin, sending a real-time monitoring video of the target passenger to a remote device, so that after the remote device is used for monitoring the passenger state of the target passenger, the passenger state monitoring method further comprises:
acquiring gesture actions and/or voice prompts of the main driver;
performing operation control on the remote equipment according to the gesture and/or the voice prompt; the operation control comprises calling out or collecting up the real-time monitoring video.
In a second aspect, the present application also provides a passenger status monitoring device. The device comprises:
the system comprises an acquisition module, a control module and a control module, wherein the acquisition module is used for acquiring user information in an automobile cabin of a vehicle to be monitored when the vehicle to be monitored is in a power-on state;
the identification module is used for determining whether a main driver and a target passenger exist in the automobile cabin according to the user information; the target passengers are passengers with riding positions being rear seats of the vehicle to be monitored and the ages within a preset age range;
and the monitoring module is used for sending the real-time monitoring video of the target passenger to a remote device when the main driver and the target passenger exist in the automobile cabin, so that the remote device is used for monitoring the passenger state of the target passenger.
In a third aspect, the application further provides a terminal device. The terminal device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, which processor, when executing the computer program, implements the steps of the method as described above.
In a fourth aspect, the present application also provides a vehicle, including a vehicle body, and further including a controller, where the controller performs the steps of the method described above.
In a fifth aspect, the present application also provides a computer-readable storage medium. The computer readable storage medium stores a computer program which, when executed by a processor, implements the steps of the method as described above.
The application provides a passenger state monitoring method, which is characterized in that when a target passenger of a main driver and a rear seat exists in an automobile cabin of a vehicle to be monitored, a real-time monitoring video of the target passenger is actively sent to a remote device, namely, the real-time monitoring video can be sent to the remote device without depending on manual operation of the driver, so that the method can efficiently and conveniently monitor the passenger state of the target passenger on the vehicle to be monitored.
It can be appreciated that the passenger state monitoring device, the terminal device, the vehicle and the computer readable storage medium provided in the embodiments of the present application have the same beneficial effects as the passenger state monitoring method described above, and are not described herein again.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are needed in the description of the embodiments or the prior art will be briefly described, and it is obvious that the drawings in the description below are some embodiments of the present application, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a method for monitoring a passenger status according to an embodiment of the present application;
FIG. 2 is a schematic diagram of constructing a three-dimensional coordinate system with the tip of the nose of the detection target as the origin in an embodiment of the present application;
FIG. 3 is a flow chart of another method for monitoring a passenger status according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a passenger status monitoring device according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a terminal device according to an embodiment of the present application.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth such as the particular system architecture, techniques, etc., in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
It should be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It should also be understood that the term "and/or" as used in the present specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
As used in the present description and the appended claims, the term "if" may be interpreted as "when..once" or "in response to a determination" or "in response to detection" depending on the context. Similarly, the phrase "if a determination" or "if a [ described condition or event ] is detected" may be interpreted in the context of meaning "upon determination" or "in response to determination" or "upon detection of a [ described condition or event ]" or "in response to detection of a [ described condition or event ]".
Furthermore, the terms "first," "second," "third," and the like in the description of the present specification and in the appended claims, are used for distinguishing between descriptions and not necessarily for indicating or implying a relative importance.
Reference in the specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," and the like in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise. "plurality" means "two or more".
The passenger state monitoring method provided by the embodiment of the application can be executed by the processor of the terminal equipment when the corresponding computer program is run.
Fig. 1 is a flowchart of a passenger status monitoring method according to an embodiment of the present application, and for convenience of explanation, only a portion related to the present embodiment is shown, where the method provided by the present embodiment includes the following steps:
s100: and when the vehicle to be monitored is in a power-on state, acquiring user information in the automobile cabin of the vehicle to be monitored.
The vehicle to be monitored refers to a vehicle needing to monitor the state of passengers, and may be a fuel-oil vehicle or an electric vehicle, and the specific type of the vehicle to be monitored is not limited in this embodiment.
The vehicle to be monitored is in a power-on state, namely the vehicle to be monitored is in a state after ignition, and the vehicle to be monitored is in a state of being ready to start driving or being in running. More specifically, for a fuel automobile, the vehicle to be monitored is in a power-on state, which is a state corresponding to the vehicle to be monitored after a user performs door opening and card swiping; for an electric automobile, the state that the vehicle to be monitored is in the power-on state is the state corresponding to the state that the vehicle to be monitored is in after soft start. In a specific embodiment, after each power-up of the vehicle to be monitored, if the vehicle to be monitored is in P gear (park), user information in the cabin of the vehicle to be monitored is obtained.
Wherein, the automobile cabin refers to the space where the driver and the passengers in the vehicle are to be monitored; the user information comprises information corresponding to the driver and the passengers in the automobile cabin, and specifically comprises whether a main driver exists, the positions of the passengers on the vehicle to be monitored, the number of the passengers and the like.
In actual operation, image information in a car seat cabin can be acquired by using image acquisition equipment preset in a vehicle to be monitored, face recognition is carried out on the image information, and user information is determined by combining a face recognition result, an installation position of the image acquisition equipment and a riding position of a user object corresponding to the recognized face.
S200: determining whether a main driver and a target passenger exist in the automobile seat cabin according to the user information; the target passengers are passengers with riding positions being rear seats of the vehicle to be monitored and the ages within a preset age range.
In the step, analysis and judgment are carried out according to the determined user information, and whether a main driver and a target passenger exist in the automobile cabin of the vehicle to be monitored or not is determined. In specific implementation, determining whether a main driver and a target passenger exist in an automobile cabin includes at least two conditions, wherein one condition is whether only the main driver and the target passenger exist in the automobile cabin, namely, whether the main driver and the target passenger exist in a main driver seat, a passenger does not exist in a co-driver seat and a rear seat of the automobile to be monitored, and the age of the passenger is in a preset age range; another is whether the main driver and the target passengers are included in the car cabin, i.e. the car cabin has other passengers in addition to the main driver and the target passengers, such as in the case of a passenger in the co-driver seat.
It should be noted that, in this embodiment, the preset age range of the target passenger is not limited, and the target passenger is set according to actual requirements. For example, the preset age range may be an age range representing the passenger as a child, or an age range representing the passenger as an elderly person. In a specific embodiment, based on the intelligent care monitoring scenario of the child user, the preset age range is set as the age range representing that the passenger is a child, and the specific value interval of the preset age range can be set according to the requirement, which is not limited in this embodiment. More specifically, if the age range of the child is defined to be less than or equal to 12 years old, the age range of the adult is defined to be more than 12 years old, i.e., the preset age range corresponding to the target passenger is defined to be less than or equal to 12 years old. In actual operation, an error range may also be set, that is, when the age of the identified passenger is within the error range of the preset age range, it is determined that the age of the passenger is within the preset age range; the error range may be a preset age range ± 3 years old.
S300: when a main driver and a target passenger exist in the automobile cabin, sending a real-time monitoring video of the target passenger to a remote device so as to monitor the passenger state of the target passenger by using the remote device.
In the step, when the main driver and the target passenger exist in the automobile seat cabin, the remote equipment is used for monitoring the passenger state of the target passenger. Specifically, whether the remote equipment currently calls out a real-time monitoring video or not is judged, namely whether intelligent back-row monitoring of the remote equipment is in an on state or not is judged; if the real-time monitoring video is not called currently (the intelligent back-row monitoring is in a closed state), determining the real-time monitoring video of the target passenger, opening the intelligent back-row monitoring of the remote equipment, and sending the real-time monitoring video of the target passenger to the remote equipment; if the real-time monitoring video is called up currently (the intelligent back-row monitoring is in an on state), the real-time monitoring video is not repeatedly sent to the remote equipment. After receiving the real-time monitoring video, the remote device displays the real-time monitoring video through an application program or in a widget position; and other users monitor the passenger state of the target passenger in the vehicle to be monitored through the real-time monitoring video displayed by the remote equipment.
It should be noted that in actual operation, the remote device may also perform remote operation on the vehicle to be monitored, for example, when detecting that the emotion of the target passenger is abnormal, the remote device controls the intelligent device of the vehicle to be monitored to play music or other types of audio, or establishes a voice call with the vehicle to be monitored to pacify the emotion of the target passenger; emotional abnormalities include crying, violence, panic, and the like.
The embodiment of the application provides a passenger state monitoring method, which is characterized in that when a target passenger of a main driver and a rear seat exists in an automobile cabin of a vehicle to be monitored, a real-time monitoring video of the target passenger is actively sent to a remote device, namely, the real-time monitoring video can be sent to the remote device without depending on manual operation of the driver, so that the method can efficiently and conveniently monitor the passenger state of the target passenger on the vehicle to be monitored.
On the basis of the above embodiment, the technical solution is further described and optimized in this embodiment, and specifically, in this embodiment, when a main driver and a target passenger exist in an automobile cabin, a real-time monitoring video of the target passenger is sent to a remote device, so that the remote device is used to monitor a passenger state of the target passenger, where the method includes:
determining the number of passengers of the target passenger when the main driver and the target passenger exist in the automobile cabin;
if the number of the passengers is in the preset number range, sending real-time monitoring videos corresponding to the target passengers to the remote equipment, and monitoring the passenger states of the target passengers by using the remote equipment.
The preset number range is generally within the range of the number of passengers of the rear seats, and can be set according to actual requirements. When a main driver and a target passenger exist in the automobile cabin, further carrying out face recognition on the image information, and determining the number of passengers of the target passenger according to the number of recognized faces and the same number of faces.
Then, judging whether the number of passengers is within a preset number range; if the number of the passengers is in the preset number range, sending real-time monitoring videos corresponding to the target passengers to the remote equipment, and displaying the target passengers on the remote equipment in a split screen mode according to the number of the passengers; that is, for each target passenger, the real-time monitoring video corresponding to the target passenger is displayed by using the corresponding split screen at the remote device. And the other users monitor the passenger state of each target passenger through the real-time monitoring videos respectively corresponding to each target user and displayed by the remote equipment.
In a specific embodiment, if the target passenger is a child passenger on a rear seat of the vehicle to be monitored, when detecting that 2 children are on the rear seat, dividing a display area of the remote device into two, outputting a face frame center point of the child through a sensing algorithm, taking the face frame center point of each child as a center, cutting rear-row shooting pictures (based on a UI design (User Interface Design, an interface design)) according to a proportion of the transversely-divided remote device, obtaining rear-row shooting pictures corresponding to each child respectively, and scaling the cut rear-row shooting pictures in the same proportion to adapt to the display area corresponding to each split screen of the remote device.
According to the method, corresponding real-time monitoring videos can be displayed for each target passenger independently, interference of other factors is avoided, and effectiveness of passenger state monitoring is improved.
On the basis of the above embodiment, the present embodiment further describes and optimizes the technical solution, and specifically, in this embodiment, if the number of passengers is within a preset number range, sending real-time monitoring videos corresponding to each target passenger to the remote device, and displaying each target passenger on the remote device in a split screen according to the number of passengers, so as to monitor the passenger status of each target passenger by using the remote device, where the method includes:
if the number of the passengers is in the preset number range, capturing target images corresponding to the target passengers respectively from the real-time monitoring video;
transmitting target images corresponding to the target passengers respectively to the remote equipment, and displaying the target images on the remote equipment in a split screen mode;
determining whether the center point of a face frame in the target image of the same target passenger, which is adjacent to the target passenger, is displaced or not according to a preset time interval;
if the displacement occurs, the target image of the target passenger is redetermined, and the updated target image is sent to the remote device, so that the remote device is used for monitoring the passenger state of each target passenger.
Specifically, after the real-time monitoring video is acquired, if the number of passengers is within a preset number range, determining a target frame image in the real-time monitoring video, identifying each target passenger in the target frame image, and intercepting target images corresponding to each target passenger from the target frame image; and sending target images corresponding to the target passengers respectively to the remote equipment, and displaying the target images on the remote equipment in a split screen mode.
Then, determining a next target frame image in the real-time monitoring video according to a preset time interval, and identifying each target passenger in the next target frame image to obtain a next target image; judging whether the positions of the center points of the face frames in the target image and the next target image are displaced or not according to each target passenger; determining whether a deviation value of the center point position of the face frame in the target image and the next target image exceeds a deviation threshold value; if the displacement occurs (the deviation threshold is exceeded), the next target image is taken as the updated target image of the target passengers, and the updated target image is sent to the remote equipment so as to monitor the passenger state of each target passenger by using the remote equipment. In this embodiment, the specific value of the preset time interval is not limited, and the preset time interval may be 5s.
That is, in this embodiment, whether the center point of the face frame corresponding to each target passenger is displaced is determined at intervals of a preset time, and the target image corresponding to the target passenger displayed by the remote device is updated when the displacement is determined, so that the state of the target passenger can be updated in time while the stability of the display of the remote device is ensured, and the accuracy of monitoring the state of the passenger is improved.
On the basis of the above embodiment, the technical solution is further described and optimized in this embodiment, and specifically, in this embodiment, a method for monitoring a passenger status further includes:
if the number of passengers is not in the preset number range, cutting the shot picture according to the display proportion of the remote equipment to obtain the real-time monitoring video.
Specifically, in this embodiment, when it is determined that the number of passengers of the target passenger is not within the preset number range, the rear-row shooting picture is directly cut, so as to obtain a real-time monitoring video suitable for the display proportion of the remote device.
More specifically, when the number of passengers of the target passenger is greater than the upper limit value in the preset number range, the display proportion of the remote device and the center point of the rear-row shooting picture can be determined first, then the shooting picture is cut according to the display proportion of the remote device by taking the center point of the rear-row shooting picture as the center, and the real-time monitoring video is obtained.
Or when the number of passengers of the target passengers is 1, the display proportion of the remote equipment and the center point of the face frame of the child can be determined, then the shot picture is cut according to the display proportion of the remote equipment by taking the center point of the face frame of the child as the center, and the real-time monitoring video is obtained.
In a specific embodiment, if the target passenger is a child passenger on a rear seat of the vehicle to be monitored, assuming that the preset number range is 2-3, when only 1 child is detected on the rear seat, outputting a face frame center point of the child through a sensing algorithm, taking the face frame center point of the child as a center, cutting a rear photographing picture (based on a UI design (User Interface Design, an interface design)) according to a display proportion of the remote device, and scaling the cut photographing picture in a same proportion to adapt to a display area of the remote device. When the children of the rear seats are detected to be more than 3 persons, the rear shooting pictures are cut according to the display proportion of the remote equipment by taking the central point of the rear shooting pictures as the center, and the cut rear shooting pictures are displayed by the remote equipment, namely the real-time monitoring video is displayed.
Therefore, according to the method of the embodiment, the states of all target passengers can be completely and comprehensively displayed, namely the comprehensiveness and the accuracy of passenger state monitoring are improved.
On the basis of the above embodiment, the technical solution is further described and optimized in this embodiment, and specifically, in this embodiment, the user information includes image information and voiceprint information in the vehicle to be monitored; determining whether a primary driver and a target passenger are present in the automobile cabin according to the user information, comprising:
determining whether a main driver and a rear seat passenger exist in the automobile seat cabin according to the image information;
and determining whether the rear seat passenger is a target passenger according to the image information and the voiceprint information.
The user information in the embodiment comprises image information and voiceprint information in the vehicle to be monitored; the image information refers to information in the automobile cabin acquired by the image acquisition device, and the voiceprint information refers to information in the automobile cabin acquired by the sound acquisition device.
Specifically, after the user information in the automobile cabin is acquired, the image information is firstly subjected to face recognition, and the user information is determined according to a face recognition result, the installation position of the image acquisition equipment and the riding position of the user object corresponding to the recognized face. More specifically, the first shooting device can be used for collecting image information corresponding to the main driver seat and the auxiliary driver seat, and if face information is identified in the image information, whether the main driver seat in the automobile seat cabin has a main driver or not and whether the auxiliary driver seat has a passenger or not are determined according to the sitting position of the identified face information and the installation position of the first shooting device; and acquiring image information corresponding to the rear seat by using a second shooting device, and determining that the rear seat passenger exists in the automobile seat cabin if the face information is identified in the image information.
After the rear-seat passengers are determined, age identification is performed according to the image information and the voiceprint information corresponding to the rear-seat passengers, and whether the ages of the rear-seat passengers are within a preset age range or not is determined, namely whether the rear-seat passengers are target passengers or not is determined.
In this embodiment, whether the rear seat in the vehicle to be monitored is the target passenger is determined by combining the image information and the voiceprint information, so that the target passenger can be determined more accurately, the target passenger is prevented from being identified by mistake, and the accuracy of monitoring the passenger state is improved.
On the basis of the above embodiment, the present embodiment further describes and optimizes a technical solution, and specifically, in this embodiment, determining whether a main driver and a rear seat passenger exist in a car seat cabin according to image information includes:
when the detection target is in the shooting range of the image acquisition equipment, acquiring image information of the detection target;
and carrying out face recognition on the image information to determine whether a main driver and rear seat passengers exist in the automobile cabin.
In actual operation, after a vehicle to be monitored is in a power-on state, the image acquisition equipment judges whether a detection target is in a shooting range of the detection target; if the detection target is in the shooting range of the image acquisition equipment, acquiring image information of the detection target, namely acquiring user information in a car cabin; if the detection target is not in the shooting range of the image acquisition equipment, continuing to detect until the detection target is in the shooting range of the image acquisition equipment or a control instruction for ending the detection is received. After the image information is acquired, the image information is subjected to face recognition to determine whether a main driver and a rear seat passenger exist in the automobile seat cabin.
In a specific embodiment, assuming that the detection target is a main driver, the detection target is positioned on a main driver seat, is seen in a binocular head-up mode, faces the image acquisition equipment on the front surface, and the distance between the face of the detection target and the image acquisition equipment is 40-60 cm; a three-dimensional coordinate system is constructed with the tip of the nose of the detection target as the origin, as shown in fig. 2, in which the z-axis is the line-of-sight direction. The recognition range of the image acquisition device is as follows:
x(PITCH)：[-30°,30°]；
y(YAW)：[-45°,45°]；
z(ROLL)：[-30°,30°]。
that is, when the distance between the face of the detection target and the image capturing apparatus is within the specified range and the face of the detection target is within the recognition range of the image capturing apparatus, the image capturing apparatus captures the image information of the detection target.
It should be noted that, when the image information is collected, it is required to ensure that the pixels of the image information are greater than or equal to a preset standard, for example 96px, to ensure the accuracy of face recognition for the image information.
In addition, in the face recognition process, the face recognition algorithm can support face recognition under the condition of different illumination scenes, wherein the different illumination scenes comprise daytime, night, forward light, side light, backlight, shade sunlight alternate flickering, atmosphere lamps and the like; the face recognition algorithm can support face recognition under the face shielding condition, and the face shielding condition comprises a mask, glasses and a sunglasses shielding condition; the face recognition algorithm can support face recognition under the condition of face makeup, and the face makeup comprises make-up changes of eyes, eyebrows, mouth, nose, skin and the like.
Therefore, the image information in the automobile cabin is acquired only when the detection target is determined to be in the shooting range of the image acquisition device, so that the image information acquired by the method is more accurate, and the accuracy of passenger state monitoring based on the image information can be improved.
Fig. 3 is a flowchart of another passenger status monitoring method according to an embodiment of the present application. On the basis of the above embodiment, the technical solution is further described and optimized in this embodiment, and specifically, in this embodiment, when a main driver and a target passenger exist in an automobile cabin, a real-time monitoring video of the target passenger is sent to a remote device, so that after the remote device is used to monitor the passenger state of the target passenger, a passenger state monitoring method further includes:
acquiring gesture actions and/or voice prompts of a main driver;
performing operation control on the remote equipment according to gesture actions and/or voice prompts; the operation control comprises calling out or collecting up the real-time monitoring video.
Specifically, when a vehicle to be detected is in a power-on state, performing OMS (Occupancy Monitoring System, passenger monitoring system) passenger identification, and when a main driver and a target passenger exist in an automobile cabin, judging whether intelligent back-row monitoring of remote equipment is in an on state or not, and if so, acquiring gesture actions and/or voice prompts of the main driver; determining a corresponding operation instruction according to the gesture action and/or the voice prompt, sending the operation instruction to the remote equipment, and determining to execute corresponding operation control by the remote equipment according to the received operation instruction, wherein the operation control comprises calling out or collecting up a real-time monitoring video; if the main driver is not present or the target passenger is not present in the automobile cabin, ending the process.
In a specific embodiment, the case of performing operation control on the remote device according to the gesture action is as follows:
case 1: when the intelligent back-row monitoring switch is in an on state, when detecting that the palm faces the main driving window, the palm and the finger swing leftwards in a plane by taking the wrist as a rotating point, and the left swing degree exceeds [ -20 degrees, 0 degrees ], and the fixed point time length on the right side is greater than or equal to 1 s', correspondingly generating a picture calling command, and calling the real-time monitoring video of the remote equipment;
case 2: when the remote device opens the real-time monitoring video, when detecting that the palm faces the main driving window and the palm and the fingers swing rightwards in a plane by taking the wrist as a rotating point, and the right swing degree exceeds [0 degrees ], +20 degrees ] ], and the left fixed point time length is greater than or equal to 1 s', a picture packing-up command is correspondingly generated, and the real-time monitoring video of the remote device is packed up.
Therefore, according to the method of the embodiment, the operation control can be performed on the real-time monitoring video according to the gesture action or the voice prompt of the main driver, and the convenience of monitoring the passenger state can be further improved.
It should be understood that the sequence number of each step in the foregoing embodiment does not mean that the execution sequence of each process should be determined by the function and the internal logic, and should not limit the implementation process of the embodiment of the present application.
Fig. 4 is a schematic structural diagram of a passenger status monitoring device according to an embodiment of the present application. As shown in fig. 4, the passenger state monitoring device of this embodiment includes an acquisition module 410, an identification module 420, and a monitoring module 430; wherein, the liquid crystal display device comprises a liquid crystal display device,
the acquiring module 410 is configured to acquire user information in an automobile cabin of the vehicle to be monitored when the vehicle to be monitored is in a power-on state;
an identification module 420 for determining whether a main driver and a target passenger exist in the car cabin according to the user information; the target passengers are passengers with riding positions being rear seats of the vehicle to be monitored and the ages within a preset age range;
the monitoring module 430 is configured to send a real-time monitoring video of the target passenger to the remote device when the main driver and the target passenger exist in the car cabin, so as to monitor the passenger status of the target passenger by using the remote device.
The passenger state monitoring device provided by the embodiment of the application has the same beneficial effects as the passenger state monitoring method.
In one embodiment, the monitoring module 430 includes:
a number determination submodule for determining the number of passengers of the target passenger when the main driver and the target passenger exist in the automobile cabin;
And the data transmission sub-module is used for transmitting real-time monitoring videos corresponding to the target passengers to the remote equipment if the number of the passengers is in the preset number range, and displaying the target passengers on the remote equipment in a split screen mode according to the number of the passengers so as to monitor the passenger state of the target passengers by using the remote equipment.
In one embodiment, the data transmission submodule includes:
the image determining unit is used for intercepting target images corresponding to each target passenger from the real-time monitoring video if the number of the passengers is in a preset number range;
the transmitting unit is used for transmitting target images corresponding to the target passengers respectively to the remote equipment and displaying the target images on the remote equipment in a split screen mode;
the judging unit is used for determining whether the center point of the face frame in the target images of the same target passenger, which are adjacent to each other, is displaced or not according to a preset time interval;
and the updating unit is used for re-determining the target image of the target passenger if the displacement occurs, and sending the updated target image to the remote equipment so as to monitor the passenger state of each target passenger by using the remote equipment.
In one embodiment, a passenger condition monitoring device further comprises:
And the adjusting unit is used for cutting the shooting picture according to the display proportion of the remote equipment to obtain the real-time monitoring video if the number of passengers is not in the preset number range.
In one embodiment, the user information includes image information and voiceprint information within the vehicle to be monitored; the identification module 420 includes:
the first determining submodule is used for determining whether a main driver and a rear seat passenger exist in the automobile seat cabin according to the image information;
and the second determination submodule is used for determining whether the rear seat passenger is a target passenger or not according to the image information and the voiceprint information.
In one embodiment, the first determination submodule includes:
the acquisition unit is used for acquiring image information of the detection target when the detection target is in the shooting range of the image acquisition equipment;
and the identification unit is used for carrying out face recognition on the image information and determining whether a main driver and a rear seat passenger exist in the automobile seat cabin.
In one embodiment, a passenger condition monitoring device further comprises:
the operation acquisition module is used for acquiring gesture actions and/or voice prompts of the main driver;
the control module is used for performing operation control on the remote equipment according to gesture actions and/or voice prompts; the operation control comprises calling out or collecting up the real-time monitoring video.
It should be noted that, because the content of information interaction and execution process between the above devices/units is based on the same concept as the method embodiment of the present application, specific functions and technical effects thereof may be referred to in the method embodiment section, and will not be described herein.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, the specific names of the functional units and modules are only for distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.
Fig. 5 is a schematic structural diagram of a terminal device according to an embodiment of the present application. As shown in fig. 5, the terminal device 500 of this embodiment includes a memory 501, a processor 502, and a computer program 503 stored in the memory 501 and executable on the processor 502; the processor 502, when executing the computer program 503, implements the steps of the various passenger condition monitoring method embodiments described above, such as S100 to S300 shown in fig. 1; or the processor 502, when executing the computer program 503, performs the functions of the modules/units in the above-described apparatus embodiments, such as the functions of the acquisition module, the identification module, and the monitoring module shown in fig. 3.
By way of example, the computer program 503 may be divided into one or more modules/units, which are stored in the memory 501 and executed by the processor 502 to implement the methods of embodiments of the present application. One or more of the modules/units may be a series of computer program instruction segments capable of performing a specific function for describing the execution of the computer program 503 in the terminal device 500. For example, the computer program 503 may be divided into an acquisition module, an identification module, and a monitoring module, each of which specifically functions as follows:
The acquisition module is used for acquiring user information in the automobile cabin of the vehicle to be monitored when the vehicle to be monitored is in a power-on state;
the identification module is used for determining whether a main driver and a target passenger exist in the automobile seat cabin according to the user information; the target passengers are passengers with riding positions being rear seats of the vehicle to be monitored and the ages within a preset age range;
and the monitoring module is used for sending the real-time monitoring video of the target passenger to the remote equipment when the main driver and the target passenger exist in the automobile cabin, so that the remote equipment is used for monitoring the passenger state of the target passenger.
In application, the terminal device 500 may be a computing device such as a desktop computer, a notebook computer, a palm computer, and a cloud server. Terminal device 500 may include, but is not limited to, memory 501 and processor 502. It will be appreciated by those skilled in the art that fig. 5 is merely an example of a terminal device and is not meant to be limiting, and may include more or fewer components than shown, or may combine certain components, or different components, e.g., a terminal device may also include an input-output device, a network access device, a bus, etc.; the input and output equipment can comprise a camera, an audio acquisition/play device, a display screen and the like; the network access device may include a communication module for wireless communication with an external device.
In application, the processor may be a central processing unit (Central Processing Unit, CPU), or other general purpose processor, digital signal processor (Digital Signal Processor, DSP), application specific integrated circuit (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
In an application, the memory may be an internal storage unit of the terminal device, such as a hard disk or a memory of the terminal device; external storage devices of the terminal device, for example, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) and the like, which are provided on the terminal device; it may also comprise both an internal memory unit of the terminal device and an external memory device. The memory is used to store an operating system, application programs, boot Loader (Boot Loader), data, and other programs, etc., such as program code for a computer program, etc. The memory may also be used to temporarily store data that has been output or is to be output.
The embodiment of the application also provides a vehicle, which comprises a vehicle body and a controller, wherein the controller executes the steps in the method embodiments.
The vehicle provided by the embodiment of the application has the same beneficial effects as the passenger state monitoring method.
The embodiments of the present application also provide a computer readable storage medium storing a computer program, which when executed by a processor, implements the steps of the above-described method embodiments.
The computer readable storage medium provided by the embodiment of the application has the same beneficial effects as the passenger state monitoring method.
The present application may be implemented in whole or in part by a computer program which, when executed by a processor, performs the steps of the method embodiments described above, and which may be embodied in a computer readable storage medium. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include at least: any entity or device capable of carrying computer program code to a terminal device, a recording medium, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunication signal, and a software distribution medium. Such as a U-disk, removable hard disk, magnetic or optical disk, etc.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.
Those of ordinary skill in the art will appreciate that the various illustrative apparatus and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided by the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the embodiments of the apparatus described above are illustrative only, and the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, the apparatus may be indirectly coupled or in communication connection, whether in electrical, mechanical or other form.
The above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application, and are intended to be included in the scope of the present application.
Claims (10)
1. A method of monitoring a passenger condition, the method comprising:
when a vehicle to be monitored is in a power-on state, acquiring user information in an automobile cabin of the vehicle to be monitored;
determining whether a main driver and a target passenger exist in the automobile cabin according to the user information; the target passengers are passengers with riding positions being rear seats of the vehicle to be monitored and the ages within a preset age range;
and when the main driver and the target passengers exist in the automobile cabin, sending real-time monitoring video of the target passengers to remote equipment so as to monitor the passenger states of the target passengers by using the remote equipment.
2. The method of claim 1, wherein said transmitting real-time surveillance video of said target passenger to a remote device for passenger status surveillance of said target passenger with said remote device when said primary driver and said target passenger are present in said car cabin comprises:
determining the number of passengers of the target passenger when the main driver and the target passenger are present in the car cabin;
and if the number of the passengers is in the preset number range, sending real-time monitoring videos corresponding to the target passengers to a remote device, and displaying the target passengers on the remote device in a split screen mode according to the number of the passengers so as to monitor the passenger state of the target passengers by using the remote device.
3. The method of claim 2, wherein the transmitting the real-time monitoring video corresponding to each of the target passengers to the remote device and displaying each of the target passengers on the remote device in a split screen according to the number of passengers so as to monitor the passenger status of each of the target passengers using the remote device comprises:
if the number of the passengers is in the preset number range, capturing target images corresponding to the target passengers respectively from the real-time monitoring video;
Transmitting target images respectively corresponding to the target passengers to a remote device, and displaying the target images on a split screen of the remote device;
determining whether the center points of face frames in the target images of the same target passenger, which are adjacent to each other, are displaced or not according to a preset time interval;
and if the displacement occurs, re-determining the target image of the target passenger, and sending the updated target image to the remote equipment so as to monitor the passenger state of each target passenger by using the remote equipment.
4. A method according to claim 3, characterized in that the method further comprises:
and if the number of the passengers is not in the preset number range, cutting the shot picture according to the display proportion of the remote equipment to obtain the real-time monitoring video.
5. The method of claim 1, wherein the user information comprises image information and voiceprint information within the vehicle to be monitored; the determining whether a main driver and a target passenger exist in the automobile cabin according to the user information comprises the following steps:
determining whether a main driver and rear seat passengers exist in the automobile cabin according to the image information;
And determining whether the rear seat passenger is a target passenger according to the image information and the voiceprint information.
6. The method of claim 5, wherein said determining from said image information whether a primary driver and a rear seat passenger are present in said vehicle cabin comprises:
when the detection target is in the shooting range of the shooting device, acquiring image information of the detection target;
and carrying out face recognition on the image information to determine whether a main driver and rear seat passengers exist in the automobile cabin.
7. The method according to any one of claims 1 to 6, wherein when the main driver and the target passenger are present in the car cabin, transmitting a real-time monitoring video of the target passenger to a remote device so that after the passenger status monitoring of the target passenger by the remote device, the method further comprises:
acquiring gesture actions and/or voice prompts of the main driver;
performing operation control on the remote equipment according to the gesture and/or the voice prompt; the operation control comprises calling out or collecting up the real-time monitoring video.
8. A passenger condition monitoring device, the device comprising:
The system comprises an acquisition module, a control module and a control module, wherein the acquisition module is used for acquiring user information in an automobile cabin of a vehicle to be monitored when the vehicle to be monitored is in a power-on state;
the identification module is used for determining whether a main driver and a target passenger exist in the automobile cabin according to the user information; the target passengers are passengers with riding positions being rear seats of the vehicle to be monitored and the ages within a preset age range;
and the monitoring module is used for sending the real-time monitoring video of the target passenger to a remote device when the main driver and the target passenger exist in the automobile cabin, so that the remote device is used for monitoring the passenger state of the target passenger.
9. A terminal device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any of claims 1 to 7 when the computer program is executed.
10. A vehicle comprising a vehicle body, further comprising a controller, the controller performing the steps of the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310879084.XA CN116883977A (en) | 2023-07-17 | 2023-07-17 | Passenger state monitoring method and device, terminal equipment and vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310879084.XA CN116883977A (en) | 2023-07-17 | 2023-07-17 | Passenger state monitoring method and device, terminal equipment and vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116883977A true CN116883977A (en) | 2023-10-13 |
Family
ID=88269473
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310879084.XA Pending CN116883977A (en) | 2023-07-17 | 2023-07-17 | Passenger state monitoring method and device, terminal equipment and vehicle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116883977A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117146828A (en) * | 2023-10-30 | 2023-12-01 | 网思科技股份有限公司 | Method and device for guiding picking path, storage medium and computer equipment |
-
2023
- 2023-07-17 CN CN202310879084.XA patent/CN116883977A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117146828A (en) * | 2023-10-30 | 2023-12-01 | 网思科技股份有限公司 | Method and device for guiding picking path, storage medium and computer equipment |
| CN117146828B (en) * | 2023-10-30 | 2024-03-19 | 网思科技股份有限公司 | Method and device for guiding picking path, storage medium and computer equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112016457A (en) | Driver distraction and dangerous driving behavior recognition method, device and storage medium | |
| US11084424B2 (en) | Video image output apparatus, video image output method, and medium | |
| CN116883977A (en) | Passenger state monitoring method and device, terminal equipment and vehicle | |
| CN112083795A (en) | Object control method and device, storage medium and electronic equipment | |
| CN109291794A (en) | Driver status monitoring method, automobile and storage medium | |
| US11453401B2 (en) | Closed eye determination device | |
| CN112183200B (en) | Eye movement tracking method and system based on video image | |
| CN111027506B (en) | Method and device for determining sight direction, electronic equipment and storage medium | |
| EP3440592A1 (en) | Method and system of distinguishing between a glance event and an eye closure event | |
| CN113895357B (en) | Rearview mirror adjustment method, device, equipment and storage medium | |
| CN110949272A (en) | Vehicle-mounted display equipment adjusting method and device, vehicle, medium and equipment | |
| CN113313019A (en) | Distracted driving detection method, system and related equipment | |
| US20210146934A1 (en) | Vehicle operation assistance device, vehicle operation assistance method, and program | |
| CN113002461A (en) | Virtual image position adjusting method, device and storage medium of AR-HUD system | |
| CN115643483A (en) | Terminal equipment control method and device, readable storage medium and terminal equipment | |
| WO2017096821A1 (en) | Driving safety detection method and apparatus | |
| CN113561988A (en) | Voice control method based on sight tracking, automobile and readable storage medium | |
| CN115116439A (en) | Voice control method and device, terminal equipment and storage medium | |
| EP4312205A1 (en) | Control device, glasses-type information display device, control method, and control program | |
| CN117576667A (en) | Vehicle interior monitoring method, device, equipment and storage medium | |
| WO2023105700A1 (en) | Update determination device and update determination method | |
| CN113657212A (en) | Fatigue detection method and related device | |
| EP4286200A1 (en) | A vehicle, a system and a method for reducing motion sickness for a passenger of a moving vehicle | |
| CN116503826A (en) | Method and device for avoiding passengers from disliked outside-vehicle pictures, electronic equipment and storage medium | |
| CN114643861A (en) | Central control screen adjusting method and related equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |