CN115214462A - Sight line reminding method and device for vehicle-mounted rearview mirror, vehicle and storage medium - Google Patents
Sight line reminding method and device for vehicle-mounted rearview mirror, vehicle and storage medium Download PDFInfo
- Publication number
- CN115214462A CN115214462A CN202211057571.XA CN202211057571A CN115214462A CN 115214462 A CN115214462 A CN 115214462A CN 202211057571 A CN202211057571 A CN 202211057571A CN 115214462 A CN115214462 A CN 115214462A
- Authority
- CN
- China
- Prior art keywords
- reminding
- vehicle
- rearview mirror
- passenger
- driver
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 230000003287 optical effect Effects 0.000 claims abstract description 35
- 230000000007 visual effect Effects 0.000 claims abstract description 17
- 238000004590 computer program Methods 0.000 claims description 9
- 238000004891 communication Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 230000000903 blocking effect Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 230000037237 body shape Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
- Traffic Control Systems (AREA)
Abstract
The application relates to a sight line reminding method and device for a vehicle-mounted rearview mirror, a vehicle and a storage medium, wherein the method comprises the following steps: acquiring image data of a passenger driving position and/or a rear row position; identifying actual positions of parts of the body of the secondary driver and/or the rear passenger based on the image data, and determining relative positions in a visual plane of the driver based on the actual positions; the relative position is compared with the preset shielding position, and when the relative position overlaps with the preset shielding position, at least one acoustic reminding device and/or at least one optical reminding device are controlled to perform acoustic reminding and/or optical reminding.
Description
Technical Field
The application relates to the technical field of in-vehicle vision, in particular to a sight line reminding method and device for a vehicle-mounted rearview mirror, a vehicle and a storage medium.
Background
The in-car vision in the intelligent cabin occupies a certain proportion in the intelligent cabin, and information such as face information, face position, user body position and the like can be identified by using an intelligent algorithm of the in-car vision, so that the camera can perform visual identification to judge the position of a certain limb of a person.
At present, the related art can detect shielding through a radar, and can remind a driver of shielding the sight of observing the rearview mirror, so that the driver can make adjustment in time, and accidents are avoided.
However, the use of radar in vehicles in the related art involves problems with radiation in vehicles, and is less feasible.
Disclosure of Invention
The application provides a sight line reminding method and device for a vehicle-mounted rearview mirror, a vehicle and a storage medium, and aims to solve the problems that the sight line of a driver observing the rearview mirror is easily blocked by passengers, driving safety is greatly threatened, and the like.
An embodiment of a first aspect of the application provides a sight line reminding method for a vehicle-mounted rearview mirror, which comprises the following steps: acquiring image data of a passenger driving position and/or a rear row position; identifying actual positions of various parts of the body of the secondary driver and/or the rear passenger based on the image data, and determining relative positions in a visual plane of the driver based on the actual positions; and comparing the relative position with a preset shielding position, and controlling at least one acoustic reminding device and/or at least one optical reminding device to carry out acoustic reminding and/or optical reminding when the relative position is overlapped with the preset shielding position.
Optionally, in an embodiment of the present application, before comparing the relative position with the preset occlusion position, the method further includes: collecting body type data of the passenger and/or the back-row passenger; and determining the preset shielding position according to the actual seat pose corresponding to the auxiliary driving position and/or the rear row position and the body type data.
Optionally, in an embodiment of the present application, before acquiring the image data of the rider position and/or the rear row position, the method further includes: identifying a gaze intent of the driver; and when the sight intention is a rearview mirror observation intention, controlling the vehicle to enter a rearview mirror shielding reminding mode.
Optionally, in an embodiment of the present application, the identifying the driver's gaze intention includes: detecting the current working condition of the vehicle; and when the current working condition is detected to be a reversing working condition, a turning working condition or a lane changing working condition, determining the sight intention to be the rearview mirror observation intention.
Optionally, in an embodiment of the present application, before controlling the at least one acoustic reminding device and/or the at least one optical reminding device to perform acoustic reminding and/or optical reminding, an instruction to turn on the occlusion reminding for the driver is received; and controlling the vehicle to allow the rearview mirror to shield and remind according to the shielding and reminding opening instruction.
The embodiment of the second aspect of this application provides a sight reminding device of on-vehicle rear-view mirror, includes: the first acquisition module is used for acquiring image data of a passenger driving position and/or a rear row position; the first identification module is used for identifying the actual positions of all parts of the body of the secondary driver and/or the rear passenger based on the image data and determining the relative position of the visual plane of the driver based on the actual positions; and the first control module is used for comparing the relative position with a preset shielding position and controlling at least one acoustic reminding device and/or at least one optical reminding device to carry out acoustic reminding and/or optical reminding when the relative position is overlapped with the preset shielding position.
Optionally, in an embodiment of the present application, the method further includes: the second acquisition module is used for acquiring body type data of the passenger in the passenger seat and/or the passenger in the rear row before the relative position is compared with the preset shielding position; and the determining module is used for determining the preset shielding position according to the actual seat pose corresponding to the assistant driving position and/or the rear row position and the body type data.
Optionally, in an embodiment of the present application, the method further includes: a second identification module for identifying the driver's gaze intention prior to acquiring image data of the secondary driving position and/or the rear row position; and the second control module is used for controlling the vehicle to enter a rearview mirror shielding reminding mode when the sight intention is a rearview mirror observation intention.
Optionally, in an embodiment of the present application, the second identification module includes: the detection unit is used for detecting the current working condition of the vehicle; and the judging unit is used for determining the sight intention as the rearview mirror observation intention when the current working condition is detected to be a reversing working condition, a turning working condition or a lane changing working condition.
Optionally, in an embodiment of the present application, the method further includes: the receiving module is used for receiving an occlusion starting reminding instruction of the driver before controlling the at least one acoustic reminding device and/or the at least one optical reminding device to carry out acoustic reminding and/or optical reminding; and the third control module is used for controlling the vehicle to allow the rearview mirror to shield and remind according to the shielding and reminding opening instruction.
An embodiment of a third aspect of the present application provides a vehicle, comprising: the sight line reminding method of the vehicle-mounted rearview mirror comprises a memory, a processor and a computer program, wherein the computer program is stored on the memory and can run on the processor, and the processor executes the program to realize the sight line reminding method of the vehicle-mounted rearview mirror.
A fourth aspect of the present application provides a computer-readable storage medium, which stores a computer program, and when the program is executed by a processor, the computer program implements the line-of-sight reminding method for a vehicle-mounted rearview mirror as above.
Thus, the embodiments of the present application have the following advantageous effects:
the embodiment of the application can be used for acquiring the image data of the passenger car position and/or the rear row position; identifying actual positions of parts of the body of the secondary driver and/or the rear passenger based on the image data, and determining relative positions in a visual plane of the driver based on the actual positions; the relative position is compared with the preset shielding position, and when the relative position overlaps with the preset shielding position, at least one acoustic reminding device and/or at least one optical reminding device are controlled to perform acoustic reminding and/or optical reminding. Therefore, the problem that the sight of a driver for observing the rearview mirror is easily blocked by passengers, the driving safety is greatly threatened and the like is solved.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a flowchart of a sight line reminding method for a vehicle-mounted rearview mirror according to an embodiment of the application;
fig. 2 is a schematic effect diagram of a sight line reminding method for a vehicle-mounted rearview mirror according to an embodiment of the application;
FIG. 3 is a schematic view of a passenger in a shielded position according to an embodiment of the present application;
fig. 4 is an exemplary view of a sight line reminding device of a vehicle-mounted rearview mirror according to an embodiment of the application;
FIG. 5 is a schematic structural diagram of a vehicle according to an embodiment of the present application.
The system comprises a 10-vehicle rearview mirror sight line reminding device, a 100-first acquisition module, a 200-first identification module, a 300-first control module, a 501-memory, a 502-processor and a 503-communication interface.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative and intended to explain the present application and should not be construed as limiting the present application.
The following describes a sight line reminding method and device for a vehicle-mounted rearview mirror, a vehicle and a storage medium according to embodiments of the present application with reference to the drawings. In view of the problems mentioned in the background art, the present application provides a sight line reminding method for a vehicle-mounted rearview mirror, in which, in the method, the embodiment of the present application can acquire image data of a driving assistant position and/or a rear row position; identifying actual positions of parts of the body of the secondary driver and/or the rear passenger based on the image data, and determining relative positions in a visual plane of the driver based on the actual positions; the relative position is compared with the preset shielding position, and when the relative position overlaps with the preset shielding position, at least one acoustic reminding device and/or at least one optical reminding device are controlled to perform acoustic reminding and/or optical reminding. Therefore, the problem that the sight of a driver for observing the rearview mirror is easily blocked by passengers, the driving safety is greatly threatened and the like is solved.
Specifically, fig. 1 is a flowchart of a sight line reminding method for a vehicle-mounted rearview mirror according to an embodiment of the present application.
As shown in fig. 1, the sight line reminding method of the vehicle-mounted rearview mirror comprises the following steps:
in step S101, image data of the passenger driving position and/or the rear row position is acquired.
The embodiment of this application can gather the image data that interior copilot drove and the back row position through equipment such as on-vehicle camera, simultaneously, can also improve the quality of the picture of gathering through equipment such as light filling lamp when the interior light ring environment is darker to provide reliable data support for discerning the actual position of each position of passenger's health in the car.
Optionally, in an embodiment of the present application, before acquiring the image data of the passenger driving position and/or the rear row position, the method further includes: identifying a driver's gaze intent; and when the sight intention is the rearview mirror observation intention, controlling the vehicle to enter a rearview mirror shielding reminding mode.
It should be noted that, before collecting image data of passengers in the vehicle, the embodiment of the application may further analyze and judge the potential intention of the sight line of the driver, and when it is judged that the driver is going to observe through the rearview mirror, the vehicle automatically enters a rearview mirror shielding reminding mode, and reminds the passenger in the front-seat or the passenger in the rear-seat through voice or text. For example, the driver needs to observe the rearview mirror, the rear row or the passenger does not need to shield the rearview mirror, and the driver pays attention to the driving safety! ' etc. thereby not only improving the safety and reliability of the vehicle, but also making the vehicle more humanized and intelligent, and greatly improving the use experience and use willingness of the user.
Optionally, in one embodiment of the present application, identifying the driver's gaze intent comprises: detecting the current working condition of the vehicle; and when the current working condition is detected to be a reversing working condition, a turning working condition or a lane changing working condition, determining the sight intention to be a rearview mirror observation intention.
Specifically, the embodiment of the application can call a vehicle-mounted navigation system to acquire a driving path in front of the vehicle, or acquire road information in front through sensor equipment such as a vehicle-mounted radar and a camera, and meanwhile, the driving state of the vehicle, such as the gear state of the vehicle and the state of a steering lamp of the vehicle, can be combined to accurately and efficiently judge the current working condition of the vehicle.
For example, when the vehicle is judged to be in a straight-ahead state according to the navigation information of the vehicle and the front road condition, and the gear of the vehicle is 'N' gear without turning on a steering lamp, the current straight-ahead state of the vehicle can be judged without the observation intention of a rearview mirror; when the vehicle is judged to turn left according to the navigation information of the vehicle and the front road condition, and the left steering lamp is turned on according to the N gear of the vehicle, the current turning working condition of the vehicle can be judged, and the user can be judged to have the intention of observing the rearview mirror.
In step S102, the actual positions of the respective parts of the body of the passenger are identified based on the image data, and the relative position in the visual plane of the driver is determined based on the actual positions.
After the image data of the passenger seat and the rear row position are collected, the embodiment of the application can also identify the actual positions of all parts of the body of the passenger seat and the rear row passenger according to the image data and by combining an intelligent algorithm of the in-vehicle vision, such as an openpos gesture identification framework, and the like, and can also identify the dynamic positions of all parts, so that the relative positions of the visual plane where the head and the limbs of the person are located can be determined. Fig. 2 illustrates an effect schematic diagram of the sight line reminding method for the vehicle-mounted rearview mirror according to the embodiment of the present application, and as shown in fig. 2, a sheltered position where a passenger or a passenger affects a viewing sight line of the vehicle-mounted rearview mirror can be separated into a front view component and a top view direction component, and the components at the two positions can be represented as different position differences on a visual recognition plane.
Therefore, the embodiment of the application can be combined with deep learning and the like to identify and judge the positions of all parts of the body of a passenger, the intelligent level of a vehicle is effectively improved, and reliable data support is provided for subsequent rearview mirror shielding judgment.
In step S103, the relative position and the preset blocking position are compared, and when there is an overlap between the relative position and the preset blocking position, at least one acoustic reminding device and/or at least one optical reminding device is controlled to perform acoustic reminding and/or optical reminding.
After the relative position of the visual plane of the driver is determined based on the actual position, the embodiment of the application can compare the relative position with the shielding position preset by the system, and when the relative position and the preset shielding position are overlapped, as shown in fig. 3, the acoustic reminding device and the optical reminding device can be controlled to remind the passenger, so that the driving safety of the vehicle can be effectively guaranteed.
Optionally, in an embodiment of the present application, before comparing the relative position with the preset occlusion position, the method further includes: collecting body type data of the passenger in the passenger seat and/or the passenger in the back row; and determining a preset shielding position according to the actual seat pose and body type data corresponding to the passenger seat position and/or the rear row position.
It should be noted that, because each human body is different in size and the seat is different in adjustment position, the relative position of the passenger body to the driver is different, and the shielding position of the sight line of the rearview mirror is different, so that the position of the shielded sight line needs to be calibrated before use, so as to determine the relative position of the visual plane where the head and the body of the passenger are located, and prompt is facilitated when the same condition occurs.
Specifically, the shielding position needs to be calibrated before use, a user can be prompted to enable a secondary driver and a back passenger to intentionally shield the rearview mirror for calibration, then body shape data of the secondary driver and the back passenger, such as head length, shoulder width, chest width and the like, are collected through the camera, and a preset shielding position is determined according to the actual seat pose and body shape data corresponding to the secondary driver position and the back passenger, so that the shielding condition of the user is recorded, and the user is prompted to finish calibration after the recording is completed. If the passenger stature takes place great change after, discernment is accurate inadequately, and the user then can initiate new demarcation, and every is markd and all can be stored in the car machine, and the user can switch by oneself in order to adapt to different passengers to, the embodiment of this application all possesses fine discernment and warning effect of sheltering from to the user of different sizes, has further improved the reliability and the humanized level of vehicle, has improved user's driving experience.
Optionally, in an embodiment of the present application, before controlling the at least one acoustic reminding device and/or the at least one optical reminding device to perform acoustic reminding and/or optical reminding, an instruction to turn on the occlusion reminding for the driver is received; and controlling the vehicle to allow the rearview mirror to be shielded for reminding according to the shielding starting reminding instruction.
Before shielding and alarming, a driver can send an opening shielding reminding instruction by sending a voice instruction or manually shifting switch keys at equipment such as a steering wheel, and after receiving the instruction, the vehicle-mounted system can control the vehicle to allow rearview mirror shielding reminding operation according to the instruction.
Furthermore, once the camera identifies the position on the calibrated visual plane, namely when the relative position and the calibrated shielding position are overlapped, the situation that the passenger in the front passenger seat or the passenger in the rear passenger seat shields the rearview mirror can be judged, at the moment, the vehicle can be controlled to circularly play alarm voice, or the vehicle steering lamp and other devices are controlled to flash at a certain frequency to carry out rearview mirror shielding reminding on the passenger, so that the life safety of drivers and passengers can be effectively ensured, and the reliability and the safety of the vehicle are improved.
According to the sight line reminding method of the vehicle-mounted rearview mirror, provided by the embodiment of the application, the image data of the driving position and/or the rear row position are collected; identifying actual positions of respective parts of the body of the passenger and/or the rear passenger based on the image data, and determining relative positions in a visual plane of the driver based on the actual positions; the relative position is compared with the preset shielding position, and when the relative position overlaps with the preset shielding position, at least one acoustic reminding device and/or at least one optical reminding device are controlled to perform acoustic reminding and/or optical reminding.
Next, a sight line reminding device of a vehicle-mounted rearview mirror provided according to an embodiment of the application is described with reference to the drawings.
Fig. 4 is a block diagram schematically illustrating a sight line reminding device of a vehicle-mounted rearview mirror according to an embodiment of the present application.
As shown in fig. 4, the sight line reminder 10 for the vehicle-mounted rearview mirror includes: a first acquisition module 100, a first identification module 200, and a first control module 300.
The first acquisition module is used for acquiring image data of the passenger car position and/or the rear row position.
And the first identification module is used for identifying the actual positions of all parts of the body of the secondary driver and/or the rear passenger based on the image data and determining the relative position of the parts in the visual plane of the driver based on the actual positions.
The first control module is used for comparing the relative position with a preset shielding position and controlling at least one acoustic reminding device and/or at least one optical reminding device to carry out acoustic reminding and/or optical reminding when the relative position and the preset shielding position are overlapped.
Optionally, in an embodiment of the present application, the sight line reminding device 10 of the vehicle-mounted rearview mirror of the embodiment of the present application further includes: the device comprises a second acquisition module and a determination module.
The second acquisition module is used for acquiring body type data of the passenger on the copilot and/or the back passenger before the relative position is compared with the preset shielding position.
And the determining module is used for determining a preset shielding position according to the actual seat pose and body type data corresponding to the secondary driving position and/or the rear row position.
Optionally, in an embodiment of the present application, the sight line reminding device 10 of the vehicle-mounted rearview mirror of the embodiment of the present application further includes:
the second identification module is used for identifying the sight intention of the driver before acquiring the image data of the passenger driving position and/or the rear row position.
And the second control module is used for controlling the vehicle to enter a rearview mirror shielding reminding mode when the sight intention is a rearview mirror observation intention.
Optionally, in an embodiment of the present application, the second identification module includes: a detection unit and a judgment unit.
The detection unit is used for detecting the current working condition of the vehicle.
And the judging unit is used for determining the sight intention as the rearview mirror observation intention when the current working condition is detected to be a reversing working condition, a turning working condition or a lane changing working condition.
Optionally, in an embodiment of the present application, the sight line reminding device 10 of the vehicle-mounted rearview mirror of the embodiment of the present application further includes: the device comprises a receiving module and a third control module.
The receiving module is used for receiving an opening blocking reminding instruction of a driver before controlling at least one acoustic reminding device and/or at least one optical reminding device to carry out acoustic reminding and/or optical reminding.
And the third control module is used for controlling the vehicle to allow the rearview mirror to be shielded for reminding according to the shielding opening reminding instruction.
It should be noted that the foregoing explanation of the embodiment of the method for prompting the line of sight of the vehicle-mounted rearview mirror is also applicable to the device for prompting the line of sight of the vehicle-mounted rearview mirror of this embodiment, and is not repeated here.
According to the sight line reminding device of the vehicle-mounted rearview mirror, the image data of the driving position and/or the rear row position are collected; identifying actual positions of parts of the body of the secondary driver and/or the rear passenger based on the image data, and determining relative positions in a visual plane of the driver based on the actual positions; the relative position is compared with the preset shielding position, and when the relative position overlaps with the preset shielding position, at least one acoustic reminding device and/or at least one optical reminding device are controlled to perform acoustic reminding and/or optical reminding.
Fig. 5 is a schematic structural diagram of a vehicle according to an embodiment of the present application. The vehicle may include:
a memory 501, a processor 502, and a computer program stored on the memory 501 and executable on the processor 502.
The processor 502 executes the program to implement the sight line reminding method of the vehicle-mounted rearview mirror provided in the above-described embodiment.
Further, the vehicle further includes:
a communication interface 503 for communication between the memory 501 and the processor 502.
A memory 501 for storing computer programs that can be run on the processor 502.
The memory 501 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.
If the memory 501, the processor 502 and the communication interface 503 are implemented independently, the communication interface 503, the memory 501 and the processor 502 may be connected to each other through a bus and perform communication with each other. The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 5, but this is not intended to represent only one bus or type of bus.
Alternatively, in practical implementation, if the memory 501, the processor 502 and the communication interface 503 are integrated on a chip, the memory 501, the processor 502 and the communication interface 503 may complete communication with each other through an internal interface.
The processor 502 may be a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits configured to implement embodiments of the present Application.
The embodiment of the application further provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the method for reminding the sight line of the vehicle-mounted rearview mirror is realized.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or N embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "N" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or N executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present application.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or N wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. If implemented in hardware as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried out in the method of implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and the program, when executed, includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.
Claims (10)
1. A sight line reminding method of a vehicle-mounted rearview mirror is characterized by comprising the following steps:
acquiring image data of a passenger driving position and/or a rear row position;
identifying actual positions of various parts of the body of the secondary driver and/or the rear passenger based on the image data, and determining relative positions in a visual plane of the driver based on the actual positions; and
and comparing the relative position with a preset shielding position, and controlling at least one acoustic reminding device and/or at least one optical reminding device to carry out acoustic reminding and/or optical reminding when the relative position and the preset shielding position are overlapped.
2. The method of claim 1, further comprising, prior to comparing the relative position to the preset occlusion position:
collecting body type data of the passenger and/or the back-row passenger;
and determining the preset shielding position according to the actual seat pose corresponding to the auxiliary driving position and/or the rear row position and the body type data.
3. The method of claim 1, further comprising, prior to acquiring the image data for the rider position and/or the rear row position:
identifying a gaze intent of the driver;
and when the sight intention is a rearview mirror observation intention, controlling the vehicle to enter a rearview mirror shielding reminding mode.
4. The method of claim 3, wherein the identifying the driver's gaze intent comprises:
detecting the current working condition of the vehicle;
and when the current working condition is detected to be a reversing working condition, a turning working condition or a lane changing working condition, determining the sight intention to be the rearview mirror observation intention.
5. The method according to claim 1, characterized in that before controlling the at least one acoustic reminding device and/or the at least one optical reminding device to make an acoustic reminding and/or an optical reminding,
receiving an opening shielding reminding instruction of the driver;
and controlling the vehicle to allow the rearview mirror to be shielded for reminding according to the shielding starting reminding instruction.
6. The utility model provides a sight reminding device of on-vehicle rear-view mirror which characterized in that includes:
the first acquisition module is used for acquiring image data of a passenger driving position and/or a rear row position;
the first identification module is used for identifying the actual positions of all parts of the body of the secondary driver and/or the rear passenger based on the image data and determining the relative position of the visual plane of the driver based on the actual positions; and
the first control module is used for comparing the relative position with a preset shielding position and controlling at least one acoustic reminding device and/or at least one optical reminding device to carry out acoustic reminding and/or optical reminding when the relative position is overlapped with the preset shielding position.
7. The apparatus of claim 6, further comprising:
the second acquisition module is used for acquiring body type data of the passenger in the passenger seat and/or the passenger in the rear row before the relative position is compared with the preset shielding position;
and the determining module is used for determining the preset shielding position according to the actual seat pose corresponding to the assistant driving position and/or the rear row position and the body type data.
8. The apparatus of claim 6, further comprising:
a second recognition module for recognizing the driver's gaze intent prior to acquiring image data of the rider position and/or the rear row position;
and the second control module is used for controlling the vehicle to enter a rearview mirror shielding reminding mode when the sight intention is a rearview mirror observation intention.
9. A vehicle, characterized by comprising: a memory, a processor and a computer program stored on the memory and executable on the processor, the processor executing the program to implement the line of sight alerting method of the vehicle mirror according to any one of claims 1 to 5.
10. A computer-readable storage medium on which a computer program is stored, the program being executed by a processor for implementing the line of sight alerting method of a vehicle-mounted rearview mirror as claimed in any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211057571.XA CN115214462A (en) | 2022-08-31 | 2022-08-31 | Sight line reminding method and device for vehicle-mounted rearview mirror, vehicle and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211057571.XA CN115214462A (en) | 2022-08-31 | 2022-08-31 | Sight line reminding method and device for vehicle-mounted rearview mirror, vehicle and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115214462A true CN115214462A (en) | 2022-10-21 |
Family
ID=83616831
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211057571.XA Pending CN115214462A (en) | 2022-08-31 | 2022-08-31 | Sight line reminding method and device for vehicle-mounted rearview mirror, vehicle and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115214462A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204547919U (en) * | 2014-12-26 | 2015-08-12 | 大连理工大学 | There is the vehicle of safe lane-changing assistance system |
| KR20160091293A (en) * | 2016-07-13 | 2016-08-02 | 엠엠피씨 주식회사 | Side Mirror Camera System For Vehicle |
| CN106218502A (en) * | 2016-07-26 | 2016-12-14 | 北京汽车股份有限公司 | Vehicle and driver observe the based reminding method that rearview mirror sight line is blocked |
| US20200238906A1 (en) * | 2019-01-28 | 2020-07-30 | Toyota Motor Engineering & Manufacturing North America, Inc. | E-mirror automatic position adjustment system |
| JP2021012624A (en) * | 2019-07-09 | 2021-02-04 | 三菱電機株式会社 | Driving support device, and driving support program |
| CN113569718A (en) * | 2021-07-26 | 2021-10-29 | 阿波罗智联(北京)科技有限公司 | Reminding method, device, equipment, system and storage medium |
-
2022
- 2022-08-31 CN CN202211057571.XA patent/CN115214462A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204547919U (en) * | 2014-12-26 | 2015-08-12 | 大连理工大学 | There is the vehicle of safe lane-changing assistance system |
| KR20160091293A (en) * | 2016-07-13 | 2016-08-02 | 엠엠피씨 주식회사 | Side Mirror Camera System For Vehicle |
| CN106218502A (en) * | 2016-07-26 | 2016-12-14 | 北京汽车股份有限公司 | Vehicle and driver observe the based reminding method that rearview mirror sight line is blocked |
| US20200238906A1 (en) * | 2019-01-28 | 2020-07-30 | Toyota Motor Engineering & Manufacturing North America, Inc. | E-mirror automatic position adjustment system |
| JP2021012624A (en) * | 2019-07-09 | 2021-02-04 | 三菱電機株式会社 | Driving support device, and driving support program |
| CN113569718A (en) * | 2021-07-26 | 2021-10-29 | 阿波罗智联(北京)科技有限公司 | Reminding method, device, equipment, system and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9616809B1 (en) | Lane change prediction and turn signal activation upon observation of head and eye movement | |
| US10336323B2 (en) | Predictive human-machine interface using eye gaze technology, blind spot indicators and driver experience | |
| US9041789B2 (en) | System and method for determining driver alertness | |
| EP3431344B1 (en) | Parking assistance device, onboard cameras, vehicle, and parking assistance method | |
| EP2523173B1 (en) | Driver assisting system and method for a motor vehicle | |
| US10410514B2 (en) | Display device for vehicle and display method for vehicle | |
| JP2016103249A (en) | Driving support device and driving support method | |
| JP7215228B2 (en) | Control device, control method, control program | |
| US10930148B2 (en) | Method and device for reminding a driver about an approach to a light signal apparatus | |
| JP2019091272A (en) | Driver state determination device, and method and program for the same | |
| CN113442832A (en) | Control method and device of vehicle panoramic image system | |
| US11221495B2 (en) | Aid for a driver with impaired field of view | |
| US20140379201A1 (en) | Apparatus and method for vehicular self-diagnosis | |
| US20190361533A1 (en) | Automated Activation of a Vision Support System | |
| US20190156133A1 (en) | Vehicle driving support apparatus and vehicle driving support program | |
| US11881054B2 (en) | Device and method for determining image data of the eyes, eye positions and/or a viewing direction of a vehicle user in a vehicle | |
| CN112277804A (en) | Vehicle image fusion display system, control method and vehicle | |
| CN117002387A (en) | Display method and device of vehicle-mounted streaming media rearview mirror | |
| CN115214462A (en) | Sight line reminding method and device for vehicle-mounted rearview mirror, vehicle and storage medium | |
| US20230095614A1 (en) | Mirror position registration control apparatus | |
| CN114312567A (en) | Reversing reminding method and device, vehicle and storage medium | |
| JP2016095571A (en) | Vehicle driving evaluation device and vehicle driving evaluation method | |
| CN113696897B (en) | Driver distraction early warning method and driver distraction early warning system | |
| JP7028601B2 (en) | Reverse run notification device | |
| CN112660022A (en) | Door opening early warning display method and device based on transparent A column |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |