CN210573658U - Vehicle-mounted eye interaction device - Google Patents
Vehicle-mounted eye interaction device Download PDFInfo
- Publication number
- CN210573658U CN210573658U CN201920381494.0U CN201920381494U CN210573658U CN 210573658 U CN210573658 U CN 210573658U CN 201920381494 U CN201920381494 U CN 201920381494U CN 210573658 U CN210573658 U CN 210573658U
- Authority
- CN
- China
- Prior art keywords
- vehicle
- eyeball tracking
- display screen
- eyeball
- eye
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
A vehicle-mounted eye interaction device comprises a vehicle-mounted display screen, an eyeball tracking and positioning system and an eyeball tracking processor, wherein the eyeball tracking and positioning system comprises an infrared camera for capturing the corresponding position of an eyeball, the infrared camera is connected with the eyeball tracking processor, the eyeball tracking processor comprises an image acquisition module, an image recognition module, an image processing module and a screen control module, and the image processing module comprises an identity recognition system and an eye control operation system; the utility model discloses at the during operation, track positioning system through the eyeball and draw driver's eye characteristic, then give eyeball tracking processor with information transmission, eyeball tracking processor sends the screen control command after handling information and gives vehicle-mounted display screen, and vehicle-mounted display screen carries out corresponding action after obtaining the instruction. The utility model discloses an eyeball tracking technology makes the driver can control the page or leaf and volume control of vehicle-mounted display screen through the spirit of the eye to driver's identity can be discerned and individualized setting is used for starting.
Description
Technical Field
The utility model relates to the technical field of automobiles, in particular to on-vehicle eye-god interaction device.
Background
The central control screen is used as a key part for displaying information and human-vehicle interaction, and a multimode interaction technology is increasingly applied, so that more experiences of naturalness, intimacy and convenience are brought to automobile users. However, the currently mainstream interaction is problematic in the following:
1) voice command recognition is inaccurate. Speech recognition, i.e., the conversion of human speech into a computer-readable sequence of characters. The technology is still to be perfected, background sound, the common degree of recognized language, the speech speed of a user and the level of Mandarin all can generate great interference on speech recognition, the highest accuracy of the current speech industry reaches 95%, and a uniform industry standard is not formed in the field of speech recognition at present;
2) when the finger is in touch control operation, blind operation is difficult, the press reaction time is delayed, and the hand feeling is difficult to grasp;
3) during gesture operation, the right hand leaves the steering wheel, which affects driving safety.
Therefore, for the car owner, the current human-car interaction mode cannot bring the extreme natural feeling and the extreme tangential feeling.
The eyeball tracking technology is a scientific application technology, when human eyes look at different directions, the eyes have slight changes, the changes can generate extractable features, and a computer can extract the features through image capture or scanning, so that the changes of the eyes are tracked in real time, the state and the demand of a user are predicted, response is carried out, and the purpose of controlling equipment by the eyes is achieved.
The eyeball tracking technology is applied to the automobile field to control the operation of the vehicle-mounted display screen, and the vehicle-mounted eye interaction device is designed, so that the driver can conveniently operate in the driving process, and the technical problem to be solved urgently at present is solved.
Disclosure of Invention
The utility model provides an on-vehicle catch of eye interaction device, the utility model provides a problem that exists among the prior art, through eyeball tracking technology, make the driver can control the page or leaf and volume control of on-vehicle display screen through catch of eye to can discern driver's identity and be used for starting individualized setting, this technique is suitable for and uses widely.
A vehicle-mounted eye interaction device comprises a vehicle-mounted display screen, an eyeball tracking and positioning system and an eyeball tracking processor, wherein the eyeball tracking and positioning system comprises an infrared camera used for capturing the corresponding position of an eyeball, the infrared camera is connected with the eyeball tracking processor, the eyeball tracking processor comprises an image acquisition module, an image recognition module, an image processing module and a screen control module, and the image processing module comprises an identity recognition system and an eye control operation system;
when the vehicle-mounted eye spirit interaction device works, the eye characteristics of a driver are extracted through the eyeball tracking and positioning system, then the information is transmitted to the eyeball tracking processor, the eyeball tracking processor processes the information and then sends a screen control instruction to the vehicle-mounted display screen, and the vehicle-mounted display screen performs corresponding action after receiving the instruction.
The image acquisition module of the eyeball tracking processor receives information transmitted by the eyeball tracking positioning system, the image identification module identifies the information transmitted by the eyeball tracking positioning system, the picture is converted into information which can be understood by the system, the image processing module processes the information to understand the intention of a driver at the moment, and the screen control module sends a screen control instruction according to the intention of the driver.
The identity recognition system of the image processing module recognizes the identity of the owner of the vehicle, the eye control operation system understands the operation which the owner wants to carry out, and then the screen control module sends out a control instruction.
A user stares at four points in the vehicle-mounted display screen for calibration, and the middle point where the sight line focus is located becomes red after calibration. The coordinates of the four points are extracted and analyzed to generate a set of coordinate system, the point above the vehicle-mounted display screen is (0, 1), the point below the vehicle-mounted display screen is (0, -1), the point on the left of the vehicle-mounted display screen is (-1, 0), and the point on the right of the vehicle-mounted display screen is (1, 0). When a user stares at the upper point of the vehicle-mounted display screen, the volume is increased, the volume is decreased at the lower point, the left page is turned leftwards, and the right page is turned rightwards.
The model of the image acquisition module is TMS320DM642, the model of the image recognition module is ShuffleNet, the model of the image processing module is Hi3559AV100, and the model of the screen control module is ADS 7843.
The working principle of the utility model is as follows:
and performing iris recognition on the collected driver information by using an identity recognition system of the eyeball tracking processor, verifying the identity of the driver, and then sending an instruction to set the vehicle to be in a preset state of a secondary driver.
The eyeball tracking positioning system can lead a user to achieve the purposes of turning left and right pages and adjusting the volume by staring at different positions of the vehicle-mounted display screen. The eyeball tracking positioning system captures the corresponding positions of eyeballs through the infrared camera, a Cartesian coordinate system is established by taking the middle point of the connecting line of the centers of the two pupils as a point 0, the coordinate values of the positions of the two pupils are obtained, the coordinate values of the positions of the pupils are continuously output to the eyeball tracking processor, the eyeball tracking processor applies algorithm processing to the signals of the set and converts the signals into control instructions, and the instructions are transmitted to the screen control module. For example, if the driver gazes at the left position of the vehicle-mounted display screen, the page is turned to the left, and if the driver gazes above or below the screen, the volume of the system is correspondingly increased or decreased.
The eyeball tracking and positioning system is formed by combining a sensor and an infrared illumination system (camera), and ensures that people can track tiny actions according to a new tracking algorithm and a high-resolution sensor, meanwhile, the high-precision positioning range is kept, and most environments and illumination conditions are optimized. Before the camera is used, the screen is only needed to be calibrated to determine the distance between a user and the camera and the rotation range of the user.
The utility model has the advantages that:
1. identity recognition: iris recognition is more accurate than other identity recognition, the misidentification rate is only one millionth, and the iri recognition is used for unlocking, starting a driving system, recognizing the identity of a driver and carrying out private personalized application and setting, such as a common navigation route, personal favorite music and the like, in an eye-mind interaction system.
2. Eye control operation: in the driving process, the driver can realize the functions of turning pages left and right, adjusting the volume and the like by watching a specific position of the display screen, so that the hands of the driver are liberated, and the driving safety is ensured.
Drawings
Figure 1 is a schematic structural diagram of the present invention,
fig. 2 is a schematic view of the eyeball tracking processing of the present invention.
Fig. 3 is a schematic diagram of the image processing module of the present invention.
Fig. 4 is the schematic view of the vehicle-mounted display screen of the present invention.
Detailed Description
As shown in fig. 1, fig. 2, fig. 3 and fig. 4, a vehicle-mounted eye interaction device includes a vehicle-mounted display screen 1, an eyeball tracking positioning system 2 and an eyeball tracking processor 3, where the eyeball tracking positioning system 2 includes an infrared camera for capturing a corresponding position of an eyeball, the infrared camera is connected to the eyeball tracking processor 3, the eyeball tracking processor 3 includes an image acquisition module 31, an image recognition module 32, an image processing module 33 and a screen control module 34, and the image processing module 33 includes an identity recognition system 331 and an eye control operating system 332;
when the vehicle-mounted eye spirit interaction device works, the characteristics of the eyes 4 of a driver are extracted through the eyeball tracking positioning system 2, then information is transmitted to the eyeball tracking processor 3, the eyeball tracking processor 3 processes the information and then sends a screen control instruction to the vehicle-mounted display screen 1, and the vehicle-mounted display screen 1 performs corresponding action after receiving the instruction.
As shown in fig. 2, the image acquisition module 31 of the eye tracking processor 3 receives the information transmitted by the eye tracking positioning system 2, the image recognition module 32 recognizes the information transmitted by the eye tracking positioning system 2, converts the image into information that can be understood by the system, the image processing module 33 processes the information, understands the intention of the driver at this time, and the screen control module 34 sends a screen control instruction according to the intention of the driver.
As shown in fig. 3, the identity recognition system 331 of the image processing module 33 recognizes the identity of the owner of the vehicle, and the eye control operating system 332 understands the operation that the owner of the vehicle wants to perform, and further the screen control module 34 sends out a control command.
As shown in FIG. 4, the user performs calibration by gazing at four points on the display screen 1, and the middle point where the sight line focus is located becomes red after calibration. The coordinates of the four points are extracted and analyzed to generate a set of coordinate system, the point above the vehicle-mounted display screen 1 is (0, 1), the point below the vehicle-mounted display screen 1 is (0, -1), the point on the left of the vehicle-mounted display screen 1 is (-1, 0), and the point on the right of the vehicle-mounted display screen 1 is (1, 0). When a user stares at the upper point of the vehicle-mounted display screen 1, the volume is increased, the lower point is a volume reduction instruction, the left page is turned leftwards, and the right page is turned rightwards.
The model of the image acquisition module 31 is TMS320DM642, the model of the image recognition module 32 is ShuffleNet, the model of the image processing module 33 is Hi3559AV100, and the model of the screen control module 34 is ADS 7843.
The working principle of the utility model is as follows:
the iris recognition of the collected driver information is performed by the identification system 331 of the eyeball tracking processor 3, the identity of the driver is verified, and then an instruction is issued to set the vehicle in a preset state of the secondary driver.
The eyeball tracking positioning system 2 can lead the user to achieve the purposes of turning pages left and right and adjusting the volume by staring at different positions of the vehicle-mounted display screen 1. The eyeball tracking positioning system 2 captures the corresponding positions of the eyeballs through the infrared camera, a Cartesian coordinate system is established by taking the middle point of the connecting line of the centers of the two pupils as a point 0, coordinate values of the positions of the two pupils are obtained, the coordinate values of the positions of the pupils are continuously output to the eyeball tracking processor 3, the eyeball tracking processor 3 applies algorithm processing to the collected signals and converts the signals into control instructions, and the instructions are transmitted to the screen control module 34. For example, if the driver gazes at the left position of the vehicle-mounted display screen 1, the page is turned to the left, and if the driver gazes above or below the screen, the volume of the system is correspondingly increased or decreased.
The eyeball tracking and positioning system 2 is formed by combining a sensor and an infrared illumination system (camera), and ensures that people can track tiny actions according to a new tracking algorithm and a high-resolution sensor, meanwhile, the high-precision positioning range is kept, and most environments and illumination conditions are optimized. Before the camera is used, the screen is only needed to be calibrated to determine the distance between a user and the camera and the rotation range of the user.
Claims (1)
1. The utility model provides a vehicle-mounted eye-god interaction device which characterized in that: including on-vehicle display screen (1), eyeball tracking positioning system (2) and eyeball tracking processor (3), eyeball tracking positioning system (2) is including the infrared camera that is used for catching the corresponding position of eyeball, and infrared camera links to each other with eyeball tracking processor (3), and eyeball tracking processor (3) include image acquisition module (31), image recognition module (32), image processing module (33) and screen control module (34), and image processing module (33) are including identification system (331) and eye accuse operating system (332).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201920381494.0U CN210573658U (en) | 2019-03-25 | 2019-03-25 | Vehicle-mounted eye interaction device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201920381494.0U CN210573658U (en) | 2019-03-25 | 2019-03-25 | Vehicle-mounted eye interaction device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN210573658U true CN210573658U (en) | 2020-05-19 |
Family
ID=70639492
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201920381494.0U Active CN210573658U (en) | 2019-03-25 | 2019-03-25 | Vehicle-mounted eye interaction device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN210573658U (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109933205A (en) * | 2019-03-25 | 2019-06-25 | 一汽轿车股份有限公司 | A kind of vehicle-mounted expression in the eyes interactive device |
| CN113744680A (en) * | 2021-08-24 | 2021-12-03 | 一汽奔腾轿车有限公司 | Self-adaptive adjusting method and system for brightness of information display screen for automobile |
-
2019
- 2019-03-25 CN CN201920381494.0U patent/CN210573658U/en active Active
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109933205A (en) * | 2019-03-25 | 2019-06-25 | 一汽轿车股份有限公司 | A kind of vehicle-mounted expression in the eyes interactive device |
| CN113744680A (en) * | 2021-08-24 | 2021-12-03 | 一汽奔腾轿车有限公司 | Self-adaptive adjusting method and system for brightness of information display screen for automobile |
| CN113744680B (en) * | 2021-08-24 | 2023-12-15 | 一汽奔腾轿车有限公司 | Self-adaptive adjusting method and system for brightness of information display screen for automobile |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109933205A (en) | A kind of vehicle-mounted expression in the eyes interactive device | |
| Mahmud et al. | Interface for human machine interaction for assistant devices: A review | |
| US7295904B2 (en) | Touch gesture based interface for motor vehicle | |
| US9703373B2 (en) | User interface control using gaze tracking | |
| EP2891954B1 (en) | User-directed personal information assistant | |
| EP1853465B1 (en) | Method and device for voice controlling a device or system in a motor vehicle | |
| EP2969697B1 (en) | System and method for identifying handwriting gestures in an in-vehicle infromation system | |
| CN111104820A (en) | Gesture recognition method based on deep learning | |
| CN210573658U (en) | Vehicle-mounted eye interaction device | |
| KR101490908B1 (en) | System and method for providing a user interface using hand shape trace recognition in a vehicle | |
| EP2846224A1 (en) | Display method through a head mounted device | |
| CN110658742A (en) | Multi-mode cooperative control wheelchair control system and method | |
| JPH10260773A (en) | Information input method and device therefor | |
| CN105159452A (en) | Control method and system based on estimation of human face posture | |
| CN106020479A (en) | Method and apparatus for operating center console of intelligent vehicle with distance by utilization of orientation gestures | |
| CN105373230A (en) | Gesture recognition method and device of on-board unit | |
| US11009963B2 (en) | Sign language inputs to a vehicle user interface | |
| CN109144262B (en) | Human-computer interaction method, device, equipment and storage medium based on eye movement | |
| Biswas | Exploring the use of eye gaze controlled interfaces in automotive environments | |
| CN106445100A (en) | Method and system for processing multimodal input signals | |
| WO2019145907A1 (en) | Method aimed at patients with motor disabilities for selecting a command by means of a graphic interface, and corresponding system and computer program product | |
| Fu et al. | Research on application of cognitive-driven human-computer interaction | |
| CN113561988A (en) | Voice control method based on sight tracking, automobile and readable storage medium | |
| KR102083372B1 (en) | System for alternative computer access using eye-tracking and voice recognition and operating method having the same | |
| CN113703485B (en) | Airborne intelligent glasses equipment and airplane control method based on same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |