CN110456914B - Multifunctional in-vehicle display device, method, electronic equipment and storage medium - Google Patents
Multifunctional in-vehicle display device, method, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN110456914B CN110456914B CN201910776544.XA CN201910776544A CN110456914B CN 110456914 B CN110456914 B CN 110456914B CN 201910776544 A CN201910776544 A CN 201910776544A CN 110456914 B CN110456914 B CN 110456914B
- Authority
- CN
- China
- Prior art keywords
- user
- module
- display screen
- naked eye
- multifunctional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 19
- 230000004424 eye movement Effects 0.000 claims abstract description 40
- 238000001514 detection method Methods 0.000 claims abstract description 22
- 230000004044 response Effects 0.000 claims abstract description 8
- 210000001508 eye Anatomy 0.000 claims description 56
- 239000004973 liquid crystal related substance Substances 0.000 claims description 32
- 210000005252 bulbus oculi Anatomy 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 5
- 230000005684 electric field Effects 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 13
- 230000003993 interaction Effects 0.000 description 10
- 230000000694 effects Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 241000283715 Damaliscus lunatus Species 0.000 description 1
- 241001282135 Poromitra oscitans Species 0.000 description 1
- 206010048232 Yawning Diseases 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Mechanical Engineering (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a multifunctional in-vehicle display device, a method, an electronic device and a storage medium, wherein the multifunctional in-vehicle display device is arranged on a vehicle and comprises the following components: the naked eye stereoscopic display screen is used for displaying naked eye stereoscopic images; the camera module, the camera module integrate in on the three-dimensional display screen of bore hole, include: the eye movement instrument is used for capturing the eye movement track of a user; the gesture recognition module is used for capturing gesture tracks of users; the control module is used for controlling the naked eye stereoscopic image displayed by the naked eye stereoscopic display screen according to the user eye movement track captured by the eye movement instrument and/or the user gesture track captured by the gesture recognition module; and the fatigue detection module is used for detecting whether the user is tired to drive according to the user video acquired by the camera shooting module and providing an alarm signal in response to the detection of the tired to drive of the user. The invention realizes the multifunctional multiplexing in-vehicle display device.
Description
Technical Field
The present invention relates to the field of vehicle control, and in particular, to a multifunctional in-vehicle display device, method, electronic apparatus, and storage medium.
Background
At present, the combination instrument of the existing vehicle does not have a naked eye 3D function, and the display effect is poor. Meanwhile, the combined instrument of the existing vehicle is not provided with a camera, if the vehicle has the face recognition or driver detection function, the camera can be independently placed outside, video signals are transmitted to the corresponding controller in a coaxial line mode and the like, the installation and communication are complex, and the vehicle installation cost is increased. In addition, the combination meter of the existing vehicle does not have the functions of eye movement interaction, gesture interaction and fatigue detection. If a user needs to operate the instrument, the operation is inconvenient only by the operation of the steering wheel keys at one level and one level.
Disclosure of Invention
The present invention is directed to overcoming the above-mentioned drawbacks of the related art, and provides a multifunctional in-vehicle display apparatus, method, electronic device, storage medium, and program, which, at least in part, overcome one or more of the problems due to the limitations and disadvantages of the related art.
According to one aspect of the present invention, there is provided a multifunctional in-vehicle display device provided on a vehicle, comprising:
the naked eye stereoscopic display screen is used for displaying naked eye stereoscopic images;
the camera module, the camera module integrate in on the three-dimensional display screen of bore hole, include:
the eye movement instrument is used for capturing the eye movement track of a user;
the gesture recognition module is used for capturing gesture tracks of users;
the control module is used for controlling the naked eye stereoscopic image displayed by the naked eye stereoscopic display screen according to the user eye movement track captured by the eye movement instrument and/or the user gesture track captured by the gesture recognition module;
and the fatigue detection module is used for detecting whether the user is tired to drive according to the user video acquired by the camera shooting module and providing an alarm signal in response to the detection of the tired to drive of the user.
In one embodiment of the invention, the camera module is integrated in a frame area of the naked eye stereoscopic display screen; or the camera module is integrated in the display area of the naked eye stereoscopic display screen in a hidden way.
In one embodiment of the present invention, the steering wheel and the selector lever of the vehicle are provided with sensor electrodes, and the multifunctional in-vehicle display device further includes:
the electrode signal receiving module is used for receiving electrode signals sent by sensor electrodes arranged on the steering wheel and the gear selecting rod, and triggering the gesture recognition module to capture gesture tracks of a user when the electrode signals of the sensor electrodes of the steering wheel and the gear selecting rod indicate that at least one hand of the user is not contacted with the steering wheel and the gear selecting rod;
and the alarm signal sending module is used for responding to the fatigue driving of the user detected by the fatigue detection module and providing current for the sensor electrodes arranged on the steering wheel and the gear selecting rod.
In one embodiment of the present invention, the autostereoscopic display screen includes:
a display module;
the liquid crystal module is positioned on the light emitting side of the display module;
and the switching module is used for determining a first angle formed by the position of the eyeball of the user and the naked eye three-dimensional display screen according to the eye movement track of the user captured by the eye movement instrument, and controlling the liquid crystal molecules of the liquid crystal module to turn according to the determined first angle so as to enable the naked eye three-dimensional display screen to display the naked eye three-dimensional image towards the eyeball of the user.
In one embodiment of the present invention, the liquid crystal module includes:
the first electrode is close to the display module and covers the display module;
liquid crystal molecules;
the second electrode array is far away from the display module and comprises a plurality of second electrodes, and the liquid crystal molecules are positioned between the first electrodes and the second electrode array;
and the switching module controls at least one second electrode in the second electrode array to be electrified according to the determined first angle so as to enable the at least one second electrode to be electrified and the first electrode to form an electric field, so that the liquid crystal molecules are driven to turn, and the naked eye stereoscopic display screen displays a naked eye stereoscopic image towards the eyeballs of the user.
In one embodiment of the invention, the liquid crystal molecules are positive liquid crystal molecules.
In one embodiment of the invention, the second electrode array comprises:
a plurality of second electrodes arranged along a first direction, the first direction being perpendicular to a line between two eyes when a user is looking at the autostereoscopic display screen,
and the switching module determines a second electrode with a difference between a second angle and the first angle smaller than a preset threshold value from a plurality of second electrodes as a second electrode to be electrified, wherein the second angle is an included angle between a plane formed by the second electrode and the naked eye three-dimensional display screen along the central line of the first direction and the naked eye three-dimensional display screen.
In one embodiment of the present invention, the multifunctional in-vehicle display device provides a multi-level page displayed on the autostereoscopic display screen, and the control module includes:
the interface switching module is used for switching between pages at the same level according to the gesture track of the user captured by the gesture recognition module;
and the selection switching module is used for selecting options in the current display page according to the eye movement track of the user captured by the eye movement instrument so as to enter the next page.
According to still another aspect of the present invention, there is also provided a multifunctional in-vehicle display method, applied to the multifunctional in-vehicle display apparatus as described above, comprising:
displaying the naked eye stereoscopic image;
capturing an eye movement track of a user through the eye movement instrument;
capturing a gesture track of a user through the gesture recognition module;
controlling the naked eye stereoscopic image displayed by the naked eye stereoscopic display screen according to the user eye movement track captured by the eye movement instrument and/or the user gesture track captured by the gesture recognition module;
and detecting whether the user is tired to drive according to the user video collected by the camera module, and providing an alarm signal in response to the detection of the tired driving of the user.
According to still another aspect of the present invention, there is also provided an electronic apparatus including: a processor; a storage medium having stored thereon a computer program which, when executed by the processor, performs the steps as described above.
According to a further aspect of the present invention there is also provided a storage medium having stored thereon a computer program which, when executed by a processor, performs the steps as described above.
Compared with the prior art, the invention has the advantages that:
aiming at the current situation that in the prior art, the display effect of an in-car display screen (such as a combination instrument) is not outstanding enough, the structure is not compact enough and the interaction means is relatively single, the naked eye 3D combination instrument technology integrating eye interaction, gesture recognition and fatigue detection is provided.
Drawings
The above and other features and advantages of the present invention will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings.
Fig. 1 shows a block diagram of a multifunctional in-vehicle display apparatus according to an embodiment of the present invention.
Fig. 2 and 3 show schematic views of an autostereoscopic display according to an embodiment of the invention.
Fig. 4 is a block diagram showing a multifunctional in-vehicle display apparatus according to an embodiment of the present invention.
Fig. 5 shows a block diagram of an autostereoscopic display screen according to an embodiment of the invention.
Fig. 6 and 7 are schematic structural views of an autostereoscopic display screen according to an embodiment of the present invention.
Fig. 8 and 9 show schematic diagrams of a gesture switching page according to a specific embodiment of the present invention.
Fig. 10 and 11 are schematic diagrams of an eye-switch page according to an embodiment of the present invention.
Fig. 12 shows a flowchart of a multifunctional in-vehicle display method according to an embodiment of the present invention.
Fig. 13 schematically illustrates a computer-readable storage medium according to an exemplary embodiment of the present invention.
Fig. 14 schematically illustrates an electronic device according to an exemplary embodiment of the invention.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. However, the exemplary embodiments may be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
Furthermore, the drawings are merely schematic illustrations of the present invention and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus a repetitive description thereof will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software or in one or more hardware modules or integrated circuits or in different networks and/or processor devices and/or microcontroller devices.
The flow diagrams depicted in the figures are exemplary only and not necessarily all steps are included. For example, some steps may be decomposed, and some steps may be combined or partially combined, so that the order of actual execution may be changed according to actual situations.
Fig. 1 shows a block diagram of a multifunctional in-vehicle display apparatus according to an embodiment of the present invention. The multifunction vehicle interior display device 100 is provided on a vehicle. The multifunctional in-vehicle display device 100 may be provided on a vehicle as an instrument panel, for example. The multifunctional in-vehicle display device 100 includes an autostereoscopic display screen 110, a camera module 120, a control module 130, and a fatigue detection module 140.
The autostereoscopic display screen 110 is used for displaying an autostereoscopic image.
The camera module 120 is integrated on the autostereoscopic display screen. See in particular fig. 2 and 3. The camera module 120 is integrated in the frame area 111 of the autostereoscopic display screen 110 (fig. 2). Or the camera module 120 is integrated in the display area 112 of the autostereoscopic display screen 110 in a hidden manner. The present invention can realize more variations, for example, the display area of the autostereoscopic display screen 110 is not rectangular, and the variations are all within the protection scope of the present invention and are not described herein.
The camera module 120 includes an eye tracker 121 and a gesture recognition module 122. The eye tracker 121 is used to capture a user's eye movement trajectory. Gesture recognition module 122 is used to capture user gesture trajectories. Specifically, the eye tracker 121 may be, for example, a topi eye tracker, and the gesture recognition module 122 may be, for example, a Soli gesture recognition radar. The invention is not limited in this regard.
The control module 130 is configured to control the autostereoscopic image displayed on the autostereoscopic display screen 110 according to the user eye movement track captured by the eye movement instrument 121 and/or the user gesture track captured by the gesture recognition module 122.
The fatigue detection module 140 is configured to detect whether a user is tired to drive according to the user video acquired 120 by the camera module, and provide an alarm signal in response to detecting the user is tired to drive. The fatigue detection module 140 can determine whether the user is in fatigue driving according to the eye closing time, the head lowering time, and the yawning times of the user, and those skilled in the art can implement more fatigue detection methods, which are not described herein.
In the multifunctional in-vehicle display device of the exemplary embodiment of the invention, aiming at the current situation that in the prior art, the display effect of an in-vehicle display screen (such as a combination instrument) is not enough outstanding, the structure is not compact enough and the interaction means is relatively single, the technology of the naked eye 3D combination instrument integrating eye interaction, gesture recognition and fatigue detection is provided.
Fig. 1 is a schematic view of a multifunctional in-vehicle display device 100 according to the present invention, and the splitting, combining, and adding of modules are all within the scope of the present invention without departing from the concept of the present invention. The multifunctional in-vehicle display device 100 provided by the present invention may be implemented by software, hardware, firmware, plug-ins and any combination thereof, which is not limited to this.
In one embodiment of the present invention, referring to fig. 4, fig. 4 shows a block diagram of a multifunctional in-vehicle display device according to an embodiment of the present invention. In this embodiment, the steering wheel and select lever of the vehicle are provided with sensor electrodes 210 and 220. The sensor electrodes 210 and 220 may determine whether the user keeps touching the steering wheel and the select lever based on their electric field changes. The multifunctional in-vehicle display device 100 further includes an electrode signal receiving module 150 and an alarm signal transmitting module 160. The electrode signal receiving module 150 is configured to receive electrode signals sent by the sensor electrodes 210 and 220 disposed on the steering wheel and the gear selector, so as to determine whether the user touches the steering wheel and the gear selector with his hands at the current moment. The gesture recognition module 122 is triggered to capture a user gesture trajectory when electrode signals of sensor electrodes of the steering wheel and the select lever indicate that at least one hand of a user is not in contact with the steering wheel and the select lever. Thus, it can be appreciated that, in order to reduce system load, only when at least one of the user's hands is not performing driving (touching the steering wheel and/or touching the select lever), the user's hands that are not touching the steering wheel and/or select lever can be used for gesture control. The alarm signal sending module 160 is configured to provide current to the sensor electrodes disposed on the steering wheel and the gear selector in response to the fatigue detection module 140 detecting the fatigue driving of the user. Thereby alerting the user with a weak current. Meanwhile, the technical scheme also realizes multiplexing of the sensor electrodes 210 and 220.
In one embodiment of the present invention, referring to fig. 5, fig. 5 shows a block diagram of an autostereoscopic display screen according to a specific embodiment of the present invention. The autostereoscopic display screen 110 includes a display module 113, a liquid crystal module 114, and a switching module 115. The display module 113 may be a liquid crystal display module or an organic light emitting display module, which is not limited in this invention. The liquid crystal module 114 is located at the side of the display module 113, so that the image displayed by the display module 113 is a stereoscopic image through liquid crystal inversion. The switching module 115 is configured to determine a first angle formed by a user eyeball position and the autostereoscopic display screen according to a user eye movement track captured by the eye movement instrument, and control liquid crystal molecules of the liquid crystal module to turn according to the determined first angle so that the autostereoscopic display screen displays an autostereoscopic image towards the user eyeball.
Referring to fig. 6, fig. 6 shows a schematic diagram of the structure of the liquid crystal module 114 according to an embodiment of the invention. The liquid crystal module 114 includes a first electrode 114A, liquid crystal molecules 114B and a second electrode array.
The first electrode 114A is close to the display module 113. The first electrode 114A covers the display module 113. The liquid crystal molecules 114B are located between the first electrode 114A and the second electrode array. The liquid crystal molecules 114B are preferably positive liquid crystal molecules. The second electrode array is far away from the display module 113. The second electrode array includes a plurality of second electrodes 114C. The switching module controls at least one second electrode 114C in the second electrode array to be electrified according to the determined first angle, so that an electric field is formed between the at least one second electrode 114C and the first electrode to drive the liquid crystal molecules 114B to turn to enable the autostereoscopic display screen to display an autostereoscopic image towards the eyeball of the user.
In particular, with continued reference to fig. 6 and 7, in one embodiment of the invention, the second electrode array includes a plurality of second electrodes 114C arranged along a first direction. The first direction is perpendicular to a line between two eyes when a user looks at the naked eye stereoscopic display screen. The switching module determines, from a plurality of second electrodes 114C, a second electrode 114C having a difference between a second angle B and the first angle a smaller than a predetermined threshold value as a second electrode to be electrified, where the second angle B is an included angle between a plane formed by the second electrode 114C and a neutral line of the autostereoscopic display screen along the first direction and the autostereoscopic display screen (top surface of the first electrode). Specifically, the first angle a is an included angle between a plane formed by a center point between eyes of the user and a midline of the autostereoscopic display screen along the first direction and the autostereoscopic display screen (the top surface of the first electrode). Thereby, by energizing the determined second electrode to be energized to form an electric field between the second electrode 114C and the first electrode 114A, the liquid crystal molecules 114B between the second electrode 114C and the first electrode 114A are driven to rotate, thereby displaying an autostereoscopic image. The invention can realize more variation modes, and the second electrode to be electrified is updated according to the eyeball track of the user and the first included angle which changes in real time so as to update the display effect in real time. In still other variations, the first electrode and the second electrode may be switched between energized and de-energized according to a user eye trajectory and/or a user gesture, thereby switching between a stereoscopic display and a planar display, which are not described herein.
In one embodiment of the invention, see fig. 8-11. Fig. 8 and 9 show schematic diagrams of a gesture switching page according to a specific embodiment of the present invention. Fig. 10 and 11 are schematic diagrams of an eye-switch page according to an embodiment of the present invention. In this embodiment, the multifunctional in-vehicle display device provides a multi-level page displayed on the autostereoscopic display screen. The control module comprises an interface switching module and a selection switching module.
And the interface switching module is used for switching between pages at the same level according to the gesture track of the user captured by the gesture recognition module. As shown in fig. 8 to 9, the first-stage page A1 and the first-stage page A2 are combined together to form the first-stage page a (for example, the first-stage page A1 displays a plurality of options of the first-stage page a, and the first-stage page A1 displays the remaining plurality of options of the first-stage page a) according to the left-right swing of the user arm 300 from the first-stage page A1 to the first-stage page A2; the first-level page A1 and the first-level page B1 peer are switched from the first-level page A1 to the first-level page B1 according to the up-and-down swing of the user arm 300, and different functions are provided.
And the selection switching module is used for selecting options in the current display page according to the eye movement track of the user captured by the eye movement instrument so as to enter the next page. As shown in fig. 10 to 11, the option selected by the user is determined in the page according to the gazing position of the eyeball 400 of the user, thereby entering the next page.
The above description is merely illustrative of specific embodiments of the invention, and the steps may be performed individually or in combination, without departing from the scope of the invention.
Fig. 12 shows a flowchart of a multifunctional in-vehicle display method according to an embodiment of the present invention. The multifunctional in-vehicle display method is applied to the multifunctional in-vehicle display device, and comprises the following steps of:
step S410: displaying the naked eye stereoscopic image;
step S420: capturing an eye movement track of a user through the eye movement instrument;
step S430: capturing a gesture track of a user through the gesture recognition module;
step S440: controlling the naked eye stereoscopic image displayed by the naked eye stereoscopic display screen according to the user eye movement track captured by the eye movement instrument and/or the user gesture track captured by the gesture recognition module;
step S450: and detecting whether the user is tired to drive according to the user video collected by the camera module, and providing an alarm signal in response to the detection of the tired driving of the user. The alarm signal may be an acousto-optic signal, which is not described herein.
The above description is merely illustrative of the multifunctional in-vehicle display method of the present invention, and the execution order of the steps is not limited thereto, for example, the step S420 and the step S430 may be performed simultaneously or in reverse order. Step S450 may be performed before, between, after, or simultaneously with steps S410 to S440.
In the multifunctional in-vehicle display method of the exemplary embodiment of the invention, aiming at the current situations that in the prior art, the display effect of an in-vehicle display screen (such as a combination instrument) is not outstanding, the structure is not compact enough and the interaction means is relatively single, the naked eye 3D combination instrument technology integrating eye interaction, gesture recognition and fatigue detection is provided.
In an exemplary embodiment of the present invention, there is also provided a computer-readable storage medium having stored thereon a computer program which, when executed by, for example, a processor, can implement the steps of the multifunctional in-vehicle display method described in any one of the above embodiments. In some possible embodiments, the various aspects of the invention may also be implemented in the form of a program product comprising program code for causing a terminal device to carry out the steps according to the various exemplary embodiments of the invention as described in the above-mentioned multifunctional in-vehicle display method section of this specification, when said program product is run on the terminal device.
Referring to fig. 13, a program product 700 for implementing the above-described method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The computer readable storage medium may include a data signal propagated in baseband or as part of a carrier wave, with readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A readable storage medium may also be any readable medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the tenant computing device, partially on the tenant device, as a stand-alone software package, partially on the tenant computing device, partially on a remote computing device, or entirely on a remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the tenant computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected through the internet using an internet service provider).
In an exemplary embodiment of the invention, an electronic device is also provided, which may include a processor, and a memory for storing executable instructions of the processor. Wherein the processor is configured to perform the steps of the multi-function in-vehicle display method of any of the above embodiments via execution of the executable instructions.
Those skilled in the art will appreciate that the various aspects of the invention may be implemented as a system, method, or program product. Accordingly, aspects of the invention may be embodied in the following forms, namely: an entirely hardware embodiment, an entirely software embodiment (including firmware, micro-code, etc.) or an embodiment combining hardware and software aspects may be referred to herein as a "circuit," module "or" system.
An electronic device 500 according to this embodiment of the present invention is described below with reference to fig. 14. The electronic device 500 shown in fig. 14 is merely an example, and should not be construed as limiting the functionality and scope of use of embodiments of the present invention.
As shown in fig. 14, the electronic device 500 is embodied in the form of a general purpose computing device. The components of electronic device 500 may include, but are not limited to: at least one processing unit 510, at least one memory unit 520, a bus 530 connecting the different system components (including the memory unit 520 and the processing unit 510), a display unit 540, etc.
Wherein the storage unit stores program code executable by the processing unit 510 such that the processing unit 510 performs the steps according to various exemplary embodiments of the present invention described in the above-described section of the multifunctional in-vehicle display method of the present specification. For example, the processing unit 510 may perform the steps shown in fig. 1-3.
The memory unit 520 may include readable media in the form of volatile memory units, such as Random Access Memory (RAM) 5201 and/or cache memory unit 5202, and may further include Read Only Memory (ROM) 5203.
The storage unit 520 may also include a program/utility 5204 having a set (at least one) of program modules 5205, such program modules 5205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment.
Bus 530 may be one or more of several types of bus structures including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
The electronic device 500 may also communicate with one or more external devices 600 (e.g., keyboard, pointing device, bluetooth device, etc.), one or more devices that enable a tenant to interact with the electronic device 500, and/or any device (e.g., router, modem, etc.) that enables the electronic device 500 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 550. Also, electronic device 500 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet, through network adapter 560. The network adapter 560 may communicate with other modules of the electronic device 500 via the bus 530. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with electronic device 500, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
From the above description of embodiments, those skilled in the art will readily appreciate that the example embodiments described herein may be implemented in software, or may be implemented in software in combination with the necessary hardware. Thus, the technical solution according to the embodiment of the present invention may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (may be a CD-ROM, a usb disk, a mobile hard disk, etc.) or on a network, and includes several instructions to cause a computing device (may be a personal computer, a server, or a network device, etc.) to perform the above-described multifunctional in-vehicle display method according to the embodiment of the present invention.
Compared with the prior art, the invention has the advantages that:
aiming at the current situation that in the prior art, the display effect of an in-car display screen (such as a combination instrument) is not outstanding enough, the structure is not compact enough and the interaction means is relatively single, the naked eye 3D combination instrument technology integrating eye interaction, gesture recognition and fatigue detection is provided.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
Claims (9)
1. A multifunctional in-vehicle display device provided on a vehicle, comprising:
the naked eye stereoscopic display screen is used for displaying naked eye stereoscopic images;
the camera module, the camera module integrate in on the three-dimensional display screen of bore hole, include:
the eye movement instrument is used for capturing the eye movement track of a user;
the gesture recognition module is used for capturing gesture tracks of users;
the control module is used for controlling the naked eye stereoscopic image displayed by the naked eye stereoscopic display screen according to the user eye movement track captured by the eye movement instrument and/or the user gesture track captured by the gesture recognition module; the fatigue detection module is used for detecting whether a user is in fatigue driving or not according to the user video acquired by the camera shooting module and providing an alarm signal in response to the detection of the user fatigue driving;
the naked eye stereoscopic display screen comprises:
a display module;
the liquid crystal module is positioned on the light emitting side of the display module;
the switching module is used for determining a first angle formed by the position of the eyeball of the user and the naked eye three-dimensional display screen according to the eye movement track of the user captured by the eye movement instrument, and controlling the liquid crystal molecules of the liquid crystal module to turn according to the determined first angle so as to enable the naked eye three-dimensional display screen to display the naked eye three-dimensional image towards the eyeball of the user;
the liquid crystal module comprises:
the first electrode is close to the display module and covers the display module;
liquid crystal molecules;
the second electrode array is far away from the display module and comprises a plurality of second electrodes, and the liquid crystal molecules are positioned between the first electrodes and the second electrode array;
and the switching module controls at least one second electrode in the second electrode array to be electrified according to the determined first angle so as to enable the at least one second electrode to be electrified and the first electrode to form an electric field, so that the liquid crystal molecules are driven to turn, and the naked eye stereoscopic display screen displays a naked eye stereoscopic image towards the eyeballs of the user.
2. The multifunctional in-vehicle display apparatus according to claim 1, wherein,
the camera module is integrated in the frame area of the naked eye three-dimensional display screen; or alternatively
The camera module is integrated in a display area of the naked eye stereoscopic display screen in a hidden mode.
3. The multifunctional in-vehicle display apparatus according to claim 1, wherein sensor electrodes are provided on a steering wheel and a select lever of the vehicle, the multifunctional in-vehicle display apparatus further comprising:
the electrode signal receiving module is used for receiving electrode signals sent by sensor electrodes arranged on the steering wheel and the gear selecting rod, and triggering the gesture recognition module to capture gesture tracks of a user when the electrode signals of the sensor electrodes of the steering wheel and the gear selecting rod indicate that at least one hand of the user is not contacted with the steering wheel and the gear selecting rod;
and the alarm signal sending module is used for responding to the fatigue driving of the user detected by the fatigue detection module and providing current for the sensor electrodes arranged on the steering wheel and the gear selecting rod.
4. The multifunctional in-vehicle display apparatus of claim 1, wherein the liquid crystal molecules are positive liquid crystal molecules.
5. The multifunctional in-vehicle display apparatus of claim 1, wherein the second electrode array comprises:
a plurality of second electrodes arranged along a first direction, the first direction being perpendicular to a line between two eyes when a user is looking at the autostereoscopic display screen,
and the switching module determines a second electrode with a difference between a second angle and the first angle smaller than a preset threshold value from a plurality of second electrodes as a second electrode to be electrified, wherein the second angle is an included angle between a plane formed by the second electrode and the naked eye three-dimensional display screen along the central line of the first direction and the naked eye three-dimensional display screen.
6. The multi-function in-vehicle display apparatus of any one of claims 1 to 5, wherein the multi-function in-vehicle display apparatus provides a multi-level page displayed on the autostereoscopic display screen, the control module comprising:
the interface switching module is used for switching between pages at the same level according to the gesture track of the user captured by the gesture recognition module;
and the selection switching module is used for selecting options in the current display page according to the eye movement track of the user captured by the eye movement instrument so as to enter the next page.
7. A multifunctional in-vehicle display method, characterized by being applied to the multifunctional in-vehicle display device according to any one of claims 1 to 6, comprising:
displaying the naked eye stereoscopic image;
capturing an eye movement track of a user through the eye movement instrument;
capturing a gesture track of a user through the gesture recognition module;
controlling the naked eye stereoscopic image displayed by the naked eye stereoscopic display screen according to the user eye movement track captured by the eye movement instrument and/or the user gesture track captured by the gesture recognition module;
and detecting whether the user is tired to drive according to the user video collected by the camera module, and providing an alarm signal in response to the detection of the tired driving of the user.
8. An electronic device, the electronic device comprising:
a processor;
a memory having stored thereon a computer program which, when executed by the processor, performs the steps of claim 7.
9. A storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of claim 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910776544.XA CN110456914B (en) | 2019-08-21 | 2019-08-21 | Multifunctional in-vehicle display device, method, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910776544.XA CN110456914B (en) | 2019-08-21 | 2019-08-21 | Multifunctional in-vehicle display device, method, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110456914A CN110456914A (en) | 2019-11-15 |
| CN110456914B true CN110456914B (en) | 2024-04-09 |
Family
ID=68488387
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910776544.XA Active CN110456914B (en) | 2019-08-21 | 2019-08-21 | Multifunctional in-vehicle display device, method, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110456914B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111196281A (en) * | 2020-01-03 | 2020-05-26 | 恒大新能源汽车科技(广东)有限公司 | Page layout control method and device for vehicle display interface |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204929111U (en) * | 2015-08-11 | 2015-12-30 | 天津你有我影视文化发展有限公司 | Bore hole 3D display device |
| CN106200896A (en) * | 2016-06-23 | 2016-12-07 | 广州亿程交通信息有限公司 | Gesture recognition system and recognition methods for Vehicular intelligent equipment |
| CN107884947A (en) * | 2017-11-21 | 2018-04-06 | 中国人民解放军海军总医院 | Auto-stereoscopic mixed reality operation simulation system |
| CN207623956U (en) * | 2017-11-06 | 2018-07-17 | 深圳市愿景视讯科技有限公司 | More picture car message gesture interactions control holographic display system |
| CN109326085A (en) * | 2018-11-08 | 2019-02-12 | 上海掌门科技有限公司 | A kind of method and apparatus for the progress fatigue driving detection on vehicle arrangement |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9864498B2 (en) * | 2013-03-13 | 2018-01-09 | Tobii Ab | Automatic scrolling based on gaze detection |
-
2019
- 2019-08-21 CN CN201910776544.XA patent/CN110456914B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204929111U (en) * | 2015-08-11 | 2015-12-30 | 天津你有我影视文化发展有限公司 | Bore hole 3D display device |
| CN106200896A (en) * | 2016-06-23 | 2016-12-07 | 广州亿程交通信息有限公司 | Gesture recognition system and recognition methods for Vehicular intelligent equipment |
| CN207623956U (en) * | 2017-11-06 | 2018-07-17 | 深圳市愿景视讯科技有限公司 | More picture car message gesture interactions control holographic display system |
| CN107884947A (en) * | 2017-11-21 | 2018-04-06 | 中国人民解放军海军总医院 | Auto-stereoscopic mixed reality operation simulation system |
| CN109326085A (en) * | 2018-11-08 | 2019-02-12 | 上海掌门科技有限公司 | A kind of method and apparatus for the progress fatigue driving detection on vehicle arrangement |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110456914A (en) | 2019-11-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7178447B2 (en) | Vehicle control method, device, vehicle, electronic device and storage medium | |
| US20190092345A1 (en) | Driving method, vehicle-mounted driving control terminal, remote driving terminal, and storage medium | |
| US10705521B2 (en) | Autonomous driving interface | |
| US9437131B2 (en) | Driving a multi-layer transparent display | |
| CN114153406B (en) | Method and device for displaying application | |
| US20170147271A1 (en) | Identifying the positioning in a multiple display grid | |
| US10496890B2 (en) | Vehicular collaboration for vehicular blind spot detection | |
| EP2827223A1 (en) | Gesture input operation processing device | |
| US20150178990A1 (en) | System and method for in-vehicle interaction | |
| EP2829440A1 (en) | On-board apparatus | |
| CN112822529B (en) | Electronic apparatus and control method thereof | |
| CN104866089A (en) | Adjusting a display based on a detected orientation | |
| US9134891B1 (en) | Format and display configuration selection of a display device | |
| US20210055790A1 (en) | Information processing apparatus, information processing system, information processing method, and recording medium | |
| JPWO2018066026A1 (en) | Automatic operation control parameter changing device and automatic operation control parameter changing method | |
| CN110456914B (en) | Multifunctional in-vehicle display device, method, electronic equipment and storage medium | |
| US20160048665A1 (en) | Unlocking an electronic device | |
| CN110614634B (en) | Control method, portable terminal, and storage medium | |
| CN105573622A (en) | Single-hand control method and device of user interface and terminal device | |
| CN111638786B (en) | Display control method, device, equipment and storage medium of vehicle-mounted rear projection display system | |
| CN115022611B (en) | VR picture display method, electronic device and readable storage medium | |
| KR101480617B1 (en) | Apparatus and method for processing image signal | |
| KR101821147B1 (en) | Device and Method for Providing Video | |
| CN117435153A (en) | Screen display system, display control method and electronic equipment of vehicle-mounted terminal | |
| TR201702396A2 (en) | TOUCH BACK FEEDING USING VARIABLE SURFACE FRICTION OF A TOUCH SCREEN IMAGE |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |