CN112558305B - Control method, device and medium of display picture and head-up display control system - Google Patents
Control method, device and medium of display picture and head-up display control system Download PDFInfo
- Publication number
- CN112558305B CN112558305B CN202011529820.1A CN202011529820A CN112558305B CN 112558305 B CN112558305 B CN 112558305B CN 202011529820 A CN202011529820 A CN 202011529820A CN 112558305 B CN112558305 B CN 112558305B
- Authority
- CN
- China
- Prior art keywords
- head
- display
- instruction
- gesture
- operation instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
Abstract
The invention discloses a control method of a display picture, which comprises the following steps: acquiring the current gesture operation of a user according to a gesture acquisition device; determining a corresponding current gesture operation type according to the current gesture operation; searching a head-up display operation instruction corresponding to the current gesture operation type from a preset corresponding relation between the gesture operation type and the head-up display operation instruction; and converting the display picture of the head-up display system according to the head-up display operation instruction. The embodiment of the invention also provides a control device, a medium and a head-up display control system for displaying pictures, which can effectively solve the problem that the setting of the head-up display system cannot be accurately finished in the prior art.
Description
Technical Field
The present invention relates to the field of display technologies, and in particular, to a method, an apparatus, a medium, and a head-up display control system for controlling a display screen.
Background
With the rapid development of new energy vehicles, more and more vehicles are equipped with a Head Up Display (HUD) for safe driving of users. At present, the control of the head-up display is generally completed by controlling a central control touch screen, a single function key (such as a steering wheel switch) or voice. However, when the head-up display is controlled through the central control touch screen and the single function keys, a user needs to frequently adjust the head-up display in the driving process, and the safety factor of vehicle driving is low; when the head-up display is controlled by voice, the vehicle is easily interfered by external sound, and the voice instruction of the user cannot be accurately recognized, so that the setting of the head-up display cannot be completed.
Disclosure of Invention
The embodiment of the invention provides a control method, a control device, a control medium and a head-up display control system for a display picture, which can effectively solve the problem that the setting of the head-up display system cannot be accurately finished in the prior art.
An embodiment of the present invention provides a method for controlling a display screen, including:
acquiring the current gesture operation of a user according to a gesture acquisition device;
determining a corresponding current gesture operation type according to the current gesture operation;
searching a head-up display operation instruction corresponding to the current gesture operation type from a preset corresponding relation between the gesture operation type and the head-up display operation instruction; the corresponding relation between the gesture operation type and the head-up display operation instruction is preset in the head-up display system, and the corresponding relation between the gesture operation type and the head-up display operation instruction comprises at least one gesture operation type and a head-up display operation instruction corresponding to each gesture operation type;
and converting the display picture of the head-up display system according to the head-up display operation instruction.
As an improvement of the above scheme, the determining a corresponding current gesture operation type according to the current gesture operation specifically includes:
recognizing a gesture type corresponding to the current gesture operation according to a preset static gesture recognition algorithm;
identifying an operation type corresponding to the current gesture operation according to a preset dynamic gesture identification algorithm;
and determining a corresponding current gesture operation type according to the gesture type and the operation type.
As an improvement of the above solution, the gesture types include: a palm, a single finger, and at least two fingers;
the operation types include: up movement, down movement, left movement, right movement, open operation, close operation, and movement in a diagonal direction.
As an improvement of the above solution, the gesture operation types include: palm up movement, palm down movement, palm left movement, palm right movement, palm diagonal movement, palm open, palm closed, single finger up movement, single finger down movement, single finger left movement, single finger right movement, at least two fingers open, at least two fingers closed, and at least two fingers moved in any direction.
As an improvement of the above solution, the preset correspondence between the gesture operation type and the head-up display operation instruction includes at least one of:
the corresponding head-up display operation instruction is a starting navigation instruction when the palm moves upwards;
the corresponding head-up display operation instruction of the downward movement of the palm is a navigation closing instruction;
the corresponding head-up display operation instruction for moving the palm to the left is an instruction for starting a driving auxiliary system;
the head-up display operation instruction corresponding to the palm right movement is an instruction for closing the driving assistance system;
the head-up display operation instruction corresponding to the palm opening is an instruction for opening a head-up display picture;
the head-up display operation instruction corresponding to the palm closing is a head-up display image closing instruction;
the corresponding head-up display operation instruction is switched to a snow-on mode or a snow-off mode when the palm moves along the diagonal direction;
the corresponding head-up display operation instruction of the upward movement of the single finger is a display image height increasing instruction;
the corresponding head-up display operation instruction of the single finger moving downwards is a display image height reducing instruction;
the corresponding head-up display operation instruction of the single finger moving to the left is a display image brightness increasing instruction;
the head-up display operation instruction corresponding to the movement of the single finger to the right is a display image brightness reduction instruction;
the head-up display operation instruction corresponding to the at least two fingers being opened is a display image magnification instruction;
the head-up display operation instruction corresponding to the at least two closed fingers is a display image reduction instruction;
and the at least two fingers move along any direction, and the corresponding head-up display operation instruction is a display image moving instruction along any direction.
As an improvement of the above, the method further comprises:
if the corresponding head-up display operation instruction cannot be found from the corresponding relation between the preset gesture operation type and the head-up display operation instruction, sending all the head-up display operation instructions to a user for the user to select the operation instruction;
and receiving a head-up display operation instruction selected by a user, and converting a display picture of the head-up display system according to the head-up display operation instruction selected by the user.
Another embodiment of the present invention correspondingly provides a control device for displaying a picture, including:
the acquisition module is used for acquiring the current gesture operation of the user according to the gesture acquisition device;
the determining module is used for determining the corresponding current gesture operation type according to the current gesture operation;
the searching module is used for searching a head-up display operation instruction corresponding to the current gesture operation type from the corresponding relation between the preset gesture operation type and the head-up display operation instruction; the corresponding relation between the gesture operation type and the head-up display operation instruction is preset in the head-up display system, and the corresponding relation between the gesture operation type and the head-up display operation instruction comprises at least one gesture operation type and a head-up display operation instruction corresponding to each gesture operation type;
and the control module is used for converting the display picture of the head-up display system according to the head-up display operation instruction.
Another embodiment of the present invention provides a head-up display control system of a vehicle, including: front windshield and heads-up display systems; wherein the head-up display system comprises: the control system comprises a gesture acquisition device, an image generation module, a reflector group for reflecting imaging light rays emitted by the image generation module to the front windshield, a processor, a memory and a computer program which is stored in the memory and configured to be executed by the processor, wherein the processor realizes the control method of the display picture in the embodiment of the invention when executing the computer program;
imaging light rays emitted by the head-up display system are refracted to the eyeball position of a driver through the front windshield;
wherein the mirror group comprises: the imaging light rays emitted by the image generation module form parallel light rays after being reflected by the second concave reflector and then enter the first concave reflector; the processor is respectively connected with the gesture acquisition device and the memory.
As an improvement of the above solution, the system installs the front windshield by the steps of:
calculating the horizontal curvature gradual progress according to the horizontal curvature radius of the front windshield;
calculating the vertical curvature gradual progress according to the vertical curvature radius of the front windshield;
and when the horizontal direction curvature progressive degree is smaller than a preset horizontal direction curvature progressive degree threshold value and the vertical direction curvature progressive degree is smaller than a preset vertical direction curvature progressive degree threshold value, the front windshield is installed.
Another embodiment of the present invention provides a storage medium, where the computer-readable storage medium includes a stored computer program, where when the computer program runs, a device on which the computer-readable storage medium is located is controlled to execute the method for controlling a display screen according to the above-described embodiment of the present invention.
Compared with the prior art, the method, the device, the medium and the head-up display control system for controlling the display frame disclosed by the embodiment of the invention have the advantages that the current gesture operation of the user is acquired through the gesture acquisition device, the corresponding current gesture operation type is determined according to the current gesture operation, the head-up display operation instruction corresponding to the current gesture operation type is searched according to the corresponding relation between the gesture operation type and the head-up display operation instruction, and the display frame of the head-up display system is changed according to the head-up display operation instruction. Therefore, the display picture of the head-up display system is controlled through gesture operation, so that a user does not need to frequently adjust the head-up display system in a head-down mode in the driving process, the vehicle driving process is safer, the interference of external sounds is avoided, the user instruction can be accurately identified by the head-up display system, the display picture is controlled to display, the head-up display setting is completed, and the user experience is improved.
Drawings
Fig. 1 is a flowchart illustrating a method for controlling a display according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a step S20 of a method for controlling a display according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating an embodiment of a method for controlling a display according to the present invention;
fig. 4 is a schematic diagram illustrating another embodiment of a method for controlling a display according to an embodiment of the present invention;
FIG. 5 is a diagram illustrating another embodiment of a method for controlling a display according to an embodiment of the present invention;
FIG. 6 is a diagram illustrating another embodiment of a method for controlling a display according to an embodiment of the present invention;
fig. 7 is a schematic diagram illustrating another embodiment of a method for controlling a display according to an embodiment of the present invention;
fig. 8 is a schematic diagram illustrating another embodiment of a method for controlling a display according to an embodiment of the present invention;
fig. 9 is a schematic diagram illustrating another embodiment of a method for controlling a display according to an embodiment of the present invention;
fig. 10 is a schematic diagram illustrating another embodiment of a method for controlling a display according to an embodiment of the present invention;
FIG. 11 is a schematic structural diagram of a control device for displaying a screen according to an embodiment of the present invention;
fig. 12 is a schematic structural diagram of a head-up display system according to an embodiment of the invention;
fig. 13 is a schematic structural diagram of a head-up display control system of a vehicle according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1-2 are schematic flow charts of a method for controlling a display according to an embodiment of the present invention.
The control method for the display screen provided in this embodiment may be executed by a processor of a head-up display system (even a cloud server, etc.), the head-up display system may be implemented in a software and/or hardware manner, and the head-up display system may be formed by two or more physical entities or may be formed by one physical entity.
Further, the head-up display system is applied to a vehicle, and a processor of the head-up display system is connected with the gesture collecting device 13, the wireless communication module, a display system of the vehicle, a driving system of the vehicle, and the like (the connection mode may be a wired connection mode or a wireless connection mode). The head-up display system obtains the gesture operation of the user through the gesture acquisition device 13, communicates with the outside through the wireless communication module, and sends a corresponding operation instruction to the driving system so that the driving system controls the driving of the vehicle according to the operation instruction. It should be noted that the above-mentioned various information may be directly sent to the head-up display system, or may be sent to another information processing device first, and then the information processing device sends the processed information to the head-up display system after corresponding information processing.
As shown in fig. 1, an embodiment of the present invention provides a method for controlling a display screen, including:
and S10, acquiring the current gesture operation of the user according to the gesture acquisition device 13.
Specifically, after the head-up display system is powered on, the head-up display system starts to work, and the gesture operation of the user is acquired through the gesture acquisition device 13. The gesture collection device 13 may be an infrared device, a camera, or other devices capable of collecting gestures. Further, when the gesture collection device 13 is a plurality of infrared geminate transistors (an infrared emission LED lamp and an infrared reception LED lamp), a part of infrared light is reflected and received by a reception LED lamp in the system and converted into an electric signal by blocking the infrared light when the user performs a gesture operation, so that the gesture of the user is determined. When the gesture collection device 13 is a shooting device, specifically, a camera, and when the user starts gesture operation, the camera takes a gesture of the user. In this embodiment, the gesture capturing device 13 is used as a camera for explanation.
And S20, determining the corresponding current gesture operation type according to the current gesture operation.
It should be noted that each gesture operation corresponds to one gesture operation type, and in this embodiment, after a gesture picture taken by a camera is obtained, a gesture in the gesture picture is recognized, so that the gesture operation type is determined.
S30, searching a head-up display operation instruction corresponding to the current gesture operation type from a preset corresponding relation between the gesture operation type and the head-up display operation instruction; the corresponding relation between the gesture operation type and the head-up display operation instruction is preset in the head-up display system, and the corresponding relation between the gesture operation type and the head-up display operation instruction comprises at least one gesture operation type and a head-up display operation instruction corresponding to each gesture operation type.
Specifically, in order to better control the display screen of the head-up display system through gesture operation, a corresponding relationship between the gesture operation type and the head-up display operation instruction is preset in the head-up display system. In this embodiment, the function that the head-up display system can perform setting is determined first, and different gesture operations are set according to different functions, for example, the head-up display system may perform navigation display, so that the operations that the user needs to perform correspond to actions such as starting navigation and closing navigation, and the palm is set to move upward, that is, the navigation is started, and the palm moves downward, that is, the navigation is closed. And correspondingly storing the gesture operation and the operation instruction into the corresponding relation between the gesture operation type and the head-up display operation instruction, so that the corresponding head-up display operation instruction can be obtained after the gesture operation type of the user is obtained. It should be noted that the corresponding relationship between the gesture operation type and the head-up display operation instruction may be stored in the head-up display system in the form of a relationship table, and may also be stored in other forms in the head-up display system, which is not limited herein.
And S40, converting a display picture of the head-up display system according to the head-up display operation instruction.
Specifically, after the head-up display operation instruction corresponding to the gesture operation type is determined, the display picture is controlled to be changed according to the head-up display operation instruction. The change of the display screen may be a screen condition in which the visual effect changes, such as a change in the brightness, a change in the height, or a change in the display content.
Exemplarily, when the gesture operation type is that the palm moves upwards, and the corresponding head-up display operation instruction is a navigation starting instruction, the navigation interface is displayed on the display screen, so that the head-up display system accurately identifies the instruction of the user, and the setting of the head-up display system is accurately completed, thereby improving the user experience.
In summary, the current gesture operation of the user is obtained through the gesture collecting device 13, the corresponding current gesture operation type is determined according to the current gesture operation, and then the head-up display operation instruction corresponding to the current gesture operation type is searched according to the corresponding relationship between the gesture operation type and the head-up display operation instruction, so that the display frame of the head-up display system is changed according to the head-up display operation instruction. Therefore, the display picture of the head-up display system is controlled through gesture operation, so that a user does not need to frequently adjust the head-up display system in a head-down mode in the driving process, the vehicle driving process is safer, the interference of external sounds is avoided, the user instruction can be accurately identified by the head-up display system, the display picture is controlled to display, the head-up display setting is completed, and the user experience is improved.
In a preferred embodiment, the determining, according to the current gesture operation, a corresponding current gesture operation type includes:
s200, recognizing the gesture type corresponding to the current gesture operation according to a preset static gesture recognition algorithm.
Further, the gesture types include: a palm, a single finger, and at least two fingers. The at least two fingers include at least two fingers.
It should be noted that the preset static gesture recognition algorithm may learn various gestures according to methods such as a neural network or a classifier, for example, training an image of a palm, an image of a single finger, images of two fingers, images of three fingers, and the like through the neural network, so that the static gesture recognition algorithm can recognize a gesture type of a current gesture operation.
S201, identifying an operation type corresponding to the current gesture operation according to a preset dynamic gesture recognition algorithm.
Further, the operation types include: upward movement, downward movement, leftward movement, rightward movement, opening operation, closing operation, diagonal movement, and the like. It will be appreciated that the operation type may also be S-type movement, C-type movement, etc. In the present embodiment, the moving in the diagonal direction includes: move from bottom left to top right, move from top left to bottom right, move from top right to bottom left, and move from bottom right to top left.
It should be noted that the preset dynamic gesture recognition algorithm may learn various gesture operations according to methods such as a neural network or a classifier, for example, training a plurality of images of palm movement, an image of single finger movement, an image of two finger movements, and the like through the neural network, so that the dynamic gesture recognition algorithm can recognize the operation type of the current gesture operation.
Specifically, the operation type of the gesture operation may be identified by a video segment captured by a camera, or may be obtained by displacement identification of a plurality of still images.
And S202, determining a corresponding current gesture operation type according to the gesture type and the operation type.
Further, the gesture operation types include: palm up movement, palm down movement, palm left movement, palm right movement, palm diagonal movement, palm open, palm closed, single finger up movement, single finger down movement, single finger left movement, single finger right movement, at least two fingers open, at least two fingers closed, and at least two fingers moving in any direction. It is understood that the gesture operation type is obtained by combining a gesture type and an operation type, and as the gesture type increases and the operation type increases, more gesture operation types can be combined, and the gesture operation type is not limited to the above-listed gesture operation types.
Specifically, after the image of the current gesture operation is acquired, the gesture type and the operation type are recognized at the same time, for example, if the operation is recognized through a palm, and the operation is moved to the left, the gesture operation type is that the palm is moved to the left.
In a preferred embodiment, the preset corresponding relationship between the gesture operation type and the head-up display operation instruction includes at least one of the following:
the corresponding head-up display operation instruction is a starting navigation instruction when the palm moves upwards;
the corresponding head-up display operation instruction of the downward movement of the palm is a navigation closing instruction;
the corresponding head-up display operation instruction for moving the palm to the left is an instruction for starting a driving auxiliary system;
the head-up display operation instruction corresponding to the palm right movement is an instruction for closing the driving assistance system;
the head-up display operation instruction corresponding to the palm opening is an instruction for opening a head-up display picture;
the head-up display operation instruction corresponding to the palm closing is a head-up display image closing instruction;
the corresponding head-up display operation instruction is switched to a snow-on mode or a snow-off mode when the palm moves along the diagonal direction;
the corresponding head-up display operation instruction of the upward movement of the single finger is a display image height increasing instruction;
the single finger moves downwards to correspond to the head-up display operation instruction which is an instruction for reducing the height of the display picture;
the corresponding head-up display operation instruction for moving the single finger to the left is a display image brightness increasing instruction;
the head-up display operation instruction corresponding to the movement of the single finger to the right is a display image brightness reduction instruction;
the head-up display operation instruction corresponding to the opening of the at least two fingers is a display image amplification instruction;
the head-up display operation instruction corresponding to the at least two closed fingers is a display image reduction instruction;
and the at least two fingers move along any direction, and the corresponding head-up display operation instruction is a display image moving instruction along any direction.
It should be noted that the preset correspondence between the gesture operation type and the head-up display operation command may be set when the vehicle leaves the factory, or may be set according to the personal habit of the user, which is not limited herein. Each gesture corresponds to one head-up display operation instruction, so that the display picture of the head-up display system can be accurately and quickly changed only by recognizing the gesture operation of a user, the safety factor of the driving process is higher, and the user experience is further improved.
To facilitate an understanding of embodiments of the present invention, several implementation scenarios are provided herein:
for example, referring to fig. 3, the gesture collecting device 13 collects a current gesture operation, and after determining that the gesture operation type is that the palm moves upward, finds out that the corresponding head-up display operation instruction is an open navigation instruction from the corresponding relationship between the gesture operation type and the head-up display operation instruction; and after the gesture operation type is determined to be that the palm moves downwards, finding out that the corresponding head-up display operation instruction is a navigation closing instruction from the corresponding relation between the gesture operation type and the head-up display operation instruction.
For example, referring to fig. 4, the gesture collecting device 13 collects a current gesture operation, and after determining that the gesture operation type is that the palm moves to the left, finds out a corresponding head-up display operation instruction from the corresponding relationship between the gesture operation type and the head-up display operation instruction as an instruction to start the driving assistance system; and after the gesture operation type is determined to be the palm rightwards movement, finding out that the corresponding head-up display operation instruction is a driving auxiliary system closing instruction from the corresponding relation between the gesture operation type and the head-up display operation instruction.
For example, referring to fig. 5, the gesture collecting device 13 collects the current gesture operation, and after determining that the gesture operation type is that the palm is opened, finds out that the corresponding head-up display operation instruction is an instruction to open the head-up display screen from the corresponding relationship between the gesture operation type and the head-up display operation instruction; and after the gesture operation type is determined to be the palm closing, searching the corresponding head-up display operation instruction from the corresponding relation between the gesture operation type and the head-up display operation instruction to be a head-up display image closing instruction.
For example, in this embodiment, the corresponding head-up display operation command for moving the palm from left to bottom and right to top is an on snow mode command, and the corresponding head-up display operation command for moving the palm from right to top and left to bottom is an off snow mode command. Referring to fig. 6, the gesture collecting device 13 collects the current gesture operation, and after determining that the gesture operation type is that the palm moves from left to bottom to right to top, finds out the corresponding head-up display operation instruction as the snow-open mode instruction from the corresponding relationship between the gesture operation type and the head-up display operation instruction; and after the gesture operation type is determined to move from the upper right to the lower left, searching the corresponding head-up display operation instruction from the corresponding relation between the gesture operation type and the head-up display operation instruction as a snow-off mode instruction.
Exemplarily, referring to fig. 7, the gesture collecting device 13 collects a current gesture operation, and after determining that the gesture operation type is that a single finger moves upward, finds out a corresponding head-up display operation instruction from a corresponding relationship between the gesture operation type and the head-up display operation instruction as a display image height increasing instruction; and after the gesture operation type is determined to be that a single finger moves downwards, searching the corresponding head-up display operation instruction from the corresponding relation between the gesture operation type and the head-up display operation instruction to be a display image height reducing instruction.
Exemplarily, referring to fig. 8, the gesture collecting device 13 collects a current gesture operation, and after determining that the gesture operation type is that a single finger moves leftward, finds out a corresponding head-up display operation instruction as a display image brightness increase instruction from a corresponding relationship between the gesture operation type and the head-up display operation instruction; and after the gesture operation type is determined to be the movement of a single finger to the right, searching the corresponding head-up display operation instruction from the corresponding relation between the gesture operation type and the head-up display operation instruction to be a display image brightness reduction instruction.
For example, in the present embodiment, at least two fingers are taken as an example of two fingers, specifically, a thumb and an index finger. Referring to fig. 9, the gesture collecting device 13 collects the current gesture operation, and after it is determined that the gesture operation type is two fingers open, finds out the corresponding head-up display operation instruction as a display image enlarging instruction from the corresponding relationship between the gesture operation type and the head-up display operation instruction; and after the gesture operation type is determined to be that two fingers are closed, searching the corresponding head-up display operation instruction from the corresponding relation between the gesture operation type and the head-up display operation instruction to be a display image reduction instruction. For example, the current display screen of the head-up display system is a navigation screen, and when a user needs to view a specific route of a map, the thumb and the index finger are opened, so that the head-up display system responds to a display screen zoom-in instruction to zoom in the map.
For example, in the present embodiment, at least two fingers are exemplified as two fingers. Referring to fig. 10, the gesture collecting device 13 collects the current gesture operation, and after determining that the gesture operation type is that two fingers are along any direction, finds out the corresponding head-up display operation instruction from the corresponding relationship between the gesture operation type and the head-up display operation instruction as a movement instruction of the display screen along any direction. It is to be understood that when the two fingers are simultaneously moved in any direction, such as up, down, left, or right, the control display is moved in the direction corresponding to the movement of the two fingers. According to the various implementation scenes, when the head-up display system is operated by recognizing gestures, the display picture is controlled, and the head-up display system can accurately recognize the instruction of the user, so that the user experience is improved.
In a preferred embodiment, the method further comprises:
and if the corresponding head-up display operation instruction cannot be found from the corresponding relation between the preset gesture operation type and the head-up display operation instruction, sending all the head-up display operation instructions to the user for the user to select the operation instruction.
And receiving a head-up display operation instruction selected by a user, and converting a display picture of the head-up display system according to the head-up display operation instruction selected by the user.
It should be noted that, if the head-up display operation instruction corresponding to the gesture operation type cannot be found in the head-up display system, all the head-up display operation instructions stored in the head-up display system may be sent to the user, so that the user can select the operation instruction through the central control platform, and the display picture of the head-up display system is changed according to the head-up display operation instruction selected by the user. And sending the matching relation between whether the gesture operation type is changed and the head-up display operation instruction to the user, namely, replacing the old gesture operation with the new gesture operation of the user and matching the new gesture operation with the operation instruction. If the user determines to change, the user respectively learns through a static gesture recognition algorithm and a dynamic gesture recognition algorithm, so that the user can control the display picture to change by adopting a user-defined gesture.
Fig. 11 is a schematic structural diagram of a control device for displaying a screen according to an embodiment of the present invention.
An embodiment of the present invention correspondingly provides a control device for displaying a picture, including:
the obtaining module 10 is configured to obtain a current gesture operation of the user according to the gesture collecting device 13.
And a determining module 20, configured to determine a corresponding current gesture operation type according to the current gesture operation.
The searching module 30 is configured to search a head-up display operation instruction corresponding to the current gesture operation type from a preset correspondence between gesture operation types and head-up display operation instructions; the corresponding relation between the gesture operation type and the head-up display operation instruction is preset in the head-up display system, and the corresponding relation between the gesture operation type and the head-up display operation instruction comprises at least one gesture operation type and a head-up display operation instruction corresponding to each gesture operation type.
And the control module 40 is used for converting the display picture of the head-up display system according to the head-up display operation instruction.
In a preferred embodiment, the determining module further includes:
and the first calculation module is used for identifying the gesture type corresponding to the current gesture operation according to a preset static gesture recognition algorithm.
And the second calculation module is used for identifying the operation type corresponding to the current gesture operation according to a preset dynamic gesture recognition algorithm.
And the processing module is used for determining the corresponding current gesture operation type according to the gesture type and the operation type.
According to the control device for the display frame, the display frame of the head-up display system is controlled through gesture operation, so that a user does not need to frequently adjust the head-up display system in a head-down mode in the driving process, the vehicle driving process is safer, meanwhile, interference of external sound is avoided, the head-up display system can accurately recognize the instruction of the user to control the display frame to display, the head-up display setting is completed, and the user experience is improved.
Referring to fig. 12 to 13, a head up display control system for a vehicle according to an embodiment of the present invention includes: a front windshield 16 and a heads-up display system; wherein the head-up display system comprises: the device comprises a gesture acquisition device 13, an image generation module 15, a mirror group for reflecting imaging light rays emitted by the image generation module 15 to the front windshield 16, a processor 11, a memory 12 and a computer program stored in the memory 12 and capable of running on the processor 11. The processor 11 implements the steps in the above-described embodiments of the control method for each display screen when executing the computer program. Alternatively, the processor 11 implements the functions of the modules/units in the above-described device embodiments when executing the computer program.
Imaging light emitted by the head-up display system is refracted to an eyeball position 17 of a driver through the front windshield 16;
wherein the reflector assembly 14 comprises: the imaging light emitted by the image generation module 15 is reflected by the second concave reflector 142 to form parallel light and then enters the first concave reflector 141; the processor 11 is connected to the gesture collecting device 13 and the memory 12, respectively.
It should be noted that the head-up display control system of the vehicle may be a controller of the entire vehicle, and may also be a cloud server, which is not limited herein. The gesture collecting device 13 may be externally connected to the head-up display system, or may be disposed in the head-up display system. In this embodiment, the gesture collecting device 13 may be an infrared device, and may also be a shooting device, which is not limited again.
In a preferred embodiment, the system mounts the front windshield 16 by:
calculating the horizontal curvature gradual progress according to the horizontal curvature radius of the front windshield 16;
calculating the vertical curvature gradual progress according to the vertical curvature radius of the front windshield 16;
and when the horizontal direction curvature gradient is smaller than a preset horizontal direction curvature gradient threshold value and the vertical direction curvature gradient is smaller than a preset vertical direction curvature gradient threshold value, installing the front windshield 16.
In practical use, the front windshield 16 of the automobile is a free-surface concave mirror, and the vertical curvature of the front windshield 100 of the passenger car is larger than the lateral curvature, and the vertical curvature radius of the mirror surface of the front windshield 100 in the HUD imaging area is usually more than 4000mm, which is close to the imaging effect of a plane mirror. However, since the optical model often reduces the longitudinal deviation of the windshield to a plane mirror in the calculation, it is easy to cause deviation in the refraction of the imaging light. Therefore, in the embodiment of the present invention, the degree of progress of the curvature of the front windshield 16 in the horizontal direction and the degree of progress of the curvature of the front windshield 16 in the vertical direction are respectively determined, so that image ghosting is eliminated, images viewed by a driver are formed consistently, and user experience is better.
In particular, the amount of the solvent to be used,
a is expressed as the degree of curvature in the horizontal direction, R 1MAX Expressed as the maximum value of the radius of curvature in the horizontal direction, R 1MIN Expressed as the minimum value of the radius of curvature in the horizontal direction, R 1avg Expressed as the average value of the radius of curvature in the horizontal direction.
In this embodiment, the preset horizontal curvature gradient threshold and the preset vertical curvature gradient threshold are both set to 20%, and may also be set to other values as needed, which is not limited herein.
According to the head-up display control system of the vehicle, provided by the embodiment of the invention, due to the adoption of the head-up display system, a user does not need to frequently adjust the head-up display system in a head-down mode in the driving process, the driving process of the vehicle is safer, meanwhile, the interference of external sound is avoided, and the head-up display system can accurately identify the instruction of the user so as to control the display picture to display, so that the head-up display setting is completed. Moreover, since the horizontal curvature progressing degree of the front windshield 16 and the vertical curvature progressing degree of the front windshield 16 are respectively judged before the front windshield 16 is installed, the driver can see that the head-up display system has consistent images, and the user experience is improved.
Illustratively, the computer program may be divided into one or more modules/units, which are stored in the memory and executed by the processor 11 to accomplish the present invention. The one or more modules/units may be a series of computer program instruction segments capable of performing certain functions, the instruction segments describing the execution of the computer program in the heads-up display system.
The head-up display system can be computing equipment such as a cloud server. The head-up display system may include, but is not limited to, a processor 11, a memory 12. It will be understood by those skilled in the art that the schematic diagram is merely an example of a heads-up display system and is not intended to limit the heads-up display system, and may include more or fewer components than shown, or some components may be combined, or different components, for example, the heads-up display system may also include input-output devices, network access devices, buses, etc.
The Processor 11 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The general purpose processor may be a microprocessor or the processor may be any conventional processor or the like that is the control center of the heads-up display system and connects the various parts of the overall heads-up display system using various interfaces and lines.
The memory 12 may be used to store the computer programs and/or modules, and the processor may implement various functions of the heads-up display system by running or executing the computer programs and/or modules stored in the memory and calling up data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, etc. In addition, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
Wherein, the integrated module/unit of the head-up display system can be stored in a computer readable storage medium if it is implemented in the form of software functional unit and sold or used as a stand-alone product. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, read-Only Memory (ROM), random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like.
It should be noted that the above-described device embodiments are merely illustrative, where the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. In addition, in the drawings of the embodiment of the apparatus provided by the present invention, the connection relationship between the modules indicates that there is a communication connection therebetween, and may be specifically implemented as one or more communication buses or signal lines. One of ordinary skill in the art can understand and implement without inventive effort.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.
Claims (6)
1. A head-up display control system of a vehicle, characterized by comprising: front windshield and heads-up display systems; wherein the head-up display system comprises: the device comprises a gesture acquisition device, an image generation module, a reflector group for reflecting imaging light rays emitted by the image generation module to the front windshield, a processor, a memory and a computer program which is stored in the memory and configured to be executed by the processor, wherein the processor realizes a control method for displaying pictures when executing the computer program;
imaging light rays emitted by the head-up display system are refracted to the eyeball position of a driver through the front windshield;
wherein the mirror group comprises: the imaging light rays emitted by the image generation module form parallel light rays after being reflected by the second concave reflector and then enter the first concave reflector; the processor is respectively connected with the gesture acquisition device and the memory; the system installs the front windshield by the steps comprising:
calculating the horizontal curvature gradual progress according to the horizontal curvature radius of the front windshield;
calculating the vertical curvature gradual progress according to the vertical curvature radius of the front windshield;
when the curvature gradient in the horizontal direction is smaller than a preset curvature gradient threshold in the horizontal direction and the curvature gradient in the vertical direction is smaller than a preset curvature gradient threshold in the vertical direction, installing the front windshield;
the horizontal curvature progression is calculated by the following formula:
a is expressed as the degree of curvature progression in the horizontal direction, R 1MAX Expressed as the maximum value of the radius of curvature in the horizontal direction, R 1MIN Expressed as the minimum value of the radius of curvature in the horizontal direction, R 1avg Expressed as the mean value of the radius of curvature in the horizontal direction;
the vertical curvature progression is calculated by the following formula:
b is expressed as the vertical curvature progression, R 2MAX Expressed as the maximum value of the radius of curvature in the vertical direction, R 2MIN Expressed as the minimum value of the radius of curvature in the vertical direction, R 2avg Expressed as the mean value of the vertical direction radius of curvature;
the control method of the display screen comprises the following steps:
acquiring the current gesture operation of a user according to a gesture acquisition device;
determining a corresponding current gesture operation type according to the current gesture operation;
searching a head-up display operation instruction corresponding to the current gesture operation type from a preset corresponding relation between the gesture operation type and the head-up display operation instruction; the corresponding relation between the gesture operation type and the head-up display operation instruction is preset in the head-up display system, and the corresponding relation between the gesture operation type and the head-up display operation instruction comprises at least one gesture operation type and a head-up display operation instruction corresponding to each gesture operation type;
and converting the display picture of the head-up display system according to the head-up display operation instruction.
2. The head-up display control system of a vehicle according to claim 1, wherein the determining a corresponding current gesture operation type according to the current gesture operation specifically includes:
recognizing a gesture type corresponding to the current gesture operation according to a preset static gesture recognition algorithm;
identifying an operation type corresponding to the current gesture operation according to a preset dynamic gesture identification algorithm;
and determining a corresponding current gesture operation type according to the gesture type and the operation type.
3. The heads-up display control system of a vehicle according to claim 2,
the gesture types include: a palm, a single finger, and at least two fingers;
the operation types include: up movement, down movement, left movement, right movement, open operation, close operation, and movement in a diagonal direction.
4. The heads-up display control system of a vehicle of claim 3, wherein the gesture operation type includes: palm up movement, palm down movement, palm left movement, palm right movement, palm diagonal movement, palm open, palm closed, single finger up movement, single finger down movement, single finger left movement, single finger right movement, at least two fingers open, at least two fingers closed, and at least two fingers moving in any direction.
5. The heads-up display control system of claim 4, wherein the preset corresponding relationship between the gesture operation type and the heads-up display operation command comprises at least one of the following:
the corresponding head-up display operation instruction is a starting navigation instruction when the palm moves upwards;
the corresponding head-up display operation instruction of the downward movement of the palm is a navigation closing instruction;
the corresponding head-up display operation instruction for moving the palm to the left is an instruction for starting a driving auxiliary system;
the head-up display operation instruction corresponding to the palm right movement is an instruction for closing the driving assistance system;
the head-up display operation instruction corresponding to the palm opening is an instruction for opening a head-up display picture;
the head-up display operation instruction corresponding to the palm closing is a head-up display image closing instruction;
the corresponding head-up display operation instruction is changed into a snow-on mode or a snow-off mode when the palm moves along the diagonal direction;
the corresponding head-up display operation instruction of the upward movement of the single finger is a display image height increasing instruction;
the single finger moves downwards to correspond to the head-up display operation instruction which is an instruction for reducing the height of the display picture;
the corresponding head-up display operation instruction of the single finger moving to the left is a display image brightness increasing instruction;
the head-up display operation instruction corresponding to the movement of the single finger to the right is a display image brightness reduction instruction;
the head-up display operation instruction corresponding to the opening of the at least two fingers is a display image amplification instruction;
the head-up display operation instruction corresponding to the at least two finger closures is a display picture reduction instruction;
and the at least two fingers move along any direction, and the corresponding head-up display operation instruction is a display image moving instruction along any direction.
6. The heads-up display control system of a vehicle of claim 1, the method further comprising:
if the corresponding head-up display operation instruction cannot be found from the corresponding relation between the preset gesture operation type and the head-up display operation instruction, sending all the head-up display operation instructions to a user for the user to select the operation instruction;
and receiving a head-up display operation instruction selected by a user, and converting a display picture of the head-up display system according to the head-up display operation instruction selected by the user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011529820.1A CN112558305B (en) | 2020-12-22 | 2020-12-22 | Control method, device and medium of display picture and head-up display control system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011529820.1A CN112558305B (en) | 2020-12-22 | 2020-12-22 | Control method, device and medium of display picture and head-up display control system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112558305A CN112558305A (en) | 2021-03-26 |
| CN112558305B true CN112558305B (en) | 2022-10-18 |
Family
ID=75030783
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011529820.1A Active CN112558305B (en) | 2020-12-22 | 2020-12-22 | Control method, device and medium of display picture and head-up display control system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112558305B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115402262A (en) * | 2021-05-27 | 2022-11-29 | 上海博泰悦臻网络技术服务有限公司 | Defogging method, electronic device and storage medium |
| CN113253849A (en) * | 2021-07-01 | 2021-08-13 | 湖北亿咖通科技有限公司 | Display control method, device and equipment of control bar |
| CN117218716B (en) * | 2023-08-10 | 2024-04-09 | 中国矿业大学 | DVS-based automobile cabin gesture recognition system and method |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1101096A (en) * | 1993-09-28 | 1995-04-05 | 基德科资源有限公司 | Drilling short radius curvature well bores |
| CN101017476A (en) * | 2006-07-10 | 2007-08-15 | 山东理工大学 | Characteristic analytical method for product point clouds surface based on dynamic access model |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6102117B2 (en) * | 2012-08-08 | 2017-03-29 | ソニー株式会社 | MOBILE BODY, SYSTEM, PROGRAM, AND INFORMATION PROCESSING DEVICE |
| CN103176605A (en) * | 2013-03-27 | 2013-06-26 | 刘仁俊 | Control device of gesture recognition and control method of gesture recognition |
| KR101640053B1 (en) * | 2015-01-02 | 2016-07-18 | 현대자동차주식회사 | Display device for vehicle and vehicle comprising the same |
| CN105677206A (en) * | 2016-01-08 | 2016-06-15 | 北京乐驾科技有限公司 | System and method for controlling head-up display based on vision |
| CN106681004A (en) * | 2017-02-14 | 2017-05-17 | 深圳前海智云谷科技有限公司 | Embedded head-up display device |
| JP6876580B2 (en) * | 2017-09-15 | 2021-05-26 | マクセル株式会社 | Information display device |
| CN110248040B (en) * | 2018-03-08 | 2021-08-20 | 阿里巴巴集团控股有限公司 | Image data transmission method and device and electronic equipment |
-
2020
- 2020-12-22 CN CN202011529820.1A patent/CN112558305B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1101096A (en) * | 1993-09-28 | 1995-04-05 | 基德科资源有限公司 | Drilling short radius curvature well bores |
| CN101017476A (en) * | 2006-07-10 | 2007-08-15 | 山东理工大学 | Characteristic analytical method for product point clouds surface based on dynamic access model |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112558305A (en) | 2021-03-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112558305B (en) | Control method, device and medium of display picture and head-up display control system | |
| US10514758B2 (en) | Visibility improvement method based on eye tracking, machine-readable storage medium and electronic device | |
| JP7061685B2 (en) | Motion recognition, driving motion analysis methods and devices, and electronic devices | |
| EP1589478B1 (en) | Apparatus for magnifying an image | |
| US7853051B2 (en) | Recognizing apparatus and method, recording media, and program | |
| US11524578B2 (en) | Control method and control device for vehicle display device | |
| US9275274B2 (en) | System and method for identifying handwriting gestures in an in-vehicle information system | |
| CN105677206A (en) | System and method for controlling head-up display based on vision | |
| KR20140072734A (en) | System and method for providing a user interface using hand shape trace recognition in a vehicle | |
| US10354148B2 (en) | Object detection apparatus, vehicle provided with object detection apparatus, and non-transitory recording medium | |
| CN113065383B (en) | Vehicle-mounted interaction method, device and system based on three-dimensional gesture recognition | |
| CN112383826A (en) | Control method and device of vehicle-mounted entertainment terminal, storage medium, terminal and automobile | |
| EP4029716A1 (en) | Vehicle interactive system and method, storage medium, and vehicle | |
| CN114783067A (en) | Gesture-based recognition method, device and system | |
| CN114612667A (en) | Image segmentation method, vehicle control method and device | |
| CN113002461A (en) | Virtual image position adjusting method, device and storage medium of AR-HUD system | |
| EP4154094A1 (en) | Machine learning based forecasting of human gaze | |
| US20200234591A1 (en) | Vehicle, vehicle control method, and vehicle control program | |
| KR20220047022A (en) | Vehicle and controlling method thereof | |
| CN112947761B (en) | Virtual image position adjustment method, device and storage medium of AR-HUD system | |
| EP4328765A1 (en) | Method and apparatus for recommending vehicle driving strategy | |
| WO2022130780A1 (en) | Image processing device | |
| CN115953153A (en) | Vehicle maintenance method, device and storage medium | |
| Bergelt | Chair of Computer Engineering, Dept. of Computer Science in cooperation with | |
| CN116872674A (en) | Air conditioner air outlet control method and device, vehicle control unit and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |