CN106557170A - The method and device zoomed in and out by image on virtual reality device - Google Patents
The method and device zoomed in and out by image on virtual reality device Download PDFInfo
- Publication number
- CN106557170A CN106557170A CN201611049218.1A CN201611049218A CN106557170A CN 106557170 A CN106557170 A CN 106557170A CN 201611049218 A CN201611049218 A CN 201611049218A CN 106557170 A CN106557170 A CN 106557170A
- Authority
- CN
- China
- Prior art keywords
- image
- head
- user
- equipment
- axis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 238000001514 detection method Methods 0.000 claims abstract description 80
- 210000003128 head Anatomy 0.000 claims description 388
- 238000006073 displacement reaction Methods 0.000 claims description 208
- 230000001133 acceleration Effects 0.000 claims description 67
- 230000006698 induction Effects 0.000 claims description 40
- 238000012360 testing method Methods 0.000 claims description 24
- 230000000007 visual effect Effects 0.000 claims description 11
- 238000012790 confirmation Methods 0.000 claims description 10
- 230000003321 amplification Effects 0.000 claims description 4
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 4
- 210000001508 eye Anatomy 0.000 description 3
- 210000005252 bulbus oculi Anatomy 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 238000011897 real-time detection Methods 0.000 description 2
- 239000003795 chemical substances by application Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000686 essence Substances 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/003—Navigation within 3D models or images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Optics & Photonics (AREA)
- Software Systems (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
The application proposes the method and device zoomed in and out to the image on virtual reality device.Method includes：The head pose of detection VR equipment users；When the head pose of VR equipment users is that predefined image amplifies attitude, operation is amplified to the image on VR equipment；When the head pose of VR equipment users is predefined image down attitude, reduction operation is carried out to the image on VR equipment.The application is realized carries out intelligent scaling to the image on VR equipment.
Description
Technical field
The present invention relates to VR (Virtual Reality, virtual reality) technical field, more particularly to the figure on VR equipment
As the method and device for zooming in and out.
Background technology
At present, button is typically passed through to the scaling of the image on two-dimensional display device or touch is controlled.With VR
The development of technology, needs the solution zoomed in and out to the image on VR equipment badly.
The content of the invention
The present invention provides the method and device zoomed in and out to the image on VR equipment, to realize to the image on VR equipment
Zoom in and out.
The technical scheme is that what is be achieved in that：
A kind of method that image on VR equipment is zoomed in and out, the method include：
The head pose of detection VR equipment users；
When the head pose of VR equipment users is that predefined image amplifies attitude, the image on VR equipment is put
It is big to operate；
When the head pose of VR equipment users is predefined image down attitude, the image on VR equipment is contracted
Little operation.
The predefined image amplifies attitude：Head is left-leaning, and the predefined image down attitude is：Head is right
Incline；
Or, the predefined image amplifies attitude and is：Head Right deviation, the predefined image down attitude is：
Head is left-leaning；
Or, the predefined image amplifies attitude and is：Head leans forward, and the predefined image down attitude is：
Head is swung back；
Or, the predefined image amplifies attitude and is：Head is swung back, and the predefined image down attitude is：
Head leans forward.
The image on VR equipment is further included before being amplified operation：Detection user's watching attentively on image
Focus；The image on VR equipment is amplified operation to be included：By user on image watch focus attentively centered on, to VR
Image on equipment is amplified operation；
The image on VR equipment carries out further including before reduction operation：Detection user's watching attentively on image
Focus；The image on VR equipment carries out reduction operation to be included：By user on image watch focus attentively centered on, to VR
Image on equipment carries out reduction operation.
The image on VR equipment is further included before being amplified operation：Detection user's watching attentively on image
Focus, watches focus attentively according to this, determines interesting part of the user on image；The image on VR equipment is amplified
Operation includes：Interesting part to user on image is amplified operation；
The image on VR equipment carries out further including before reduction operation：Detection user's watching attentively on image
Focus, watches focus attentively according to this, determines interesting part of the user on image；The image on VR equipment reduces
Operation includes：Interesting part to user on image carries out reduction operation.
The image on VR equipment is further included before being amplified operation：The resolution for judging present image is
It is no less than default first resolution, or/and, active user's watches focus attentively on the image, and if so, then image is amplified
Operation；Otherwise, operation is not amplified to image；
The image on VR equipment carries out further including before reduction operation：The resolution for judging present image is
It is no higher than default second resolution, or/and, active user's watches focus attentively on the image, and if so, then image is reduced
Operation；Otherwise, reduction operation is not carried out to image.
The head pose of the detection VR equipment users includes：
The direction that predefined image is amplified attitude sensing is positive as X-axis, will and the sensing user crown vertical with X-axis
Direction it is positive as Y-axis, will be positive as Z axis with X-axis and Y-axis vertical direction, set up the first coordinate system；
Component of the user's head displacement vector in X, Y, Z axis direction is obtained from the acceleration induction device of VR equipment；
If it was found that user's head displacement vector the component of X-axis positive direction absolute value more than default first displacement threshold value,
And user's head displacement vector then confirms to use in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
The head pose at family is that predefined image amplifies attitude；
If it was found that user's head displacement vector the component of X-axis negative direction absolute value more than default first displacement threshold value,
And user's head displacement vector then confirms to use in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
The head pose at family is predefined image down attitude.
Methods described is further included：Angular velocity of the user's head in X, Y, Z axis direction is obtained from the gyroscope of VR equipment；
The absolute value that user's head displacement vector is found in the component of X-axis positive direction is more than default first displacement threshold
Value, and user's head displacement vector after the both less than default second displacement threshold value of the absolute value of Y-axis and the component of Z-direction,
Confirm that the head pose of user is further included before being predefined image amplification attitude：
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed；
The absolute value that user's head displacement vector is found in the component of X-axis negative direction is more than default first displacement threshold
Value, and user's head displacement vector after the both less than default second displacement threshold value of the absolute value of Y-axis and the component of Z-direction,
Confirm that the head pose of user is further included before being predefined image down attitude：
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed.
When the predefined image amplifies attitude it is：Head leans forward, and the predefined image down attitude is：Head
During layback,
The head pose of the detection VR equipment users includes：
The initial direction of visual lines for obtaining VR equipment users is positive as X-axis, by side that is vertical with X-axis and pointing to the user crown
To positive as Y-axis, will be vertical with X-axis and Y-axis and the direction on the left of user's head be pointed to as Z axis forward direction, set up the first seat
Mark system；
Component of the user's head displacement vector in X, Y, Z axis direction is obtained from the acceleration induction device of VR equipment；
If it was found that user's head displacement vector the component of X-axis positive direction absolute value more than default first displacement threshold value,
And user's head displacement vector then confirms to use in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
The head pose at family is to lean forward；
If it was found that user's head displacement vector the component of X-axis negative direction absolute value more than default first displacement threshold value,
And user's head displacement vector then confirms to use in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
The head pose at family is layback.
The initial direction of visual lines of the user is：User is pointed to from the center of user's eyes and watches focus attentively on VR images
Direction.
Methods described is further included：Angular velocity of the user's head in X, Y, Z axis direction is obtained from the gyroscope of VR equipment；
The absolute value that user's head displacement vector is found in the component of X-axis positive direction is more than default first displacement threshold
Value, and user's head displacement vector after the both less than default second displacement threshold value of the absolute value of Y-axis and the component of Z-direction,
Confirm the head pose of user to further include before leaning forward：
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed；
The absolute value that user's head displacement vector is found in the component of X-axis negative direction is more than default first displacement threshold
Value, and user's head displacement vector after the both less than default second displacement threshold value of the absolute value of Y-axis and the component of Z-direction,
Confirm the head pose of user to further include before layback：
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed.
When the predefined image amplifies attitude it is：Head leans forward, and the predefined image down attitude is：Head
During layback；Or, when the predefined image amplifies attitude it is：Head leans forward, and the predefined image down attitude is：
When head is swung back,
And, when the VR equipment is located on the vehicles,
It is described when the head pose of VR equipment users is after predefined image amplifies attitude, to the image on VR equipment
Further include before being amplified operation：
The acceleration induction device installed on the vehicles is calculated when the acceleration of pre-test is in vehicle travels side
The acceleration induction device on component and VR equipment upwards is when the acceleration of pre-test is on vehicle travels direction
The difference of component, if the absolute value of the difference is more than preset value, performs the image on VR equipment and is amplified operation
Action, otherwise, do not perform the action that the image on VR equipment is amplified operation；
It is described after the head pose of VR equipment users is predefined image down attitude, to the image on VR equipment
Carry out further including before reduction operation：The acceleration induction device installed on the vehicles is calculated when the acceleration of pre-test is sweared
Component of the amount on vehicle travels direction works as the acceleration of pre-test in friendship with the acceleration induction device on VR equipment
The difference of the component in logical instrument travel direction, if the absolute value of the difference is more than preset value, performs described on VR equipment
Image carry out the action of reduction operation, otherwise, not performing the image on VR equipment carries out the action of reduction operation.
The image on VR equipment is further included after being amplified operation：
Detection velocity component of the user's head in X-axis positive direction, if the velocity component is more than or equal to 0, continues right
Image on VR equipment is amplified operation；If the velocity component is less than 0, stop being amplified behaviour to the image on VR equipment
Make；
The image on VR equipment is further included after carrying out reduction operation：
Detection velocity component of the user's head in X-axis negative direction, if the velocity component is more than or equal to 0, continues right
Image on VR equipment carries out reduction operation；If the velocity component is less than 0, stop carrying out diminution behaviour to the image on VR equipment
Make.
The device that a kind of image on VR equipment is zoomed in and out, the device include：
Head pose detection module, for detecting the head pose of VR equipment users；
The image control mold, the head pose for VR equipment users are detected in head pose detection module are predefined
Image amplify attitude when, operation is amplified to the image on VR equipment；VR equipment is detected in head pose detection module
When the head pose of user is predefined image down attitude, reduction operation is carried out to the image on VR equipment.
The predefined image that the head pose detection module is detected amplifies attitude：Head is left-leaning, predefined
Image down attitude is：Head Right deviation；
Or, the predefined image that the head pose detection module is detected amplifies attitude and is：Head Right deviation, it is described
Predefined image down attitude is：Head is left-leaning；
Or, the predefined image that the head pose detection module is detected amplifies attitude and is：Head leans forward, described
Predefined image down attitude is：Head is swung back；
Or, the predefined image that the head pose detection module is detected amplifies attitude and is：Head is swung back, described
Predefined image down attitude is：Head leans forward.
Described device is further included：Sight line capture module, for detecting that user watches focus attentively on image；
Described image control module is amplified operation to the image on VR equipment to be included：Detected with sight line capture module
User on image watch focus attentively centered on, operation is amplified to the image on VR equipment；
Described image control module carries out reduction operation to the image on VR equipment to be included：Detected with sight line capture module
User on image watch focus attentively centered on, reduction operation is carried out to the image on VR equipment.
Described image control module is amplified operation specifically for user is on image for detection to the image on VR equipment
Watch focus attentively, focus is watched attentively according to this, interesting part of the user on image is determined, it is interested on image in user
Part is amplified operation；
Described image control module carries out reduction operation specifically for user is on image for detection to the image on VR equipment
Watch focus attentively, focus is watched attentively according to this, interesting part of the user on image is determined, it is interested on image in user
Part carries out reduction operation.
Described image control module is further used for before operation is amplified to the image on VR equipment, judges current figure
Whether the resolution of picture is less than default first resolution, or/and, the focus of watching attentively of active user is located on image, if so, then right
Image is amplified operation；Otherwise, operation is not amplified to image；
Described image control module is further used for before carrying out reduction operation to the image on VR equipment, judges current figure
Whether the resolution of picture is higher than default second resolution, or/and, the focus of watching attentively of active user is located on image, if so, then right
Image carries out reduction operation；Otherwise, reduction operation is not carried out to image.
The head pose of the head pose detection module detection VR equipment users includes：
The direction that predefined image is amplified attitude sensing is positive as X-axis, will and the sensing user crown vertical with X-axis
Direction it is positive as Y-axis, will be positive as Z axis with X-axis and Y-axis vertical direction, set up the first coordinate system；
Component of the user's head displacement vector in X, Y, Z axis direction is obtained from the acceleration induction device of VR equipment；
If it was found that user's head displacement vector the component of X-axis positive direction absolute value more than default first displacement threshold value,
And user's head displacement vector then confirms to use in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
The head pose at family is that predefined image amplifies attitude；
If it was found that user's head displacement vector the component of X-axis negative direction absolute value more than default first displacement threshold value,
And user's head displacement vector then confirms to use in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
The head pose at family is predefined image down attitude.
The head pose detection module is further used for, and obtains user's head in X, Y, Z axis from the gyroscope of VR equipment
The angular velocity in direction；
The head pose detection module finds that user's head displacement vector is more than in the absolute value of the component of X-axis positive direction
Default first displacement threshold value, and user's head displacement vector is in the absolute value both less than default second of Y-axis and the component of Z-direction
After displacement threshold value, confirm that the head pose of user is further used for before amplifying attitude for predefined image,
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed；
The head pose detection module finds that user's head displacement vector is more than in the absolute value of the component of X-axis negative direction
Default first displacement threshold value, and user's head displacement vector is in the absolute value both less than default second of Y-axis and the component of Z-direction
After displacement threshold value, the head pose of user is confirmed to be further used for before predefined image down attitude,
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed.
When the predefined image amplifies attitude it is：Head leans forward, and the predefined image down attitude is：Head
During layback,
The head pose detection module specifically for,
The initial direction of visual lines of the VR equipment users that sight line capture module is detected is positive as X-axis, will be vertical with X-axis
And point to that the direction on the user crown is positive as Y-axis, using the direction on the left of and sensing user's head vertical with X-axis and Y-axis as Z
Axle is positive, sets up the first coordinate system；
Component of the user's head displacement vector in X, Y, Z axis direction is obtained from the acceleration induction device of VR equipment；
If it was found that user's head displacement vector the component of X-axis positive direction absolute value more than default first displacement threshold value,
And user's head displacement vector then confirms to use in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
The head pose at family is to lean forward；
If it was found that user's head displacement vector the component of X-axis negative direction absolute value more than default first displacement threshold value,
And user's head displacement vector then confirms to use in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
The head pose at family is layback.
The head pose detection module is further used for, and obtains user's head in X, Y, Z axis from the gyroscope of VR equipment
The angular velocity in direction；
And, absolute value of the user's head displacement vector in the component of X-axis positive direction is found more than default first displacement threshold value,
And user's head displacement vector is after the both less than default second displacement threshold value of the absolute value of Y-axis and the component of Z-direction, confirmation
The head pose of user is further used for before to lean forward,
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed；
The absolute value that user's head displacement vector is found in the component of X-axis negative direction is more than default first displacement threshold
Value, and user's head displacement vector after the both less than default second displacement threshold value of the absolute value of Y-axis and the component of Z-direction,
The head pose of user is confirmed to be further used for before layback,
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed.
When the predefined image amplifies attitude it is：Head leans forward, and the predefined image down attitude is：Head
During layback；Or, when the predefined image amplifies attitude it is：Head leans forward, and the predefined image down attitude is：
When head is swung back,
And, when the VR equipment is located on the vehicles,
When the head pose of VR equipment users is that predefined image amplifies attitude, described image control module is set to VR
Standby upper image be amplified operation specifically for,
The acceleration induction device installed on the vehicles is calculated when the acceleration of pre-test is in vehicle travels side
The acceleration induction device on component and VR equipment upwards is when the acceleration of pre-test is on vehicle travels direction
The difference of component, if the absolute value of the difference is more than preset value, is amplified operation to the image on VR equipment, otherwise, no
Operation is amplified to the image on VR equipment；
When the head pose of VR equipment users is predefined image down attitude, described image control module is set to VR
Standby upper image carry out reduction operation specifically for,
The acceleration induction device installed on the vehicles is calculated when the acceleration of pre-test is in vehicle travels side
The acceleration induction device on component and VR equipment upwards is when the acceleration of pre-test is on vehicle travels direction
The difference of component, if the absolute value of the difference is more than preset value, carries out reduction operation to the image on VR equipment, otherwise, no
Reduction operation is carried out to the image on VR equipment.
Described image control module is further used for after operation is amplified to the image on VR equipment,
Detection velocity component of the user's head in X-axis positive direction, if the velocity component is more than or equal to 0, continues right
Image on VR equipment is amplified operation；If the velocity component is less than 0, stop being amplified behaviour to the image on VR equipment
Make；
Described image control module is further used for after carrying out reduction operation to the image on VR equipment,
Detection velocity component of the user's head in X-axis negative direction, if the velocity component is more than or equal to 0, continues right
Image on VR equipment carries out reduction operation, until it reaches till the diminution end condition of image；If the velocity component is less than 0,
Then stop carrying out reduction operation to the image on VR equipment.
Described device is located on VR equipment.
Head pose of the application by detection VR equipment users, when attitude is amplified for predefined image, sets to VR
Standby upper image is amplified, when for predefined image down attitude when, the image on VR equipment is reduced, is realized
Intelligent scaling is carried out to the image on VR equipment；
Further, watch focus attentively by detecting user on image, on VR equipment centered on watching focus attentively
Image is zoomed in and out so that the image after scaling more meets user's request；
Further, by only zooming in and out to user's interesting part, reduce the power consumption of VR device handlers；
Further, when VR equipment is located on the vehicles, by detecting the vehicles with VR equipment in the vehicles
The difference of the component of acceleration in travel direction, determines whether the vehicles occur plus/minus speed motion, so that it is determined that user's head
Whether leaned forward/swing back due to inertia, so as to avoid the zoom operations that mistake is carried out to image；
Further, by detecting velocity component of the user's head in X-axis positive and negative direction, whether determine user's head
Holding is leaned forward or is swung back, and determines whether to continue to zoom in or out image so that image scale operation is more accurate.
Description of the drawings
The method flow diagram zoomed in and out by the image on VR equipment that Fig. 1 is provided for one embodiment of the application；
The exemplary plot of the VR images that Fig. 2-1 is provided for the application；
The detection exemplary plot of watching focus of the user on VR images shown in Fig. 2-1 that Fig. 2-2 is provided for the application；
Focus of watching attentively on the VR images according to user is in Fig. 2-1 that Fig. 2-3 is provided for the application determines that user's sense is emerging
The exemplary plot of interesting part；
The exemplary plot that Fig. 2-4 is amplified for the user's interesting part determined to Fig. 2-3 that the application is provided；
The method flow diagram zoomed in and out by the image on VR equipment that Fig. 3 is provided for another embodiment of the application；
Fig. 4 is the schematic diagram that the embodiment of the present application determines X, Y, Z axis according to the original state of VR equipment users；
The composition schematic diagram of the device zoomed in and out by the image on VR equipment that Fig. 5 is provided for the embodiment of the present application.
Specific embodiment
Below in conjunction with the accompanying drawings and specific embodiment the present invention is further described in more detail.
The method flow diagram zoomed in and out to the image on VR equipment that Fig. 1 is provided for one embodiment of the application, which is concrete
Step is as follows：
Step 100：Predefined image amplifies attitude and image down attitude.
For example：Predefined image amplifies attitude：Head is left-leaning, and image down attitude is：Head Right deviation；
Or, predefined image amplifies attitude and is：Head Right deviation, image down attitude is：Head is left-leaning；
Or, predefined image amplifies attitude and is：Head leans forward, and image down attitude is：Head is swung back；
Or, predefined image amplifies attitude and is：Head is swung back, and image down attitude is：Head leans forward.
Step 101：The head pose of detection VR equipment users.
Wherein, detect that the head pose of VR equipment users may include：
The direction that predefined image is amplified attitude sensing is positive as X-axis, will and the sensing user crown vertical with X-axis
Direction it is positive as Y-axis, will be positive as Z axis with X-axis and Y-axis vertical direction, set up the first coordinate system；
Component of the user's head displacement vector in X, Y, Z axis direction is obtained from the acceleration induction device of VR equipment；
If it was found that user's head displacement vector the component of X-axis positive direction absolute value more than default first displacement threshold value,
And user's head displacement vector then confirms to use in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
The head pose at family is that predefined image amplifies attitude；If it was found that component of the user's head displacement vector in X-axis negative direction
Absolute value is more than default first displacement threshold value, and user's head displacement vector is all little in the absolute value of Y-axis and the component of Z-direction
In default second displacement threshold value, then confirm that the head pose of user is predefined image down attitude；
Or, find absolute value of the user's head displacement vector in the component of X-axis positive direction more than default first displacement threshold
Value, and user's head displacement vector is in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction, and use
Angular velocity of the account portion in X, Y, Z axis direction is both less than preset angle threshold speed, then confirm that the head pose of user is predefined
Image amplify attitude；It was found that user's head displacement vector is more than default first displacement in the absolute value of the component of X-axis negative direction
Threshold value, and user's head displacement vector is in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction, and
Angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed, then confirm that the head pose of user is predetermined
The image down attitude of justice.
For example：When predefined image amplifies attitude it is：Head leans forward, and predefined image down attitude is：When head is swung back,
The head pose of detection VR equipment users may include：
The initial direction of visual lines for obtaining VR equipment users is positive as X-axis, by side that is vertical with X-axis and pointing to the user crown
To positive as Y-axis, will be vertical with X-axis and Y-axis and the direction on the left of user's head be pointed to as Z axis forward direction, set up the one or three
Dimension rectangular coordinate system；Wherein, the initial direction of visual lines of user can be to point to user on VR images from the center of user two
Watch the direction of focus attentively；
User's head displacement vector X, Y, Z in the first three-dimensional cartesian coordinate system are obtained from the acceleration induction device of VR equipment
Axial component；
If it was found that user's head displacement vector the component of X-axis positive direction absolute value more than default first displacement threshold value,
And user's head displacement vector then confirms to use in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
The head pose at family is to lean forward；If it was found that user's head displacement vector the component of X-axis negative direction absolute value more than default the
One displacement threshold value, and user's head displacement vector is in the both less than default second displacement threshold of absolute value of Y-axis and the component of Z-direction
Value, then confirm that the head pose of user is layback；
Or, find absolute value of the user's head displacement vector in the component of X-axis positive direction more than default first displacement threshold
Value, and user's head displacement vector is in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction, and use
Angular velocity of the account portion in X, Y, Z axis direction is both less than preset angle threshold speed, then confirm the head pose of user to lean forward；Send out
Existing user's head displacement vector is more than default first displacement threshold value, and user's head position in the absolute value of the component of X-axis negative direction
Absolute value both less than default second displacement threshold value of the vector in Y-axis and the component of Z-direction is moved, and user's head is in X, Y, Z axis
The angular velocity in direction is both less than preset angle threshold speed, then confirm that the head pose of user is layback.
Step 102：When the head pose of VR equipment users is that predefined image amplifies attitude, to the figure on VR equipment
As being amplified operation；When the head pose of VR equipment users is predefined image down attitude, to the figure on VR equipment
As carrying out reduction operation.
Wherein, can further include before being amplified operation to the image on VR equipment：User is on image for detection
Watch focus attentively；
Operation is amplified to the image on VR equipment includes：By user on image watch focus attentively centered on, to VR
Image on equipment is amplified operation；
Further include before reduction operation is carried out to the image on VR equipment：Detection user watches Jiao attentively on image
Point；
Reduction operation is carried out to the image on VR equipment includes：By user on image watch focus attentively centered on, to VR
Image on equipment carries out reduction operation.
Can also further include before operation is amplified to the image on VR equipment：The resolution for judging present image is
It is no less than default first resolution, or/and, active user's watches focus attentively on the image, and if so, then image is amplified
Operation；Otherwise, operation is not amplified to image；
Can also further include before reduction operation is carried out to the image on VR equipment：The resolution for judging present image is
It is no higher than default second resolution, or/and, active user's watches focus attentively on the image, and if so, then image is reduced
Operation；Otherwise, reduction operation is not carried out to image.
Further, it is contemplated that when user in the mobile vehicles such as：When automobile etc. above uses VR equipment, the vehicles
Startup, braking, turning etc. can produce acceleration, can now cause user to allow head to lean forward or swing back due to inertia.In order to
Make the decision zoomed in or out to VR images for making mistake in the case of avoiding this kind, provide following solution：
When predefined image amplifies attitude it is：Head leans forward, and image down attitude is：When head is swung back；Or, when pre-
The image of definition amplifies attitude：Head leans forward, and image down attitude is：When head is swung back, first, install in the vehicles
One acceleration induction device, and VR equipment built-in acceleration induction apparatuss, and arrange the second three-dimensional cartesian coordinate system be：X-axis is positive to be begun
Vehicle travels direction is pointed to eventually, and X, Y, Z axis is mutually perpendicular to.
In step 102, put after the head pose for confirming VR equipment users is to lean forward, to the image on VR equipment
Further include before big operation：
The acceleration induction device on the vehicles is calculated when the acceleration sense in the acceleration and VR equipment of pre-test
Device is answered to work as the difference of component of the acceleration of pre-test in the X-axis positive direction of the second three-dimensional cartesian coordinate system, if the difference
The absolute value of value is more than preset value, then perform the action that the image on VR equipment is amplified operation, otherwise, not to VR
Image on equipment is amplified operation；
And, in step 102, reduce after the head layback for confirming VR equipment users, to the image on VR equipment
Further include before operation：Acceleration induction device on the calculating vehicles is when the vector and VR equipment of the acceleration of pre-test
On acceleration induction device when pre-test acceleration component of the vector in the X-axis positive direction of the second three-dimensional cartesian coordinate system
Difference, if the absolute value of the difference is more than preset value, performing the image on VR equipment carries out the dynamic of reduction operation
Make, otherwise, reduction operation is not carried out to the image on VR equipment.
In actual applications, the executive agent of above-mentioned steps 101～102 can all be VR equipment, and VR equipment can be with traffic work
The built-in acceleration induction device real-time Communication for Power of tool simultaneously follows identical protocol specification, such as ITO agreements.
In actual applications, in order to reduce the power consumption of VR device handlers, in step 102, when confirmation VR equipment users'
Head pose is the bag that takes a step forward that operation is amplified after predefined image amplifies attitude, to the image on VR equipment
Include：
Detection VR equipment users watch focus attentively on VR images, go out user's sense according to the location recognition for watching focus attentively emerging
The part of interest, and operation is amplified to user part interested on VR images only subsequently.
And, in step 102, when confirm VR equipment users head pose be predefined image down attitude after, it is right
Image on VR equipment carries out further including before reduction operation：
Detection VR equipment users watch focus attentively on VR images, go out user's sense according to the location recognition for watching focus attentively emerging
The part of interest, and reduction operation is carried out to user part interested on VR images only subsequently.
For example：At identifying user part interested, can be identified using edge detecting technology and watch focus place thing attentively
The border of body, it is then determined that the object is user's object interested, zooms in or out to the object.
As shown in Fig. 2-1, two pieces of coins on VR images, are included；Detect that user's watches focus attentively as shown in Fig. 2-2；Then adopt
The border of the object for watching focus attentively comprising user, the as border of the right coin, such as Fig. 2-3 are detected with edge detecting technology
It is shown；Then only the right coin is amplified, as in Figure 2-4.
The method flow diagram zoomed in and out by the image on VR equipment that Fig. 3 is provided for another embodiment of the application, this reality
Apply in example, predefined image amplifies attitude and leans forward for head, and image down attitude is swung back for head, and which comprises the following steps that：
Step 301：The initial direction of visual lines that VR equipment obtains VR equipment users is positive as X-axis, will be vertical with X-axis and refers to
Direction to the user crown is positive as Y-axis, using the direction on the left of and sensing user's head vertical with X-axis and Y-axis as Z axis just
To setting up the first three-dimensional cartesian coordinate system.
VR equipment can pass through the initial direction of visual lines of eyeball tracking technical limit spacing VR equipment users, and the direction is user face
Towards direction.Specifically, image that can first using eyeball tracking technical limit spacing user eyes on VR equipment watches focus attentively,
Then the direction for watching focus using the central point of user's eyes to this attentively is positive as X-axis.
Fig. 4 is the schematic diagram that X, Y, Z axis is determined according to the original state of VR equipment users.
Step 302：VR equipment obtains user's head displacement vector in X, Y, Z axis direction from the acceleration induction device of itself
Component.
In implementing, VR equipment is to be available for user to be worn on head in modes such as the helmet or glasses.This enforcement
In example, VR equipment built-in acceleration induction apparatuss and gyroscope.
Step 303：VR equipment judges whether to meet：Absolute value of the user's head displacement vector in the component of X-axis positive direction
More than default first displacement threshold value, and in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction, if
It is, execution step 304；Otherwise, execution step 307.
Step 304：VR equipment obtains angular velocity of the user's head in X, Y, Z axis direction from the gyroscope of itself.
Step 305：VR equipment judges whether the angular velocity in X, Y, Z axis direction is both less than preset angle threshold speed, if so, holds
Row step 306；Otherwise, execution step 307.
Step 306：VR equipment determines that user's head leans forward, and is amplified operation, return to step to the image that itself shows
302。
Before VR equipment is amplified operation to image, can determine whether：It is current whether to meet image amplification condition, if
Meet, then operation is amplified to image；Otherwise, operation, direct return to step 302 are not amplified to image.
Wherein, image amplifies condition for example：The resolution of image watches Jiao attentively less than default first resolution threshold value, user
Point is positioned at image is one of first-class or combination in any.
In addition, before VR equipment is amplified operation to image, can also further detect that user watches Jiao attentively on image
Point, when operation is amplified to image, by user on image watch focus attentively centered on operation is amplified to image.
In step 306, VR equipment can further detect user's head after operation is amplified to the image that itself shows
Velocity component in the X-axis positive direction of the first three-dimensional cartesian coordinate system, if the velocity component is more than or equal to 0, continues right
The image for itself showing is amplified operation, until it reaches the amplification end condition of image is (for example：The resolution of image is more than pre-
If ultimate resolution) till；If the velocity component is less than 0, stop being amplified operation to the image that itself shows.
Step 307：VR equipment judges whether to meet：Absolute value of the user's head displacement vector in the component of X-axis negative direction
More than default first displacement threshold value, and in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction, if
It is, execution step 308；Otherwise, return to step 302.
Step 308：VR equipment judges whether angular velocity of the user's head in X, Y, Z axis direction obtained from gyroscope is all little
In preset angle threshold speed, if so, execution step 309；Otherwise, return to step 302.
Step 309：VR equipment determines that user's head is swung back, and carries out reduction operation, return to step to the image that itself shows
302。
Before VR equipment carries out reduction operation to image, can determine whether：Currently whether meet image down condition, if
Meet, then reduction operation is carried out to image；Otherwise, reduction operation, direct return to step 302 are not carried out to image.
Wherein, image down condition is for example：The high resolution of image watches Jiao attentively in default second resolution threshold value, user
Point is positioned at image is one of first-class or combination in any.
In addition, before VR equipment carries out reduction operation to image, can also further detect that user watches Jiao attentively on image
Point, when reduction operation is carried out to image, by user on image watch focus attentively centered on reduction operation is carried out to image.
In step 309, VR equipment can further detect user's head after reduction operation is carried out to the image for itself showing
Velocity component in the X-axis negative direction of the first three-dimensional cartesian coordinate system, if the velocity component is more than or equal to 0, continues right
The image for itself showing carries out reduction operation, until it reaches the diminution end condition of image is (for example：The resolution of image is less than pre-
If minimum resolution) till；If the velocity component is less than 0, stop carrying out reduction operation to the image that itself shows.
The composition schematic diagram of the device zoomed in and out to the image on VR equipment that Fig. 5 is provided for the embodiment of the present application, should
Device mainly includes：Head pose detection module 51 and the image control mold 52, wherein：
Head pose detection module 51, for the head pose of real-time detection VR equipment user, and the VR for detecting is set
The head pose of standby user is sent to the image control mold 52.
The image control mold 52, the head pose for VR equipment users are detected in head pose detection module 51 are pre-
When the image of definition amplifies attitude, operation is amplified to the image on VR equipment；VR is detected in head pose detection module
When the head pose of equipment user is predefined image down attitude, reduction operation is carried out to the image on VR equipment.
In one embodiment, the predefined image that head pose detection module 51 is detected amplifies attitude and is：Head is left-leaning,
Predefined image down attitude is：Head Right deviation；
Or, the predefined image that head pose detection module 51 is detected amplifies attitude and is：Head Right deviation, it is described pre-
The image down attitude of definition is：Head is left-leaning；
Or, the predefined image that head pose detection module 51 is detected amplifies attitude and is：Head leans forward, described pre-
The image down attitude of definition is：Head is swung back；
Or, the predefined image that head pose detection module 51 is detected amplifies attitude and is：Head is swung back, described pre-
The image down attitude of definition is：Head leans forward.
The device can be further included：Sight line capture module, watches focus attentively for real-time detection user on image, and
It is sent to the image control mold 52；
And the image control mold 52 is amplified operation to the image on VR equipment and includes：Detected with sight line capture module
User on image watch focus attentively centered on, operation is amplified to the image on VR equipment；
The image control mold 52 carries out reduction operation to the image on VR equipment to be included：Detected with sight line capture module
User on image watch focus attentively centered on, reduction operation is carried out to the image on VR equipment.
The image control mold 52 is amplified operation specifically for user is on image for detection to the image on VR equipment
Watch focus attentively, focus is watched attentively according to this, determine interesting part of the user on image, the portion interested to user on image
Divide and be amplified operation；
The image control mold 52 carries out reduction operation specifically for user is on image for detection to the image on VR equipment
Watch focus attentively, focus is watched attentively according to this, determine interesting part of the user on image, the portion interested to user on image
Dividing carries out reduction operation.
The image control mold 52 can be further used for before operation is amplified to the image on VR equipment, judge current figure
Whether the resolution of picture is less than default first resolution, or/and, the focus of watching attentively of active user is located on image, if so, then right
Image is amplified operation；Otherwise, operation is not amplified to image；
The image control mold 52 can be further used for before carrying out reduction operation to the image on VR equipment, judge current figure
Whether the resolution of picture is higher than default second resolution, or/and, the focus of watching attentively of active user is located on image, if so, then right
Image carries out reduction operation；Otherwise, reduction operation is not carried out to image.
The head pose of the detection VR equipment users of head pose detection module 51 may include：
The direction that predefined image is amplified attitude sensing is positive as X-axis, will and the sensing user crown vertical with X-axis
Direction it is positive as Y-axis, will be positive as Z axis with X-axis and Y-axis vertical direction, set up the first coordinate system；
Component of the user's head displacement vector in X, Y, Z axis direction is obtained from the acceleration induction device of VR equipment；
If it was found that user's head displacement vector the component of X-axis positive direction absolute value more than default first displacement threshold value,
And user's head displacement vector then confirms to use in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
The head pose at family is that predefined image amplifies attitude；
If it was found that user's head displacement vector the component of X-axis negative direction absolute value more than default first displacement threshold value,
And user's head displacement vector then confirms to use in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
The head pose at family is predefined image down attitude.
Head pose detection module 51 can be further used for, and obtain user's head in X, Y, Z axis from the gyroscope of VR equipment
The angular velocity in direction；
Head pose detection module 51 finds absolute value of the user's head displacement vector in the component of X-axis positive direction more than pre-
If the first displacement threshold value, and user's head displacement vector is in the both less than default second of absolute value of Y-axis and the component of Z-direction
After moving threshold value, confirm that the head pose of user is further used for before amplifying attitude for predefined image,
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed；
Head pose detection module 51 finds absolute value of the user's head displacement vector in the component of X-axis negative direction more than pre-
If the first displacement threshold value, and user's head displacement vector is in the both less than default second of absolute value of Y-axis and the component of Z-direction
After moving threshold value, the head pose of user is confirmed to be further used for before predefined image down attitude,
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed.
When predefined image amplifies attitude it is：Head leans forward, and predefined image down attitude is：When head is swung back,
Head pose detection module 51 can be specifically for,
The initial direction of visual lines of VR equipment users is obtained from sight line capture module, it is positive using the direction as X-axis, will be with X
Axle is vertical and points to the direction on the user crown as Y-axis forward direction, by the side on the left of and sensing user's head vertical with X-axis and Y-axis
To positive as Z axis, the first coordinate system is set up；
Component of the user's head displacement vector in X, Y, Z axis direction is obtained from the acceleration induction device of VR equipment；
If it was found that user's head displacement vector the component of X-axis positive direction absolute value more than default first displacement threshold value,
And user's head displacement vector then confirms to use in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
The head pose at family is to lean forward；
If it was found that user's head displacement vector the component of X-axis negative direction absolute value more than default first displacement threshold value,
And user's head displacement vector then confirms to use in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
The head pose at family is layback.
Head pose detection module 51 can be further used for, and obtain user's head in X, Y, Z axis from the gyroscope of VR equipment
The angular velocity in direction；
And, absolute value of the user's head displacement vector in the component of X-axis positive direction is found more than default first displacement threshold value,
And user's head displacement vector is after the both less than default second displacement threshold value of the absolute value of Y-axis and the component of Z-direction, confirmation
The head pose of user is further used for before to lean forward,
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed；
It was found that user's head displacement vector is more than default first displacement threshold value in the absolute value of the component of X-axis negative direction, and
User's head displacement vector is after the both less than default second displacement threshold value of the absolute value of Y-axis and the component of Z-direction, confirmation is used
The head pose at family is further used for before being layback,
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed.
When predefined image amplifies attitude it is：Head leans forward, and predefined image down attitude is：When head is swung back；
Or, when predefined image amplifies attitude it is：Head leans forward, and predefined image down attitude is：When head is swung back, and,
When VR equipment is located on the vehicles,
When the head pose of VR equipment users is that predefined image amplifies attitude, the image control mold 52 is to VR equipment
On image be amplified operation specifically for,
The acceleration induction device installed on the vehicles is calculated when the acceleration of pre-test is in vehicle travels side
The acceleration induction device on component and VR equipment upwards is when the acceleration of pre-test is on vehicle travels direction
The difference of component, if the absolute value of the difference is more than preset value, is amplified operation to the image on VR equipment, otherwise, no
Operation is amplified to the image on VR equipment；
When the head pose of VR equipment users is predefined image down attitude, the image control mold 52 is to VR equipment
On image carry out reduction operation specifically for,
The acceleration induction device installed on the vehicles is calculated when the acceleration of pre-test is in vehicle travels side
The acceleration induction device on component and VR equipment upwards is when the acceleration of pre-test is on vehicle travels direction
The difference of component, if the absolute value of the difference is more than preset value, carries out reduction operation to the image on VR equipment, otherwise, no
Reduction operation is carried out to the image on VR equipment.
The image control mold 52 is further used for after operation is amplified to the image on VR equipment,
Detection velocity component of the user's head in X-axis positive direction, if the velocity component is more than or equal to 0, continues right
Image on VR equipment is amplified operation；If the velocity component is less than 0, stop being amplified behaviour to the image on VR equipment
Make；
The image control mold 52 is further used for after carrying out reduction operation to the image on VR equipment,
Detection velocity component of the user's head in X-axis negative direction, if the velocity component is more than or equal to 0, continues right
Image on VR equipment carries out reduction operation, until it reaches till the diminution end condition of image；If the velocity component is less than 0,
Then stop carrying out reduction operation to the image on VR equipment.
Said apparatus are can be located on VR equipment, wherein, VR equipment is helmet-like, wearable in user's head.
Presently preferred embodiments of the present invention is the foregoing is only, not to limit the present invention, all essences in the present invention
Within god and principle, any modification, equivalent substitution and improvements done etc. are should be included within the scope of protection of the invention.
Claims (24)
1. a kind of method that image on Virtual Reality equipment is zoomed in and out, it is characterised in that the method includes：
The head pose of detection VR equipment users；
When the head pose of VR equipment users is that predefined image amplifies attitude, behaviour is amplified to the image on VR equipment
Make；
When the head pose of VR equipment users is predefined image down attitude, diminution behaviour is carried out to the image on VR equipment
Make.
2. method according to claim 1, it is characterised in that the predefined image amplifies attitude and is：Head is left-leaning,
The predefined image down attitude is：Head Right deviation；
Or, the predefined image amplifies attitude and is：Head Right deviation, the predefined image down attitude is：Head
It is left-leaning；
Or, the predefined image amplifies attitude and is：Head leans forward, and the predefined image down attitude is：Head
Layback；
Or, the predefined image amplifies attitude and is：Head is swung back, and the predefined image down attitude is：Head
Lean forward.
3. method according to claim 1, it is characterised in that before the image on VR equipment is amplified operation
Further include：Detection user watches focus attentively on image；The image on VR equipment is amplified operation to be included：With
User on image watch focus attentively centered on, operation is amplified to the image on VR equipment；
The image on VR equipment carries out further including before reduction operation：Detection user watches Jiao attentively on image
Point；The image on VR equipment carries out reduction operation to be included：By user on image watch focus attentively centered on, VR is set
Standby upper image carries out reduction operation.
4. method according to claim 1, it is characterised in that before the image on VR equipment is amplified operation
Further include：Detection user watches focus attentively on image, watches focus attentively according to this, determines that user is interested on image
Part；The image on VR equipment is amplified operation to be included：Interesting part to user on image is amplified
Operation；
The image on VR equipment carries out further including before reduction operation：Detection user watches Jiao attentively on image
Point, watches focus attentively according to this, determines interesting part of the user on image；The image on VR equipment carries out diminution behaviour
Work includes：Interesting part to user on image carries out reduction operation.
5. according to the arbitrary described method of Claims 1-4, it is characterised in that the image on VR equipment is amplified
Further include before operation：Whether the resolution of present image is judged less than default first resolution, or/and, active user
Watch focus attentively on the image, operation is if so, then amplified to image；Otherwise, operation is not amplified to image；
The image on VR equipment carries out further including before reduction operation：Judge whether the resolution of present image is high
In default second resolution, or/and, active user's watches focus attentively on image, if so, then carries out diminution behaviour to image
Make；Otherwise, reduction operation is not carried out to image.
6. according to the arbitrary described method of Claims 1-4, it is characterised in that the head pose of the detection VR equipment users
Including：
The direction that predefined image is amplified attitude sensing is positive as X-axis, by side that is vertical with X-axis and pointing to the user crown
To positive as Y-axis, the first coordinate system will be set up with X-axis and Y-axis vertical direction as Z axis forward direction；
Component of the user's head displacement vector in X, Y, Z axis direction is obtained from the acceleration induction device of VR equipment；
If it was found that user's head displacement vector is more than default first displacement threshold value in the absolute value of the component of X-axis positive direction, and using
Family head displacement vector then confirms user's in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
Head pose is that predefined image amplifies attitude；
If it was found that user's head displacement vector is more than default first displacement threshold value in the absolute value of the component of X-axis negative direction, and using
Family head displacement vector then confirms user's in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
Head pose is predefined image down attitude.
7. method according to claim 6, it is characterised in that methods described is further included：From the gyroscope of VR equipment
Obtain angular velocity of the user's head in X, Y, Z axis direction；
It is described to find that user's head displacement vector is more than default first displacement threshold value in the absolute value of the component of X-axis positive direction, and
User's head displacement vector is after the both less than default second displacement threshold value of the absolute value of Y-axis and the component of Z-direction, confirmation is used
The head pose at family is to further include before predefined image amplifies attitude：
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed；
It is described to find that user's head displacement vector is more than default first displacement threshold value in the absolute value of the component of X-axis negative direction, and
User's head displacement vector is after the both less than default second displacement threshold value of the absolute value of Y-axis and the component of Z-direction, confirmation is used
The head pose at family is further included before being predefined image down attitude：
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed.
8. method according to claim 2, it is characterised in that be when the predefined image amplifies attitude：Before head
Incline, the predefined image down attitude is：When head is swung back,
The head pose of the detection VR equipment users includes：
The initial direction of visual lines for obtaining VR equipment users is positive as X-axis, and direction that is vertical with X-axis and pointing to the user crown is made
It is positive for Y-axis, will be the direction on the left of and sensing user's head vertical with X-axis and Y-axis positive as Z axis, set up the first coordinate system；
Component of the user's head displacement vector in X, Y, Z axis direction is obtained from the acceleration induction device of VR equipment；
If it was found that user's head displacement vector is more than default first displacement threshold value in the absolute value of the component of X-axis positive direction, and using
Family head displacement vector then confirms user's in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
Head pose is to lean forward；
If it was found that user's head displacement vector is more than default first displacement threshold value in the absolute value of the component of X-axis negative direction, and using
Family head displacement vector then confirms user's in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
Head pose is layback.
9. method according to claim 8, it is characterised in that the initial direction of visual lines of the user is：From user's eyes
Center point to the direction of watching focus of the user on VR images.
10. method according to claim 8, it is characterised in that methods described is further included：From the gyroscope of VR equipment
Obtain angular velocity of the user's head in X, Y, Z axis direction；
It is described to find that user's head displacement vector is more than default first displacement threshold value in the absolute value of the component of X-axis positive direction, and
User's head displacement vector is after the both less than default second displacement threshold value of the absolute value of Y-axis and the component of Z-direction, confirmation is used
The head pose at family is further included before to lean forward：
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed；
It is described to find that user's head displacement vector is more than default first displacement threshold value in the absolute value of the component of X-axis negative direction, and
User's head displacement vector is after the both less than default second displacement threshold value of the absolute value of Y-axis and the component of Z-direction, confirmation is used
The head pose at family is further included before being layback：
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed.
11. methods according to claim 2, it is characterised in that be when the predefined image amplifies attitude：Before head
Incline, the predefined image down attitude is：When head is swung back；Or, when the predefined image amplifies attitude it is：Head
Portion leans forward, and the predefined image down attitude is：When head is swung back,
And, when the VR equipment is located on the vehicles,
It is described to carry out after the head pose of VR equipment users is predefined image amplification attitude, to the image on VR equipment
Further include before amplifieroperation：
The acceleration induction device installed on the vehicles is calculated when the acceleration of pre-test is on vehicle travels direction
Component and VR equipment on acceleration induction device when the component of the acceleration on vehicle travels direction of pre-test
Difference, if the absolute value of the difference is more than preset value, performs the image on VR equipment and be amplified the dynamic of operation
Make, otherwise, do not perform the action that the image on VR equipment is amplified operation；
It is described to carry out after the head pose of VR equipment users is predefined image down attitude, to the image on VR equipment
Further include before reduction operation：The acceleration induction device installed on the vehicles is calculated when the acceleration of pre-test exists
Component on vehicle travels direction works as the acceleration of pre-test in traffic work with the acceleration induction device on VR equipment
The difference of the component in tool travel direction, if the absolute value of the difference is more than preset value, performs the figure on VR equipment
Action as carrying out reduction operation, otherwise, not performing the image on VR equipment carries out the action of reduction operation.
12. methods according to claim 6, it is characterised in that the image on VR equipment is amplified operation
After further include：
Detection velocity component of the user's head in X-axis positive direction, if the velocity component is more than or equal to 0, continues to set VR
Standby upper image is amplified operation；If the velocity component is less than 0, stop being amplified operation to the image on VR equipment；
The image on VR equipment is further included after carrying out reduction operation：
Detection velocity component of the user's head in X-axis negative direction, if the velocity component is more than or equal to 0, continues to set VR
Standby upper image carries out reduction operation；If the velocity component is less than 0, stop carrying out reduction operation to the image on VR equipment.
The device that a kind of 13. images on Virtual Reality equipment are zoomed in and out, it is characterised in that the device includes：
Head pose detection module, for detecting the head pose of VR equipment users；
The image control mold, the head pose for VR equipment users are detected in head pose detection module are predefined figure
As amplifying during attitude, operation is amplified to the image on VR equipment；VR equipment users are detected in head pose detection module
Head pose be predefined image down attitude when, reduction operation is carried out to the image on VR equipment.
14. devices according to claim 13, it is characterised in that it is predefined that the head pose detection module is detected
Image amplify attitude be：Head is left-leaning, and predefined image down attitude is：Head Right deviation；
Or, the predefined image that the head pose detection module is detected amplifies attitude and is：Head Right deviation, it is described predetermined
Justice image down attitude be：Head is left-leaning；
Or, the predefined image that the head pose detection module is detected amplifies attitude and is：Head leans forward, described predetermined
Justice image down attitude be：Head is swung back；
Or, the predefined image that the head pose detection module is detected amplifies attitude and is：Head is swung back, described predetermined
Justice image down attitude be：Head leans forward.
15. devices according to claim 13, it is characterised in that described device is further included：Sight line capture module, uses
Watch focus attentively in detection user on image；
Described image control module is amplified operation to the image on VR equipment to be included：With the use that sight line capture module is detected
Family on image watch focus attentively centered on, operation is amplified to the image on VR equipment；
Described image control module carries out reduction operation to the image on VR equipment to be included：With the use that sight line capture module is detected
Family on image watch focus attentively centered on, reduction operation is carried out to the image on VR equipment.
16. devices according to claim 13, it is characterised in that
Described image control module is amplified operation specifically for detecting note of the user on image to the image on VR equipment
Viewing point, watches focus attentively according to this, determines interesting part of the user on image, the interesting part to user on image
It is amplified operation；
Described image control module carries out reduction operation specifically for detecting note of the user on image to the image on VR equipment
Viewing point, watches focus attentively according to this, determines interesting part of the user on image, the interesting part to user on image
Carry out reduction operation.
17. according to the arbitrary described device of claim 13 to 16, it is characterised in that described image control module is on VR equipment
Image be amplified operation before be further used for, judge the resolution of present image whether less than presetting first resolution,
Or/and, active user's watches focus attentively on image, and operation is if so, then amplified to image；Otherwise, image is not entered
Row amplifieroperation；
Described image control module is further used for before carrying out reduction operation to the image on VR equipment, judges present image
Whether resolution is higher than default second resolution, or/and, active user's watches focus attentively on image, if so, then to image
Carry out reduction operation；Otherwise, reduction operation is not carried out to image.
18. according to the arbitrary described device of claim 13 to 16, it is characterised in that the head pose detection module detects VR
The head pose of equipment user includes：
The direction that predefined image is amplified attitude sensing is positive as X-axis, by side that is vertical with X-axis and pointing to the user crown
To positive as Y-axis, the first coordinate system will be set up with X-axis and Y-axis vertical direction as Z axis forward direction；
Component of the user's head displacement vector in X, Y, Z axis direction is obtained from the acceleration induction device of VR equipment；
If it was found that user's head displacement vector is more than default first displacement threshold value in the absolute value of the component of X-axis positive direction, and using
Family head displacement vector then confirms user's in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
Head pose is that predefined image amplifies attitude；
If it was found that user's head displacement vector is more than default first displacement threshold value in the absolute value of the component of X-axis negative direction, and using
Family head displacement vector then confirms user's in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
Head pose is predefined image down attitude.
19. devices according to claim 18, it is characterised in that the head pose detection module is further used for, from
The gyroscope of VR equipment obtains angular velocity of the user's head in X, Y, Z axis direction；
The head pose detection module finds absolute value of the user's head displacement vector in the component of X-axis positive direction more than default
First displacement threshold value, and user's head displacement vector is in the both less than default second displacement of absolute value of Y-axis and the component of Z-direction
After threshold value, confirm that the head pose of user is further used for before amplifying attitude for predefined image,
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed；
The head pose detection module finds absolute value of the user's head displacement vector in the component of X-axis negative direction more than default
First displacement threshold value, and user's head displacement vector is in the both less than default second displacement of absolute value of Y-axis and the component of Z-direction
After threshold value, the head pose of user is confirmed to be further used for before predefined image down attitude,
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed.
20. according to the arbitrary described device of claim 14, it is characterised in that when the predefined image amplifies attitude be：
Head leans forward, and the predefined image down attitude is：When head is swung back,
The head pose detection module specifically for,
The initial direction of visual lines of the VR equipment users that sight line capture module is detected is positive as X-axis, will be vertical with X-axis and refers to
Direction to the user crown is positive as Y-axis, using the direction on the left of and sensing user's head vertical with X-axis and Y-axis as Z axis just
To setting up the first coordinate system；
Component of the user's head displacement vector in X, Y, Z axis direction is obtained from the acceleration induction device of VR equipment；
If it was found that user's head displacement vector is more than default first displacement threshold value in the absolute value of the component of X-axis positive direction, and using
Family head displacement vector then confirms user's in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
Head pose is to lean forward；
If it was found that user's head displacement vector is more than default first displacement threshold value in the absolute value of the component of X-axis negative direction, and using
Family head displacement vector then confirms user's in the both less than default second displacement threshold value of absolute value of Y-axis and the component of Z-direction
Head pose is layback.
21. devices according to claim 20, it is characterised in that the head pose detection module is further used for, from
The gyroscope of VR equipment obtains angular velocity of the user's head in X, Y, Z axis direction；
And, absolute value of the user's head displacement vector in the component of X-axis positive direction is found more than default first displacement threshold value, and use
Family head displacement vector is after the both less than default second displacement threshold value of the absolute value of Y-axis and the component of Z-direction, confirmation user
Head pose to be further used for before leaning forward,
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed；
It is described to find that user's head displacement vector is more than default first displacement threshold value in the absolute value of the component of X-axis negative direction, and
User's head displacement vector is after the both less than default second displacement threshold value of the absolute value of Y-axis and the component of Z-direction, confirmation is used
The head pose at family is further used for before being layback,
It was found that angular velocity of the user's head in X, Y, Z axis direction is both less than preset angle threshold speed.
22. devices according to claim 14, it is characterised in that be when the predefined image amplifies attitude：Head
Lean forward, the predefined image down attitude is：When head is swung back；Or, when the predefined image amplifies attitude it is：
Head leans forward, and the predefined image down attitude is：When head is swung back,
And, when the VR equipment is located on the vehicles,
When the head pose of VR equipment users is that predefined image amplifies attitude, described image control module is on VR equipment
Image be amplified operation specifically for,
The acceleration induction device installed on the vehicles is calculated when the acceleration of pre-test is on vehicle travels direction
Component and VR equipment on acceleration induction device when the component of the acceleration on vehicle travels direction of pre-test
Difference, if the absolute value of the difference be more than preset value, operation is amplified to the image on VR equipment, otherwise, not to VR
Image on equipment is amplified operation；
When the head pose of VR equipment users is predefined image down attitude, described image control module is on VR equipment
Image carry out reduction operation specifically for,
The acceleration induction device installed on the vehicles is calculated when the acceleration of pre-test is on vehicle travels direction
Component and VR equipment on acceleration induction device when the component of the acceleration on vehicle travels direction of pre-test
Difference, if the absolute value of the difference be more than preset value, reduction operation is carried out to the image on VR equipment, otherwise, not to VR
Image on equipment carries out reduction operation.
23. devices according to claim 18, it is characterised in that described image control module is entered to the image on VR equipment
It is further used for after row amplifieroperation,
Detection velocity component of the user's head in X-axis positive direction, if the velocity component is more than or equal to 0, continues to set VR
Standby upper image is amplified operation；If the velocity component is less than 0, stop being amplified operation to the image on VR equipment；
Described image control module is further used for after carrying out reduction operation to the image on VR equipment,
Detection velocity component of the user's head in X-axis negative direction, if the velocity component is more than or equal to 0, continues to set VR
Standby upper image carries out reduction operation, until it reaches till the diminution end condition of image；If the velocity component is less than 0, stop
Reduction operation is carried out to the image on VR equipment only.
24. devices according to claim 13, it is characterised in that described device is located on VR equipment.
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611049218.1A CN106557170A (en) | 2016-11-25 | 2016-11-25 | The method and device zoomed in and out by image on virtual reality device |
| KR1020170157514A KR20180059366A (en) | 2016-11-25 | 2017-11-23 | Method and device for zooming in or out on an image on a virtual reality device |
| EP17873373.9A EP3545387A4 (en) | 2016-11-25 | 2017-11-24 | Method and device for providing an image |
| PCT/KR2017/013483 WO2018097632A1 (en) | 2016-11-25 | 2017-11-24 | Method and device for providing an image |
| US15/822,340 US11068048B2 (en) | 2016-11-25 | 2017-11-27 | Method and device for providing an image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611049218.1A CN106557170A (en) | 2016-11-25 | 2016-11-25 | The method and device zoomed in and out by image on virtual reality device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106557170A true CN106557170A (en) | 2017-04-05 |
Family
ID=58443798
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611049218.1A Pending CN106557170A (en) | 2016-11-25 | 2016-11-25 | The method and device zoomed in and out by image on virtual reality device |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP3545387A4 (en) |
| KR (1) | KR20180059366A (en) |
| CN (1) | CN106557170A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107464291A (en) * | 2017-08-22 | 2017-12-12 | 广州魔发科技有限公司 | A kind of processing method and processing device of face image |
| CN111629195A (en) * | 2019-02-28 | 2020-09-04 | 邓云天 | Display method of 3DVR (digital video recorder) photo |
| WO2021168922A1 (en) * | 2020-02-25 | 2021-09-02 | 上海唯二网络科技有限公司 | Method and apparatus for achieving man-machine interaction using head-mounted vr display device |
| CN115442581A (en) * | 2021-12-29 | 2022-12-06 | 北京罗克维尔斯科技有限公司 | Vehicle-mounted VR glasses control method and device and computer equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103118202A (en) * | 2013-03-12 | 2013-05-22 | 上海斐讯数据通信技术有限公司 | Method for controlling mobile phone by swinging |
| WO2015062320A1 (en) * | 2013-11-01 | 2015-05-07 | 王洪亮 | Human body coupled intelligent information input system and method |
| CN104796594A (en) * | 2014-01-16 | 2015-07-22 | 中兴通讯股份有限公司 | Preview interface special effect real-time presenting method and terminal equipment |
| CN105359084A (en) * | 2013-07-01 | 2016-02-24 | Lg电子株式会社 | Display device and control method thereof |
| CN105898346A (en) * | 2016-04-21 | 2016-08-24 | 联想(北京)有限公司 | Control method, electronic equipment and control system |
| CN106131483A (en) * | 2016-06-24 | 2016-11-16 | 宇龙计算机通信科技(深圳)有限公司 | A kind of method for inspecting based on virtual reality and relevant device, system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9213403B1 (en) * | 2013-03-27 | 2015-12-15 | Google Inc. | Methods to pan, zoom, crop, and proportionally move on a head mountable display |
| US20150346813A1 (en) * | 2014-06-03 | 2015-12-03 | Aaron Michael Vargas | Hands free image viewing on head mounted display |
| US10073516B2 (en) * | 2014-12-29 | 2018-09-11 | Sony Interactive Entertainment Inc. | Methods and systems for user interaction within virtual reality scene using head mounted display |
-
2016
- 2016-11-25 CN CN201611049218.1A patent/CN106557170A/en active Pending
-
2017
- 2017-11-23 KR KR1020170157514A patent/KR20180059366A/en not_active IP Right Cessation
- 2017-11-24 EP EP17873373.9A patent/EP3545387A4/en not_active Withdrawn
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103118202A (en) * | 2013-03-12 | 2013-05-22 | 上海斐讯数据通信技术有限公司 | Method for controlling mobile phone by swinging |
| CN105359084A (en) * | 2013-07-01 | 2016-02-24 | Lg电子株式会社 | Display device and control method thereof |
| WO2015062320A1 (en) * | 2013-11-01 | 2015-05-07 | 王洪亮 | Human body coupled intelligent information input system and method |
| CN104796594A (en) * | 2014-01-16 | 2015-07-22 | 中兴通讯股份有限公司 | Preview interface special effect real-time presenting method and terminal equipment |
| CN105898346A (en) * | 2016-04-21 | 2016-08-24 | 联想(北京)有限公司 | Control method, electronic equipment and control system |
| CN106131483A (en) * | 2016-06-24 | 2016-11-16 | 宇龙计算机通信科技(深圳)有限公司 | A kind of method for inspecting based on virtual reality and relevant device, system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107464291A (en) * | 2017-08-22 | 2017-12-12 | 广州魔发科技有限公司 | A kind of processing method and processing device of face image |
| CN111629195A (en) * | 2019-02-28 | 2020-09-04 | 邓云天 | Display method of 3DVR (digital video recorder) photo |
| WO2021168922A1 (en) * | 2020-02-25 | 2021-09-02 | 上海唯二网络科技有限公司 | Method and apparatus for achieving man-machine interaction using head-mounted vr display device |
| CN115442581A (en) * | 2021-12-29 | 2022-12-06 | 北京罗克维尔斯科技有限公司 | Vehicle-mounted VR glasses control method and device and computer equipment |
| CN115442581B (en) * | 2021-12-29 | 2024-01-16 | 北京罗克维尔斯科技有限公司 | Vehicle-mounted VR glasses control method and device and computer equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| EP3545387A4 (en) | 2019-12-11 |
| KR20180059366A (en) | 2018-06-04 |
| EP3545387A1 (en) | 2019-10-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106557170A (en) | The method and device zoomed in and out by image on virtual reality device | |
| US10384348B2 (en) | Robot apparatus, method for controlling the same, and computer program | |
| US11068048B2 (en) | Method and device for providing an image | |
| JP5323910B2 (en) | Collision prevention apparatus and method for remote control of mobile robot | |
| US20130249942A1 (en) | System and apparatus for augmented reality display and controls | |
| CN102508546A (en) | Three-dimensional (3D) virtual projection and virtual touch user interface and achieving method | |
| CN101566875A (en) | Image processing apparatus, image processing method, program, and recording medium | |
| JP2013236374A (en) | System and method of interactively controlling virtual camera | |
| WO2017195034A1 (en) | Systems and methods involving edge camera assemblies in handheld devices | |
| KR20120046973A (en) | Method and apparatus for generating motion information | |
| JP2016045874A (en) | Information processor, method for information processing, and program | |
| US10771707B2 (en) | Information processing device and information processing method | |
| WO2016197639A1 (en) | Screen picture display method and apparatus | |
| JP6501035B2 (en) | Glasses-type wearable information terminal, control method thereof and control program | |
| CN104699249A (en) | Information processing method and electronic equipment | |
| WO2019142560A1 (en) | Information processing device for guiding gaze | |
| US20180165853A1 (en) | Head-mounted display apparatus and virtual object display system | |
| CN105373230A (en) | Gesture recognition method and device of on-board unit | |
| JP2020120388A (en) | Operating device, mobile device, and control system thereof | |
| KR101566963B1 (en) | Method of monitoring around view recognizing object considering state of operation vehicle, attaratus performing the same and storage media storing the same | |
| KR101221741B1 (en) | Camera zoom control system and method using position sensing information | |
| KR102024914B1 (en) | Blackbox system with function of managing emergency event | |
| US20210405771A1 (en) | Apparatus, method and computer program for controlling scrolling of content | |
| CN112074801A (en) | Method and user interface for detecting input through a pointing gesture | |
| CN108139814A (en) | Show method of adjustment, system and the head-mounted display apparatus of content |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170405 |