CN108475085A - Head-mounted display apparatus and its interaction input method - Google Patents
Head-mounted display apparatus and its interaction input method Download PDFInfo
- Publication number
- CN108475085A CN108475085A CN201780004641.6A CN201780004641A CN108475085A CN 108475085 A CN108475085 A CN 108475085A CN 201780004641 A CN201780004641 A CN 201780004641A CN 108475085 A CN108475085 A CN 108475085A
- Authority
- CN
- China
- Prior art keywords
- touch
- display
- touch screen
- head
- display device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/163—Wearable computers, e.g. on a belt
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Position Input By Displaying (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
A kind of interaction input method is applied in a head-mounted display apparatus, and the head-mounted display apparatus includes display device and the touch screen positioned at the display device back side, and the interaction input method includes step：Pass through the touch object in touchscreen senses pre-determined distance；When touchscreen senses are to touch object, the display device display highlighting (S601) is controlled；And change the display properties (S603) of the cursor according to the variation control of distance between the touch object and the touch screen.This method, which is capable of providing, more intuitively to be interactively entered.
Description
Technical field
The present invention relates to a kind of display equipment more particularly to a kind of head-mounted display apparatus and its interaction input method.
Background technology
Head-mounted display apparatus can realize stereoscopic display and stereo and other effects due to convenience, gradually by people
Liked.In recent years, with the appearance of virtual reality (virtual reality, VR) technology, head-mounted display apparatus conduct
The hardware supported equipment of VR technologies, is more widely used.However, current head-mounted display apparatus, when user's wearing is worn
When being inputted after formula display equipment, it usually needs operation input device carries out blind operation, it appears very inconvenient.In some technologies
In, by showing some more friendly input interfaces and carrying out the body that input improves input for user's operation input unit
It tests, but it is still not intuitive enough.
Invention content
The embodiment of the present invention discloses a kind of head-mounted display apparatus and its interaction input method, can be in a manner of more intuitive
It is inputted after dressing head-mounted display apparatus for user, input experience can be effectively improved.
Head-mounted display apparatus disclosed by the embodiments of the present invention, including processor and display device, wherein the wear-type
Show that equipment further includes touch screen, the touch screen is set to the back side of display device, for sensing the touch-control in pre-determined distance
Object, the processor are electrically connected with the display device and the touch screen, are used for when touchscreen senses are to touch object,
The display device display highlighting is controlled, and is controlled and is changed according to the variation of distance between the touch object and the touch screen
The display properties of the cursor.
Interaction input method disclosed by the embodiments of the present invention is applied in a head-mounted display apparatus, and the wear-type is aobvious
Show that equipment includes display device and the touch screen positioned at the display device back side, the interaction input method includes step：By touching
Touch the touch object in screen sensing pre-determined distance；When touchscreen senses are to touch object, control the display device and show light
Mark；And change the display properties of the cursor according to the variation control of distance between the touch object and the touch screen.
The head-mounted display apparatus and its interaction input method of the present invention, by the back of the body that touch screen is set to display device
Face, user can carry out touch control operation by the corresponding position in touch screen to the content for the display device seen, operate more straight
It sees, and according to the far and near control cursor dynamic change of user's touch-control distance, guiding user is to suitably apart from interior carry out touch-control, more
Add intuitive and convenient.
Description of the drawings
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to needed in the embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for ability
For the those of ordinary skill of domain, without creative efforts, it can also be obtained according to these attached drawings other attached
Figure.
Fig. 1 is the structure diagram of the head-mounted display apparatus in one embodiment of the invention.
Fig. 2 is the schematic diagram of the head-mounted display apparatus in one embodiment of the invention.
Fig. 3 is the schematic diagram of the head-mounted display apparatus display highlighting in one embodiment of the invention.
Fig. 4 is that the touch screen of the head-mounted display apparatus in one embodiment of the invention and the setting relationship of display device are illustrated
Figure.
Fig. 5 is the decomposition diagram worn formula and show equipment in one embodiment of the invention.
Fig. 6 is the flow chart of the interaction input method in one embodiment of the invention.
Fig. 7 is the sub-process figure of step S603 in Fig. 6.
Fig. 8 is the flow chart of the interaction input method in another embodiment of the present invention.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation describes, it is clear that described embodiment is only a part of the embodiment of the present invention, instead of all the embodiments.Based on this
Embodiment in invention, every other reality obtained by those of ordinary skill in the art without making creative efforts
Example is applied, shall fall within the protection scope of the present invention.
Referring to Fig. 1, for the structure diagram of the head-mounted display apparatus 100 in one embodiment of the invention.As shown in Figure 1,
The head-mounted display apparatus 100 includes processor 10, display device 20, touch screen 30.
Also referring to Fig. 2, the touch screen 30 is attached to the back side of display device 20.That is, being worn described in user's wearing
When formula shows equipment 100, the touch screen 30 is located on the side of the separate eyes of user of the display device 20.
The touch screen 30 is used to sense the touch object T1 in pre-determined distance.In some embodiments, the touch control object
Body T1 can be the finger etc. of user.The pre-determined distance can be 5 centimetres etc..In some embodiments, the touch screen 30 senses
When having touch object T1 in pre-determined distance, corresponding inductive signal is generated.
It is the schematic diagram of 20 display highlighting of display device also referring to Fig. 3.The processor 10 and the display device
20 and the touch screen 30 be electrically connected, it is aobvious for when touch screen 30 senses touch object T1, controlling the display device 20
Show cursor B1, and changes the cursor B1's according to the variation control of distance between the touch object T1 and the touch screen 30
Display properties.
In some embodiments, when touch object T1 is in the pre-determined distance, the processor 10 is in touch object
When T1 is remoter from touch screen 30, controls the cursor B1 and show bigger and more transparent.Correspondingly, the processor 10 is in touch-control
When object T1 is closer from touch screen 30, controls the cursor B1 and show smaller and more clear.Obviously, when cursor B1 is more transparent,
Then can not it recognize, it is when cursor B1 is opaquer, then more clear.
To which touch screen 30 is set to the back side of display device 20 by the present invention, and user can be by filling the display seen
The content for setting 20 carries out touch control operation by touch screen 30, and operation is more intuitive, and can pass through cursor B1 dynamic instruction users'
Touch-control distance, bootable user, which is moved in suitable touch-control distance range, carries out touch-control so that input more intuitive and convenient.
In some embodiments, the processor 10 controls the display when touch screen 30 senses touch object T1
20 display highlighting B1 of device is specifically included：The processor 10 is touched when touch screen 30 senses touch object T1 according to described
The position of touch of control object T1 is controlled shows the cursor B1 in the correspondence display location of display device 20.
In some embodiments, the touch screen 30 senses the inductive signal packet that the touch object T1 in pre-determined distance is generated
Include the range information of touch object T1 and touch screen 30.The processor 10 obtains the inductive signal, and according to inductive signal
In range information determine the touch object T1 with a distance from touch screen 30, and determined according to the inductive signal that continuously receives
The variation of distance between the touch object T1 and touch screen 30.As previously mentioned, the processor 10 touch object T1 from touch
Touch screen 30 it is remoter when, control the cursor B1 and show bigger and more transparent.Correspondingly, the processor 10 is in touch object T1
When closer from touch screen 30, control the cursor B1 and show smaller and more clear.
Wherein, it further includes touch-control position that the touch screen 30, which senses the inductive signal that the touch object T1 in pre-determined distance is generated,
Confidence ceases, and the processor 10 obtains the inductive signal, and according to the position of touch information in the inductive signal of the acquisition
It determines position of touch of the touch object T1 on touch screen 30, and controls and shown in the correspondence display location of display device 20
The cursor B1.
In some embodiments, the display corresponding with the position of touch on the touch screen 30 in the display device 20
Position is that after user puts on head-mounted display apparatus 100, the position overlapped with the position of touch is looked in the sight of user.
That is, after user puts on head-mounted display apparatus 100, on the region and touch screen 30 in display device 20 that user's sight is seen
Corresponding position of touch is to overlap, in this way, user carries out the position of touch-control input and the display location seen on touch screen 30
It is to overlap, user accurately can carry out touch-control to the icon etc. shown in display device 20.
Also referring to Fig. 4, in some embodiments, the display device 20 includes the display area 21 for display,
The entire display area 21 of the display device 20 is square with the touch screen 30.The touch screen 30 is set to described aobvious
Position on the back side of showing device 20 is so that four vertex of the entire display area 21 of the display device 20 are touched with described
The extended line for touching the line between 30 corresponding four vertex of screen is just intersected in the point of observation G1 of eyes of user.
Wherein, when the display area 21 and touch screen 30 are to extend over the whole screen region of right and left eyes, that is, when with
After head-mounted display apparatus 100 is dressed at family, when the display area 21 and touch screen 30 completely cover the right and left eyes position of user,
The point of observation of the eyes of user refers to the point midway of the line of user's right and left eyes of wearing head-mounted display apparatus 100.
In further embodiments, when the region that the display area 21 and touch screen 30 are corresponding left eye or right eye
When, that is, in some embodiments, the touch screen 30 includes the touch screen of corresponding left eye region and touching for corresponding right eye region
Two touch screens including screen are touched, and 20 display area 21 of the display device includes left eye display area and right eye display area
When two display areas inside, the point of observation of the eyes of user refers to that the user of wearing head-mounted display apparatus 100 is left
The position of eye or right eye.
By the above-mentioned setting to touch screen 30 and display area 21, the touch screen 30 for correspondence is enabled to
On position of touch and the display location in the display device 20 be that user puts on regarding for user after head-mounted display apparatus 100
It is looked on line in two bands of position to overlap.
To which user sees display interface by display device 20, and can wait for touch-control according on the display interface seen
Position and by finger accurately to this wait for the position of touch-control carry out contact or non-contact type touch control, under this touch control manner,
It is also more intuitive to interactively enter mode.
In some embodiments, the touch screen 30 senses in the inductive signal that the touch object T1 in pre-determined distance is generated
Further include touch action information, the processor 10 is additionally operable to determine user according to the touch action information in the inductive signal
Touch action, for example, double-click, click, slide, and active user is determined according to the position of touch information in inductive signal
Position of touch, then determine the position of touch correspond to the display element shown on display location on the display device 20, and
It is executed and the relevant function of the display element according to the touch action.
For example, as shown in figure 3, showing several icon P1, including browser icon, electricity in the display device 20
Philosophical works icon, map icon, imaging icon etc..It is used when processor 10 is determined according to the touch action information in the inductive signal
The touch action at family is to double-click, and the position of touch of active user corresponds to the display shown on display location on the display device 20
When element is browser icon, browser is opened in the control of the processor 10.In another example if processor 10 is believed according to the induction
Touch action information in number determines that the touch action of user is that two fingers draw close sliding touch, and the position of touch of active user exists
When to correspond to the display element that is shown on display location in display device 20 be picture, the figure is reduced in the control of the processor 10
Piece.
Wherein, the display location of the display device 20 and the correspondence of the touch location on touch screen 30 can be advance
Display device 20 and touch screen 30 are divided into several bands of position with default resolution ratio, and weight will be in eyes of user sight
The display location of the display device 20 of conjunction state and the touch location on touch screen 30, which are established one by one after correspondence, to be obtained.Its
In, the correspondence can be pre-established in head-mounted display apparatus 100 before manufacture.
As shown in Figure 1, the head-mounted display apparatus 100 further includes memory 40, the memory 40 is stored with display
The display location of device 20 and the correspondence of the touch location on touch screen 30.The processor 10 determines touching for active user
After controlling position, then determine that the correspondence determines the correspondence display location of position of touch on the display device 20, goes forward side by side one
Step determines the display element shown on the display location.Obviously, the processor 10 is when controlling display highlighting B1, also for
After the position of touch for determining active user, the correspondence of position of touch on the display device 20 is then determined according to the correspondence
Display location, and control and show the cursor B1 on the correspondence display location of the display device 100.
Please refer to fig. 5, for the decomposition texture schematic diagram of head-mounted display apparatus 100.In some embodiments, described
Touch screen 30 is floated touch screen, short distance touch sensor is distributed with, it is close that the touch screen 30 can sense touch object T1
The touch of distance.The head-mounted display apparatus 100 further includes shell 50, and the shell 50 is used to cover the back of the body of display device 20
Face, the touch screen 30 are set to the inner wall of shell 50.That is, as shown in figure 5, when the touch screen 30 is floated touch screen
When, the touch screen 30 is set to the inner wall of shell 50 without being directly exposed.
In further embodiments, the touch screen 30 can be the touch screen that common detecting user directly touches, described
Touch screen 30 is used to sense the touch object T1 being in direct contact with touch screen 30.Obviously, when the touch screen 30 is sensing and is touched
When touching the touch object T1 that screen 30 is in direct contact, the touch screen 30 is located on the outermost surface of display device 20.
Wherein the processor 10 can be microcontroller, microprocessor, microcontroller, digital signal processor etc..
The memory 40 can be the computer readable storage mediums such as storage card, solid-state memory, micro harddisk, CD.
In some embodiments, several program instructions are stored in the memory 40, after described program instruction can be called by processor 10
Execute function above-mentioned.
The head-mounted display apparatus 100 can be intelligent helmet, the headset equipments such as intelligent glasses.
Referring to Fig. 6, for the flow chart of the interaction input method in one embodiment of the invention.The interaction input method is answered
For in head-mounted display apparatus 100 above-mentioned, execution sequence to be not limited to sequence shown in fig. 6.The method includes the steps：
When touch screen 30 senses touch object T1,20 display highlighting B1 (S601) of the display device is controlled.One
In a little embodiments, the processor 10 is when touch screen 30 senses touch object T1, according to the touch-control of the touch object T1
Position control shows the cursor B1 in the correspondence display location of display device 20.In some embodiments, the display device
After head-mounted display apparatus 100 is put in display location corresponding with the position of touch on the touch screen 30 on 20 for user,
The position overlapped with the position of touch is looked in the sight of user.In some embodiments, the head-mounted display apparatus
The display location of display device 20 and the correspondence of the touch location on touch screen 30 are prestored in 100, for according to described right
It should be related to the correspondence display location of determining position of touch on the display device 20.
Change the aobvious of the cursor B1 according to the variation control of distance between the touch object T1 and the touch screen 30
Show attribute (S603).In some embodiments, described in the processor 10 is controlled when touch object T1 is remoter from touch screen 30
Cursor B1 shows bigger and more transparent.
Referring to Fig. 7, being the sub-process figures of step S603 in some embodiments.As shown in fig. 7, the step S603 packets
It includes:
It obtains touch screen 30 and senses the inductive signal (S6031) that touch object T1 is generated.
The distance between the touch object T1 and touch screen 30 are determined according to the range information in inductive signal
(S6032)。
It is determined between the touch object T1 and touch screen 30 according to the range information in the inductive signal continuously received
Distance variation (S6033).
Change the aobvious of the cursor B1 according to the variation control of distance between the touch object T1 and the touch screen 30
Show attribute (S6034).
Referring to Fig. 8, the flow chart of the interaction input method in one embodiment of the invention.The interaction input method application
In head-mounted display apparatus 100 above-mentioned, execution sequence is not limited to sequence shown in Fig. 8.The method includes the steps：
When touch screen 30 senses touch object T1,20 display highlighting B1 (S801) of the display device is controlled.One
In a little embodiments, the processor 10 is when touch screen 30 senses touch object T1, according to the touch-control of the touch object T1
Position control shows the cursor B1 in the correspondence display location of display device 20.
Change the aobvious of the cursor B1 according to the variation control of distance between the touch object T1 and the touch screen 30
Show attribute (S803).
The touch action information sensed according to the touch screen 30 in the inductive signal that touch object T1 is generated determines use
The touch action (S805) at family.
The position of touch (S806) of active user is determined according to the position of touch information in inductive signal.
Determine that the position of touch corresponds to the display element (S807) shown on display location on the display device 20.One
In a little embodiments, touching on the display location and touch screen 30 of display device 20 is stored in the head-mounted display apparatus 100
Touch the correspondence of position.The step S807 includes：After the position of touch of determined active user, then according to the correspondence
Relationship determines the correspondence display location of position of touch on the display device 20, and further determines that and shown on the display location
Display element.
The relevant function of display element (S808) is executed according to the touch action.
Wherein, described step S801, S803 are identical as step S601, the S603 difference in Fig. 6, included by it is further
Feature it is identical as step S601, the S603 difference in Fig. 6, detailed step please refers to step S601, S603 in Fig. 6.
Wherein, when being stored with several program instructions in memory 40, several program instructions are used for for processor 10
Call the step in any one of executing and execute Fig. 6-7.
To which touch screen 30 is set to display device by head-mounted display apparatus 100 of the invention and interaction input method
20 back side, user can to the content of the display device 20 seen by touch screen 30 to seeing that the corresponding position of content is touched
Control operation, operation is more intuitive, in addition, display highlighting B1, and root on the display device 20 can be touched according to the short distance of user
According to the display properties for touching distance change cursor B1, to prompt user to touch the distance of distance.In addition, the present invention is also by making
Position of touch is to overlap in user's sight with corresponding display location so that user is to display content and position of touch
It is more accurate to hold, and user is facilitated fast to be inputted.
The above is the preferred embodiment of the present invention, it is noted that those skilled in the art are come
It says, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also considered as this
The protection domain of invention.
Claims (20)
1. a kind of head-mounted display apparatus, including processor and display device, which is characterized in that the head-mounted display apparatus is also
Including touch screen, the touch screen is attached to the back side of display device, for sensing the touch object in pre-determined distance, the place
Reason device is electrically connected with the display device and the touch screen, described aobvious for when touchscreen senses are to touch object, controlling
Showing device display highlighting, and the cursor is changed according to the variation control of distance between the touch object and the touch screen
Display properties.
2. head-mounted display apparatus as described in claim 1, which is characterized in that the display properties include display size and thoroughly
Lightness, the processor control the cursor and show bigger and more transparent when touch object is remoter from the touch screen.
3. head-mounted display apparatus as described in claim 1, which is characterized in that touching in the touchscreen senses pre-determined distance
It controls object and generates inductive signal, the inductive signal includes the range information of touch object and touch screen, and the processor obtains
The inductive signal, and the touch object is determined with a distance from touch screen according to the range information in inductive signal, and according to
Range information in the inductive signal continuously received determines the variation of distance between the touch object and touch screen.
4. head-mounted display apparatus as claimed in claim 3, which is characterized in that the inductive signal further includes position of touch letter
Breath, the processor obtains the inductive signal, and determines institute according to the position of touch information in the inductive signal of the acquisition
The position of touch of touch object on the touchscreen is stated, and controls and shows the cursor in the correspondence display location of display device.
5. head-mounted display apparatus as claimed in claim 4, which is characterized in that in the display device on the touch screen
The corresponding display location of position of touch be after user puts on head-mounted display apparatus looked over from the sight of user with it is described
The position that position of touch overlaps.
6. head-mounted display apparatus as claimed in claim 5, which is characterized in that the display area of the display device with it is described
The extended line of line between corresponding four vertex of touch screen is intersected in the point of observation of eyes of user.
7. head-mounted display apparatus as claimed in claim 6, which is characterized in that the display area and touch screen are to extend
The whole screen region of right and left eyes is covered, the point of observation of the eyes of user is the point midway of the line of user's right and left eyes.
8. head-mounted display apparatus as claimed in claim 6, which is characterized in that the touch screen includes corresponding left eye region
The touch screen of touch screen and corresponding right eye region, and the viewing area includes left eye display area and right eye display area, institute
The point of observation for stating eyes of user is the left eye for the user for dressing head-mounted display apparatus or the position of right eye；The left eye viewing area
The extended line of line between four vertex corresponding with the touch screen of the corresponding left eye region of domain is intersected in user's left eye
Position, the extension of the line between four vertex corresponding with the touch screen of the corresponding right eye region of the right eye display area
Line is intersected in the position of user's right eye.
9. head-mounted display apparatus as claimed in claim 3, which is characterized in that touching in the touchscreen senses pre-determined distance
It further includes touch action information to control in the inductive signal that object generates, and the processor is additionally operable to according in the inductive signal
Touch action information determines the touch action of user, then determines that the position of touch corresponds on display location on the display apparatus
The display element of display, and executed and the relevant function of the display element according to the touch action.
10. the head-mounted display apparatus as described in claim 4 or 9, which is characterized in that the processor determines active user's
After position of touch, the correspondence of the touch location on display location according to display device and touch screen determines that position of touch exists
Correspondence display location in display device.
11. the head-mounted display apparatus as described in claim 4 or 9, which is characterized in that the display location of the display device and
The correspondence of touch location on touch screen is that display device and touch screen are divided into several positions with default resolution ratio in advance
Region is set, and the display location that the display device of coincidence status will be in eyes of user sight and the touch location on touch screen
It establishes after correspondence and to obtain one by one.
12. head-mounted display apparatus as described in claim 1, which is characterized in that the head-mounted display apparatus further includes shell
Body, the shell are used to cover the back side of display device, and the touch screen is set to the inner wall of shell.
13. a kind of interaction input method is applied in a head-mounted display apparatus, the head-mounted display apparatus includes that display fills
Set and be attached to the touch screen at the display device back side, which is characterized in that the interaction input method includes step：
Pass through the touch object in touchscreen senses pre-determined distance；
When touchscreen senses are to touch object, the display device display highlighting is controlled；And
Change the display properties of the cursor according to the variation control of distance between the touch object and the touch screen.
14. interaction input method as claimed in claim 13, which is characterized in that the display properties include display size and thoroughly
Lightness, the step " change the aobvious of the cursor according to the variation control of distance between the touch object and the touch screen
Show attribute " include：
When touch object is remoter from the touch screen, controls the cursor and show bigger and more transparent.
15. interaction input method as claimed in claim 13, which is characterized in that touching in the touchscreen senses pre-determined distance
It controls object and generates inductive signal, the inductive signal includes the range information of touch object and touch screen, and the step is " according to institute
The variation control for stating distance between touch object and the touch screen changes the display properties of the cursor " include：
Obtain the inductive signal that the touch object in the touchscreen senses pre-determined distance generates；
Determine the touch object with a distance from touch screen according to the range information in inductive signal；
The change of distance between the touch object and touch screen is determined according to the range information in the inductive signal continuously received
Change；And
Change the display properties of the cursor according to the variation control of distance between the touch object and the touch screen.
16. interaction input method as claimed in claim 13, which is characterized in that touching in the touchscreen senses pre-determined distance
It controls object and generates inductive signal, the inductive signal includes position of touch information, and the step is " in touchscreen senses to touch control object
When body, the display device display highlighting is controlled " include：
Obtain the inductive signal that the touch object in the touchscreen senses pre-determined distance generates；
The touch-control position of the touch object on the touchscreen is determined according to the position of touch information in the inductive signal of the acquisition
It sets, and controls and show the cursor in the correspondence display location of display device.
17. interaction input method as claimed in claim 13, which is characterized in that touching in the touchscreen senses pre-determined distance
It controls object and generates inductive signal, the inductive signal includes touch action information, and the method further includes step：
The touch action of user is determined according to the touch action information in the inductive signal；
Determine that the position of touch corresponds to the display element shown on display location on the display apparatus, and dynamic according to the touch-control
Make to execute and the relevant function of the display element.
18. the interaction input method as described in claim 16 or 17, which is characterized in that being touched with described in the display device
Touch the corresponding display location of position of touch on screen and be after user puts on head-mounted display apparatus looked in the sight of user with
The position that the position of touch overlaps.
19. the interaction input method as described in claim 16 or 17, which is characterized in that the method further includes step：
The correspondence of touch location on display location according to display device and touch screen determines the position of touch aobvious
Correspondence display location on showing device.
20. interaction input method as claimed in claim 19, which is characterized in that the method further includes step：
Display device and touch screen are divided into several bands of position with default resolution ratio in advance；And
Will in eyes of user sight in coincidence status display device display location and touch screen on touch location one by one
It establishes correspondence and obtains the display location of the display device and the correspondence of the touch location on touch screen.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2017/084567 WO2018209572A1 (en) | 2017-05-16 | 2017-05-16 | Head-mountable display device and interaction and input method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108475085A true CN108475085A (en) | 2018-08-31 |
Family
ID=63266550
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201780004641.6A Pending CN108475085A (en) | 2017-05-16 | 2017-05-16 | Head-mounted display apparatus and its interaction input method |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108475085A (en) |
| WO (1) | WO2018209572A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110113529A (en) * | 2019-04-29 | 2019-08-09 | 努比亚技术有限公司 | A kind of acquisition parameters regulation method, equipment and computer readable storage medium |
| CN110362231A (en) * | 2019-07-12 | 2019-10-22 | 腾讯科技（深圳）有限公司 | The method and device that new line touch control device, image are shown |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007310599A (en) * | 2006-05-17 | 2007-11-29 | Nikon Corp | Video display device |
| CN102402386A (en) * | 2010-09-07 | 2012-04-04 | 索尼公司 | Information processing apparatus, information processing method and program |
| CN102609120A (en) * | 2007-11-30 | 2012-07-25 | 原相科技股份有限公司 | Cursor control device and method on image display device, and image system |
| CN103487937A (en) * | 2012-06-13 | 2014-01-01 | 索尼公司 | Head-mounted video display device |
| CN103823550A (en) * | 2012-11-16 | 2014-05-28 | 广达电脑股份有限公司 | Virtual touch method |
| CN106155383A (en) * | 2015-04-03 | 2016-11-23 | 上海乐相科技有限公司 | A kind of head-wearing type intelligent glasses screen control method and device |
| DE102015012720A1 (en) * | 2015-10-01 | 2017-04-06 | Audi Ag | Interactive operator system and method for performing an operator action in an interactive operator system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104076930B (en) * | 2014-07-22 | 2018-04-06 | 北京智谷睿拓技术服务有限公司 | Blind method of controlling operation thereof, device and system |
-
2017
- 2017-05-16 CN CN201780004641.6A patent/CN108475085A/en active Pending
- 2017-05-16 WO PCT/CN2017/084567 patent/WO2018209572A1/en active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007310599A (en) * | 2006-05-17 | 2007-11-29 | Nikon Corp | Video display device |
| CN102609120A (en) * | 2007-11-30 | 2012-07-25 | 原相科技股份有限公司 | Cursor control device and method on image display device, and image system |
| CN102402386A (en) * | 2010-09-07 | 2012-04-04 | 索尼公司 | Information processing apparatus, information processing method and program |
| CN103487937A (en) * | 2012-06-13 | 2014-01-01 | 索尼公司 | Head-mounted video display device |
| CN103487937B (en) * | 2012-06-13 | 2018-01-12 | 索尼公司 | Head video display device |
| CN103823550A (en) * | 2012-11-16 | 2014-05-28 | 广达电脑股份有限公司 | Virtual touch method |
| CN106155383A (en) * | 2015-04-03 | 2016-11-23 | 上海乐相科技有限公司 | A kind of head-wearing type intelligent glasses screen control method and device |
| DE102015012720A1 (en) * | 2015-10-01 | 2017-04-06 | Audi Ag | Interactive operator system and method for performing an operator action in an interactive operator system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110113529A (en) * | 2019-04-29 | 2019-08-09 | 努比亚技术有限公司 | A kind of acquisition parameters regulation method, equipment and computer readable storage medium |
| CN110113529B (en) * | 2019-04-29 | 2022-03-18 | 努比亚技术有限公司 | Shooting parameter regulation and control method and device and computer readable storage medium |
| CN110362231A (en) * | 2019-07-12 | 2019-10-22 | 腾讯科技（深圳）有限公司 | The method and device that new line touch control device, image are shown |
| CN110362231B (en) * | 2019-07-12 | 2022-05-20 | 腾讯科技（深圳）有限公司 | Head-up touch device, image display method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018209572A1 (en) | 2018-11-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2972669B1 (en) | Depth-based user interface gesture control | |
| US9733752B2 (en) | Mobile terminal and control method thereof | |
| CN114830066A (en) | Device, method and graphical user interface for displaying applications in a three-dimensional environment | |
| JP5759660B2 (en) | Portable information terminal having touch screen and input method | |
| US9582096B2 (en) | Information processing apparatus, information processing method, and program | |
| KR20190009846A (en) | Remote hover touch system and method | |
| EP2840478B1 (en) | Method and apparatus for providing user interface for medical diagnostic apparatus | |
| KR20170053280A (en) | Method for displaying one or more virtual objects in a plurality of electronic devices, and an electronic device supporting the method | |
| KR102297473B1 (en) | Apparatus and method for providing touch inputs by using human body | |
| CN111665983A (en) | Electronic device and display method thereof | |
| KR20130142824A (en) | Remote controller and control method thereof | |
| KR20160023298A (en) | Electronic device and method for providing input interface thereof | |
| CN107250950A (en) | Head-mounted display apparatus, wear-type display system and input method | |
| WO2020014002A1 (en) | Systems and methods for using eye gaze to bend and snap targeting rays for remote interaction | |
| KR20120126508A (en) | method for recognizing touch input in virtual touch apparatus without pointer | |
| CN113396378A (en) | System and method for a multipurpose input device for two-dimensional and three-dimensional environments | |
| WO2019091124A1 (en) | Terminal user interface display method and terminal | |
| US10852816B2 (en) | Gaze-informed zoom and pan with manual speed control | |
| KR20110115683A (en) | Input method for touch screen using one hand | |
| KR20180065727A (en) | Method for displaying object and electronic device thereof | |
| KR20230007515A (en) | Method and system for processing detected gestures on a display screen of a foldable device | |
| CN104363345A (en) | Displaying method and electronic equipment | |
| CN108475085A (en) | Head-mounted display apparatus and its interaction input method | |
| KR101363661B1 (en) | Smart Remote Controller Using Edge Sliding UI | |
| US20230100689A1 (en) | Methods for interacting with an electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Building 43, Dayun software Town, No. 8288 Longgang Avenue, Henggang street, Longgang District, Shenzhen City, Guangdong Province Applicant after: Shenzhen Ruoyu Technology Co.,Ltd. Address before: Building 43, Dayun software Town, No. 8288 Longgang Avenue, Henggang street, Longgang District, Shenzhen City, Guangdong Province Applicant before: SHENZHEN ROYOLE TECHNOLOGIES Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180831 |