CN109189312A - A kind of human-computer interaction device and method for mixed reality - Google Patents
A kind of human-computer interaction device and method for mixed reality Download PDFInfo
- Publication number
- CN109189312A CN109189312A CN201810886077.1A CN201810886077A CN109189312A CN 109189312 A CN109189312 A CN 109189312A CN 201810886077 A CN201810886077 A CN 201810886077A CN 109189312 A CN109189312 A CN 109189312A
- Authority
- CN
- China
- Prior art keywords
- mixed reality
- touch
- human
- computer interaction
- interaction device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03543—Mice or pucks
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention discloses a kind of human-computer interaction device for mixed reality and method, combine on mobile phone in the interaction habits and interactive mode of plane interactive interface and mixed reality using it is commonplace three-dimension object is interacted by handle by the way of；The present invention is integrated on interactive device by the touch panel device that present most people is all compared habit, can be realized it is efficient interacted with planar interface, and for most of crowds often in contact with smart phone, learning cost is very low；Three-dimension object in mixed reality system can also be interacted easily by the operation mode of switching equipment.The operating mode of free switching of the present invention can adapt to most of interactive task in mixed reality, and guarantee user it is comfortable with it is light, promoted interactive efficiency while, user will not be allowed to feel excessive fatigue.
Description
Technical field
The invention belongs to technical field of virtual reality, and in particular to a kind of human-computer interaction device and side for mixed reality
Method.
Background technique
In mixed reality system, user generally uses handle to interact with virtual environment, more commonly used on the market
There are following three kinds of handles:
Joy-Con handle is the handle of switch game machine, each handle include simulation rocking bar and 4 main keys with
Some function keys may be mounted at game machine two sides and become palm machine, can also take off more as the progress of an independent handle
People's game either needs the somatic sensation television game that both hands are operated.It can also be mounted on specific device, can convert and get married
With machine mode.Adapt to a variety of different game experiencings；But Joy-Con handle is not particularly suited for virtual reality experience, only application trip
Gaming machine handle.
HTC VIVE provides two handles, and handle is tracked by way of infrared scan base station location, user or so
Hand respectively holds one, and handle can reflect the position that user works as remote holder.Handle is grasped equipped with a fritter touch tablet and several buttons
Control, user may be used touch tablet switching interface, selected, can be simply interacted with 3D object with button；
But the touch tablet that HTC VIVE handle provides is too small, significantly limits the performance of touch tablet effect, and user mostly relies on
Handle current location is operated with key, compares shortcoming for two-dimentional interface alternation, and interactive efficiency is low, does not meet user's habit
It is used.
Oculus Touch handle is the handle of oculus collocation, which possesses comfortable feel, pass through infrared mark
Point with pairing thermal camera tracked, can analog subscriber work as remote holder position and finger bending state, than serious
The shape that real reflection is sold has experience very true to nature when interact with three-dimension object；Oculus
Touch handle is laborious for the interaction with two-dimentional interface, and the scope of application is narrow, and both hands is needed to be always maintained at grasping shape
State is unfavorable for prolonged use.
Summary of the invention
In view of this, the object of the present invention is to provide a kind of human-computer interaction device for mixed reality and method, it can
The interaction demand for adapting to distinct interaction interface also can be improved interactive efficiency while easily comfortable use.
A kind of human-computer interaction device for mixed reality, including two pieces of touch tablets；Touch screen is provided on touch tablet；It is interior
Portion is provided with control system；The surface of the touch tablet is provided with key；
Wherein, when interacting with mixed reality system, two pieces of touch tablets are combined into one by way of splicing and set
It is standby；Two touch screen combinations are at a touch screen；After touching instruction outside the touch screen and key reception, via the control
System processed is interacted with mixed reality system.
Preferably, being provided with connection component on the side that two pieces of touch tablets are connect with other side.
Preferably, the connection component is magnet or buckle.
Preferably, the side of touch tablet is arranged in the key.
Preferably, the touch tablet back side opposite with touch screen is arranged in the key.
A kind of exchange method of the human-computer interaction device for mixed reality, when mixed reality system generates virtual screen
When, two pieces of touch tablets are stitched together；The mixed reality system renders virtual interface on touch screen position, for user
The interaction with the virtual screen is realized by point touching plate.
Preferably, the virtual interface is mobile phone interface, tablet computer interface either dummy keyboard.
A kind of exchange method of the human-computer interaction device for mixed reality, two pieces of touch tablets are stitched together；It is described
Mixed reality system renders virtual input interface on touch screen position, while multiple show is rendered around touch screen
Show interface；User realizes the interaction with the display interface by point touching plate.
Preferably, the relative position that the mixed reality system renders display interface and the touch screen is fixed or not
It is fixed.
A kind of exchange method of the human-computer interaction device for mixed reality, the mixed reality system renders three-dimensional object
Body；Using six degree of freedom tracking transducer, the rotation of the three-dimension object is controlled by slewing.
Preferably, face zooms in and out the three-dimension object by way of multi-point touch on the touchscreen.
A kind of exchange method of the human-computer interaction device for mixed reality, the mixed reality system is in Virtual Space
Three-dimension object is rendered, and renders the corresponding remote-controller function key of three-dimension object on the touchscreen；When user is directed at three-dimensional
When object, which is highlighted；User is sent to the three-dimension object by the function button of touch screen and is instructed.
The invention has the following beneficial effects:
A kind of human-computer interaction device and method for mixed reality of the invention combines on mobile phone for plane interaction
The interaction habits and interactive mode at interface hand over three-dimension object by handle using commonplace with mixed reality
Mutual mode；The present invention is integrated on interactive device by the touch panel device that present most people is all compared habit, can
Realize it is efficient interacted with planar interface, and for most of crowds often in contact with smart phone, study
Cost is very low.Three-dimension object in mixed reality system can also be carried out easily by the operation mode of switching equipment
Interaction.The operating mode of free switching of the present invention can adapt to most of interactive task in mixed reality, and guarantee user
It is comfortable with it is light, promoted interactive efficiency while, user will not be allowed to feel excessive fatigue.
Detailed description of the invention
Fig. 1 is the front schematic view of interactive device of the invention；
Fig. 2 is the schematic rear view of interactive device of the invention；
Fig. 3 is the contact surface schematic diagram of interactive device of the invention；
The side schematic view of interactive device Fig. 4 of the invention；
Wherein, 1- touch screen, 2- key, 3- magnet.
Specific embodiment
The present invention will now be described in detail with reference to the accompanying drawings and examples.
It in people's common practice is at present the planes interactive interface such as mobile phone screen or computer screen, in mixed reality system
In system, user interacts necessary not only for traditional planar interface, also needs to interact with three-dimension object simultaneously, and works as
The mode that the most of offers of interactive device and three-dimension object in preceding mixed reality equipment interact, for planar interface interaction
The adaptability of operation is less high.The present invention provides a set of adaptation planar interface and three-dimension object for interactive task in mixed reality
Interactive device, realize it is more convenient with comfortably interacted with mixed reality system.
Interactive device of the invention is implemented in combination with by combined type entity touchable device and virtual two-dimensional screen interface
Two dimension in three-dimensional VR system can touch interactive interface, be made of two pieces of touch tablets, and six degree of freedom built in each touch tablet tracks
Device, several physical buttons 2 are distributed in touchpad surface.Touch tablet can be used separately, and group and can also be got up, to realize two kinds
Operating mode: when two touch tablets stitch and fasten, size is similar to mobile phone (to refer to iphone X, 143.6mm
(height) * 70.9mm (width) * 7.7mm (thickness)), it can be used for interacting with the planar interface in mixed reality, be capable of providing class
Like the sliding of mobile phone, the gesture operations such as scaling rotation；When needing to input text, virtual keyboard can be showed, side
Just user inputs text.When touch tablet separates, user right-hand man respectively holds one, is capable of providing the function of similar handle,
For being interacted with three-dimension object.Each touch tablet can use but be not limited to characteristic point pose estimation mode carry out with
Track, mixed reality system can render key by the three-dimensional position and operating mode of tracking touch tablet at touchpad position
Disk or handle etc. facilitate the position of user's awareness apparatus.
Interactive device of the invention includes two symmetrical touch tablets, and each touch tablet composition is as shown in Fig. 1,2 and 4.Often
A touch tablet includes one piece of touch screen 1, several keys 2, built-in control system, six degree of freedom tracker and other indispensable moulds
Block.1 coating member upper surface major part region of touch screen, accounts about the 90% of the upper surface gross area, is capable of providing finger and is touching
The location information above screen 1 is touched, supports multi-point touch.Several keys 2 are distributed in component side and the back side, separate when equipment is in
When state, interacted as the key 2 on handle, on touch tablet the distribution mode of key 2 can use but be not limited to Fig. 2 and
Mode in Fig. 4.The mode of two pieces of touch tablets combination can be to be superimposed, at this time, it is only necessary to touch tablet above up and down
Upper setting touch screen 1；On the face of two pieces of touch tablets contact, it is provided with connection component, so that the two links together；Combination side
Formula is also possible to the mode of splicing, is both provided with touch screen 1 on two pieces of touch tablets at this time, after splicing, two touch screens 1 are spliced into
It is integrated, bigger interface, therefore more aspect operation is provided.In addition, connection component can be buckle, it is also possible to magnet 3.
The mode provided in the embodiment of the present invention is that magnet 3 connects, as shown in figure 3, touch tablet side is equipped with magnet 3, can allow two
A component close to when fit together, easily convert different interactive modes.
Each component or the equipment synthesized after entirety can be used but not limited to optical alignment in inertial sensor
In conjunction with mode tracked, the tracking of ancillary equipment can facilitate user to carry out complicated two handed input simultaneously, for example scale
Or one three-dimension object of rotation.Other modules built in component include battery, communication module, tracking and positioning module, state inspection
Survey module, infrared module, shock module etc..
The function of may be implemented based on this equipment is had very much, only provides some examples here, but be not limited to the function provided
Energy.When disassembled asset becomes two components, each component can individually carry out 6DOF tracking, and system can be right
The handle of various styles or the model of hand are rendered in the virtual spatial location answered.Under separate condition, equipment can be real
The institute that existing current virtual reality handle can be realized is functional, including but not limited to: by the key of the distribution on component, giving
System sends confirmation/cancellation instruction；The movement of user's hand is imitated, realizes crawl/release three-dimension object；Pass through component court
To the transmission etc. of user position in virtual world may be implemented.
When equipment synthesizes an entirety, the touch screen of two components synthesizes a bigger touch screen, empty
Quasi- reality system can integrally carry out whole equipment 6DOF tracking, and render corresponding model in corresponding position.
In the state that equipment synthesizes entirety, it can be listed below there are many operating mode, but only example, do not limit to
In listed function:
Plate mode.System can render a flat screen in the touch screen position of equipment, and user can work as equipment
It makees plate to be operated, flat screen can project the interface of mobile phone or tablet computer, and touch screen also can receive user's
Operation, and fed back in flat screen, user uses just and with true mobile phone or tablet computer without too
Big difference.
Keyboard mode.Equipment can be rendered to a dummy keyboard by system, when user touch dummy keyboard key when
It waits, the input of text and the input of keyboard instruction can be carried out.The render style of dummy keyboard can be with sets itself.
Notebook mode.When using present mode, have one piece of virtual screen and be presented on around equipment, screen it is big
Small to be adjusted, user, which can choose, to be fixed on the specific position of equipment for virtual screen and equipment is followed to move together
It is dynamic, for example perpendicular to the position of equipment touch screen or the lower section of equipment, touch screen can also be fixed on virtual world
Specific position does not follow equipment mobile, and equipment can be realized the keyboard and function of touchpad of similar notebook.For virtual screen
The content of presentation is slided, the operation such as scaling, or carries out the input of text and instruction.
Three-dimension object observing pattern.This mode can be convenient user and carry out multi-angle observation to three-dimension object.When selected
After one three-dimension object, the three-dimension object for wanting observation can be made to generate same rotation by slewing, touched
Screen is zoomed in and out by way of multi-point touch above, and three-dimension object can be made to become larger or become smaller, carried out to three-dimension object
Observation.
Remote controler mode.In such a mode, user can use equipment as remote controler.Above the touch screen of equipment
The function button that remote controler can be rendered, when user is directed at the object that some can be controlled, object can highlight aobvious
Show, when face clicks function button to user on the touchscreen, instruction, such as virtual air conditioner electric can be sent to selected object
Depending on etc. household electrical appliances.
In conclusion the above is merely preferred embodiments of the present invention, being not intended to limit the scope of the present invention.
All within the spirits and principles of the present invention, any modification, equivalent replacement, improvement and so on should be included in of the invention
Within protection scope.
Claims (11)
1. a kind of human-computer interaction device for mixed reality, which is characterized in that including two pieces of touch tablets；It is provided on touch tablet
Touch screen；Touch tablet is internally provided with control system and position tracking device；The surface of the touch tablet is provided with key；
Wherein, when interacting with mixed reality system, two pieces of touch tablets are combined into an equipment by way of splicing；Two
A touch screen combination is at an entity touch screen；Mixed reality system obtains touch tablet by the position tracking device in real time
3 d pose；Mixed reality system renders virtual two-dimensional operation circle in the position of touch screen according to the 3 d pose of touch tablet
Display is merged with touch screen to realize in face；After touching instruction outside the touch screen and key reception, via the control
System is interacted with mixed reality system, realizes the direct operation to virtual two-dimensional interface.
2. a kind of human-computer interaction device for mixed reality as described in claim 1, which is characterized in that two pieces of touches
Connection component is provided on the side that plate is connect with other side.
3. a kind of human-computer interaction device for mixed reality as claimed in claim 2, which is characterized in that the connection component
For magnet or buckle.
4. a kind of human-computer interaction device for mixed reality as described in claim 1, which is characterized in that the key setting
In the side of touch tablet.
5. a kind of human-computer interaction device for mixed reality as described in claim 1, which is characterized in that the key setting
At the touch tablet back side opposite with touch screen.
6. a kind of human-computer interaction device for mixed reality as described in claim 1, which is characterized in that two virtually
Dimension interface is mobile phone interface, tablet computer interface either dummy keyboard.
7. a kind of a kind of exchange method of the human-computer interaction device for mixed reality described in claim 1, which is characterized in that
Two pieces of touch tablets are stitched together；The mixed reality system renders virtual input interface on touch screen position, together
When multiple display interfaces are rendered around touch screen；User realizes the friendship with the display interface by point touching plate
Mutually.
8. a kind of exchange method of the human-computer interaction device for mixed reality as claimed in claim 7, which is characterized in that institute
State that mixed reality system renders display interface and the relative position of the touch screen is fixed or is not fixed.
9. a kind of a kind of exchange method of the human-computer interaction device for mixed reality as claimed in claim 7, which is characterized in that
The mixed reality system renders three-dimensional object；Using six degree of freedom tracking transducer, described three are controlled by slewing
Tie up the rotation of object.
10. a kind of exchange method of the human-computer interaction device for mixed reality as claimed in claim 9, which is characterized in that
Face zooms in and out the three-dimension object by way of multi-point touch on the touchscreen.
11. a kind of a kind of exchange method of the human-computer interaction device for mixed reality as claimed in claim 7, feature exist
In the mixed reality system renders three-dimension object in Virtual Space, and it is corresponding to render three-dimension object on the touchscreen
Remote-controller function key；When user is directed at three-dimension object, which is highlighted；The function that user passes through touch screen
Key sends to the three-dimension object and instructs.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810886077.1A CN109189312A (en) | 2018-08-06 | 2018-08-06 | A kind of human-computer interaction device and method for mixed reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810886077.1A CN109189312A (en) | 2018-08-06 | 2018-08-06 | A kind of human-computer interaction device and method for mixed reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109189312A true CN109189312A (en) | 2019-01-11 |
Family
ID=64920285
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810886077.1A Pending CN109189312A (en) | 2018-08-06 | 2018-08-06 | A kind of human-computer interaction device and method for mixed reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109189312A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110780733A (en) * | 2019-09-10 | 2020-02-11 | 北京理工大学 | Text input system for virtual reality |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101349961A (en) * | 2008-08-11 | 2009-01-21 | 深圳华为通信技术有限公司 | Method and apparatus for automatically switching portable terminal display mode |
| CN101561715A (en) * | 2009-05-15 | 2009-10-21 | 宇龙计算机通信科技(深圳)有限公司 | Input method and corresponding terminal, physical keyboard and physical key |
| CN201440679U (en) * | 2009-05-15 | 2010-04-21 | 宇龙计算机通信科技(深圳)有限公司 | Terminal and physical keyboard and physical key thereof |
| CN102752422A (en) * | 2012-07-09 | 2012-10-24 | 太仓市同维电子有限公司 | Touch-screen mobile phone |
| CN102779000A (en) * | 2012-05-03 | 2012-11-14 | 乾行讯科（北京）科技有限公司 | User interaction system and method |
| CN102855077A (en) * | 2011-07-01 | 2013-01-02 | 宫润玉 | Mode switching method for multifunctional touchpad |
| CN103376984A (en) * | 2012-04-28 | 2013-10-30 | 宇龙计算机通信科技(深圳)有限公司 | Application selection method and communication terminal |
| CN104331189A (en) * | 2014-11-19 | 2015-02-04 | 业成光电（深圳）有限公司 | Touch display device |
| CN104516649A (en) * | 2013-09-28 | 2015-04-15 | 南京专创知识产权服务有限公司 | Intelligent cell phone operating technology based on motion-sensing technology |
| CN105100442A (en) * | 2015-06-26 | 2015-11-25 | 努比亚技术有限公司 | Method and device for controlling screen display |
| CN204883491U (en) * | 2015-07-22 | 2015-12-16 | 瑞声声学科技(深圳)有限公司 | Touch -sensitive screen mobile communication terminal |
| CN105278855A (en) * | 2014-06-25 | 2016-01-27 | Lg电子株式会社 | Mobile terminal and method for controlling the same |
| CN105812565A (en) * | 2016-03-15 | 2016-07-27 | 杜采桑 | Self-adaptive desktop management system and method of external connection display of smart phone |
| CN107340962A (en) * | 2017-04-13 | 2017-11-10 | 北京安云世纪科技有限公司 | Input method, device and virtual reality device based on virtual reality device |
| CN107450716A (en) * | 2016-05-31 | 2017-12-08 | 北京京东尚科信息技术有限公司 | Control method for screen display and control device |
| CN107728901A (en) * | 2017-10-24 | 2018-02-23 | 广东欧珀移动通信有限公司 | interface display method, device and terminal |
| CN108073341A (en) * | 2017-12-27 | 2018-05-25 | 兴天通讯技术有限公司 | A kind of display system for smart mobile phone |
-
2018
- 2018-08-06 CN CN201810886077.1A patent/CN109189312A/en active Pending
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101349961A (en) * | 2008-08-11 | 2009-01-21 | 深圳华为通信技术有限公司 | Method and apparatus for automatically switching portable terminal display mode |
| CN101561715A (en) * | 2009-05-15 | 2009-10-21 | 宇龙计算机通信科技(深圳)有限公司 | Input method and corresponding terminal, physical keyboard and physical key |
| CN201440679U (en) * | 2009-05-15 | 2010-04-21 | 宇龙计算机通信科技(深圳)有限公司 | Terminal and physical keyboard and physical key thereof |
| CN102855077A (en) * | 2011-07-01 | 2013-01-02 | 宫润玉 | Mode switching method for multifunctional touchpad |
| CN103376984A (en) * | 2012-04-28 | 2013-10-30 | 宇龙计算机通信科技(深圳)有限公司 | Application selection method and communication terminal |
| CN102779000A (en) * | 2012-05-03 | 2012-11-14 | 乾行讯科（北京）科技有限公司 | User interaction system and method |
| CN102752422A (en) * | 2012-07-09 | 2012-10-24 | 太仓市同维电子有限公司 | Touch-screen mobile phone |
| CN104516649A (en) * | 2013-09-28 | 2015-04-15 | 南京专创知识产权服务有限公司 | Intelligent cell phone operating technology based on motion-sensing technology |
| CN105278855A (en) * | 2014-06-25 | 2016-01-27 | Lg电子株式会社 | Mobile terminal and method for controlling the same |
| CN104331189A (en) * | 2014-11-19 | 2015-02-04 | 业成光电（深圳）有限公司 | Touch display device |
| CN105100442A (en) * | 2015-06-26 | 2015-11-25 | 努比亚技术有限公司 | Method and device for controlling screen display |
| CN204883491U (en) * | 2015-07-22 | 2015-12-16 | 瑞声声学科技(深圳)有限公司 | Touch -sensitive screen mobile communication terminal |
| CN105812565A (en) * | 2016-03-15 | 2016-07-27 | 杜采桑 | Self-adaptive desktop management system and method of external connection display of smart phone |
| CN107450716A (en) * | 2016-05-31 | 2017-12-08 | 北京京东尚科信息技术有限公司 | Control method for screen display and control device |
| CN107340962A (en) * | 2017-04-13 | 2017-11-10 | 北京安云世纪科技有限公司 | Input method, device and virtual reality device based on virtual reality device |
| CN107728901A (en) * | 2017-10-24 | 2018-02-23 | 广东欧珀移动通信有限公司 | interface display method, device and terminal |
| CN108073341A (en) * | 2017-12-27 | 2018-05-25 | 兴天通讯技术有限公司 | A kind of display system for smart mobile phone |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110780733A (en) * | 2019-09-10 | 2020-02-11 | 北京理工大学 | Text input system for virtual reality |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Wacker et al. | Arpen: Mid-air object manipulation techniques for a bimanual ar system with pen & smartphone | |
| US8760391B2 (en) | Input cueing emersion system and method | |
| CN110168475B (en) | Method of operating a hub and system for interacting with peripheral devices | |
| CN105473021B (en) | wearable device and related system | |
| Bruder et al. | Touching the void revisited: Analyses of touch behavior on and above tabletop surfaces | |
| Babic et al. | Pocket6: A 6dof controller based on a simple smartphone application | |
| TW201120685A (en) | Portable virtual human-machine interaction device and method therewith | |
| Steinicke et al. | Multi-touching 3D data: Towards direct interaction in stereoscopic display environments coupled with mobile devices | |
| CN108027705A (en) | The apparatus and method inputted for buttons/keys and " finger writing " mixed type and low gabarit/geometry-variable controller based on hand | |
| Englmeier et al. | A tangible spherical proxy for object manipulation in augmented reality | |
| Caputo et al. | The Smart Pin: An effective tool for object manipulation in immersive virtual reality environments | |
| He et al. | Hand-based interaction for object manipulation with augmented reality glasses | |
| Stellmach et al. | Investigating freehand pan and zoom | |
| Tseng et al. | EZ-Manipulator: Designing a mobile, fast, and ambiguity-free 3D manipulation interface using smartphones | |
| Bai et al. | Free-hand gesture interfaces for an augmented exhibition podium | |
| Lee et al. | Relative Pointing Interface: A gesture interaction method based on the ability to divide space | |
| CN208239923U (en) | wearable computer | |
| CN109189312A (en) | A kind of human-computer interaction device and method for mixed reality | |
| CN112068757B (en) | Target selection method and system for virtual reality | |
| CN103309466A (en) | Directional image control device and method thereof | |
| Lee et al. | Tunnelslice: Freehand subspace acquisition using an egocentric tunnel for wearable augmented reality | |
| Unuma et al. | 3D interaction with virtual objects in a precisely-aligned view using a see-through mobile AR system | |
| van de Pol et al. | Interaction in semi-immersive large display environments | |
| CN104834410A (en) | Input apparatus and input method | |
| WO2019127325A1 (en) | Information processing method and apparatus, cloud processing device, and computer program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190111 |