CN109710075B - Method and device for displaying content in VR scene - Google Patents

Method and device for displaying content in VR scene Download PDF

Info

Publication number
CN109710075B
CN109710075B CN201811641965.3A CN201811641965A CN109710075B CN 109710075 B CN109710075 B CN 109710075B CN 201811641965 A CN201811641965 A CN 201811641965A CN 109710075 B CN109710075 B CN 109710075B
Authority
CN
China
Prior art keywords
content
displayed
virtual object
gesture
displaying
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811641965.3A
Other languages
Chinese (zh)
Other versions
CN109710075A (en
Inventor
郭瑽
刘晨阳
戴若犁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BEIJING NOITOM TECHNOLOGY Ltd
Original Assignee
BEIJING NOITOM TECHNOLOGY Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BEIJING NOITOM TECHNOLOGY Ltd filed Critical BEIJING NOITOM TECHNOLOGY Ltd
Priority to CN201811641965.3A priority Critical patent/CN109710075B/en
Publication of CN109710075A publication Critical patent/CN109710075A/en
Application granted granted Critical
Publication of CN109710075B publication Critical patent/CN109710075B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention relates to a method and a device for displaying content in a VR scene, comprising the following steps: detecting whether content to be displayed exists or not; if the content to be displayed exists, acquiring the content to be displayed; determining a first virtual object used for displaying the content to be displayed in the VR scene; and displaying the content to be displayed on the first virtual object. According to the embodiment of the invention, the content to be displayed can be displayed on the first virtual object of the VR scene, the data content is visualized, and a user can conveniently acquire the required data content in the VR scene.

Description

Method and device for displaying content in VR scene
Technical Field
The embodiment of the invention relates to a method and a device for displaying content in a VR scene.
Background
Virtual Reality (VR) technology is a computer simulation system that can create and experience Virtual worlds, which uses computers to create a simulated environment, which is a system simulation of multi-source information-fused, interactive three-dimensional dynamic views and physical behaviors to immerse users in the environment.
At present, users generally display contents through computers, and cannot display contents in VR scenes.
Disclosure of Invention
To solve the problems of the prior art, at least one embodiment of the present invention provides a method and an apparatus for displaying content in a VR scene.
In a first aspect, an embodiment of the present invention discloses a method for displaying content in a VR scene, including:
detecting whether content to be displayed exists or not;
if the content to be displayed exists, acquiring the content to be displayed;
determining a first virtual object used for displaying the content to be displayed in the VR scene;
and displaying the content to be displayed on the first virtual object.
Optionally, the detecting whether the content to be displayed exists includes:
determining whether pre-stored content to be displayed exists or receiving collected content collected by data collection equipment;
if the pre-stored content to be displayed exists or the collected content collected by the data collecting equipment is received, determining that the content to be displayed exists;
otherwise, determining that the content to be displayed does not exist.
Optionally, the method further comprises:
after the content to be displayed is displayed on the first virtual object, acquiring the posture of VR interactive equipment;
determining, based on the gesture, a gesture in the VR scene that corresponds to the gesture;
judging whether the gesture is a preset disappearing control gesture for controlling the disappearing of the content to be displayed and displayed on the first virtual object;
and if the gesture is the preset disappearing control gesture, controlling the content to be displayed on the first virtual object to disappear.
Optionally, the method further comprises:
determining an alignment line in a VR scene corresponding to the alignment gesture;
and if the alignment line is aligned with a second virtual object after the first virtual object is aligned, controlling the content to be displayed to be transferred from the first virtual object to the second virtual object for display.
Optionally, the displaying the content to be displayed on the first virtual object includes:
directly displaying the content to be displayed on the first virtual object;
or drawing a curve based on the content to be displayed and displaying the curve;
or drawing an icon based on the content to be displayed and displaying the icon.
In a second aspect, an embodiment of the present invention further provides an apparatus for displaying content in a VR scene, including:
the detection module is used for detecting whether the content to be displayed exists or not;
the first acquisition module is used for acquiring the content to be displayed if the content to be displayed exists;
a first determination module, configured to determine a first virtual object in a VR scene for displaying the content to be displayed;
and the display module is used for displaying the content to be displayed on the first virtual object.
Optionally, the detecting is a module comprising:
the device comprises a first determining unit, a second determining unit and a display unit, wherein the first determining unit is used for determining whether pre-stored contents to be displayed exist or receiving collected contents collected by data collecting equipment;
the second determining unit is used for determining that the content to be displayed exists if the content to be displayed which is stored in advance exists or the acquired content acquired by the data acquisition equipment is received; otherwise, determining that the content to be displayed does not exist.
Optionally, the apparatus further comprises:
the second acquisition module is used for acquiring the posture of the VR interactive equipment after the content to be displayed is displayed on the first virtual object;
a second determination module to determine, based on the gesture, a gesture in the VR scene that corresponds to the gesture;
the judging module is used for judging whether the gesture is a preset disappearance control gesture used for controlling disappearance of the content to be displayed and displayed on the first virtual object;
and the first control module is used for controlling the content to be displayed on the first virtual object to disappear if the gesture is the preset disappearance control gesture.
Optionally, the apparatus further comprises:
a third determination module to determine an alignment line in a VR scene that corresponds to the alignment gesture;
and the second control module is used for controlling the content to be displayed to be transferred from the first virtual object to the second virtual object for display if the alignment line is aligned with the second virtual object after being aligned with the first virtual object.
Optionally, the display module is further configured to:
directly displaying the content to be displayed on the first virtual object;
or drawing a curve based on the content to be displayed and displaying the curve;
or drawing an icon based on the content to be displayed and displaying the icon.
Therefore, the method and the device for displaying the data content can display the content to be displayed on the first virtual object of the VR scene, realize visualization of the data content, and facilitate a user to acquire the required data content in the VR scene.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.
Fig. 1 is a flowchart of a method for displaying content in a VR scene according to an embodiment of the present invention;
fig. 2 is an actual view of an actual application scenario provided by the embodiment of the present invention;
fig. 3 is an actual diagram of another actual application scenario provided by the embodiment of the present invention;
fig. 4 is an actual diagram of another actual application scenario provided by the embodiment of the present invention;
fig. 5 is an actual diagram of another actual application scenario provided by the embodiment of the present invention;
fig. 6 is a block diagram of an apparatus for displaying content in a VR scene according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
At present, users generally display contents through computers, and the display of the contents in VR scenes cannot be realized. To this end, in one embodiment of the present invention, a method and an apparatus for displaying content in a VR scene are provided, and the method may be applied to a processing device, for example: a computer or the like, the processing device being communicatively connected to the VR interaction device, and the VR interaction device may be provided with an inertial sensor, a position sensor, and the like, as shown in fig. 1 and 2, the method includes:
step S101, detecting whether contents to be displayed exist or not;
in this step, in one embodiment of the present invention, the content to be displayed that needs to be displayed at a certain display time may be stored in the storage space of the processing device, and when the display time comes, it is determined that the content to be displayed exists.
In another embodiment of the present invention, it may be determined whether acquisition content acquired by a data acquisition device is received; if the pre-stored content to be displayed exists or the collected content collected by the data collecting equipment is received, determining that the content to be displayed exists; otherwise, determining that the content to be displayed does not exist.
Step S102, if the content to be displayed exists, acquiring the content to be displayed;
step S103, determining a first virtual object used for displaying the content to be displayed in the VR scene;
in the embodiment of the invention, the user can specify the first virtual object through the VR interaction device, or can preset the first virtual object through a program.
And step S104, displaying the content to be displayed on the first virtual object.
In this step, the content to be displayed may be directly displayed on the first virtual object; or drawing a curve based on the content to be displayed and displaying the curve; or drawing a chart based on the content to be displayed and displaying the chart.
According to the embodiment of the invention, the content to be displayed can be displayed on the first virtual object of the VR scene, the data content is visualized, and a user can conveniently acquire the required data content in the VR scene.
In yet another embodiment of the present invention, as shown in fig. 3, the method further comprises:
after the content to be displayed is displayed on the first virtual object, acquiring the posture of VR interactive equipment;
in the embodiment of the present invention, the VR interaction device may refer to a motion capture glove, and the like, the motion capture glove may be worn on a hand of a user, and when the motion capture glove acquires a gesture of the hand of the user in a real scene, information including the gesture is sent to the processing device, so that the processing device acquires the gesture of the first motion capture glove.
For example, the first gesture may refer to a gesture of a user's hand, such as: open five fingers, grasp a fist, pinch the thumb and forefinger or pinch the thumb and middle finger, etc.
Determining, based on the gesture, a gesture in the VR scene that corresponds to the gesture;
in this step, a gesture matching the gesture is generated in the VR scene, and for example, the gesture may be the same as the gesture; the corresponding positions in a plurality of important positions and the first gesture can be the same, other non-important positions are similar to the gestures, and the important positions can refer to key points of preset hand gesture collection positions, such as fingertips, palm centers and the like.
Judging whether the gesture is a preset disappearing control gesture for controlling the disappearing of the content to be displayed and displayed on the first virtual object;
for example, the preset disappearing control gesture may be a five-finger opening gesture, a fist making gesture, or the like, in this step, the gesture may be compared with the preset disappearing control gesture, and if the similarity between the two gestures is greater than a preset similarity threshold, the gesture may be determined to be the preset disappearing control gesture.
And if the gesture is the preset disappearing control gesture, controlling the content to be displayed on the first virtual object to disappear.
According to the embodiment of the invention, the real content to be displayed on the first virtual object can be controlled to disappear according to the posture of the VR interactive device, and the content to be displayed can not be displayed on the first virtual object any longer through interaction with the VR scene when the user does not need to continuously display the content to be displayed by the first virtual object.
In a further embodiment of the present invention, as shown in fig. 4 and 5, the method further comprises:
determining an alignment line in a VR scene corresponding to the alignment gesture;
to facilitate alignment, a straight line perpendicular to the palm in the alignment gesture may be determined as an alignment line; or, for more accuracy in alignment, an extension line of the wrist in the alignment gesture may be determined as an alignment line; or, in order to reduce the angle of wrist lifting in the alignment process, a line connecting the center of the palm and the centers of circles formed by three preset finger tips in the alignment gesture can be determined as the alignment line.
And if the alignment line is aligned with a second virtual object after the first virtual object is aligned, controlling the content to be displayed to be transferred from the first virtual object to the second virtual object for display.
In this step, firstly, the user may make the alignment line pass through the first virtual object in the VR scene, and after the hand gesture of the user changes, the alignment line determined according to the gesture corresponding to the gesture correspondingly passes through the second virtual object, so that it may be determined that the alignment line aligns with the second virtual object after aligning with the first virtual object. Furthermore, it may be considered that the user needs to transfer the content to be displayed on the first virtual object to the second virtual object for display, and therefore, the processing device controls the content to be displayed to be transferred from the first virtual object to the second virtual object for display.
In embodiments of the invention, the visible light emitting assembly on the motion capture glove can be controlled to emit visible light along the alignment line when the virtual object is aligned, the visible light forming a beam of light in its path of travel, which can facilitate determining whether the alignment line passes through the virtual object.
According to the embodiment of the invention, the content to be displayed, which needs to be displayed on the first virtual object by the user, can be transferred to the second virtual object to be displayed according to the change of the hand gesture of the user, so that the operation is simple, and the use by the user is convenient.
In still another embodiment of the present invention, there is also provided an apparatus for displaying content in a VR scene, as shown in fig. 6, including:
the detection module 11 is configured to detect whether content to be displayed exists;
a first obtaining module 12, configured to obtain a content to be displayed if the content exists;
a first determining module 13, configured to determine a first virtual object in a VR scene for displaying the content to be displayed;
a display module 14, configured to display the content to be displayed on the first virtual object.
In yet another embodiment of the present invention, the detecting is a module comprising:
the device comprises a first determining unit, a second determining unit and a display unit, wherein the first determining unit is used for determining whether pre-stored contents to be displayed exist or receiving collected contents collected by data collecting equipment;
the second determining unit is used for determining that the content to be displayed exists if the content to be displayed which is stored in advance exists or the acquired content acquired by the data acquisition equipment is received; otherwise, determining that the content to be displayed does not exist.
In yet another embodiment of the present invention, the apparatus further comprises:
the second acquisition module is used for acquiring the posture of the VR interactive equipment after the content to be displayed is displayed on the first virtual object;
a second determination module to determine, based on the gesture, a gesture in the VR scene that corresponds to the gesture;
the judging module is used for judging whether the gesture is a preset disappearance control gesture used for controlling disappearance of the content to be displayed and displayed on the first virtual object;
and the first control module is used for controlling the content to be displayed on the first virtual object to disappear if the gesture is the preset disappearance control gesture.
In yet another embodiment of the present invention, the apparatus further comprises:
a third determination module to determine an alignment line in a VR scene that corresponds to the alignment gesture;
and the second control module is used for controlling the content to be displayed to be transferred from the first virtual object to the second virtual object for display if the alignment line is aligned with the second virtual object after being aligned with the first virtual object.
In another embodiment of the present invention, the display module is further configured to:
directly displaying the content to be displayed on the first virtual object;
or drawing a curve based on the content to be displayed and displaying the curve;
or drawing an icon based on the content to be displayed and displaying the icon.
The apparatus for displaying content in a VR scene disclosed in the foregoing embodiments can implement the process of the method for displaying content in a VR scene disclosed in the foregoing method embodiments, and details are not repeated here to avoid repetition.
It is to be understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or any combination thereof. For a hardware implementation, the Processing units may be implemented within one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, micro-controllers, microprocessors, other electronic units configured to perform the functions described herein, or a combination thereof.
For a software implementation, the techniques described herein may be implemented by means of units performing the functions described herein. The software codes may be stored in a memory and executed by a processor. The memory may be implemented within the processor or external to the processor.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or make a contribution to the prior art, or may be implemented in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
It is noted that, in this document, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (6)

1. A method of displaying content in a VR scene, comprising:
detecting whether content to be displayed exists or not;
if the content to be displayed exists, acquiring the content to be displayed;
determining a first virtual object used for displaying the content to be displayed in the VR scene;
displaying the content to be displayed on the first virtual object;
the method further comprises the following steps:
determining an alignment line in the VR scene corresponding to the alignment gesture;
if the alignment line is aligned with a second virtual object after the first virtual object is aligned with the alignment line, controlling the content to be displayed to be transferred from the first virtual object to the second virtual object for display;
the method further comprises the following steps:
after the content to be displayed is displayed on the first virtual object, acquiring the posture of VR interactive equipment;
determining, based on the gesture, a gesture in the VR scene that corresponds to the gesture;
judging whether the gesture is a preset disappearing control gesture for controlling the disappearing of the content to be displayed and displayed on the first virtual object;
and if the gesture is the preset disappearing control gesture, controlling the content to be displayed on the first virtual object to disappear.
2. The method of claim 1, wherein the detecting whether the content to be displayed exists comprises:
determining whether pre-stored content to be displayed exists or receiving collected content collected by data collection equipment;
if the pre-stored content to be displayed exists or the collected content collected by the data collecting equipment is received, determining that the content to be displayed exists;
otherwise, determining that the content to be displayed does not exist.
3. The method according to claim 1, wherein the displaying the content to be displayed on the first virtual object comprises:
directly displaying the content to be displayed on the first virtual object;
or drawing a curve based on the content to be displayed and displaying the curve;
or drawing an icon based on the content to be displayed and displaying the icon.
4. An apparatus for displaying content in a VR scene, comprising:
the detection module is used for detecting whether the content to be displayed exists or not;
the first acquisition module is used for acquiring the content to be displayed if the content to be displayed exists;
a first determination module, configured to determine a first virtual object in a VR scene for displaying the content to be displayed;
the display module is used for displaying the content to be displayed on the first virtual object;
the device further comprises:
a third determining module to determine an alignment line corresponding to the alignment gesture in the VR scene;
the second control module is used for controlling the content to be displayed to be transferred from the first virtual object to the second virtual object for display if the alignment line is aligned with the second virtual object after being aligned with the first virtual object;
the device further comprises:
the second acquisition module is used for acquiring the posture of the VR interactive equipment after the content to be displayed is displayed on the first virtual object;
a second determination module to determine, based on the gesture, a gesture in the VR scene that corresponds to the gesture;
the judging module is used for judging whether the gesture is a preset disappearance control gesture used for controlling disappearance of the content to be displayed and displayed on the first virtual object;
and the first control module is used for controlling the content to be displayed on the first virtual object to disappear if the gesture is the preset disappearance control gesture.
5. The apparatus of claim 4, wherein the detection module comprises:
the device comprises a first determining unit, a second determining unit and a display unit, wherein the first determining unit is used for determining whether pre-stored contents to be displayed exist or receiving collected contents collected by data collecting equipment;
the second determining unit is used for determining that the content to be displayed exists if the content to be displayed which is stored in advance exists or the acquired content acquired by the data acquisition equipment is received; otherwise, determining that the content to be displayed does not exist.
6. The apparatus of claim 4, wherein the display module is further configured to:
directly displaying the content to be displayed on the first virtual object;
or drawing a curve based on the content to be displayed and displaying the curve;
or drawing an icon based on the content to be displayed and displaying the icon.
CN201811641965.3A 2018-12-29 2018-12-29 Method and device for displaying content in VR scene Active CN109710075B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811641965.3A CN109710075B (en) 2018-12-29 2018-12-29 Method and device for displaying content in VR scene

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811641965.3A CN109710075B (en) 2018-12-29 2018-12-29 Method and device for displaying content in VR scene

Publications (2)

Publication Number Publication Date
CN109710075A CN109710075A (en) 2019-05-03
CN109710075B true CN109710075B (en) 2021-02-09

Family

ID=66260278

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811641965.3A Active CN109710075B (en) 2018-12-29 2018-12-29 Method and device for displaying content in VR scene

Country Status (1)

Country Link
CN (1) CN109710075B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107132917A (en) * 2017-04-25 2017-09-05 腾讯科技(深圳)有限公司 For the hand-type display methods and device in virtual reality scenario
CN107885316A (en) * 2016-09-29 2018-04-06 阿里巴巴集团控股有限公司 A kind of exchange method and device based on gesture
CN107967089A (en) * 2017-12-20 2018-04-27 浙江煮艺文化科技有限公司 A kind of virtual reality interface display methods
CN108434735A (en) * 2018-03-19 2018-08-24 腾讯科技(深圳)有限公司 Virtual objects display methods, device, electronic device and storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4286556B2 (en) * 2003-02-24 2009-07-01 株式会社東芝 Image display device
US11106273B2 (en) * 2015-10-30 2021-08-31 Ostendo Technologies, Inc. System and methods for on-body gestural interfaces and projection displays
CN107256087B (en) * 2017-06-13 2020-02-21 宁波美象信息科技有限公司 VR instantaneous shift control method
CN109002167B (en) * 2018-08-07 2021-04-20 浙江冰峰科技有限公司 Eyeball tracking simulation method and device and head-mounted display equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107885316A (en) * 2016-09-29 2018-04-06 阿里巴巴集团控股有限公司 A kind of exchange method and device based on gesture
CN107132917A (en) * 2017-04-25 2017-09-05 腾讯科技(深圳)有限公司 For the hand-type display methods and device in virtual reality scenario
CN107967089A (en) * 2017-12-20 2018-04-27 浙江煮艺文化科技有限公司 A kind of virtual reality interface display methods
CN108434735A (en) * 2018-03-19 2018-08-24 腾讯科技(深圳)有限公司 Virtual objects display methods, device, electronic device and storage medium

Also Published As

Publication number Publication date
CN109710075A (en) 2019-05-03

Similar Documents

Publication Publication Date Title
US11048333B2 (en) System and method for close-range movement tracking
Kim et al. Touch and hand gesture-based interactions for directly manipulating 3D virtual objects in mobile augmented reality
US10268279B2 (en) Detection of user gestures
Seo et al. Direct hand touchable interactions in augmented reality environments for natural and intuitive user experiences
US8902198B1 (en) Feature tracking for device input
KR101872426B1 (en) Depth-based user interface gesture control
EP3594790A1 (en) Using finger touch types to interact with electronic devices
EP2538305A2 (en) System and method for close-range movement tracking
Wilkinson et al. Expressy: Using a wrist-worn inertial measurement unit to add expressiveness to touch-based interactions
US20140022171A1 (en) System and method for controlling an external system using a remote device with a depth sensor
US9740398B2 (en) Detecting input based on multiple gestures
US11054896B1 (en) Displaying virtual interaction objects to a user on a reference plane
EP3100151A1 (en) Virtual mouse for a touch screen device
US20180074646A1 (en) Gesture recognition and control based on finger differentiation
JP6270495B2 (en) Information processing apparatus, information processing method, computer program, and storage medium
US20180067552A1 (en) Input device, system and method for finger touch interface
CN109710075B (en) Method and device for displaying content in VR scene
US10379639B2 (en) Single-hand, full-screen interaction on a mobile device
JP2016066254A (en) Electronic device with touch detection apparatus
JP7203436B2 (en) USER INTERFACE DEVICE, USER INTERFACE SYSTEM AND PROGRAM FOR USER INTERFACE
Chen et al. Unobtrusive touch‐free interaction on mobile devices in dirty working environments
JP6256545B2 (en) Information processing apparatus, control method and program thereof, and information processing system, control method and program thereof
WO2019039065A1 (en) Information processing device, information processing method, and program
Ranjith et al. IMPLEMENTING A REAL TIME VIRTUAL MOUSE SYSTEM USING COMPUTER VISION
KR20130099708A (en) Input apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant