CN107272892B - Virtual touch system, method and device - Google Patents
Virtual touch system, method and device Download PDFInfo
- Publication number
- CN107272892B CN107272892B CN201710399191.7A CN201710399191A CN107272892B CN 107272892 B CN107272892 B CN 107272892B CN 201710399191 A CN201710399191 A CN 201710399191A CN 107272892 B CN107272892 B CN 107272892B
- Authority
- CN
- China
- Prior art keywords
- touch
- head
- mounted display
- motion track
- display device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention discloses a virtual touch system, a method and a device, wherein the virtual touch system comprises: wear display device and intelligent wrist strap, wherein, the intelligent wrist strap for acquire user's touch-control information to with touch-control information transmission to wear display device, be used for receiving touch-control information, and respond to the touch-control instruction that touch-control information corresponds. Because the depth camera does not need to be used, the cost of virtual touch is greatly reduced.
Description
Technical Field
The present invention relates to the field of virtual touch technologies, and in particular, to a virtual touch system, method and device.
Background
In recent years, display technologies such as virtual reality, augmented reality, and mixed reality have been rapidly developed, and display is often performed by a head-mounted display device. In order to facilitate the user to control the head-mounted display device, a virtual touch technology is developed.
In the existing virtual touch technology, a depth camera and object recognition are combined to realize virtual touch. Generally, a plurality of depth cameras are installed on the head-mounted display device, and the shooting ranges of the depth cameras are the virtual touch detectable ranges of the head-mounted display device. That is to say, after the user wears the head-mounted display device, the user may issue a touch gesture such as a click or a slide within the detectable range of the depth camera, the depth camera may capture the touch gesture of the user, and the head-mounted display device may recognize the touch instruction corresponding to the touch gesture, and then respond to the touch instruction.
However, the virtual touch method uses a plurality of depth cameras, so that the method has high power consumption and high cost for the head-mounted device.
Disclosure of Invention
The embodiment of the invention discloses a virtual touch system, a method and a device, which are used for reducing the virtual touch cost. The technical scheme is as follows:
an embodiment of the present invention provides a virtual touch system, where the system includes: a head-mounted display device and a smart wristband, wherein,
the intelligent wrist strap is used for acquiring touch information of a user and sending the touch information to the head-mounted display equipment;
and the head-mounted display equipment is used for receiving the touch information and responding to a touch instruction corresponding to the touch information.
Optionally, the smart wristband is specifically configured to acquire a motion speed, an acceleration, a vibration frequency, and a motion time of the smart wristband, determine a touch action according to the motion speed, the acceleration, the vibration frequency, and the motion time, and send action information of the touch action as the touch information to the head-mounted display device.
Optionally, the system further includes:
the sensing ring is used for transmitting electromagnetic waves and sending the transmission time sequence of the electromagnetic waves to the intelligent wrist strap;
the intelligent wrist strap is further used for receiving the electromagnetic waves through skin, receiving the transmitting time sequence through a wireless network, determining a motion track of the sensing ring according to the transmitting time sequence and the receiving time sequence for receiving the electromagnetic waves, and sending the motion track to the head-mounted display device as the touch information;
the head-mounted display equipment is further used for receiving the motion track, determining a touch instruction corresponding to the motion track according to the motion track and the current display content, and responding to the touch instruction.
Optionally, the smart wristband is further configured to record formation time of the motion trajectory, determine whether a touch gesture corresponding to the motion trajectory is valid according to the motion trajectory and the formation time, and if so, send the motion trajectory to the head-mounted display device as the touch information;
or the like, or, alternatively,
the intelligent wrist strap is further used for recording the forming time of the motion trail and sending the forming time to the head-mounted display equipment; the head-mounted display device is further configured to receive the forming time, judge whether a touch instruction corresponding to the motion trajectory is valid according to the forming time, and respond to the touch instruction if the touch instruction is valid.
The embodiment of the invention also provides a virtual touch method, which is applied to an intelligent wrist strap in a virtual touch system, wherein the virtual touch system comprises: the smart wristband and a head-mounted display device, the method comprising:
acquiring touch information of a user;
and sending the touch information to a head-mounted display device so that the head-mounted display device receives the touch information and responds to a touch instruction corresponding to the touch information.
Optionally, the method further includes:
receiving electromagnetic waves transmitted by a sensing ring through skin;
receiving the emission time sequence of the electromagnetic waves sent by the sensing ring through a wireless network;
determining the motion track of the sensing ring according to the transmitting time sequence and the receiving time sequence for receiving the electromagnetic waves;
sending the motion track as the touch information to the head-mounted display device, so that the head-mounted display device: and receiving the motion track, determining a touch instruction corresponding to the motion track according to the motion track and the current display content, and responding to the touch instruction.
Optionally, the step of sending the motion trajectory to the head-mounted display device as the touch information includes: recording the forming time of the motion trail; judging whether the touch control gesture corresponding to the motion track is effective or not according to the motion track and the forming time; and if so, sending the motion track as the touch information to the head-mounted display equipment.
Or the like, or, alternatively,
the motion track is sent to the head-mounted display device as the touch information, so that the head-mounted display device: receiving the motion track, determining a touch instruction corresponding to the motion track according to the motion track and the current display content, and responding to the touch instruction, wherein the step comprises the following steps: recording the forming time of the motion trail; sending the forming time and the motion track to the head-mounted display device as the touch information; to cause the head mounted display device to: receiving the motion track and the forming time, and determining a touch instruction corresponding to the motion track according to the motion track and the current display content; judging whether the touch instruction corresponding to the motion track is effective or not according to the forming time; and if so, responding to the touch instruction.
The embodiment of the present invention further provides a virtual touch device, which is applied to an intelligent wristband in a virtual touch system, wherein the virtual touch system includes: the smart wristband and head-mounted display device, the apparatus comprising:
the touch information acquisition module is used for acquiring touch information of a user;
and the touch information sending module is used for sending the touch information to the head-mounted display equipment so that the head-mounted display equipment receives the touch information and responds to a touch instruction corresponding to the touch information.
The embodiment of the invention also provides an intelligent wrist strap which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;
a memory for storing a computer program;
and the processor is used for realizing the steps of the method when executing the program stored in the memory.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements the above-mentioned method steps.
In the solution provided in the embodiment of the present invention, the virtual touch system includes: wear display device and intelligent wrist strap, wherein, the intelligent wrist strap is used for acquireing user's touch-control information to with touch-control information transmission to wear display device, wear display device and be used for receiving touch-control information, and respond to the touch-control instruction that touch-control information corresponds. Because the depth camera does not need to be used, the cost of virtual touch is greatly reduced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a virtual touch system according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of another virtual touch system based on the embodiment shown in FIG. 1;
fig. 3 is a flowchart of a virtual touch method according to an embodiment of the present invention;
FIG. 4 is a flowchart illustrating another virtual touch method according to the embodiment shown in FIG. 3;
FIG. 5 is a detailed flowchart of step S504 in the embodiment shown in FIG. 4;
fig. 6 is a schematic structural diagram of a virtual touch device according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an intelligent wristband according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In order to reduce the cost of virtual touch, embodiments of the present invention provide a virtual touch system, method, apparatus, smart wristband, and storage medium.
First, a virtual touch system according to an embodiment of the present invention will be described.
As shown in fig. 1, a virtual touch system provided in an embodiment of the present invention includes: a head mounted display device 110 and a smart wristband 120. The head-mounted display device 110 is a device worn on the head of the user for displaying virtual reality, augmented reality, mixed reality, and the like, and the smart wristband 120 is an electronic device worn on the wrist, the arm, and the like of the user.
Specifically, the smart wristband 120 is configured to obtain touch information of a user and send the touch information to the head-mounted display device 110, and the head-mounted display device 110 is configured to receive the touch information and respond to a touch instruction corresponding to the touch information. It is understood that when the user uses the head-mounted display device 110, in order to control the display content of the head-mounted display device 110, a touch gesture is issued, and then the smart wristband 120 acquires touch information corresponding to the touch gesture of the user. The smart wristband 120 establishes a communication connection with the head-mounted display device 110 to transmit data, and for convenience of use, the communication connection may be a wireless network connection, such as a WIFI connection, a WLAN connection, a bluetooth connection, and the like, which is not specifically limited herein.
For example, the smart wristband 120 is worn on an arm of a user, and the user may need to perform operations such as pause and fast forward while watching a video using the head-mounted display device 110, and the user may perform a virtual touch through the arm wearing the smart wristband 120, for example, may wave an arm, vibrate an arm, and so on. At this time, the movement of the arm drives the smart wristband 120 to move together, the smart wristband 120 can acquire the touch information corresponding to the virtual touch gesture of the user by detecting the movement information of the smart wristband 120, and then send the touch information to the head-mounted display device 110, and after receiving the touch information, the head-mounted display device 110 can respond to the touch instruction corresponding to the touch information. For example, if the touch instruction corresponding to the touch information is a fast forward instruction, the head-mounted display device 110 fast forwards the video being played to meet the user's requirement.
As can be seen, in the solution provided in the embodiment of the present invention, the virtual touch system includes: wear display device and intelligent wrist strap, intelligent wrist strap is used for acquireing user's touch-control information to with touch-control information transmission to wear display device, wear display device and be used for receiving touch-control information, and respond to the touch-control instruction that touch-control information corresponds. Because the depth camera does not need to be used, the cost of virtual touch is greatly reduced.
As an implementation manner of the embodiment of the present invention, the smart wristband 120 may be specifically configured to obtain a motion speed, an acceleration, a vibration frequency, and a motion time of the smart wristband, determine a touch action according to the motion speed, the acceleration, the vibration frequency, and the motion time, and send action information of the touch action as the touch information to the head-mounted display device 110.
In one embodiment, the smart wristband 120 may obtain its own motion speed and acceleration through an internally installed Inertial Measurement Unit (IMU). An IMU is a device that measures the three-axis attitude angles (or angular rates) and accelerations of an object, and generally, an IMU includes three single-axis accelerometers and three single-axis gyroscopes, the accelerometers detecting acceleration signals of the object in three independent axes of a carrier coordinate system, and the gyroscopes detecting angular velocity signals of the carrier relative to a navigation coordinate system, measuring the angular velocity and acceleration of the object in three-dimensional space, and calculating the attitude of the object from the angular velocity and acceleration of the object in three-dimensional space.
Meanwhile, the smart wristband 120 may record its own movement time and measure its own vibration frequency through a built-in acceleration sensor or other sensor with related functions. Furthermore, the smart wristband 120 may use the obtained motion speed, acceleration, vibration frequency, and motion time to calculate a corresponding touch action, such as a palm turning, a thumb and middle finger playing, a thumb and index finger playing, and the like. It should be noted that, in the present embodiment, a specific algorithm for calculating the touch action is not limited. Computational models that achieve the same or similar effect in the art can be incorporated under the overall solution of the present embodiment.
It should be noted that, since the smart wristband 120 is worn on the wrist, arm, or other part of the user, the movement of the part of the user wearing the smart wristband 120 drives the smart wristband 120 to move along with the movement, and the speed, the acceleration, the vibration frequency, and the movement time of the two parts are almost the same, so the speed, the acceleration, the vibration frequency, and the movement time of the smart wristband 120 reflect the movement state of the part of the user wearing the smart wristband 120, and the touch action determined by the above method is the touch action sent by the user.
Further, the smart wristband 120 may be configured to send motion information of the touch motion to the head-mounted display device 110 as touch information. The action information of the touch action may be preset identification information, keyword information, and the like corresponding to the touch action, for example, if the touch action is palm flipping, the action information may be a page turn.
It should be noted that, in order to enable the head-mounted display device 110 to accurately and quickly obtain the touch instruction, the head-mounted display device 110 may store the corresponding relationship between the motion information and the touch instruction in advance, so that after receiving the touch information, the head-mounted display device 110 may find the corresponding touch instruction, and then respond to the found touch instruction. Suppose the motion information of the touch motion is: if the preset touch instruction corresponding to the ring finger is: when the current interface is closed, the head-mounted display device 110 may respond to the touch command, that is, close the current interface, and complete the virtual touch.
Therefore, the intelligent wrist strap can obtain the self motion speed, acceleration, vibration frequency and motion time, determine the touch action accordingly, accurately determine the touch action in a weak environment light or even in a dark state, and ensure that the head-mounted display device correctly responds to the touch instruction of the user.
As an implementation manner of the embodiment of the present invention, as shown in fig. 2, the system may further include: the sensing ring 130 is used for emitting electromagnetic waves and sending the emission time sequence of the electromagnetic waves to the smart wristband 120. The sensing ring 130 is generally worn on a finger of a user, so that a touch gesture of the finger of the user can be obtained conveniently.
In practical applications, the sensing ring 130 can emit electromagnetic waves through a biological waveguide device installed inside and capable of emitting electromagnetic waves, and the sensing ring 130 can be used for recording the emission time sequence of the electromagnetic waves while emitting the electromagnetic waves. It will be appreciated that since the transmission of electromagnetic waves is a continuous process, the transmission time is a time sequence comprising a plurality of transmission times.
Typically, the sensing ring 130 and the smart wristband 120 may establish a communication connection via a wireless network to transmit the transmission time sequence to the smart wristband 120 via the wireless network. The wireless network may be a WIFI, WLAN, bluetooth connection, etc., and is not specifically limited herein.
Correspondingly, the smart wristband 120 is further configured to receive the electromagnetic wave sent by the sensing ring 130 through the skin, receive the transmission time sequence through the wireless network, determine the motion trajectory of the sensing ring 130 according to the transmission time sequence and the reception time sequence of the received electromagnetic wave, and send the motion trajectory to the head-mounted display device 110 as touch information.
The smart wristband 120 may be configured to record a receiving time sequence of the received electromagnetic waves when receiving the electromagnetic waves sent by the sensing ring 130, so that the smart wristband 120 may calculate the position of the sensing ring 130 in the motion process according to the transmitting time sequence, the receiving time sequence, and the propagation rate of the electromagnetic waves in the skin, determine all positions of the sensing ring 130 in the motion process, and then determine the motion trajectory of the sensing ring 130, and it may be understood that the motion trajectory of the sensing ring 130 is the motion trajectory of the user for sending the touch gesture. The smart wristband 120 may further be configured to transmit the determined motion profile to the head mounted display device 110.
It should be noted that, in order to enable the smart wristband 120 to accurately determine the movement track of the sensing ring 130, the smart wristband 120 may receive the electromagnetic waves through a plurality of positions, so that the position of the sensing ring 130 at any time may be accurately determined according to the time difference between the electromagnetic waves propagating to the plurality of positions, and further, the movement track of the sensing ring 130 may be accurately determined.
It should be further noted that, in order to avoid the smart wristband 120 recognizing the motion trajectories of all touch gestures as one point, when the user wears the sensing ring 130 and the smart wristband 120, the user needs to wear the two positions with relative displacement, for example, the smart wristband 120 is worn on the wrist of one hand of the user, the sensing ring 130 may be worn on a finger of the other hand of the user, in this way, when the user uses the finger wearing the sensing ring 130 to perform handwriting or other touch gestures on the back of the hand or the arm of the hand wearing the smart wristband 120, the sensing ring 130 and the smart band 120 are displaced relative to each other, the receiving time sequence of the electromagnetic waves received by the smart band 120 is changed, and the smart band 120 can determine the motion trajectory of the sensing ring 130 according to the transmitting time sequence and the receiving time sequence of the electromagnetic waves.
The head-mounted display device 110 is further configured to receive the motion trajectory, determine a touch instruction corresponding to the motion trajectory according to the motion trajectory and the current display content, and respond to the touch instruction.
After the head-mounted display device 110 receives the motion track sent by the smart wristband 120, the head-mounted display device 110 may determine a touch instruction corresponding to the motion track according to the motion track and the current display content. For example, assuming that the currently displayed content of the head-mounted display device 110 is a WeChat message input interface, and the motion trajectory sent by the smart wristband 120 is a horizontal line from left to right, the head-mounted display device 110 may determine that the touch instruction corresponding to the motion trajectory is: inputting Chinese characters 'one'; assuming that the currently displayed content of the head-mounted display device 110 is a picture browsing interface, and the motion trajectory sent by the smart wristband 120 is a horizontal line from left to right, the head-mounted display device 110 may determine that the touch instruction corresponding to the motion trajectory is: and viewing the previous picture.
Therefore, through the matching of the sensing ring and the intelligent wrist strap, the virtual touch system provided by the embodiment of the invention can accurately identify the operations such as handwriting input of the user, the accuracy rate is obviously improved, the user operation is convenient, and the user experience is improved.
In order to ensure that the touch commands responded by the head-mounted display device 110 are correct touch commands and avoid false responses, in an embodiment, the smart wristband 120 may further be configured to record formation time of the motion track, determine whether a touch gesture corresponding to the motion track is valid according to the motion track and the formation time, and if so, send the motion track to the head-mounted display device 110 as touch information.
In some cases, the user may perform some misoperation, and in order to avoid the influence of the misoperation on the virtual touch, the smart wristband 120 may be configured to record the formation time of the motion trajectory, and determine whether the touch gesture corresponding to the motion trajectory is valid according to the motion trajectory and the formation time. In a possible case, the motion trajectory is an irregular messy trajectory and is not any chinese character, the motion trajectory is likely to be caused by a user misoperation, and at this time, the user does not actually send any touch instruction that needs to be executed by the head-mounted display device 110, so the smart wristband 120 may determine that the touch gesture corresponding to the motion trajectory is invalid, and then the motion trajectory is not sent to the head-mounted display device 110 as touch information.
In another possible case, the forming time of the motion trajectory is too long or too short, and the motion trajectory is not caused by the user's misoperation any longer within the preset time period, and at this time, the user does not actually send any touch instruction that needs to be executed by the head-mounted display device 110, so that the smart wristband 120 may determine that the touch gesture corresponding to the motion trajectory is invalid, and similarly, the motion trajectory will not be sent to the head-mounted display device 110 as touch information.
In another embodiment, the smart wristband 120 may also be configured to record the formation time of the motion trajectory and send the formation time to the head-mounted display device 110; the head-mounted display device 110 may be further configured to receive the forming time, determine whether a touch instruction corresponding to the motion trajectory is valid according to the forming time, and respond to the touch instruction if the touch instruction is valid.
That is to say, after recording the formation time of the motion trajectory, the smart wristband 120 may send the formation time to the head-mounted display device 110, and the head-mounted display device 110 determines whether the touch instruction corresponding to the motion trajectory is valid. The specific determination manner is the same as the manner in which the smart wristband 120 determines whether the touch gesture corresponding to the motion trajectory is valid, and reference may be specifically made to the description of the manner in which the smart wristband 120 determines whether the touch gesture corresponding to the motion trajectory is valid, which is not described herein again.
Corresponding to the above system embodiment, an embodiment of the present invention further provides a virtual touch method, and the following introduces a virtual touch method provided in an embodiment of the present invention.
As shown in fig. 3, a virtual touch method is applied to a smart wristband in a virtual touch system, where the virtual touch system includes: the intelligent wrist strap and the head-mounted display device are the devices which are worn on the head of a user and used for displaying virtual reality, reality augmentation, mixed reality and the like, and the intelligent wrist strap is the electronic device worn on the wrist, the arm and the like of the user. The method comprises the following steps:
s301, acquiring touch information of a user;
when the user wears the display device, in order to control the display content of the head-worn display device, a touch gesture is sent out, and then the smart wristband acquires touch information corresponding to the touch gesture of the user.
For example, the smart wristband may be worn on an arm of a user, and when the user watches videos using the head-mounted display device, the user may need to pause, fast forward, and the like, and at this time, the user may perform virtual touch control via the arm wearing the smart wristband, for example, the user may wave the arm, vibrate the arm, and the like, and the motion of the arm may drive the smart wristband to move together, and the smart wristband may acquire touch information corresponding to the virtual touch gesture of the user by detecting motion information of the smart wristband itself.
S302, sending the touch information to a head-mounted display device so that the head-mounted display device receives the touch information and responds to a touch instruction corresponding to the touch information.
It is understood that the smart wristband establishes a communication connection with the head-mounted display device to transmit data, and the communication connection is generally a wireless network connection, for example, a WIFI connection, a WLAN connection, a bluetooth connection, and the like, and is not limited specifically herein.
After the smart wristband acquires the touch information of the user, the smart wristband can send the touch information to the head-mounted display device, and the head-mounted display device can receive the touch information and respond to the touch instruction corresponding to the touch information.
For example, if the touch instruction corresponding to the touch information sent by the smart wristband is a fast forward instruction, the head-mounted display device performs fast forward processing on the video being played to meet the user's requirement.
Therefore, in the scheme provided by the embodiment of the invention, the intelligent wrist strap acquires the touch information of the user and sends the touch information to the head-mounted display device, and the head-mounted display device receives the touch information and responds to the touch instruction corresponding to the touch information. Because the depth camera does not need to be used, the cost of virtual touch is greatly reduced.
As an implementation manner of the embodiment of the present invention, the step of acquiring the touch information of the user may include:
acquiring self motion speed, acceleration, vibration frequency and motion time; and determining the touch action according to the motion speed, the acceleration, the vibration frequency and the motion time.
Because the smart wrist strap is worn on the wrist, the arm and other parts of a user, the movement of the part of the user wearing the smart wrist strap can drive the smart wrist strap to move along with the smart wrist strap, and the speed, the acceleration, the vibration frequency and the movement time of the smart wrist strap are almost the same, so when the user performs virtual touch control through the part wearing the smart wrist strap, the movement of the smart wrist strap reflects the touch gesture of the user, the smart wrist strap can record the movement time of the user, the movement speed and the acceleration of the user are acquired through the IMU installed inside, and the vibration frequency of the user is measured through the built-in acceleration sensor or other sensors with related functions.
After the smart wristband obtains the motion speed, the acceleration, the vibration frequency and the motion time of the smart wristband, corresponding touch actions, such as palm turning, thumb and middle finger cooperation for hitting a ringing finger, thumb and index finger cooperation for flicking a finger, and the like, can be calculated according to the motion speed, the acceleration, the vibration frequency and the motion time. It should be noted that, in the present embodiment, a specific algorithm for calculating the touch action is not limited. Computational models that achieve the same or similar effect in the art can be incorporated under the overall solution of the present embodiment.
As an implementation manner of the embodiment of the present invention, the step of sending the touch information to a head-mounted display device may include:
and sending the motion information of the touch action as the touch information to the head-mounted display equipment.
After the smart wristband determines the touch action, action information of the touch action can be sent to the head-mounted display device as touch information. The action information of the touch action may be preset identification information, keyword information, and the like corresponding to the touch action, for example, if the touch action is palm flipping, the action information may be a page turn.
It should be noted that, in order to enable the head-mounted display device to accurately and quickly obtain the touch instruction, the head-mounted display device may store the corresponding relationship between the motion information and the touch instruction in advance, so that after receiving the touch information, the head-mounted display device may find the corresponding touch instruction, and then respond to the found touch instruction. Suppose the motion information of the touch motion is: and if the preset touch instruction corresponding to the ring finger is: and closing the current interface, and then responding to the touch instruction by the head-mounted display equipment, namely closing the current interface to finish virtual touch.
Therefore, the intelligent wrist strap can obtain the self motion speed, acceleration, vibration frequency and motion time, determine the touch action accordingly, accurately determine the touch action in a weak environment light or even in a dark state, and ensure that the head-mounted display device correctly responds to the touch instruction of the user.
As an implementation manner of the embodiment of the present invention, as shown in fig. 4, the method may further include:
s401, receiving electromagnetic waves sent by a sensing ring through skin;
the virtual touch system can further comprise a sensing ring, and the sensing ring is generally worn on the finger of the user, so that the touch gesture of the finger of the user can be conveniently obtained. In practical application, the sensing ring can emit electromagnetic waves through a biological waveguide device which is arranged inside and can emit the electromagnetic waves. The intelligent wrist strap can receive the electromagnetic waves sent by the sensing ring through skin, and it needs to be explained that in order to enable the intelligent wrist strap to accurately determine the motion track of the sensing ring, the intelligent wrist strap can receive the electromagnetic waves through a plurality of positions, so that the position of the sensing ring at any moment can be accurately determined according to the time difference of the electromagnetic waves propagating to the plurality of positions, and the motion track of the sensing ring can be accurately determined.
S402, receiving the emission time sequence of the electromagnetic waves sent by the sensing ring through a wireless network;
the sensing ring can record the emission time sequence of the electromagnetic waves while emitting the electromagnetic waves, and sends the emission time sequence of the electromagnetic waves to the intelligent wrist strap. It will be appreciated that since the transmission of electromagnetic waves is a continuous process, the transmission time is a time sequence comprising a plurality of transmission times. Generally, the sensing ring and the smart wristband can establish communication connection through a wireless network, so that the transmission time sequence is sent to the smart wristband through the wireless network. The wireless network may be a WIFI, WLAN, bluetooth connection, etc., and is not specifically limited herein.
S403, determining the motion track of the sensing ring according to the transmitting time sequence and the receiving time sequence for receiving the electromagnetic waves;
when receiving the electromagnetic waves sent by the sensing ring, the intelligent wrist strap can record a receiving time sequence for receiving the electromagnetic waves, so that the intelligent wrist strap can calculate the position of the sensing ring in the motion process according to the transmitting time sequence, the receiving time sequence and the propagation rate of the electromagnetic waves in the skin, and the motion track of the sensing ring is determined at all positions of the sensing ring in the motion process. It can be understood that the motion trajectory of the sensing ring is the motion trajectory of the user sending the touch gesture.
It should be noted that, in order to avoid that the smart wristband recognizes the motion trajectories of all the touch gestures as one point, when the user wears the sensing ring and the smart wristband, the sensing ring and the smart wristband need to be worn at two positions with relative displacement, for example, when the smart wristband is worn on the wrist of one hand of the user, the sensing ring can be worn on a certain finger of the other hand of the user, so that when the user uses the finger wearing the sensing ring to perform handwriting or other touch gestures on the back of the hand, the arm, or the like of the hand wearing the smart wristband, the sensing ring and the smart wristband have relative displacement, the receiving time sequence of the electromagnetic waves received by the smart wristband is changed, and the smart wristband can determine the motion trajectories of the sensing ring according to the transmitting time sequence and the receiving time sequence of the electromagnetic waves.
S404, the motion track is used as the touch information and sent to the head-mounted display device, so that the head-mounted display device receives the motion track, determines a touch instruction corresponding to the motion track according to the motion track and the current display content, and responds to the touch instruction.
Furthermore, after the smart wristband determines the motion track of the sensing ring, the motion track can be sent to the head-mounted display device. After the head-mounted display device receives the motion track sent by the intelligent wrist strap, the head-mounted display device can determine the touch instruction corresponding to the motion track according to the motion track and the current display content.
For example, if the current display content of the head-mounted display device is a WeChat message input interface, and the motion trajectory sent by the smart wristband is a horizontal line from left to right, the head-mounted display device may determine that the touch instruction corresponding to the motion trajectory is: inputting Chinese characters 'one'; assuming that the current display content of the head-mounted display device is a picture browsing interface, and the motion trajectory sent by the smart wristband is a horizontal line from left to right, the head-mounted display device may determine that the touch instruction corresponding to the motion trajectory is: and viewing the previous picture.
Therefore, through the matching of the sensing ring and the intelligent wrist strap, the virtual touch system provided by the embodiment of the invention can accurately identify the operations such as handwriting input of the user, the accuracy rate is obviously improved, the user operation is convenient, and the user experience is improved.
In order to ensure that the touch commands responded by the head-mounted display device are all correct touch commands and avoid erroneous responses, in an embodiment, as shown in fig. 5, the step of sending the motion trajectory to the head-mounted display device as the touch information may include:
s501, recording the forming time of the motion trail;
in some cases, a user may perform some misoperation, and in order to avoid the influence of the misoperation on virtual touch, the smart wristband may record the formation time of the motion trajectory of the sensing ring when receiving the electromagnetic waves transmitted by the sensing ring, so that a subsequent process may determine whether the touch gesture corresponding to the motion trajectory is valid according to the formation time of the motion trajectory.
S502, judging whether the touch gesture corresponding to the motion track is effective or not according to the motion track and the forming time, and if so, executing the step S503; if not, no operation is carried out;
in a possible case, the motion trajectory is an irregular messy trajectory and is not any Chinese character, the motion trajectory is likely to be caused by misoperation of the user, at this time, the user does not actually send any touch instruction which needs to be executed by the head-mounted display device, and then the smart wristband can determine that the touch gesture corresponding to the motion trajectory is invalid, and then no operation can be performed.
In another possible case, the forming time of the motion trajectory is too long or too short, and the motion trajectory is probably caused by the misoperation of the user no longer within the preset time period, and at this time, the user does not actually send any touch instruction which needs to be executed by the head-mounted display device, so that the smart wristband may determine that the touch gesture corresponding to the motion trajectory is invalid, and similarly, no operation may be performed.
In other cases, for example, when the motion trajectory is a chinese character or a regular graph and the motion time is within the preset time period, the smart wristband may determine that the touch gesture corresponding to the motion trajectory is valid, and continue to execute step S503.
And S503, sending the motion track as the touch information to the head-mounted display equipment.
After determining that the touch gesture corresponding to the motion track is valid, the smart wristband can send the motion track to the head-mounted display device as touch information, and after receiving the touch information, the head-mounted display device can determine a touch instruction corresponding to the motion track according to the motion track and the current display content, and then respond to the touch instruction.
In another embodiment, the step of sending the motion trajectory to the head-mounted display device as the touch information may include:
recording the forming time of the motion trail; and sending the forming time and the motion track to the head-mounted display equipment as the touch information.
That is to say, after recording the formation time of the motion trajectory, the smart wristband may send the formation time to the head-mounted display device, and the head-mounted display device determines whether the touch instruction corresponding to the motion trajectory is valid.
Correspondingly, the step of responding to the touch instruction by the head-mounted display device may include:
receiving the formation time; judging whether the touch instruction corresponding to the motion track is effective or not according to the forming time; and if so, responding to the touch instruction.
And the head-mounted display equipment receives the forming time sent by the intelligent wrist strap, and can judge whether the touch instruction corresponding to the motion track is effective according to the forming time, if so, the head-mounted display equipment responds to the touch instruction, and if not, no operation is performed.
Because the manner of judging whether the touch instruction corresponding to the motion trajectory is valid by the head-mounted display device is the same as the manner of judging whether the touch gesture corresponding to the motion trajectory is valid by the smart wristband, reference may be specifically made to the description of the manner of judging whether the touch gesture corresponding to the motion trajectory is valid by the smart wristband, which is not described herein again.
Corresponding to the above method embodiment, an embodiment of the present invention further provides a virtual touch device, and the following describes a virtual touch device provided in an embodiment of the present invention.
As shown in fig. 6, a virtual touch device is applied to a smart wristband in a virtual touch system, where the virtual touch system includes: the smart wristband and head-mounted display device, the apparatus comprising:
a touch information acquiring module 610, configured to acquire touch information of a user;
the touch information sending module 620 is configured to send the touch information to a head-mounted display device, so that the head-mounted display device receives the touch information and responds to a touch instruction corresponding to the touch information.
Therefore, in the scheme provided by the embodiment of the invention, the intelligent wrist strap acquires the touch information of the user and sends the touch information to the head-mounted display device, and the head-mounted display device receives the touch information and responds to the touch instruction corresponding to the touch information. Because the depth camera does not need to be used, the cost of virtual touch is greatly reduced.
As an implementation manner of the embodiment of the present invention, the touch information obtaining module 610 may include:
an information acquisition unit (not shown in fig. 6) for its own movement speed, acceleration, vibration frequency, and movement time;
a touch action determining unit (not shown in fig. 6) for determining a touch action according to the motion speed, the acceleration, the vibration frequency and the motion time;
the touch information sending module 620 may include:
a first touch information sending unit (not shown in fig. 6) configured to send motion information of the touch action as the touch information to the head-mounted display device.
As an implementation manner of the embodiment of the present invention, the apparatus may further include:
an electromagnetic wave receiving module (not shown in fig. 6) for receiving the electromagnetic wave transmitted by the sensing finger ring through the skin;
a time sequence receiving module (not shown in fig. 6) for receiving a transmission time sequence of the electromagnetic waves sent by the sensing ring through a wireless network;
a motion trajectory determination module (not shown in fig. 6) configured to determine a motion trajectory of the sensing ring according to the emission time sequence and the receiving time sequence for receiving the electromagnetic wave;
a motion trajectory sending module (not shown in fig. 6) configured to send the motion trajectory to the head-mounted display device as the touch information, so that the head-mounted display device receives the motion trajectory, determines a touch instruction corresponding to the motion trajectory according to the motion trajectory and the current display content, and responds to the touch instruction.
As an implementation manner of the embodiment of the present invention, the motion trajectory transmitting module may include:
a first formation time recording unit (not shown in fig. 6) for recording a formation time of the motion trajectory;
a touch gesture determination unit (not shown in fig. 6) configured to determine whether a touch gesture corresponding to the motion trajectory is valid according to the motion trajectory and the forming time;
a second touch information sending unit (not shown in fig. 6) configured to send the motion trajectory to the head-mounted display device as the touch information when the touch gesture is valid.
As an implementation manner of the embodiment of the present invention, the motion trajectory transmitting module may include:
a second formation time recording unit (not shown in fig. 6) for recording a formation time of the motion trajectory;
a forming time sending unit (not shown in fig. 6) configured to send the forming time and the motion trajectory to the head-mounted display device as the touch information, so that the head-mounted display device receives the forming time, and determines whether a touch instruction corresponding to the motion trajectory is valid according to the forming time, and if so, responds to the touch instruction.
The embodiment of the present invention further provides an intelligent wristband, as shown in fig. 7, including a processor 710, a communication interface 720, a memory 730 and a communication bus 740, where the processor 710, the communication interface 720 and the memory 730 complete mutual communication through the communication bus 740;
a memory 730 for storing a computer program;
the processor 710, when executing the program stored in the memory 730, implements the following steps:
acquiring touch information of a user;
and sending the touch information to a head-mounted display device so that the head-mounted display device receives the touch information and responds to a touch instruction corresponding to the touch information.
The step of acquiring the touch information of the user may include:
acquiring self motion speed, acceleration, vibration frequency and motion time;
determining a touch action according to the motion speed, the acceleration, the vibration frequency and the motion time;
the step of sending the touch information to the head-mounted display device may include:
and sending the motion information of the touch action as the touch information to the head-mounted display equipment.
Wherein, the method can also comprise:
receiving electromagnetic waves transmitted by a sensing ring through skin;
receiving the emission time sequence of the electromagnetic waves sent by the sensing ring through a wireless network;
determining the motion track of the sensing ring according to the transmitting time sequence and the receiving time sequence for receiving the electromagnetic waves;
and sending the motion track as the touch information to the head-mounted display equipment so that the head-mounted display equipment receives the motion track, determines a touch instruction corresponding to the motion track according to the motion track and the current display content, and responds to the touch instruction.
Wherein the step of sending the motion trajectory to the head-mounted display device as the touch information may include:
recording the forming time of the motion trail;
judging whether the touch control gesture corresponding to the motion track is effective or not according to the motion track and the forming time;
and if so, sending the motion track as the touch information to the head-mounted display equipment.
Wherein the step of sending the motion trajectory to the head-mounted display device as the touch information may include:
recording the forming time of the motion trail;
sending the forming time and the motion track to the head-mounted display device as the touch information;
the step of the head-mounted display device responding to the touch instruction comprises the following steps:
receiving the formation time;
judging whether the touch instruction corresponding to the motion track is effective or not according to the forming time;
and if so, responding to the touch instruction.
Therefore, in the scheme provided by the embodiment of the invention, the intelligent wrist strap acquires the touch information of the user and sends the touch information to the head-mounted display device, and the head-mounted display device receives the touch information and responds to the touch instruction corresponding to the touch information. Because the depth camera does not need to be used, the cost of virtual touch is greatly reduced.
The communication bus mentioned in the above smart wristband may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component.
An embodiment of the present invention further provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps:
acquiring touch information of a user;
and sending the touch information to a head-mounted display device so that the head-mounted display device receives the touch information and responds to a touch instruction corresponding to the touch information.
The step of acquiring the touch information of the user may include:
acquiring self motion speed, acceleration, vibration frequency and motion time;
determining a touch action according to the motion speed, the acceleration, the vibration frequency and the motion time;
the step of sending the touch information to the head-mounted display device may include:
and sending the motion information of the touch action as the touch information to the head-mounted display equipment.
Wherein, the method can also comprise:
receiving electromagnetic waves transmitted by a sensing ring through skin;
receiving the emission time sequence of the electromagnetic waves sent by the sensing ring through a wireless network;
determining the motion track of the sensing ring according to the transmitting time sequence and the receiving time sequence for receiving the electromagnetic waves;
and sending the motion track as the touch information to the head-mounted display equipment so that the head-mounted display equipment receives the motion track, determines a touch instruction corresponding to the motion track according to the motion track and the current display content, and responds to the touch instruction.
Wherein the step of sending the motion trajectory to the head-mounted display device as the touch information may include:
recording the forming time of the motion trail;
judging whether the touch control gesture corresponding to the motion track is effective or not according to the motion track and the forming time;
and if so, sending the motion track as the touch information to the head-mounted display equipment.
Wherein the step of sending the motion trajectory to the head-mounted display device as the touch information may include:
recording the forming time of the motion trail;
sending the forming time and the motion track to the head-mounted display device as the touch information;
the step of the head-mounted display device responding to the touch instruction comprises the following steps:
receiving the formation time;
judging whether the touch instruction corresponding to the motion track is effective or not according to the forming time;
and if so, responding to the touch instruction.
As can be seen, in the solution provided in the embodiment of the present invention, when the computer program is executed by the processor, the smart wristband acquires the touch information of the user and sends the touch information to the head-mounted display device, and the head-mounted display device receives the touch information and responds to the touch instruction corresponding to the touch information. Because the depth camera does not need to be used, the cost of virtual touch is greatly reduced.
For the device, smart wristband and storage medium embodiments, the description is relatively simple as they are substantially similar to the system and method embodiments, and reference may be made to some descriptions of the system and method embodiments for their relevance.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (8)
1. A virtual touch system, the system comprising: a head-mounted display device and a smart wristband, wherein,
the intelligent wrist strap is used for acquiring touch information of a user and sending the touch information to the head-mounted display equipment;
the head-mounted display equipment is used for receiving the touch information and responding to a touch instruction corresponding to the touch information;
the system further comprises:
the sensing ring is used for transmitting electromagnetic waves and sending the transmission time sequence of the electromagnetic waves to the intelligent wrist strap;
the intelligent wrist strap is further used for receiving the electromagnetic waves through skin, receiving the transmitting time sequence through a wireless network, determining a motion track of the sensing ring according to the transmitting time sequence and the receiving time sequence for receiving the electromagnetic waves, and sending the motion track to the head-mounted display device as the touch information;
the head-mounted display equipment is further used for receiving the motion track, determining a touch instruction corresponding to the motion track according to the motion track and the current display content, and responding to the touch instruction.
2. The system of claim 1,
the intelligent wrist strap is specifically used for acquiring the motion speed, the acceleration, the vibration frequency and the motion time of the intelligent wrist strap, determining a touch action according to the motion speed, the acceleration, the vibration frequency and the motion time, and sending action information of the touch action to the head-mounted display device as the touch information.
3. The system of claim 1,
the intelligent wrist strap is further used for recording the forming time of the motion track, judging whether the touch gesture corresponding to the motion track is effective according to the motion track and the forming time, and if so, sending the motion track to the head-mounted display device as the touch information;
or the like, or, alternatively,
the intelligent wrist strap is further used for recording the forming time of the motion trail and sending the forming time to the head-mounted display equipment; the head-mounted display device is further configured to receive the forming time, judge whether a touch instruction corresponding to the motion trajectory is valid according to the forming time, and respond to the touch instruction if the touch instruction is valid.
4. The virtual touch method is applied to a smart wristband in a virtual touch system, wherein the virtual touch system comprises: the smart wristband and a head-mounted display device, the method comprising:
acquiring touch information of a user;
sending the touch information to a head-mounted display device so that the head-mounted display device receives the touch information and responds to a touch instruction corresponding to the touch information;
the method further comprises the following steps:
receiving electromagnetic waves transmitted by a sensing ring through skin;
receiving the emission time sequence of the electromagnetic waves sent by the sensing ring through a wireless network;
determining the motion track of the sensing ring according to the transmitting time sequence and the receiving time sequence for receiving the electromagnetic waves;
sending the motion track as the touch information to the head-mounted display device, so that the head-mounted display device: and receiving the motion track, determining a touch instruction corresponding to the motion track according to the motion track and the current display content, and responding to the touch instruction.
5. The method of claim 4,
the step of sending the motion trajectory to the head-mounted display device as the touch information includes: recording the forming time of the motion trail; judging whether the touch control gesture corresponding to the motion track is effective or not according to the motion track and the forming time; if so, sending the motion track to the head-mounted display equipment as the touch information;
or the like, or, alternatively,
the motion track is sent to the head-mounted display device as the touch information, so that the head-mounted display device: receiving the motion track, determining a touch instruction corresponding to the motion track according to the motion track and the current display content, and responding to the touch instruction, wherein the step comprises the following steps: recording the forming time of the motion trail; sending the forming time and the motion track to the head-mounted display device as the touch information; to cause the head mounted display device to: receiving the motion track and the forming time, and determining a touch instruction corresponding to the motion track according to the motion track and the current display content; judging whether the touch instruction corresponding to the motion track is effective or not according to the forming time; and if so, responding to the touch instruction.
6. The virtual touch device is applied to a smart wristband in a virtual touch system, wherein the virtual touch system comprises: the smart wristband and head-mounted display device, the apparatus comprising:
the touch information acquisition module is used for acquiring touch information of a user;
the touch information sending module is used for sending the touch information to head-mounted display equipment so that the head-mounted display equipment receives the touch information and responds to a touch instruction corresponding to the touch information;
the electromagnetic wave receiving module is used for receiving the electromagnetic waves sent by the sensing finger ring through the skin;
the time sequence receiving module is used for receiving the transmitting time sequence of the electromagnetic waves sent by the sensing ring through a wireless network;
the motion track determining module is used for determining the motion track of the sensing ring according to the transmitting time sequence and the receiving time sequence for receiving the electromagnetic waves;
and the motion track sending module is used for sending the motion track serving as the touch information to the head-mounted display equipment so that the head-mounted display equipment receives the motion track, determines a touch instruction corresponding to the motion track according to the motion track and the current display content, and responds to the touch instruction.
7. The intelligent wristband is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are communicated with each other through the communication bus by the memory;
a memory for storing a computer program;
a processor for implementing the method steps of any of claims 4 to 5 when executing a program stored in the memory.
8. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of claims 4-5.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710399191.7A CN107272892B (en) | 2017-05-31 | 2017-05-31 | Virtual touch system, method and device |
| PCT/CN2018/088915 WO2018219279A1 (en) | 2017-05-31 | 2018-05-30 | Virtual touch system, method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710399191.7A CN107272892B (en) | 2017-05-31 | 2017-05-31 | Virtual touch system, method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107272892A CN107272892A (en) | 2017-10-20 |
| CN107272892B true CN107272892B (en) | 2019-12-20 |
Family
ID=60065006
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710399191.7A Active CN107272892B (en) | 2017-05-31 | 2017-05-31 | Virtual touch system, method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107272892B (en) |
| WO (1) | WO2018219279A1 (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107272892B (en) * | 2017-05-31 | 2019-12-20 | 北京一数科技有限公司 | Virtual touch system, method and device |
| CN111766936A (en) * | 2019-04-02 | 2020-10-13 | 广东虚拟现实科技有限公司 | Virtual content control method and device, terminal equipment and storage medium |
| CN110162262B (en) * | 2019-05-08 | 2022-02-25 | 安徽华米信息科技有限公司 | Display method and device, intelligent wearable device and storage medium |
| WO2021259176A1 (en) * | 2020-06-25 | 2021-12-30 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method, mobile device, head-mounted display, and system for estimating hand pose |
| CN114679612A (en) * | 2022-03-15 | 2022-06-28 | 辽宁科技大学 | Intelligent household system and control method thereof |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130135223A1 (en) * | 2009-12-13 | 2013-05-30 | Ringbow Ltd. | Finger-worn input devices and methods of use |
| CN204480231U (en) * | 2014-12-31 | 2015-07-15 | 青岛歌尔声学科技有限公司 | Wear display device and realization and wear display device and the mutual system of smart machine |
| CN105607743A (en) * | 2016-02-24 | 2016-05-25 | 北京小鸟看看科技有限公司 | System based on double sets of sensors, hand-held terminal and head mount display |
| CN105975058A (en) * | 2016-04-26 | 2016-09-28 | 上海与德通讯技术有限公司 | Control method and apparatus for virtual reality integrated machine |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20120105818A (en) * | 2011-03-16 | 2012-09-26 | 한국전자통신연구원 | Information input apparatus based events and method thereof |
| CN103927009B (en) * | 2014-04-16 | 2017-12-05 | 北京智谷睿拓技术服务有限公司 | Exchange method and system |
| CN107272892B (en) * | 2017-05-31 | 2019-12-20 | 北京一数科技有限公司 | Virtual touch system, method and device |
-
2017
- 2017-05-31 CN CN201710399191.7A patent/CN107272892B/en active Active
-
2018
- 2018-05-30 WO PCT/CN2018/088915 patent/WO2018219279A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130135223A1 (en) * | 2009-12-13 | 2013-05-30 | Ringbow Ltd. | Finger-worn input devices and methods of use |
| CN204480231U (en) * | 2014-12-31 | 2015-07-15 | 青岛歌尔声学科技有限公司 | Wear display device and realization and wear display device and the mutual system of smart machine |
| CN105607743A (en) * | 2016-02-24 | 2016-05-25 | 北京小鸟看看科技有限公司 | System based on double sets of sensors, hand-held terminal and head mount display |
| CN105975058A (en) * | 2016-04-26 | 2016-09-28 | 上海与德通讯技术有限公司 | Control method and apparatus for virtual reality integrated machine |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018219279A1 (en) | 2018-12-06 |
| CN107272892A (en) | 2017-10-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107272892B (en) | Virtual touch system, method and device | |
| US10534442B2 (en) | Method and wearable device for providing a virtual input interface | |
| CN105824431B (en) | Message input device and method | |
| US10353478B2 (en) | Hover touch input compensation in augmented and/or virtual reality | |
| US9235241B2 (en) | Anatomical gestures detection system using radio signals | |
| US9753545B2 (en) | Input device, input method, and storage medium | |
| JP2004280836A (en) | System for recognizing stroke of writing motion and recognition method thereof | |
| CN106527670A (en) | Hand gesture interaction device | |
| US20150015542A1 (en) | Control Method And Electronic Device | |
| CN102722240A (en) | Text information input system, handwriting input device and text information input method | |
| US10296096B2 (en) | Operation recognition device and operation recognition method | |
| KR101678292B1 (en) | METHOD, SYSTEM AND COMPUTER-READABLE RECORDING MEDIUM FOR CONTROLLING IoT(Internet of Things) DEVICE USING A WEARABLE DEVICE | |
| CN106527671A (en) | Method for spaced control of equipment | |
| US11029753B2 (en) | Human computer interaction system and human computer interaction method | |
| CN106527669A (en) | Interaction control system based on wireless signal | |
| CN106527672A (en) | Non-contact type character input method | |
| CN113641278A (en) | Control method, control device, electronic equipment and storage medium | |
| US20160291703A1 (en) | Operating system, wearable device, and operation method | |
| CN111142772A (en) | Content display method and wearable device | |
| CN115047966A (en) | Interaction method, electronic equipment and interaction system | |
| EP4310637A1 (en) | System and method for remotely controlling extended reality by virtual mouse | |
| US20230333664A1 (en) | Head-mounted display, tapping input signal generating method and non-transitory computer readable storage medium thereof | |
| CN116166120A (en) | Gesture recognition method and device, electronic equipment and storage medium | |
| US20140132510A1 (en) | Handheld Electronic Apparatus, Operating Method Thereof, and Non-Transitory Computer Readable Medium Thereof | |
| KR20220151328A (en) | Electronic device and control method of the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |