WO2018006461A1

WO2018006461A1 - Virtual reality helmet capable of recognizing gesture and gesture recognition method therefor

Info

Publication number: WO2018006461A1
Application number: PCT/CN2016/093998
Authority: WO
Inventors: 胡治国; 李炜
Original assignee: 深圳市掌网科技股份有限公司
Priority date: 2016-07-07
Filing date: 2016-08-08
Publication date: 2018-01-11
Also published as: CN107589827A; CN107589827B

Abstract

Disclosed is a virtual reality helmet capable of recognizing a gesture, comprising: a helmet shell which is convenient for a user to wear; a sensing module having an infrared emitter for emitting infrared light so as to form an infrared inductive area and an infrared receiving array for receiving reflected infrared light and generating a corresponding signal; a signal processing unit electrically connected to the infrared emitter and the infrared receiving array respectively; and a driving mainboard electrically connected to the signal processing unit and used for sending a recognized manipulation command to a corresponding actuating mechanism. Also disclosed is a gesture recognition method for a virtual reality helmet capable of recognizing a gesture, comprising three steps: the initialization of a virtual reality helmet; the starting of an infrared gesture recognition mode; and a gesture control auxiliary function. A parameter of a virtual reality helmet is accurately and quickly adjusted by recognizing a gesture of a user when the user is wearing the helmet, thereby improving the user experience.

Description

Virtual reality helmet capable of recognizing gestures and gesture recognition method thereof

Technical field

The present invention relates to the field of virtual reality technologies, and in particular, to a virtual reality helmet, and more particularly to a virtual reality helmet capable of recognizing a gesture and a gesture recognition method thereof.

Background technique

Virtual reality technology is a computer simulation system that can create and experience a virtual world. It uses a computer to generate a simulation environment. It is a multi-source information fusion interactive system simulation of three-dimensional dynamic vision and physical behavior to immerse users in the system. Environment. With the advancement of virtual reality technology, many virtual reality devices have emerged, and virtual reality helmets are one of them.

Usually, in addition to the main components such as the screen and the eyepiece for displaying the left and right eye images, the virtual reality helmet usually has some small function keys with auxiliary functions, such as a volume adjustment button, a screen brightness adjustment button, or even A virtual reality helmet switch button with a higher-order drive that adjusts the screen refresh rate. In order to experience the best immersion when wearing a virtual reality helmet, the user needs to adjust the corresponding parameters through the above-mentioned small function buttons, and the user can hardly and accurately find the expected minute function button when wearing the virtual reality helmet. Therefore, the user usually has to remove the virtual reality helmet to find the expected small function button to adjust the corresponding parameters. Otherwise, the user may cause unintended consequences such as the end of the process due to misoperation, resulting in a bad user. Experience.

To this end, it is necessary to design a new virtual reality helmet to overcome the above problems.

Summary of the invention

The technical problem to be solved by the present invention is that in the prior art, the user usually has to remove the virtual reality helmet to find the expected micro function button to adjust the corresponding parameters. Otherwise, the user may end the process due to misoperation. The problem of undesired consequences, resulting in a poor user experience, provides a avatar-aware virtual reality helmet that allows the user to adjust parameters quickly and accurately while wearing the virtual reality helmet. The experience of the experience, thereby bringing a better user experience.

The technical solution adopted by the present invention to solve the problem is: a virtual reality helmet capable of recognizing a gesture, comprising: a helmet shell, a sensing module, a signal processing unit and a driving main board; wherein the sensing module comprises an infrared light for emitting An infrared emitter forming an infrared sensing area in front of the outer side of the helmet shell; and an infrared receiving array mounted on the helmet shell for receiving infrared light reflected by a human gesture and generating a corresponding signal; the signal processing unit A gesture signal template unit is included, a matching unit that compares the infrared receiving array signal from the gesture signal template unit signal, and a control unit that generates a corresponding control signal according to the matching unit output signal to the driving main board.

In the avatar-aware virtual reality helmet of the present invention, the infrared receiving array is composed of not less than three infrared signal receiving units, and the infrared emitter is located at an intermediate position of the infrared receiving array.

In the avatar-aware virtual reality helmet of the present invention, the infrared signal receiving unit includes an infrared sensing device.

In the avatar-aware virtual reality helmet of the present invention, the gesture signal template unit pre-stores a correspondence between a plurality of gesture sensing signals and a virtual reality helmet manipulation signal.

In the avatar-aware virtual reality helmet of the present invention, the virtual reality helmet control letter The number includes at least four of play, stop, previous, next, fast forward, fast reverse, volume up, volume down, brightness increase, and brightness decrease.

In the avatar-aware virtual reality helmet of the present invention, the method further includes: a sensing unit electrically connected to the signal processing unit for sensing whether the gesture control mode is currently entered, when the gesture control mode is sensed, The signal processing unit controls the infrared emitter and the infrared receiving array unit to start operating.

In the avatar-aware virtual reality helmet of the present invention, the sensing unit is a touch button or other sensing device electrically connected to the signal processing unit.

The invention also provides a gesture recognition method for a virtual reality helmet, comprising the following steps:

S1, starting the driving main board, the infrared emitter starts to emit infrared rays to form an infrared sensing area in front of the outer side of the helmet shell;

S2. The operator performs a gesture in the infrared sensing area;

S3. The infrared receiving array receives the infrared light reflected by the gesture action, and detects the intensity and duration of the reflected infrared light. When the intensity of the infrared light received by the infrared receiving array is higher than a threshold, and the operator is When the gesture in the infrared sensing area pauses for more than a predetermined time, the infrared receiving array will send a signal higher than the threshold to the signal processing unit;

S4. The signal processing unit sends a signal to the driving main board to enter an infrared control state.

S5. The driving main board enters an infrared gesture recognition mode according to a preset program.

In the gesture recognition method of the virtual reality helmet according to claim 1 , before step S1, a step of gesture-defining the auxiliary function corresponding to the function control key of the virtual reality helmet is performed by the operator. Specifically include:

Pressing, by the operator, the function control button to trigger the signal processing unit to control the infrared emitter to emit infrared rays to form an infrared sensing area in front of the outer side of the helmet shell;

SB, the operator performs a gesture in the infrared sensing area;

The infrared receiving array receives the infrared light reflected by the gesture action and generates a corresponding gesture sensing signal;

The SD, the template unit of the signal processing unit receives the gesture sensing signal, and records the gesture sensing signal as an effective gesture sensing signal.

In the gesture recognition method of the virtual reality helmet of the present invention, the following steps are sequentially included after step S4:

S6. The operator performs a first recognition gesture in the infrared sensing area.

S7. The infrared receiving array receives infrared rays reflected by the first recognition gesture and generates a corresponding first gesture sensing signal.

S8. The matching unit of the signal processing unit receives the first gesture sensing signal and compares it with the effective gesture sensing signal in the gesture signal template unit, and determines whether the gesture signal template unit includes An effective gesture sensing signal that is consistent with the first gesture sensing signal. If yes, the control unit of the signal processing unit sends a first control signal to the driving motherboard, and if not, does not send;

S9. The driving main board receives the first control signal and then performs a corresponding auxiliary function.

The virtual reality helmet and the gesture recognition method thereof for implementing the gesture recognizing the present invention have the following beneficial effects: when the user wears the virtual reality helmet and is immersed in the virtual world created by the virtual reality helmet, if the user wants to The auxiliary function of the volume, brightness, progress or the screen rate of the realistic helmet is adjusted, and the virtual reality helmet is not required to be taken off, and the auxiliary function of the virtual reality helmet is quickly and accurately adjusted by the gesture directly, thereby It will not interrupt the user's experience process and bring a better experience to the user.

DRAWINGS

1 is a flow chart showing the overall steps of a gesture recognition method for a virtual reality helmet capable of recognizing a gesture according to a first embodiment of the present invention;

2 is a flow chart of specific steps of initializing a virtual reality helmet in a gesture recognition method of a virtual reality helmet capable of recognizing a gesture according to a first embodiment of the present invention;

3 is a flow chart of specific steps of opening an infrared gesture recognition mode in a gesture recognition method of a avatar-capable virtual reality helmet according to a first embodiment of the present invention;

4 is a flow chart of specific steps of a gesture control assisting function in a gesture recognition method of a virtual reality helmet capable of recognizing a gesture according to a first embodiment of the present invention;

FIG. 5 is a schematic diagram of an internal module of a virtual reality helmet capable of recognizing a gesture according to a first embodiment of the present invention.

detailed description

For a better understanding of the technical features, objects and effects of the present invention, the embodiments of the present invention are described in detail with reference to the accompanying drawings.

The first embodiment of the avatar-providing virtual reality helmet provided by the present invention comprises: a helmet shell substantially conforming to the shape of the glasses; and a plurality of function control keys (in this embodiment, a play function control key, a stop function control key, The previous function control button, the next function control button, the fast forward function control button, the fast reverse function control button, the volume up function control button, the volume down function control button, the brightness increase function control button, the brightness decrease function control button, and a function control button for adjusting a screen refresh rate is disposed outside the helmet shell; a driving main board is disposed in the helmet shell and is equipped with an operating system; and a signal processing unit passes through an interface on the driving board The driving main board forms a contact connection; a sensing module is located substantially in front of the inside of the helmet shell.

As shown in FIG. 5, the sensing module has an infrared emitter and an infrared receiving array. The infrared hair The emitter is for emitting infrared light, and when the infrared emitter emits infrared light, an infrared sensing area may be formed on the front outer side of the helmet shell. The infrared receiving array is configured to receive reflected infrared light and generate a corresponding signal, and the infrared receiving array is composed of 16 infrared signal receiving units (in other embodiments, the infrared receiving array may be 32 or 64 More or more infrared signal receiving units, the more the number of infrared signal receiving units, the better the effect of gesture recognition, of course, the occupied space also increases), 16 of the infrared signal receiving unit rules Arranged in a rectangular array (in other embodiments, may be a regular circle, diamond or ellipse), the infrared emitter being located at the geometric center of the infrared receiving array (in other embodiments, of course It can be offset from the geometric center of the infrared receiving array). The infrared emitter and the infrared signal receiving unit of the infrared receiving array are respectively connected to the signal processing unit through an interface.

As shown in FIG. 5, the signal processing unit has a gesture signal template unit, a matching unit, and a control unit. When the signal processing unit controls the infrared emitter to emit infrared light, an infrared sensing area is formed outside the front end of the helmet shell for the operator to perform a gesture in the infrared sensing area, and the infrared receiving array generates The signal is processed by the signal processing unit and a corresponding steering signal is generated. The gesture signal template unit stores in advance a correspondence between a plurality of gesture sensing signals and a virtual reality helmet manipulation signal. The matching unit is configured to compare the gesture sensing signal received by the information processor with a plurality of the effective gesture sensing signals in the gesture signal template unit, and issue corresponding signals according to different comparison results. The control unit generates a corresponding control signal according to the signal output by the matching unit to be delivered to the driving main board.

As shown in FIG. 1 , the present invention provides a gesture recognition method for a virtual reality helmet in a first embodiment, which can be divided into three steps: initialization of a virtual reality helmet, opening of an infrared gesture recognition mode, and gesture control auxiliary function.

First, the initialization of the virtual reality helmet:

When the virtual reality helmet is used, the virtual reality helmet is first initialized, that is, the operator performs a preliminary gesture-driven definition on the auxiliary function corresponding to the function control key of the virtual reality helmet. The preliminary gesture-driven definition means that the activation of the auxiliary function corresponding to a certain function control key is realized by the operator performing a gesture action in the infrared sensing area. As shown in FIG. 2, the following steps are specifically included:

The SA, the operator presses a function control button, and the signal processing unit controls the infrared emitter to emit infrared rays, thereby forming an infrared sensing area in front of the virtual reality helmet. The function control key may be a play function control key, a stop function control key, a previous function control key, a next function control key, a fast forward function control key, a fast reverse function control key, a volume increase function control key, a volume drop The function control button, the brightness increase function control button, the brightness decrease function control button, and any of the function control keys that can adjust the screen refresh rate. The range of the infrared sensing area is limited, and is generally within 30 cm in front of the infrared emitter.

SB, the operator performs a gesture in the infrared sensing area. The operator can do his or her favorite gestures according to his or her own preferences, such as clockwise circle, counterclockwise circle, left to right line, right to left line, top to bottom line or bottom to top. Dash and so on.

SC. The infrared receiving array receives the reflected infrared rays generated by the gesture action and generates a corresponding gesture sensing signal. When the operator performs a gesture in the infrared sensing area, infrared light is irradiated on the operator's hand and forms reflected infrared light, and the infrared signal receiving unit of the infrared receiving array senses that the gesture is reflected by the gesture The infrared light then generates a corresponding gesture-sensing signal. For example, when the gesture action of the operator in step SB is a line from left to right, the infrared receiving unit located on the left side of the infrared receiving array receives the reflected infrared light first, and the signal processing unit receives the level change. Then, the infrared receiving unit located on the right side of the infrared receiving array receives the reflected infrared light, the signal processing unit receives the level change, and the signal processing unit determines the direction of the gesture action from the left by the component calculation. Right and generate the corresponding gesture sensing signal.

SD, a gesture signal template unit of the signal processing unit receives the gesture sensing signal, and records the gesture sensing signal as an effective gesture sensing signal for a gesture sensing signal corresponding to the gesture action of the operator later. . The operator repeats the above steps to complete a preliminary gesture-driven definition of the plurality of function control keys, and the corresponding gesture signal template unit will include a plurality of valid gesture sensing signals. Thereby, the operator completes the preliminary gesture-driven definition of the function control key. For example, the operator can define the volume increase function corresponding to the function control key for adjusting the volume as the left-to-right gesture action according to the above steps ( Of course, it can also be driven by other more complicated gestures.

Second, the opening of the infrared gesture recognition mode:

After the operator completes the initialization of the virtual reality helmet, the infrared gesture recognition mode of the virtual reality helmet needs to be activated, as shown in FIG. 3, which specifically includes the following steps:

S2. The operator makes a gesture in the infrared sensing area and hover for a period of time;

S3. The infrared light is reflected on the operator's hand, the infrared receiving array receives the reflected infrared rays, and detects the intensity and duration of the reflected infrared rays, and the intensity of the infrared rays received by the infrared receiving array. Above a threshold (the threshold may be preset by an operator), and the operator pauses in the infrared sensing area for more than a preset time (the preset time is 1 s in this embodiment) The infrared receiving array will send a signal above the threshold to the signal processing unit.

S5. The driving main board enters an infrared gesture recognition mode according to a preset program; when the driving main board enters an infrared gesture recognition mode, the operator can drive the corresponding auxiliary function by using a gesture action.

Third, gesture control auxiliary function:

After the virtual reality helmet enters the sensing module, the operator can directly control the driving function by using the gesture action, and the immersive experience is interrupted without taking off the virtual reality helmet, and is directly utilized according to the needs in the immersed state. Pre-defined recognition gestures drive the corresponding auxiliary functions. As shown in FIG. 4, the following steps are specifically included:

S5. The operator makes a first recognition gesture in the infrared sensing area. The first recognition gesture may be an operator's gesture according to a gesture action when performing a preliminary gesture-driven definition, such as drawing a circle clockwise, drawing a circle counterclockwise, marking from left to right, and drawing from right to left. Line, from top to bottom or bottom to top.

S6. The infrared receiving array receives the reflected infrared rays generated by the first recognition gesture and generates a corresponding first gesture sensing signal. When the operator makes the first recognition gesture in the infrared sensing area, the infrared light is irradiated on the operator's hand and forms reflected infrared light, and the infrared signal receiving unit of the infrared receiving array senses the reflected infrared light. A corresponding first gesture sensing signal is then generated. For example, when the gesture of the operator is a line from left to right, the infrared receiving unit located on the left side of the infrared receiving array first receives the reflected infrared light, and the signal processing unit receives the level change, and then is located at the The infrared receiving unit on the right side of the infrared receiving array receives the reflected infrared light, the signal processing unit receives the level change, and the signal processing unit determines, by component calculation, that the gesture action direction is from left to right and generates a corresponding first gesture sensing signal. .

S7. The matching unit of the signal processing unit receives the first gesture sensing signal, and determines whether the gesture signal template unit includes an effective gesture sensing signal that is consistent with the first gesture sensing signal, and if yes, the The control unit of the signal processing unit sends a first control signal to the driving main board, and if not, does not transmit; when the signal processing unit receives the first gesture sensing signal through the input/output interface, the matching unit Extracting an effective gesture sensing signal in the gesture signal template unit and comparing the first gesture sensing signals one by one to determine the first gesture feeling Whether the signal should be consistent with one of the effective gesture sensing signals in the gesture signal template unit, that is, determining whether the gesture signal template unit includes an effective gesture sensing signal consistent with the first gesture sensing signal. If yes, the signal processing unit sends a first control signal corresponding to the effective gesture sensing signal corresponding to the first gesture sensing signal to the driving main board; if not, the first control signal is not sent. .

S8. The driving main board receives the first control signal and then performs a corresponding auxiliary function.

Specifically, when the operator defines the volume up function control key during the initial gesture driving definition process of the function control key, the gesture action is to draw a line from left to right (of course, it may also be a clockwise circle, reverse When the hour hand draws a circle, from right to left, from top to bottom, or from bottom to top, etc., if the first recognition gesture made by the operator in step S5 is also left to right, Then, the first gesture sensing signal generated by the infrared array in step S6 is matched with the effective gesture sensing signal of the corresponding volume increasing function in the gesture signal template unit, and the signal processing unit sends and increases the volume. The first control signal corresponding to the function is sent to the driving main board, and the driving main board receives the first control signal to perform a volume increasing function.

The second embodiment of the avatar-aware virtual reality helmet provided by the present invention is different from the virtual reality helmet in the first embodiment in that the virtual reality helmet is further provided with a sensing unit and the signal processing unit. Electrically connected, the sensing unit may be a touch button or other sensing device, and the sensing unit is configured to sense whether the virtual reality helmet is currently entering a sensing unit of the gesture control mode, when the entering the gesture manipulation mode is sensed The signal processing unit controls the infrared emitter and the infrared receiving array unit to start operating. Other identical structures will not be described again.

The difference between the gesture recognition method of the virtual reality helmet in the second embodiment and the gesture recognition method of the virtual reality helmet in the first embodiment is that the initialization unit of the virtual reality helmet needs to activate the sensing unit first, even if The sensing unit is configured to sense that the virtual reality helmet is currently entering In the gesture control mode, the signal processing unit controls the infrared emitter and the infrared receiving array unit to start working. In addition, if the operator performs the action of turning off and then turning on the virtual reality helmet after initialization, in the opening phase of the infrared gesture recognition mode, the operation needs to activate the sensing unit first, the signal processing unit The infrared emitter and the infrared receiving array unit are controlled to start working. Other identical steps will not be described again.

The method and system for implementing the brace design of the present invention has the following beneficial effects: when the user wears the virtual reality helmet and is immersed in the virtual world created by the virtual reality helmet, if the user wants to wear the virtual reality helmet Adjusting auxiliary functions such as volume, brightness, progress, or screen rate, without removing the virtual reality helmet, and directly and accurately adjusting the auxiliary function of the virtual reality helmet by gestures, thereby not hitting Break the user's experience process and bring a better experience to the user.

The embodiments of the present invention have been described above with reference to the drawings, but the present invention is not limited to the specific embodiments described above, and the specific embodiments described above are merely illustrative and not restrictive, and those skilled in the art In the light of the present invention, many forms may be made without departing from the scope of the invention and the scope of the invention.

Claims

A virtual reality helmet capable of recognizing a gesture, comprising: a helmet shell, a sensing module, a signal processing unit and a driving main board; wherein the sensing module comprises a front side for emitting infrared light outside the helmet shell An infrared emitter forming an infrared sensing region and an infrared receiving array mounted on the helmet housing for receiving infrared light reflected by a human gesture and generating a corresponding signal; the signal processing unit including a gesture signal template unit, a matching unit that compares the infrared receiving array signal with the gesture signal template unit signal and a corresponding control signal generated according to the matching unit output signal are sent to a control unit of the driving main board.
The avatar-aware virtual reality helmet of claim 1 wherein said infrared receiving array is comprised of no less than three infrared signal receiving units, said infrared emitters being located intermediate said infrared receiving array.
The avatar-aware virtual reality helmet of claim 2, wherein the infrared signal receiving unit comprises an infrared sensing device.
The avatar-capable virtual reality helmet according to claim 2, wherein the gesture signal template unit pre-stores a correspondence between the plurality of gesture sensing signals and the virtual reality helmet manipulation signal.
The avatar-aware virtual reality helmet according to claim 4, wherein the virtual reality helmet control signal comprises play, stop, previous, next, fast forward, fast reverse, volume increase, volume decrease, brightness Increase and decrease at least four of the brightness.
The avatar-aware virtual reality helmet of claim 4, further comprising a sensing unit electrically coupled to the signal processing unit for sensing whether to enter a gesture manipulation mode, when sensing an incoming gesture manipulation In the mode, the signal processing unit controls the infrared emitter to And the infrared receiving array unit starts working.
The avatar-aware virtual reality helmet of claim 6 wherein said sensing unit is a touch button or other sensing device electrically coupled to said signal processing unit.
A gesture recognition method for a virtual reality helmet according to claim 1, comprising the steps of:

S1, starting the driving main board, the infrared emitter starts to emit infrared rays to form an infrared sensing area in front of the outer side of the helmet shell;

S2. The operator performs a gesture in the infrared sensing area;

S3. The infrared receiving array receives the infrared light reflected by the gesture action, and detects the intensity and duration of the reflected infrared light. When the intensity of the infrared light received by the infrared receiving array is higher than a threshold, and the operator is When the gesture in the infrared sensing area pauses for more than a predetermined time, the infrared receiving array will send a signal higher than the threshold to the signal processing unit;

S4. The signal processing unit sends a signal to the driving main board to enter an infrared control state.

S5. The driving main board enters an infrared gesture recognition mode according to a preset program.
The gesture recognition method for a gesture-aware virtual reality helmet according to claim 8, wherein an operator performs a gesture-driven definition of an auxiliary function corresponding to a function control key of the virtual reality helmet before step S1. The steps specifically include:

Pressing, by the operator, the function control button to trigger the signal processing unit to control the infrared emitter to emit infrared rays to form an infrared sensing area in front of the outer side of the helmet shell;

SB, the operator performs a gesture in the infrared sensing area;

The infrared receiving array receives the infrared light reflected by the gesture action and generates a corresponding gesture sensing signal;

SD, the template unit of the signal processing unit receives the gesture sensing signal, and the gesture The sensing signal is recorded as a valid gesture sensing signal.
The gesture recognition method for a gesture-aware virtual reality helmet according to claim 9, wherein the following steps are sequentially included after step S4:

S6. The operator performs a first recognition gesture in the infrared sensing area.

S7. The infrared receiving array receives infrared rays reflected by the first recognition gesture and generates a corresponding first gesture sensing signal.

S8. The matching unit of the signal processing unit receives the first gesture sensing signal and compares it with the effective gesture sensing signal in the gesture signal template unit, and determines whether the gesture signal template unit includes An effective gesture sensing signal that is consistent with the first gesture sensing signal. If yes, the control unit of the signal processing unit sends a first control signal to the driving motherboard, and if not, does not send;

S9. The driving main board receives the first control signal and then performs a corresponding auxiliary function.