CN105867605A - Functional menu page-turning method and apparatus for virtual reality helmet, and helmet - Google Patents
Functional menu page-turning method and apparatus for virtual reality helmet, and helmet Download PDFInfo
- Publication number
- CN105867605A CN105867605A CN201510933755.1A CN201510933755A CN105867605A CN 105867605 A CN105867605 A CN 105867605A CN 201510933755 A CN201510933755 A CN 201510933755A CN 105867605 A CN105867605 A CN 105867605A
- Authority
- CN
- China
- Prior art keywords
- brightness value
- value
- eye
- difference
- function menu
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 230000004397 blinking Effects 0.000 abstract description 29
- 230000009471 action Effects 0.000 abstract description 4
- 210000001508 eye Anatomy 0.000 description 315
- 230000006870 function Effects 0.000 description 144
- 238000010586 diagram Methods 0.000 description 19
- 230000007246 mechanism Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 210000004556 brain Anatomy 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 210000000744 eyelid Anatomy 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000007789 sealing Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention provides a functional menu page-turning method and apparatus for a virtual reality helmet, and the helmet. The method comprises: acquiring a brightness value of a left eye and a brightness value of a right eye of a user; determining whether a difference exists between the brightness value of the left eye and the brightness value of the right eye; and if exists, starting a page-turning operation of a functional menu according to the difference. According to the functional menu page-turning method and apparatus for a virtual reality helmet, and the helmet, which are provided by the present invention, the brightness value of the left eye and the brightness value of the right eye are acquired, and the page-turning operation of the functional menu is determined according to a relationship about whether the brightness value of the left eye or the brightness value of the right eye is larger or smaller; and the functional menu page-turning method and apparatus for a virtual reality helmet, and the helmet require no manual operations, and the page-turning operation can be performed on the functional menu according to a blinking action of a person, thereby improving user experience.
Description
Technical Field
The invention relates to the technical field of virtual reality, in particular to a method and a device for turning a page of a function menu of a virtual reality helmet and the helmet.
Background
With the rapid development of Virtual Reality technology (VR), a head-mounted display, also called a Virtual Reality helmet, appears. By utilizing the virtual reality helmet, the vision and the hearing of people to the outside are sealed, and the user is guided to generate a feeling of the user in a virtual environment. The display principle is that the left and right eye screens respectively display images of the left and right eyes, and the human eyes generate stereoscopic impression in the brain after acquiring the information with the difference. The virtual reality helmet is used as a virtual reality display device, has the characteristics of small size and strong sealing property, and has wide application in military training, virtual driving, virtual cities and other projects.
When a function menu is turned over, the existing virtual reality helmet adopts a method that a handle is arranged outside the virtual reality helmet and is shaken when the page is required to be turned over, or a page turning button is arranged outside the virtual reality helmet and is pressed when the page is required to be turned over, or a camera is arranged outside the helmet and is used for turning over the page by a gesture recognition method. The handle is specially operated by one hand of a user in a mode of shaking the handle to turn pages, so that the use of both hands of the user is limited, and the handle is very inconvenient to carry; the button is arranged outside the virtual reality helmet, so that the user is required to click the button, and the head of the user is easy to be uncomfortable; by adopting the gesture recognition method, the camera needs to be started, the gesture of the user is continuously collected, the power consumption is high, and meanwhile, the camera is easily limited by the field range, and the recognition is not accurate enough.
Therefore, the method for turning the page of the function menu of the virtual reality helmet in the prior art has certain defects, so that the experience of a user is reduced.
Disclosure of Invention
The invention provides a method and a device for turning a page of a function menu of a virtual reality helmet and the helmet, aiming at overcoming certain defects of the method for turning the page of the function menu of the virtual reality helmet in the prior art, so as to reduce the technical problem of experience of a user.
The invention provides a function menu page turning method of a virtual reality helmet, which comprises the following steps:
collecting the brightness value of the left eye and the brightness value of the right eye of a user;
determining whether there is a difference between the brightness value of the left eye and the brightness value of the right eye;
and if so, starting page turning operation of the function menu according to the difference.
Further optionally, the determining whether there is a difference between the brightness value of the left eye and the brightness value of the right eye includes:
judging the numerical value magnitude relation between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, if the difference exists, starting the page turning operation of the function menu according to the difference, and the step includes:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, performing right page turning operation on the function menu;
and if the difference value of the brightness value of the right eye and the brightness value of the left eye is greater than a preset threshold value, performing left page turning operation on the function menu.
Further optionally, the determining whether there is a difference between the brightness value of the left eye and the brightness value of the right eye includes:
judging the numerical value magnitude relation between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, if the difference exists, starting the page turning operation of the function menu according to the difference, and the step includes:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, performing left page turning operation on the function menu;
and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, performing right page turning operation on the function menu.
Further optionally, the determining whether there is a difference between the brightness value of the left eye and the brightness value of the right eye includes:
judging the numerical value magnitude relation between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, if the difference exists, starting the page turning operation of the function menu according to the difference, and the step includes:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, page-up operation is carried out on the function menu;
and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, performing page-down operation on the function menu.
Further optionally, the determining whether there is a difference between the brightness value of the left eye and the brightness value of the right eye includes:
judging the numerical value magnitude relation between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, if the difference exists, starting the page turning operation of the function menu according to the difference, and the step includes:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, page-down operation is carried out on the function menu;
and if the difference value between the brightness value of the right eye and the brightness value of the left eye is greater than a preset threshold value, performing page up operation on the function menu.
The invention also provides a function menu page turning device of the virtual reality helmet, which comprises:
the acquisition module is used for acquiring the brightness value of the left eye and the brightness value of the right eye of the user;
a determining module, configured to determine whether there is a difference between the brightness value of the left eye and the brightness value of the right eye;
and the page turning module is used for starting page turning operation of the function menu according to the difference when the brightness value of the left eye and the brightness value of the right eye are different.
Further optionally, the determining module is specifically configured to:
judging the numerical value magnitude relation between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, the page turning module is specifically configured to:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, performing right page turning operation on the function menu;
and if the difference value of the brightness value of the right eye and the brightness value of the left eye is greater than a preset threshold value, performing left page turning operation on the function menu.
Further optionally, the determining module is specifically configured to:
judging the numerical value magnitude relation between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, the page turning module is specifically configured to:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, performing left page turning operation on the function menu;
and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, performing right page turning operation on the function menu.
Further optionally, the determining module is specifically configured to:
judging the numerical value magnitude relation between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, if the difference exists, starting the page turning operation of the function menu according to the difference, and the step includes:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, page-up operation is carried out on the function menu;
and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, performing page-down operation on the function menu.
Further optionally, the determining module is specifically configured to:
judging the numerical value magnitude relation between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, if the difference exists, starting the page turning operation of the function menu according to the difference, and the step includes:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, page-down operation is carried out on the function menu;
and if the difference value between the brightness value of the right eye and the brightness value of the left eye is greater than a preset threshold value, performing page up operation on the function menu.
The invention also provides a virtual reality helmet, which comprises lenses respectively arranged at the positions corresponding to the left eye and the right eye of a user, light sensors arranged at the positions corresponding to the inner canthus at the edges of the lenses, and any one of the devices.
According to the method and the device for turning the page of the function menu of the virtual reality helmet and the helmet, the page turning operation of the function menu is determined according to the magnitude relation of the brightness values of the left eye and the right eye by acquiring the brightness value of the left eye and the brightness value of the right eye of a user; according to the method and the device for turning the page of the function menu of the virtual reality helmet and the helmet, the user does not need to operate by hands, the function menu can be operated to turn the page according to the blinking action of the user, and the experience of the user is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a schematic diagram of a lens structure in a virtual reality helmet according to the present invention;
FIG. 2 is a schematic diagram of light transmission in a virtual reality helmet according to the present invention;
fig. 3 is a schematic diagram illustrating a first embodiment of a function menu page turning method of a virtual reality helmet according to the present invention;
fig. 4 is a schematic diagram illustrating a second embodiment of a function menu page turning method of a virtual reality helmet according to the present invention;
fig. 5 is a schematic diagram of a third embodiment of a function menu page turning method of a virtual reality helmet according to the present invention;
fig. 6 is a schematic diagram of a fourth embodiment of a function menu page turning method of a virtual reality helmet according to the present invention;
fig. 7 is a schematic diagram of a fifth embodiment of a function menu page turning method of a virtual reality helmet according to the present invention;
fig. 8 is a schematic diagram of a first embodiment of a function menu page flipping device of a virtual reality helmet according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic view of a lens structure in a virtual reality helmet according to the present invention, and as shown in fig. 1, a lens 12 is disposed between a human eye and a screen in a virtual reality helmet 11, at a position corresponding to the human eye. Accordingly, the number of the lenses 12 is two, corresponding to the left and right eyes of the user, respectively. Light ray sensors 13 are respectively provided at positions corresponding to the inner corners of the eyes at the edges of the two lenses 12.
Fig. 2 is a schematic diagram of light transmission in the virtual reality helmet of the present invention, as shown in fig. 2, when the screen 14 starts to work, light is emitted, and light is reflected by the left eye and the right eye of the user. Normally, both eyes are opened and closed at the same time, and the luminance values of both eyes may be approximately equal. When there is one eye closed and the other eye open, the light reflected by the two eyes is different, and the brightness collected by the light sensor 13 is also different. This is because the reflectance of the eyeball is higher than that of the eyelid, and the present invention has been made based on this principle, and specific embodiments are as follows.
Fig. 3 is a schematic view of a first embodiment of a page turning method for a function menu of a virtual reality helmet, as shown in fig. 3, the page turning method for a function menu of a virtual reality helmet of this embodiment may specifically include the following steps:
and S11, acquiring the brightness value of the left eye and the brightness value of the right eye of the user.
In practical application, when a user operates a function menu, the method for turning a page of a function menu of a virtual reality helmet sends a collection instruction to the light sensor shown in fig. 1 to collect a brightness value of a left eye and a brightness value of a right eye of the user.
S12, it is determined whether there is a difference between the brightness value of the left eye and the brightness value of the right eye.
In practical application, a screen of the virtual reality helmet emits light during operation, and human eyes receive the light emitted by the screen and reflect the light. Therefore, from the difference between the luminance values of the left and right eyes of the user acquired in step S11, it can be determined whether there is a blinking motion of the user.
And S13, if yes, starting page turning operation of the function menu according to the difference.
According to the function menu page turning method of the virtual reality helmet, after a user starts a function menu, a light collecting instruction is sent to the light sensor, when the brightness values of the left eye and the right eye collected by the light sensor are different, it can be known that the user blinks, and according to the brightness values, the eyes with smaller brightness values blink, so that the page turning operation of the function menu is started.
According to the method for turning the page of the function menu of the virtual reality helmet, the page turning operation of the function menu is determined according to the difference between the brightness values of the left eye and the right eye of a user by acquiring the brightness value of the left eye and the brightness value of the right eye of the user; according to the method and the device for turning the page of the function menu of the virtual reality helmet and the helmet, the user does not need to operate by hands, the function menu can be operated to turn the page according to the blinking action of the user, and the experience of the user is improved.
Fig. 4 is a schematic diagram of a second embodiment of the method for turning a page of a function menu of a virtual reality helmet according to the present invention, and the method for turning a page of a function menu of a virtual reality helmet according to the present embodiment further introduces the technical solution of the present invention in more detail on the basis of the first embodiment. As shown in fig. 4, the method for turning a page of a function menu of a virtual reality helmet in this embodiment may specifically include the following steps:
and S21, acquiring the brightness value of the left eye and the brightness value of the right eye of the user.
In practical applications, when the automatic page turning function of the function menu is turned on, the light sensor 13 shown in fig. 1 starts to acquire the brightness value of the left eye and the brightness value of the right eye of the user.
S22, determining the magnitude relationship between the left-eye luminance value and the right-eye luminance value.
In practical application, the function menu page turning method for the virtual reality helmet compares the brightness of the left eye with the brightness of the right eye, and if the brightness of the left eye and the brightness of the right eye have a numerical value relationship, it is determined that the user has a blinking motion. For example, the luminance value of the left eye and the luminance value of the right eye are subtracted from each other, the absolute value of the difference between the two is determined, and when the absolute value of the difference between the two is not 0, it is considered that the luminance values of the left eye and the right eye are different, and a blinking motion may occur in the user. And when the brightness value of the left eye minus the brightness value of the right eye is positive, determining that the brightness value of the left eye is greater than the brightness value of the right eye, and determining that the blinking motion of the user exists, or vice versa.
S23, if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, performing right page turning operation on the function menu; and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, performing left page turning operation on the function menu.
In practical applications, it is known from the common general knowledge that, since the light emitted from the screen may not be symmetrical and the sizes of the left eye and the right eye are not necessarily the same, the luminance values of the left eye and the right eye may not be completely equal even though the left eye and the right eye are opened or closed simultaneously, and therefore, it can be considered that a blinking motion exists when the difference between the luminance value of the left eye and the luminance value of the right eye is greater than a preset threshold. When the method is specifically implemented, the left eye blinking motion is set as the operation of turning pages of the function menu to the left, and the right eye blinking motion is set as the operation of turning pages of the function menu to the right. Subtracting the brightness value of the right eye from the brightness value of the left eye, subtracting the brightness value of the left eye from the brightness value of the right eye, and if the difference value between the brightness value of the left eye and the brightness value of the right eye is greater than a preset threshold value, performing right page turning operation on the function menu; and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, performing left page turning operation on the function menu.
Fig. 5 is a schematic diagram of a third embodiment of the method for turning a page of a function menu of a virtual reality helmet according to the present invention, and the method for turning a page of a function menu of a virtual reality helmet according to the present embodiment further introduces the technical solution of the present invention in more detail on the basis of the first embodiment. As shown in fig. 5, the method for turning a page of a function menu of a virtual reality helmet in this embodiment may specifically include the following steps:
and S31, acquiring the brightness value of the left eye and the brightness value of the right eye of the user.
In practical application, when a user operates a function menu, the method for turning a page of a function menu of a virtual reality helmet sends a collection instruction to the light sensor shown in fig. 1 to collect a brightness value of a left eye and a brightness value of a right eye of the user.
S32, judging the numerical value size relationship between the brightness value of the left eye and the brightness value of the right eye;
in practical application, the function menu page turning method for the virtual reality helmet compares the brightness of the left eye with the brightness of the right eye, and if the brightness of the left eye and the brightness of the right eye have a numerical value relationship, it is determined that the user has a blinking motion. For example, the luminance value of the left eye and the luminance value of the right eye are subtracted from each other, the absolute value of the difference between the two is determined, and when the absolute value of the difference between the two is not 0, it is considered that the luminance values of the left eye and the right eye are different, and a blinking motion may occur in the user. And when the brightness value of the left eye minus the brightness value of the right eye is positive, determining that the brightness value of the left eye is greater than the brightness value of the right eye, and determining that the blinking motion of the user exists, or vice versa.
S33, if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, performing left page turning operation on the function menu; and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than the preset threshold value, performing right page turning operation on the function menu.
In practical applications, it is known from the common general knowledge that, since the light emitted from the screen may not be symmetrical and the sizes of the left eye and the right eye are not necessarily the same, the luminance values of the left eye and the right eye may not be completely equal even though the left eye and the right eye are opened or closed simultaneously, and therefore, it can be considered that a blinking motion exists when the difference between the luminance value of the left eye and the luminance value of the right eye is greater than a preset threshold. When the method is specifically implemented, the left eye blinking motion is set as the operation of turning pages of the function menu to the left, and the right eye blinking motion is set as the operation of turning pages of the function menu to the right. Subtracting the brightness value of the right eye from the brightness value of the left eye, subtracting the brightness value of the left eye from the brightness value of the right eye, and performing left page turning operation on the function menu if the difference value between the brightness value of the left eye and the brightness value of the right eye is greater than a preset threshold value; and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than the preset threshold value, performing right page turning operation on the function menu.
Fig. 6 is a schematic diagram of a fourth embodiment of the method for turning a page of a function menu of a virtual reality helmet according to the present invention, and the method for turning a page of a function menu of a virtual reality helmet according to the present embodiment further introduces the technical solution of the present invention in more detail on the basis of the first embodiment. As shown in fig. 6, the method for turning a page of a function menu of a virtual reality helmet in this embodiment may specifically include the following steps:
and S41, acquiring the brightness value of the left eye and the brightness value of the right eye of the user.
In practical applications, when the automatic page turning function of the function menu is turned on, the light sensor 13 shown in fig. 1 starts to acquire the brightness value of the left eye and the brightness value of the right eye of the user.
S42, determining the magnitude relationship between the left-eye luminance value and the right-eye luminance value.
In practical application, the function menu page turning method for the virtual reality helmet compares the brightness of the left eye with the brightness of the right eye, and if the brightness of the left eye and the brightness of the right eye have a numerical value relationship, it is determined that the user has a blinking motion. For example, the luminance value of the left eye and the luminance value of the right eye are subtracted from each other, the absolute value of the difference between the two is determined, and when the absolute value of the difference between the two is not 0, it is considered that the luminance values of the left eye and the right eye are different, and a blinking motion may occur in the user. And when the brightness value of the left eye minus the brightness value of the right eye is positive, determining that the brightness value of the left eye is greater than the brightness value of the right eye, and determining that the blinking motion of the user exists, or vice versa.
S43, if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, page up operation is carried out on the function menu; and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, performing page-down operation on the function menu.
In practical applications, it is known from the common general knowledge that, since the light emitted from the screen may not be symmetrical and the sizes of the left eye and the right eye are not necessarily the same, the luminance values of the left eye and the right eye may not be completely equal even though the left eye and the right eye are opened or closed simultaneously, and therefore, it may be considered that a blinking motion exists when the difference between the luminance value of the left eye and the luminance value of the right eye is greater than a preset threshold. When the method is specifically implemented, according to personal habits of a user, the left eye blinking motion can be set as the operation of turning down pages of the function menu, and the right eye blinking motion can be set as the operation of turning up pages of the function menu. Subtracting the brightness value of the right eye from the brightness value of the left eye, subtracting the brightness value of the left eye from the brightness value of the right eye, and performing page up operation on the function menu if the difference value between the brightness value of the left eye and the brightness value of the right eye is greater than a preset threshold value; and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, performing page-down operation on the function menu.
Fig. 7 is a schematic diagram of a fifth embodiment of the method for turning a page of a function menu of a virtual reality helmet according to the present invention, and the method for turning a page of a function menu of a virtual reality helmet according to the present embodiment further introduces the technical solution of the present invention in more detail on the basis of the first embodiment. As shown in fig. 7, the method for turning a page of a function menu of a virtual reality helmet in this embodiment may specifically include the following steps:
and S51, acquiring the brightness value of the left eye and the brightness value of the right eye of the user.
In practical applications, when the automatic page turning function of the function menu is turned on, the light sensor 13 shown in fig. 1 starts to acquire the brightness value of the left eye and the brightness value of the right eye of the user.
S52, determining the magnitude relationship between the left-eye luminance value and the right-eye luminance value.
In practical application, the function menu page turning method for the virtual reality helmet compares the brightness of the left eye with the brightness of the right eye, and if the brightness of the left eye and the brightness of the right eye have a numerical value relationship, it is determined that the user has a blinking motion. For example, the luminance value of the left eye and the luminance value of the right eye are subtracted from each other, the absolute value of the difference between the two is determined, and when the absolute value of the difference between the two is not 0, it is considered that the luminance values of the left eye and the right eye are different, and a blinking motion may occur in the user. And when the brightness value of the left eye minus the brightness value of the right eye is positive, determining that the brightness value of the left eye is greater than the brightness value of the right eye, and determining that the blinking motion of the user exists, or vice versa.
S53, if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, performing page-down operation on the function menu; and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, page-up operation is carried out on the function menu.
In practical applications, it is known from the common general knowledge that, since the light emitted from the screen may not be symmetrical and the sizes of the left eye and the right eye are not necessarily the same, the luminance values of the left eye and the right eye may not be completely equal even though the left eye and the right eye are opened or closed simultaneously, and therefore, it may be considered that a blinking motion exists when the difference between the luminance value of the left eye and the luminance value of the right eye is greater than a preset threshold. When the method is specifically implemented, according to personal habits of a user, the left eye blinking motion can be set as page-up operation on the function menu, and the right eye blinking motion can be set as page-down operation on the function menu. Subtracting the brightness value of the right eye from the brightness value of the left eye, subtracting the brightness value of the left eye from the brightness value of the right eye, and if the difference value between the brightness value of the left eye and the brightness value of the right eye is greater than a preset threshold value, performing page-down operation on the function menu; and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, page-up operation is carried out on the function menu.
Fig. 8 is a schematic view of a first embodiment of a function menu page flipping device of a virtual reality helmet, and as shown in fig. 8, the function menu page flipping device of the virtual reality helmet of this embodiment may specifically include an acquisition module 15, a determination module 16, and a page flipping module 17.
Wherein,
the acquisition module 15 is configured to acquire a luminance value of a left eye and a luminance value of a right eye of a user;
a determining module 16, configured to determine whether there is a difference between the brightness value of the left eye and the brightness value of the right eye;
and the page turning module 17 is configured to start a page turning operation of the function menu according to the difference when the brightness value of the left eye and the brightness value of the right eye are different.
According to the function menu page turning device of the virtual reality helmet, page turning operation of a function menu is determined according to the difference between the brightness values of the left eye and the right eye of a user by collecting the brightness value of the left eye and the brightness value of the right eye of the user; according to the method and the device for turning the page of the function menu of the virtual reality helmet and the helmet, the user does not need to operate by hands, the function menu can be operated to turn the page according to the blinking action of the user, and the experience of the user is improved.
In order to illustrate the second embodiment of the function menu page-turning device of the virtual reality helmet, the technical solution of the present invention is further described in more detail based on the first embodiment shown in fig. 8. As shown in fig. 8, the function menu page-turning device of the virtual reality helmet of this embodiment may specifically include an acquisition module 15, a determination module 16, and a page-turning module 17.
Wherein,
the acquisition module 15 is configured to acquire a luminance value of a left eye and a luminance value of a right eye of a user;
a determining module 16, configured to determine whether there is a difference between the brightness value of the left eye and the brightness value of the right eye;
and the page turning module 17 is configured to start a page turning operation of the function menu according to the difference when the brightness value of the left eye and the brightness value of the right eye are different.
Further optionally, the determining module 16 is specifically configured to:
judging the numerical value size relationship between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, the page flipping module 13 is specifically configured to:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, performing right page turning operation on the function menu;
and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, performing left page turning operation on the function menu.
In the function menu page turning device of the virtual reality helmet of this embodiment, the operation of automatically turning the page of the function menu by using the module is the same as the implementation mechanism of the function menu page turning method of the virtual reality helmet in the embodiment shown in fig. 4, and reference may be made to the description of the embodiment shown in fig. 4 in detail, which is not described herein again.
A schematic diagram of a third embodiment of the function menu page turning device of the virtual reality helmet of the present invention is consistent with the schematic diagram of the embodiment shown in fig. 8, and referring to fig. 8 specifically, the function menu page turning device of the virtual reality helmet of the present embodiment further introduces the technical solution of the present invention in more detail on the basis of the first embodiment shown in fig. 8. The function menu page turning device of the virtual reality helmet in this embodiment may specifically include an acquisition module 15, a determination module 16, and a page turning module 17.
Wherein,
the acquisition module 15 is configured to acquire a luminance value of a left eye and a luminance value of a right eye of a user;
a determining module 16, configured to determine whether there is a difference between the brightness value of the left eye and the brightness value of the right eye;
and the page turning module 17 is configured to start a page turning operation of the function menu according to the difference when the brightness value of the left eye and the brightness value of the right eye are different.
Further optionally, the determining module 16 is specifically configured to:
judging the numerical value size relationship between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, the page flipping module 17 is specifically configured to:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, performing left page turning operation on the function menu;
and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than the preset threshold value, performing right page turning operation on the function menu.
In the function menu page turning device of the virtual reality helmet of this embodiment, the operation of automatically turning the page of the function menu by using the module is the same as the implementation mechanism of the function menu page turning method of the virtual reality helmet in the embodiment shown in fig. 5, and reference may be made to the description of the embodiment shown in fig. 5 in detail, which is not described herein again.
A schematic diagram of a fourth embodiment of the function menu page turning device of the virtual reality helmet of the present invention is consistent with the schematic diagram of the embodiment shown in fig. 8, and referring to fig. 8 specifically, the function menu page turning device of the virtual reality helmet of the present embodiment further introduces the technical solution of the present invention in more detail on the basis of the first embodiment shown in fig. 8. The function menu page turning device of the virtual reality helmet in this embodiment may specifically include an acquisition module 15, a determination module 16, and a page turning module 17.
The acquisition module 15 is configured to acquire a luminance value of a left eye and a luminance value of a right eye of a user;
a determining module 16, configured to determine whether there is a difference between the brightness value of the left eye and the brightness value of the right eye;
and the page turning module 17 is configured to start a page turning operation of the function menu according to the difference when the brightness value of the left eye and the brightness value of the right eye are different.
Further optionally, the determining module 16 is specifically configured to:
judging the numerical value size relationship between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, the page flipping module 17 is specifically configured to: if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, page-up operation is carried out on the function menu;
and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, performing page-down operation on the function menu.
In the function menu page turning device of the virtual reality helmet of this embodiment, the operation of automatically turning the page of the function menu by using the module is the same as the implementation mechanism of the function menu page turning method of the virtual reality helmet in the embodiment shown in fig. 6, and reference may be made to the description of the embodiment shown in fig. 6 in detail, which is not described herein again.
A schematic diagram of a fifth embodiment of the function menu page turning device of the virtual reality helmet of the present invention is consistent with the schematic diagram of the embodiment shown in fig. 8, and referring to fig. 8 specifically, the function menu page turning device of the virtual reality helmet of the present embodiment further introduces the technical solution of the present invention in more detail on the basis of the first embodiment shown in fig. 8. The function menu page turning device of the virtual reality helmet in this embodiment may specifically include an acquisition module 15, a determination module 16, and a page turning module 17.
The acquisition module 15 is configured to acquire a luminance value of a left eye and a luminance value of a right eye of a user;
a determining module 16, configured to determine whether there is a difference between the brightness value of the left eye and the brightness value of the right eye;
and the page turning module 17 is configured to start a page turning operation of the function menu according to the difference when the brightness value of the left eye and the brightness value of the right eye are different.
Further optionally, the determining module 16 is specifically configured to:
judging the numerical value size relationship between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, the page flipping module 17 is specifically configured to:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, page-down operation is carried out on the function menu;
and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, page-up operation is carried out on the function menu.
In the function menu page turning device of the virtual reality helmet of this embodiment, the operation of automatically turning the page of the function menu by using the module is the same as the implementation mechanism of the function menu page turning method of the virtual reality helmet in the embodiment shown in fig. 7, and reference may be made to the description of the embodiment shown in fig. 7 in detail, which is not described herein again.
The present invention also provides a virtual reality helmet including lenses respectively disposed at positions corresponding to left and right eyes of a user, light sensors disposed at positions corresponding to inner corners of eyes at edges of the lenses, and the devices of embodiments one to five as shown in fig. 8.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (11)
1. A method for turning a page of a function menu of a virtual reality helmet is characterized by comprising the following steps:
collecting the brightness value of the left eye and the brightness value of the right eye of a user;
determining whether there is a difference between the brightness value of the left eye and the brightness value of the right eye;
and if so, starting page turning operation of the function menu according to the difference.
2. The method of claim 1, wherein determining whether there is a difference between the left-eye luminance value and the right-eye luminance value comprises:
judging the numerical value magnitude relation between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, if the difference exists, starting the page turning operation of the function menu according to the difference, and the step includes:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, performing right page turning operation on the function menu;
and if the difference value of the brightness value of the right eye and the brightness value of the left eye is greater than a preset threshold value, performing left page turning operation on the function menu.
3. The method of claim 1, wherein determining whether there is a difference between the left-eye luminance value and the right-eye luminance value comprises:
judging the numerical value magnitude relation between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, if the difference exists, starting the page turning operation of the function menu according to the difference, and the step includes:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, performing left page turning operation on the function menu;
and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, performing right page turning operation on the function menu.
4. The method of claim 1, wherein determining whether there is a difference between the left-eye luminance value and the right-eye luminance value comprises:
judging the numerical value magnitude relation between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, if the difference exists, starting the page turning operation of the function menu according to the difference, and the step includes:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, page-up operation is carried out on the function menu;
and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, performing page-down operation on the function menu.
5. The method of claim 1, wherein determining whether there is a difference between the left-eye luminance value and the right-eye luminance value comprises:
judging the numerical value magnitude relation between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, if the difference exists, starting the page turning operation of the function menu according to the difference, and the step includes:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, page-down operation is carried out on the function menu;
and if the difference value between the brightness value of the right eye and the brightness value of the left eye is greater than a preset threshold value, performing page up operation on the function menu.
6. A function menu page-turning device of a virtual reality helmet, comprising:
the acquisition module is used for acquiring the brightness value of the left eye and the brightness value of the right eye of the user;
a determining module, configured to determine whether there is a difference between the brightness value of the left eye and the brightness value of the right eye;
and the page turning module is used for starting page turning operation of the function menu according to the difference when the brightness value of the left eye and the brightness value of the right eye are different.
7. The apparatus of claim 6, wherein the determining module is specifically configured to:
judging the numerical value magnitude relation between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, the page turning module is specifically configured to:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, performing right page turning operation on the function menu;
and if the difference value of the brightness value of the right eye and the brightness value of the left eye is greater than a preset threshold value, performing left page turning operation on the function menu.
8. The apparatus of claim 6, wherein the determining module is specifically configured to:
judging the numerical value magnitude relation between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, the page turning module is specifically configured to:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, performing left page turning operation on the function menu;
and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, performing right page turning operation on the function menu.
9. The apparatus of claim 6, wherein the determining module is specifically configured to:
judging the numerical value magnitude relation between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, if the difference exists, starting the page turning operation of the function menu according to the difference, and the step includes:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, page-up operation is carried out on the function menu;
and if the difference value of the brightness value of the right eye and the brightness value of the left eye is larger than a preset threshold value, performing page-down operation on the function menu.
10. The apparatus of claim 6, wherein the determining module is specifically configured to:
judging the numerical value magnitude relation between the brightness value of the left eye and the brightness value of the right eye;
correspondingly, if the difference exists, starting the page turning operation of the function menu according to the difference, and the step includes:
if the difference value of the brightness value of the left eye and the brightness value of the right eye is larger than a preset threshold value, page-down operation is carried out on the function menu;
and if the difference value between the brightness value of the right eye and the brightness value of the left eye is greater than a preset threshold value, performing page up operation on the function menu.
11. A virtual reality helmet comprising a lens disposed at a position corresponding to a left eye and a right eye of a user, respectively, a light sensor disposed at a position corresponding to an inner corner of the eye at an edge of the lens, and the device of any one of claims 6 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510933755.1A CN105867605A (en) | 2015-12-15 | 2015-12-15 | Functional menu page-turning method and apparatus for virtual reality helmet, and helmet |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510933755.1A CN105867605A (en) | 2015-12-15 | 2015-12-15 | Functional menu page-turning method and apparatus for virtual reality helmet, and helmet |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105867605A true CN105867605A (en) | 2016-08-17 |
Family
ID=56623772
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510933755.1A Pending CN105867605A (en) | 2015-12-15 | 2015-12-15 | Functional menu page-turning method and apparatus for virtual reality helmet, and helmet |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105867605A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106325524A (en) * | 2016-09-14 | 2017-01-11 | 珠海市魅族科技有限公司 | Method and device for acquiring instruction |
| CN106446912A (en) * | 2016-09-14 | 2017-02-22 | 珠海市魅族科技有限公司 | Media processing method and media processing device |
| CN106527710A (en) * | 2016-11-07 | 2017-03-22 | 三星电子（中国）研发中心 | Virtual reality interaction method and device |
| CN106648055A (en) * | 2016-09-30 | 2017-05-10 | 珠海市魅族科技有限公司 | Method of managing menu in virtual reality environment and virtual reality equipment |
| CN106681514A (en) * | 2017-01-11 | 2017-05-17 | 广东小天才科技有限公司 | Virtual reality equipment and implementation method thereof |
| CN106774928A (en) * | 2016-12-30 | 2017-05-31 | 维沃移动通信有限公司 | The data processing method and virtual reality terminal of a kind of virtual reality terminal |
| WO2018192312A1 (en) * | 2017-04-20 | 2018-10-25 | 上海耕岩智能科技有限公司 | Operation method and device for eyeball tracking |
| WO2018192311A1 (en) * | 2017-04-20 | 2018-10-25 | 上海耕岩智能科技有限公司 | Operation method and device for eyeball tracking |
| CN111722716A (en) * | 2020-06-18 | 2020-09-29 | 清华大学 | Eye movement interaction method, head-mounted device and computer readable medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009081529A (en) * | 2007-09-25 | 2009-04-16 | Nikon Corp | Head-mounted display device |
| CN102163377A (en) * | 2010-02-24 | 2011-08-24 | 英特尔公司 | Facial tracking electronic reader |
| CN102799277A (en) * | 2012-07-26 | 2012-11-28 | 深圳先进技术研究院 | Wink action-based man-machine interaction method and system |
| CN103294198A (en) * | 2013-05-23 | 2013-09-11 | 深圳先进技术研究院 | Mobile terminal based human-computer interaction method and system |
| CN104076512A (en) * | 2013-03-25 | 2014-10-01 | 精工爱普生株式会社 | Head-mounted display device and method of controlling head-mounted display device |
| CN104272168A (en) * | 2012-04-02 | 2015-01-07 | 谷歌公司 | Proximity sensing for wink detection |
| CN104281266A (en) * | 2014-10-17 | 2015-01-14 | 栾林林 | Head-mounted display equipment |
| CN104755023A (en) * | 2012-11-02 | 2015-07-01 | 索尼公司 | Image display device and information input device |
| CN105006105A (en) * | 2015-08-04 | 2015-10-28 | 三峡大学 | Eye state identification device and eye state identification method based on infrared detection |
-
2015
- 2015-12-15 CN CN201510933755.1A patent/CN105867605A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009081529A (en) * | 2007-09-25 | 2009-04-16 | Nikon Corp | Head-mounted display device |
| CN102163377A (en) * | 2010-02-24 | 2011-08-24 | 英特尔公司 | Facial tracking electronic reader |
| CN104272168A (en) * | 2012-04-02 | 2015-01-07 | 谷歌公司 | Proximity sensing for wink detection |
| CN102799277A (en) * | 2012-07-26 | 2012-11-28 | 深圳先进技术研究院 | Wink action-based man-machine interaction method and system |
| CN104755023A (en) * | 2012-11-02 | 2015-07-01 | 索尼公司 | Image display device and information input device |
| CN104076512A (en) * | 2013-03-25 | 2014-10-01 | 精工爱普生株式会社 | Head-mounted display device and method of controlling head-mounted display device |
| CN103294198A (en) * | 2013-05-23 | 2013-09-11 | 深圳先进技术研究院 | Mobile terminal based human-computer interaction method and system |
| CN104281266A (en) * | 2014-10-17 | 2015-01-14 | 栾林林 | Head-mounted display equipment |
| CN105006105A (en) * | 2015-08-04 | 2015-10-28 | 三峡大学 | Eye state identification device and eye state identification method based on infrared detection |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106325524A (en) * | 2016-09-14 | 2017-01-11 | 珠海市魅族科技有限公司 | Method and device for acquiring instruction |
| CN106446912A (en) * | 2016-09-14 | 2017-02-22 | 珠海市魅族科技有限公司 | Media processing method and media processing device |
| CN106648055A (en) * | 2016-09-30 | 2017-05-10 | 珠海市魅族科技有限公司 | Method of managing menu in virtual reality environment and virtual reality equipment |
| CN106527710A (en) * | 2016-11-07 | 2017-03-22 | 三星电子（中国）研发中心 | Virtual reality interaction method and device |
| CN106774928A (en) * | 2016-12-30 | 2017-05-31 | 维沃移动通信有限公司 | The data processing method and virtual reality terminal of a kind of virtual reality terminal |
| CN106681514A (en) * | 2017-01-11 | 2017-05-17 | 广东小天才科技有限公司 | Virtual reality equipment and implementation method thereof |
| WO2018192312A1 (en) * | 2017-04-20 | 2018-10-25 | 上海耕岩智能科技有限公司 | Operation method and device for eyeball tracking |
| WO2018192311A1 (en) * | 2017-04-20 | 2018-10-25 | 上海耕岩智能科技有限公司 | Operation method and device for eyeball tracking |
| CN108733204A (en) * | 2017-04-20 | 2018-11-02 | 上海耕岩智能科技有限公司 | A kind of method and apparatus of eyeball tracking operation |
| TWI681339B (en) * | 2017-04-20 | 2020-01-01 | 大陸商上海耕岩智能科技有限公司 | Method and device for eye tracking operation |
| CN111722716A (en) * | 2020-06-18 | 2020-09-29 | 清华大学 | Eye movement interaction method, head-mounted device and computer readable medium |
| CN111722716B (en) * | 2020-06-18 | 2022-02-08 | 清华大学 | Eye movement interaction method, head-mounted device and computer readable medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105867605A (en) | Functional menu page-turning method and apparatus for virtual reality helmet, and helmet | |
| Zhao et al. | Foresee: A customizable head-mounted vision enhancement system for people with low vision | |
| CN108919958B (en) | Image transmission method and device, terminal equipment and storage medium | |
| US9728163B2 (en) | Operation mode switching method and electronic device | |
| CN103729981B (en) | A kind of child sitting gesture monitoring intelligent terminal | |
| US10133407B2 (en) | Display apparatus, display system, method for controlling display apparatus, and program | |
| CN107111863B (en) | Apparatus and method for corneal imaging | |
| EP2813922A1 (en) | Visibility improvement method based on eye tracking, machine-readable storage medium and electronic device | |
| JP2017531221A (en) | Countering stumbling when immersed in a virtual reality environment | |
| CN110352033A (en) | Eyes degree of opening is determined with eye tracks device | |
| JP6341755B2 (en) | Information processing apparatus, method, program, and recording medium | |
| EP3047361A1 (en) | A method, apparatus, and system for displaying a graphical user interface | |
| US9779552B2 (en) | Information processing method and apparatus thereof | |
| JP6750697B2 (en) | Information processing apparatus, information processing method, and program | |
| Zhao et al. | Designing and evaluating a customizable head-mounted vision enhancement system for people with low vision | |
| WO2023098175A1 (en) | Screen brightness adjustment method and apparatus for head-mounted display device, and head-mounted display device | |
| CN105867608A (en) | Function menu page turning method and device of virtual reality helmet and helmet | |
| CN110275620B (en) | Interaction method, interaction device, head-mounted equipment and storage medium | |
| CN106095375B (en) | Display control method and device | |
| KR20140003107A (en) | Apparatus and method for providing augmented reality | |
| KR20140133323A (en) | Augmented Reality service apparatus and system | |
| CN103677544A (en) | State switching method and electronic equipment | |
| CN113132642B (en) | Image display method and device and electronic equipment | |
| CN104156138B (en) | Filming control method and imaging control device | |
| EP3139586B1 (en) | Image shooting processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160817 |
|
| WD01 | Invention patent application deemed withdrawn after publication |