CN108108022B - Control method and auxiliary imaging device - Google Patents
Control method and auxiliary imaging device Download PDFInfo
- Publication number
- CN108108022B CN108108022B CN201810000598.2A CN201810000598A CN108108022B CN 108108022 B CN108108022 B CN 108108022B CN 201810000598 A CN201810000598 A CN 201810000598A CN 108108022 B CN108108022 B CN 108108022B
- Authority
- CN
- China
- Prior art keywords
- user
- eye
- display mode
- state
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a control method and an imaging auxiliary device, wherein the method comprises the steps of determining eye states of a user, wherein the eye states comprise an eye opening state and an eye closing state; determining a display mode of the display device according to the eye state, wherein the display mode comprises a first display mode operated when the user is in the eye-open state and a second display mode operated when the user is in the eye-closed state, and the second display mode is different from the first display mode. The control method can realize automatic switching of the display mode by detecting the eye state of the user, thereby greatly simplifying the operation of the user.
Description
Technical Field
The invention relates to the field of intelligent control, in particular to a control method and an auxiliary imaging device applying the control method.
Background
Currently, as smart wearable devices are further developed and mature, such as smart contact lenses, they gradually start to step from individual professional areas into general areas. In the existing intelligent contact lenses, because a traditional switch or a controller cannot be set, the display device of the intelligent contact lenses usually cannot be directly closed or started, namely, the switching of the display modes is realized, so that a user can only stop the intelligent contact lenses to display in front of eyes by wearing or removing the intelligent contact lenses, or the display modes of the display device are manually switched by using an external device, the operation is very complicated and very inconvenient, if the user cannot remove the lenses or cannot operate through the external device at present, only the display device can uninterruptedly display virtual pictures in front of the eyes, and great influence is generated on the actual life of the user.
Aiming at the problems in the prior art, the method and the equipment for controlling the intelligent contact lenses have important significance.
Disclosure of Invention
The invention aims to provide a control method capable of realizing automatic switching of a display mode by detecting the eye state of a user and an auxiliary imaging device applying the method.
In order to solve the above problem, the present invention provides a control method including:
determining eye states of a user, wherein the eye states comprise an eye opening state and an eye closing state;
determining a display mode of the display device according to the eye state, wherein the display mode comprises a first display mode operated when the user is in the eye-open state and a second display mode operated when the user is in the eye-closed state, and the second display mode is different from the first display mode.
Preferably, the determining the eye state of the user specifically includes:
determining the eye state of the user by detecting the light sensitivity of the eyes of the user through the photosensitive substance; or
The eye state of the user is determined by the image collector.
Preferably, the determining the eye state of the user specifically includes:
detecting whether the user makes an eye opening action or an eye closing action;
acquiring the eye opening time or eye closing time of a user;
and determining the eye state of the user according to the eye opening time or the eye closing time.
Preferably, the first display mode is to stop presenting the picture to the user, so that the user directly observes the live-action picture, or a virtual picture presented to the user is adapted to the live-action picture observed by the user;
the second display mode is to present a virtual picture to a user or stop presenting the picture to the user;
the first display mode is different from the second display mode.
Preferably, the first display mode and the second display mode display different visual focal lengths of pictures and/or different frame rates of the pictures.
Preferably, the method further comprises the following steps:
acquiring physical sign parameters of eyes of a user;
determining the current eye fatigue state of the user according to the physical sign parameters;
and adjusting the picture parameters displayed in the first display mode and the second display mode according to the eye fatigue state, wherein the picture parameters at least comprise one of color, brightness, focal length and frame rate.
The invention also provides an auxiliary imaging device, comprising:
a detector for detecting eye states of a user, the eye states including an open eye state and a closed eye state;
display means for displaying to a user in a first display mode or a second display mode; and
and the controller is used for controlling the display device to operate a first display mode when the user is in an eye opening state according to the eye state, and operate a second display mode when the user is in an eye closing state.
Preferably, at least the display device is an eye-insertion device located between the eyelid and the eyeball of the user; at least part of the display device is made of transparent materials.
Preferably, the first display mode is to stop presenting the picture to the user, so that the user directly observes the live-action picture, or a virtual picture presented to the user is adapted to the live-action picture observed by the user;
the second display mode is to present a virtual picture to a user or stop presenting the picture to the user;
the first display mode is different from the second display mode.
Preferably, the first display mode and the second display mode display different visual focal lengths of pictures and/or different frame rates of the pictures.
Preferably, the display device is made of a flexible material adapted to the shape of the eyeball.
Preferably, the display means is separate from the detector or is connected thereto.
The invention has the advantages that the intelligent switching of the display mode of the display device can be realized by detecting the eye state of the user, the user operation is greatly simplified, and convenience is provided for the user.
Drawings
Fig. 1 is a flowchart of a control method in an embodiment of the present invention.
FIG. 2 is a flowchart of a method for determining an eye state of a user according to an embodiment of the invention.
Fig. 3 is a flowchart of a control method according to another embodiment of the invention.
Fig. 4 is a block diagram of the auxiliary imaging device in the embodiment of the present invention.
Detailed Description
Embodiments of the present invention are described in detail below with reference to the accompanying drawings.
It will be understood that various modifications may be made to the embodiments disclosed herein. The following description is, therefore, not to be taken in a limiting sense, but is made merely as an exemplification of embodiments. Other modifications will occur to those skilled in the art within the scope and spirit of the disclosure.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the disclosure and, together with a general description of the disclosure given above, and the detailed description of the embodiments given below, serve to explain the principles of the disclosure.
These and other characteristics of the invention will become apparent from the following description of a preferred form of embodiment, given as a non-limiting example, with reference to the accompanying drawings.
It should also be understood that, although the invention has been described with reference to some specific examples, a person of skill in the art shall certainly be able to achieve many other equivalent forms of the invention, having the characteristics as set forth in the claims and hence all coming within the field of protection defined thereby.
The above and other aspects, features and advantages of the present disclosure will become more apparent in view of the following detailed description when taken in conjunction with the accompanying drawings.
Specific embodiments of the present disclosure are described hereinafter with reference to the accompanying drawings; however, it is to be understood that the disclosed embodiments are merely examples of the disclosure that may be embodied in various forms. Well-known and/or repeated functions and structures have not been described in detail so as not to obscure the present disclosure with unnecessary or unnecessary detail. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present disclosure in virtually any appropriately detailed structure.
The specification may use the phrases "in one embodiment," "in another embodiment," "in yet another embodiment," or "in other embodiments," which may each refer to one or more of the same or different embodiments in accordance with the disclosure.
As shown in fig. 1, an embodiment of the present invention provides a control method, including:
determining eye states of a user, wherein the eye states comprise an eye opening state and an eye closing state;
the display mode of the display device is determined according to the eye state, and the display mode comprises a first display mode operated when the user is in the eye-open state and a second display mode operated when the user is in the eye-closed state, wherein the second display mode is different from the first display mode.
That is, by the control method in the embodiment of the present invention, the system can automatically switch the display mode of the display device by determining the current state of the eyes of the user, so that the display device can display in different display modes when the user opens and closes the eyes, the user does not need to manually adjust the display mode of the display device, the operation of the user is simplified, the user can adjust the display mode only by opening or closing the eyes, and a brand new use experience is created for the user.
Further, the system may adopt various methods when determining the eye state of the user, for example, embodiment one:
determining the eye state of the user by detecting the light sensitivity of the eyes of the user through the photosensitive substance; or
The eye state of the user is determined by the image collector.
For example, when the user wears the eye-type display device (i.e. the display device is located between the eyeball and the eyelid), the system can detect the increase of the intensity of the light rays incident on the eyes of the user through the photosensitive substance when the user opens the eyes by installing the photosensitive substance on the display device, such as preparing the display device with a flexible transparent material having photosensitive property, so as to determine that the user is in the eye-open state; when the user closes the eyes, the system can detect that the intensity of the light rays emitted into the eyes of the user is greatly weakened through the photosensitive substance, so that the user can be judged to be in the eye closing state at the moment.
Alternatively, the system may be provided with an image collector to determine the current eye state of the user by collecting the image of the eyes of the user. Specifically, for example, when the user wears ear-hung or head-worn glasses, such as VR glasses, AR glasses, or helmet glasses, the image collector may be disposed on the glasses, so that the image collector may obtain the eye image of the user in real time. The system can determine whether the current eye state of the user is the eye closing state matched with the first display mode of the display device by judging whether the brightness of the light rays entering the eyes of the user is within the range of the preset brightness threshold value, so that the phenomenon of misjudgment is avoided.
As shown in fig. 2, the second embodiment:
detecting whether the user makes an eye opening action or an eye closing action;
acquiring the eye opening time or eye closing time of a user;
and determining the eye state of the user according to the eye opening time or the eye closing time.
Specifically, the system first detects whether the eyes of the user are moving, for example, detects whether the light rays incident on the eyes of the user are changed significantly through a photosensitive material, or judges whether the eyes of the user are moving currently through an image collector. Then, the system may determine the time for which the user opens his eyes or the time for which the user closes his eyes by determining a stabilization time of the luminance value of the light ray incident on the user's eyes, that is, a time at which the luminance value of the light ray incident on the user's eyes is constant at the same value (change in the luminance value of the light ray incident on the user's eyes at the moment when the user blinks is negligible), or determine the time for which the user opens his eyes or the time for which the user closes his eyes by detecting whether the eye movement is constant in the eye-opening state or the eye-closing state for a certain period of time by the image collector. Then, the system may determine whether the user is currently in the eye-closed state matching the second display mode of the display device or the eye-open state matching the first display mode of the display device by determining whether the eye-open state or the duration of the eye-closed state of the user is within a preset time threshold.
Taking the system for determining the eye state of the user by detecting the brightness of the light incident on the eyes of the user through the photosensitive material, when the system detects that the brightness of the light incident on the eyes of the user is changed from the value A to the value B (where A > B), the system starts to detect the time when the brightness of the light is the value B, and if the duration time of the current brightness value of the light is detected to be 3s, the system can determine that the duration time is already at the preset time threshold, so that the user can be determined to be in the eye closing state currently, and at the moment, the system immediately starts the second display mode for displaying. If the system detects that the time when the light brightness is the value B is 2s and is not within the preset time threshold range, and the brightness of the light entering the eyes of the user is increased to the value A from the value B, the system judges that the eyes of the user are still in the eye opening state at the moment, and therefore the first display mode is continuously operated.
Further, the specific contents of the first display mode and the second display mode are not unique, for example, the first display mode of the display device may be configured to stop presenting the picture to the user, so that the user directly observes the live-action picture. That is, when the user is currently in the eye-open state, the system stops presenting any picture, such as a virtual picture, to the user, and allows the user to directly observe the live-action picture through the display device, that is, the display device at this time is equivalent to glass, and the user can observe all the live-action pictures observed when the user is naked eyes through the display device.
Alternatively, the first display mode of the display device may also be a virtual picture presented to the user and adapted to a real-scene picture observed by the user, that is, the first display mode is a virtual-real combined picture. For example, if the current environment of the user is in a park and the real scene in front of the user is a bench, the system can collect the real scene picture in front of the user, determine the real scene in front of the user and then present a virtual character to the user to sit on the bench in the real scene in front of the user to read the book; if the user is still in a park and the real scene in front of the user is a river, the system collects the real scene picture in front of the user and presents a group of ducklings swimming in the river in the real scene in front of the user after determining the real scene picture in front of the user.
Further, the second display mode may be to present a virtual picture to the user, that is, when the user is currently in the eye-closing state, the system causes the display device to display a pure virtual picture to the user, for example, the pure virtual picture may be a recorded image, a movie or other video content of a certain game selected by the user, or may be a plurality of pictures, and the pictures may be displayed in the form of playing light films. In order to increase the experience effect of the user, the sound equipment can be additionally arranged at the same time, so that the user can hear the sound matched with the displayed picture while watching.
Or, the second display mode may also be to stop presenting the picture to the user, that is, when the user is currently in the eye-closing state, the system stops presenting any picture to the user, so that the user can take a rest with eyes closed.
The specific mode contents of the first display mode and the second display mode may be exchanged and are not fixed, but it is required to ensure that the first display mode is different from the second display mode, that is, when the user is currently in the eye-open state or the eye-closed state, the display device performs display (including stop of display) in different modes, so that the images that the user can observe are different when the eyes are in different states.
Further, as shown in fig. 3, it is preferable that the frames are flashed faster to avoid that the frames are too messy before the eyes of the user are in the eye-closing state or the eye-opening state, which leads to the increase of the intraocular pressure of the user and causes the feeling of light-headedness. In this embodiment, the visual focal lengths of the pictures displayed in the first display mode and the second display mode are different and/or the frame rates of the pictures are different, the visual focal lengths and the frame rates of the pictures can be specifically adjusted, and the adjustment mode may be manual adjustment by the user, or a dialog box with multiple options is preset by the system for the user to select, that is, the adjustment is performed according to the user instruction, so as to meet the requirements of the user. Or system self-adaptive adjustment, which comprises the following steps:
acquiring physical sign parameters of eyes of a user, such as the water content of eyeballs, whether red blood filaments exist or not and the like;
determining the current eye fatigue state of the user according to the physical sign parameters, namely judging whether the eyes of the user are in the fatigue state currently;
and adjusting the picture parameters displayed in the first display mode and the second display mode according to the eye fatigue state, wherein the picture parameters at least comprise one of color, brightness, visual focus and picture frame rate. That is, whether the eyes of the user are currently in the fatigue state is determined according to the sign parameters, if so, the degree of the current eye fatigue state of the user can be further determined, and then one or more of the color, brightness, visual focal length and frame rate of the pictures displayed in the first display mode and the second display mode are adjusted according to the eye fatigue degree of the user. For example, if the user is tired of his eyes, the system will decrease the color and brightness of the displayed picture, and increase the visual focal length and slow down the frame rate, i.e. display the picture in an eye-protecting manner. Alternatively, the system may directly adjust the display mode to stop displaying the picture to the user.
As shown in fig. 4, an embodiment of the present invention also provides an auxiliary imaging apparatus, which includes:
a detector for detecting eye states of a user, the eye states including an open eye state and a closed eye state;
the display device is used for displaying to a user in a first display mode or a second display mode, and the display device can be connected with the detector or separated from the detector; and
and the controller is used for controlling the display device to operate the first display mode when the user is in an eye opening state according to the eye state and operate the second display mode when the user is in an eye closing state.
That is, with the auxiliary imaging device in the embodiment of the present invention, the display mode of the display device can be automatically switched by determining the current state of the eyes of the user, so that the display device can display in different display modes when the user opens and closes the eyes, the user does not need to manually adjust the display mode of the display device, the operation of the user is simplified, the user can adjust the display mode only by opening or closing the eyes, and a completely new use experience is created for the user.
Further, in the auxiliary imaging device in this embodiment, at least the display device may be an in-eye device, that is, at least the display device is an in-eye device located between the eyelid and the eyeball of the user, and at least a portion of the display device is made of a transparent material, so that the user can observe the real-scene picture in front of the eye through the display device. In order to make the user wear the in-eye display device better, the display device is preferably made of flexible material to at least partially conform to the physiological curvature of the eyeball of the user, such as the shape of a contact lens. Of course, the display device may also be an ear-hanging or head-mounted device, such as a-glasses, VR glasses, or head-mounted smart glasses, etc.
Further, the controller may adopt various methods when determining the eye state of the user, for example, embodiment one:
determining the eye state of the user by detecting the light sensitivity of the eyes of the user through the photosensitive substance; or
The eye state of the user is determined by the image collector.
For example, when the user wears the eye-type display device (i.e., the display device is located between the eyeball and the eyelid), the controller may determine that the user is in the eye-open state by detecting the increase in intensity of the light incident on the eyes of the user through the photosensitive substance when the user opens the eyes by installing the photosensitive substance on the display device, such as preparing the display device with a flexible transparent material having photosensitive property; when the user closes the eyes, the controller can detect that the intensity of the light rays emitted into the eyes of the user is greatly reduced through the photosensitive substance, so that the user can be judged to be in the eye closing state at the moment.
Or, an image collector is adopted as a detector to collect images of the eyes of the user through the image collector to determine the current eye state of the user. Specifically, for example, when the user wears ear-hung or head-worn glasses, such as VR glasses, AR glasses, or helmet glasses, the image collector may be disposed on the glasses, so that the image collector may obtain the eye image of the user in real time. The controller can determine whether the current eye state of the user is the eye closing state matched with the first display mode of the display device by judging whether the brightness of the light rays entering the eyes of the user is within the range of the preset brightness threshold value, so that the phenomenon of misjudgment is avoided.
Example two:
the detector detects whether the user makes an eye opening action or an eye closing action;
the controller acquires the eye opening time or the eye closing time of the user and determines the eye state of the user according to the eye opening time or the eye closing time.
Specifically, the controller first detects whether the eyes of the user are moving, for example, detects whether the light rays incident on the eyes of the user are changed significantly through the photosensitive material, or judges whether the eyes of the user are moving currently through the image collector. Then, the controller may determine the time for which the user opens his or her eyes or the time for which the user closes his or her eyes by determining a stabilization time of the luminance value of the light ray incident on the user's eyes, that is, a time at which the luminance value of the light ray incident on the user's eyes is constant at the same value (a change in the luminance value of the light ray incident on the user's eyes at the moment when the user blinks is negligible), or by detecting whether the eye movement for a certain period of time is constant in an eye-open state or an eye-closed state by the image acquirer (a change in the eye state at the moment when the user blinks. Then, the controller may determine whether the user is currently in the eye-closed state matching the second display mode of the display device or the eye-open state matching the first display mode of the display device by determining whether the eye-open state or the duration of the eye-closed state of the user is within a preset time threshold.
Taking the controller to detect the brightness of the light incident on the user's eyes through the photosensitive material to determine the eye state of the user, when the controller detects that the brightness of the light incident on the user's eyes is changed from the value A to the value B (where A > B), the controller starts to detect the time when the brightness of the light is the value B, and if the duration of the current brightness of the light is detected to be 3s, the controller can determine that the duration is already at the preset time threshold, so that the user can be determined to be in the eye-closing state currently, and at this time, the controller immediately starts the second display mode to display. If the controller detects that the time when the light brightness is the value B is 2s and is not in the preset time threshold range, and the brightness of the light entering the eyes of the user is increased to the value A from the value B, the controller judges that the eyes of the user are still in the eye opening state at the moment, and therefore the first display mode is continuously operated.
Further, the specific contents of the first display mode and the second display mode are not unique, for example, the first display mode of the display device may be configured to stop presenting the picture to the user, so that the user directly observes the live-action picture. That is, when the user is currently in the eye-open state, the controller stops presenting any picture, such as a virtual picture, to the user, and allows the user to directly observe the live-action picture through the display device, that is, the display device at this time is equivalent to glass, and the user can observe all the live-action pictures observed when the user is naked eyes through the display device.
Alternatively, the first display mode of the display device may also be a virtual picture presented to the user and adapted to a real-scene picture observed by the user, that is, the first display mode is a virtual-real combined picture. For example, if the current environment of the user is in a park and the real scene in front of the user is a bench, the controller can collect the real scene picture in front of the user, determine the real scene in front of the user and then present a virtual character to the user to sit on the bench in the real scene in front of the user to read a book; if the user is still in a park and the real scene in front of the user is a river, the controller collects the real scene picture in front of the user and presents a group of ducklings swimming in the river in the real scene in front of the user after determining the real scene picture in front of the user.
Further, the second display mode may be to present a virtual picture to the user, that is, when the user is currently in the eye-closing state, the controller causes the display device to display a pure virtual picture to the user, for example, the pure virtual picture may be a recorded image, a movie or other video content of a certain game selected by the user, or may be a plurality of pictures, and the pictures may be displayed in the form of playing light films. In order to increase the experience effect of the user, the sound equipment can be additionally arranged at the same time, so that the user can hear the sound matched with the displayed picture while watching.
Alternatively, the second display mode may also be to stop presenting the picture to the user, that is, when the user is currently in the eye-closing state, the controller stops presenting any picture to the user, so that the user can take a rest with eyes closed.
The specific mode contents of the first display mode and the second display mode may be exchanged and are not fixed, but it is required to ensure that the first display mode is different from the second display mode, that is, when the user is currently in the eye-open state or the eye-closed state, the display device performs display (including stop of display) in different modes, so that the images that the user can observe are different when the eyes are in different states.
Further, it is preferable that the frames are flashed faster to avoid that the frames are too messy before the eyes of the user are in the eye-closing state or the eye-opening state, which leads to the increase of the eye pressure of the user and causes the feeling of light-headedness. In this embodiment, the visual focal lengths of the pictures displayed in the first display mode and the second display mode are different and/or the frame rates of the pictures are different, the visual focal lengths and the frame rates of the pictures can be specifically adjusted, and the adjustment mode may be manual adjustment by the user, or a dialog box with multiple options is preset by the controller for the user to select, that is, the adjustment is performed according to the user instruction, so as to meet the requirements of the user. Or the controller can adjust in a self-adaptive manner, and the specific steps are as follows:
the detector obtains physical sign parameters of eyes of a user, such as the water content of eyeballs, whether red blood filaments exist or not and the like;
the controller determines the current eye fatigue state of the user according to the sign parameters, namely, judges whether the eyes of the user are in the fatigue state currently, and then adjusts the picture parameters displayed in the first display mode and the second display mode according to the eye fatigue state, wherein the picture parameters at least comprise one of color, brightness, visual focus and picture frame rate. That is, whether the eyes of the user are currently in the fatigue state is determined according to the sign parameters, if so, the degree of the current eye fatigue state of the user can be further determined, and then one or more of the color, brightness, visual focal length and frame rate of the pictures displayed in the first display mode and the second display mode are adjusted according to the eye fatigue degree of the user. For example, if the user is tired of his eyes, the controller will decrease the color and brightness of the displayed picture, and increase the visual focal length to slow down the frame rate, i.e. display the picture in an eye-protecting manner. Alternatively, the controller may directly adjust the display mode to stop displaying the picture to the user.
The above embodiments are only exemplary embodiments of the present invention, and are not intended to limit the present invention, and the scope of the present invention is defined by the claims. Various modifications and equivalents may be made by those skilled in the art within the spirit and scope of the present invention, and such modifications and equivalents should also be considered as falling within the scope of the present invention.
Claims (5)
1. A control method, comprising:
determining the eye state of the user by detecting the intensity of light rays emitted to the eyes of the user through the photosensitive substance, wherein the eye state comprises an eye opening state and an eye closing state;
determining display modes of the display device according to the eye states, wherein the display modes comprise a first display mode and a second display mode, the first display mode is operated when the user is in an eye opening state, the second display mode is operated when the user is in an eye closing state, the first display mode is to stop presenting pictures to the user, so that the user directly observes live-action pictures, or virtual pictures presented to the user are matched with the live-action pictures observed by the user, the second display mode is to present virtual pictures to the user, or stop presenting pictures to the user, and the first display mode and the second display mode display pictures are different in visual focal length and/or frame rate, so that the pictures observed by the user are different when the eyes are in different states.
2. The method according to claim 1, wherein the determining the eye state of the user is specifically:
detecting whether the user makes an eye opening action or an eye closing action;
acquiring the eye opening time or eye closing time of a user;
and determining the eye state of the user according to the eye opening time or the eye closing time.
3. The method of claim 1, further comprising:
acquiring physical sign parameters of eyes of a user;
determining the current eye fatigue state of the user according to the physical sign parameters;
and adjusting the picture parameters displayed in the first display mode and the second display mode according to the eye fatigue state, wherein the picture parameters at least comprise one of color, brightness, focal length and frame rate.
4. An auxiliary imaging apparatus, comprising:
the detector is used for detecting the intensity of light rays emitted to the eyes of the user through the photosensitive substance to determine the eye state of the user, and the eye state comprises an eye opening state and an eye closing state;
display means for displaying to a user in a first display mode or a second display mode; and
the controller is used for controlling the display device to operate a first display mode when the user is in an eye opening state according to the eye state, and operate a second display mode when the user is in an eye closing state;
the first display mode is to stop presenting the picture to the user, so that the user directly observes the real-scene picture, or the virtual picture presented to the user is adapted to the real-scene picture observed by the user, and the second display mode is to present the virtual picture to the user, or stop presenting the picture to the user, wherein the first display mode and the second display mode display pictures with different visual focal lengths and/or different frame rates, so that the pictures observed by the user are different when the eyes are in different states.
5. An auxiliary imaging device as claimed in claim 4, wherein at least the display device is an intraocular device positioned between the eyelid and the eyeball of the user; at least part of the display device is made of transparent materials.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810000598.2A CN108108022B (en) | 2018-01-02 | 2018-01-02 | Control method and auxiliary imaging device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810000598.2A CN108108022B (en) | 2018-01-02 | 2018-01-02 | Control method and auxiliary imaging device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108108022A CN108108022A (en) | 2018-06-01 |
| CN108108022B true CN108108022B (en) | 2021-05-18 |
Family
ID=62218421
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810000598.2A Active CN108108022B (en) | 2018-01-02 | 2018-01-02 | Control method and auxiliary imaging device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108108022B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11378805B2 (en) * | 2018-06-25 | 2022-07-05 | Maxell, Ltd. | Head-mounted display, head-mounted display linking system, and method for same |
| EP3966624A4 (en) * | 2019-05-10 | 2023-01-11 | Twenty Twenty Therapeutics LLC | Natural physio-optical user interface for intraocular microdisplay |
| CN110412778A (en) * | 2019-07-25 | 2019-11-05 | 南京聚米粒智能科技有限公司 | A kind of spectacles asthenopia alleviation method and device |
| CN113138659A (en) * | 2020-01-16 | 2021-07-20 | 七鑫易维(深圳)科技有限公司 | Method, device and equipment for controlling working mode and storage medium |
| WO2023224803A1 (en) * | 2022-05-18 | 2023-11-23 | Apple Inc. | Eye characteristic determination |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101520690A (en) * | 2006-09-08 | 2009-09-02 | 索尼株式会社 | Image capturing and displaying apparatus and image capturing and displaying method |
| CN103257877A (en) * | 2013-05-06 | 2013-08-21 | 苏州三星电子电脑有限公司 | Automatic sleep control system of display device and control method thereof |
| CN104766056A (en) * | 2015-03-31 | 2015-07-08 | 青岛歌尔声学科技有限公司 | Human-computer interaction method, device and virtual headset device |
| CN105929926A (en) * | 2016-04-08 | 2016-09-07 | 惠州Tcl移动通信有限公司 | VR (Virtual Reality) glasses and power saving method thereof |
| CN106406501A (en) * | 2016-09-30 | 2017-02-15 | 珠海市魅族科技有限公司 | Method and device for controlling rendering |
| CN106873157A (en) * | 2016-12-28 | 2017-06-20 | 广州途威慧信息科技有限公司 | Intelligent virtual glasses control method based on eyeball condition |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0749744A (en) * | 1993-08-04 | 1995-02-21 | Pioneer Electron Corp | Head mounting type display input device |
| US10962808B2 (en) * | 2013-05-02 | 2021-03-30 | Sony Corporation | Contact lens with image pickup control |
| JP2016002353A (en) * | 2014-06-18 | 2016-01-12 | ソニー株式会社 | Detection device and method, and program |
| CN107483722A (en) * | 2017-07-31 | 2017-12-15 | 广东欧珀移动通信有限公司 | Mobile terminal and control method, computer-readable recording medium |
| CN107510460B (en) * | 2017-09-28 | 2021-04-23 | 歌尔光学科技有限公司 | Anti-fatigue control method for head-mounted display equipment and head-mounted display equipment |
-
2018
- 2018-01-02 CN CN201810000598.2A patent/CN108108022B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101520690A (en) * | 2006-09-08 | 2009-09-02 | 索尼株式会社 | Image capturing and displaying apparatus and image capturing and displaying method |
| CN103257877A (en) * | 2013-05-06 | 2013-08-21 | 苏州三星电子电脑有限公司 | Automatic sleep control system of display device and control method thereof |
| CN104766056A (en) * | 2015-03-31 | 2015-07-08 | 青岛歌尔声学科技有限公司 | Human-computer interaction method, device and virtual headset device |
| CN105929926A (en) * | 2016-04-08 | 2016-09-07 | 惠州Tcl移动通信有限公司 | VR (Virtual Reality) glasses and power saving method thereof |
| CN106406501A (en) * | 2016-09-30 | 2017-02-15 | 珠海市魅族科技有限公司 | Method and device for controlling rendering |
| CN106873157A (en) * | 2016-12-28 | 2017-06-20 | 广州途威慧信息科技有限公司 | Intelligent virtual glasses control method based on eyeball condition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108108022A (en) | 2018-06-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108108022B (en) | Control method and auxiliary imaging device | |
| TWI516804B (en) | Head mounted display apparatus and backlight adjustment method thereof | |
| CN109633907B (en) | Method for automatically adjusting brightness of monocular AR (augmented reality) glasses and storage medium | |
| JP4600290B2 (en) | Visual auxiliary display device | |
| TWI710800B (en) | Head-mounted personal multimedia systems and visual assistance devices thereof | |
| CN107863089B (en) | Blue light adjusting method, device and terminal | |
| CN103843322B (en) | Head mounted display and display control method | |
| JP6051605B2 (en) | Display device, display control method, and program | |
| CN103501406B (en) | Image collecting system and image collecting method | |
| JP3348956B2 (en) | Display device | |
| WO2015024327A1 (en) | Eyesight-protection imaging apparatus and eyesight-protection imaging method | |
| CN109725423B (en) | Method for automatically adjusting brightness of monocular AR (augmented reality) glasses and storage medium | |
| US20130044939A1 (en) | Method and system for modifying binocular images | |
| WO2018003205A1 (en) | Spectacles with image display function | |
| WO2018120928A1 (en) | Smart virtual glasses control method based on conditions of eyeballs | |
| KR20110035585A (en) | Game apparatus for interacting according to user's status determined by eye image and method for providing game | |
| CN109758108A (en) | A kind of AR spectacle visual function examination device | |
| WO2018120929A1 (en) | Clear and smooth image playback control method based on vr glasses | |
| CN111630847B (en) | Image projection apparatus, image projection method, image display light output control method | |
| CN110200745A (en) | Eyeshade and sleep promotion method | |
| CN112180604A (en) | Display device and method for near-to-eye information | |
| CN106019587A (en) | Near-to-eye display device capable of automatically focusing and method | |
| JP2003287708A (en) | Vision expansion device and display system | |
| CN114816065A (en) | Screen backlight adjusting method, virtual reality device and readable storage medium | |
| JP2002119471A (en) | Optometry system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |