CN111491104A - Image shooting method, device and system and controller - Google Patents
Image shooting method, device and system and controller Download PDFInfo
- Publication number
- CN111491104A CN111491104A CN202010325569.0A CN202010325569A CN111491104A CN 111491104 A CN111491104 A CN 111491104A CN 202010325569 A CN202010325569 A CN 202010325569A CN 111491104 A CN111491104 A CN 111491104A
- Authority
- CN
- China
- Prior art keywords
- user
- controller
- image
- display screen
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 210000001508 eye Anatomy 0.000 claims description 68
- 238000012545 processing Methods 0.000 claims description 11
- 210000004279 orbit Anatomy 0.000 claims description 9
- 210000001747 pupil Anatomy 0.000 claims description 6
- 230000008569 process Effects 0.000 description 13
- 208000004350 Strabismus Diseases 0.000 description 7
- 230000009471 action Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 210000005252 bulbus oculi Anatomy 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 229930091051 Arenine Natural products 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000009323 psychological health Effects 0.000 description 1
- 238000004445 quantitative analysis Methods 0.000 description 1
- 230000004382 visual function Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The application provides a method, a device, a system and a controller for shooting an image. The display screen and the camera are both arranged in front of the sight line of a user, the method is applied to the controller, and the method comprises the following steps: controlling a display screen to display a guide pattern at a preset position on the display screen, wherein the guide pattern is used for guiding the sight line focus of a user; and controlling a camera to shoot the eye image of the user when the sight line of the user is determined to be focused on the guide pattern. The controller automatically controls and displays the guide pattern, and automatically controls the camera to shoot the eye image of the user when the sight of the user is automatically determined to be focused on the guide pattern.
Description
Technical Field
The application relates to the technical field of measuring equipment, in particular to a method, a device, a system and a controller for shooting an image.
Background
Strabismus is a problem which is easy to occur to children, and according to statistics, 0.29% -5.66% of children have strabismus, if adjustment is not found in time, strabismus not only affects the appearance, but also seriously affects the binocular visual function and physical and psychological health of the children. Quantitative analysis of eye position and eye movement is the main way to determine if strabismus is present.
For the way, the current specific operation mode is to manually guide the eyes of the child to watch the corresponding position, and when the eyes of the child watch the position, the shutter of the shooting device is pressed to shoot the eyes of the child. After the nine-eye image of the eyes is obtained by shooting in the above way repeatedly, the positions of the eyeballs in the nine-eye image can reflect whether the squinting condition exists or not.
It can be understood that although the nine-eye image can be shot by adopting the above method, the whole process is manual operation, which is time-consuming and labor-consuming, and the image quality is not stable due to the strong subjectivity of the manual operation.
Disclosure of Invention
An object of the embodiments of the present application is to provide an image capturing method, an image capturing apparatus, an image capturing system, and a controller, which are used to achieve efficient and stable capturing of an eye image.
In a first aspect, an embodiment of the present application provides an image capturing method, where a display screen and a camera are both disposed in front of a line of sight of a user, and the method is applied to a controller, and the method includes: the controller controls the display screen to display a guide pattern at a preset position on the display screen, wherein the guide pattern is used for guiding the line of sight of the user to be focused; the controller controls the camera to capture an eye image of the user when it is determined that the line of sight of the user is focused on the guide pattern.
In the embodiment of the application, the guide pattern is automatically controlled and displayed through the controller, and when the sight of the user is automatically determined to be focused on the guide pattern, the camera is automatically controlled to shoot the eye image of the user.
With reference to the first aspect, in a first possible implementation manner, the controlling the camera to capture an eye image of the user by the controller includes: the controller controls the camera to continuously shoot a plurality of eye images of the user.
In the embodiment of the application, because the plurality of eye images are shot, the high-quality eye image can be obtained more easily, so that the slicing quality is further improved.
With reference to the first possible implementation manner of the first aspect, in a second possible implementation manner, after the controller controls the camera to continuously capture multiple eye images of the user, the method further includes: the controller determines an image with the highest definition from the plurality of eye images; the controller judges whether the definition value of the image with the highest definition is larger than or equal to a preset definition lower limit value or not; if so, the controller stores the image with the highest definition; otherwise, the controller deletes the eye images, and controls the camera to shoot the eye images of the user again when determining that the sight line of the user refocuses on the guide pattern again until the definition value of the finally obtained image with the highest definition is larger than or equal to the definition lower limit value.
In the embodiment of the application, when the definition of the image with the highest definition is greater than or equal to the lower definition limit value, shooting is performed again until the definition of the finally obtained image with the highest definition is greater than or equal to the lower definition limit value, so that the situation that the definition of the finally used image is not enough is avoided.
With reference to the first aspect, in a third possible implementation manner, after the controller controls the camera to capture an eye image of the user, the method further includes: and the controller splices a plurality of images including the eye image shot at this time and the eye image shot by the user history according to a shooting sequence to obtain a spliced image, wherein the sight focusing positions of the user are different in any two images of the plurality of images.
In the embodiment of the application, the images are spliced, so that the spliced images can reflect the focusing of the sight of the user at each position, and the subsequent use is more convenient.
With reference to the first aspect, in a fourth possible implementation manner, the number of positions displayed by the guide pattern on the display screen is nine, the nine positions are distributed on the display screen in a nine-square grid, and a position located at the center of the nine-square grid is directly in front of the eyes of the user.
In the embodiment of the application, the nine display positions of the guide pattern are distributed in the grid of nine squares, so that the nine eye images finally obtained are standard nine eye images, and the strabismus analysis can be better performed in the subsequent use.
With reference to the first aspect, in a fifth possible implementation manner, the step of determining whether the line of sight of the user is focused on the guide pattern includes: the controller determines the current position of the pupil of the user in the eye socket by analyzing the current image acquired by the camera, and determines the current sight focus of the user on the display screen based on the position; determining whether the position of the line-of-sight focus is on the guide pattern.
In embodiments of the present application, the user's current gaze focus on the display screen is determined by the position of the eye ball in the eye socket, such that the user's gaze focus is quantified, in order to more accurately determine that the user's gaze focus is on the guide pattern.
With reference to the fifth possible implementation manner of the first aspect, in a sixth possible implementation manner, after the controller determines the gaze focus, the method further includes: the controller controls the display screen to display a pattern representing the gaze focus at the gaze focus.
In the embodiment of the application, the pattern for representing the sight line focus is displayed at the sight line focus, so that the user can perceive the sight line focus of the user, and the user can focus on the guide pattern better.
In a second aspect, an embodiment of the present application provides an image capturing device, where a display screen and a camera are both disposed in front of a line of sight of a user, the device is applied to a controller, and the device includes: the display control module is used for controlling the display screen to display a guide pattern at a preset position on the display screen, and the guide pattern is used for guiding the sight line of the user to be focused; the processing module is used for controlling the camera to shoot the eye images of the user when the fact that the sight line of the user is focused on the guide pattern is determined.
With reference to the second aspect, in a first possible implementation manner, the processing module is configured to control the camera to continuously capture multiple eye images of the user by the controller.
With reference to the first possible implementation manner of the second aspect, in a second possible implementation manner, after the processing module controls the camera to continuously capture multiple eye images of the user, the processing module is further configured to determine an image with the highest definition from the multiple eye images; the controller judges whether the definition value of the image with the highest definition is larger than or equal to a preset definition lower limit value or not; if yes, storing the image with the highest definition; otherwise, deleting the eye images, and controlling the camera to shoot the eye images of the user again when determining that the sight line of the user is focused on the guide pattern again until the definition value of the finally obtained image with the highest definition is larger than or equal to the definition lower limit value.
With reference to the second aspect, in a third possible implementation manner, after the processing module controls the camera to capture the eye image of the user, the processing module is further configured to splice, by the controller, a plurality of images including the eye image captured this time and the eye image captured by the user history according to a capturing sequence, so as to obtain a spliced image, where the focusing positions of the lines of sight of the user are different in any two images of the plurality of images.
With reference to the second aspect, in a fourth possible implementation manner, the positions of the guide pattern displayed on the display screen are nine, the nine positions are distributed on the display screen in a nine-square grid, and the position located at the center of the nine-square grid is directly in front of the eyes of the user.
With reference to the second aspect, in a fifth possible implementation manner, the processing module is configured to determine, by analyzing a picture currently acquired by the camera, a current position of a pupil of the user in an eye socket, and determine, based on the position, a current line-of-sight focus of the user on the display screen; determining whether the position of the line-of-sight focus is on the guide pattern.
With reference to the fifth possible implementation manner of the first aspect, in a sixth possible implementation manner, after the processing module determines the gaze focus, the processing module is further configured to control the display screen to display a pattern representing the gaze focus at the gaze focus.
In a third aspect, an embodiment of the present application provides an image capturing system, including: the image shooting method comprises a display screen, a camera and a controller, wherein the display screen and the camera are arranged in front of the sight line of a user, the controller is connected with the display screen and the camera, and the controller is used for executing the image shooting method according to the first aspect or any possible implementation manner of the first aspect.
In a fourth aspect, an embodiment of the present application provides a controller, including: an interface; a memory for storing a program; a control core, configured to invoke and run the program to execute, through the interface, the image capturing method according to the first aspect or any one of the possible implementation manners of the first aspect.
In a fifth aspect, the present application provides a computer-readable storage medium having a computer-executable non-volatile program code, where the program code makes the computer perform the method for capturing an image according to the first aspect or any one of the possible implementation manners of the first aspect.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is an application scene diagram of an image capturing system according to an embodiment of the present application;
fig. 2 is a block diagram of a controller in an image capturing system according to an embodiment of the present disclosure;
fig. 3 is a flowchart of a method for capturing an image according to an embodiment of the present disclosure;
fig. 4 is a first application scene diagram in an image capturing method according to an embodiment of the present disclosure;
fig. 5 is a second application scene diagram in an image capturing method according to an embodiment of the present application;
fig. 6 is a block diagram of a structure of an image capturing apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
Referring to fig. 1, an embodiment of the present application provides an image capturing system 10, where the image capturing system 10 may include: display screen 11, camera 12 and controller 20.
The Display screen 11 may be a conventional type Display screen, such as a Display screen 11 of L CD (L liquid Crystal Display), L ED (L light Emitting Diode), or O L ED (O L ED).
In this embodiment, the display screen 11 and the camera 12 need to be arranged in the same direction, so as to ensure that both the display screen 11 and the camera 12 can be located in front of the sight line of the user in practical application. Moreover, in practical applications, the camera 12 may be disposed between the user and the display 11 to ensure that the camera 12 can better capture the eye images of the user. In addition, the distance between the display screen 11 and the user may be appropriately adjusted according to the size of the display screen 11, so as to ensure that the pupil of the user can sufficiently move to the edge of the eye socket when the user gazes at the guide pattern displayed on the display screen 11, thereby ensuring that the captured eye image of the user can accurately reflect whether the user has strabismus. For example, when the display screen 11 is small, the distance between the display screen 11 and the user is suitably short, and vice versa.
Referring to fig. 1 and fig. 2, in the present embodiment, the controller 20 may include: an interface 21, which interface 21 is a logical interface in the form of software or a hardware interface in the form of physical hardware, one or more control cores 22 for executing program instructions, a bus 23, and a different form of memory 24, such as a disk, ROM, or RAM, or any combination thereof. The memory 24 is used for storing a program, and the control core 22 is used for calling and running the program in the memory 24 to execute a shooting method of the image, so as to realize control of displaying a guide pattern for guiding the focusing of the sight line of the user at a preset position on the display screen 11, and control the camera 12 to shoot an eye image of the user when the sight line of the user is determined to be focused on the guide pattern.
In this embodiment, besides the above forms, in practice, the display screen 11 and the camera 12 may be designed integrally, or even the display screen 11, the camera 12 and the controller 20 may be designed integrally.
How the controller 20 performs the photographing method of the image will be described in detail below by way of a method embodiment.
Referring to fig. 3, an embodiment of the present application provides an image capturing method, where the image capturing method may be executed by the controller 20, and a method flow of the image capturing method may include:
step S100: the controller controls the display screen to display a guide pattern at a preset position on the display screen, wherein the guide pattern is used for guiding the sight line of a user to be focused;
step S200: the controller controls the camera to capture an eye image of the user when determining that the line of sight of the user is focused on the guide pattern.
It should be noted that, in practical applications, each time the flow from step S100 to step S200 is executed, an eye image in which the line of sight of the user is focused in one direction may be acquired. In order to facilitate strabismus analysis, it is necessary to acquire each eye image in various different directions focused by the user' S line of sight in one shooting process, so the processes of step S100 to step S200 need to be repeated multiple times in one shooting process. Since the logic executed each time is substantially the same, in order to avoid the repeated description, the present embodiment will be described by taking an example of executing the flow once.
Specifically, for step S100:
the controller 20 presets the position of the guide pattern displayed on the display screen 11, wherein the guide pattern is generally a pattern that is of interest to the user and can attract the attention of the user, for example, the guide pattern may be an animal, a plant, a toy, etc. For example, as shown in fig. 4, the display positions may be six, and the six positions may be evenly distributed on the display screen 11 in a 3 × 2 matrix manner. For example, as shown in fig. 5, the number of the displayed positions may be nine, and the nine positions may be uniformly distributed on the display screen 11 in a 3 × 3 matrix manner, i.e., in a nine-grid format, and the position located at the center of the nine-grid is directly in front of the eyes of the user.
In this embodiment, the controller 20 also presets a display order in which the guide pattern is displayed at each position for each shooting flow. Also, to make the user's attention more focused and the line of sight more focused, the guide pattern is displayed at only one position per shot under the control of the controller 20. For example, taking nine display positions and uniformly distributed on the display screen 11 in a nine-grid format as an example, if the display sequence of the guide patterns displayed on the positions is from top to bottom and from left to right, in one shooting process, the controller 20 controls the display screen 11 to display the guide patterns at the upper left corner of the display screen 11 for the first shooting; for the second shooting, the controller 20 controls the display screen 11 to display a guide pattern at a position between the upper left corner and the upper right corner of the display screen 11; for the third shooting, the controller 20 controls the display screen 11 to display a guide pattern at the upper right corner of the display screen 11; and analogizing in turn until the ninth shooting, the controller 20 controls the display screen 11 to display a guide pattern at the lower right corner of the display screen 11, thereby completing the shooting process.
Then, at the time of the current shooting, the controller 20 determines a preset position where the guide pattern is displayed on the display screen 11 in the current shooting according to the sequence of the current shooting in the current shooting process, that is, according to the current shooting being the second shooting in the current shooting process, and then controls the display screen 11 to display the guide pattern at the preset position.
After controlling the display of the guide pattern, the controller 20 may perform step S200.
For step S200:
in the present embodiment, the manner in which the controller 20 determines whether the line of sight of the user has focused on the guide pattern differs depending on the application scenario. For example, the controller 20 may passively determine whether the user's gaze is focused on the guide pattern, or may actively determine whether the user's gaze is focused on the guide pattern, as described below.
With respect to the passive approach, the controller 20 may passively determine whether the user's line of sight has focused on the guidance pattern based on an active trigger by the user. Illustratively, in an application scenario, in addition to the display screen 11 and the camera 12, buttons may be provided. When the user's gaze is focused on the guide pattern, the user may actively press the button, the button may receive a trigger and send a trigger signal to the controller 20, and the controller 20 may passively determine that the user's gaze is focused on the guide pattern based on the trigger signal. In practical applications, game elements may be added in this way to help the user to focus the line of sight more easily and to bring a better user experience to the user, for example, the button may be designed as a trigger of a gun and the guide pattern may be designed as a pattern with a target, so that the action of the user focusing the line of sight on the guide pattern and pressing the button is played as the action of the user aiming and shooting.
Regarding the active mode, the camera 12 can automatically capture a picture besides being controlled by the controller 20, and the currently captured picture is sent to the controller 20, so that the controller 20 can determine the current sight line focus of the user on the display screen 11 according to the currently captured picture, and determine whether the position of the sight line focus is on the guide pattern, thereby actively determining the sight line focus of the user. For example, the controller 20 may process the currently captured frames in an image feature analysis manner to determine the current position of the user's pupil in the eye socket. In this way, based on the current position of the user's pupil in the eye socket, the controller 20 may back-out determine where on the display screen 11 the user is currently forming a line of sight focus. Of course, this technology is currently practiced, and its specific details will not be discussed again.
Further, in this manner, in order to allow the user to intuitively perceive where the user's gaze focus is on the display screen 11 so that the user can better focus the gaze focus on the guidance pattern, after the controller 20 determines the location of the gaze focus on the display screen 11, the controller 20 may control the display screen 11 to display a pattern representing the gaze focus at the gaze focus, such as a careless, a red dot, or other more prominent graphic. Also, based on the dynamic change of the position of the user's gaze focus on the display screen 11, the controller 20 also dynamically adjusts the position of the pattern in accordance with the change thereof, so that the position of the pattern can be changed in real time in accordance with the change of the gaze focus position.
In the present embodiment, when the controller 20 determines that the focal point of the user's line of sight is on the guide pattern, that is, determines that the user's line of sight is focused on the guide pattern, the controller 20 controls the camera 12 to perform shooting to acquire an eye image of the user.
For example, in controlling the photographing, the controller 20 may control the camera 12 to continuously photograph a plurality of eye images of the user, for example, control the camera 12 to continuously photograph 10 eye images. Then, the controller 20 calculates the sharpness of each of the plurality of eye images, for example, the controller 20 may determine the contour of the eye socket in each of the eye images, and calculate a maximum pixel difference between pixels at the edge of the contour of the eye socket in each of the eye images, where the maximum pixel difference may represent the sharpness of the eye image, and the larger the maximum pixel difference is, the higher the sharpness of the eye image is, the sharper the image is, and otherwise, the blurrier the image is. Based on the sharpness of each eye image, the controller 20 may select the image with the highest sharpness determined from the plurality of eye images. Finally, the controller 20 may determine whether the sharpness value of the image with the highest sharpness is greater than or equal to a preset lower sharpness limit value; if so, indicating that the image is sufficiently sharp, the controller 20 may save the image with the highest sharpness; otherwise, the controller 20 deletes the plurality of eye images shot this time, and controls the camera 12 to shoot the plurality of eye images of the user again when determining that the sight line of the user refocuses on the guide pattern again until the sharpness value of the finally obtained image with the highest sharpness is greater than or equal to the lower sharpness limit value.
In addition, if a speaker is provided in the application scene, the controller 20 may control the speaker to play a voice prompt to indicate that the line of sight of the user needs to be focused on the guide pattern.
In this embodiment, the shooting is the last shooting in the shooting process, and after the eye image shot at this time is saved, the controller 20 may splice the eye image shot at this time and the eye image shot in the user history in the shooting process at this time in the shooting sequence to obtain a spliced image, so that whether the user looks obliquely or not may be determined based on the spliced image after analysis.
Referring to fig. 6, based on the same inventive concept, an embodiment of the present invention further provides an image capturing apparatus 100, where the image capturing apparatus 100 may be applied to the controller 20, and the image capturing apparatus 100 may include:
a display control module 110, configured to control the display screen to display a guide pattern at a preset position on the display screen, where the guide pattern is used to guide the line of sight of the user to focus;
a processing module 120, configured to, when it is determined that the line of sight of the user is focused on the guide pattern, control the camera to capture an eye image of the user.
It should be noted that, as those skilled in the art can clearly understand, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
Some embodiments of the present application further provide a computer-readable storage medium of a computer-executable nonvolatile program code, which can be a general-purpose storage medium such as a removable magnetic disk, a hard disk, or the like, and the computer-readable storage medium stores a program code thereon, which when executed by a computer, performs the steps of the image capturing method according to any of the above embodiments.
The program code product of the image capturing method provided in the embodiment of the present application includes a computer-readable storage medium storing the program code, and instructions included in the program code may be used to execute the method in the foregoing method embodiment, and specific implementation may refer to the method embodiment, which is not described herein again.
In summary, the guidance guide pattern is automatically controlled and displayed by the controller, and when the sight of the user is automatically determined to be focused on the guidance pattern, the camera is automatically controlled to shoot the eye image of the user.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
In addition, units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
Furthermore, the functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. A method for shooting images, wherein a display screen and a camera are arranged in front of the sight line of a user, and the method is applied to a controller and comprises the following steps:
the controller controls the display screen to display a guide pattern at a preset position on the display screen, wherein the guide pattern is used for guiding the line of sight of the user to be focused;
the controller controls the camera to capture an eye image of the user when it is determined that the line of sight of the user is focused on the guide pattern.
2. The method for capturing an image according to claim 1, wherein the controller controls the camera to capture an eye image of the user, and comprises:
the controller controls the camera to continuously shoot a plurality of eye images of the user.
3. The method of capturing an image according to claim 2, wherein the controller controls the camera to capture a plurality of eye images of the user in succession, and the method further comprises:
the controller determines an image with the highest definition from the plurality of eye images;
the controller judges whether the definition value of the image with the highest definition is larger than or equal to a preset definition lower limit value or not;
if so, the controller stores the image with the highest definition; otherwise, the controller deletes the eye images, and controls the camera to shoot the eye images of the user again when determining that the sight line of the user refocuses on the guide pattern again until the definition value of the finally obtained image with the highest definition is larger than or equal to the definition lower limit value.
4. The method of capturing an image according to claim 1, wherein the controller controls the camera to capture an eye image of the user, and the method further comprises:
and the controller splices a plurality of images including the eye image shot at this time and the eye image shot by the user history according to a shooting sequence to obtain a spliced image, wherein the sight focusing positions of the user are different in any two images of the plurality of images.
5. The method of capturing an image according to claim 1,
nine positions of the guide patterns are displayed on the display screen, nine positions are distributed on the display screen in a nine-square grid manner, and the position at the center of the nine-square grid is right in front of the eyes of the user.
6. The method of capturing an image according to claim 1, characterized in that it is determined whether the line of sight of the user has focused on the guide pattern by:
the controller determines the current position of the pupil of the user in the eye socket by analyzing the current image acquired by the camera, and determines the current sight focus of the user on the display screen based on the position;
determining whether the position of the line-of-sight focus is on the guide pattern.
7. The method of capturing an image according to claim 6, wherein after the controller determines the gaze focus, the method further comprises:
the controller controls the display screen to display a pattern representing the gaze focus at the gaze focus.
8. An apparatus for capturing images, wherein a display screen and a camera are both disposed in front of a user's line of sight, the apparatus being applied to a controller, the apparatus comprising:
the display control module is used for controlling the display screen to display a guide pattern at a preset position on the display screen, and the guide pattern is used for guiding the sight line of the user to be focused;
the processing module is used for controlling the camera to shoot the eye images of the user when the fact that the sight line of the user is focused on the guide pattern is determined.
9. A system for capturing images, comprising:
the system comprises a display screen, a camera and a controller, wherein the display screen and the camera are arranged in front of the sight line of a user, the controller is connected with the display screen and the camera, and the controller is used for executing the image shooting method according to any one of claims 1 to 7.
10. A controller, comprising:
an interface;
a memory for storing a program;
a control core for calling and running the program to execute the image capturing method according to any one of claims 1 to 7 through the interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010325569.0A CN111491104A (en) | 2020-04-23 | 2020-04-23 | Image shooting method, device and system and controller |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010325569.0A CN111491104A (en) | 2020-04-23 | 2020-04-23 | Image shooting method, device and system and controller |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111491104A true CN111491104A (en) | 2020-08-04 |
Family
ID=71813140
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010325569.0A Pending CN111491104A (en) | 2020-04-23 | 2020-04-23 | Image shooting method, device and system and controller |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111491104A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103655133A (en) * | 2013-12-18 | 2014-03-26 | 北京东方之星幼儿教育科技有限公司 | Visual perception training system and method |
| CN104065880A (en) * | 2014-06-05 | 2014-09-24 | 惠州Tcl移动通信有限公司 | Processing method and system for automatically taking pictures based on eye tracking technology |
| CN105431076A (en) * | 2012-09-12 | 2016-03-23 | 特里维迪公司 | Gaze guidance arrangement |
-
2020
- 2020-04-23 CN CN202010325569.0A patent/CN111491104A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105431076A (en) * | 2012-09-12 | 2016-03-23 | 特里维迪公司 | Gaze guidance arrangement |
| CN103655133A (en) * | 2013-12-18 | 2014-03-26 | 北京东方之星幼儿教育科技有限公司 | Visual perception training system and method |
| CN104065880A (en) * | 2014-06-05 | 2014-09-24 | 惠州Tcl移动通信有限公司 | Processing method and system for automatically taking pictures based on eye tracking technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9948863B2 (en) | Self-timer preview image presentation method and apparatus, and terminal | |
| US10455224B2 (en) | Digital inter-pupillary distance adjustment | |
| US10846927B2 (en) | Method and apparatus for displaying a bullet-style comment in a virtual reality system | |
| JP5073013B2 (en) | Display control program, display control device, display control method, and display control system | |
| JP6586991B2 (en) | Information processing apparatus, information processing method, and program | |
| CN109840946B (en) | Virtual object display method and device | |
| CN111684496B (en) | Apparatus and method for tracking focus in a head-mounted display system | |
| CN109002248B (en) | VR scene screenshot method, equipment and storage medium | |
| CN110211211B (en) | Image processing method, device, electronic equipment and storage medium | |
| JP5464130B2 (en) | Information display system, apparatus, method and program | |
| JPWO2019021601A1 (en) | Information processing apparatus, information processing method, and program | |
| CN115103094A (en) | Camera module far-view angle adjusting method and system based on fixation point | |
| JP6283329B2 (en) | Augmented Reality Object Recognition Device | |
| CN111784604B (en) | Image processing method, device, equipment and computer readable storage medium | |
| CN106095375B (en) | Display control method and device | |
| TW201928444A (en) | Head-mounted display and adjusting method of the same | |
| CN111491104A (en) | Image shooting method, device and system and controller | |
| CN113960788B (en) | Image display method, device, AR glasses and storage medium | |
| CN113612978A (en) | Geometric distortion correction method, device, system and computer readable storage medium | |
| CN111208964B (en) | Low vision aiding method, terminal and storage medium | |
| CN108732750A (en) | Virtual reality playback equipment and its control method and computer readable storage medium | |
| CN112673621A (en) | Automatic focusing method, device, holder, equipment and storage medium | |
| US11430190B2 (en) | Virtual and real image fusion method, virtual and real image fusion system and non-transient computer readable medium | |
| WO2022018898A1 (en) | Image-capture device and program | |
| WO2024021250A1 (en) | Identity information acquisition method and apparatus, and electronic device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200804 |
|
| RJ01 | Rejection of invention patent application after publication |