CN115100728A - Method, apparatus, storage medium and program product for detecting visual acuity status - Google Patents
Method, apparatus, storage medium and program product for detecting visual acuity status Download PDFInfo
- Publication number
- CN115100728A CN115100728A CN202210592920.1A CN202210592920A CN115100728A CN 115100728 A CN115100728 A CN 115100728A CN 202210592920 A CN202210592920 A CN 202210592920A CN 115100728 A CN115100728 A CN 115100728A
- Authority
- CN
- China
- Prior art keywords
- user
- abnormal
- state
- eye
- vision
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 230000004304 visual acuity Effects 0.000 title claims description 22
- 230000002159 abnormal effect Effects 0.000 claims abstract description 169
- 230000006399 behavior Effects 0.000 claims abstract description 161
- 230000004438 eyesight Effects 0.000 claims abstract description 115
- 238000001514 detection method Methods 0.000 claims abstract description 86
- 210000001508 eye Anatomy 0.000 claims description 165
- 210000005252 bulbus oculi Anatomy 0.000 claims description 45
- 210000003128 head Anatomy 0.000 claims description 31
- 238000004590 computer program Methods 0.000 claims description 16
- 230000004397 blinking Effects 0.000 claims description 9
- 238000004898 kneading Methods 0.000 claims description 5
- 239000011521 glass Substances 0.000 claims description 4
- 208000001491 myopia Diseases 0.000 abstract description 8
- 230000004379 myopia Effects 0.000 abstract description 8
- 208000004350 Strabismus Diseases 0.000 abstract description 6
- 210000004279 orbit Anatomy 0.000 description 8
- 238000004891 communication Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 206010000117 Abnormal behaviour Diseases 0.000 description 5
- 230000000007 visual effect Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 206010047571 Visual impairment Diseases 0.000 description 3
- 230000009471 action Effects 0.000 description 3
- 230000004393 visual impairment Effects 0.000 description 3
- 208000019749 Eye movement disease Diseases 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 208000005494 xerophthalmia Diseases 0.000 description 2
- 201000009487 Amblyopia Diseases 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/193—Preprocessing; Feature extraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/46—Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- Human Computer Interaction (AREA)
- Eye Examination Apparatus (AREA)
Abstract
The invention provides a method, a device, a storage medium and a program product for detecting vision state, wherein the method comprises the following steps: carrying out image detection on a plurality of images in the acquired target video to obtain detection information of a user, wherein the detection information comprises: eye key points of the user and/or behavior information of the user; determining abnormal eye using behaviors of the user according to the detection information; determining the vision state of the user according to the abnormal eye using behavior, wherein the vision state comprises a normal state and an abnormal state; and outputting prompt information under the condition that the vision state of the user is determined to be an abnormal state, wherein the prompt information is used for reminding the user that the vision is abnormal. The method, the device, the storage medium and the program product for detecting the vision state provided by the embodiment of the invention can prevent the vision problems such as myopia, strabismus and the like in advance.
Description
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to a method, an apparatus, a storage medium, and a program product for detecting a visual acuity status.
Background
At present, the myopia problem of teenagers is more serious, and the myopia trend of children is more obvious along with the rapid popularization of smart phones and tablet computers.
Generally, the vision state of a child is known through a professional detection mode, for example, problems such as amblyopia, strabismus, myopia and the like need to be detected by professional equipment in a hospital, and after the vision problems of the child are detected, a corresponding correction mode is adopted for correction.
However, in the daily learning process, some eye behaviors of children expose some vision problems, so how to early warn and prevent the vision state of the children according to the daily eye behaviors of the children is a technical problem to be solved at present.
Disclosure of Invention
The invention provides a method, a device, a storage medium and a program product for detecting vision states, which are used for solving the defect that the vision states cannot be early warned and prevented in advance in the prior art and realizing the prevention of the vision problems such as myopia or strabismus and the like in advance.
The invention provides a method for detecting vision state, which comprises the following steps:
carrying out image detection on a plurality of images in the acquired target video to obtain detection information of a user, wherein the detection information comprises: eye key points of the user and/or behavior information of the user;
determining whether the user has abnormal eye using behaviors or not according to the detection information;
under the condition that the user has abnormal eye using behaviors, determining the vision state of the user according to the abnormal eye using behaviors, wherein the vision state comprises a normal state and an abnormal state;
and under the condition that the vision state of the user is determined to be an abnormal state, outputting prompt information, wherein the prompt information is used for reminding the user of the abnormal vision.
According to the detection method of the vision state provided by the invention, the detection information comprises the eye key points of the user;
the determining whether the user has abnormal eye using behavior according to the detection information includes:
determining the central position of the eyeball according to the eye key point;
and determining whether the user has abnormal eye using behaviors or not according to the central position of the eyeball.
According to the detection method of the vision state provided by the invention, the step of determining whether the user has abnormal eye using behaviors or not according to the central position of the eyeball comprises the following steps:
and determining the abnormal eye using behavior of the user under the condition that the eyeballs are positioned in the non-central area of the eyesockets according to the central positions of the eyeballs and/or under the condition that the two eyeballs are not positioned at the same horizontal position.
According to the detection method of the vision state provided by the invention, the detection information comprises the behavior information of the user;
the determining whether the user has abnormal eye using behavior according to the detection information includes:
according to the behavior information of the user, determining that the user has the abnormal eye use behavior under the condition that the user is determined to have at least one of the following behaviors: the glasses are in a squinting state in a time length exceeding a first preset time period, the eye kneading times in a second preset time period exceed a third preset value, and the blinking times in the third preset time period exceed a fourth preset value.
According to the detection method of the vision state provided by the invention, the determining the vision state of the user according to the abnormal eye using behavior comprises the following steps:
and determining that the vision state of the user is an abnormal state under the condition that the frequency of the abnormal eye using behaviors is greater than the preset frequency within a first preset time.
According to the detection method of the vision state provided by the invention, the method further comprises the following steps:
determining the distance between the head of the user and a desktop or the distance between the head of the user and the terminal equipment through a structured light camera or a time of flight (TOF) camera;
determining that the user has abnormal eye use behaviors when the distances are all smaller than a fifth preset value within a time length exceeding a fourth preset time period;
and determining that the vision state of the user is an abnormal state under the condition that the frequency of the abnormal eye using behaviors is greater than the preset frequency within a second preset time length.
The present invention also provides a device for detecting visual acuity status, comprising:
the detection module is used for carrying out image detection on a plurality of images in the collected target video to obtain detection information of a user, wherein the detection information comprises: eye key points of the user and/or behavior information of the user;
the determining module is used for determining whether the user has abnormal eye using behaviors or not according to the detection information;
the determining module is further configured to determine, according to the abnormal eye using behavior, a vision state of the user under the condition that the user has the abnormal eye using behavior, where the vision state includes a normal state and an abnormal state;
and the output module is used for outputting prompt information under the condition that the vision state of the user is determined to be an abnormal state, wherein the prompt information is used for reminding the user that the vision is abnormal.
The invention also provides an electronic device, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the vision state detection method.
The present invention also provides a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method of detecting a vision state as described in any of the above.
The invention also provides a computer program product comprising a computer program which, when executed by a processor, implements a method of detecting a vision state as described in any one of the above.
The invention provides a method, a device, a storage medium and a program product for detecting vision state, which are used for detecting a plurality of images in a collected target video to obtain detection information of a user, wherein the detection information comprises: eye key points of the user and/or behavior information of the user; determining whether the user has abnormal eye using behaviors or not according to the detection information, and determining the vision state of the user according to the abnormal eye using behaviors under the condition that the user has the abnormal eye using behaviors, wherein the vision state comprises a normal state and an abnormal state; and under the condition that the vision state of the user is determined to be an abnormal state, outputting prompt information, wherein the prompt information is used for reminding the user that the vision is abnormal. Whether the abnormal eye using behaviors exist in the user can be determined through the daily eye using behaviors of the user, the vision state of the user is further determined under the condition that the abnormal eye using behaviors exist, and then prompt information is output to remind the user under the condition that the vision state is determined to be the abnormal state, so that the aims of early warning and preventing the vision state in advance based on the daily eye using behaviors of the user can be fulfilled.
Drawings
In order to more clearly illustrate the technical solutions of the present invention or the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flow chart of a method for detecting a vision status according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of key points of the eye;
FIG. 3 is a schematic diagram of a prompt device for eyesight protection according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device provided in the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The method for detecting the vision state provided by the embodiment of the invention is applied to an application scene for detecting the vision state of a user so as to early warn and prevent vision problems in advance.
The method for detecting the eyesight state provided by the embodiment of the invention determines at least one of the eye key point of the user and the behavior information of the user by carrying out image detection on a plurality of images in the acquired target video, determines the eyeball position of the user based on the eye key point under the condition that the eye key point of the user is determined, determines whether the user has the strabismus problem according to the eyeball position of the user, and determines whether the user has abnormal eye using behavior based on the behavior information of the user under the condition that the behavior information of the user is determined, thereby further determining whether the user has the problems of myopia or xerophthalmia and the like. Under the condition that the vision state of the user is determined to be an abnormal state, prompt information can be output to remind the user to pay attention to eyes, and therefore the purposes of early warning and preventing the vision state in advance are achieved.
The method for detecting the visual acuity status according to the present invention will be described with reference to fig. 1 to 2.
Fig. 1 is a schematic flow chart of a method for detecting a visual acuity state according to an embodiment of the present invention, where an executive subject of the method for detecting a visual acuity state according to the embodiment of the present invention may be a device for detecting a visual acuity state, and the device may be a mobile terminal device having a display function or a voice prompt function, such as a PC, a smart phone, a tablet computer, a portable computer, or the like, or an electronic device integrated with a camera and various sensors, such as a robot, glasses, or the like. As shown in fig. 1, the method includes:
step 101: and carrying out image detection on a plurality of images in the acquired target video to obtain detection information of the user.
Wherein the detection information comprises eye key points of the user and/or behavior information of the user.
In this step, the electronic device acquires, through the image acquisition device, a target video, where the target video includes a user needing to perform vision state detection, where the user includes a child or a teenager who is learning or reading a book, and may also include other users needing to perform vision state detection, such as an adult who is playing a game, and the specific type of the user is not limited herein.
Illustratively, fig. 2 is a schematic diagram of eye key points, and as shown in fig. 2, the user's eye key points include upper and lower eye socket key points 1, 2, 3 and 4, inner and outer corner key points 5 and 6, and eyeball key point 7.
In addition, the image capturing apparatus may include a structured light camera or a Time of flight (TOF) camera.
Step 102: and determining whether the user has abnormal eye using behaviors or not according to the detection information.
In this embodiment, after determining the detection information of the user, the electronic device determines whether the user has abnormal eye use behavior based on the detection information.
For example, in the case that the detection information includes an eye key point of the user, determining whether the user has an abnormal eye using behavior according to the detection information may be determining a center position of an eyeball according to the eye key point, and determining whether the user has the abnormal eye using behavior according to the center position of the eyeball.
Specifically, after the electronic device obtains each image, the MTCNN network may be used to perform face detection and face key point positioning, where the face key points include eye key points. The eye key points include eyeball key points, and coordinates of the eyeball key points may represent an eyeball center, such as eyeball key point 7 in fig. 2.
For example, in the case where the eyeball is determined to be located in a non-central region of the orbit according to the central position of the eyeball, and/or in the case where the two eyeballs are determined not to be located at the same horizontal position, it is determined that abnormal eye use behavior exists in the user.
Specifically, the electronic device may determine whether the eyeballs of the user are located in a central area of the eye sockets, and if it is determined that any one of the eyeballs is located in a non-central area of the eye sockets, it is determined that the user has an abnormal eye using behavior, such as an oblique eye. The electronic device can also determine whether the two eyeballs are not in the same horizontal position according to the central positions of the eyeballs, and can determine that the user has abnormal eye using behaviors, such as oblique eyes, under the condition that the two eyeballs are not in the same horizontal position. The electronic device may also determine that the user has abnormal eye using behavior, such as an oblique eye problem, when it is determined that any one of the eyeballs of the user is located in a non-central area of the eye socket and the two eyeballs are not located at the same horizontal position.
In the embodiment, the eyeball is positioned through the center position of the eyeball, so that whether the user has abnormal eye using behaviors or not can be determined quickly and accurately.
Further, in order to avoid the situation that the user only moves eyes or occasionally judges the oblique eyes as abnormal vision, when determining whether the user has abnormal eye using behavior, the electronic device may determine that the user has abnormal eye using behavior in the case that the duration of the eyeballs located in the non-central area of the eye sockets is greater than a first preset value, and/or in the case that the duration of the two eyeballs not located at the same horizontal position is greater than a second preset value.
Specifically, when it is determined that the time length of the eyeballs of the user in the non-center area of the eyepit is greater than a first preset value, the electronic device determines that the user has an abnormal eye using behavior, or when it is determined that the time length of the two eyeballs not in the same horizontal position is greater than a second preset value, the electronic device determines that the user has an abnormal eye using behavior, or when it is determined that the time length of the eyeballs of the user in the non-center area of the eyepit is greater than the first preset value and the time length of the two eyeballs not in the same horizontal position is greater than the second preset value, the electronic device determines that the user has an abnormal eye using behavior.
The first preset value and the second preset value may be the same or different, and the values may be set according to actual situations or experience, for example, the values may be set to 10 minutes or 20 minutes, and the specific values of the first preset value and the second preset value are not limited herein.
For example, in the case that the detection information includes behavior information of the user, when determining whether the user has abnormal eye use behavior according to the detection information, it may be determined whether the user has abnormal behavior according to the behavior information of the user, where the abnormal behavior includes at least one of: the method comprises the steps that the user is in a narrow-eye state within a time length exceeding a first preset time period, the number of times of kneading eyes exceeds a third preset value within a second preset time period, and the number of times of winking eyes exceeds a fourth preset value within the third preset time period; and in the case that the user has abnormal behaviors, determining that the user has abnormal eye use behaviors.
Specifically, a plurality of sample images of normal behaviors and a plurality of sample images of abnormal behaviors can be acquired, the behavior of the user in each sample image is marked in a manual marking mode, the plurality of sample images are input into an initial behavior recognition model to obtain a behavior recognition result corresponding to each sample image, the behavior recognition result is compared with the manually marked behavior to determine loss information, network parameters of the initial behavior recognition model are adjusted based on the loss information, the process is repeatedly executed until the loss information is minimum, and the determined model is used as the behavior recognition model.
And inputting a plurality of images included in the target video into the behavior recognition model, so that the behavior information of the user corresponding to each image can be obtained. The behavior information includes various behaviors of the user, such as eating, rubbing eyes, squinting, writing, and the like. After behavior information of the user is obtained, whether the user has abnormal behaviors, such as squinting, eye kneading or blinking and the like, is determined.
It can be understood that, in order to improve the accuracy of recognition and avoid misjudgment, when determining that the user has an eye squinting action, the user can further determine the eye squinting time, and if the user is only in the eye squinting state in a very short time period, the user may have a situation of dozing off or occasionally squinting. If the user is in the squint state within the time length exceeding the first preset time period, the user is indicated to have abnormal eye using behaviors.
In addition, for the eye rubbing action, the eye rubbing times of the user in the second preset time period can be counted, if the eye rubbing times exceed a third preset value, the user is indicated to frequently rub eyes, and at this time, it can be determined that the user has abnormal eye using behaviors. Further, in order to improve the accuracy of determining the eyesight state, the eye-rolling interval duration of the user can be counted, and if the interval duration is smaller than a preset value, frequent eye-rolling of the user is indicated, so that the user can be further determined to have abnormal eye-using behaviors.
For the blinking action, the blinking times of the user in a third preset time period may be counted, and if the blinking times exceed a fourth preset value, it is indicated that the user blinks frequently, and at this time, it may be determined that the user has abnormal eye using behavior. Furthermore, in order to improve the accuracy of determining the vision state, the blinking interval duration of the user can be counted, and if the interval duration is smaller than a preset value, frequent blinking of the user is indicated, so that the user can be further determined to have abnormal eye using behaviors.
The first preset time period, the second preset time period, and the third preset time period may be set to the same value, or may be set to different values, and the values may be set according to actual conditions or experience, for example, the values may be set to 10 minutes or 20 minutes, and the specific values of the first preset time period, the second preset time period, and the third preset time period are not limited in this embodiment of the present invention.
In the embodiment, whether the user has the abnormal eye using behavior or not can be determined based on the behavior information of the user so as to determine the vision state of the user, so that the vision state of the user can be warned conveniently and efficiently according to the daily eye using behavior of children.
Step 103: and under the condition that the user has abnormal eye using behaviors, determining the vision state of the user according to the abnormal eye using behaviors, wherein the vision state comprises a normal state and an abnormal state.
Specifically, in the case where it is determined that there is abnormal eye use behavior of the user, the visual acuity state of the user will be further determined. The electronic device may determine the vision state of the user according to the abnormal eye use behavior of the user, and specifically, the determining may include determining that the vision state of the user is an abnormal state when the number of times of the abnormal eye use behavior is greater than a preset number of times within a first preset time period.
Specifically, in order to improve the accuracy of determining the visual acuity state of the user and eliminate the misjudgment, the number of times of the abnormal eye-use behavior of the user within the first preset time period may be counted, for example, the number of times of the abnormal eye-use behavior of the user within one week or one month may be counted, and when the number of times of the abnormal eye-use behavior of the user within the first preset time period is greater than the preset number of times, it is described that the abnormal eye-use behavior of the user occurs more frequently, and it may be determined that the visual acuity state of the user is abnormal at this time.
In this embodiment, the number of times that the user has abnormal eye use behavior within the first preset time period may be counted to determine whether the visual state of the user is abnormal according to the number of times, so that the situation of misjudgment may be reduced, and the accuracy of the visual state detection may be improved.
Further, the electronic device may determine whether the eyes of the target user are reddened based on the multiple images in the target video, and if the number of times of reddening of the eyes of the user exceeds a preset number of times within the first preset time period, it is indicated that the eye state of the user is abnormal.
For example, the electronic device may further determine a distance between the head of the user and the desktop through the structured light camera or the TOF camera, or determine a distance between the head and the terminal device, and determine that the user has an abnormal eye use behavior when the distance is smaller than a fifth preset value; and determining the vision state of the user to be an abnormal state under the condition that the frequency of the abnormal eye using behaviors is greater than the preset frequency within the second preset time.
Specifically, when the electronic device acquires the target video through the structured light camera or the TOF camera, the distance between the head of the user and the desktop can be further acquired, specifically, the distance between the face or eyes of the user and the desktop can be determined, or the distance between the head and the terminal device can be acquired, and specifically, the distance between the face or eyes of the user and the terminal device can be determined.
Hereinafter, the determination of the distance between the head and the desktop is taken as an example for explanation, and the determination of the distance between the head and the terminal device is similar to the determination of the distance between the head and the desktop, and is not described herein again.
The distance between the head and the desktop may include a distance between any one point of the head and the desktop edge, and may also include a distance between any one point of the head and a gaze point of the user on the desktop, for example, the distance between the top of the head and the desktop edge, or the distance between the eyes of the user and the gaze point, and the like.
In a specific implementation process, a book on a desktop and a face of a user can be simultaneously positioned in a visual field range of a camera, and the position of the book (or an ipad or a mobile phone) on the desktop is detected through a target detection algorithm, so that distance information between the face and the corresponding position can be acquired.
The structure light is a system structure composed of a projector and a camera, the projector is adopted to project specific light information to the surface of an object and the background, the specific light information is collected by the camera, and information such as the position and the depth of the object is calculated according to the change of a light signal caused by the object, for example, the distance between the head of a user and a desktop is calculated. TOF camera is when shooing the target video, can outwards launch infrared light (laser pulse), infrared light (laser pulse) meets object (head, desktop) after reflection, the reflection finishes to the camera, through calculating from launching to reflecting back the time difference or the phase difference of camera, thereby can determine the camera to the distance of head and camera to the distance of desktop, the degree of depth information that obtains through the RGB image that combines to obtain and structured light, can pass through coordinate transformation, determine the absolute coordinate of eyes and the absolute coordinate of point of fixation, can calculate the distance of head to desktop through above-mentioned two coordinates.
After the distance between the head of the user and the desktop is determined, in order to eliminate the situation of misjudgment, for example, to eliminate the behavior that the user accidentally lowers the head or operates the terminal device, and the like, from being determined as the abnormal eye using behavior, in practical application, it may be determined whether the distance is always smaller than a fifth preset value within a time period exceeding a fourth preset time period, and if the distance is smaller than the fifth preset value within the time period exceeding the fourth preset time period, it is determined that the distance between the head of the user and the desktop is too small, so that it may be determined that the abnormal eye using behavior exists in the user. The fifth preset value may be set according to actual conditions or experience such as a height of a user or a height of a desktop, for example, may be set to 33cm, and a specific value of the fifth preset value is not limited herein.
And under the condition that the user is determined to have the abnormal eye using behavior, further judging whether the frequency of the abnormal eye using behavior is greater than the preset frequency within a second preset time length, and if the frequency of the abnormal eye using behavior is greater than the preset frequency, determining that the vision state of the user is an abnormal state. For example, the number of times of the abnormal eye-using behavior of the user in one week or one month may be counted, and when the number of times of the abnormal eye-using behavior of the user in the second preset time period is greater than the preset number of times, it is described that the abnormal eye-using behavior of the user occurs frequently, for example, when the distance between the head and the desktop is frequently small, or the distance between the head and the terminal device is small, it may be determined that the visual state of the user is abnormal.
In this embodiment, whether the vision state of the user is abnormal or not can be determined according to the times by counting the times that the distance between the head of the user and the desktop or between the head of the user and the terminal device is smaller than the fifth preset value within the second preset time, so that the condition of misjudgment can be reduced, and the accuracy of vision state detection can be improved.
In addition, with the popularization of online courses, more and more children can learn online through electronic devices, such as mobile phones and IPADs. When a user learns using the IPAD, the IPAD may not be laid flat on a table, but is generally supported by a stand and placed in front of the table.
After the distance between the eyes of the user and the fixation point on the mobile phone or the IPAD is determined, whether the distance is smaller than a fifth preset value in a time period exceeding a fourth preset time period or not can be judged, and if the distance is smaller than the fifth preset value in the time period exceeding the fourth preset time period, the fact that the distance between the head of the user and the mobile phone or the IPAD is too small is indicated, so that the fact that abnormal eye using behaviors exist in the user can be determined.
And under the condition that the user has the abnormal eye using behavior, further judging whether the frequency of the abnormal eye using behavior is greater than the preset frequency within a second preset time length, and if the frequency of the abnormal eye using behavior is greater than the preset frequency, determining that the vision state of the user is the abnormal state. For example, the number of times of the abnormal eye-using behavior of the user in one week or one month may be counted, and when the number of times of the abnormal eye-using behavior of the user in the second preset time period is greater than the preset number of times, it is described that the abnormal eye-using behavior of the user occurs frequently, for example, when the distance between the head and the mobile phone or the IPAD is frequently small, it may be determined that the visual state of the user is abnormal.
In this embodiment, the number of times that the distance between the head of the user and the terminal device is smaller than the fifth preset value in the second preset time period may be counted to determine whether the vision state of the user is abnormal according to the number of times, so that the situation of misjudgment may be reduced, and the accuracy of the vision state detection may be improved.
Step 104: and under the condition that the vision state of the user is determined to be an abnormal state, outputting prompt information, wherein the prompt information is used for reminding the user that the vision is abnormal.
Specifically, when the vision state of the user is determined to be an abnormal state, for example, when the user has abnormal conditions such as strabismus, myopia or xerophthalmia, the electronic device outputs prompt information. Wherein, the prompt message can be output by voice, text, image or other modes. For example, the user may be reminded by voice reminding that "the eyes are at risk of myopia, please pay attention to the eyes, and advise to go to the hospital for further examination", or output "there may be a situation of oblique eyes, advise to go to the hospital for further examination" through the display screen, and so on.
The method for detecting the eyesight state provided by the embodiment of the invention obtains the detection information of the user by carrying out image detection on a plurality of images in the acquired target video, wherein the detection information comprises: eye key points of the user and/or behavior information of the user; determining whether the user has abnormal eye using behaviors or not according to the detection information; determining the vision state of the user according to the abnormal eye using behavior under the condition that the user has the abnormal eye using behavior, wherein the vision state comprises a normal state and an abnormal state; and under the condition that the vision state of the user is determined to be an abnormal state, outputting prompt information, wherein the prompt information is used for reminding the user that the vision is abnormal. Whether the abnormal eye using behaviors exist in the user can be determined through the daily eye using behaviors of the user, the vision state of the user is further determined under the condition that the abnormal eye using behaviors exist, and the prompt information is output to remind the user under the condition that the vision state of the user is determined to be the abnormal state, so that the aims of early warning and preventing the vision state in advance based on the daily eye using behaviors of the user can be fulfilled.
The following describes the device for detecting visual acuity status provided by the present invention, and the device for detecting visual acuity status described below and the method for detecting visual acuity status described above can be referred to in correspondence with each other.
Fig. 3 is a schematic diagram of a device for detecting eyesight states according to an embodiment of the present invention, as shown in fig. 3, the device 30 includes:
the detection module 11 is configured to perform image detection on multiple images in the acquired target video to obtain detection information of a user, where the detection information includes: eye key points of the user and/or behavior information of the user;
a determining module 12, configured to determine whether the user has an abnormal eye use behavior according to the detection information;
the determining module 12 is further configured to determine, according to the abnormal eye using behavior, a vision state of the user when the user has the abnormal eye using behavior, where the vision state includes a normal state and an abnormal state;
and the output module 13 is configured to output prompt information when it is determined that the vision state of the user is an abnormal state, where the prompt information is used to remind the user that the vision is abnormal.
Optionally, the detection information includes eye key points of the user;
the determining module 12 is specifically configured to:
determining the central position of the eyeball according to the eye key point;
and determining whether the user has abnormal eye using behaviors or not according to the central position of the eyeball.
Optionally, the determining module 12 is specifically configured to:
and determining whether the user has abnormal eye using behaviors or not under the condition that the eyeball is positioned in a non-central area of the eyepit according to the central position of the eyeball and/or under the condition that the two eyeballs are not positioned at the same horizontal position.
Optionally, the determining module 12 is specifically configured to:
and determining that the user has abnormal eye using behaviors when determining that the time length of the eyeballs in the non-central area of the eye sockets is greater than a first preset value and/or the time length of the two eyeballs which are not in the same horizontal position is greater than a second preset value.
Optionally, the detection information includes behavior information of the user;
the determining module 12 is specifically configured to:
according to the behavior information of the user, determining that the user has the abnormal eye use behavior under the condition that the user is determined to have at least one of the following behaviors: the glasses are in a squinting state in a time length exceeding a first preset time period, the eye kneading times in a second preset time period exceed a third preset value, and the blinking times in the third preset time period exceed a fourth preset value.
Optionally, the determining module 12 is specifically configured to:
and determining that the vision state of the user is an abnormal state under the condition that the frequency of the abnormal eye using behaviors is greater than the preset frequency within a first preset time.
Optionally, the determining module 12 is further configured to:
determining the distance between the head of the user and a desktop or the distance between the head of the user and the terminal equipment through a structured light camera or a time of flight (TOF) camera;
determining that the user has abnormal eye use behaviors when the distances are all smaller than a fifth preset value within a time length exceeding a fourth preset time period;
and determining that the vision state of the user is an abnormal state under the condition that the frequency of the abnormal eye using behaviors is greater than the preset frequency within a second preset time length.
The device for detecting a visual acuity state provided by the embodiment of the present invention can be used for executing the method of any embodiment of the foregoing method for detecting a visual acuity state, and the specific implementation process is similar to the technical effect in the embodiment of the method for detecting a visual acuity state, which can specifically refer to the detailed description in the embodiment of the method for detecting a visual acuity state, and is not described herein again.
Fig. 4 illustrates a physical structure diagram of an electronic device, which may include, as shown in fig. 4: a processor (processor)410, a communication Interface (Communications Interface)420, a memory (memory)430 and a communication bus 440, wherein the processor 410, the communication Interface 420 and the memory 430 are in communication with each other via the communication bus 440. The processor 410 may invoke logic instructions in the memory 430 to perform a method of vision state detection, the method comprising: carrying out image detection on a plurality of images in the acquired target video to obtain detection information of a user, wherein the detection information comprises: eye key points of the user and/or behavior information of the user; determining whether the user has abnormal eye using behaviors or not according to the detection information; under the condition that the user has abnormal eye using behaviors, determining the vision state of the user according to the abnormal eye using behaviors, wherein the vision state comprises a normal state and an abnormal state; and under the condition that the vision state of the user is determined to be an abnormal state, outputting prompt information, wherein the prompt information is used for reminding the user of the abnormal vision.
Furthermore, the logic instructions in the memory 430 may be implemented in software functional units and stored in a computer readable storage medium when sold or used as a stand-alone product. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In another aspect, the present invention also provides a computer program product, the computer program product comprising a computer program, the computer program being storable on a non-transitory computer-readable storage medium, the computer program, when executed by a processor, being capable of executing the method for detecting a vision state provided by the above methods, the method comprising: carrying out image detection on a plurality of images in the acquired target video to obtain detection information of a user, wherein the detection information comprises: eye key points of the user and/or behavior information of the user; determining whether the user has abnormal eye using behaviors or not according to the detection information; under the condition that the user has abnormal eye using behaviors, determining the vision state of the user according to the abnormal eye using behaviors, wherein the vision state comprises a normal state and an abnormal state; and outputting prompt information under the condition that the vision state of the user is determined to be an abnormal state, wherein the prompt information is used for reminding the user that the vision is abnormal.
In yet another aspect, the present invention also provides a non-transitory computer-readable storage medium having stored thereon a computer program, which when executed by a processor, implements a method for detecting a vision state provided by the above methods, the method including: carrying out image detection on a plurality of images in the acquired target video to obtain detection information of a user, wherein the detection information comprises: eye key points of the user and/or behavior information of the user; determining whether the user has abnormal eye using behaviors or not according to the detection information; under the condition that the user has abnormal eye using behaviors, determining the vision state of the user according to the abnormal eye using behaviors, wherein the vision state comprises a normal state and an abnormal state; and outputting prompt information under the condition that the vision state of the user is determined to be an abnormal state, wherein the prompt information is used for reminding the user that the vision is abnormal.
The above-described embodiments of the apparatus are merely illustrative, wherein the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, i.e. may be located in one place, or may also be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A method for detecting a visual acuity status, comprising:
carrying out image detection on a plurality of images in the acquired target video to obtain detection information of a user, wherein the detection information comprises: eye key points of the user and/or behavior information of the user;
determining whether the user has abnormal eye using behaviors or not according to the detection information;
under the condition that the user has abnormal eye using behaviors, determining the vision state of the user according to the abnormal eye using behaviors, wherein the vision state comprises a normal state and an abnormal state;
and outputting prompt information under the condition that the vision state of the user is determined to be an abnormal state, wherein the prompt information is used for reminding the user that the vision is abnormal.
2. The vision status detection method according to claim 1, wherein the detection information includes eye key points of the user;
the determining whether the user has abnormal eye using behavior according to the detection information includes:
determining the central position of the eyeball according to the eye key point;
and determining whether the user has abnormal eye using behaviors or not according to the central position of the eyeball.
3. The method for detecting eyesight state according to claim 2, wherein the determining whether the user has abnormal eye use behavior according to the center position of the eyeball comprises:
determining that the abnormal eye using behavior exists in the user when the eyeball is determined to be located in a non-central area of the eyepit according to the central position of the eyeball and/or when the two eyeballs are determined not to be located at the same horizontal position.
4. The visual acuity state detection method according to claim 1, wherein the detection information includes behavior information of the user;
the determining whether the user has abnormal eye using behavior according to the detection information includes:
according to the behavior information of the user, determining that the user has the abnormal eye use behavior under the condition that the user is determined to have at least one of the following behaviors: the glasses are in a squinting state in a time length exceeding a first preset time period, the eye kneading times in a second preset time period exceed a third preset value, and the blinking times in the third preset time period exceed a fourth preset value.
5. The vision state detection method according to any one of claims 1-4, wherein the determining the vision state of the user according to the abnormal eye use behavior comprises:
and determining that the vision state of the user is an abnormal state under the condition that the frequency of the abnormal eye using behaviors is greater than the preset frequency within a first preset time.
6. The method for detecting a visual acuity state according to any one of the claims 1-4, wherein the method further comprises:
determining the distance between the head of the user and a desktop or the distance between the head of the user and the terminal equipment through a structured light camera or a time of flight (TOF) camera;
determining that the user has abnormal eye use behaviors when the distances are all smaller than a fifth preset value within a time length exceeding a fourth preset time period;
and determining that the vision state of the user is an abnormal state under the condition that the frequency of the abnormal eye using behaviors is greater than the preset frequency within a second preset time length.
7. An apparatus for detecting a visual acuity status, comprising:
the detection module is used for carrying out image detection on a plurality of images in the collected target video to obtain detection information of a user, wherein the detection information comprises: eye key points of the user and/or behavior information of the user;
the determining module is used for determining whether the user has abnormal eye using behaviors according to the detection information;
the determining module is further configured to determine, according to the abnormal eye using behavior, a vision state of the user under the condition that the user has the abnormal eye using behavior, where the vision state includes a normal state and an abnormal state;
and the output module is used for outputting prompt information under the condition that the vision state of the user is determined to be an abnormal state, wherein the prompt information is used for reminding the user that the vision is abnormal.
8. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method for detecting a vision state of any one of claims 1 to 6 when executing the program.
9. A non-transitory computer-readable storage medium on which a computer program is stored, the computer program, when being executed by a processor, implementing a method for detecting a vision state according to any one of claims 1 to 6.
10. A computer program product comprising a computer program, wherein the computer program, when executed by a processor, implements the method of vision state detection of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210592920.1A CN115100728A (en) | 2022-05-27 | 2022-05-27 | Method, apparatus, storage medium and program product for detecting visual acuity status |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210592920.1A CN115100728A (en) | 2022-05-27 | 2022-05-27 | Method, apparatus, storage medium and program product for detecting visual acuity status |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115100728A true CN115100728A (en) | 2022-09-23 |
Family
ID=83289581
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210592920.1A Pending CN115100728A (en) | 2022-05-27 | 2022-05-27 | Method, apparatus, storage medium and program product for detecting visual acuity status |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115100728A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116936097A (en) * | 2023-07-24 | 2023-10-24 | 云南白药集团无锡药业有限公司 | Training lamp user eye abnormal movement intelligent detection method |
| CN117671908A (en) * | 2023-12-06 | 2024-03-08 | 广州视域光学科技股份有限公司 | Myopia prevention and control system based on behavior monitoring and prevention and control method thereof |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105022981A (en) * | 2014-04-18 | 2015-11-04 | 中兴通讯股份有限公司 | Method and device for detecting health state of human eyes and mobile terminal |
| CN109977727A (en) * | 2017-12-27 | 2019-07-05 | 广东欧珀移动通信有限公司 | Sight protectio method, apparatus, storage medium and mobile terminal |
| CN110555426A (en) * | 2019-09-11 | 2019-12-10 | 北京儒博科技有限公司 | Sight line detection method, device, equipment and storage medium |
| CN110889955A (en) * | 2019-11-29 | 2020-03-17 | 上海掌门科技有限公司 | Method and equipment for reminding user of rest when user reads |
-
2022
- 2022-05-27 CN CN202210592920.1A patent/CN115100728A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105022981A (en) * | 2014-04-18 | 2015-11-04 | 中兴通讯股份有限公司 | Method and device for detecting health state of human eyes and mobile terminal |
| CN109977727A (en) * | 2017-12-27 | 2019-07-05 | 广东欧珀移动通信有限公司 | Sight protectio method, apparatus, storage medium and mobile terminal |
| CN110555426A (en) * | 2019-09-11 | 2019-12-10 | 北京儒博科技有限公司 | Sight line detection method, device, equipment and storage medium |
| CN110889955A (en) * | 2019-11-29 | 2020-03-17 | 上海掌门科技有限公司 | Method and equipment for reminding user of rest when user reads |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116936097A (en) * | 2023-07-24 | 2023-10-24 | 云南白药集团无锡药业有限公司 | Training lamp user eye abnormal movement intelligent detection method |
| CN117671908A (en) * | 2023-12-06 | 2024-03-08 | 广州视域光学科技股份有限公司 | Myopia prevention and control system based on behavior monitoring and prevention and control method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9291834B2 (en) | System for the measurement of the interpupillary distance using a device equipped with a display and a camera | |
| CN115100728A (en) | Method, apparatus, storage medium and program product for detecting visual acuity status | |
| CN109191802B (en) | Method, device, system and storage medium for eyesight protection prompt | |
| EP3641624B1 (en) | Determining eye openness with an eye tracking device | |
| CN107358217B (en) | Sight estimation method and device | |
| EP3582071B1 (en) | Devices having system for reducing the impact of near distance viewing on myopia onset and/or myopia progression | |
| CN112006900B (en) | Control method and system of intelligent desk lamp capable of preventing myopia and storage medium | |
| CN111248851A (en) | Visual function self-testing method | |
| CN105095885A (en) | Human eye state detection method and detection device | |
| García et al. | Dioptric defocus maps across the visual field for different indoor environments | |
| Balsdon et al. | How wide is the cone of direct gaze? | |
| Xiong et al. | Eye control system base on ameliorated hough transform algorithm | |
| CN104504374A (en) | Method and system for automatically monitoring distance from human eyes to screen | |
| US10108259B2 (en) | Interaction method, interaction apparatus and user equipment | |
| CN111580665A (en) | Method and device for predicting fixation point, mobile terminal and storage medium | |
| CN113495616A (en) | Terminal display control method, terminal, and computer-readable storage medium | |
| CN115116088A (en) | Myopia prediction method, apparatus, storage medium, and program product | |
| US20190346921A1 (en) | Devices having system with enhanced functionality for reducing the impact of near distance viewing on myopia onset and/or myopia progression | |
| CN113596539B (en) | Vision detection processing method, device, terminal and medium based on intelligent television | |
| CN112203131B (en) | Prompting method and device based on display equipment and storage medium | |
| CN113132642A (en) | Image display method and device and electronic equipment | |
| CN115035588A (en) | Eyesight protection prompting method, device, storage medium and program product | |
| CN111198611A (en) | Method for determining sight line landing point, terminal and computer readable storage medium | |
| CN111583600B (en) | Apparatus for preventing myopia and computer readable storage medium | |
| CN117872561A (en) | Focal length adjustment method, focal length adjustment device, VR device and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |