WO2015158087A1 - Method and apparatus for detecting health status of human eyes and mobile terminal - Google Patents

Method and apparatus for detecting health status of human eyes and mobile terminal Download PDF

Info

Publication number
WO2015158087A1
WO2015158087A1 PCT/CN2014/084844 CN2014084844W WO2015158087A1 WO 2015158087 A1 WO2015158087 A1 WO 2015158087A1 CN 2014084844 W CN2014084844 W CN 2014084844W WO 2015158087 A1 WO2015158087 A1 WO 2015158087A1
Authority
WO
WIPO (PCT)
Prior art keywords
eye
state
preset
user
blinks
Prior art date
Application number
PCT/CN2014/084844
Other languages
French (fr)
Chinese (zh)
Inventor
晏国淇
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2015158087A1 publication Critical patent/WO2015158087A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition

Definitions

  • the present invention relates to the field of communications, and in particular, to a method, a device, and a mobile terminal for detecting a healthy state of a human eye.
  • blinking is to increase the moisturization of the eyes and promote the secretion of mucus from the eyes to moisturize the eye mask.
  • the blink frequency will drop to about 10 seconds or more. If the user maintains such bad habits for a long time, it may cause problems such as decreased vision, dry eyes, and even induce dry eye syndrome, lacrimal gland atrophy and other organic diseases of the eye.
  • the number of blinks is small, which is likely to cause eye problems.
  • the existing terminals are relatively smart, they cannot urge the user to protect the eyesight, resulting in a decrease in the user's vision.
  • the present invention provides a method, a device, and a mobile terminal for detecting a health state of a human eye, which are used to solve the problem in the prior art, when a user uses a terminal, because the number of blinks is small, an eye problem is easily caused.
  • the terminals are relatively smart, they cannot urge users to protect their vision, which leads to the problem of decreased eyesight.
  • the present invention provides a method for detecting a health state of a human eye, comprising: acquiring, by a camera, a number of blinks of an eye within a predetermined time period; comparing the number of blinks with a threshold of a preset number of blinks, The health state of the user's eyes is determined according to the comparison result, and a corresponding eye prompt is issued according to the health state.
  • the obtaining the blinking times of the eyes in the predetermined time period by the camera includes: placing the eyes in the blinking state of the user in front of the camera, maintaining the first predetermined length of time, and acquiring the predetermined area in the blinking state by the camera.
  • Gray scale information wherein the predetermined area is a preset pattern that is taken out from the center of each eye; after the first predetermined time period, the gray in the preset area is collected according to the first preset time interval Degree information, and determining a closed state of the current eye of the user according to the changed value of the collected grayscale information, wherein, when the change value of the grayscale information is within a preset variation range, determining that the eye is in a state
  • the eye state determines that the eye is in the closed eye state when the change value of the gray scale information exceeds the preset change range; and determines the number of blinks according to the closed state of the eye that is counted in the predetermined time period.
  • the obtaining the blinking times of the eyes in the predetermined time period by the camera includes: placing the eyes in the blinking state of the user in front of the camera, maintaining the second predetermined duration, and acquiring the current image to record the grayscale information of the predetermined area in the blinking state.
  • the predetermined area is a preset pattern that is taken out from the center of each of the eyes; after the second predetermined time length, the image corresponding to the preset area is collected according to the second preset time interval, and And averaging the gray level information corresponding to all the collected images, and determining an extreme point of the average value to determine a maximum value of the gray level change rate in the preset range of the extreme point; according to the gray level change
  • the maximum value of the rate determines the closed state of the current eye of the user, wherein the image corresponding to the extreme value of the predetermined multiple of the maximum value of the gray-scale change rate is determined to be a closed-eye state, Determining that the image corresponding to the extreme value of the change range of the gray-scale change rate is equal to or smaller than the maximum value of the maximum value of the gray-scale change rate is a blink state; The closed state of the eye counted during the predetermined time period determines the number of blinks.
  • Comparing the number of blinks with a preset threshold of blinks, and determining, according to the comparison result, a health state of the eye of the user includes: determining, in a case where the number of blinks is greater than or equal to a threshold of the preset number of blinks, The eye is in a healthy state; in a case where the number of blinks is less than the threshold of the preset number of blinks, it is determined that the eye is in a tired state.
  • the corresponding eye prompts are issued according to the health status: in the case that the user's eyes are in a tired state, an alarm sound and/or a prompt box is issued to prompt the user that the eyes need rest.
  • the method further includes: detecting whether face information appears in the camera; and detecting whether the camera detects the eye information in the case that the face information appears; In the case where the eye information is detected, the number of blinks of the eye within a predetermined period of time is acquired by the camera.
  • the present invention provides an apparatus for detecting a health state of a human eye, comprising: an acquisition module configured to acquire a blink number of an eye within a predetermined time period by a camera; and a determining module configured to set the number of blinks and a preset The blink threshold is compared, and the health state of the user's eyes is determined according to the comparison result, and a corresponding eye prompt is issued according to the health state.
  • the acquiring module includes: a first acquiring unit, configured to: place an eye in a blinking state of the user in front of the camera, maintain the first predetermined duration, and obtain gray information of a predetermined area in a blinking state by using the camera, where The predetermined area is a preset pattern that is taken out from the center of each of the eyes.
  • the first determining unit is configured to collect the preset area according to the first preset time interval after the first predetermined time length.
  • the gray scale information and determining the closed state of the current eye of the user according to the changed value of the collected gray scale information, wherein when the change value of the gray scale information is within a preset variation range, determining the eye In a blinking state, when the change value of the gray scale information exceeds the preset change range, determining that the eye is in a closed eye state; the first statistical unit is configured to count the eye according to the predetermined time period The closed state determines the number of blinks.
  • the acquiring module includes: a second acquiring unit, configured to place an eye in a blinking state in front of the camera, maintain a second predetermined duration, and acquire a current image to record grayscale information of a predetermined region in a blinking state.
  • the predetermined area is a preset pattern that is taken out from the center of each eye; the second determining unit is configured to collect the preset according to the second preset time interval after the second predetermined time length An image corresponding to the region, and averaging the grayscale information corresponding to all the acquired images, and determining an extreme value of the average value to determine a maximum value of the grayscale change rate in the preset range of the extreme value point Determining, according to the maximum value of the gray-scale change rate, a closed state in which the user's current eye is located, wherein it is determined that the range of change of the gray-scale change rate exceeds an extreme value of a predetermined multiple of the maximum value of the gray-scale change rate
  • the image is in the closed-eye state, and the image corresponding to the extreme value of the predetermined multiple of the maximum value of the gray-scale change rate is determined to be ⁇ State; a second counting unit arranged to determine a statistical time period according to the predetermined closed state of the wide open eye blinks.
  • the present invention provides a mobile terminal, comprising: the apparatus for detecting a human eye health state according to any one of the preceding claims.
  • the invention collects the number of blinks of the eye through the camera, and compares the data with a preset threshold of the number of blinks to determine the health state of the eye to present different eye tips, so that when the user uses the terminal, The user's eye is monitored by the camera corresponding to the terminal, and the user's eyesight is protected.
  • the number of blinks is small, which may cause eye problems.
  • FIG. 1 is a flow chart of a method for detecting a human eye health state according to an embodiment of the present invention
  • FIG. 2 is a schematic structural view of an apparatus for detecting a human eye health state according to an embodiment of the present invention
  • 3 is a schematic structural diagram of a device acquisition module for detecting a human eye health state according to an embodiment of the present invention
  • FIG. 4 is a schematic structural diagram of a device acquisition module for detecting a human eye health state according to an embodiment of the present invention
  • FIG. 1 is a flow chart of a method for detecting a human eye health state according to an embodiment of the present invention
  • FIG. 2 is a schematic structural view of an apparatus for detecting a human eye health state according to an embodiment of the present invention
  • 3 is a schematic structural diagram of a device acquisition module for detecting a human eye health state according to an embodiment of the present invention
  • FIG. 4 is a schematic structural diagram of a device acquisition module for detecting a human eye health state according to an embodiment of the present invention
  • FIG. 6 is a flow chart of a method for detecting a healthy state of a human eye in a preferred embodiment of the present invention
  • FIG. 7 is a flowchart of extracting an eye ROI in a preferred embodiment of the present invention
  • FIG. 8 is a schematic diagram of human eye ROI cutting during extraction of eye ROI in a preferred embodiment of the present invention
  • FIG. 9 is a schematic diagram of determining human eye ROI during extraction of eye ROI in a preferred embodiment of the present invention
  • 10 is a schematic view of the eye in a half-open half-closed state in a preferred embodiment of the present invention
  • FIG. 11 is a schematic view showing only one eye detected in a closed-eye state in a preferred embodiment of the present invention
  • FIG. 11 is a schematic view showing only one eye detected in a closed-eye state in a preferred embodiment of the present invention
  • FIG. 12 is a closed view in a preferred embodiment of the present invention.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In order to solve the problem in the prior art, when a user uses a terminal, since the number of blinks is small, eye problems are easily caused.
  • the present invention provides a method, device and mobile terminal for detecting a healthy state of a human eye, and the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
  • An embodiment of the present invention provides a method for detecting a healthy state of a human eye. As shown in FIG. 1, the method includes steps S102 to S104:
  • S102 Obtain a blinking number of eyes in a predetermined time period by using a camera.
  • the number of blinks of the eye can also be presented in various forms, for example, the number of times is presented in frequency.
  • S104 Compare the number of blinks with a preset threshold of blinks, determine a health state of the user's eyes according to the comparison result, and issue a corresponding eye prompt according to the health state.
  • the number of blinks of the eye is collected by the camera, and the data is compared with a preset threshold of the number of blinks to determine the health state of the eye to present different eye tips, so that when the user uses the terminal
  • the camera can be supervised by the camera corresponding to the terminal to protect the user's eyesight.
  • the number of blinks is small, which is easy to cause eye problems, and the existing terminals are relatively smart.
  • the number of blinks of the eye in the predetermined time period can be obtained by the camera.
  • the eye in the blinking state can be placed in front of the camera for the first predetermined time (for example, 1 second).
  • Obtaining gray scale information of a predetermined area in a blinking state wherein the predetermined area is a preset pattern taken out from the center of each eye, and may be a rectangle or a circle, etc.; after the first predetermined time period, according to the first
  • the preset time interval is used to collect the gray scale information in the preset area, and the closed state of the current eye of the user is determined according to the changed value of the collected gray scale information, wherein when the change value of the gray scale information is in the preset variation range
  • the eye is determined to be in the closed eye state; and the blinking is determined according to the closed state of the eye counted in the predetermined time period.
  • the number of blinks of the eye in the predetermined time period obtained by the camera may also be that the eye in the blinking state is placed in front of the camera for a second predetermined duration (the second predetermined duration may be the same as the first predetermined duration), obtaining the current
  • the image is used to record grayscale information of a predetermined area in a blinking state, wherein the predetermined area is a preset pattern that is taken out from the center of each eye; after the second predetermined length of time, the preset is collected according to the second preset time interval.
  • the maximum value of the degree of change of the degree of change determines the state of the closed state in which the user's current eye is located, wherein the image corresponding to the extreme value of the predetermined multiple of the maximum value of the gray-scale change rate is determined to be a closed-eye state, Determining that the image corresponding to the extreme value of the gray level change rate is equal to or smaller than the maximum value of the gray level change rate is a blinking state; After the closed state of eyes wide open in accordance with a predetermined time period to determine the statistical number of blinks.
  • the above two implementations can determine the number of blinks, and those skilled in the art can also perform other methods based on the foregoing solution, and no further details are provided herein.
  • the number of blinks when the number of blinks is greater than or equal to the threshold of the preset number of blinks, it can be determined that the eye is in a healthy state; when the number of blinks is less than the threshold of the preset number of blinks, it can be determined that the eye is in Tired state.
  • the health status of the eyes can be divided into various forms, for example, health status, sub-health status, fatigue status, etc., and different classification levels can be set according to needs and experience.
  • the implementation process in order to further enhance the accuracy of the monitoring, it is possible to detect whether or not the face information appears in the camera before the number of blinks of the eye in the predetermined time period is obtained by the camera; in the case where the face information appears, the detection of the camera is detected. To the eye information, if the face information does not appear, the next operation is not performed; in the case where the eye information is detected, the number of blinks of the eye in the predetermined time period is acquired by the camera, and if the eye information is not detected, the next operation is not performed.
  • One-step acquisition operation at this time, you can remind the user to blink and other operations.
  • an alert tone and/or a prompt box may be issued to the user to prompt the user to rest the eye to further protect the eyesight.
  • the embodiment of the present invention further provides a device for detecting a healthy state of a human eye, and the structure thereof is as shown in FIG. 2, including: an obtaining module 10, configured to acquire a blinking number of an eye in a predetermined time period by using a camera; and determining a module 20, The method is coupled to the acquisition module 10, and is configured to compare the number of blinks with a preset threshold of the number of blinks, determine a health state of the user's eyes according to the comparison result, and issue a corresponding eye prompt according to the health state.
  • FIG. 3 shows a first structural diagram of the acquisition module 10, which includes: a first acquisition unit 101, configured to place an eye in a blinking state in front of the camera for a first predetermined duration, and obtain the image through the camera.
  • the grayscale information in the preset area is collected according to the first preset time interval, and the closed state of the current eye of the user is determined according to the changed value of the collected grayscale information, wherein when the grayscale information changes value In the case of the preset variation range, it is determined that the eye is in the blinking state, and when the change value of the grayscale information exceeds the preset variation range, determining that the eye is in the closed eye state; the first statistical unit 103, and the first determination The unit 102 is coupled to determine the number of blinks based on the closed state of the eye counted during the predetermined time period.
  • FIG. 4 is a schematic structural diagram of the acquisition module 10, which includes: a second acquisition unit 104, configured to place an eye in a blinking state in front of the camera for a second predetermined duration, to obtain a current image. Recording the gradation information of the predetermined area in the blinking state, wherein the predetermined area is a preset pattern taken out from the center of each eye; the second determining unit 105 is coupled to the second obtaining unit 104, and is set to be in the second After the predetermined length of time, the image corresponding to the preset area is collected according to the second preset time interval, and the gray level information corresponding to all the collected images is averaged, and the extreme value is obtained for the average value to determine the extreme value point.
  • the maximum value of the gray level change rate is set; the closed state of the current eye of the user is determined according to the maximum value of the gray rate change rate, wherein the range of the gray level change rate is determined to exceed the maximum value of the gray level change rate by a predetermined multiple
  • the image corresponding to the extreme point is a closed-eye state, and the range of the change of the gray-scale change rate is determined to be equal to or smaller than the maximum value of the predetermined multiple of the maximum value of the gray-scale change rate.
  • FIG. 5 is a schematic diagram showing a preferred structure of a device for detecting a state of health of a human eye.
  • the device may further include a detecting module 30 configured to detect whether face information appears in the camera, and a face appears. In the case of information, it is detected whether the camera detects eye information, and in the case where the eye information is detected, the number of blinks of the eye in the predetermined time period is acquired by the camera.
  • the acquisition module may be further configured to issue an alarm sound and/or a prompt box to prompt the user that the eye needs rest if the user's eyes are in a tired state.
  • the embodiment of the invention further provides a mobile terminal, which may have a camera itself or may be connected to the camera through an external device.
  • the mobile terminal is provided with the above-mentioned functions that can be implemented by the device for detecting the health state of the human eye, or integrates the device for detecting the health state of the human eye in the mobile phone. Therefore, the mobile terminal includes the respective modules of the device for detecting the health state of the human eye.
  • the preferred embodiment camera is one of the most notable modules of today's smartphones, usually with front and rear cameras. Its front camera can also reach 30 frames per second on a typical mobile phone, and get photos of about 1.3 million pixels. This makes it possible to perform face recognition on the image acquired by the front camera, further positioning the eyes, and judging the movement of the eyes.
  • Embodiments of the present invention provide a method for detecting a blinking frequency of an eye by using a front camera to detect a healthy state of a human eye, and a person skilled in the art may apply the method to a terminal only (for example, a mobile phone), or separately Set to become a standalone software application (ie APP). It can be presented as a standalone app or integrated into mobile management software such as "Personal Manager".
  • the user can detect the blink frequency by using the front camera provided by the mobile phone, and make suggestions for the user's eye habit using the mobile phone.
  • the user can use the APP provided in this embodiment to look at the front camera.
  • the system automatically detects the opening and closing action of the eye in the background, and counts the blink frequency by counting the number of times, which can help protect the eye health of the user.
  • This embodiment can well solve the problem that people use smart phones and their vision is easy to drop. It can promptly feedback to the user, and currently read or use the blinking frequency of the mobile phone to protect the eye health of the user. The specific embodiments of the embodiments of the present invention are described below.
  • the user first needs to turn on the detection mode, for example, open the APP corresponding to the function in the mobile phone, or in the mobile phone integrated with the function, the function in the mobile phone can be turned on. Then the user blinks in front of the front camera for a period of time (about 0.5 seconds bath), then blinks at the normal frequency; the system grabs the image in the background for face, human eye detection, and finally locates the human eye to the human eye Take a rectangle for the center. The opening and closing of the eye is judged by calculating the change in the gray value of the eye rectangle. These calculations are carried out in the background.
  • a specific embodiment of the present invention may include steps S601 to S609:
  • the system automatically turns on the front camera, and the camera starts to detect.
  • step S605 If a human face is detected, further human eye detection is performed to determine whether the number of human eyes is less than 1. If yes, go to step S605, otherwise go to step S604. S604, performing ROI longitudinal gray level average detection to determine whether the eye is in a blinking state. If yes, go to step S605, otherwise go to S607.
  • step S608 is performed, otherwise, S601 is continued.
  • S609 Calculate the obtained blink data to determine the health status of the eye.
  • the user opens the eyes, and the system inputs the ROI (Region Of Interesting) information of the eyes when the eyes are opened, and then tests according to the normal frequency blink.
  • the system grabs the preview frame every 200 milliseconds, and the entire algorithm takes less than 20 milliseconds. Since a person needs 0.2 seconds to 0.4 seconds in one eye, the system can only capture at most one frame of blinking images in one blinking process. Since the eye is in the closed state, the classifier may not be fully detected (as shown in Figure 3-2;), and in the blink state the system can be nearly 100% detected.
  • the human eye ROI matrix is extracted in accordance with the flow shown in FIGS. 7 to 9.
  • M is a row vector.
  • the Camera first uses the Adabost+Haar classifier to detect the face after acquiring the preview frame, and extracts the face area if the face is detected.
  • the blinking state is The lower L will be much larger than the L in the half open half closed and closed state. According to this condition, if the L calculated by the ROI is smaller than a certain multiple of L of the blink state recorded by the system, it is considered that the frame picture is in the blink state, and the number of blinks is increased by one. Otherwise, it is considered to be blind.
  • the system stops working, and the time interval T from the detection of the face to the face of the face to the last time is calculated, and the blink frequency of the user is calculated by counting the number of blinks. According to the user's blink frequency and the normal blink frequency value, the user is given certain suggestions.
  • the white of the eyes is much less than that in the open state (as shown in Fig. 9).
  • the gray value of the extracted human eye ROI picture is close to the skin color, and the ROI of the human eye in the blinking state is greatly different, further demonstrating the present invention.
  • the index L is much smaller than the L in the blinking state.
  • the index L in the blinking state is less than 0.5 times the L in the blinking state, indicating the accuracy of the human eye state detection proposed by the present invention. high.

Abstract

A method and an apparatus for detecting health status of human eyes and a mobile terminal. The method comprises: acquiring a blink rate of eyes in a predetermined time period through a camera (S102); and comparing the blink rate with a preset blink rate threshold, determining the health status of the eyes of a user according to a comparison result, and giving a corresponding tip for using eyes according to the health status (S104). By collecting a blink rate of eyes through a camera and comparing the data with a preset blink rate threshold to determine the health status of the eyes and present different tips for using eyes, the use of eyes of a user can be monitored through a corresponding camera of a terminal when the user uses the terminal. Therefore, the eyesight of the user is protected, and the problem in the prior art that an eye problem is easily caused because the user blinks less when using a terminal, while existing intelligent terminals cannot monitor and urge the user to protect his/her eyesight so that the eyesight fades is solved.

Description

一种检测人眼健康状态的方法、 装置及移动终端 技术领域 本发明涉及通讯领域, 特别是涉及一种检测人眼健康状态的方法、 装置及移动终  TECHNICAL FIELD The present invention relates to the field of communications, and in particular, to a method, a device, and a mobile terminal for detecting a healthy state of a human eye.
背景技术 随着智能手机近几年的飞速发展和普及, 已融入到人们日常生活的各个方面。 越 来越多的使用者喜欢在手机上看电子小说、 书籍、 新闻、 电影等。 由于用户在手机上 进行娱乐、 阅读时, 多发生在移动场景中, 本身光线就不太好, 再加上手机屏幕对眼 睛的辐射和伤害, 所以, 当用户长时间看手机屏幕时, 通常会有一定的依赖性且全神 贯注, 眼睛眨眼频率会在不知不觉中下降。 根据相关资料表明, 人类正常眨眼频率是每 5秒中眨眼一次。 眨眼作为人类的一 种本能行为, 是为了增加眼睛湿润度, 促进眼睛分泌粘液滋润眼膜。 当用户长时间全 神贯注看屏幕时, 眨眼频率会下降到约 10秒甚至更长时间才一次。如果用户长期保持 这种不良习惯会造成视力下降、 眼睛干涩等问题, 甚至诱发干眼症, 泪腺萎缩等眼睛 器质性病变。 现有技术中, 用户在使用终端时, 由于眨眼次数较少, 容易引发眼部问题, 现有 的终端虽然都较为智能, 但却无法督促用户保护视力, 导致用户视力下降。 发明内容 本发明提供了一种检测人眼健康状态的方法、 装置及移动终端, 用以解决现有技 术中, 用户在使用终端时, 由于眨眼次数较少, 容易引发眼部问题, 现有的终端虽然 都较为智能, 但却无法督促用户保护视力, 导致用户视力下降的问题。 为解决上述技术问题, 一方面, 本发明提供一种检测人眼健康状态的方法, 包括: 通过摄像头获取预定时间段内眼睛的眨眼次数; 将所述眨眼次数与预设眨眼次数阈值 进行比较, 根据比较结果确定用户的眼睛所处的健康状态, 并根据所述健康状态发出 对应的用眼提示。 其中, 通过摄像头获取预定时间段内眼睛的眨眼次数包括: 将用户处于睁眼状态 下的眼睛置于摄像头前, 保持第一预定时长, 通过摄像头获取睁眼状态下预定区域的 灰度信息, 其中, 所述预定区域是以每只眼睛为中心向外截取的预设图形; 在所述第 一预定时长之后, 按照第一预设时间间隔采集所述预设区域内的灰度信息, 并根据采 集到的灰度信息的变化值判断用户当前眼睛所处的睁闭状态, 其中, 当所述灰度信息 的变化值在预设变化范围内的情况下, 确定眼睛处于睁眼状态, 当所述灰度信息的变 化值超过所述预设变化范围的情况下, 确定眼睛处于闭眼状态; 根据所述预定时间段 内统计的眼睛的睁闭状态确定所述眨眼次数。 其中, 通过摄像头获取预定时间段内眼睛的眨眼次数包括: 将用户处于睁眼状态 下的眼睛置于摄像头前, 保持第二预定时长, 获取当前图像以记录睁眼状态下预定区 域的灰度信息, 其中, 所述预定区域是以每只眼睛为中心向外截取的预设图形; 在所 述第二预定时长之后, 按照第二预设时间间隔采集所述预设区域对应的图像, 并对采 集到的所有图像所对应的灰度信息求平均值, 对所述平均值求极值点, 以确定所述极 值点预设范围内灰度变化率的最大值; 根据所述灰度变化率的最大值判断用户当前眼 睛所处的睁闭状态, 其中, 确定灰度变化率的变化范围超过所述灰度变化率的最大值 预定倍数的极值点所对应的图像为闭眼状态, 确定灰度变化率的变化范围等于或小于 所述灰度变化率的最大值预定倍数的极值点所对应的图像为睁眼状态; 根据所述预定 时间段内统计的眼睛的睁闭状态确定所述眨眼次数。 其中, 将所述眨眼次数与预设眨眼次数阈值进行比较, 根据比较结果确定用户的 眼睛所处的健康状态包括: 在所述眨眼次数大于或等于所述预设眨眼次数阈值的情况 下, 确定所述眼睛处于健康状态; 在所述眨眼次数小于所述预设眨眼次数阈值的情况 下, 确定所述眼睛处于疲惫状态。 其中, 根据所述健康状态发出对应的用眼提示包括: 在用户的眼睛处于疲惫状态 的情况下, 发出告警音和 /或提示框以提示用户眼睛需要休息。 其中, 在通过摄像头获取预定时间段内眼睛的眨眼次数之前, 还包括: 检测所述 摄像头内是否出现人脸信息; 在出现人脸信息的情况下, 检测所述摄像头是否检测到 眼睛信息; 在检测到眼睛信息的情况下, 通过摄像头获取预定时间段内眼睛的眨眼次 数。 另一方面, 本发明还提供一种检测人眼健康状态的装置, 包括: 获取模块, 设置 为通过摄像头获取预定时间段内眼睛的眨眼次数; 确定模块, 设置为将所述眨眼次数 与预设眨眼次数阈值进行比较, 根据比较结果确定用户的眼睛所处的健康状态, 并根 据所述健康状态发出对应的用眼提示。 其中, 所述获取模块包括: 第一获取单元, 设置为将用户处于睁眼状态下的眼睛 置于摄像头前,保持第一预定时长,通过摄像头获取睁眼状态下预定区域的灰度信息, 其中, 所述预定区域是以每只眼睛为中心向外截取的预设图形; 第一确定单元, 设置 为在所述第一预定时长之后,按照第一预设时间间隔采集所述预设区域内的灰度信息, 并根据采集到的灰度信息的变化值判断用户当前眼睛所处的睁闭状态, 其中, 当所述 灰度信息的变化值在预设变化范围内的情况下, 确定眼睛处于睁眼状态, 当所述灰度 信息的变化值超过所述预设变化范围的情况下, 确定眼睛处于闭眼状态; 第一统计单 元, 设置为根据所述预定时间段内统计的眼睛的睁闭状态确定所述眨眼次数。 其中, 所述获取模块包括: 第二获取单元, 设置为将用户处于睁眼状态下的眼睛 置于摄像头前, 保持第二预定时长, 获取当前图像以记录睁眼状态下预定区域的灰度 信息, 其中, 所述预定区域是以每只眼睛为中心向外截取的预设图形; 第二确定单元, 设置为在所述第二预定时长之后, 按照第二预设时间间隔采集所述预设区域对应的图 像, 并对采集到的所有图像所对应的灰度信息求平均值, 对所述平均值求极值点, 以 确定所述极值点预设范围内灰度变化率的最大值; 根据所述灰度变化率的最大值判断 用户当前眼睛所处的睁闭状态, 其中, 确定灰度变化率的变化范围超过所述灰度变化 率的最大值预定倍数的极值点所对应的图像为闭眼状态, 确定灰度变化率的变化范围 等于或小于所述灰度变化率的最大值预定倍数的极值点所对应的图像为睁眼状态; 第 二统计单元,设置为根据所述预定时间段内统计的眼睛的睁闭状态确定所述眨眼次数。 其中, 所述确定模块, 还设置为在用户的眼睛处于疲惫状态的情况下, 发出告警 音和 /或提示框以提示用户眼睛需要休息。 又一方面, 本发明还提供了一种移动终端, 包括: 上述任一项所述的检测人眼健 康状态的装置。 本发明通过摄像头采集眼睛的眨眼次数, 并将该数据与预设的眨眼次数阈值进行 比较, 来确定眼睛所处的健康状态, 以呈现不同的用眼提示, 这样, 在用户使用终端 时, 能够通过终端对应的摄像头来监督用户用眼, 保护了用户视力, 解决现有技术中, 用户在使用终端时, 由于眨眼次数较少, 容易引发眼部问题, 现有的终端虽然都较为 智能, 但却无法督促用户保护视力, 导致用户视力下降的问题。 附图说明 图 1 是本发明实施例中检测人眼健康状态的方法的流程图; 图 2 是本发明实施例中检测人眼健康状态的装置的结构示意图; 图 3 是本发明实施例中检测人眼健康状态的装置获取模块的一种结构示意图; 图 4 是本发明实施例中检测人眼健康状态的装置获取模块的又一种结构示意图; 图 5 是本发明实施例中检测人眼健康状态的装置的优选结构示意图; 图 6 是本发明优选实施例中检测人眼健康状态的方法的流程图; 图 7 是本发明优选实施例中提取眼睛 ROI过程中人眼检测的示意图; 图 8 是本发明优选实施例中提取眼睛 ROI过程中人眼 ROI切割的示意图; 图 9 是本发明优选实施例中提取眼睛 ROI过程中确定人眼 ROI的示意图; 图 10 是本发明优选实施例中眼睛处于半开半闭状态的示意图; 图 11 是本发明优选实施例中闭眼状态下只检测到一只眼睛的示意图; 图 12 是本发明优选实施例中闭眼状态下检测到两只眼睛的示意图; 图 13 是本发明优选实施例中检测人眼 ROI状态下 L=12.4的仿真示意图; 图 14 是本发明优选实施例中检测人眼 ROI状态下 L=2.4的仿真示意图; 图 15 是本发明优选实施例中检测人眼 ROI状态下 L=3的仿真示意图。 具体实施方式 为了解决现有技术中, 用户在使用终端时, 由于眨眼次数较少, 容易引发眼部问 题, 现有的终端虽然都较为智能, 但却无法督促用户保护视力, 导致用户视力下降的 问题, 本发明提供了一种检测人眼健康状态的方法、 装置及移动终端, 以下结合附图 以及实施例, 对本发明进行进一步详细说明。 应当理解, 此处所描述的具体实施例仅 仅用以解释本发明, 并不限定本发明。 本发明实施例提供了一种检测人眼健康状态的方法, 如图 1所示, 包括步骤 S102 至 S104: BACKGROUND OF THE INVENTION With the rapid development and popularization of smart phones in recent years, they have been integrated into various aspects of people's daily lives. More and more users like to watch e-fiction, books, news, movies, etc. on their mobile phones. Since the user often enters the mobile scene while playing and reading on the mobile phone, the light itself is not very good, and the radiation and damage of the mobile phone screen to the eyes, so when the user watches the mobile phone screen for a long time, usually With a certain amount of dependence and concentration, the frequency of blinking eyes will drop unconsciously. According to relevant information, the normal blink frequency of humans is blinking every 5 seconds. As an instinctive behavior of human beings, blinking is to increase the moisturization of the eyes and promote the secretion of mucus from the eyes to moisturize the eye mask. When the user concentrates on the screen for a long time, the blink frequency will drop to about 10 seconds or more. If the user maintains such bad habits for a long time, it may cause problems such as decreased vision, dry eyes, and even induce dry eye syndrome, lacrimal gland atrophy and other organic diseases of the eye. In the prior art, when the user uses the terminal, the number of blinks is small, which is likely to cause eye problems. Although the existing terminals are relatively smart, they cannot urge the user to protect the eyesight, resulting in a decrease in the user's vision. SUMMARY OF THE INVENTION The present invention provides a method, a device, and a mobile terminal for detecting a health state of a human eye, which are used to solve the problem in the prior art, when a user uses a terminal, because the number of blinks is small, an eye problem is easily caused. Although the terminals are relatively smart, they cannot urge users to protect their vision, which leads to the problem of decreased eyesight. In order to solve the above technical problem, in one aspect, the present invention provides a method for detecting a health state of a human eye, comprising: acquiring, by a camera, a number of blinks of an eye within a predetermined time period; comparing the number of blinks with a threshold of a preset number of blinks, The health state of the user's eyes is determined according to the comparison result, and a corresponding eye prompt is issued according to the health state. The obtaining the blinking times of the eyes in the predetermined time period by the camera includes: placing the eyes in the blinking state of the user in front of the camera, maintaining the first predetermined length of time, and acquiring the predetermined area in the blinking state by the camera. Gray scale information, wherein the predetermined area is a preset pattern that is taken out from the center of each eye; after the first predetermined time period, the gray in the preset area is collected according to the first preset time interval Degree information, and determining a closed state of the current eye of the user according to the changed value of the collected grayscale information, wherein, when the change value of the grayscale information is within a preset variation range, determining that the eye is in a state The eye state determines that the eye is in the closed eye state when the change value of the gray scale information exceeds the preset change range; and determines the number of blinks according to the closed state of the eye that is counted in the predetermined time period. The obtaining the blinking times of the eyes in the predetermined time period by the camera includes: placing the eyes in the blinking state of the user in front of the camera, maintaining the second predetermined duration, and acquiring the current image to record the grayscale information of the predetermined area in the blinking state. The predetermined area is a preset pattern that is taken out from the center of each of the eyes; after the second predetermined time length, the image corresponding to the preset area is collected according to the second preset time interval, and And averaging the gray level information corresponding to all the collected images, and determining an extreme point of the average value to determine a maximum value of the gray level change rate in the preset range of the extreme point; according to the gray level change The maximum value of the rate determines the closed state of the current eye of the user, wherein the image corresponding to the extreme value of the predetermined multiple of the maximum value of the gray-scale change rate is determined to be a closed-eye state, Determining that the image corresponding to the extreme value of the change range of the gray-scale change rate is equal to or smaller than the maximum value of the maximum value of the gray-scale change rate is a blink state; The closed state of the eye counted during the predetermined time period determines the number of blinks. Comparing the number of blinks with a preset threshold of blinks, and determining, according to the comparison result, a health state of the eye of the user includes: determining, in a case where the number of blinks is greater than or equal to a threshold of the preset number of blinks, The eye is in a healthy state; in a case where the number of blinks is less than the threshold of the preset number of blinks, it is determined that the eye is in a tired state. Wherein, the corresponding eye prompts are issued according to the health status: in the case that the user's eyes are in a tired state, an alarm sound and/or a prompt box is issued to prompt the user that the eyes need rest. Before the capturing the number of blinks of the eye in the predetermined time period by the camera, the method further includes: detecting whether face information appears in the camera; and detecting whether the camera detects the eye information in the case that the face information appears; In the case where the eye information is detected, the number of blinks of the eye within a predetermined period of time is acquired by the camera. In another aspect, the present invention provides an apparatus for detecting a health state of a human eye, comprising: an acquisition module configured to acquire a blink number of an eye within a predetermined time period by a camera; and a determining module configured to set the number of blinks and a preset The blink threshold is compared, and the health state of the user's eyes is determined according to the comparison result, and a corresponding eye prompt is issued according to the health state. The acquiring module includes: a first acquiring unit, configured to: place an eye in a blinking state of the user in front of the camera, maintain the first predetermined duration, and obtain gray information of a predetermined area in a blinking state by using the camera, where The predetermined area is a preset pattern that is taken out from the center of each of the eyes. The first determining unit is configured to collect the preset area according to the first preset time interval after the first predetermined time length. The gray scale information, and determining the closed state of the current eye of the user according to the changed value of the collected gray scale information, wherein when the change value of the gray scale information is within a preset variation range, determining the eye In a blinking state, when the change value of the gray scale information exceeds the preset change range, determining that the eye is in a closed eye state; the first statistical unit is configured to count the eye according to the predetermined time period The closed state determines the number of blinks. The acquiring module includes: a second acquiring unit, configured to place an eye in a blinking state in front of the camera, maintain a second predetermined duration, and acquire a current image to record grayscale information of a predetermined region in a blinking state. The predetermined area is a preset pattern that is taken out from the center of each eye; the second determining unit is configured to collect the preset according to the second preset time interval after the second predetermined time length An image corresponding to the region, and averaging the grayscale information corresponding to all the acquired images, and determining an extreme value of the average value to determine a maximum value of the grayscale change rate in the preset range of the extreme value point Determining, according to the maximum value of the gray-scale change rate, a closed state in which the user's current eye is located, wherein it is determined that the range of change of the gray-scale change rate exceeds an extreme value of a predetermined multiple of the maximum value of the gray-scale change rate The image is in the closed-eye state, and the image corresponding to the extreme value of the predetermined multiple of the maximum value of the gray-scale change rate is determined to be 睁State; a second counting unit arranged to determine a statistical time period according to the predetermined closed state of the wide open eye blinks. The determining module is further configured to issue an alert tone and/or a prompt box to prompt the user to rest when the user's eyes are in a tired state. In still another aspect, the present invention provides a mobile terminal, comprising: the apparatus for detecting a human eye health state according to any one of the preceding claims. The invention collects the number of blinks of the eye through the camera, and compares the data with a preset threshold of the number of blinks to determine the health state of the eye to present different eye tips, so that when the user uses the terminal, The user's eye is monitored by the camera corresponding to the terminal, and the user's eyesight is protected. In the prior art, when the user uses the terminal, the number of blinks is small, which may cause eye problems. Although the existing terminals are relatively smart, However, it is impossible to urge users to protect their vision, which leads to the problem of decreased vision. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a flow chart of a method for detecting a human eye health state according to an embodiment of the present invention; FIG. 2 is a schematic structural view of an apparatus for detecting a human eye health state according to an embodiment of the present invention; 3 is a schematic structural diagram of a device acquisition module for detecting a human eye health state according to an embodiment of the present invention; FIG. 4 is a schematic structural diagram of a device acquisition module for detecting a human eye health state according to an embodiment of the present invention; FIG. 6 is a flow chart of a method for detecting a healthy state of a human eye in a preferred embodiment of the present invention; FIG. 7 is a flowchart of extracting an eye ROI in a preferred embodiment of the present invention; FIG. FIG. 8 is a schematic diagram of human eye ROI cutting during extraction of eye ROI in a preferred embodiment of the present invention; FIG. 9 is a schematic diagram of determining human eye ROI during extraction of eye ROI in a preferred embodiment of the present invention; 10 is a schematic view of the eye in a half-open half-closed state in a preferred embodiment of the present invention; FIG. 11 is a schematic view showing only one eye detected in a closed-eye state in a preferred embodiment of the present invention; FIG. 12 is a closed view in a preferred embodiment of the present invention. A schematic diagram of two eyes detected in an eye state; FIG. 13 is a schematic diagram of simulation of detecting L=12.4 in a human eye ROI state in a preferred embodiment of the present invention; 14 is a simulation diagram for detecting L=2.4 in the ROI state of the human eye in a preferred embodiment of the present invention; and FIG. 15 is a schematic diagram showing the simulation of detecting L=3 in the ROI state of the human eye in a preferred embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In order to solve the problem in the prior art, when a user uses a terminal, since the number of blinks is small, eye problems are easily caused. Although the existing terminals are relatively smart, they cannot urge the user to protect vision, resulting in a decrease in visual acuity of the user. Problem, the present invention provides a method, device and mobile terminal for detecting a healthy state of a human eye, and the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. An embodiment of the present invention provides a method for detecting a healthy state of a human eye. As shown in FIG. 1, the method includes steps S102 to S104:
S102, 通过摄像头获取预定时间段内眼睛的眨眼次数。 在实现的过程中, 眼睛的眨眼次数还可以通过多种形式呈现, 例如, 将次数以频 率形式进行呈现。 S104, 将眨眼次数与预设眨眼次数阈值进行比较, 根据比较结果确定用户的眼睛 所处的健康状态, 并根据健康状态发出对应的用眼提示。 本发明实施例通过摄像头采集眼睛的眨眼次数, 并将该数据与预设的眨眼次数阈 值进行比较, 来确定眼睛所处的健康状态, 以呈现不同的用眼提示, 这样, 在用户使 用终端时, 能够通过终端对应的摄像头来监督用户用眼, 保护了用户视力, 解决现有 技术中, 用户在使用终端时, 由于眨眼次数较少, 容易引发眼部问题, 现有的终端虽 然都较为智能, 但却无法督促用户保护视力, 导致用户视力下降的问题。 实施过程中, 通过摄像头获取预定时间段内眼睛的眨眼次数可以包括多种方式: 例如,可以先将用户处于睁眼状态下的眼睛置于摄像头前,保持第一预定时长(比 如 1秒), 以获取睁眼状态下预定区域的灰度信息, 其中, 预定区域是以每只眼睛为中 心向外截取的预设图形, 可以是矩形或圆形等; 在第一预定时长之后, 按照第一预设 时间间隔采集预设区域内的灰度信息, 并根据采集到的灰度信息的变化值判断用户当 前眼睛所处的睁闭状态, 其中, 当灰度信息的变化值在预设变化范围内的情况下, 确 定眼睛处于睁眼状态, 当灰度信息的变化值超过预设变化范围的情况下, 确定眼睛处 于闭眼状态; 再根据预定时间段内统计的眼睛的睁闭状态确定眨眼次数。 通过摄像头获取预定时间段内眼睛的眨眼次数还可以是将用户处于睁眼状态下的 眼睛置于摄像头前, 保持第二预定时长 (该第二预定时长可以与第一预定时长相同), 获取当前图像以记录睁眼状态下预定区域的灰度信息, 其中, 预定区域是以每只眼睛 为中心向外截取的预设图形; 在第二预定时长之后, 按照第二预设时间间隔采集预设 区域对应的图像, 并对采集到的所有图像所对应的灰度信息求平均值, 对平均值求极 值点, 以确定极值点预设范围内灰度变化率的最大值; 再根据灰度变化率的最大值判 断用户当前眼睛所处的睁闭状态, 其中, 确定灰度变化率的变化范围超过灰度变化率 的最大值预定倍数的极值点所对应的图像为闭眼状态, 确定灰度变化率的变化范围等 于或小于灰度变化率的最大值预定倍数的极值点所对应的图像为睁眼状态; 最后, 根 据预定时间段内统计的眼睛的睁闭状态确定眨眼次数。 上述两种实现方式都可以确定眨眼次数, 本领域技术人员还可以基于上述方案来 采取其他方式进行采集, 此处不进行赘述。 将眨眼次数与预设眨眼次数阈值进行比较时, 当眨眼次数大于或等于预设眨眼次 数阈值时, 则可以确定眼睛处于健康状态; 当眨眼次数小于预设眨眼次数阈值时, 则 可以确定眼睛处于疲惫状态。 按照需求, 还可以将眼睛的健康状态分为多种形式, 例 如, 健康状态、 亚健康状态、 疲惫状态等, 可以根据需求和经验设置不同的区分等级。 实施过程中, 为了进一步加强监测的准确性, 可以在通过摄像头获取预定时间段 内眼睛的眨眼次数之前, 先检测摄像头内是否出现人脸信息; 在出现人脸信息的情况 下, 检测摄像头是否检测到眼睛信息, 如果未出现人脸信息, 则不执行下一操作; 在 检测到眼睛信息的情况下, 通过摄像头获取预定时间段内眼睛的眨眼次数, 如果未检 测到眼睛信息, 则不执行下一步采集操作, 此时, 可以提醒用户睁眼等操作。 当监测到用户的眼睛处于疲惫状态时, 可以向用户发出告警音和 /或提示框, 来提 示用户眼睛需要休息, 以进一步保护眼睛视力。 本发明实施例还提供了一种检测人眼健康状态的装置, 其结构示意如图 2所示, 包括: 获取模块 10, 设置为通过摄像头获取预定时间段内眼睛的眨眼次数; 确定模块 20, 与获取模块 10耦合, 设置为将眨眼次数与预设眨眼次数阈值进行比较, 根据比较 结果确定用户的眼睛所处的健康状态, 并根据健康状态发出对应的用眼提示。 图 3示出了获取模块 10的第一种结构示意图, 其包括: 第一获取单元 101, 设置为将用户处于睁眼状态下的眼睛置于摄像头前, 保持第 一预定时长, 通过摄像头获取睁眼状态下预定区域的灰度信息, 其中, 预定区域是以 每只眼睛为中心向外截取的预设图形; 第一确定单元 102, 与第一获取单元 101耦合, 设置为在第一预定时长之后, 按照第一预设时间间隔采集预设区域内的灰度信息, 并 根据采集到的灰度信息的变化值判断用户当前眼睛所处的睁闭状态, 其中, 当灰度信 息的变化值在预设变化范围内的情况下, 确定眼睛处于睁眼状态, 当灰度信息的变化 值超过预设变化范围的情况下, 确定眼睛处于闭眼状态; 第一统计单元 103, 与第一 确定单元 102耦合, 设置为根据预定时间段内统计的眼睛的睁闭状态确定眨眼次数。 图 4示出了获取模块 10的又一种结构示意图, 其包括: 第二获取单元 104, 设置为将用户处于睁眼状态下的眼睛置于摄像头前, 保持第 二预定时长, 获取当前图像以记录睁眼状态下预定区域的灰度信息, 其中, 预定区域 是以每只眼睛为中心向外截取的预设图形; 第二确定单元 105, 与第二获取单元 104 耦合, 设置为在第二预定时长之后,按照第二预设时间间隔采集预设区域对应的图像, 并对采集到的所有图像所对应的灰度信息求平均值, 对平均值求极值点, 以确定极值 点预设范围内灰度变化率的最大值; 根据灰度变化率的最大值判断用户当前眼睛所处 的睁闭状态, 其中, 确定灰度变化率的变化范围超过灰度变化率的最大值预定倍数的 极值点所对应的图像为闭眼状态, 确定灰度变化率的变化范围等于或小于灰度变化率 的最大值预定倍数的极值点所对应的图像为睁眼状态; 第二统计单元 106, 与第二确 定单元 105耦合, 设置为根据预定时间段内统计的眼睛的睁闭状态确定眨眼次数。 本领域技术人员可以将图 3和图 4中的两种获取模块的内部结构都设置在获取模 块中, 则在不同情况下, 可以开启不同的方式来获取眨眼次数。 图 5示出了检测人眼健康状态的装置的优选结构示意图, 在图 2的基础上, 上述 装置还可以包括检测模块 30, 设置为检测所述摄像头内是否出现人脸信息, 在出现人 脸信息的情况下,检测所述摄像头是否检测到眼睛信息,在检测到眼睛信息的情况下, 通过摄像头获取预定时间段内眼睛的眨眼次数。 上述装置中, 获取模块还可以设置为在用户的眼睛处于疲惫状态的情况下, 发出 告警音和 /或提示框以提示用户眼睛需要休息。 本发明实施例还提供了一种移动终端, 该移动终端可以是本身具备摄像头, 也可 以是通过外接设备连接了摄像头。 该移动终端设置了上述检测人眼健康状态的装置能 够实现的功能, 或者将上述检测人眼健康状态的装置集成在手机中, 因此, 该移动终 端包含上述检测人眼健康状态的装置的各个模块, 本领域技术人员知晓如何根据本发 明实施例公开的内容进行设置, 此处不再进行赘述。 优选实施例 摄像头是当今智能手机最显著的模块之一, 通常带有前后摄像头。 其前置摄像头 在一般手机上也能够达到每秒 30帧, 获得 130万像素左右的照片。这使得可以在前置 摄像头获取的图像上进行人脸识别, 进一步定位眼睛, 判断眼睛的动作成为可能。 本发明实施例提供了一种利用前置摄像头检测眼睛的眨眼频率, 以检测人眼健康 状态的方法, 本领域技术人员可以将该方法应用到只能终端 (例如手机) 中, 或单独 将其设置成为一个独立的软件应用 (即 APP)。 即可以以一个独立的 APP呈现, 或集 成到手机管理软件如 "掌心管家" 中。 用户可以通过手机自带的前置摄像头检测眨眼频率, 对用户使用手机的用眼习惯 作出建议, 当用户希望检测自己的眨眼频率时, 可以利用本实施例提供的 APP, 对着 前置摄像头看一段时间, 系统在后台自动检测眼睛的开和闭动作, 并统计次数计算出 眨眼频率, 可以辅助保护用户的眼睛健康。 本实施例能够很好的解决当今人们在使用 智能手机, 视力容易下降的问题。 能够及时反馈给用户, 当前阅读或使用手机习惯下 的眨眼频率, 为用户的眼睛健康保驾护航。 下面对本发明实施例的具体方案进行说明。 在本实施例提供的检测人眼健康状态的方法中, 用户首先需要开启检测模式, 例 如打开手机中的该功能对应的 APP, 或者在集成了该功能的手机中, 可以开启手机中 的该功能; 然后用户以睁眼状态对着前置摄像头一段时间 (约 0.5秒坐浴), 然后按照 正常频率眨眼; 系统在后台抓取图像进行人脸、 人眼检测, 最终定位人眼, 以人眼为 中心截取一个矩形。 通过计算眼睛矩形灰度值的变化判断眼睛的开和闭。 这些计算是 在后台进行, 在这一段时间内, 用户按照平时的习惯使用手机, 如阅读电子书, 进行 聊天、 看新闻、 购物等, 以确保系统检测的真实; 最后, 当检测时间到一定时间后, 显示计算的眨眼频率, 并根据系统中存储的用户以前的眨眼频率进行比较, 给出眨眼 频率健康值。 如图 6所示, 本发明具体实施方式可以包括步骤 S601至 S609: S102. Obtain a blinking number of eyes in a predetermined time period by using a camera. In the process of implementation, the number of blinks of the eye can also be presented in various forms, for example, the number of times is presented in frequency. S104: Compare the number of blinks with a preset threshold of blinks, determine a health state of the user's eyes according to the comparison result, and issue a corresponding eye prompt according to the health state. In the embodiment of the present invention, the number of blinks of the eye is collected by the camera, and the data is compared with a preset threshold of the number of blinks to determine the health state of the eye to present different eye tips, so that when the user uses the terminal The camera can be supervised by the camera corresponding to the terminal to protect the user's eyesight. In the prior art, when the user uses the terminal, the number of blinks is small, which is easy to cause eye problems, and the existing terminals are relatively smart. However, it is impossible to urge users to protect their vision, which leads to the problem of decreased eyesight. During the implementation process, the number of blinks of the eye in the predetermined time period can be obtained by the camera. For example, the eye in the blinking state can be placed in front of the camera for the first predetermined time (for example, 1 second). Obtaining gray scale information of a predetermined area in a blinking state, wherein the predetermined area is a preset pattern taken out from the center of each eye, and may be a rectangle or a circle, etc.; after the first predetermined time period, according to the first The preset time interval is used to collect the gray scale information in the preset area, and the closed state of the current eye of the user is determined according to the changed value of the collected gray scale information, wherein when the change value of the gray scale information is in the preset variation range In the case of the inside, it is determined that the eye is in a blinking state, and when the change value of the grayscale information exceeds the preset variation range, the eye is determined to be in the closed eye state; and the blinking is determined according to the closed state of the eye counted in the predetermined time period. frequency. The number of blinks of the eye in the predetermined time period obtained by the camera may also be that the eye in the blinking state is placed in front of the camera for a second predetermined duration (the second predetermined duration may be the same as the first predetermined duration), obtaining the current The image is used to record grayscale information of a predetermined area in a blinking state, wherein the predetermined area is a preset pattern that is taken out from the center of each eye; after the second predetermined length of time, the preset is collected according to the second preset time interval. The image corresponding to the region, and averaging the grayscale information corresponding to all the acquired images, and determining the extreme value of the average value to determine the maximum value of the grayscale change rate in the preset range of the extreme value point; The maximum value of the degree of change of the degree of change determines the state of the closed state in which the user's current eye is located, wherein the image corresponding to the extreme value of the predetermined multiple of the maximum value of the gray-scale change rate is determined to be a closed-eye state, Determining that the image corresponding to the extreme value of the gray level change rate is equal to or smaller than the maximum value of the gray level change rate is a blinking state; After the closed state of eyes wide open in accordance with a predetermined time period to determine the statistical number of blinks. The above two implementations can determine the number of blinks, and those skilled in the art can also perform other methods based on the foregoing solution, and no further details are provided herein. When comparing the number of blinks with the threshold of the preset number of blinks, when the number of blinks is greater than or equal to the threshold of the preset number of blinks, it can be determined that the eye is in a healthy state; when the number of blinks is less than the threshold of the preset number of blinks, it can be determined that the eye is in Tired state. According to the needs, the health status of the eyes can be divided into various forms, for example, health status, sub-health status, fatigue status, etc., and different classification levels can be set according to needs and experience. During the implementation process, in order to further enhance the accuracy of the monitoring, it is possible to detect whether or not the face information appears in the camera before the number of blinks of the eye in the predetermined time period is obtained by the camera; in the case where the face information appears, the detection of the camera is detected. To the eye information, if the face information does not appear, the next operation is not performed; in the case where the eye information is detected, the number of blinks of the eye in the predetermined time period is acquired by the camera, and if the eye information is not detected, the next operation is not performed. One-step acquisition operation, at this time, you can remind the user to blink and other operations. When it is detected that the user's eyes are in a state of exhaustion, an alert tone and/or a prompt box may be issued to the user to prompt the user to rest the eye to further protect the eyesight. The embodiment of the present invention further provides a device for detecting a healthy state of a human eye, and the structure thereof is as shown in FIG. 2, including: an obtaining module 10, configured to acquire a blinking number of an eye in a predetermined time period by using a camera; and determining a module 20, The method is coupled to the acquisition module 10, and is configured to compare the number of blinks with a preset threshold of the number of blinks, determine a health state of the user's eyes according to the comparison result, and issue a corresponding eye prompt according to the health state. FIG. 3 shows a first structural diagram of the acquisition module 10, which includes: a first acquisition unit 101, configured to place an eye in a blinking state in front of the camera for a first predetermined duration, and obtain the image through the camera. The grayscale information of the predetermined area in the eye state, wherein the predetermined area is a preset pattern that is taken out from the center of each eye; the first determining unit 102 is coupled to the first acquiring unit 101, and is set to be in the first predetermined time period. After that, the grayscale information in the preset area is collected according to the first preset time interval, and the closed state of the current eye of the user is determined according to the changed value of the collected grayscale information, wherein when the grayscale information changes value In the case of the preset variation range, it is determined that the eye is in the blinking state, and when the change value of the grayscale information exceeds the preset variation range, determining that the eye is in the closed eye state; the first statistical unit 103, and the first determination The unit 102 is coupled to determine the number of blinks based on the closed state of the eye counted during the predetermined time period. FIG. 4 is a schematic structural diagram of the acquisition module 10, which includes: a second acquisition unit 104, configured to place an eye in a blinking state in front of the camera for a second predetermined duration, to obtain a current image. Recording the gradation information of the predetermined area in the blinking state, wherein the predetermined area is a preset pattern taken out from the center of each eye; the second determining unit 105 is coupled to the second obtaining unit 104, and is set to be in the second After the predetermined length of time, the image corresponding to the preset area is collected according to the second preset time interval, and the gray level information corresponding to all the collected images is averaged, and the extreme value is obtained for the average value to determine the extreme value point. The maximum value of the gray level change rate is set; the closed state of the current eye of the user is determined according to the maximum value of the gray rate change rate, wherein the range of the gray level change rate is determined to exceed the maximum value of the gray level change rate by a predetermined multiple The image corresponding to the extreme point is a closed-eye state, and the range of the change of the gray-scale change rate is determined to be equal to or smaller than the maximum value of the predetermined multiple of the maximum value of the gray-scale change rate. Open-eye image corresponding to the state; a second statistic unit 106, coupled to the second determination unit 105, is set to the closed state according to a predetermined time period wide open eye statistics to determine the number of blinks. A person skilled in the art can set the internal structures of the two acquisition modules in FIG. 3 and FIG. 4 in the acquisition module, and in different situations, different ways can be opened to obtain the number of blinks. FIG. 5 is a schematic diagram showing a preferred structure of a device for detecting a state of health of a human eye. On the basis of FIG. 2, the device may further include a detecting module 30 configured to detect whether face information appears in the camera, and a face appears. In the case of information, it is detected whether the camera detects eye information, and in the case where the eye information is detected, the number of blinks of the eye in the predetermined time period is acquired by the camera. In the above device, the acquisition module may be further configured to issue an alarm sound and/or a prompt box to prompt the user that the eye needs rest if the user's eyes are in a tired state. The embodiment of the invention further provides a mobile terminal, which may have a camera itself or may be connected to the camera through an external device. The mobile terminal is provided with the above-mentioned functions that can be implemented by the device for detecting the health state of the human eye, or integrates the device for detecting the health state of the human eye in the mobile phone. Therefore, the mobile terminal includes the respective modules of the device for detecting the health state of the human eye. The person skilled in the art knows how to set according to the content disclosed in the embodiment of the present invention, and details are not described herein. The preferred embodiment camera is one of the most notable modules of today's smartphones, usually with front and rear cameras. Its front camera can also reach 30 frames per second on a typical mobile phone, and get photos of about 1.3 million pixels. This makes it possible to perform face recognition on the image acquired by the front camera, further positioning the eyes, and judging the movement of the eyes. Embodiments of the present invention provide a method for detecting a blinking frequency of an eye by using a front camera to detect a healthy state of a human eye, and a person skilled in the art may apply the method to a terminal only (for example, a mobile phone), or separately Set to become a standalone software application (ie APP). It can be presented as a standalone app or integrated into mobile management software such as "Personal Manager". The user can detect the blink frequency by using the front camera provided by the mobile phone, and make suggestions for the user's eye habit using the mobile phone. When the user wants to detect the blink frequency of the mobile phone, the user can use the APP provided in this embodiment to look at the front camera. For a period of time, the system automatically detects the opening and closing action of the eye in the background, and counts the blink frequency by counting the number of times, which can help protect the eye health of the user. This embodiment can well solve the problem that people use smart phones and their vision is easy to drop. It can promptly feedback to the user, and currently read or use the blinking frequency of the mobile phone to protect the eye health of the user. The specific embodiments of the embodiments of the present invention are described below. In the method for detecting the health state of the human eye provided by the embodiment, the user first needs to turn on the detection mode, for example, open the APP corresponding to the function in the mobile phone, or in the mobile phone integrated with the function, the function in the mobile phone can be turned on. Then the user blinks in front of the front camera for a period of time (about 0.5 seconds bath), then blinks at the normal frequency; the system grabs the image in the background for face, human eye detection, and finally locates the human eye to the human eye Take a rectangle for the center. The opening and closing of the eye is judged by calculating the change in the gray value of the eye rectangle. These calculations are carried out in the background. During this period of time, the user uses the mobile phone according to the usual habits, such as reading e-books, chatting, watching news, shopping, etc., to ensure the authenticity of the system detection; finally, when the detection time reaches a certain time After that, the calculated blink frequency is displayed, and the blink frequency health value is given according to the user's previous blink frequency stored in the system. As shown in FIG. 6, a specific embodiment of the present invention may include steps S601 to S609:
5601 , 在开启检测模式后, 系统自动打开前置 Camera, 摄像头开始检测。 5601, after the detection mode is turned on, the system automatically turns on the front camera, and the camera starts to detect.
5602,判断是否能够检测到人脸信息。如果是,则执行步骤 S603,否则执行 S608。 5602. Determine whether the face information can be detected. If yes, go to step S603, otherwise go to S608.
5603 , 如果检测到人脸, 则进一步进行人眼检测, 判断人眼的个数是否小于 1。 如果是, 则执行步骤 S605, 否则执行 S604。 S604, 进行 ROI纵向灰度平均值检测, 以判断眼睛是否处于眨眼状态。 如果是, 则执行步骤 S605, 否则执行 S607。 5603. If a human face is detected, further human eye detection is performed to determine whether the number of human eyes is less than 1. If yes, go to step S605, otherwise go to step S604. S604, performing ROI longitudinal gray level average detection to determine whether the eye is in a blinking state. If yes, go to step S605, otherwise go to S607.
5605, 将眨眼次数增加 1次。 5605, Increase the number of blinks by one.
5606, 判断检测时间是否到时。 如果是, 则执行步骤 S608, 否则继续执行 S601。 5606, determining whether the detection time is up. If yes, step S608 is performed, otherwise, S601 is continued.
5607, 忽略此次检测。 S608, 如果检测不到人脸, 本次测试过程结束。 5607, ignore this test. S608, if the face is not detected, the test process ends.
S609, 对获取到的眨眼数据进行计算, 以确定眼睛的健康状态。 在实现上述过程中, 用户睁开双眼, 系统录入眼睛睁开时的眼睛 ROI(Region Of Interesting)信息, 之后按照正常频率眨眼进行测试。 系统每 200 毫秒抓取预览帧, 整 个算法耗时在 20毫秒以内。 由于人眨一次眼睛需要 0.2秒至 0.4秒, 所以在一次眨眼 过程中, 系统最多只能抓取到一帧眨眼图片。 由于眼睛在闭合状态下, 分类器未必能完全检测到 (如图 3-2所示;),而在睁眼状态 下系统可以接近百分百检测到。所以如果检测到人眼数小于等于 1则判定为眨眼动作。 如果检测到两只人眼, 则按照图 7至图 9所示流程提取人眼 ROI矩阵。 对人眼的 两个 ROI矩阵, 分别求每一列的灰度平均值, 得到纵向灰度平均值矩阵 M (M为行向 量)。 对 M求极值点, 并计算极值点附近灰度变化率的最大值, 记这个指标为 L。 实施过程中, Camera获取预览帧后首先利用 Adabost+Haar分类器对人脸检测, 如果检测到人脸则提取出人脸区域。 然后对人脸区域进行灰度化、 亮度归一化等预处 理操作, 基于 Adabost+Haar分类器再进行人眼检测, 如果检测到人眼则提取出人眼所 在的正方形区域 (图 7所示), 将其缩放到 64 X 64的标准大小。 以此正方形中心为坐标 原点, 切割出宽度为 W=50, 高度 H=10的矩形 ROI区域 (如图 8所示), 最终得到人眼 ROI图片 (如图 9所示)。 如图 10及图 12所示, 当眼睛处于半开半闭状态或完全闭合状态, 由于 ROI中眼 白相较睁开状态下会大幅度减少, 也即灰度值过度比较平缓, 因此睁眼状态下的 L会 比半开半闭和闭合状态下的 L大很多。根据这个条件, 如果 ROI计算的 L小于系统录 入的睁眼状态的 L一定倍数, 则视为该帧图片处在眨眼状态, 眨眼次数加 1。 否则, 视为没有眨眼。 当检测计时到一定时间后系统停止工作, 计算从第一帧检测到人脸到最后一次检 测到人脸的时间间隔 T, 利用统计到眨眼次数 Ν算出用户的眨眼频率。 根据用户的眨 眼频率及正常眨眼频率值, 对用户给出一定建议。 实施过程中, 如图 3所示, 眼睛处于半开半闭状态 (如图 10所示)时, 眼白相较睁 开状态下 (如图 9所示)少很多。 当眼睛完全处理闭合状态时 (如图 11、 图 12所示), 提 取出的人眼 ROI图片灰度值接近肤色, 跟睁眼状态下的人眼 ROI差别很大, 进一步证 明了本发明的实用性。 如图 13至 15所示, 对人眼 ROI纵向灰度平均值仿真可得, 睁眼状态下 L=12.4, 半睁半闭状态下 L=2.4, 闭眼状态下 L=3。 当眼睛处于眨眼状态时, 指标 L相较睁眼 状态下的 L小很多, 一般情况下处于眨眼状态的指标 L小于睁眼状态下 L的 0.5倍, 说明本发明提出的人眼状态检测精确度高。 尽管为示例目的, 已经公开了本发明的优选实施例, 本领域的技术人员将意识到 各种改进、 增加和取代也是可能的, 因此, 本发明的范围应当不限于上述实施例。 工业实用性 如上所述, 通过上述实施例及优选实施方式, 不仅解决了相关技术中用户在使用 终端时, 由于眨眼次数较少, 容易引发眼部问题, 现有的终端虽然都较为智能, 但却 无法督促用户保护视力, 导致用户视力下降的问题。 S609: Calculate the obtained blink data to determine the health status of the eye. In the above process, the user opens the eyes, and the system inputs the ROI (Region Of Interesting) information of the eyes when the eyes are opened, and then tests according to the normal frequency blink. The system grabs the preview frame every 200 milliseconds, and the entire algorithm takes less than 20 milliseconds. Since a person needs 0.2 seconds to 0.4 seconds in one eye, the system can only capture at most one frame of blinking images in one blinking process. Since the eye is in the closed state, the classifier may not be fully detected (as shown in Figure 3-2;), and in the blink state the system can be nearly 100% detected. Therefore, if it is detected that the number of human eyes is less than or equal to 1, it is determined to be a blinking motion. If two human eyes are detected, the human eye ROI matrix is extracted in accordance with the flow shown in FIGS. 7 to 9. For the two ROI matrices of the human eye, the gray average values of each column are respectively obtained to obtain a vertical gray average matrix M (M is a row vector). Find the extreme point for M, and calculate the maximum value of the gray-scale change rate near the extreme point. Make this indicator L. During the implementation process, the Camera first uses the Adabost+Haar classifier to detect the face after acquiring the preview frame, and extracts the face area if the face is detected. Then, the face area is subjected to preprocessing operations such as graying and brightness normalization, and the human eye detection is performed based on the Adabost+Haar classifier, and if the human eye is detected, the square area where the human eye is located is extracted (shown in FIG. 7). ), scale it to a standard size of 64 X 64. Taking the square center as the coordinate origin, a rectangular ROI region with a width of W=50 and a height of H=10 is cut out (as shown in FIG. 8), and finally a human eye ROI picture is obtained (as shown in FIG. 9). As shown in FIG. 10 and FIG. 12, when the eye is in a half-open half-closed state or a completely closed state, since the white phase of the ROI is greatly reduced compared with the open state, that is, the gray value is excessively gentle, the blinking state is The lower L will be much larger than the L in the half open half closed and closed state. According to this condition, if the L calculated by the ROI is smaller than a certain multiple of L of the blink state recorded by the system, it is considered that the frame picture is in the blink state, and the number of blinks is increased by one. Otherwise, it is considered to be blind. When the detection time reaches a certain time, the system stops working, and the time interval T from the detection of the face to the face of the face to the last time is calculated, and the blink frequency of the user is calculated by counting the number of blinks. According to the user's blink frequency and the normal blink frequency value, the user is given certain suggestions. During the implementation process, as shown in Fig. 3, when the eyes are in the semi-open and semi-closed state (as shown in Fig. 10), the white of the eyes is much less than that in the open state (as shown in Fig. 9). When the eyes are completely processed in the closed state (as shown in FIG. 11 and FIG. 12), the gray value of the extracted human eye ROI picture is close to the skin color, and the ROI of the human eye in the blinking state is greatly different, further demonstrating the present invention. Practicality. As shown in Figs. 13 to 15, the simulation of the vertical gray scale of the human eye ROI is obtained, L = 12.4 in the blinking state, L = 2.4 in the half-bow half-closed state, and L = 3 in the closed-eye state. When the eye is in the blinking state, the index L is much smaller than the L in the blinking state. Generally, the index L in the blinking state is less than 0.5 times the L in the blinking state, indicating the accuracy of the human eye state detection proposed by the present invention. high. While the preferred embodiments of the present invention have been disclosed for purposes of illustration, those skilled in the art will recognize that various modifications, additions and substitutions are possible, and the scope of the invention should not be limited to the embodiments described above. INDUSTRIAL APPLICABILITY As described above, the above embodiments and preferred embodiments not only solve the problem in the related art that when the user uses the terminal, the number of blinks is small, and the eye problem is easily caused. However, the existing terminals are smart, but the existing terminals are smart. However, it is impossible to urge users to protect their vision, which leads to the problem of decreased vision.

Claims

权 利 要 求 书 、 一种检测人眼健康状态的方法, 包括: 通过摄像头获取预定时间段内眼睛的眨眼次数; A claim for a claim, a method for detecting a state of health of a human eye, comprising: obtaining, by a camera, the number of blinks of an eye within a predetermined period of time;
将所述眨眼次数与预设眨眼次数阈值进行比较, 根据比较结果确定用户的 眼睛所处的健康状态, 并根据所述健康状态发出对应的用眼提示。 、 如权利要求 1所述的方法, 其中, 通过摄像头获取预定时间段内眼睛的眨眼次 数包括:  Comparing the number of blinks with a preset threshold of blinks, determining a health state of the user's eyes based on the comparison result, and issuing a corresponding eye prompt according to the health state. The method according to claim 1, wherein the obtaining the number of blinks of the eye in the predetermined period of time by the camera comprises:
将用户处于睁眼状态下的眼睛置于摄像头前, 保持第一预定时长, 通过摄 像头获取睁眼状态下预定区域的灰度信息, 其中, 所述预定区域是以每只眼睛 为中心向外截取的预设图形; 在所述第一预定时长之后, 按照第一预设时间间隔采集所述预设区域内的 灰度信息, 并根据采集到的灰度信息的变化值判断用户当前眼睛所处的睁闭状 态, 其中, 当所述灰度信息的变化值在预设变化范围内的情况下, 确定眼睛处 于睁眼状态, 当所述灰度信息的变化值超过所述预设变化范围的情况下, 确定 眼睛处于闭眼状态; 根据所述预定时间段内统计的眼睛的睁闭状态确定所述眨眼次数。 、 如权利要求 1所述的方法, 其中, 通过摄像头获取预定时间段内眼睛的眨眼次 数包括:  The eye in the blinking state is placed in front of the camera for a first predetermined length of time, and the grayscale information of the predetermined area in the blink state is obtained by the camera, wherein the predetermined area is taken out from the center of each eye. Presetting the graphics; after the first predetermined duration, collecting the grayscale information in the preset area according to the first preset time interval, and determining, according to the changed value of the collected grayscale information, the current eye of the user a closed state, wherein, when the change value of the gray scale information is within a preset variation range, determining that the eye is in a blink state, when the change value of the gray scale information exceeds the preset variation range In the case, it is determined that the eye is in a closed eye state; the number of blinks is determined according to the state of the eyelid closed in the predetermined time period. The method according to claim 1, wherein the obtaining the number of blinks of the eye in the predetermined period of time by the camera comprises:
将用户处于睁眼状态下的眼睛置于摄像头前, 保持第二预定时长, 获取当 前图像以记录睁眼状态下预定区域的灰度信息, 其中, 所述预定区域是以每只 眼睛为中心向外截取的预设图形; 在所述第二预定时长之后, 按照第二预设时间间隔采集所述预设区域对应 的图像, 并对采集到的所有图像所对应的灰度信息求平均值, 对所述平均值求 极值点, 以确定所述极值点预设范围内灰度变化率的最大值;  The eye in the blinking state is placed in front of the camera for a second predetermined time period, and the current image is acquired to record the grayscale information of the predetermined region in the blink state, wherein the predetermined region is centered on each eye. The preset image is taken out; after the second predetermined time length, the image corresponding to the preset area is acquired according to the second preset time interval, and the gray level information corresponding to all the collected images is averaged. And determining an extreme point of the average value to determine a maximum value of the gray level change rate in the preset range of the extreme point;
根据所述灰度变化率的最大值判断用户当前眼睛所处的睁闭状态, 其中, 确定灰度变化率的变化范围超过所述灰度变化率的最大值预定倍数的极值点所 对应的图像为闭眼状态, 确定灰度变化率的变化范围等于或小于所述灰度变化 率的最大值预定倍数的极值点所对应的图像为睁眼状态; 根据所述预定时间段内统计的眼睛的睁闭状态确定所述眨眼次数。 、 如权利要求 1至 3中任一项所述的方法, 其中, 将所述眨眼次数与预设眨眼次 数阈值进行比较, 根据比较结果确定用户的眼睛所处的健康状态包括: Determining, according to the maximum value of the gray-scale change rate, a closed state in which the current eye of the user is located, wherein determining that the range of change of the gray-scale change rate exceeds an extreme value of a predetermined multiple of the maximum value of the gray-scale change rate The image is in a closed-eye state, and an image corresponding to an extreme value point in which the variation range of the gray-scale change rate is equal to or smaller than a maximum value of the maximum value of the gray-scale change rate is a blink state; The number of blinks is determined according to the closed state of the eye counted in the predetermined period of time. The method according to any one of claims 1 to 3, wherein comparing the number of blinks with a preset threshold of blinks, and determining the health status of the user's eyes according to the comparison result includes:
在所述眨眼次数大于或等于所述预设眨眼次数阈值的情况下, 确定所述眼 睛处于健康状态;  Determining that the eye is in a healthy state if the number of blinks is greater than or equal to the threshold of the preset number of blinks;
在所述眨眼次数小于所述预设眨眼次数阈值的情况下, 确定所述眼睛处于 疲惫状态。 、 如权利要求 4所述的方法,其中,根据所述健康状态发出对应的用眼提示包括: 在用户的眼睛处于疲惫状态的情况下,发出告警音和 /或提示框以提示用户 眼睛需要休息。 、 如权利要求 1至 3中任一项所述的方法, 其中, 在通过摄像头获取预定时间段 内眼睛的眨眼次数之前, 还包括: 检测所述摄像头内是否出现人脸信息;  In the case where the blink number is less than the preset blink count threshold, it is determined that the eye is in a tired state. The method according to claim 4, wherein the issuing the corresponding eye prompt according to the health state comprises: in the case that the user's eyes are in a tired state, issuing an alert tone and/or a prompt box to prompt the user that the eye needs rest . The method according to any one of claims 1 to 3, wherein before the obtaining the number of blinks of the eye in the predetermined time period by the camera, the method further comprises: detecting whether face information appears in the camera;
在出现人脸信息的情况下, 检测所述摄像头是否检测到眼睛信息; 在检测到眼睛信息的情况下, 通过摄像头获取预定时间段内眼睛的眨眼次 数。 、 一种检测人眼健康状态的装置, 包括: 获取模块, 设置为通过摄像头获取预定时间段内眼睛的眨眼次数; 确定模块, 设置为将所述眨眼次数与预设眨眼次数阈值进行比较, 根据比 较结果确定用户的眼睛所处的健康状态, 并根据所述健康状态发出对应的用眼 提示。 、 如权利要求 7所述的装置, 其中, 所述获取模块包括: 第一获取单元, 设置为将用户处于睁眼状态下的眼睛置于摄像头前, 保持 第一预定时长, 通过摄像头获取睁眼状态下预定区域的灰度信息, 其中, 所述 预定区域是以每只眼睛为中心向外截取的预设图形; 第一确定单元, 设置为在所述第一预定时长之后, 按照第一预设时间间隔 采集所述预设区域内的灰度信息, 并根据采集到的灰度信息的变化值判断用户 当前眼睛所处的睁闭状态, 其中, 当所述灰度信息的变化值在预设变化范围内 的情况下, 确定眼睛处于睁眼状态, 当所述灰度信息的变化值超过所述预设变 化范围的情况下, 确定眼睛处于闭眼状态; 第一统计单元, 设置为根据所述预定时间段内统计的眼睛的睁闭状态确定 所述眨眼次数。 、 如权利要求 7所述的装置, 其中, 所述获取模块包括: 第二获取单元, 设置为将用户处于睁眼状态下的眼睛置于摄像头前, 保持 第二预定时长, 获取当前图像以记录睁眼状态下预定区域的灰度信息, 其中, 所述预定区域是以每只眼睛为中心向外截取的预设图形; In the case where the face information appears, it is detected whether the camera detects the eye information; in the case where the eye information is detected, the number of blinks of the eye in the predetermined time period is acquired by the camera. And a device for detecting a healthy state of the human eye, comprising: an obtaining module, configured to acquire a blinking number of the eye within a predetermined time period by the camera; and a determining module configured to compare the blinking number with a preset blinking threshold value, according to The comparison results determine the health status of the user's eyes and issue corresponding eye tips based on the health status. The device of claim 7, wherein the obtaining module comprises: a first acquiring unit, configured to place an eye in a blinking state of the user in front of the camera, to maintain a first predetermined duration, and obtain a blink through the camera The grayscale information of the predetermined area in the state, wherein the predetermined area is a preset pattern that is taken out from the center of each eye; the first determining unit is configured to follow the first predetermined time after the first predetermined time length Setting a time interval to collect grayscale information in the preset area, and determining a closed state of the current eye of the user according to the changed value of the collected grayscale information, wherein when the change value of the grayscale information is in advance Set within the range of variation a case where it is determined that the eye is in a blinking state, and when the change value of the grayscale information exceeds the preset variation range, determining that the eye is in a closed eye state; the first statistical unit is set to be according to the predetermined time The closed state of the eye counted in the segment determines the number of blinks. The device of claim 7, wherein the obtaining module comprises: a second acquiring unit, configured to place an eye in a blinking state of the user in front of the camera, maintain a second predetermined duration, and acquire a current image for recording Gray scale information of a predetermined area in a blinking state, wherein the predetermined area is a preset pattern taken outwardly from each eye;
第二确定单元, 设置为在所述第二预定时长之后, 按照第二预设时间间隔 采集所述预设区域对应的图像, 并对采集到的所有图像所对应的灰度信息求平 均值, 对所述平均值求极值点, 以确定所述极值点预设范围内灰度变化率的最 大值;根据所述灰度变化率的最大值判断用户当前眼睛所处的睁闭状态,其中, 确定灰度变化率的变化范围超过所述灰度变化率的最大值预定倍数的极值点所 对应的图像为闭眼状态, 确定灰度变化率的变化范围等于或小于所述灰度变化 率的最大值预定倍数的极值点所对应的图像为睁眼状态; 第二统计单元, 设置为根据所述预定时间段内统计的眼睛的睁闭状态确定 所述眨眼次数。 0、 如权利要求 7至 9中任一项所述的装置, 其中, 所述确定模块, 还设置为在用户的眼睛处于疲惫状态的情况下, 发出告警 音和 /或提示框以提示用户眼睛需要休息。 1、 一 移动终端,包括:权利要求 7至 10中任一项所述的检测人眼健康状态的装  The second determining unit is configured to: after the second predetermined duration, collect the image corresponding to the preset area according to the second preset time interval, and average the gray level information corresponding to all the collected images, And determining an extreme point of the average value to determine a maximum value of the gray level change rate in the preset range of the extreme value point; and determining a closed state of the current eye of the user according to the maximum value of the gray level change rate, Wherein, the image corresponding to the extreme value point whose variation range of the gray-scale change rate exceeds the maximum value of the maximum value of the gray-scale change rate is a closed-eye state, and the variation range of the gray-scale change rate is determined to be equal to or smaller than the grayscale The image corresponding to the extreme value of the predetermined multiple of the change rate is the blink state; the second statistical unit is configured to determine the number of blinks according to the closed state of the eye counted in the predetermined time period. The device according to any one of claims 7 to 9, wherein the determining module is further configured to issue an alert tone and/or a prompt box to prompt the user's eyes if the user's eyes are in a tired state. need to have a rest. A mobile terminal comprising: the device for detecting the health of the human eye according to any one of claims 7 to 10.
PCT/CN2014/084844 2014-04-18 2014-08-20 Method and apparatus for detecting health status of human eyes and mobile terminal WO2015158087A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410158930.XA CN105022981B (en) 2014-04-18 2014-04-18 A kind of method, device and mobile terminal detecting human eye health state
CN201410158930.X 2014-04-18

Publications (1)

Publication Number Publication Date
WO2015158087A1 true WO2015158087A1 (en) 2015-10-22

Family

ID=54323445

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/084844 WO2015158087A1 (en) 2014-04-18 2014-08-20 Method and apparatus for detecting health status of human eyes and mobile terminal

Country Status (2)

Country Link
CN (1) CN105022981B (en)
WO (1) WO2015158087A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180089499A1 (en) * 2016-09-24 2018-03-29 Nanchang O-Film Bio-Identification Technology Co., Ltd. Face recognition method and device and apparatus
CN108196767A (en) * 2017-12-28 2018-06-22 广东小天才科技有限公司 The use control method and electronic equipment of a kind of electronic equipment
CN110245574A (en) * 2019-05-21 2019-09-17 平安科技(深圳)有限公司 A kind of human fatigue state identification method, device and terminal device
WO2022152095A1 (en) * 2021-01-12 2022-07-21 周星 Mobile phone having user state testing function

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106897725A (en) * 2015-12-18 2017-06-27 西安中兴新软件有限责任公司 A kind of method and device for judging user's asthenopia
CN105677174A (en) * 2015-12-30 2016-06-15 宇龙计算机通信科技(深圳)有限公司 Terminal reading mode control method and device, and terminal
CN106155319A (en) * 2016-06-28 2016-11-23 广东欧珀移动通信有限公司 Control method, control device and electronic installation
CN106199970A (en) * 2016-08-30 2016-12-07 北京乐动卓越科技有限公司 The anti-fatigue method of a kind of helmet and system
CN106405838A (en) * 2016-09-30 2017-02-15 珠海市魅族科技有限公司 Sight distance adjustment method and device
CN106570461A (en) * 2016-10-21 2017-04-19 哈尔滨工业大学深圳研究生院 Video frame image extraction method and system based on lip movement identification
CN106569928A (en) * 2016-11-01 2017-04-19 佛山科学技术学院 Eye usage protection method and system thereof
CN106921806A (en) * 2017-04-27 2017-07-04 广东艾檬电子科技有限公司 A kind of eyeshield based reminding method and mobile terminal for being applied to mobile terminal
CN107115669A (en) * 2017-05-26 2017-09-01 合肥充盈信息科技有限公司 A kind of eyeshield games system and its implementation
CN107301008A (en) * 2017-05-31 2017-10-27 广东欧珀移动通信有限公司 The output intent and Related product of prompt message
KR101889463B1 (en) * 2017-08-03 2018-08-17 연세대학교 산학협력단 Method for Controlling Screen Display of Terminal and Terminal using the same
CN108459806A (en) * 2018-03-30 2018-08-28 努比亚技术有限公司 terminal control method, terminal and computer readable storage medium
CN109044375A (en) * 2018-07-30 2018-12-21 珠海格力电器股份有限公司 A kind of control system and its method of real-time tracking detection eyeball fatigue strength
CN111079679A (en) * 2019-12-23 2020-04-28 广东小天才科技有限公司 Eye fatigue value judgment method, device, equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102109903A (en) * 2010-12-28 2011-06-29 中兴通讯股份有限公司 Method and device for protecting eyesight
JP2012139562A (en) * 2012-04-26 2012-07-26 Hamamatsu Photonics Kk Blinking measuring instrument
US20120230553A1 (en) * 2009-09-01 2012-09-13 Lg Innotek Co., Ltd. Apparatus and method for detecting eye state
CN103426275A (en) * 2013-08-01 2013-12-04 步步高教育电子有限公司 Device, desk lamp and method for detecting eye fatigue
CN103530595A (en) * 2012-07-04 2014-01-22 富士通株式会社 Method and apparatus for detecting eye states
CN103617421A (en) * 2013-12-17 2014-03-05 上海电机学院 Fatigue detecting method and system based on comprehensive video feature analysis

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101344919B (en) * 2008-08-05 2012-08-22 华南理工大学 Sight tracing method and disabled assisting system using the same
CN101339603A (en) * 2008-08-07 2009-01-07 电子科技大学中山学院 Method for selecting qualified iris image from video frequency stream

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120230553A1 (en) * 2009-09-01 2012-09-13 Lg Innotek Co., Ltd. Apparatus and method for detecting eye state
CN102109903A (en) * 2010-12-28 2011-06-29 中兴通讯股份有限公司 Method and device for protecting eyesight
JP2012139562A (en) * 2012-04-26 2012-07-26 Hamamatsu Photonics Kk Blinking measuring instrument
CN103530595A (en) * 2012-07-04 2014-01-22 富士通株式会社 Method and apparatus for detecting eye states
CN103426275A (en) * 2013-08-01 2013-12-04 步步高教育电子有限公司 Device, desk lamp and method for detecting eye fatigue
CN103617421A (en) * 2013-12-17 2014-03-05 上海电机学院 Fatigue detecting method and system based on comprehensive video feature analysis

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180089499A1 (en) * 2016-09-24 2018-03-29 Nanchang O-Film Bio-Identification Technology Co., Ltd. Face recognition method and device and apparatus
US10311289B2 (en) * 2016-09-24 2019-06-04 Nanchang O-Film Bio-Identification Technology Co., Ltd. Face recognition method and device and apparatus
CN108196767A (en) * 2017-12-28 2018-06-22 广东小天才科技有限公司 The use control method and electronic equipment of a kind of electronic equipment
CN110245574A (en) * 2019-05-21 2019-09-17 平安科技(深圳)有限公司 A kind of human fatigue state identification method, device and terminal device
WO2022152095A1 (en) * 2021-01-12 2022-07-21 周星 Mobile phone having user state testing function

Also Published As

Publication number Publication date
CN105022981B (en) 2019-08-16
CN105022981A (en) 2015-11-04

Similar Documents

Publication Publication Date Title
WO2015158087A1 (en) Method and apparatus for detecting health status of human eyes and mobile terminal
US10311289B2 (en) Face recognition method and device and apparatus
CN109976506B (en) Awakening method of electronic equipment, storage medium and robot
WO2021068256A1 (en) Method for relieving eye strain and intelligent teriminal
US20200334477A1 (en) State estimation apparatus, state estimation method, and state estimation program
CN101470460B (en) Method for sight protection when using computer, and computer thereof
CN103295370B (en) Method and system for preventing myopia by monitoring distance between eyes and screen
CN105072327B (en) A kind of method and apparatus of the portrait processing of anti-eye closing
TWI729983B (en) Electronic device, system and method for adjusting display device
Kurylyak et al. Detection of the eye blinks for human's fatigue monitoring
CN101430576B (en) Eye protection warning device and method
CN103093124A (en) Method for restricting the usage of electronic equipment and electronic equipment
WO2017101226A1 (en) Method and apparatus for judging user eyesight fatigue
CN111616718B (en) Method and system for detecting fatigue state of driver based on attitude characteristics
CN108898079A (en) A kind of monitoring method and device, storage medium, camera terminal
CN107918726A (en) Apart from inducing method, equipment and storage medium
CN115599219A (en) Eye protection control method, system, equipment and storage medium for display screen
CN107958572B (en) Baby monitoring system
TWI684438B (en) Method of detecting eye fatigue
CN111447497A (en) Intelligent playing device and energy-saving control method thereof
CN109426797B (en) Doze detection device and doze detection method thereof
WO2020118882A1 (en) Method, apparatus and smart device for monitoring study status
CN109044375A (en) A kind of control system and its method of real-time tracking detection eyeball fatigue strength
CN113744499A (en) Fatigue early warning method, glasses, system and computer readable storage medium
CN110633012A (en) Anti-addiction computer

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14889393

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14889393

Country of ref document: EP

Kind code of ref document: A1