CN113596539B

CN113596539B - Vision detection processing method, device, terminal and medium based on intelligent television

Info

Publication number: CN113596539B
Application number: CN202110855756.4A
Authority: CN
Inventors: 姚燕
Original assignee: Konka Group Co Ltd
Current assignee: Konka Group Co Ltd
Priority date: 2021-07-28
Filing date: 2021-07-28
Publication date: 2023-12-05
Anticipated expiration: 2041-07-28
Also published as: CN113596539A

Abstract

The invention discloses a vision detection processing method, a device, a terminal and a medium based on an intelligent television, wherein the method comprises the following steps: detecting the state of a detected target, and confirming whether the state of the detected target accords with a detection environment; when the detected target state accords with the detection environment, acquiring a preset electronic logarithmic visual chart; acquiring detection feedback information corresponding to a detected target based on a focus detection prompt of the electronic logarithmic visual chart; outputting a vision detection result based on the detection data of the detection feedback information; and controlling the intelligent television to perform corresponding operation response according to the vision detection result. The method aims at solving the problem that in the prior art, the television can only be turned off when the preset watching time is reached, and the aim of really warning the user to protect eyes can not be achieved. The intelligent television has the eyesight detection function, is convenient for prompting the health state of eyes of a user, and is convenient for the user to use.

Description

Vision detection processing method, device, terminal and medium based on intelligent television

Technical Field

The invention relates to the technical field of display control, in particular to a vision detection processing method, device, terminal and medium based on an intelligent television.

Background

Along with the development of technology and the continuous improvement of living standard of people, the use of various intelligent terminals such as intelligent televisions is becoming more and more popular, and the intelligent televisions become indispensable leisure tools in the life of people.

The intelligent television has more and more functions, and people enjoy watching television more and more in leisure time. However, the smart television in the prior art does not have a vision detection function, and is sometimes inconvenient for users to use.

Accordingly, there is a need for improvement and development in the art.

Disclosure of Invention

The invention mainly aims to provide a vision detection processing method and device based on an intelligent television, an intelligent terminal and a storage medium, and aims to solve the problem that the intelligent television in the prior art does not have a vision detection function and is inconvenient for users to use.

In order to achieve the above object, a first aspect of the present invention provides a vision testing processing method based on a smart television, where the method includes:

detecting the state of a detected target, and confirming whether the state of the detected target accords with a detection environment;

when the detected target state accords with the detection environment, acquiring a preset electronic logarithmic visual chart;

acquiring detection feedback information corresponding to a detected target based on a focus detection prompt of the electronic logarithmic visual chart;

Outputting a vision detection result based on the detection data of the detection feedback information;

and controlling the intelligent television to perform corresponding operation response according to the vision detection result.

Optionally, the step of detecting the detected target state and determining whether the detected target state meets the detection environment includes:

the electronic logarithmic visual acuity chart is collected in advance and stored in the intelligent television, and the electronic logarithmic visual acuity chart is called by starting the visual acuity detection function;

and pre-storing a first preset time for the vision detection function to be automatically started at regular intervals, and pre-storing a second preset time for the intelligent television to be automatically started when the continuous watching time of the intelligent television exceeds the second preset time.

Optionally, the step of detecting the detected target state and determining whether the detected target state meets the detection environment further includes:

detecting whether the continuous watching time of the intelligent television exceeds the second preset time; or detecting whether the current watching time of the intelligent television reaches the first preset time;

when the continuous watching time of the intelligent television exceeds the second preset time; or detecting that the current watching time of the intelligent television reaches the first preset time, and controlling to automatically start the vision detection function;

When the function of canceling vision detection is received, the cancellation password is prompted to be input through the prompt box.

acquiring a face image of a detected target, and acquiring information of a current user through face recognition;

identifying the distance between the current user and the intelligent television, and judging whether the distance accords with the vision detection distance set by the detection environment;

when the distance accords with the vision detection distance set by the detection environment and one eye of the current user is in an open state and the other eye is in a shielding state, the current detected target state is judged to accord with the detection environment.

detecting whether a remote controller with preset pinna shields one eye of a current user or not, and detecting whether the pinna of the remote controller rotates to a preset position or not;

When the distance accords with the vision detection distance set by the detection environment, and when the wing of the remote controller is detected to rotate to a preset position to shield one eye of the current user and the other eye of the current user is detected to be in an open state, the current detected target state is judged to accord with the detection environment.

Optionally, the step of acquiring the detection feedback information corresponding to the detected target based on the focus detection prompt of the electronic logarithmic visual chart includes:

displaying the acquired electronic logarithmic visual chart on a screen of the intelligent television;

according to a preset vision testing requirement, controlling a focus cursor to automatically move to a target position to be detected by the electronic logarithmic visual chart;

waiting for a third preset time to acquire detection feedback information corresponding to the detected target at the position of the sighting target corresponding to each focus cursor;

checking the detection feedback information with E-direction information of the position of the current focus cursor; if the vision value is correct, recording the current vision value, and continuously detecting the next optotype;

if the voice prompt is wrong, responding for the second time at a third preset time; if the vision value is wrong, the current vision value is recorded.

Optionally, the step of controlling the smart television to perform corresponding operation response according to the vision detection result includes:

When the vision detection result is a first preset result indicating good vision, controlling the intelligent television to exit the vision detection function and continuously watching the television;

when the vision detection result is a second preset result indicating poor vision, controlling the intelligent television message prompt box to input a password to finish detection and continue watching television, otherwise, directly entering standby; and when the unsuccessful input of the password is detected, controlling to enter a screen locking state.

The second aspect of the present invention provides a vision testing processing device based on a smart television, where the device includes:

the environment detection module is used for detecting the state of the detected target and confirming whether the state of the detected target accords with the detection environment;

the acquisition module is used for acquiring a preset electronic logarithmic visual chart when the state of the detected target accords with the detection environment;

the vision detection module is used for acquiring detection feedback information corresponding to a detected target based on the focus detection prompt of the electronic logarithmic visual chart;

the result output module is used for outputting a vision detection result based on the detection data of the detection feedback information;

and the operation response module is used for controlling the intelligent television to perform corresponding operation response according to the vision detection result.

The third aspect of the present invention provides an intelligent terminal, where the intelligent terminal includes a memory, a processor, and a vision detection processing program based on an intelligent television stored in the memory and capable of running on the processor, where the vision detection processing program based on the intelligent television implements any one of the steps of the vision detection processing method based on the intelligent television when executed by the processor.

A fourth aspect of the present invention provides a computer readable storage medium, where the computer readable storage medium stores a vision testing processing program based on a smart tv, where the vision testing processing program based on the smart tv implements any one of the steps of the vision testing processing method based on the smart tv when executed by a processor.

From the above, the invention adopts: when the user turns on the vision inspection function in the menu, and sets an inspection plan. According to the appointed time, the television automatically starts vision testing. Firstly, the user can finish vision detection according to prompts according to the visual charts displayed on the television interface by regulating the required data through the AI identification module. The data generated by detection is displayed in a follow-up comparison mode. If the data is worse than the last time or exceeds the warning value, the detection system has relevant prompts and suggestions, and the television automatically enters a standby mode. If the data is good, the user also needs to input an unlocking password to continue watching. The invention adds new functions to the intelligent television: the vision detecting device has a vision detecting function, and can periodically detect the basic vision condition of a user. And providing early warning and decision making according to the detected data condition, and timely controlling the duration of using the intelligent television by the user. The final purpose is to help the user to improve eye protection consciousness and avoid the long-time use of the television by the children at home.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic flow chart of a vision testing processing method based on an intelligent television according to an embodiment of the present invention;

FIG. 2 is a schematic flow chart of step S100 in FIG. 1 according to an embodiment of the present invention;

FIG. 3 is a schematic flow chart of step S100 in FIG. 1 according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of a remote control with feathering according to an embodiment of the present invention;

FIG. 5 is a flowchart illustrating the step S300 in FIG. 1 according to an embodiment of the present invention;

FIG. 6 is a schematic flow chart of step S500 in FIG. 1 according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of detecting a detected target state according to an embodiment of the present invention;

fig. 8 is a schematic diagram of a specific flow of vision testing processing of an intelligent television according to an embodiment of the present invention;

fig. 9 is a schematic structural diagram of a vision testing processing device based on an intelligent television according to an embodiment of the present invention;

Fig. 10 is a schematic block diagram of an internal structure of an intelligent terminal according to an embodiment of the present invention.

Detailed Description

In the following description, for purposes of explanation and not limitation, specific details are set forth such as the particular system architecture, techniques, etc., in order to provide a thorough understanding of the embodiments of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.

It should be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

It is also to be understood that the terminology used in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

It should be further understood that the term "and/or" as used in the present specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.

As used in this specification and the appended claims, the term "if" may be interpreted in context as "when …" or "upon" or "in response to a determination" or "in response to detection. Similarly, the phrase "if a condition or event described is determined" or "if a condition or event described is detected" may be interpreted in the context of meaning "upon determination" or "in response to determination" or "upon detection of a condition or event described" or "in response to detection of a condition or event described".

The following description of the embodiments of the present invention will be made more fully hereinafter with reference to the accompanying drawings, in which embodiments of the invention are shown, it being evident that the embodiments described are only some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, but the present invention may be practiced in other ways other than those described herein, and persons skilled in the art will readily appreciate that the present invention is not limited to the specific embodiments disclosed below.

However, as the functions of the smart tv are more and more, besides live broadcasting, for example, opening an aiqi on-demand cartoon and opening a game application to play a small game, people increasingly like to use the smart tv to play entertainment in leisure time, especially children forbidden to contact with the internet by parents, can take much time in various interesting application programs of the smart tv. It is well known that excessive television watching can be degraded in vision due to long-term radiation received by eyes, and especially for children with poor homemade ability, the television can be immersed in the intelligent television all the time without a parent reminding.

The smart television product in the prior art has a video viewing time length protection function, but the protection mode is generally that when the user viewing time length reaches a preset time length, for example, five hours, the smart television is controlled to be automatically turned off, and the television can be continuously watched regardless of the limitation of the viewing time length through the manager password. The method can simply limit the viewing time of the user, and the user may observe the viewing time when the user uses the method in the earlier stage, but when the user prolongs the time limit or cancels the time limit for the user to continue watching the wonderful part at one time, the sense of conviction is reduced, and the user cancels the time limit set by the user in the later time. For this reason, the user cannot adhere to a thing to the bottom simply by simply having no benefit or simple constraint of vigilance, and the user can reduce the distraction when finding that the duration of adhering to the constraint to watch television is not different from what the user does not watch television at will. And when the vision of the user is damaged and the user needs to be matched with glasses, the user can feel that the user watches the television for a long time. Therefore, the prior art lacks a technical scheme for limiting the television watching time of the user in a warning or benefit mode, for example, a scheme for testing eyesight of the user, enabling the user to intuitively see whether the eyesight of the user is reduced or not, and limiting the watching time of the user by combining a watching time limiting function.

In order to solve the problems in the prior art, in the scheme of the invention, the state of the detected target is detected, and whether the state of the detected target accords with the detection environment is confirmed; when the detected target state accords with the detection environment, acquiring a preset electronic logarithmic visual chart; acquiring detection feedback information corresponding to a detected target based on a focus detection prompt of the electronic logarithmic visual chart; outputting a vision detection result based on the detection data of the detection feedback information; and controlling the intelligent television to perform corresponding operation response according to the vision detection result. Compared with the scheme in the prior art that the user can only watch the duration in a common mode by limiting the user, and the automatic power-off is realized when the user exceeds the watching duration. The scheme of the invention is that when the current watching time of the intelligent television is detected to reach a certain preset time or the time for the user to watch the intelligent television is detected to reach a certain time, the vision detection function is started, when the vision of the user is detected to not be reduced, the user is allowed to watch the television continuously, when the vision of the user is detected to be reduced or the eyes are tired, the vision detection result of the user is controlled to return, and the intelligent television is controlled to respond to an operation response such as closing the television, so that the intelligent television can warn the user to protect eyes while the watching time of the user is limited. Therefore, the invention adds new functions to the intelligent television: the vision detecting device has a vision detecting function, and can periodically detect the basic vision condition of a user. And providing early warning and decision making according to the detected data condition, and timely controlling the duration of using the intelligent television by the user. The final purpose is to help the user to improve eye protection consciousness and avoid the long-time use of the television by the children at home.

Exemplary method

As shown in fig. 1, an embodiment of the present invention provides a vision testing processing method based on an intelligent television, and specifically, the method includes the following steps:

step S100, detecting the detected target state, and confirming whether the detected target state accords with a detection environment;

in this embodiment, the detected target includes a user who is using a smart television, and the determining whether the state of the detected target accords with the detection environment includes determining a current state of the user, for example, whether a distance between the current user and the smart television accords with a detection distance; whether the current user environment brightness accords with the detection brightness or not; whether one eye of the current user is covered, etc. The confirmation mode includes collecting the behavior and distance information of the user and the environment brightness information of the user through a sensor such as a camera sensor, an infrared sensor, a brightness sensor and the like arranged on the television, and confirming whether the detected target state accords with the detection environment or not through analyzing the behavior of the user, the distance between the user and the intelligent television and the size of the environment brightness value.

Step S200, when the detected target state accords with the detection environment, a preset electronic logarithmic visual chart is obtained;

In this embodiment, when it is detected that the behavior, the distance, the environmental brightness, and the like of the detected object conform to the detection environment, the electronic logarithmic visual chart preset in the smart television is controlled to be acquired, and the electronic logarithmic visual chart is displayed in the screen. The electronic vision testing table is also named as an electronic vision tester, and consists of letters E with different opening directions and different character sizes in each row, when a user is separated from the electronic vision testing table by a certain distance, the numerical value corresponding to the smallest character in the opening direction can be distinguished by a single eye, namely the vision value of the user, wherein the normal vision value of the human eye is 5.0. Further, in order to obtain the vision value of the user more accurately, the electronic vision pair table can be finely adjusted according to the obtained distance between the user and the intelligent television.

Step S300, based on focus detection prompt of an electronic logarithmic visual chart, detection feedback information corresponding to a detected target is obtained;

in this embodiment, the smart television controls the letter "E" to be randomly marked in the electronic vision pair chart, and obtains the detection feedback information corresponding to the detected target by obtaining the behavior of the user through the camera sensor installed on the smart television. The detection feedback information comprises the direction indicated by the current action of the user or the direction information in the user language is obtained through the AI algorithm and a microphone, for example, the intelligent television sends the user action image obtained through a camera sensor to the AI algorithm, and the AI algorithm judges that the current detection feedback information of the user is left when recognizing that the direction of the finger or the arm is left. When the acquired detection feedback information is consistent with the opening direction of the letter E, the vision value of the user is considered to reach the current test value, then the focus detection prompt is further controlled to fall on the letter E with higher vision value, and finally the current vision value of the user is determined according to the detection feedback information obtained by multiple detection.

Step S400, outputting a vision detection result based on the detection data of the detection feedback information;

in this embodiment, the smart tv outputs the vision detection result obtained by multiple detection to the screen of the smart tv based on the detection data of the detection feedback information, for example, when detecting that the vision value of the user is 5.0, then output "may please you, the vision value is 5.0, the eyes of you are very healthy", or when detecting that the vision value of the user is 4.5, then output "the vision value of you is 4.5, you need to rest and then watch tv".

And step S500, controlling the intelligent television to perform corresponding operation response according to the vision detection result.

In this embodiment, according to the output vision detection result, the smart television controls the smart television to perform different operations correspondingly, for example, when the vision is worse, the smart television is turned off or locked, or when the vision is better, the smart television continues to play video after one minute of rest, etc., when the smart television detects that the vision of the user is normal, the user is not limited to watch the television, the smart television is controlled to continue playing the television, or the user is allowed to play the television after a little rest; when the intelligent television detects that the vision of the user is tired due to long-time watching of the television, and the vision is reduced, the intelligent television is controlled to be closed and locked, so that the user cannot continue watching television programs. In order to make the function more humanized, the user can understand the meaning of protecting eyes, and can play stories, short messages or pictures and the like related to eyes and vision before closing a screen, so that the user realizes the importance of eye health, the resolution of protecting eyes of the user is effectively improved, and the use experience of a television is improved.

From the above, it can be seen that the method for processing vision detection based on smart television provided by the embodiment of the invention detects the state of the detected object, and confirms whether the state of the detected object accords with the detection environment; when the detected target state accords with the detection environment, acquiring a preset electronic logarithmic visual chart; acquiring detection feedback information corresponding to a detected target based on a focus detection prompt of the electronic logarithmic visual chart; outputting a vision detection result based on the detection data of the detection feedback information; and controlling the intelligent television to perform corresponding operation response according to the vision detection result. Compared with the scheme in the prior art that the automatic shutdown is realized only by limiting the watching duration of the user and when the user exceeds the preset watching duration. The method and the device have the advantages that when the current watching time of the intelligent television is detected to reach a certain preset time or the watching time of the intelligent television of the user is detected to reach a fixed time, the vision detection function is started, when the vision of the user is detected to be not reduced, the vision detection result is returned, the television is continuously played, when the vision of the user is detected to be reduced, the vision detection result of the user is controlled to be returned, the intelligent television is controlled to perform corresponding operation response, such as closing the television, and the purpose of warning the user to protect eyes can be achieved when the watching time of the user is limited. Therefore, the invention adds new functions to the intelligent television: the vision detecting device has a vision detecting function, and can periodically detect the basic vision condition of a user. And providing early warning and decision making according to the detected data condition, and timely controlling the duration of using the intelligent television by the user. The final purpose is to help the user to improve eye protection consciousness and avoid the long-time use of the television by the children at home.

Specifically, when detecting that the duration of continuously watching the smart television exceeds a fixed duration or the current watching time of the smart television reaches a fixed time point, detecting the current state of the user, detecting whether the current distance between the user and the television is proper or not through a sensor arranged on the smart television, judging whether one eye of the user is covered or not, when detecting that the current state of the user accords with a detection environment, controlling to display a preset electronic logarithmic visual chart on a screen of the smart television, the television controlling prompts letters E on the electronic logarithmic visual chart, for example, performing circle selection on letters E with a specific size, simultaneously acquiring the direction expressed by the user through a camera or a microphone in combination with an AI algorithm, judging whether the direction expressed by the user is the same as the opening direction of the selected letters E, if so, further prompting smaller letters E and acquiring the direction of the user, finally determining the eyesight of the user through a series of focus checking prompts of the electronic logarithmic visual chart and detection feedback information acquired by the smart television, outputting the eyesight of the user to the smart television display screen, and controlling to close or continue playing the television according to the quality control of the eyesight of the user.

Specifically, in an application scenario, as shown in fig. 2, the step S100 includes:

step S101, acquiring a face image of a detected target, and acquiring information of a current user through face recognition;

step S102, identifying the distance between the current user and the intelligent television, and judging whether the distance accords with the vision detection distance set by the detection environment;

step S103, when the distance accords with the vision detection distance set by the detection environment and one eye of the current user is in an open state and the other eye is in a shielding state, the current detected target state is judged to accord with the detection environment.

Wherein, before the step of detecting the detected target state and confirming whether the detected target state accords with the detection environment, the method comprises the following steps:

Before the step of detecting the detected target state and confirming whether the detected target state accords with the detection environment, the method further comprises the following steps:

For example, before the user a uses the smart television a, the smart television a collects the electronic logarithmic visual charts for detecting the eyesight of the user a in advance and stores the electronic logarithmic visual charts in the smart television, and the collecting and storing steps can be the electronic logarithmic visual charts set by factories of the smart television a when leaving factories, or the electronic logarithmic visual charts which are obtained by the user according to personal preference and meet personal aesthetic or other visual test charts for detecting eyesight in the internet, and although the detection effect of the attractive visual test charts is not as good as that of the standard electronic visual charts, for young children, the attractive visual test charts can better improve the enthusiasm of the children for actively detecting eyesight and guide the children to love to protect eyes. And the electronic vision testing chart or the vision testing charts of other styles are called each time the vision testing function is started, and the vision testing charts are displayed on the screen of the intelligent television A.

The time when the user A watches the intelligent television A is preset, and the vision detection function is required to be started. Setting a certain fixed time, for example, a time point of 10 o' clock or the like every day at night, setting the fixed certain time as a first preset time, and controlling to start a vision detection function when the intelligent television A detects that the user A watches the television in the first preset time; or setting the specified continuous watching time length to be a second preset time when the time length of watching the television by the user A exceeds 3 hours, for example, and controlling the vision detection function to be started by the intelligent television A when the time length of watching the television by the user A exceeds the second preset time. Through the two preset times, a user can detect own vision condition at intervals of preset time when watching television for a long time, and can set time points when the user watches television frequently according to user definition, so that the user can detect vision on time every day no matter how long the user watches television, and know the vision change every day.

The step before detecting the detected target state further includes that the smart television a detects whether the time of continuously watching the television by the user a exceeds the second preset time, namely 3 hours, or detects whether the current watching time of the smart television reaches the first preset time, namely 10 pm. And controlling the self-starting vision detection function when the time for continuously watching the television by the user A exceeds the second preset time or the current watching time of the intelligent television A is 10 pm. When the user A does not want to perform vision testing, the function of vision testing can be canceled through a cancel button arranged on the vision testing interface, the user A is required to input a cancel password, and if the password is input three times in succession, the vision testing is continuously performed.

After the intelligent television A starts to execute the vision detection function, the intelligent television A acquires the face image of the user A, acquires the information of the user A through face recognition, and is used for judging whether the user A is a common user or a strange user which is not stored, if the face of a friend user C of the user A is acquired through face recognition, the intelligent television A judges that the face of the user C is not stored in the intelligent television A, the user C is judged to be a strange user, and vision data of the user C are stored after vision detection is carried out on the user C. When the face of the user A is acquired through face recognition, the user A is judged to be a common user of the intelligent television A, the distance between the current user A and the intelligent television A is further recognized, and whether the distance accords with the vision detection distance set by the detection environment is judged. When the vision detection distance set by the detection environment is 5 meters of the standard vision detection distance, and when the distance between the user A and the intelligent television A is 4.5 meters, the intelligent television A informs the user A that the distance is relatively close through a screen, and the user returns; when the distance between the user A and the intelligent television A is 5.5 meters, the user A is informed that the distance is far, and please go ahead. Vision detected by the user every time is accurate through the standardized test environment, and children cannot play the television, so that the television can be continuously watched.

Further, considering that the sizes of houses and living rooms of the household are different, the size of the electronic logarithmic visual chart for detecting the eyesight of the user is adjustable within a certain range, meanwhile, when the distance between the user and the intelligent electricity is 4.5 meters and is lower than the standard test distance by 5 meters, the equal proportion of the size of the electronic logarithmic visual chart is reduced by 10 percent, and similarly, when the distance between the user and the intelligent electricity is 5.5 meters, the equal proportion of the size of the electronic logarithmic visual chart is enlarged by 10 percent, so that the problem that the user needs to move back and forth for testing the eyesight is avoided, and convenience is further provided for the use of the user.

When the distance accords with the vision detection distance set by the detection environment, whether one of eyes of the user A is in an open state and the other is in a shielding state is detected, whether one of the eyes of the user A cannot be identified is judged through face recognition, and when one of the eyes of the user A cannot be identified, the one of the eyes of the user A is judged to be in the shielding state, and the current detected target state is judged to accord with the detection environment. Further ensuring the accuracy of vision detection and preventing children from playing in the home to want to continue watching television. In addition, considering that the time period of watching television of the user may be different, the user is watching in daytime sometimes, watching in night sometimes, and even the user can pull up the curtain to watch television in dark environment sometimes, the detection of the ambient light of the environment where the current user is located can be added, and when the ambient light brightness accords with the detection environment setting, the current detected target state is judged to accord with the detection environment; when the brightness of the environment does not accord with the detection environment, the current detected target state is judged to not accord with the detection environment, and the consistency of the environment conditions during detection is ensured.

Specifically, in another application scenario, as shown in fig. 3, the step S100 further includes:

step A101, acquiring a face image of a detected target, and acquiring information of a current user through face recognition;

step A102, identifying the distance between the current user and the intelligent television, and judging whether the distance accords with the vision detection distance set by the detection environment;

step A103, detecting whether a remote controller with a preset pinna shields one eye of a current user or not, and detecting whether the pinna of the remote controller rotates to a preset position or not;

and step A104, when the distance accords with the vision detection distance set by the detection environment, detecting that the wing of the remote controller rotates to a preset position to shield one eye of the current user, and judging that the current detected target state accords with the detection environment when the other eye of the current user is in an open state.

For example, the step a101 and the step a102 are similar to the steps S101 and S102 described above, and thus will not be described again.

When the intelligent television A detects that the distance of the user A accords with the vision detection distance set by the detection environment, whether the remote controller provided with the pinna shields one eye of the current user is further detected, and whether the pinna of the remote controller rotates to a preset position is detected, as shown in fig. 4, the pinna is a remote controller structure designed for facilitating the user to shield the eyes, and the pinna can be opened from the remote controller through a rotating method to form a structure similar to T shape for shielding the eyes of the user. The method comprises the steps of detecting whether a user shields eyes through a pinna of a remote controller through a camera, and detecting whether the pinna of the remote controller is in an open state, wherein the open state is shown as a remote controller on the right side of fig. 4, a right-angle mark is arranged in the pinna of the remote controller which is completely opened, and two sides of the right-angle mark are in parallel and vertical position relation with four sides of the remote controller. When one eye of the user A is detected to be in a shielding state and the other eye is detected to be in an opening state by the remote controller, judging that the current detected target state accords with the detection environment of the detection vision.

Specifically, in an application scenario, as shown in fig. 5, the step S300 includes:

step 301, displaying the acquired electronic logarithmic visual acuity chart on a screen of an intelligent television;

step S302, according to a preset vision detection requirement, controlling a focus cursor to automatically move to a target position to be detected by an electronic logarithmic visual chart;

step S303, waiting for a third preset time to acquire detection feedback information corresponding to the detected target at the position of the sighting target corresponding to each focus cursor;

step S304, checking the detection feedback information with E-direction information of the position of the current focus cursor; if the vision value is correct, recording the current vision value, and continuously detecting the next optotype;

step S305, if the error occurs, the voice prompt is carried out, and a second response is carried out at a third preset time; if the vision value is wrong, the current vision value is recorded.

When the detected object state accords with the detection environment, the intelligent television A calls a prestored electronic vision contrast table and controls the electronic vision contrast table to be displayed on a screen of the intelligent television A, and according to a preset vision detection requirement, a focus cursor is controlled to automatically move to a position of a vision target to be detected of the electronic vision contrast table, wherein the vision target is a letter E on the vision table, the focus cursor can be a circle, a hook and other graphics and is used for prompting that the currently detected vision target is the letter E selected by the circle.

Further, when the focus cursor appears on the smart television A each time, waiting for the third preset time, ending the acquisition of the current action of the user at the third preset time, and extracting the detection feedback information of the user A from the current action, wherein the third preset time can be any number within 1-3s, can be set by the user, can also be adaptively adjusted by the smart television A according to the previous reaction speed of the user, achieves the effect that the user can judge just after feedback is made each time, and improves the reaction speed. The detection feedback information can be the gesture of the user A obtained through shooting by the intelligent television A, and the pointed direction of the gesture is distinguished by an AI recognition algorithm. Checking the detection feedback information with the direction of the letter 'E' of the position of the focus cursor, and further detecting the next sighting target when the detection feedback information of the user A is consistent with the direction of the letter 'E' of the sighting target; when the vision value is inconsistent, prompting is carried out through voice, and after the third preset time of the second time is finished, the second detection feedback information of the user A on the same visual target is acquired for the second time, and when the user A continuously answers the error twice, the current vision value is recorded.

In another implementation method, the intelligent television A controls the focus cursor to automatically move to a sighting target with a preset vision detection requirement, the vision detection requirement is similar to detection logic of a doctor checking vision when going to a hospital for physical examination, the focus cursor is firstly displayed in the sighting target with a vision value of about 4.5 for 2-3 times, if the user continuously answers or the accuracy exceeds 50%, the focus cursor is further placed in the sighting target with a better vision value of 4.7-4.8, the accuracy of the user is judged again, for example, when the tested vision value reaches 5.0 and the accuracy of the user reaches about 50%, the vision detection is carried out at 5.1 and 4.9 positions at random, and if the position accuracy of the vision value of 4.9 is obviously increased, the position accuracy of the vision value of 5.1 is obviously reduced, the current vision value of the user is considered to be 5.0. The method can further improve the accuracy of vision value detection, achieve the detection effect identical to that of physical examination, and bring convenience to life of users.

Further, in an application scenario, as shown in fig. 6, the step S500 includes:

step S501, when the vision detection result is a first preset result showing good vision, controlling the intelligent television to exit the vision detection function and continuously watching the television;

Step S502, when the vision detection result is a second preset result indicating poor vision, controlling the intelligent television message prompt box to input a password to finish detection and continue watching television, otherwise, directly entering standby; when the unsuccessful input of the password is detected, the password is started again or is not successfully input, and the screen locking state is continuously controlled.

For example, when the eyesight test result of the user a of the smart television a shows a first preset result with good eyesight, controlling the smart television a to withdraw from the eyesight test function, and continuing to watch the television; when the vision detection result is a second preset result showing poor vision, the user can watch the television again by inputting the password in the message prompt box, otherwise, the intelligent television A is controlled to directly enter a standby mode, and when the password is detected to be unsuccessfully input and the password is not successfully input again, the intelligent television A is controlled to enter a screen locking state. The good and bad of the vision detection result will be compared with the vision value of the user at normal time, for example, the vision value of the user A when the user A does not watch the electronic product for a long time is 5.0, the 5.0 is recorded as the normal vision value of the user A, and when the vision detection of the intelligent television A detects that the vision value of the user A is 4.9, the vision of the user A is judged to be poor, and the user A needs to rest. Since the vision of a person is not greatly reduced by watching the electronic product for a long time, the person needs to be alerted when the vision value of 0.1 is reduced. The method can distinguish whether the eyesight of the user is temporarily deteriorated due to visual fatigue and the like, and when the eyesight of the user is detected to be temporarily deteriorated, the user is prevented from continuing to damage eyes by controlling the intelligent television A to enter a standby mode or a screen locking state.

As shown in fig. 7, in the embodiment of the present invention, the distance (VTD, vision Test Distance) between the user's eyeball and the smart tv and the height (VTH, vision Test Height) of the user's eyeball may be obtained more precisely by positioning the remote controller with feather wings, which specifically includes:

when the fact that the user rotates the pinna of the remote controller to a preset position is detected, the fact that the pinna shields one eye of the current user is detected;

controlling and obtaining the relative distance and the height between the wing of the remote controller and the center position of the intelligent television;

prompting a user to move the wing and eye positions of the remote controller to a first relative position opposite to the position of the intelligent television through a screen;

when the detected target moves to the first relative position, judging that the current detected target state accords with a detection environment;

the first relative position comprises a remote control pinna and a first relative distance between eyes and the intelligent television, and the remote control pinna and a first relative height between eyes and a central point of the intelligent television.

For example, after the user a views the television for 3 hours, the smart television a detects that the viewing time of the user a exceeds 3 hours of the second predetermined time, then the vision detection function is turned on, meanwhile, the user a turns on the wing of the remote controller and shields the wing of the remote controller at the left eye position as shown in fig. 4, at this time, the smart television a detects that the wing of the remote controller is turned on and recognizes that the wing of the remote controller is placed on one eye of the user a through the camera, then further obtains the relative position of the wing of the remote controller and the center of the smart television, and when the wing of the remote controller carried by the user does not reach the first relative position, the user is reminded to move to the first relative position through the screen or the speaker, for example, 3 meters opposite to the television screen, and the height of the eye of the wing of the remote controller is not higher than or lower than the upper edge or lower edge of the smart television a. And when the user is detected to reach the first relative position, judging that the current detected target state accords with the detection environment.

The detection of the VTH and the VTD can be maintained in real time in the vision detection process of the user, and the user is prompted through a display screen or sound when the VTH and the VTD deviate, so that the deviation of the vision detection result is avoided. By measuring the position of the user eyeball through the feather position of the remote controller, the accurate positioning of the eyeball position can be greatly improved, the workload and performance requirements of the intelligent television camera are reduced, and the commodity feeding cost of the intelligent television camera is greatly reduced.

In the embodiment of the present invention, the above method for detecting and processing eyesight based on smart tv is further specifically described based on an application scenario, and fig. 8 is a schematic flowchart of a specific process for detecting and processing eyesight of smart tv according to the embodiment of the present invention, as shown in fig. 8, where the steps include:

step S10, starting and proceeding to step S11;

step S11, detecting that the television is being watched, and entering step S12;

step S12, detecting whether the duration of continuously watching the television reaches a preset time, if so, entering a step S13, and if not, entering a step S11;

step S13, judging the current state of the tested user by combining a camera of the intelligent television and an AI recognition algorithm, and entering step S14;

step S14, judging whether the state of the tested user accords with the detection environment, if so, entering step S15, and if not, entering step S13;

Step S15, when judging that the state of the tested user accords with the detection environment, the intelligent television starts a vision detection function to detect the vision of the tested object, and the steps S16 and S17 are carried out;

step S16, outputting a detection result in the screen of the intelligent television according to the detection result of the vision detection function;

step S17, judging whether the vision of the current tested user is good or not according to the vision detection result, if so, entering step S11, and if not, entering step S18;

step S18, when the eyesight of the tested user is not good, the intelligent television switches a standby mode or a free listening mode, and the step S20 is entered;

step S20, end.

From the above, when it is detected that the user starts watching television, starting timely, judging whether the time length of watching television by the user reaches a preset time, when the time length of watching television by the user through the smart television exceeds the preset time, for example, 2 hours, the smart television acquires face information of the current user through a camera, and starts an AI algorithm to identify whether the user state of the current user can perform vision detection, wherein the user state comprises a distance from the user to a screen of the smart television, whether the user is in a state that one eye is covered and the other eye is open, if yes, judging that the user accords with a detection environment, and if not, returning to continuously identify the user state through the AI algorithm. When the current state of the user accords with the detection environment through an AI algorithm, the intelligent television starts a vision detection function, a vision detection result is displayed in a display screen of the intelligent television after vision detection, meanwhile, the intelligent television judges whether the vision is good, when the vision is good, a television picture is restored, when the vision of the user is bad, the user is controlled to enter a standby mode or a free listening mode, and the free listening mode only keeps audio output for picture display of the closed television.

According to the method, when the glasses are tired due to long-time television watching, the user is prompted to have poor eyesight by means of eyesight detection, the user needs to rest, and a free listening mode is provided to enable the user to listen to only sound and not watch pictures, so that the user can feel happy of television programs, and eyes are protected, and user experience is improved.

Exemplary apparatus

As shown in fig. 9, corresponding to the above-mentioned vision testing processing method based on the smart tv, the embodiment of the present invention further provides a vision testing processing device based on the smart tv, where the above-mentioned vision testing processing device based on the smart tv includes:

the environment detection module 910 is configured to detect a detected target state, and confirm whether the detected target state meets a detection environment;

wherein, the detected target comprises a user using the smart television, and the confirming whether the detected target state accords with the detection environment comprises confirming the current state of the user, for example, whether the distance between the current user and the smart television accords with the detection distance; whether the current user environment brightness accords with the detection brightness or not; whether one eye of the current user is covered, etc. The confirmation mode includes collecting the behavior and distance information of the user and the environment brightness information of the user through a sensor such as a camera sensor, an infrared sensor, a brightness sensor and the like arranged on the television, and confirming whether the detected target state accords with the detection environment or not through analyzing the behavior of the user, the distance between the user and the intelligent television and the size of the environment brightness value.

The acquiring module 920 is configured to acquire a preset electronic logarithmic visual chart when the detected target state accords with the detection environment;

when the behavior, the distance, the environmental brightness and the like of the detected target are detected to be in accordance with the detection environment, the electronic logarithmic visual chart preset in the intelligent television is controlled to be acquired, and the electronic logarithmic visual chart is displayed in a screen. The electronic vision testing table is also named as an electronic vision tester, and consists of letters E with different opening directions and different character sizes in each row, when a user is separated from the electronic vision testing table by a certain distance, the numerical value corresponding to the smallest character in the opening direction can be distinguished by a single eye, namely the vision value of the user, wherein the normal vision value of the human eye is 5.0. Further, in order to obtain the vision value of the user more accurately, the electronic vision pair table can be finely adjusted according to the obtained distance between the user and the intelligent television.

The vision detection module 930 is configured to obtain detection feedback information corresponding to the detected target based on the focus detection prompt of the electronic logarithmic visual chart;

the intelligent television controls the letter E in the electronic vision contrast table to be marked randomly, and obtains the behavior of a user through the camera sensor arranged on the intelligent television, namely obtains the detection feedback information corresponding to the detected target. The detection feedback information comprises the direction indicated by the current action of the user or the direction information in the user language is obtained through the AI algorithm and a microphone, for example, the intelligent television sends the user action image obtained through a camera sensor to the AI algorithm, and the AI algorithm judges that the current detection feedback information of the user is left when recognizing that the direction of the finger or the arm is left. When the acquired detection feedback information is consistent with the opening direction of the letter E, the vision value of the user is considered to reach the current test value, then the focus detection prompt is further controlled to fall on the letter E with higher vision value, and finally the current vision value of the user is determined according to the detection feedback information obtained by multiple detection.

A result output module 940 for outputting a vision test result based on the test data of the test feedback information;

the smart television outputs a vision detection result obtained by multiple detection to a screen of the smart television based on detection data of the detection feedback information, for example, when detecting that the vision value of a user is 5.0, the smart television outputs "pleased you, the vision value is 5.0, and eyes of the user are very healthy", or when detecting that the vision value of the user is 4.5, the smart television outputs "the vision value of the user is 4.5, and the user needs to rest and then watch the television".

And the operation response module 950 is used for controlling the intelligent television to perform corresponding operation response according to the vision detection result.

The intelligent television controls the intelligent television to perform different operations according to the output vision detection result, for example, the intelligent television is turned off or locked when the vision is poor, or the intelligent television continues to play videos after resting for one minute when the vision is good, and when the intelligent television detects that the vision of the user is normal, the intelligent television is not limited to watch the television, the intelligent television is controlled to continue playing the television or the user continues to play the television after resting slightly; when the intelligent television detects that the vision of the user is tired due to long-time watching of the television, and the vision is reduced, the intelligent television is controlled to be closed and locked, so that the user cannot continue watching television programs. In order to make the function more humanized, the user can understand the meaning of protecting eyes, and can play stories, short messages or pictures and the like related to eyes and vision before closing a screen, so that the user realizes the importance of eye health, the resolution of protecting eyes of the user is effectively improved, and the use experience of a television is improved.

From the above, the vision detection processing device based on the smart television provided by the embodiment of the invention detects the detected target state through the environment detection module 910, and confirms whether the detected target state accords with the detection environment; acquiring a preset electronic logarithmic visual chart when the state of a detected target accords with a detection environment through an acquisition module 920; acquiring detection feedback information corresponding to a detected target based on a focus detection prompt of the electronic logarithmic visual chart through the visual detection module 930; outputting a vision test result based on the test data of the test feedback information through a result output module 940; and controlling the intelligent television to perform corresponding operation response according to the vision detection result through the operation response module 950. Compared with the scheme in the prior art that the automatic shutdown is realized only by limiting the watching duration of the user and when the user exceeds the preset watching duration. The method and the device have the advantages that when the current watching time of the intelligent television is detected to reach a certain preset time or the watching time of the intelligent television of the user is detected to reach a fixed time, the vision detection function is started, when the vision of the user is detected to be not reduced, the vision detection result is returned, the television is continuously played, when the vision of the user is detected to be reduced, the vision detection result of the user is controlled to be returned, the intelligent television is controlled to perform corresponding operation response, such as closing the television, and the purpose of warning the user to protect eyes can be achieved when the watching time of the user is limited. Therefore, the invention adds new functions to the intelligent television: the vision detecting device has a vision detecting function, and can periodically detect the basic vision condition of a user. And providing early warning and decision making according to the detected data condition, and timely controlling the duration of using the intelligent television by the user. The final purpose is to help the user to improve eye protection consciousness and avoid the long-time use of the television by the children at home.

In particular, in the embodiment, the smart tv commonly used by the user is taken as an example of the display terminal, but the display terminal may also be other display devices, which are not limited herein, and when the display terminal is other devices, reference may be made to a specific scheme in the embodiment.

Specifically, in this embodiment, specific functions of each module of the above-mentioned vision detection processing device based on the smart tv may refer to corresponding descriptions in the above-mentioned vision detection processing method based on the smart tv, which are not described herein again.

Based on the above embodiment, the present invention further provides an intelligent terminal, and a functional block diagram thereof may be shown in fig. 10. The intelligent terminal comprises a processor, a memory, a network interface and a display screen which are connected through a system bus. The processor of the intelligent terminal is used for providing computing and control capabilities. The memory of the intelligent terminal comprises a nonvolatile storage medium and an internal memory. The nonvolatile storage medium stores an operating system and a vision detection processing program based on a smart television. The internal memory provides an environment for the operation of an operating system and a vision inspection processing program based on the intelligent television in a nonvolatile storage medium. The network interface of the intelligent terminal is used for communicating with an external terminal through network connection. The vision detection processing program based on the intelligent television realizes the steps of any vision detection processing method based on the intelligent television when being executed by a processor. The display screen of the intelligent terminal can be a liquid crystal display screen or an electronic ink display screen.

It will be appreciated by those skilled in the art that the schematic block diagram shown in fig. 10 is merely a block diagram of a portion of the structure associated with the present inventive arrangements and is not limiting of the smart terminal to which the present inventive arrangements are applied, and that a particular smart terminal may include more or fewer components than shown, or may combine some of the components, or have a different arrangement of components.

In one embodiment, a smart terminal is provided, where the smart terminal includes a memory, a processor, and a smart tv-based vision inspection processing program stored on the memory and executable on the processor, where the smart tv-based vision inspection processing program, when executed by the processor, performs the following operation instructions:

The embodiment of the invention also provides a computer readable storage medium, wherein the computer readable storage medium is stored with a vision detection processing program based on the intelligent television, and the vision detection processing program based on the intelligent television realizes any one of the steps of the vision detection processing method based on the intelligent television when being executed by a processor.

It should be understood that the sequence number of each step in the above embodiment does not mean the sequence of execution, and the execution sequence of each process should be determined by its function and internal logic, and should not be construed as limiting the implementation process of the embodiment of the present invention.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, the specific names of the functional units and modules are only for distinguishing from each other, and are not used for limiting the protection scope of the present invention. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.

In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.

Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other manners. For example, the apparatus/terminal device embodiments described above are merely illustrative, e.g., the division of the modules or units described above is merely a logical function division, and may be implemented in other manners, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed.

The integrated modules/units described above, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer-readable storage medium. Based on such understanding, the present invention may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the steps of each method embodiment may be implemented. The computer program comprises computer program code, and the computer program code can be in a source code form, an object code form, an executable file or some intermediate form and the like. The computer readable medium may include: any entity or device capable of carrying the computer program code described above, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth. The content of the computer readable storage medium can be appropriately increased or decreased according to the requirements of the legislation and the patent practice in the jurisdiction.

The above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art will understand that; the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions are not intended to depart from the spirit and scope of the various embodiments of the invention, which are also within the spirit and scope of the invention.

Claims

1. The vision detection processing method based on the intelligent television is characterized by comprising the following steps of:

the step of detecting the detected target state and confirming whether the detected target state accords with the detection environment comprises the following steps: acquiring a face image of a detected target, and acquiring information of a current user through face recognition; identifying the distance between the current user and the intelligent television, and judging whether the distance accords with the vision detection distance set by the detection environment; when the distance accords with the vision detection distance set by the detection environment, and one eye of the current user is detected to be in an open state, and the other eye is detected to be in a shielding state, the current detected target state is judged to accord with the detection environment;

The step of detecting the detected target state and confirming whether the detected target state accords with the detection environment further comprises the following steps: acquiring a face image of a detected target, and acquiring information of a current user through face recognition; identifying the distance between the current user and the intelligent television, and judging whether the distance accords with the vision detection distance set by the detection environment; detecting whether a remote controller with preset pinna shields one eye of a current user or not, and detecting whether the pinna of the remote controller rotates to a preset position or not; when the distance accords with the vision detection distance set by the detection environment, detecting that the wing of the remote controller rotates to a preset position to shield one eye of the current user, and judging that the current detected target state accords with the detection environment when detecting that the other eye of the current user is in an open state;

2. The method for detecting vision inspection processing based on intelligent television according to claim 1, wherein the step of detecting the detected object state and confirming whether the detected object state meets the detection environment comprises:

3. The method for detecting vision inspection processing based on intelligent television according to claim 2, wherein the step of detecting the detected object state and confirming whether the detected object state meets the detection environment further comprises:

4. The method for detecting and processing vision based on intelligent television according to claim 1, wherein the step of obtaining the detection feedback information corresponding to the detected object based on the focus detection prompt of the electronic logarithmic visual chart comprises:

5. The method for processing vision testing based on intelligent television according to claim 1, wherein the step of controlling the intelligent television to perform corresponding operation response according to the vision testing result comprises:

6. An intelligent television-based vision testing processing device, which is characterized by comprising:

7. An intelligent terminal, characterized in that the intelligent terminal comprises a memory, a processor and an intelligent television-based vision detection processing program stored on the memory and capable of running on the processor, wherein the intelligent television-based vision detection processing program, when executed by the processor, implements the steps of the intelligent television-based vision detection processing method according to any one of claims 1-5.

8. A computer readable storage medium, wherein a vision testing processing program based on a smart tv is stored on the computer readable storage medium, and when the vision testing processing program based on the smart tv is executed by a processor, the steps of the vision testing processing method based on the smart tv according to any one of claims 1-5 are implemented.