KR101580918B1 - Method for controlling a displayed screen of application program for the protection of the user of application execution device with a display unit - Google Patents

Abstract

The present invention provides a method for controlling an output screen of an application program by identifying a proximity state if a user uses a terminal while being too close to the output screen of the application program run in the terminal to protect an eye vision of the user of an application running terminal using a display unit such as a smartphone. When a user uses a certain application for DMB, a movie, a video, a game, a cartoon or the like through the display unit of the terminal, if a state that a gaze of the user is fixed on a display screen of the terminal at a short distance and the user gazes at the display screen of the terminal for a long time is maintained for a certain time, a warning message is displayed or execution of the application is stopped. Therefore, risk of deterioration of an eye vision can be reduced. In order to appropriately perform a warning function and an execution stop function, a process for calculating a separation distance between the display unit and a face of the user can be implemented more conveniently by using a basic hardware device provided to the terminal, without additionally installing a complicated hardware device. Accordingly, the method of the present invention has enhanced applicability to most terminals and can increase efficiency of a device.

Description

FIELD OF THE INVENTION [0001] The present invention relates to a method of controlling an output screen of an application program,

In order to protect the eyesight of a user who uses an application using a display unit such as a smart phone, when the user approaches the output screen of the application program executed in the terminal and uses the proximity of the user, To a method for controlling a screen.

Various terminals capable of performing specific applications such as DMB, movies, movies, games, cartoons and Internet access using a display unit such as a smart phone, which is widely popularized as a mobile communication terminal, have been developed, In the case of a smartphone that is supplied to a terminal, not only performance as a communication device but also a running application can be used to view DMB, movies, movies, games, and manga, as well as an Internet connection. It is becoming a necessity.

However, in general, when a specific application such as a DMB, a movie, a moving picture, a game, and a cartoon is used through a display unit of such a terminal, the user's gaze is fixed to the display screen of the terminal in a short distance, If the user continuously observes the display screen of the terminal for a long time repeatedly and repeatedly, the risk of damaging the user's eyesight is greatly increased. In particular, recently, a display- The problem of visual impairment in children or adolescents with weak self - control due to the gradual difficulty of age is becoming a social problem.

Conventionally, in the case of a terminal operating continuously for a predetermined time or longer, a control means for automatically shutting down the operation of the terminal has been adopted. However, this is mainly intended to prevent a power discharge state caused by a malfunction of the terminal, There was a lack of means.

In the conventional technologies disclosed in Korean Patent Laid-Open No. 10-2009-0111131 (Oct. 26, 2009), which is proposed as an improvement measure for the above, users are provided with an infrared sensor (an infrared light emitting element and an infrared light receiving element) A technique of discriminating a distance between a face and a display screen and executing a screen saver on the screen, displaying a control message corresponding to a warning character, or stopping execution of an application is proposed.

However, in the case of the improvement according to the related art, it is possible to install a separate infrared sensor or only to a terminal equipped with an infrared sensor, and a display unit including a mobile communication terminal such as a smart phone It is a very economical burden to provide an infrared sensor including a non-useable infrared ray emitting element and an infrared ray receiving element as basic hardware devices in a variety of terminals.

Accordingly, the present invention can be applied to various types of terminals including display units, which are commonly used in mobile communication terminals such as smart phones, by additionally using only camera elements provided as basic hardware devices in addition to display units, And a technique for displaying a warning text message on the screen when the determined distance distance does not reach the set distance, and further stopping the execution of the application.

Disclosure of Invention Technical Problem [8] The present invention has been made to solve the problems of the prior art and to solve the technical problems to be solved by the present invention,

1. A method of controlling an output screen of an application program for protecting eyesight of a terminal user,

(I) detecting a first point of time when a set screen is displayed through a display unit that displays a screen provided by the application when the set application is executed;

(II) detecting a second point of time when the image of the user's face received through the camera unit is reflected by the bright screen of the setting reference or more than the set reference and having the screen brightness of the set brightness or more;

(III) measuring a time interval between the first time point and the second time point;

(IV) calculating a separation distance between the display unit and the position at which the user's facial reflection occurs using the measured time interval and the speed of light (light flux) between the first point and the second point of time; And

(V) outputting a warning message when the spacing distance is less than a predetermined reference distance.

In this case, the bright screen over the setting reference output through the display unit in the step (I) may be a screen selected from the screens provided by the application, but a white screen generated by the control system of the terminal may be used .

Meanwhile, the step (V1) further proceeds after the step (V), wherein the distance calculated through the steps (I) to (IV) which is performed after the output of the warning message is less than a predetermined reference distance Further comprising the step of terminating the execution application when the state is maintained for more than the set duration time, and further comprising the step of terminating the execution application in order to pre-set the reference distance required for performing the step (V) A test mode is preferably performed.

According to the present invention, when a specific application such as a DMB, a movie, a movie, a game and a cartoon is used through the display unit of the terminal, the user's line of sight is fixed to the display screen of the terminal at a short distance, The user can stop the warning or the execution of the application when the state of gazing continues for a certain period of time or longer, thereby reducing the risk of visual deterioration, and in addition, And the face distance between the user's face can be more easily performed using a basic hardware device provided to the terminal without installing a complicated additional hardware device, It provides an effect to increase the device efficiency.

1 is a flowchart illustrating an operation process of a preferred embodiment of an output screen control method of an application program according to the present invention.
2 is an operational state diagram illustrating an example of the operating state of the method inventions according to the present invention.
3 is a configuration diagram of a control system for performing an output screen control method of an application program according to the present invention.
4 is a flowchart illustrating an operation process of a preferred embodiment of a test mode in an output screen control method of an application program according to the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a preferred embodiment of the present invention, which is provided for controlling an output screen of an application program in order to protect the eyesight of a user who executes an application using a display unit, will be described with reference to the accompanying drawings. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

1 showing an operation process of performing an output screen control method of an application program according to a preferred embodiment of the present invention as a flowchart, FIG. 2 showing an example of an operating state, and an output screen control method A method of controlling an output screen of an application program according to an exemplary embodiment of the present invention will be described with reference to FIG.

The invention is applicable to various terminals capable of performing specific applications such as DMB, movie, video, game, cartoon, and Internet access using a display unit such as a smart phone, As shown in Figs. 1 and 2,

Executing an application using the display unit 120 An output screen control method of an application program for protecting the sight of a user of the terminal 100,

(I) detecting a first point of time when a set screen is displayed through a display unit 120 that displays a screen provided by the application when the set application is executed;

(II) The image of the user's face, which is received through the camera unit 130 (preferably a front camera installed so as to face the same direction as the display unit), is reflected by the bright screen above the setting reference, Detecting a second time point at which an image having brightness is sensed (S200);

(III) measuring a time interval between the first time point and the second time point (S300);

(IV) calculating a separation distance between the display unit 120 and the position at which the user's facial reflection occurs using the measured time interval between the first time point and the second time point and the speed of light (flux) S400); And

(V) outputting a warning message (S500) when the spacing distance is less than a predetermined reference distance (S500).

Here, in step (I) (S100), the bright screen over the setting reference output through the display unit 120 may be a screen selected from the screens provided in the application, The white screen generated by the control system 110a of the terminal 100, preferably the white screen generator 116, which is additionally provided to the normal controller 110, may be used.

Here, the warning message may be provided in the form of a text message output through the display unit 120 of the terminal 100, or may be provided in the form of a voice message or a warning sound output to the speaker 140 .

Meanwhile, step (V1) further proceeds after step (V) (S500), and is calculated through step (S100) to step (S400) performed after step (I) It is preferable to further include a step (S600) of terminating the execution application when the state in which the separation distance is less than the preset reference distance is maintained for more than the set time duration.

Although it is possible to simply set an arbitrary distance (for example, 25 cm) to compare the separation distance and the reference distance in the step (V), it is also possible to set a test mode for presetting the reference distance before the step (I) Is performed separately as shown in FIG. 4. In this test mode,

(I) detecting a first point of time when a set screen is displayed through a display unit 120 that displays a screen provided by the application when the set application is executed;

(S200) of detecting a second point of time when an image having a screen brightness of more than a set brightness is reflected by a bright screen which is not less than the set reference among the user's facial reflection images received through the camera unit (130) ;

(III) measuring a time interval between the first time point and the second time point (S300);

(IV) calculating a separation distance between the display unit 120 and the position at which the user's facial reflection occurs using the measured time interval between the first time point and the second time point and the speed of light (flux) S400); And

(IV-a) outputting the spacing distance through the display unit 120 (S410); And

(IV-b) the reference distance is input in advance and stored in the storage unit and set (S420).

In this case, the bright screen which is not less than the setting reference outputted through the display unit 120 in the step (I) (S100) may be a screen selected from the screens provided in the application, The white screen generated by the white screen generator 116, which is preferably added to the normal control unit 110, may be used.

Hereinafter, a process of controlling the output screen of the application program according to the preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

3, the control system 110a according to an exemplary embodiment of the present invention includes a general controller 110, which is preferably implemented in an application processor (AP) module of the terminal 100, A determination unit 113, a warning message generation unit 114, a duration setting unit 115, and a time interval setting unit 115. The time interval measurement unit 111, the separation distance calculation unit 112, the determination unit 113, the warning message generation unit 114, And a white screen generating unit 116. This can be implemented in the form of an APP by a software method.

As shown in FIG. 4, when the application set in the terminal 100 is executed, the display unit 120 displays a screen provided in the application, The control unit 110 detects a first time point at which a bright screen having a brightness level equal to or higher than a preset reference level is output (S100), and reflects the brightness of the user's face, which is received through the camera unit 130, The control unit 110 detects a second time point at which the image having the above screen brightness is detected in step S200, and the time interval between the first time point and the second time point is measured by the time interval measurement unit 111 ), A distance between the first point of time and the second point of time and a speed of light (flux of light) The control unit 110 calculates the distance between the display unit 120 and the position where the user's facial reflection occurs (S400), and outputs the distance to the control unit 110 through the display unit 120 (S410) Receives the input, stores it in the storage unit in the control unit 110, and sets it (S420). Here, the input of the reference distance may be performed by a separate input interface (not shown) provided to the terminal.

When the user executes the application (a specific application such as a DMB, a movie, a video, a game, a comic book, or an internet connection) set in the terminal 100 in the state where the reference distance is set as described above, The control unit 110 detects a first view point at which a bright screen having a brightness higher than a setting reference is output through the unit 120 in step S100, The control unit 110 detects a second point of time at which the image having the screen brightness of the set brightness or more is sensed by the time interval measuring unit 111 (S200), and the time interval between the first point of time and the second point of time is measured by the time interval measuring unit 111 (S300), and the measured time interval between the first point and the second point and the speed of light W distance calculating unit 112 is calculated in the spacing between the display unit 120 and the user's face reflected it occurred position (S400).

Here, if the calculated distance is less than the preset reference distance, the determining unit 113 determines whether the calculated distance is less than the predetermined reference distance. If the calculated distance is less than the predetermined reference distance, the warning message generating unit 114 generates a warning message For example, a warning phrase or slogan such as 'I am sick of the eyes ^^', and outputs it through the display unit 120 or the speaker 140 in the control unit 110.

If the distance to be calculated through the step (S100) to the step (S400) is less than a preset reference distance, which is performed when the application is continuously executed even after the output of the warning message, If it is maintained for more than the set duration (e.g., 30 minutes) set in the duration setting unit 115 of the control system 110a, the process may proceed to terminate the executing application (S600) , That is, issue a secondary warning message.

On the other hand, in step (I) (S100), the bright screen which is not less than the setting reference outputted through the display unit 120 may be one bright screen selected from the screens provided in the application, A white screen image arbitrarily generated by the white screen image generator 116 of the control system 110a of the terminal 100 is used as a white screen image in which the brightness change in the reflection image is at least a short frame sufficient enough to be recognized by the camera unit 130 Use of a white screen with a duration is advantageous in terms of calculating a more accurate distance and preventing the user from feeling rejected. It is possible to determine a second time point at which a reflection image having a screen brightness of a preset brightness or more is sensed according to how much the brightness of a pixel value of a reflection image imaged by the camera unit 130 is changed. A technique for counting the number of pixels having a brightness equal to or greater than a reference value is known to those skilled in the art, so that a detailed description thereof will be omitted.

The terminal to which the embodiment of the present invention is applied may be any type of terminal that can perform specific applications such as DMB, movie, video, game, etc., and may be a WCDMA (Wideband CDMA) phone, Such as a portable multimedia player (PMP), a portable multimedia player (PMP), or a portable multimedia player, as well as a mobile communication terminal including a communication function such as a standard for mobile phone, a mobile broadband system (MBS) phone, a digital multimedia broadcasting (DMB) Such as an MP3 player, a portable game machine, and various PDA (Personal Digital Assistants) devices, which are capable of performing a specific application.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes and modifications may be made without departing from the scope of the present invention.

100: terminal
110:
110a: Control system
111: time interval measuring unit
112: Distance calculator
113:
114: Warning message generating unit
115: Duration setting unit
116: White screen generating unit
120: Display unit
130:
140: Speaker

Claims (7)

Executing an application using the display unit 120 An output screen control method of an application program for protecting the sight of a user of the terminal 100,
(I) detecting a first point of time when a set screen is displayed through a display unit 120 that displays a screen provided by the application when the set application is executed;
(S200) of detecting a second point of time when an image having a screen brightness of more than a set brightness is reflected by a bright screen which is not less than the set reference among the user's facial reflection images received through the camera unit (130) ;
(III) measuring a time interval between the first time point and the second time point (S300);
(IV) calculating a separation distance between the display unit 120 and the position at which the user's facial reflection occurs using the measured time interval between the first time point and the second time point and the speed of light (flux) S400); And
(V) outputting a warning message when the distance is less than a predetermined reference distance (S500). The method according to claim 1,
A method of controlling an output screen of an application program, wherein a screen selected from screens provided in an application is used in a bright screen which is not less than a setting reference output through the display unit (120) in the step (I) (S100). The method according to claim 1,
The white screen generated by the white screen generating unit 116 of the control system 110a of the terminal 100 is used for the bright screen which is not less than the setting reference outputted through the display unit 120 in the step (I) And outputting the output screen. 4. The method according to any one of claims 1 to 3,
Wherein the warning message is provided in the form of a text message output through the display unit (120) of the terminal (100). 4. The method according to any one of claims 1 to 3,
The step (V1) further proceeds after step (V) (S500), wherein the step (S100) to step (S4) performed after step (I) Further comprising the step of terminating the execution application (S600) when the state that the predetermined reference distance is not satisfied is maintained for more than the set duration time. 4. The method according to any one of claims 1 to 3,
Wherein a test mode for previously setting the reference distance before the step (I) is separately performed. The method according to claim 6,
In the test mode,
(I) detecting a first point of time when a set screen is displayed through a display unit 120 that displays a screen provided by the application when the set application is executed;
(S200) of detecting a second point of time when an image having a screen brightness of more than a set brightness is reflected by a bright screen which is not less than the set reference among the user's facial reflection images received through the camera unit (130) ;
(III) measuring a time interval between the first time point and the second time point (S300);
(IV) calculating a separation distance between the display unit 120 and the position at which the user's facial reflection occurs using the measured time interval between the first time point and the second time point and the speed of light (flux) S400); And
(IV-a) outputting the spacing distance through the display unit 120 (S410); And
Wherein the step (S420) of receiving the reference distance (IV-b) in advance and storing the reference distance in the storage unit (S420) is performed.

Images