TW201721355A - The monitor automatically identify the user status and automatically switches the screen method and structure - Google Patents

Abstract

The monitor automatically identify the user status and automatically switches the screen method and structure, and its structure contains the image capture device, image processing device, and the control processing means, the steps S1 to start the face detection service program; S2 by the image capture device acquires user location and display the current relationship, and generating an image; S3 View from the number of faces in the image and users with the monitor; S4 according to the number of faces and viewing distance of the user and display results, selectively turn off the display screen or open the screen. Whereby the display will be based on whether the user or users from the distance of the screen, to open or close, to achieve the goal of saving resources and protecting the user's vision of the automatic selection of the screen.

Description

Method and structure for automatically recognizing user usage status and automatically switching screen

The present invention relates to a method for automatically switching a screen of a display and a structure thereof, and more particularly to a display for automatically recognizing a user's use state to achieve an automatic screen switch.

A general display (television), with its screen turned on or off, needs to be done through a UI (User Interface, UI for short). Specifically, when the user leaves the display (television), it needs to be turned off autonomously. If the user does not check for a moment, leaving the monitor (television) to deal with other things without closing, there will be a problem of wasting resources, and the life of the display (television) will also be lost.

On the other hand, the current display (television) is in a passive object and will only respond to the user's operation. If the user is too close to the screen of the monitor (TV), there will be no corresponding processing at all. When the display (television) is too close, the light source is too strong and there is a problem that causes visual impairment. Therefore, the user needs to have the self-control ability to maintain a certain distance to use the display (television).

In summary, it can be known that the current display (television) is in a passive operation mode, and cannot be overcome for the problem that no user and the user is too close to the screen.

The object of the present invention is to provide a method for automatically recognizing a user's use state and automatically switching a screen, and a method for judging a current user's use state through hardware and software matching, to automatically turn on or off the screen, thereby achieving saving. Resources and the purpose of protecting the user's vision.

In order to achieve the above object, the present invention provides a method for automatically recognizing a user's use state and automatically switching a screen, and a structure thereof, the method comprising:

S1. Starting a face detection service program;

S2. obtaining, by the image capturing device, a current positional relationship between the user and the display, and generating an image;

S3. View the number of faces in the image and the distance between the user and the display;

S4. Selectively turn off the screen or turn on the screen according to the number of faces and the distance between the user and the display.

In an embodiment of the invention, step S2 comprises:

S21 checks whether the image capturing device exists;

S22 if the image capturing device does not exist, display a warning message, and stop the face detection service program;

S23, if an image capturing device exists, generates an image through the capturing device.

In an embodiment of the invention, step S3 comprises:

S31 performs a first inspection on the image to determine whether the number of faces is zero or the user is too close to the display;

The S32 generates an image again through the image capturing device;

S33 performs a second check on the image generated in step S32 to determine whether the number of faces is zero or the user is too close to the display.

In an embodiment of the invention, step S4 comprises:

S41 turns off the screen for a few seconds;

S42 checks if the screen is closed;

S43 turns on the screen.

The structure of the present invention comprises:

An image capturing device for generating an image;

An image processing device coupled to the image capture device and viewing the image; and

A central control processing device is coupled to the image processing device to selectively turn off or turn on the screen of the display according to the image inspection result.

In an embodiment of the invention, the display further includes a timing unit coupled to the image capturing device and the central processing device for timing the duration of each action.

According to the above technical means, the image processing apparatus comprises:

a face recognition unit for recognizing a face block in the image; and

A distance recognition unit for identifying the total proportion of the images occupied by the user in the image.

In this way, through the above method and structural actuation, the passive characteristics of the current display can be overcome, and the problems caused by no user and the user being too close to the screen can be overcome, and the user can be automatically recognized and the corresponding screen switch can be further determined.

The above and other objects, features and advantages of the present invention will become more <RTIgt;

1‧‧‧Image capture device

2‧‧‧Image processing device

21‧‧‧Face recognition unit

22‧‧‧Distance identification unit

3‧‧‧Central control device

4‧‧‧Time unit

S1‧‧‧Starting face detection service program

S2‧‧‧ The image capturing device obtains the current positional relationship between the user and the display, and generates an image

S21‧‧‧Check if the image capture device exists

S22‧‧‧If the image capture device does not exist, display a warning message and stop the face detection service program

S23‧‧‧If an image capture device is present, an image is generated by the capture device

S3‧‧‧View the number of faces in the image and the distance between the user and the display

S31‧‧‧Check the image for the first time to determine if the number of faces is zero or the user is too close to the display

S32‧‧‧ Reproduces images through the image capture device

S33‧‧‧ Perform a second check on the image generated in step S32 to determine whether the number of faces is zero or the user is too close to the display

S4‧‧‧ Selectively turn off the display or turn on the screen according to the number of faces and the distance between the user and the monitor

S41‧‧‧Close the screen for a few seconds

S42‧‧‧Check if the screen is closed

S43‧‧‧Open screen

1 is a block diagram of a hardware architecture of the present invention;

2 is a schematic flow chart of the method of the present invention; and

FIG. 3 is a schematic flow chart of a practical application of the method of the present invention.

In the following embodiments, the same or similar component symbols represent the same or similar components. In addition, the directional terms mentioned in the following embodiments, for example, up, down, left, right, front or back, etc., refer only to the direction of the additional drawing, and therefore, the directional term used is used for explanation, and It is not intended to limit the invention.

Please refer to FIG. 1. FIG. 1 is a block diagram of a hardware architecture of the present invention. As can be seen from the figure, the display of the present invention is substantially like a general display, and the difference lies in the image capturing device 1 and the image processing device 2. The central control processing device 3 and the timing unit 4, the image capturing device 1 can be understood as a photographic lens, which can be embedded or integrated on the display, or can be externally combined on the display, and the image capturing device 1 The camera is photographed outside the display for a certain period of time to obtain the current external state; and the image after the photographing is processed by the image processing device 2, and the face recognition unit 21 is used to determine whether there is a face in the image. Appears as a determination as to whether there is currently a user, and the distance recognition unit 22 determines the total proportion of the image occupied by the user's face in the image. When it is greater than a certain ratio, it can be interpreted as the user is too close to the screen; The control processing device 3 performs a corresponding response according to the result of the image judgment, such as reading no user (no face appears) will turn off the screen, or a human face but If the total ratio is too high, the screen will be temporarily turned off.

Please refer to FIG. 2. FIG. 2 is a schematic flowchart of the method of the present invention. It can be understood from the figure how to achieve a method for automatically recognizing the state of use of the user and automatically switching the screen. The main steps include the following four steps:

S1. Start the face detection service program.

For the first step of this method, the software is started to prepare for face inspection and judgment.

S2. The image capturing device obtains the current positional relationship between the user and the display, and generates an image.

In the second step of the method, through the hardware device (image capturing device), the image in front of the current display is captured and an image (image) is generated.

S3. View the number of faces in the image and the distance between the user and the display.

In the third step of the method, the generated image is viewed through a hardware device (image processing device), and the number of faces (face recognition unit) and the total proportion of the face in the image are determined ( Distance identification unit).

S4. Selectively turn off the screen or turn on the screen according to the number of faces and the distance between the user and the display.

For the fourth step of the method, through the above steps, according to the number of faces (determining whether there is a user) and the total proportion of the face (determining the distance of the user from the display), a review result is generated, Determine whether there are currently users (such as no-faces identified as no users) and whether the user is too close to the screen (the face is too large, it will be considered too close), and further through the inspection results to make the screen Temporarily close or reply to work.

Please refer to FIG. 3. FIG. 3 is a schematic flowchart of the actual application of the method of the present invention. A series of process judgments can be seen in the figure, and the process flow is as follows:

S1. Start the face detection service program.

The face detection service program is started, and the detection is initiated periodically (for example, several seconds), and after completion, the process proceeds to S21.

S21 checks if the image capturing device exists.

For the first judgment of the process judgment, check whether the hardware device exists, specifically for the display itself without the image capturing device (camera), such as the camera itself built in the display itself can omit this step; judgment result If yes, go to S23, otherwise enter S22.

If the image capturing device does not exist, the S22 displays a warning message and stops the face detection service program.

This state occurs when no image capture device is detected, an error or warning message is displayed through the screen, and the face detection service program is stopped, and when it is completed, the process proceeds to S21.

S23, if an image capturing device exists, generates an image through the capturing device.

This state occurs when an image capture device is detected. The system will complete an image taken through the capture device and complete it in the background of the system, and then enter S31 after completion.

S31 performs the first inspection of the image to determine if the number of faces is zero or the user is too close to the display.

For the second judgment of the process judgment, according to the content of the image, it is judged whether the face number is zero (determined as no user) or the user is too close to the display (the image is a human face but the proportion is too large); If yes, go to S32, otherwise enter S42.

The S32 generates an image again through the image capturing device.

When S31 is completed, only one judgment is performed. In order to improve the reliability of the judgment, an inspection is performed again. At this time, the image is captured by the image capturing device, and after completion, the process proceeds to S33.

S33 performs a second check on the image generated in step S32 to determine whether the number of faces is zero or the user is too close to the display.

For the third judgment of the process judgment, according to the content of the image, it is judged whether the face number is zero (determined as no user) or the user is too close to the display (the image has a human face but the proportion is too large); If yes, go to S41, otherwise enter S42.

S41 turns off the screen for a few seconds.

This state occurs when the number of faces is zero (no user) or the user is too close to the display. The former is to save energy, so the screen will be closed, the latter is to protect the user's vision, and the screen will be closed. After completion, the process proceeds to step S1.

S42 checks if the screen is closed.

For the fourth judgment of the process judgment, the next action is performed according to the current state of the screen; if the judgment result is yes, the process proceeds to S43, and if otherwise, the process proceeds to S1.

S43 turns on the screen.

If the screen is temporarily dormant due to the above judgment or the screen is temporarily dormant, the normal operation is resumed, and after completion, the process proceeds to step S1.

Although the present invention has been disclosed in the above preferred embodiments, it is not intended to limit the present invention, and those skilled in the art can make some modifications and refinements without departing from the spirit and scope of the present invention. The scope of protection is subject to the definition of the scope of the attached patent application.

S1‧‧‧Starting face detection service program

S2‧‧‧ The image capturing device obtains the current positional relationship between the user and the display, and generates an image

S3‧‧‧View the number of faces in the image and the distance between the user and the display

S4‧‧‧ Selectively turn off the display or turn on the screen according to the number of faces and the distance between the user and the monitor

Claims (7)

A method for automatically recognizing a user's usage status and automatically switching a screen, the steps of which include:
S1. Starting a face detection service program;
S2. obtaining, by the image capturing device, a current positional relationship between the user and the display, and generating an image;
S3. View the number of faces in the image and the distance between the user and the display;
S4. Selectively turn off the screen or turn on the screen according to the number of faces and the distance between the user and the display. The method of claim 1, wherein the display automatically recognizes the state of use of the user and automatically switches the screen, wherein step S2 includes:
S21 checks whether the image capturing device exists;
S22 if the image capturing device does not exist, display a warning message, and stop the face detection service program;
S23, if an image capturing device exists, generates an image through the capturing device. The method as claimed in claim 1, wherein the display automatically recognizes the state of use of the user and automatically switches the screen, wherein step S3 comprises:
S31 performs a first inspection on the image to determine whether the number of faces is zero or the user is too close to the display;
The S32 generates an image again through the image capturing device;
S33 performs a second check on the image generated in step S32 to determine whether the number of faces is zero or the user is too close to the display. The method of automatically recognizing a state of use of a user and automatically switching a screen, as described in claim 1, wherein the step S4 includes:
S41 turns off the screen for a few seconds;
S42 checks if the screen is closed;
S43 turns on the screen. A structure in which a display automatically recognizes a user's usage status and automatically switches a screen, which includes:
An image capturing device for generating an image;
An image processing device is coupled to the image capturing device and views the image; and a central processing device is coupled to the image processing device to selectively close or turn the display screen according to the image viewing result. The display device of claim 5, wherein the display automatically recognizes the state of use of the user and automatically switches the screen. The display further includes a timing unit coupled to the image capturing device and the central processing device for timing each action. The duration of the next. The display device of claim 5, wherein the display automatically recognizes the state of use of the user and automatically switches the screen, wherein the image processing device comprises:
a face recognition unit for recognizing a face block in the image; and a distance recognition unit for recognizing the total proportion of the image occupied by the user's face in the image.