WO2015178613A1

WO2015178613A1 - Method for displaying intelligent screen through pattern recognition

Info

Publication number: WO2015178613A1
Application number: PCT/KR2015/004731
Authority: WO
Inventors: 이동형
Original assignee: 이동형
Priority date: 2014-05-21
Filing date: 2015-05-12
Publication date: 2015-11-26
Also published as: KR20150134070A; KR101576630B1

Abstract

The present invention relates to a method for displaying an intelligent screen through pattern recognition by a control unit of a terminal having an image sensor and a screen display unit, the method comprising the steps of: recognizing, by the control unit, a user's face through pattern recognition for image information which has been input from the image sensor; recognizing a separation distance of each user by measuring a ratio between the recognized face image of the user and an existing configuration face image of the user; and discovering a screen magnification of the corresponding user in a database and designating the discovered screen magnification, and displaying a reading object on the screen display unit by adjusting a screen size of the reading object according to the designated screen magnification and the recognized separation distance. Thus, by using an intelligent screen auto adjustment function and apparatus of a smart device and various display devices, the present invention can eliminate the inconvenience of adjusting the size of a screen and prevent vision loss.

Description

Intelligent screen display method through pattern recognition

The present invention relates to an intelligent screen display method through pattern recognition of a digital input / output terminal (eg, tablet PC, smartphone).

Have you ever zoomed in because you have fewer fonts displayed on the screen while you work? Or do you have a magnified experience of not surfing the web or viewing e-books on your smartphone? If you're in your late 40's, you may have lost a little print because of the presbyopia that you don't know.

Paper documents can be controlled by adjusting the distance directly. However, even if you adjust it yourself, you can think that it is a lot of trouble. Especially when surfing documents and webs on smartphones and smart devices, you should always set them on each screen. In order to solve this problem, it is necessary to develop a method and a device that can automatically adjust the size of the screen to be individually adjusted to the screen focus by personal recognition through facial recognition.

Existing methods are used after manually adjusting the page or screen by hand to suit the individual. In addition, Patent 2010-292193 is a screen magnification process after distance measurement for a general user instead of a user, and may cause a problem in that the screen may not be displayed with an optimal fit according to the user's situation such as the size of a face. In addition, the conventional page automatic page turning technology of digital content has an inconvenience of using the user's nerves slightly depending on the page turning situation due to the automatic scrolling function and the user's head and the device's tilting function. Patent 10-2007-0060885 describes a method of providing an input interface using various recognition technologies, but this is applicable only to the input part and excludes the flow pattern and the security pattern part using the same, thereby making it a security pattern processing technology through eye flow recognition. I think you can. Lastly, Patent 2005-238184 is a technology that can provide images according to the viewing angle rather than a certain image according to the position where the user sees. There is a problem in providing images. Kiosk system that can be adjusted automatically using the camera of the application No. 10-2013-0037380 is described as a method of adjusting the physical position by the object and face recognition using the camera and various input sensors. Since it shows the shape of physical equipment, it is greatly affected by the increase in size and the surrounding environment.

The present invention has been developed to solve the above problems, since the beginning of presbyopia since the mid-40s, many people have seen a small screen and letters are hard to see. And the company's PCs are mainly using laptops or smart devices. At this time, the social workload is high and the work must be done correctly.

Secondly, most users feel the inconvenience of screen magnification due to the increase in the use of smart phones and smart devices.

Third, we saw the increase of spare time due to the increase in size of equipment and the personalization by mechanical automation of unmanned information desk and kiosk system.

Finally, security patterns are used to solve problems such as recognition errors through party photos in smartphones and facial recognition systems.

This has the drawback of exposing outside when the user uses the pattern.

In order to solve this problem, an object of the present invention is to provide an intelligent screen display method through pattern recognition, which enables the automatic change of the size of the displayed screen and pattern security services by recognizing the image size and the flow of eye movement.

Intelligent screen display method through the pattern recognition according to the present invention for achieving the above object,

After measuring the distance by recognizing the size of the face image through the image sensor (camera), it measures the ratio with the existing face image and intelligently displays the screen size that matches the ratio. In addition, after eye recognition through image processing, the flow of the eye can be identified to identify the page turning or security pattern processing. This can be applied to the field of facial recognition. If we add security pattern service to face recognition and process patterns with eyes, we can compensate for the shortcomings in face recognition field. Finally, the function of displaying the screen according to the situation after checking the user's location, distance, and direction by image size recognition, allows the user to view the screen as the optimal visual environment by multiplexing the screen such as concave or convex.

Specifically, in the screen display method of the control unit of the terminal having an image sensor and the screen display unit, the control step of the user face through the pattern recognition for the image information input from the image sensor, the recognized user face image and Recognizing the separation distance for each user by measuring a ratio with an existing set user face image; finding a screen magnification of the user in a database, specifying a screen magnification, and reading according to the specified screen magnification and the recognized separation distance; and adjusting the screen size of the object to be displayed on the screen display unit.

Preferably, the controller recognizes the pupil flow in the user face image using the pattern recognition, and the controller automatically turns the page after the recognized pupil flow arrives at the bottom of the reading object. Characterized in that further comprises.

The control unit may cause the security pattern to be displayed on a screen display unit when the security pattern setting display condition is met, recognizing a pupil flow pattern with respect to the security pattern, and the recognized pupil flow pattern and a preset pupil flow pattern. In this case, the method further comprises unlocking the same, and defaulting when the recognized pupil flow pattern is different from the preset pupil flow pattern.

Preferably, the control unit is a user face recognition step through the pattern recognition for the image information input from the image sensor, the distance between the recognized user face image and the existing set user face image by measuring the face image size and the separation distance And recognizing a direction (or an angle) and adjusting screen refraction, enlargement, and reduction of a reading object according to the recognized separation distance and direction (or angle). It is done.

The present invention can prevent discomfort and vision deterioration by adjusting the size of the screen by using the intelligent screen automatic adjustment function and devices of smart devices and various display devices.

In addition, defects such as facial and iris pattern recognition can be compensated for through eye flow recognition of security patterns. It is expected to improve the work processing of digital documents by solving visual problems and improve the work processing of citizens by introducing automatic screen adjustment devices such as kiosk systems.

1 is a diagram illustrating a configuration of an apparatus to which an intelligent screen display method is applied through pattern recognition according to the present invention.

2A to 2D illustrate various examples of an intelligent screen display method through pattern recognition according to the present invention.

** Description of the symbols for the main parts of the drawings **

101: camera 102: control unit

103: database 104: screen display

1 is a diagram illustrating a configuration of an apparatus to which an intelligent screen display method through pattern recognition according to the present invention is applied.

As shown in FIG. 1, the device recognizes the size of a face image through an image sensor (camera) and measures distance with an existing face image, thereby intelligently displaying a screen size that matches the ratio. It is in a ship.

In addition, after eye recognition through image processing, the flow of the eye can be identified to identify the page turning or security pattern processing.

This can be applied to the field of facial recognition.

If we add security pattern service to face recognition and process patterns with eyes, we can compensate for the shortcomings in face recognition field.

Finally, the function of displaying the screen according to the situation after checking the user's location, distance, and direction by image size recognition, allows the user to view the screen as the optimal visual environment by multiplexing the screen such as concave or convex.

In detail, the apparatus (eg, a smartphone) includes an image sensor (eg, a camera) 101, a controller 102, a screen display 104, and a database 103.

Here, the controller 102 measures a user's face recognition through pattern recognition on image information input from the image sensor 101, and measures a ratio between the recognized user's face image and an existing set user's face image, thereby separating user distances. Recognizes the screen magnification, finds the user's screen magnification in the database 103, specifies the screen magnification, and adjusts the screen size of the reading object according to the specified screen magnification and the recognized separation distance. To be displayed. The controller 102 recognizes the pupil flow in the user face image using the pattern recognition, and the controller 102 automatically displays a page after the recognized pupil flow arrives at the bottom of the reading object. Pass it over. The controller 102 causes the security pattern to be displayed on the screen display unit 104 when the security pattern setting display condition is met, recognizes the pupil flow pattern with respect to the security pattern, and then recognizes the pupil flow pattern with the recognized pupil flow pattern. If the predetermined pupil flow pattern is the same, the lock is released, and if the recognized pupil flow pattern is different from the preset pupil flow pattern, it defaults. In addition, the controller 102 may determine a user face recognition through pattern recognition on the image information input from the image sensor 101, a ratio between the recognized user face image and an existing set user face image, and a face image size. By measuring, the distance and direction (or angle) are recognized and the screen refraction, magnification and reduction of the reading object are adjusted according to the recognized distance and direction (or angle).

2A to 2D are diagrams illustrating various examples of an intelligent screen display method through pattern recognition according to the present invention.

1. FIG. 2A (Customized optimization surface technology according to user distance)

In the present invention, first, a digital input / output terminal (eg, a tablet PC, a smartphone) receives image information from an image sensor (eg, a camera).

Then, after performing the user face recognition through the pattern recognition for the input image information, by measuring the ratio of the recognized user face image and the existing set user face image to recognize the separation distance for each user.

The user can then find the user's screen magnification in the database, specify the screen magnification, and adjust the screen size of the reading object according to the specified screen magnification and the recognized separation distance (e.g., In this case, the specified screen magnification is adjusted by a set value according to the recognized separation distance so as to be displayed on the screen display unit.

2. Fig. 2b (automatic page turning technology through pupil flow recognition)

In the present invention, first, a digital input / output terminal receives image information from an image sensor (eg, a camera).

Then, after performing the user's face recognition through the pattern recognition on the input image information, using the pattern recognition to recognize the eye flow in the user's face image.

The recognized pupil flow automatically turns the page after arriving at the bottom of the leading object.

3. Figure 2c (security pattern processing technology through pupil flow recognition)

First, the present invention allows the security pattern to be displayed on the screen display unit when the digital input / output terminal corresponds to the security pattern setting display condition.

After recognizing the pupil flow pattern with respect to the security pattern, the lock is released when the recognized pupil flow pattern and the preset pupil flow pattern are the same, and the default when the recognized pupil flow pattern is different from the preset pupil flow pattern. Let's do it.

4. FIG. 2D (Technology for Supporting Screen Multiplexing through Face Recognition)

According to an embodiment of the present invention, the digital input / output terminal first performs user face recognition through pattern recognition on image information input from an image sensor, and then the ratio and face image size of the recognized user face image and the existing user face image are determined. By measuring, the distance and direction (or angle) are recognized and the screen refraction, magnification and reduction of the reading object are adjusted according to the recognized distance and direction (or angle).

For example, a screen magnification of a corresponding user can be found in a database, a screen magnification can be specified, and a screen size of a reading object is adjusted according to the specified screen magnification and the recognized separation distance and direction (eg, a screen). If the magnification is designated, the designated screen magnification is adjusted by a set value according to the recognized separation distance and direction so as to be displayed on the screen display unit.

The present invention can be used for an intelligent screen display method through pattern recognition of a digital input / output terminal (eg, tablet PC, smartphone).

Claims

In the screen display method of the control unit of the terminal having an image sensor and the screen display unit,

A step of recognizing a user's face through pattern recognition of the image information input from the image sensor by the controller;

Recognizing a separation distance for each user by measuring a ratio between the recognized user face image and an existing set user face image; And

A pattern formed by finding a screen magnification of a corresponding user in a database, specifying a screen magnification, and adjusting a screen size of a reading object according to the specified screen magnification and the recognized separation distance to be displayed on a screen display unit. How to display intelligent screen by recognition.
The method of claim 1,

The control unit recognizing a pupil flow in the user face image using the pattern recognition; And

The controller may further include automatically turning a page after the recognized pupil flow arrives at the bottom of the reading object.
The method of claim 1,

The control unit

If the security pattern setting display condition is met, displaying the security pattern on the screen display unit;

Recognizing a pupil flow pattern for the security pattern;

Unlocking when the recognized pupil flow pattern and the preset pupil flow pattern are the same, and defaulting when the recognized pupil flow pattern and the preset pupil flow pattern are different. Intelligent screen display method.
The method of claim 1,

The control unit

A user face recognition step of recognizing a pattern on image information input from the image sensor;

Recognizing a separation distance and a direction (or an angle) by measuring a ratio between the recognized user face image and an existing set user face image and a face image size; And

And adjusting the screen refraction, enlargement, and reduction of the reading object according to the recognized separation distance and direction (or angle).