TWI440016B - System and method for automatically adjusting display screen - Google Patents

Description

Screen automatic adjustment system and method

The present invention relates to a screen control system and method, and more particularly to a system and method for automatically adjusting the position of a screen.

With the popularity of computers, how to make computers more humane has become a concern of design and manufacturers. The user-friendly design brings comfort and convenience to the user and enhances the competitiveness of the product. The screen is an important part of the computer. Users sometimes need to adjust the position of the screen during use, such as adjusting its height and angle to get a better viewing angle. The existing screen can only be manually adjusted by the user, which brings some inconvenience to the user.

In view of the above, it is necessary to propose a system and method that can easily adjust the position of the screen.

An automatic screen adjustment system capable of automatically adjusting a screen according to changes in a user's facial image, the system comprising an image acquisition device for collecting facial images and a motor for driving the screen, the system The method further includes: an automatic adjusting device connected to the image capturing device and the motor, configured to control the image collecting device to collect the facial image, calculate the adjustment parameter of the screen according to the collected facial image, and adjust the parameter according to the adjusted parameter Control the motor to move the screen to the desired adjustment position.

An automatic screen adjustment method capable of controlling an automatic screen adjustment according to a change of a user's facial image, the method comprising the steps of: acquiring a corrected facial image; and converting the corrected facial image into a corrected luminance image; Extracting corrected facial features from the corrected luminance image; acquiring an instant facial image; converting the instant facial image into an instant luminance image; extracting instant facial features from the instant luminance image; The feature is different from the corrected face feature, and the adjustment parameter is calculated according to the difference between the instant face feature and the corrected face feature; and the motor motion is controlled according to the adjustment parameter to cause the screen to move to the desired adjustment position.

Compared with the prior art, the automatic screen adjustment system and method control the screen according to the change of the user's facial image, thereby facilitating the user to view the screen from a better perspective.

1‧‧‧Image acquisition equipment

2‧‧‧Automatic adjustment device

21‧‧‧ Calibration Module

22‧‧‧Tracking module

23‧‧‧Control Module

3‧‧‧Motor

4‧‧‧ screen

S301‧‧‧Acquisition corrected face image

S302‧‧‧ converted to corrected grayscale image

S303‧‧‧ Extract corrected facial features

S304‧‧‧ Collecting instant face images

S305‧‧‧ converted to instant grayscale image

S306‧‧‧ Extracting instant facial features

S307‧‧‧Is the facial features the same?

S308‧‧‧ Calculation adjustment parameters

S309‧‧‧Control motor movement

1 is a system architecture diagram of a preferred embodiment of the screen automatic adjustment system of the present invention.

2 is a functional block diagram of the automatic adjustment device 2 of FIG.

3 is a flow chart of a preferred embodiment of the screen automatic adjustment method of the present invention.

Figure 4 is a schematic illustration of correcting facial features.

Figure 5 is a schematic illustration of the instant facial features as the head is turned up.

Referring to Figure 1, there is shown a system architecture diagram of a preferred embodiment of the screen automatic adjustment system of the present invention. The automatic screen adjustment system controls the screen 4 to be adjusted according to changes in the facial image of the user, and the system includes an image capturing device 1, an automatic adjusting device 2, and a motor 3.

The image capturing device 1 is configured to collect a facial image and send the facial image to the automatic adjustment Entire device 2. The image capture device 1 can be a camera or other device for acquiring images, such as a web camera. The face image coefficient bit image acquired by the image capturing device 1 includes the corrected face image and the instant face image. The face image is corrected for the reference image when the screen is adjusted. In this embodiment, the face front image is used as the corrected face image. The instant face image is the actual image of the face during the user's viewing of the screen.

The automatic adjustment device 2 is connected to the image acquisition device 1 for controlling the image acquisition device 1 to collect a facial image, extracting a facial feature from the facial image, calculating an adjustment parameter according to the facial feature, and transmitting the adjustment parameter to Motor 3. The facial features include corrected facial features extracted from the corrected facial image and instant facial features extracted from the immediate facial image. The automatic adjusting device 2 determines whether the face position (ie, the head position) is changed by comparing the instant face feature with the corrected face feature. If the face position changes, indicating that the user position changes, the control motor 3 drives the screen 4 to move to the location. The location to be adjusted. In this embodiment, the adjustment of the screen includes height adjustment (upward and downward movement), vertical angle adjustment (upward and downward rotation), and level angle adjustment (left turn, right turn), and corresponding face position change. Includes up, down, up, down, left, and right. There are different face position changes for different screen adjustments.

The motor 3 is connected to the automatic adjustment device 2 for driving the screen 4 to the desired adjustment position according to the adjustment parameters. The motor 3 can be a DC motor, such as a permanent magnet DC motor, or an AC motor, such as a synchronous motor, or other types of motors, such as a stepper motor.

Referring to FIG. 2, it is a functional module diagram of the automatic adjustment device 2 in FIG. The automatic adjustment device 2 includes a calibration module 21, a tracking module 22, and a control module 23.

The correction module 21 is configured to control the image acquisition device 1 to acquire a corrected facial image, which will be corrected The face image is converted into a corrected grayscale image, and the corrected facial features are extracted from the corrected grayscale image.

The tracking module 22 is configured to control the image capturing device 1 to collect an instant facial image, convert the instant facial image into a real grayscale image, extract an instant facial feature from the instant grayscale image, and convert the instant face The feature is compared to the corrected face feature, and an adjustment parameter is generated based on the difference between the immediate face feature and the corrected face feature, the adjustment parameter determining the position of the desired adjustment.

The control module 23 is configured to control the movement of the motor 3 according to the adjustment parameter to cause the screen 4 to move to the position to be adjusted.

Referring to Figure 3, there is shown a flow chart of a preferred embodiment of the automatic screen adjustment method of the present invention.

In step S301, the correction module 21 controls the image acquisition device 1 to acquire a corrected face image. The corrected face image may be a color image or a black and white image.

In step S302, the correction module 21 converts the corrected face image into a corrected grayscale image.

The image acquisition device 1 acquires a digital image, which is usually represented in the form of a bitmap. The dot pattern is a rectangular dot matrix, where each dot is called a pixel (pixel), and the primitive unit of the pixel coefficient bit image. An image of m × n size consists of m × n pixels of different brightness (shading). The brightness of the digital image can be represented by a gray value, and each picture element has a determined gray value. The gray value of white is generally defined as 255, the black gray value is defined as 0, and the brightness between black and white is evenly divided into 256 levels. The gray value of each primitive of the black and white image is obtained, and the black and white image can be converted into a grayscale image. The color image can be decomposed into three monochrome images of red (R), green (G), and blue (B). Any one of the colors can be composed of these three colors. to make. The brightness of a color image is determined by the three components of red, green, and blue. Gray is used to represent the gray value, r, g, and b are three components of red, green, and blue, and the brightness of each element of the color image (determined by three components of r, g, and b) can be converted into a corresponding gray. The gray value, for example, the color value can be converted into a gray image by calculating the corresponding gray value by the formula gray=r*0.3+g*0.59+b*0.11. In the present embodiment, the correction module 21 converts the corrected face image into a corrected grayscale image regardless of whether the face image is a color image or a black and white image is corrected.

In step S303, the correction module 21 extracts corrected facial features from the corrected grayscale image.

The facial feature determines the basis for the change of the face position. If the facial feature changes, the face position is changed to determine the position change of the user. In the present embodiment, the size and position of the forehead, eyes, nose, and mouth are selected as facial features. The grayscale image indicates the brightness of the digital image, the gray value of the dark area is small, and the gray value of the bright area is large. According to the brightness characteristics of the forehead, eyes, nose and mouth, it can be extracted from the gray image. The above facial features. For example, the eyes are the two symmetrical dark areas in the upper part of the face, and the nose (represented by the nostrils) is the two dark areas in the middle of the face, and the mouth is a large dark area in the lower part of the face. As shown in FIG. 4, a schematic diagram of correcting facial features is shown. In FIG. 4, five circular regions are drawn, wherein the circular region A represents the size and position of the forehead, and the circular regions B and C represent the size and position of the eye, The circular area D represents the size and position of the nose, and the circular area E represents the size and position of the mouth. From the above five circular areas, the distance between the eyes can be calculated, as shown by the line d1 between B and C in Fig. 4, and the distance from the forehead to the mouth is calculated, as shown in Fig. 4 between A and E. Line d2 is shown.

In step S304, the tracking module 22 controls the image capturing device 1 to collect an instant facial image. The instant face image may be a color image or a black and white image.

Step S305, the tracking module 22 converts the instant facial image into a real-time grayscale image, The conversion method is the same as that described in step S302.

In step S306, the tracking module 22 extracts the instant facial features from the real-time grayscale image. The tracking module 22 extracts the same facial features as the corrected facial features, that is, if the size and position of the forehead, eyes, nose, and mouth of the facial features are corrected, the immediate facial features are also forehead, eyes, nose, and mouth. Size and location. As shown in Fig. 5, a schematic diagram of the instant facial features when the head is turned up, five circular areas are drawn in the figure, wherein the circular area A represents the size and position of the forehead, and the circular area B and C represent the size of the eye. And the position, the circular area D represents the size and position of the nose, and the circular area E represents the size and position of the mouth. From the above five circular areas, the distance between the eyes can be calculated, as shown by the line d1 between B and C in Fig. 5, and the distance from the forehead to the mouth is calculated, as shown in Fig. 5 between A and E. Line d2 is shown.

In step S307, the tracking module 22 compares the instant face feature with the corrected face feature. If the same, the process proceeds to step S304. You can compare the distance d1 between the eyes and the distance d2 from the forehead to the mouth. If d1 or d2 is different, the instant facial features are different from the corrected facial features. If d1 is the same as d2, then the size of each facial feature is compared. And the location is the same. The instant face feature when the head is turned up as shown in FIG. 5 is different from the corrected face feature shown in FIG.

Step S308, when the instant facial feature is different from the corrected facial feature, the tracking module 22 calculates an adjustment parameter according to the difference between the immediate facial feature and the corrected facial feature to determine the adjusted position. For example, face position changes include up, down, up, down, left, and right. From the forehead, eyes, nose, mouth size and position changes, you can determine whether the face position changes and can Determine the change. If d1 becomes smaller, the face rotates left and right. If d2 becomes smaller, the face rotates up and down. The forehead-to-mouth distance d1 is changed as compared to the corrected facial features in FIG. Small, nose D, mouth E becomes larger, eyes B, C become smaller, and thus it can be judged that the head is turned up. If the face position changes greatly, the temporal facial features change greatly.

In step S309, the control module 23 controls the movement of the motor 3 according to the adjustment parameter to cause the screen 4 to move to the position to be adjusted.

It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to be limiting, although the present invention will be described in detail with reference to the preferred embodiments. Or equivalents, without departing from the spirit and scope of the technical solutions of the present invention.

S301‧‧‧Acquisition corrected face image

S302‧‧‧ converted to corrected grayscale image

S303‧‧‧ Extract corrected facial features

S304‧‧‧ Collecting instant face images

S305‧‧‧ converted to instant grayscale image

S306‧‧‧ Extracting instant facial features

S307‧‧‧Is the facial features the same?

S308‧‧‧ Calculation adjustment parameters

S309‧‧‧Control motor movement

Claims (8)

An automatic screen adjustment system capable of automatically adjusting a screen according to changes in a user's facial image, the system comprising an image acquisition device for collecting facial images and a motor for driving the screen, the system The method further includes: an automatic adjusting device respectively connected to the image capturing device and the motor, wherein the automatic adjusting device comprises: a correcting module, configured to control the image collecting device to collect the corrected facial image, and correct the facial image The image is converted into a corrected brightness image, and the corrected face feature is extracted from the corrected brightness image; the tracking module is configured to control the image capturing device to collect the instant face image, and convert the instant face image into an instant brightness image. For example, extracting an instant facial feature from an instant brightness image, comparing the instant facial feature with the corrected facial feature, and calculating an adjustment parameter according to the difference between the facial feature and the corrected facial feature; and controlling the module The motor is controlled to move according to the adjustment parameters, so that the screen is moved to the desired adjustment position. The screen automatic adjustment system according to claim 1, wherein the corrected face image and the instant face image are a digital image. The screen automatic adjustment system according to claim 1, wherein the corrected brightness image and the instant brightness image are grayscale images. The automatic screen adjustment system of claim 1, wherein the corrected facial features and the immediate facial features include the size and position of the forehead, eyes, nose, and mouth. An automatic screen adjustment method capable of controlling an automatic screen adjustment according to a change of a user's facial image, the method comprising the steps of: acquiring a corrected facial image; Converting the corrected face image into a corrected brightness image; extracting the corrected face feature from the corrected brightness image; acquiring an instant face image; converting the instant face image into an instant brightness image; from instant brightness Instant facial features are extracted from the image; if the instant facial features are different from the corrected facial features, the adjustment parameters are calculated according to the difference between the immediate facial features and the corrected facial features; and the motor motion is controlled according to the adjustment parameters to drive The screen moves to the desired adjustment position. The screen automatic adjustment method according to claim 5, wherein the corrected face image and the instant face image are a digital image. The screen automatic adjustment method according to claim 5, wherein the corrected brightness image and the instant brightness image are grayscale images. The automatic screen adjustment method according to claim 5, wherein the corrected facial features and the instant facial features include the size and position of the forehead, eyes, nose, and mouth.