KR102243928B1 - Electronic terminal apparatus to enable the optimal adjustment of the screen of display apparatus and operating method thereof - Google Patents

Abstract

Disclosed are an electronic terminal device capable of adjusting the screen of a display device to an optimal state and an operating method thereof. The present invention transmits a reference image and a display command for the reference image to a display device when an adjustment command for the screen of the display device is applied from a user, acquires the reference image from a camera loaded in the electronic terminal device when the user photographs the reference image displayed on the screen of the display device through the camera to generate a screen adjustment value for the display device based on RGB values of the acquired reference image, and then transmits the screen adjustment value and a screen adjustment command based on the screen adjustment value to the display device to support to adjust the screen of the display device to an optimal state.

Description

An electronic terminal device that enables the screen of a display device to be adjusted to the optimal state, and its operation method {ELECTRONIC TERMINAL APPARATUS TO ENABLE THE OPTIMAL ADJUSTMENT OF THE SCREEN OF DISPLAY APPARATUS AND OPERATING METHOD THEREOF}

The present invention relates to an electronic terminal device and a method of operating the same for adjusting a screen of a display device to an optimum state.

In the past, users have performed optimization work on the screen of the display device by manually adjusting the screen of the display device.

For this reason, users who lack professional knowledge and experience sometimes have some difficulty in performing an optimization task for a screen of a display device.

However, in recent years, thanks to the development of technology, the AUTO function is provided on the screen of the display device, so that it is possible to perform an optimization task, but there is a problem that the sophistication is somewhat deteriorated.

In addition, since display devices do not have an illuminance sensor for measuring an ambient illuminance value, it has been difficult to adjust the brightness of a screen of a display device in consideration of an illuminance value around it.

In order to improve these difficulties and problems, after transmitting a predetermined reference image to the display device using an electronic terminal device that is interlocked with the display device and equipped with an illuminance sensor in advance, when the reference image is displayed on the screen of the display device, As the user photographs the reference image displayed on the screen of the display device using the electronic terminal device, an optimal screen adjustment value is generated based on the captured reference image, thereby displaying the screen of the display device based on the generated screen adjustment value. You can consider introducing a system that can be adjusted to the optimum state.

Therefore, there is a need for research on a system that enables the screen of a display device to be adjusted to an optimal state using an electronic terminal device.

In the electronic terminal device and its operation method according to the present invention, when an adjustment command for a screen of a display device is applied from a user, a reference image and a display command for the reference image are transmitted to the display device, and the user When the reference image displayed on the screen of the display device is captured through a camera mounted on the device, the screen adjustment value for the display device is based on the RGB value of the reference image obtained by acquiring the reference image from the camera. After generating, the screen adjustment command based on the screen adjustment value and the screen adjustment value is transmitted to the display device, so that the screen of the display device can be adjusted to an optimal state.

The electronic terminal device for adjusting the screen of the display device according to an embodiment of the present invention to an optimum state is, when an adjustment command for the screen of the display device interlocked with the electronic terminal device is applied by a user, the display A reference image designated in advance by the device-The reference image is an image in which N (N is a natural number of 2 or more) predetermined partial images are combined-and at the same time, the reference image is displayed on the screen of the display device. A first command unit that transmits a commanding first control signal to the display device, and after the reference image and the first control signal are transmitted to the display device and the reference image is displayed on the screen of the display device, the user When the reference image displayed on the screen of the display device is captured through a camera mounted on the electronic terminal device, a first image acquisition unit acquiring a first image from the camera and when the first image is acquired The first image is divided into the N partial images, and a screen adjustment value for the display device is generated based on the RGB values of the N partial images divided from the first image, and then the display device is used. And a second command unit which transmits the screen adjustment value and transmits a second control signal to the display device to command the screen adjustment of the display device according to the screen adjustment value.

In addition, according to an embodiment of the present invention, a method of operating an electronic terminal device for adjusting a screen of a display device to an optimal state includes an adjustment command for the screen of the display device interlocked with the electronic terminal device from a user. When applied, a reference image designated in advance to the display device-the reference image is an image in which N (N is a natural number of 2 or more) predetermined partial images are combined-and at the same time, the reference image is displayed on the screen of the display device. Transmitting a first control signal instructing to display on the display device to the display device, after the reference image and the first control signal are transmitted to the display device to display the reference image on the screen of the display device, When the user photographs the reference image displayed on the screen of the display device through a camera mounted on the electronic terminal device, obtaining a first image from the camera and when the first image is obtained, the The first image is divided into the N partial images, a screen adjustment value is generated for the display device based on the RGB values of the N partial images divided from the first image, and then the screen is used with the display device. And transmitting, to the display device, a second control signal instructing to adjust a screen of the display device according to the screen adjustment value while transmitting the adjustment value.

In the electronic terminal device and its operation method according to the present invention, when an adjustment command for a screen of a display device is applied from a user, a reference image and a display command for the reference image are transmitted to the display device, and the user When the reference image displayed on the screen of the display device is captured through a camera mounted on the device, the screen adjustment value for the display device is based on the RGB value of the reference image obtained by acquiring the reference image from the camera. After generating, by transmitting a screen adjustment command based on the screen adjustment value and the screen adjustment value to the display device, the screen of the display device can be adjusted to an optimum state.

1 is a diagram illustrating a structure of an electronic terminal device that enables a screen of a display device according to an embodiment of the present invention to be adjusted to an optimum state.
2 to 3 are diagrams for explaining an electronic terminal device capable of adjusting a screen of a display device according to an exemplary embodiment of the present invention to an optimum state.
4 is a flowchart illustrating a method of operating an electronic terminal device to adjust a screen of a display device to an optimum state according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. This description is not intended to limit the present invention to a specific embodiment, it is to be understood to include all changes, equivalents, and substitutes included in the spirit and scope of the present invention. While describing each drawing, similar reference numerals have been used for similar elements, and unless otherwise defined, all terms used in the present specification including technical or scientific terms refer to common knowledge in the technical field to which the present invention pertains. It has the same meaning as commonly understood by someone who has it.

In this document, when a part "includes" a certain component, it means that other components may be further included rather than excluding other components unless otherwise stated. In addition, in various embodiments of the present invention, each component, function blocks, or means may be composed of one or more sub-components, and the electrical, electronic, and mechanical functions performed by each component are electronic. A circuit, an integrated circuit, or an application specific integrated circuit (ASIC) may be implemented with various known devices or mechanical elements, and may be implemented separately or two or more may be integrated into one.

On the other hand, the blocks of the attached block diagram and the steps in the flowchart are computer program instructions that are mounted on a processor or memory of equipment capable of processing data such as general-purpose computers, special computers, portable notebook computers, and network computers to perform specified functions. It can be interpreted as meaning. Since these computer program instructions can be stored in a memory provided in a computer device or in a memory readable by a computer, the functions described in the blocks in the block diagram or in the steps in the flowchart are produced as a product containing the instruction means for performing this. It could be. In addition, each block or each step may represent a module, segment, or part of code containing one or more executable instructions for executing the specified logical function(s). In addition, it should be noted that in some alternative embodiments, functions mentioned in blocks or steps may be executed in a different order. For example, two blocks or steps shown in succession may be performed substantially simultaneously or may be performed in reverse order, and in some cases, some blocks or steps may be omitted.

1 is a diagram illustrating a structure of an electronic terminal device that enables a screen of a display device according to an embodiment of the present invention to be adjusted to an optimum state.

Referring to FIG. 1, an electronic terminal device 110 for adjusting a screen of a display device according to the present invention to an optimal state includes a first command unit 111, a first image acquisition unit 112, and a second command. Includes part 113.

When the first command unit 111 receives an adjustment command for the screen of the display device 130 linked to the electronic terminal device 110 from the user, the reference image 140 (reference The image 140 transmits a predetermined N (N is a natural number of 2 or more) partial images combined) and commands the reference image 140 to be displayed on the screen of the display device 130. The first control signal is transmitted to the display device 130.

Here, the electronic terminal device 110 and the display device 130 may interwork with each other through short-range wireless communication or wired communication using a High Definition Multimedia Interface (HDMI) cable.

After the first image acquisition unit 112 transmits the reference image 140 and the first control signal to the display device 130 and displays the reference image 140 on the screen of the display device 130, the user When the reference image 140 displayed on the screen of the display device 130 is captured through a camera mounted on the electronic terminal device 110, a first image is obtained from the camera.

When the first image is obtained, the second command unit 113 divides the first image into the N partial images, and displays based on the RGB values of the N partial images divided from the first image. A second control that generates a screen adjustment value for the device 130 and transmits the screen adjustment value to the display device 130 and commands to adjust the screen of the display device 130 according to the screen adjustment value. The signal is transmitted to the display device 130.

In connection with, the operations of the first command unit 111, the first image acquisition unit 112, and the second command unit 113 will be described with reference to the pictures shown in FIGS. 2 and 3 as follows.

First, let's assume that'N=4'. At this time, when an adjustment command for the screen of the display device 130 interlocked with the electronic terminal device 110 is applied by the user, the first command unit 111 transmits the display device 130 to the display device 130 as shown in FIG. 2. A reference image 140 designated in advance (the reference image 140 is a partial image 1 (141), which are four predetermined partial images, a partial image 2 (142), a partial image 3 (143), and a partial image 4 (144)). 'Is a combined image) and at the same time, a first control signal instructing to display the reference image 140 on the screen of the display apparatus 130 may be transmitted to the display apparatus 130.

In this way, after the reference image 140 and the first control signal are transmitted from the electronic terminal device 110 to the display device 130 and the reference image 140 is displayed on the screen of the display device 130, the user When the reference image 140 displayed on the screen of the display device 130 is captured through a camera mounted on the electronic terminal device 110, the first image acquisition unit 112 acquires a first image from the camera. can do.

At this time, when the first image is acquired from the camera, the second command unit 113 converts the first image to the four partial images,'partial image 1 145', as shown in FIG. Image 2 (146), partial image 3 (147), partial image 4 (148)', and the four partial images divided from the first image,'partial image 1 (145), partial image 2 (146). ), partial image 3(147), partial image 4(148)', after generating a screen adjustment value for the display device 130 based on the RGB values, and transmitting the screen adjustment value to the display device 130. At the same time, a second control signal instructing to adjust the screen of the display device 130 according to the screen adjustment value may be transmitted to the display device 130.

In this case, according to an exemplary embodiment of the present invention, when the screen adjustment value and the second control signal are received from the electronic terminal device 110, the display device 130 determines the screen adjustment value based on the second control signal. According to this, the screen of the display device 130 may be adjusted.

That is, when an adjustment command for the screen of the display device 130 interlocked with the electronic terminal device 110 is applied by the user, the electronic terminal device 110 selects the reference image 140 previously designated as the display device 130. Simultaneously with transmission, a first control signal instructing to display the reference image 140 on the screen of the display apparatus 130 is transmitted to the display apparatus 130, and the reference image 140 is transmitted to the display apparatus 130. And after the first control signal is transmitted and the reference image 140 is displayed on the screen of the display device 130, the user can display the screen of the display device 130 through a camera mounted on the electronic terminal device 110. When the reference image 140 displayed on the image is taken, a first image is obtained from the camera, the first image is divided into the N partial images, and the N partial images divided from the first image are After generating a screen adjustment value for the display device 130 based on the RGB value, the screen adjustment value is transmitted to the display device 130 and at the same time, the screen of the display device 130 is adjusted according to the screen adjustment value. By transmitting a second control signal instructing the operation to be performed to the display apparatus 130, the screen of the display apparatus 130 may be supported to be adjusted to an optimal state.

According to an embodiment of the present invention, the electronic terminal device 110 may further include an image attribute storage unit 114, a matching information storage unit 115, and an adjustment table storage unit 116.

The image attribute storage unit 114 stores N predetermined image attributes and different three-dimensional reference vectors that are predetermined corresponding to each of the N image attributes.

Here, the image properties mean properties such as brightness, contrast, saturation, hue, sharpness, or color temperature.

For example, in the case of'N=4', information may be stored in the image attribute storage unit 114 as shown in Table 1 below.

4 image properties 3D reference vector brightness [32 64 12] prepare [32 100 64] saturation [96 32 160] color [64 148 192]

The matching information storage unit 115 stores, for each of the N partial images, matching information with one image attribute previously designated as corresponding to each partial image among the N image attributes.

For example, in the case of'N=4', information may be stored in the matching information storage unit 115 as shown in Table 2 below.

4 partial images 4 image properties Partial image 1 brightness Partial image 2 prepare Partial image 3 saturation Partial image 4 color

In the adjustment table storage unit 116, for each of the N image attributes, a plurality of predetermined different cosine similarity range values consisting of an upper limit value and a lower limit value, and a predetermined value corresponding to each of the plurality of cosine similarity range values. An adjustment table that records the image property adjustment values is stored.

For example, in the case of'N=4', information may be recorded in an adjustment table corresponding to each of the four image attributes as shown in Table 3 below.

brightness prepare Revenge
Cosine similarity range values Image property adjustment value Revenge
Cosine similarity range values Image property adjustment value Less than 0.9 +3 Less than 0.9 -6 0.9 or more and less than 0.95 +2 0.9 or more and less than 0.95 -4 0.95 or more and less than 0.99 +1 0.95 or more and less than 0.99 -2 0.99 or higher 0 0.99 or higher 0 saturation color Revenge
Cosine similarity range values Image property adjustment value Revenge
Cosine similarity range values Image property adjustment value Less than 0.9 +4.5 Less than 0.9 -1.5 0.9 or more and less than 0.95 +3 0.9 or more and less than 0.95 -One 0.95 or more and less than 0.99 +1.5 0.95 or more and less than 0.99 -0.5 0.99 or higher 0 0.99 or higher 0

In Table 3,'+' may mean increasing the value of the image attribute by the corresponding adjustment value, and'-' may mean decreasing the value of the image attribute by the corresponding adjustment value.

At this time, the second command unit 113 includes a pixel value extraction unit 117, a vector generation unit 118, a cosine similarity calculation unit 119, an image property adjustment value extraction unit 120, and a screen adjustment value determination unit 121. It may include.

When the first image is obtained, the pixel value extracting unit 117 divides the first image into the N partial images, and comprises a plurality of the N partial images divided from the first image. Extract RGB values for pixels.

For each of the N partial images, the vector generator 118 calculates the average of the red color values, the average of the green color values, and the average of the blue color values of a plurality of pixels constituting each partial image. A partial image vector for each of the N partial images is generated by generating a three-dimensional partial image vector using the calculated average of the red color values, the average of the green color values, and the average of the blue color values as components.

Here, the RGB value is composed of a red color value, a green color value, and a blue color value having any one value between 0 and 255, and thus may be expressed in different colors.

For example, as in the example described above,'N=4' and the four partial images are'partial image 1 (145), partial image 2 (146), partial image 3 (147), partial image 4 (148). ', and assume that the first image is composed of 12 pixels. At this time, when the first image is acquired from the camera, the pixel value extracting unit 117 converts the first image to the four partial images,'partial image 1 145', as shown in FIG. Image 2 (146), partial image 3 (147), partial image 4 (148)', and the four partial images divided from the first image,'partial image 1 (145), partial image 2 (146). ), the partial image 3 147, and the partial image 4 148' can be extracted as shown in Table 4 below.

Four
Partial images Pixel sequence number Red color value Green color value Blue color value Partial image 1 Pixel 1 3 2 8 Pixel 2 2 One 7 Pixel 3 4 3 3 Partial image 2 Pixel 4 35 99 66 Pixel 5 31 101 67 Pixel 6 36 100 59 Partial image 3 Pixel 7 3 2 5 Pixel 8 One 4 7 Pixel 9 2 3 9 Partial image 4 Pixel 10 65 100 150 Pixel 11 68 120 160 Pixel 12 59 80 170

Thereafter, the vector generation unit 118, for each of the four partial images,'Partial Image 1 (145), Partial Image 2 (146), Partial Image 3 (147), Partial Image 4 (148)', The three pixels constituting the partial image'Partial Image 1 (145)','Partial Image 2 (146)','Partial Image 3 (147)', and'Partial Image 4 (148)' After calculating the average of the red color values, the average of the green color values, and the average of the blue color values of each of pixel 3','pixel 4 to pixel 6','pixel 7 to pixel 9'and'pixel 10 to pixel 12' , '3, 34, 2, 64' which is the average of the calculated red color values, '2, 100, 3, 100' which is the average of the green color values, and '6, 64, 7, 160' which is the average of the blue color values. 'Partial image 1 (145), partial image 2 (146), partial image 3 (147), partial image 4 (148)', which are the four partial images, by creating a three-dimensional partial image vector of ' For each partial image vector,'[3 2 6]','[34 100 64]','[2 3 7]', and'[64 100 160]' can be generated.

When a partial image vector for each of the N partial images is generated, the cosine similarity calculating unit 119 checks the image attribute matched to each of the N partial images with reference to the matching information storage unit 115, After checking the reference vector corresponding to the N image attributes with reference to the image attribute storage unit 114, for each of the N image attributes, the partial image vector for the partial image matched with each image attribute and the respective By calculating the cosine similarity between reference vectors according to the image attributes, a cosine similarity for each of the N image attributes is generated.

Here, for each of the N image attributes, a cosine similarity between a partial image vector for a partial image matched with each image attribute and a reference vector according to each image attribute may be calculated according to Equation 1 below.

Here, S is the cosine similarity between vectors A and B and has a value between -1 and 1, and the larger the value is, the more it is a similar vector, A _i is the i-th component of vector A, and B _i is the i of vector B Means the second ingredient.

For example, as in the above-described example, it is assumed that'N=4' and the four partial images are'partial image 1 (145), partial image 2 (146), partial image 3 (147), partial image 4 (148). 'Suppose that the partial image vectors for each were created as'[3 2 6]','[34 100 64]','[2 3 7]', and'[64 100 160]'.

At this time, the cosine similarity calculating unit 119 refers to the matching information storage unit 115 as shown in Table 2, and refers to the four partial images,'partial image 1 145, partial image 2 146), and partial image 3 (147). ), check the image attributes'brightness','contrast','saturation', and'color', which are matched to each of the partial images 4 (148), and refer to the image attribute storage unit 114 shown in Table 1 above. Thus, the reference vectors'[32 64 12], [32 100 64], [96 32 160], [64 148 192]' corresponding to the four image properties'brightness, contrast, saturation, hue' can be checked. have.

Then, the cosine similarity calculating unit 119 matches each of the four image attributes'brightness, contrast, saturation, and hue' with each image attribute'brightness','contrast','saturation', and'color'. '[3 2 6]','[34 100 64]','[2 3 7]','[64 100 160]', which are partial image vectors for the imaged partial image, and'brightness' as each of the image properties, Cosine similarity between'[32 64 12]','[32 100 64]','[96 32 160]','[64 148 192]', which are reference vectors according to'contrast','saturation', and'color' By calculating, '0.58', '0.999', '0.945', and '0.993', which are cosine similarities for each of the four image attributes,'brightness, contrast, saturation, and hue' can be generated.

Relatedly, the cosine similarity calculating unit 119 calculates the cosine similarity between the partial image vector'[3 2 6]' corresponding to the'brightness' and the reference vector'[32 64 12]', '0.58' can be generated as a cosine similarity, and'contrast' by calculating the cosine similarity between'[34 100 64]', which is a partial image vector corresponding to'contrast', and'[32 100 64]', which is a reference vector It is possible to generate '0.999' as a cosine similarity for'Saturation', and by calculating the cosine similarity between'[2 3 7]' which is a partial image vector corresponding to'saturation' and'[96 32 160]', which is a reference vector, ' '0.945' can be generated as a cosine similarity for'saturation', and by calculating the cosine similarity between'[64 100 160]', which is a partial image vector corresponding to'color', and'[64 148 192]', which is a reference vector, , '0.993' can be generated as a cosine similarity to'color'.

When the cosine similarity for each of the N image attributes is generated, the image attribute adjustment value extractor 120 generates a cosine for each image attribute from an adjustment table corresponding to each image attribute for each of the N image attributes. An image attribute adjustment value for each of the N image attributes is extracted by extracting a recorded image attribute adjustment value corresponding to a range value to which the similarity belongs.

When an image attribute adjustment value for each of the N image attributes is extracted, the screen adjustment value determiner 121 determines an image attribute adjustment value for each of the N image attributes as the screen adjustment value.

For example, as in the example described above,'N=4', the four image attributes are referred to as'brightness, contrast, saturation, hue', and each of the four image attributes'brightness, contrast, saturation, hue' Assuming that the cosine similarity to is generated as '0.58', '0.999', '0.945', and '0.993', the image property adjustment value extractor 120 includes the four image properties'brightness, contrast, saturation, and For each image attribute,'brightness','contrast','saturation' from the adjustment table shown in Table 3 above corresponding to each image attribute'brightness','contrast','saturation', and'color'. ', '0.58', '0.999', '0.945', '0.993', which are the cosine similarities to'color', are within the range of '0.9 or more', '0.99 or more', '0.9 or more and less than 0.95', '0.99 or more' By extracting the image property adjustment values'+3', '0','+3', and '0' recorded in correspondence with the four image properties,'brightness','contrast','saturation', ' '+3', '0','+3', and '0' which are image property adjustment values for each of'color' can be extracted.

In this way,'+3', '0','+3', and '0', which are image property adjustment values for each of the four image properties,'brightness, contrast, saturation, and color', are extracted from the electronic terminal device 110. If so, the screen adjustment value determining unit 121 is the image property adjustment values of'+3', '0','+3', and '0' for each of the four image properties,'brightness, contrast, saturation, and color'. May be determined as the screen adjustment value.

In addition, the second command unit 113 instructs to adjust the screen together with the image property adjustment values of'+3', '0','+3', and '0' for each of'brightness, contrast, saturation, and color'. The second control signal to be displayed may be transmitted to the display device 130, and the display device 130 sets the numerical values of'brightness, contrast, saturation, and hue' to'+3' and '0' based on the second control signal. It can be adjusted as much as','+3', and '0'.

According to an exemplary embodiment of the present invention, the first image acquisition unit 112 transmits the reference image 140 and the first control signal to the display device 130 and transmits the reference image ( 140) is displayed, as illustrated in FIG. 2, a guide area 150 of a preset size that guides the photographing of the reference image 140 is generated and displayed on the screen of the electronic terminal device 110. At the same time, a shooting guide message 160 that allows the reference image 140 displayed on the screen of the display device 130 to be captured by being included in the guide area 150 may be displayed on the screen of the electronic terminal device 110. .

Through this, the user adjusts the position of the electronic terminal device 110 so that the reference image 140 displayed on the screen of the display device 130 is included in the guide area 150 to be photographed, and then the reference image ( 140).

At this time, the first image acquisition unit 112 includes the reference image 140 as the reference image 140 displayed on the screen of the display device 130 through the camera is included in the guide area 150 and is photographed. When the corresponding image is acquired, only the area corresponding to the guide area 150 may be cut out from the acquired image to obtain the first image.

According to an embodiment of the present invention, the electronic terminal device 110 further includes a brightness adjustment table holding unit 122, an illuminance measurement unit 123, a brightness adjustment value extracting unit 124, and a third command unit 125. Can include.

The brightness adjustment table holding unit 122 stores a brightness adjustment table in which a plurality of different predetermined illuminance range values consisting of an upper limit value and a lower limit value and a predetermined brightness adjustment value corresponding to each of the plurality of illuminance range values are recorded. To keep it.

For example, the brightness adjustment table holding unit 122 may store and maintain the brightness adjustment table as shown in Table 5 below.

Multiple illuminance range values Brightness adjustment value More than 0Lux and less than 75Lux -5 More than 75Lux and less than 150Lux 5 More than 150Lux and less than 300Lux 15 300Lux or more 25

The illuminance measurement unit 123 measures an illuminance value around the electronic terminal device 110 through an illuminance sensor provided in the electronic terminal device 110.

The brightness adjustment value extracting unit 124 extracts a first brightness adjustment value recorded in correspondence with a range value to which the measured illumination value belongs from the brightness adjustment table.

When the first brightness adjustment value is extracted, the third command unit 125 transmits the first brightness adjustment value to the display device 130 and at the same time, A third control signal instructing to adjust the screen is transmitted to the display device 130.

In this case, when the first brightness adjustment value and the third control signal are received from the electronic terminal device 110, the display device 130 may display the display device according to the first brightness adjustment value based on the third control signal. 130) screen can be adjusted.

For example, if it is assumed that the measured illuminance value is '50Lux', the brightness adjustment value extractor 124 is a range value of '0Lux or more 75Lux' to which the measured illuminance value '50Lux' belongs from the brightness adjustment table as shown in Table 5 above. '-5', which is a recorded first brightness adjustment value corresponding to'less than', may be extracted.

In this way, when the first brightness adjustment value'-5' is extracted from the electronic terminal device 110, the third command unit 125 transmits the first brightness adjustment value'-5' to the display device 130. At the same time, a third control signal instructing to adjust the screen of the display device 130 according to the first brightness adjustment value of'-5' may be transmitted to the display device 130.

In this case, when the first brightness adjustment value'-5' and the third control signal are received from the electronic terminal device 110, the display device 130 displays the first brightness adjustment value ' According to -5', the screen of the display device 130 may be adjusted.

That is, the electronic terminal device 110 measures the surrounding illuminance value through an illuminance sensor, and then uses the measured illuminance value to adjust the screen of the display device 130 to darken in a dark place, and displays the display in a bright place. The screen of the device 130 may be adjusted to be bright.

4 is a flowchart illustrating a method of operating an electronic terminal device to adjust a screen of a display device to an optimum state according to an embodiment of the present invention.

In step S410, when an adjustment command for the screen of the display device interlocked with the electronic terminal device is applied by a user, a reference image previously designated to the display device (the reference image is a predetermined N (N is a natural number of 2 or more). ) Is a combined image of partial images) and a first control signal instructing to display the reference image on the screen of the display device is transmitted to the display device.

In step S420, after the reference image and the first control signal are transmitted to the display apparatus and the reference image is displayed on the screen of the display apparatus, the user When the reference image displayed on the screen of the display device is captured, a first image is obtained from the camera.

In step S430, when the first image is obtained, the first image is divided into the N partial images, and the display device is sent to the display device based on the RGB values of the N partial images divided from the first image. After generating the screen adjustment value for the display device, the screen adjustment value is transmitted to the display device, and a second control signal instructing to adjust the screen of the display device according to the screen adjustment value is transmitted to the display device.

In this case, according to an embodiment of the present invention, in the operation method of the electronic terminal device, different three-dimensional reference vectors that are predetermined as corresponding to each of the N image attributes and the N image attributes are stored. Maintaining an image attribute storage unit in which there is an image attribute storage unit, for each of the N partial images, matching information in which matching information with one image attribute previously designated as corresponding to each partial image among the N image attributes is stored Maintaining a storage unit, and for each of the N image attributes, a plurality of predetermined different cosine similarity range values consisting of an upper limit value and a lower limit value, and an image attribute predetermined as corresponding to each of the plurality of cosine similarity range values The method may further include maintaining an adjustment table storage unit in which an adjustment table in which adjustment values are recorded is stored.

At this time, in step S430, when the first image is obtained, the first image is divided into the N partial images, and a plurality of pixels constituting each of the N partial images divided from the first image Extracting RGB values for each of the N partial images, calculating an average of the red color values, the average of the green color values, and the average of the blue color values of a plurality of pixels constituting each partial image Thereafter, a partial image vector for each of the N partial images is generated by generating a three-dimensional partial image vector using the calculated average of the red color values, the average of the green color values, and the average of the blue color values as components. In the step of, when a partial image vector for each of the N partial images is generated, an image attribute matching each of the N partial images is checked with reference to the matching information storage unit, and the image attribute storage unit is referred to After checking the reference vector corresponding to the N image attributes, for each of the N image attributes, the cosine similarity between the partial image vector for the partial image matched with each image attribute and the reference vector according to each image attribute is calculated. The step of generating a cosine similarity for each of the N image attributes by calculating. When the cosine similarity for each of the N image attributes is generated, for each of the N image attributes, corresponding to each image attribute Extracting an image attribute adjustment value for each of the N image attributes by extracting an image attribute adjustment value recorded in correspondence with a range value to which the cosine similarity belongs to each image attribute from the adjustment table, and the N images When an image attribute adjustment value for each of the attributes is extracted, determining an image attribute adjustment value for each of the N image attributes as the screen adjustment value.

Further, according to an embodiment of the present invention, in step S420, after the reference image and the first control signal are transmitted to the display device and the reference image is displayed on the screen of the display device, the reference image is A photographing guide message for generating a guide region of a preset size to guide photographing and displaying it on the screen of the electronic terminal device and simultaneously including the reference image displayed on the screen of the display device to be photographed by being included in the guide region When an image including the reference image is obtained as the reference image displayed on the screen of the electronic terminal device and the reference image displayed on the screen of the display device through the camera is captured by being included in the guide area, the The first image may be obtained by cutting out only an area corresponding to the guide area from the acquired image.

Further, according to an embodiment of the present invention, when the screen adjustment value and the second control signal are received from the electronic terminal device, the display device displays the display according to the screen adjustment value based on the second control signal. You can adjust the screen of the device.

In addition, according to an embodiment of the present invention, the operation method of the electronic terminal device includes a plurality of different preset illuminance range values consisting of an upper limit value and a lower limit value, and a predetermined brightness adjustment corresponding to each of the plurality of illuminance range values. Storing and maintaining a brightness adjustment table in which values are recorded, measuring an illuminance value around the electronic terminal device through an illuminance sensor provided in the electronic terminal device, and the measured illuminance from the brightness adjustment table Extracting a recorded first brightness adjustment value corresponding to a range value to which the value belongs, and when the first brightness adjustment value is extracted, transmits the first brightness adjustment value to the display device, and at the same time, the first brightness adjustment value The method may further include transmitting, to the display device, a third control signal instructing to adjust the screen of the display device according to the brightness adjustment value.

In the above, a method of operating an electronic terminal device for adjusting a screen of a display device according to an embodiment of the present invention to an optimum state has been described with reference to FIG. 4. Here, the method of operating the electronic terminal device for adjusting the screen of the display device to the optimal state according to an embodiment of the present invention is an electronic terminal device that allows the screen of the display device described with reference to FIG. 1 to be adjusted to the optimal state. Since it may correspond to the configuration of the operation of the terminal device 110, a more detailed description thereof will be omitted.

The method of operating an electronic terminal device for adjusting a screen of a display device to an optimum state according to an embodiment of the present invention may be implemented as a computer program stored in a storage medium for execution through a combination with a computer.

In addition, the method of operating an electronic terminal device for adjusting the screen of the display device to an optimal state according to an embodiment of the present invention is implemented in the form of program commands that can be executed through various computer means, and is provided in a computer-readable medium. Can be recorded. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded in the medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

As described above, in the present invention, specific matters such as specific components, etc., and limited embodiments and drawings have been described, but this is provided only to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. , If a person of ordinary skill in the field to which the present invention belongs, various modifications and variations are possible from these descriptions.

Therefore, the spirit of the present invention is limited to the described embodiments and should not be defined, and all things that are equivalent or equivalent to the claims as well as the claims to be described later fall within the scope of the spirit of the present invention. .

110: an electronic terminal device that enables the screen of the display device to be adjusted to an optimal state
111: first command unit 112: first image acquisition unit
113: second command unit 114: image attribute storage unit
115: matching information storage unit 116: adjustment table storage unit
117: pixel value extraction unit 118: vector generation unit
119: cosine similarity calculation unit 120: image attribute adjustment value extraction unit
121: screen adjustment value determination unit 122: brightness adjustment table holding unit
123: illuminance measurement unit 124: brightness adjustment value extraction unit
125: third command unit 130: display device
140: reference image

Claims (12)

In the electronic terminal device for adjusting the screen of the display device to an optimal state,
A brightness adjustment table holding unit that stores and maintains a brightness adjustment table in which a plurality of different predetermined illuminance range values consisting of an upper limit value and a lower limit value and a predetermined brightness adjustment value corresponding to each of the plurality of illuminance range values are recorded;
When an adjustment command for the screen of the display device interlocked with the electronic terminal device is applied by a user, a reference image designated in advance by the display device-The reference image includes N (N is a natural number of 2 or more) partial images A first command unit configured to transmit, to the display device, a first control signal instructing to display the reference image on the screen of the display device while transmitting the combined image;
After the reference image and the first control signal are transmitted to the display apparatus and the reference image is displayed on the screen of the display apparatus, the user A first image acquisition unit that acquires a first image from the camera when the reference image displayed in is captured;
When the first image is obtained, the first image is divided into the N partial images, and a screen adjustment value for the display device is calculated based on the RGB values of the N partial images divided from the first image. A second command unit configured to generate and transmit the screen adjustment value to the display device and simultaneously transmit a second control signal to the display device to command the screen adjustment of the display device according to the screen adjustment value;
An illuminance measuring unit that measures an illuminance value around the electronic terminal device through an illuminance sensor provided in the electronic terminal device;
A brightness adjustment value extracting unit for extracting a recorded first brightness adjustment value corresponding to a range value to which the measured illumination value belongs from the brightness adjustment table; And
When the first brightness adjustment value is extracted, the first brightness adjustment value is transmitted to the display device and a third control signal instructing to adjust the screen of the display device according to the first brightness adjustment value is transmitted to the display device. Third command unit to transmit to display
Electronic terminal device for adjusting the screen of the display device to an optimal state, including. The method of claim 1,
The electronic terminal device
An image attribute storage unit in which N predetermined image attributes and different three-dimensional reference vectors predetermined as corresponding to each of the N image attributes are stored;
For each of the N partial images, a matching information storage unit storing matching information with one image attribute previously designated as corresponding to each partial image among the N image attributes; And
For each of the N image attributes, a plurality of predetermined cosine similarity range values consisting of an upper limit value and a lower limit value, and an adjustment table recording a predetermined image attribute adjustment value corresponding to each of the plurality of cosine similarity range values The adjustment table storage unit in which this is stored
Including more,
The second command unit
When the first image is obtained, the first image is divided into the N partial images, and RGB for a plurality of pixels constituting each of the N partial images divided from the first image A pixel value extractor for extracting a value;
For each of the N partial images, after calculating the average of the red color values, the average of the green color values, and the average of the blue color values of a plurality of pixels constituting each partial image, the average of the calculated red color values , A vector generator for generating a partial image vector for each of the N partial images by generating a three-dimensional partial image vector having the average of the green color values and the average of the blue color values as components;
When a partial image vector for each of the N partial images is generated, an image attribute matched to each of the N partial images is checked with reference to the matching information storage unit, and the N number of images are obtained by referring to the image attribute storage unit. After checking the reference vector corresponding to the image attributes, for each of the N image attributes, by calculating the cosine similarity between the partial image vector for the partial image matched with each image attribute and the reference vector according to each image attribute, A cosine similarity calculator for generating a cosine similarity for each of the N image attributes;
When the cosine similarity for each of the N image attributes is generated, for each of the N image attributes, the cosine similarity for each image attribute is recorded from an adjustment table corresponding to each image attribute in correspondence with a range value to which each image attribute belongs. An image attribute adjustment value extracting unit for extracting an image attribute adjustment value for each of the N image attributes by extracting an existing image attribute adjustment value; And
When an image attribute adjustment value for each of the N image attributes is extracted, a screen adjustment value determination unit that determines an image attribute adjustment value for each of the N image attributes as the screen adjustment value
Electronic terminal device for adjusting the screen of the display device to an optimal state, including. The method of claim 1,
The first image acquisition unit
After the reference image and the first control signal are transmitted to the display device and the reference image is displayed on the screen of the display device, the electronic terminal generates a guide area having a preset size for guiding photographing of the reference image. At the same time as displaying on the screen of the device, a shooting guide message that allows the reference image displayed on the screen of the display device to be captured by being included in the guide area is displayed on the screen of the electronic terminal device, and through the camera When an image including the reference image is obtained as the reference image displayed on the screen of the display device is included in the guide area and is photographed, only the area corresponding to the guide area is cut out from the obtained image and the first An electronic terminal device that enables a screen of a display device that acquires an image to be adjusted to an optimal state. The method of claim 1,
The display device
When the screen adjustment value and the second control signal are received from the electronic terminal device, the screen of the display device that adjusts the screen of the display device according to the screen adjustment value based on the second control signal is brought to an optimal state. Electronic terminal device to be adjustable. delete In the method of operating an electronic terminal device for adjusting a screen of a display device to an optimal state,
Storing and maintaining a brightness adjustment table in which a plurality of different predetermined illuminance range values consisting of an upper limit value and a lower limit value and a predetermined brightness adjustment value corresponding to each of the plurality of illuminance range values are recorded;
When an adjustment command for the screen of the display device linked to the electronic terminal device is applied by a user, a reference image pre-designated to the display device-The reference image includes N (N is a natural number of 2 or more) partial images. At the same time as transmitting the combined image-and transmitting a first control signal instructing to display the reference image on the screen of the display device to the display device;
After the reference image and the first control signal are transmitted to the display apparatus and the reference image is displayed on the screen of the display apparatus, the user Obtaining a first image from the camera when the reference image displayed in is captured;
When the first image is obtained, the first image is divided into the N partial images, and a screen adjustment value for the display device is calculated based on the RGB values of the N partial images divided from the first image. Generating and transmitting the screen adjustment value to the display device and simultaneously transmitting a second control signal to the display device for instructing to adjust the screen of the display device according to the screen adjustment value;
Measuring an illuminance value around the electronic terminal device through an illuminance sensor provided in the electronic terminal device;
Extracting a first brightness adjustment value recorded in correspondence with a range value to which the measured illuminance value belongs from the brightness adjustment table; And
When the first brightness adjustment value is extracted, the first brightness adjustment value is transmitted to the display device and a third control signal instructing to adjust the screen of the display device according to the first brightness adjustment value is transmitted to the display device. Steps to transfer to the display device
Operating method of an electronic terminal device to adjust the screen of the display device to an optimal state, including. The method of claim 6,
The method of operating the electronic terminal device
Maintaining an image attribute storage unit in which a reference vector of different three dimensions, which is predetermined to correspond to each of the N image attributes and the N image attributes, is stored;
For each of the N partial images, maintaining a matching information storage unit storing matching information with one of the image attributes previously designated as corresponding to each partial image among the N image attributes; And
For each of the N image attributes, a plurality of predetermined cosine similarity range values consisting of an upper limit value and a lower limit value, and an adjustment table recording a predetermined image attribute adjustment value corresponding to each of the plurality of cosine similarity range values Steps to keep the adjustment table storage in which it is stored
Including more,
Transmitting the second control signal to the display device comprises:
When the first image is obtained, the first image is divided into the N partial images, and RGB for a plurality of pixels constituting each of the N partial images divided from the first image Extracting a value;
For each of the N partial images, after calculating the average of the red color values, the average of the green color values, and the average of the blue color values of a plurality of pixels constituting each partial image, the average of the calculated red color values , Generating a partial image vector for each of the N partial images by generating a three-dimensional partial image vector using the average of the green color values and the average of the blue color values as components;
When a partial image vector for each of the N partial images is generated, an image attribute matched to each of the N partial images is checked with reference to the matching information storage unit, and the N number of images are obtained by referring to the image attribute storage unit. After checking the reference vector corresponding to the image attributes, for each of the N image attributes, by calculating the cosine similarity between the partial image vector for the partial image matched with each image attribute and the reference vector according to each image attribute, Generating a cosine similarity for each of the N image attributes;
When the cosine similarity for each of the N image attributes is generated, for each of the N image attributes, the cosine similarity for each image attribute is recorded from an adjustment table corresponding to each image attribute in correspondence with a range value to which each image attribute belongs. Extracting an image attribute adjustment value for each of the N image attributes by extracting an existing image attribute adjustment value; And
When an image attribute adjustment value for each of the N image attributes is extracted, determining an image attribute adjustment value for each of the N image attributes as the screen adjustment value
Operating method of an electronic terminal device to adjust the screen of the display device to an optimal state, including. The method of claim 6,
Acquiring the first image from the camera
After the reference image and the first control signal are transmitted to the display device and the reference image is displayed on the screen of the display device, the electronic terminal generates a guide area having a preset size for guiding photographing of the reference image. At the same time as displaying on the screen of the device, a shooting guide message that allows the reference image displayed on the screen of the display device to be captured by being included in the guide area is displayed on the screen of the electronic terminal device, and through the camera When an image including the reference image is obtained as the reference image displayed on the screen of the display device is included in the guide area and is photographed, only the area corresponding to the guide area is cut out from the obtained image and the first A method of operating an electronic terminal device that enables a screen of a display device that acquires an image to be adjusted to an optimal state. The method of claim 6,
The display device
When the screen adjustment value and the second control signal are received from the electronic terminal device, the screen of the display device that adjusts the screen of the display device according to the screen adjustment value based on the second control signal is brought to an optimal state. A method of operating an electronic terminal device to be adjustable. delete A computer-readable recording medium storing a computer program for executing the method of any one of claims 6, 7, 8, or 9 through combination with a computer. A computer program stored in a storage medium for executing the method of claim 6, 7, 8, or 9 through a combination with a computer.

Images