KR20200056373A - Display apparatus and control method thereof - Google Patents

Abstract

Disclosed is a display device capable of effectively displaying information on a transparent screen. According to one embodiment of the present disclosure, the display device comprises: a projection unit; a sensing unit; and a control unit controlling the projection unit to project information on a transparent screen, sensing location information and color information of an object located in one direction based on the transparent screen through the sensing unit, determining a transmission area of the transparent screen through which the object is projected and viewed based on the location information of the sensed object, and controlling the projection unit to change color of the projected information in an overlapped area into color different from color of the sensed object and project the projected information if the area where the information is projected overlaps the projection area.

Description

Display device and control method thereof {DISPLAY APPARATUS AND CONTROL METHOD THEREOF}

The present invention relates to a display device and a control method thereof, and more particularly, to a display device for displaying information and a control method thereof.

With the development of electronic technology, various types of display devices are used in various fields. In particular, in recent years, research discussions on next-generation display devices such as transparent display devices have been accelerated.

A transparent display device means a device having a transparent property and the background behind the device is reflected. Conventionally, a display panel was manufactured using an opaque semiconductor compound such as silicon (Si) or gallium arsenide (GaAs). However, as a variety of applications that cannot be handled by existing display panels have been pioneered, new types of electronic devices have been developed. Efforts have been made. One of the things developed under these efforts is a transparent display device.

The transparent display device is implemented in a form including a transparent oxide semiconductor film, and has transparent properties. When a transparent display device is used, the user can view necessary background and view necessary information through the transparent display device screen while looking at the rear background located behind the device. Therefore, the spatial and temporal constraints of the existing display devices can be eliminated.

The transparent display device can be conveniently used in various environments for various purposes. For example, when a store's show window is implemented as a transparent display device, an advertisement phrase may be displayed on the show window when the user passes, so that the user is interested. In addition, when a veranda window is implemented as a transparent display device in a general home, a user can view various multimedia contents through a large veranda window, thereby increasing user satisfaction.

As such, the transparent display device has many advantages over the conventional display device due to its transparent property, but also has a problem caused by the transparent property. For example, there may be a problem that the information on the screen is not easily visible due to the transparent nature.

Accordingly, a need has emerged for a technology that can more effectively use a transparent display device in various ways.

The present invention is in accordance with the above-mentioned needs, and an object of the present invention is to provide a display device and a control method thereof that can effectively display information on a transparent screen based on background information on the back side.

A display device according to an exemplary embodiment of the present disclosure controls a projection unit to project information on a projection unit, a sensing unit, and a transparent screen, and position information and color information of an object located in one direction with respect to the transparent screen through the sensing unit , And based on the detected location information of the object, determines the transmission area of the transparent screen through which the object is visible, and when the area where the information is projected in the transmission area overlaps, the color of the information projected in the overlapping area It includes a control unit for controlling the projection unit to project by changing the color of the detected object to a different color.

Here, the sensing unit includes an illuminance sensor that detects illuminance in one direction, and the control unit is based on the detected illuminance, among luminance values and color values of pixel regions corresponding to information projected on overlapping regions of the transparent screen. The projection unit may be controlled to project by changing at least one.

On the other hand, the sensing unit includes an imaging sensor that captures an object located in one direction, and the control unit controls the information projected on the overlapping area of the transparent screen based on the color information of the object included in the image captured by the imaging sensor. The projection unit may be controlled to project by changing at least one of a luminance value and a color value of a corresponding pixel area.

On the other hand, the sensing unit includes a first sensing unit that detects the position of an object located in one direction and a second sensing unit that detects a user's position in the other direction different from the one based on the transparent screen, and the control unit detects Based on the location of the object and the location of the user, a transmission area in which the object is visible on the transparent screen may be determined at the user's location.

Here, when the position of the sensed object is moved, the control unit may determine a transmission area where the object moved on the transparent screen is visible through the user's position.

On the other hand, the sensing unit includes an imaging sensor that captures an object located in one direction, and the control unit changes the position of the information projected on the transparent screen based on the color information of the object included in the image captured by the imaging sensor and projects it. So that the projection can be controlled.

Meanwhile, one direction may be the rear side of the transparent screen based on the user.

Meanwhile, the display device may further include a transparent screen.

In a control method of a display device having a projection unit according to an embodiment of the present disclosure, the control method includes projecting information on a transparent screen, and displaying location information and color information of an object located in one direction based on the transparent screen. Sensing, determining a transmission area of the transparent screen through which the object appears to be transmitted based on the detected position information of the object, and when the area where the information is projected in the transmission area overlaps, the information of the projected information in the overlapping area And projecting the color in a color different from the color of the detected object.

Here, the step of sensing includes detecting the illuminance for one direction, and the step of projecting in a different color is based on the sensed illuminance, when the region where information is projected in the transmissive region overlaps. At least one of a luminance value and a color value of the pixel region corresponding to the information projected on the overlapped region may be changed and projected.

Meanwhile, the step of sensing includes imaging an object located in one direction, and the step of projecting in a different color, when the area where the information is projected in the transmissive area overlaps, the color information of the object included in the captured image Based on the above, it is possible to project by changing at least one of a luminance value and a color value of the pixel area corresponding to the information projected on the overlapped area of the transparent screen.

On the other hand, the detecting step detects the position of the object located in one direction, and detects the user's position in the other direction different from the one direction based on the transparent screen, and the determining step determines the position of the detected object and the user's position. Based on the location, it is possible to determine a transmissive area in which the object is visible on the transparent screen at the user's location.

Here, in the determining step, when the position of the sensed object is moved, it is possible to determine a transmission area where the object moved on the transparent screen is visible at the user's position.

On the other hand, the step of sensing includes imaging an object located in one direction, and the step of projecting in a different color is based on the color information of the object included in the captured image, and the position of the information projected on the transparent screen is determined. You can change and project.

Meanwhile, one direction may be the rear side of the transparent screen based on the user.

As described above, according to various embodiments of the present invention, it is possible to increase the discrimination power of information displayed on a transparent screen through a display device.

1 is a view for explaining the operation of the transparent display device according to an embodiment of the present invention.
2 is a block diagram showing the configuration of a transparent display device according to an embodiment of the present invention.
3 is a view showing a detailed configuration example of a transparent display unit implemented in a transparent OLED type.
4 is a block diagram illustrating a configuration of a transparent display device according to a specific embodiment of the present invention.
5 is a view for explaining a method of changing and displaying a display position of information based on the detected background information according to an embodiment of the present invention.
6 is a view for explaining arrangement positions of the first imaging unit 121-1 and the second imaging unit 122-1.
7 to 11 are views illustrating a display method according to various embodiments of the present invention.
12 is a flowchart illustrating a method of controlling a transparent display device according to an embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a view for explaining the operation of the transparent display device according to an embodiment of the present invention. According to FIG. 1, in the transparent display device 100, the display screen is implemented transparently so that the rear background is transparent. Accordingly, when the displayed information overlaps with the rear background, a problem may occur in that the information is not easily seen and the discrimination power is deteriorated.

For example, as shown in FIG. 1, the transparent display device 100 may display the information 30 in a state where the object 20 located at the rear is transparently reflected. In this case, the discrimination power of the displayed information 30 may be reduced due to the object 20 located at the rear.

Accordingly, according to an embodiment of the present invention, the display state of the displayed information is changed and displayed based on the rear background of the transparent display device 100. For example, display properties or display positions such as color, luminance, size, and shape of information to be displayed on the transparent display device 100 may be changed and displayed.

Specifically, the transparent display device 100 detects the location of the user 10 and the location of the object 20, respectively, and when an object 20 is viewed from the user's location, the transparent display unit shows an area through which the object is visible. Estimate. Hereinafter, for convenience of description, an area through which an object is visible is referred to as a transmission area. When information is displayed in the transmissive area, the discrimination power of the information decreases due to the presence of an object behind it. Therefore, the transmissive region may alternatively be referred to as a discriminating region.

In this case, the transparent display device 100 may divide the entire area of the transparent display unit into a virtual divided area of a predetermined size in order to estimate the transmission area. The transparent display device 100 may estimate a region corresponding to the position of the object 20 among the divided virtual divided regions as a transparent region. In this case, the transparent display device 100 includes a mapping area 10 ′ mapping the location and shape of the user 10 to the display surface and a mapping area 20 mapping the location and shape of the object 20 to the display surface. Considering the correlation between '), the transmission region may be estimated. For example, an area 10'∩20 'where two mapping areas overlap each other may be estimated as a transmission area.

The transparent display device 100 may map a virtual partition area to a matrix table in order to accurately calculate each mapping area. In this case, it is determined whether or not the overlap occurs in consideration of a correlation between cells mapped to a transparent area of an object and cells mapped to a region in which information is to be displayed in the matrix table.

When it is determined that the two areas overlap with each other, the transparent display device 100 may adjust the display state of the information. That is, when the transmissive area is estimated, the transparent display device 100 may display the information 30 displayed in the transmissive area in a state in which there is no fear that the discrimination power is deteriorated. Specifically, the luminance value and color value of the pixel area corresponding to the information 30 may be adjusted. For example, when the information 30 is implemented as text, various display attributes such as size, color, luminance, thickness, and font can be adjusted. Alternatively, the display position of the information 30 may be adjusted. In this case, the direction and distance to move the information 30 may be determined by considering the degree of overlap between the transmission area and the display position of the information 30, the position of the overlapping area, and the position of the other area where the discrimination power does not deteriorate. . In this case, the transparent display device 100 compares the properties of the object 20 with the display properties of the information 30. For example, the area of the overlapping area, the color of the overlapping area, the distance between the object and the transparent display device 100, and the distance between the user and the transparent display device 100 are determined, and the display property of information is changed according to the determination result. Can be.

Specifically, if the object color of the overlapping area among the transparent areas of the object is similar to the display color of the information, the display color of the information is changed to another color and displayed.

Alternatively, if it is difficult to identify the text information due to the background information, it is also possible to display it in the form of an image that provides the same information as the text information.

Alternatively, if the user is far away from the transparent display device 100, the size of the display area of the information is enlarged and displayed, and if it is close, the display area of the information is displayed small. When the overlapping area is wide, the moving distance of the display position of the information becomes long, so the layout of the information may be changed in a form suitable for the extended direction. Alternatively, when the object is far away, an enlarged image of the object may be provided as information.

2 is a block diagram showing the configuration of a transparent display device according to an embodiment of the present invention. According to FIG. 2, the transparent display device 100 includes a transparent display unit 110, a sensing unit 120, and a control unit 130.

The transparent display unit 110 displays information. Here, the information may be an image, text, content reproduction screen, application execution screen, web browser screen, various graphic objects, and the like.

The transparent display 110 may be implemented in various forms, such as a transparent liquid crystal display (LCD) type, a transparent organic light-emitting diode (OLED) type, a transparent thin-film electroluminescent panel (TFEL) type, or a projection type. Can be. Hereinafter, various embodiments of the structure of the transparent display unit 110 will be described.

<Various embodiments of the structure of the transparent display>

The transparent LCD type means a transparent display device implemented by removing a backlight unit from a currently used LCD device and using a pair of polarizers, optical films, transparent thin film transistors, and transparent electrodes. In a transparent LCD device, the transmittance is reduced by a polarizing plate or an optical film, and the ambient light is used instead of the backlight unit, so the light efficiency is reduced, but there is an advantage that a large area transparent display can be realized. The transparent TFEL type means a device using an AC type inorganic thin film EL display (AC-TFEL) composed of a transparent electrode, an inorganic phosphor, and an insulating film. AC-TFEL is a display that excites the phosphor and emits light as the accelerated electrons pass inside the inorganic phosphor. When the transparent display unit 130 is implemented in the form of a transparent TFEL, the control unit 130 may determine an information display position by adjusting the electron to be projected to an appropriate position. Since the inorganic phosphor and the insulating film have transparent properties, a very transparent display can be realized.

In addition, the transparent OLED type means a transparent display device using an OLED capable of self-emission. Since the organic light emitting layer is transparent, if both electrodes are used as transparent electrodes, it can be realized as a transparent display device. OLEDs emit light by injecting electrons and holes from both sides of the organic light emitting layer and combining them in the organic light emitting layer. The transparent OLED device displays information by injecting electrons and holes into a desired position using this principle.

3 is a view showing a detailed configuration example of a transparent display unit implemented in a transparent OLED type. For convenience of description, reference numeral 140-1 is given to a transparent display unit implemented in a transparent organic light-emitting diodes (OLED) type.

According to FIG. 3, the transparent display unit 110-1 includes a transparent substrate 111-1, a transparent transistor layer 112-2, a first transparent electrode 113-1, and a transparent organic light-emitting layer. Emitting layer) (114-1), the second transparent electrode 115-1, and includes a connecting electrode (116-1).

The transparent substrate 111-1 may use glass or a polymer material such as plastic having transparent properties. The material of the transparent substrate 111-1 may be determined according to the use environment to which the transparent display device 100 is applied. For example, the polymer material has the advantage of being lightweight and flexible, and thus can be used in a portable display device, and glass can be used in a shop window or a general window.

The transparent transistor layer 112-2 means a layer including a transistor manufactured by replacing the opaque silicon of the existing thin film transistor with a transparent material such as transparent zinc oxide or titanium oxide. A source, a gate, a drain, and various dielectric films 117-1 and 118-1 are provided in the transparent transistor layer 112-2, and a connection electrode electrically connecting the drain and the first transparent electrode 113-1 ( 116-1) may also be provided. In FIG. 3, only one transparent transistor including source, gate, and drain is illustrated in the transparent transistor layer 112-1, but in practice, a plurality of transparent transistors evenly distributed over the entire area of the display surface is provided. The controller 130 may apply a control signal to the gates of the respective transistors in the transparent transistor layer 112-2 to drive the transparent transistor to display information.

The first transparent electrode 113-1 and the second transparent electrode 115-1 are disposed in opposite directions based on the transparent organic light emitting layer 114-1. The first transparent electrode, the transparent organic light emitting layer, and the second transparent electrodes 113-1, 114-1, and 115-1 form organic light-emitting diodes.

Transparent organic light emitting diodes are largely classified into a passive matrix OLED and an active matrix OLED according to a driving method. PMOLED has a structure in which portions where the first and second transparent electrodes 113-1 and 115-1 cross each other form pixels. On the other hand, AMOLED has a structure in which a thin film transistor (TFT) driving each pixel is provided. 3 shows an active type.

The first transparent electrode 113-1 and the second transparent electrode 115-1 each include a plurality of line electrodes, and alignment directions of the line electrodes are formed perpendicular to each other. For example, if the line electrodes of the first transparent electrode 113-1 are arranged in the horizontal direction, the line electrodes of the second transparent electrode 115-1 are arranged in the vertical direction. Accordingly, a plurality of crossing regions are formed between the first transparent electrode 113-1 and the second transparent electrode 115-1. A transparent transistor is connected to each crossing region as shown in FIG. 3.

The control unit 130 uses a transparent transistor to form a potential difference for each crossing region. Electrons and holes are introduced into the transparent organic light emitting layer 114-1 from each electrode in the crossing region where the potential difference is formed, and light is emitted while bonding. On the other hand, the crossing area where no potential difference is formed does not emit light, and accordingly, the rear background is transparently reflected.

Indium tin oxide (ITO) may be used as the first and second transparent electrodes 113-1 and 115-1. Alternatively, new materials such as graphene may be used. Graphene refers to a material having transparent properties with a carbon atom connected to each other to form a honeycomb plane. In addition, the transparent organic light emitting layer 114-1 may also be implemented with various materials.

Meanwhile, as described above, the transparent display unit 110 may be implemented as a projection type in addition to a transparent liquid crystal display (LCD) type, a transparent thin-film electroluminescent panel (TFEL) type, and a transparent OLED type. The projection type means a method of projecting and displaying an image on a transparent screen such as a HUD (Head Up Display).

Referring back to FIG. 2, the sensing unit 120 senses background information on at least one of the first direction and the second direction based on the transparent display unit 110. Here, the first direction and the second direction may be defined in a direction opposite to the direction in which the user is located based on the transparent display unit 110. Also, the background information may include illumination information for the corresponding direction, background information for the corresponding direction, and the like. In this case, the background information may include information about an object located in a corresponding direction. Accordingly, the sensing unit 120 may be implemented as an illuminance sensor, an imaging sensor, or the like.

The controller 130 may control to change the display state of the information displayed on the transparent display unit 110 based on the background information sensed by the sensing unit 120.

Specifically, the control unit 130 may adjust at least one of a luminance value and a color value of a pixel area corresponding to information displayed on the transparent display unit 110 based on the illuminance information sensed by the detection unit 120. have. For example, when the illuminance of both the front and rear of the two display devices 100 is high and the identification power of the information on which the information is displayed is weak, the control unit 130 reduces and displays the luminance of the pixel area corresponding to the information. The displayed information can be clearly recognized.

In addition, the controller 130 may change the display position of the information displayed on the transparent display 110 based on the background information sensed by the detector 120. For example, when displaying information in a state in which an object located behind the transparent display device 100 is transparently reflected, the display state of the information is displayed based on the location where the object is visible to the user and the shape and color of the object. You can change it and display it. Here, the object exists with a specific shape, and may be various objects such as merchandise, animals, plants, furniture, walls, wallpaper, and the like, which can be sold.

<Various embodiments for object shape and color detection>

For example, the sensing unit 120 photographs a rear background image using an imaging device such as a camera, analyzes the captured rear background image, and attributes of an object included in the rear background image, for example, the color of the object Or, it can recognize text written on an object, or an image drawn or attached to an object. In the case of the color of the object, edge detection may be performed on an image captured through the camera, and color inside the detected edge may be detected. In the case of text or images, it can be detected by using a text reading or image reading algorithm from images captured by the camera. When such a color, text, image, or the like is detected, the transparent display device 100 may provide information on the object to the controller 130.

Also, the sensing unit 120 may detect the average color of the rear background through the captured image. For example, the sensing unit 120 may detect an average value of various colors when the backgrounds transparently reflected on the transparent display unit 110 have various colors.

Based on the shape and color of the back background and the shape and color of the object 20 included in the back background, respectively, the control unit 130 detects information displayed on the transparent display unit 110. Color, brightness, size, etc. can be adjusted.

<Various embodiments of object and user location detection methods>

On the other hand, the sensing unit 120 may detect the position of the object included in the rear background and the position of the user located in front to estimate the transmission area described above.

For example, the sensing unit 120 may detect the position of the object included in the rear background through the captured image.

As another example, the sensor 120 may detect the intensity of light incident from the rear using an optical sensor, and analyze the intensity distribution of the light to detect the position of the object.

As another example, a user or an administrator may directly input the location of an object to determine the location of the object. In this case, the sensing unit 120 may be implemented by various input means such as a touch screen, keyboard, mouse, joystick, touch pad, buttons, and the like. The user or the administrator can directly determine the rear object position through the input means.

In addition, the sensing unit 120 may detect a user's location located in front of the transparent display device 100. In this case, as described above, the user's position can be detected using an imaging element or an optical sensor.

As described above, the method in which the sensing unit 120 detects the position of the object and the position of the user included in the rear background may be implemented differently according to various embodiments.

When the user 10 looks at the transparent display 110 based on the location of the object 20 and the location of the user 10 included in the rear background, respectively detected by the detection unit 120 The area in which the object 20 is visible on the transparent display unit 110, that is, the transmission area is estimated.

Then, the control unit 130 may determine whether the transparent display unit 110 displays the information 30 included in the transparent area, and may determine to move the display position of the checked information to another area.

<Various embodiments for illuminance detection>

On the other hand, the sensing unit 120 may detect the illuminance of at least one of the front where the user is located and the rear where the transparently reflected rear background is present. For example, the CDS illuminance sensor may be installed on both sides of the transparent display device 100 to detect illuminance in both directions. In this case, the illuminance sensor may be installed in at least one predetermined area on both sides of the transparent display device 100, but it may also be installed in each pixel unit of both sides. For example, it is also possible to measure the illuminance state of each region or each pixel by installing an illuminance sensor in an enlarged form so that the CMOS sensor corresponds to the size of the transparent display 110.

4 is a block diagram illustrating a configuration of a transparent display device according to a specific embodiment of the present invention. According to FIG. 4, the transparent display device 100 includes a transparent display unit 110, a first sensing unit 121, a second sensing unit 122, a third sensing unit 123, a control unit 130, and a storage unit 140 and an input unit 150. Among components shown in FIG. 4, detailed descriptions of components overlapping with those shown in FIG. 2 will be omitted.

The first sensing unit 121 detects the position of the object existing in the first direction of the transparent display device 100. The second sensing unit 122 detects the location of the user in the second direction of the transparent display device 100. Also, the third sensing unit 123 detects the illuminance of the transparent display device 100 in a first direction or a second direction. The controller 130 may display information on the transparent display unit 110 in consideration of the detected object location and the user's location, or display information on the transparent display unit 110 in consideration of the sensed illumination information. have.

The first sensing unit 121 and the second sensing unit 122 may sense the location of the object and the user in various ways. Hereinafter, various examples of the detection methods of the first detection unit 121 and the second detection unit 122 will be described.

The first sensing unit 121 detects the location of the object. The first sensing unit 120 includes a first imaging unit 121-1 and a first detection unit 121-2.

The first imaging unit 121-1 performs imaging in the first direction of the transparent display device 100. Accordingly, at least one object including the object in the first direction can be captured. For convenience of description, in this specification, an image captured by the first imaging unit 121-1 is referred to as a rear background image.

The first detection unit 121-2 detects the edge of each object by using each image pixel information of the rear background image. Edge detection can be done according to various detection algorithms.

For example, the first detection unit 121-2 divides the rear background image into m * n pixel units and divides them into a plurality of blocks. The first detection unit 121-2 detects a representative value of each block. The representative value may be the average pixel value of all pixels in the block, the largest pixel value among the pixel values of each pixel in the block, or the total pixel value of all pixels. The first detection unit 121-2 compares each of the detected representative values, and checks whether there are consecutively arranged blocks having similar representative values. Blocks included in the region in which the same object is imaged have a range in which representative values are similar to each other.

When consecutive similar blocks are identified, the first detection unit 121-2 detects a block corresponding to a boundary point between the identified similar blocks and blocks having a different representative value as an edge portion.

In addition, the first detection unit 121-2 identifies an object among the objects captured by the first imaging unit 121-1 using the detected edge, the location of the identified object, and an identification area on the captured image Detects. For example, when the detected edge portion forms a closed curve, the first detection unit 121-2 detects the position of blocks corresponding to the closed curve among the entire blocks of the background image as an object position. Then, the rear background image is compared with the entire area of the transparent display unit 110 to detect an identification area in which the object is identified among the entire area of the transparent display unit 110.

The second sensing unit 122 includes a second imaging unit 122-1 and a second detection unit 122-2. The second imaging unit 122-1 performs imaging in the second direction based on the transparent display device 100. Accordingly, a front background image is acquired.

The second detection unit 122-2 analyzes the front background image captured by the second imaging unit 122-1 to detect the user's location. The user's location detection method may be implemented in the same manner as the object location detection method of the first detection unit 121-2 described above.

In addition, it is also possible to pre-register the characteristic information for the user, or to receive it through a user terminal device or tag including a short-range wireless communication module provided by the user, and to accurately detect the user's location according to the characteristic information. Of course.

The third sensing unit 123 detects illuminance in at least one of the first direction and the second direction. Here, the third detection unit 123 may be implemented by an illuminance sensor, an IR sensor, a CMOS sensor, and the like. In this case, the illuminance sensor may use various photocells, but it is also possible to use a photoelectric tube for measurement of very low illuminance.

The controller 130 determines the transmission area based on the position of the object and the position of the user sensed by the first and second sensing units 121 and 122, respectively.

The control unit 130 divides the entire area of the transparent display unit 110 into a plurality, and determines an area in which an object is seen at a user's location among the divided areas as a transmission area. The controller 130 may change the display property of the information displayed in the transparent area by comparing the information displayed in the transparent area with the property of the image captured by the first imaging unit 121-1. For example, the luminance, color, etc. of the pixel area in which the corresponding information is displayed may be changed, or the size, display position, etc. of the corresponding information may be changed.

In addition, the controller 130 may change the luminance, color, etc. of the pixel area corresponding to the entire area of the transparent display unit 110 or the area where the information is displayed based on the illuminance state detected by the third sensing unit 123. . In this case, the control unit 130 may adjust the brightness differently according to the characteristics of the display elements (eg, LCD, OLED, etc.) constituting the display unit 110.

On the other hand, in the above-described embodiment, although the background information detected by the first sensing unit 121 to the third sensing unit 123 is described as being used separately, this is for convenience of description, and is detected by each sensing unit. It goes without saying that the background information can be used integrally.

Meanwhile, the control unit 130 includes a RAM 131, a ROM 132, a main CPU 133, a graphic processing unit 134, first to n interfaces 135-1 to 135-n, and a bus 136. do.

The RAM 131, the ROM 132, the main CPU 133, the graphic processing unit 134, and the first to n interfaces 135-1 to 135-n may be connected to each other through the bus 136.

The first to n interfaces 135-1 to 135-n are connected to various components described above. One of the interfaces may be a network interface connected to an external device through a network.

The main CPU 133 accesses the storage 140 to boot using the O / S stored in the storage 140. In addition, various operations are performed using various programs, contents, and data stored in the storage 140.

The ROM 132 stores a set of instructions for booting the system and the like. When the turn-on command is input and power is supplied, the main CPU 133 copies the O / S stored in the storage 140 to the RAM 131 according to the command stored in the ROM 132, and executes the O / S. Boot the system. When the booting is completed, the main CPU 133 copies various application programs stored in the storage 140 to the RAM 131, and executes the application programs copied to the RAM 131 to perform various operations.

The graphic processing unit 134 generates a screen including various objects, such as icons, images, and text, by using a calculation unit (not shown) and a rendering unit (not shown). The calculation unit (not shown) calculates attribute values such as coordinate values, shapes, sizes, colors, etc. to be displayed according to the layout of the screen. The rendering unit (not shown) generates screens of various layouts including objects based on attribute values calculated by the calculation unit (not shown). The screen generated by the rendering unit (not shown) is displayed in the display area of the transparent display unit 110.

The storage unit 140 may include images captured by the first imaging unit 121-1 and the second imaging unit 122-1, information on the object location and the user's location, and various other information, and a transparent display device ( In relation to the operation of 100), various setting information set by the user, system operating software, and various application programs may be stored.

The input unit 150 is a portion for receiving various user commands related to the operation of the transparent display device 100. The input unit 150 is various from external input means such as a touch screen implemented on the transparent display unit 110, various buttons provided on the main body of the transparent display device 100, a keyboard connected to the transparent display device 100, a mouse, and the like. It may be implemented in various forms such as an input / output interface (I / O) that receives an input signal. The user can turn the information display position moving function on or off (ON / OFF) through the input unit 150 and set conditions for moving the information display position or a method of changing display properties when moving.

5 is a view for explaining a method of changing and displaying a display position of information based on the detected background information according to an embodiment of the present invention.

5A is a view for explaining a state in which the entire area of the transparent display unit 110 is divided into a plurality of blocks.

According to FIG. 5A, the entire area of the transparent display unit 110 is divided into a virtual divided area composed of a plurality of vertical lines V ₁ to V _x and a plurality of horizontal lines H ₁ to H _y . The virtual partition may be implemented in a matrix form.

In the case of requiring high resolution, each cell of the matrix may be composed of one pixel unit, but each cell may be composed of a plurality of pixel units in consideration of computational burden. More specifically, the virtual divided area may be configured by dividing the entire area of the transparent display unit 110 into 4 divisions, 6 divisions, 9 divisions, 12 divisions, and the like.

The controller 130 matches the location of the user and the location of the object to a corresponding region among the entire regions of the transparent display unit 110, respectively. In FIG. 5A, the object 20 is (V _{n + 4} , H _{m + 2} ), (V _{n + 5} , H _{m + 2} ), (V _{n + 6} , H _{m + 2} ), (V _{n + 7} , H _{m + 2} ), (V _{n + 4} , H _{m + 3} ), (V _{n + 5} , H _{m + 3} ), (V _{n + 6} , H _{m + 3} ), (V _{n + 7} , H _{m +3} ), (V _{n + 4} , H _{m + 4} ), (V _{n + 5} , H _{m + 4} ), (V _{n + 6} , H _{m + 4} ), (V _{n + 7} , H _{m + 4)} ), (V _{n + 4} , H _{m + 5} ), (V _{n + 5} , H _{m + 5} ), (V _{n + 6} , H _{m + 5} ), (V _{n + 7} , H _{m + 5} ) regions It is reflected in. Hereinafter, an area reflected by the object 20 on the transparent display unit 110 is denoted by 20 '.

On the other hand, the user's location is (V _{n + 3} , H _{m + 1} ), (V _{n + 4} , H _{m + 1} ), (V _{n + 5} , H _{m + 1} ), (V _{n + 6} , H _{m +1} ), (V _{n + 3} , H _{m + 2} ), (V _{n + 4} , H _{m + 2} ), (V _{n + 5} , H _{m + 2} ), (V _{n + 6} , H _{m + 2)} ), (V _{n + 3} , H _{m + 3} ), (V _{n + 4} , H _{m + 3} ), (V _{n + 5} , H _{m + 3} ), (V _{n + 6} , H _{m + 3} ), (V _{n + 3} , H _{m + 4} ), (V _{n + 4} , H _{m + 4} ), (V _{n + 5} , H _{m + 4} ), (V _{n + 6} , H _{m + 4} ), (V _{n + 3} , H _{m + 5} ), (V _{n + 4} , H _{m + 5} ), (V _{n + 5} , H _{m + 5} ), (V _{n + 6} , H _{m + 5} ), (V _{n + 4} , H _{m + 6} ), (V _{n + 5} , H _{m + 6} ), (V _{n + 4} , H _{m + 7} ), (V _{n + 5} , H _{m + 7} ), (V _{n + 4} , H _{m + 8} ), (V _{n + 5} , H _{m + 8} ). Hereinafter, an area reflected by the user 10 on the transparent display unit 110 is denoted by reference numeral 10 '. In addition, in FIG. 5A, the information 30 is displayed at a position partially overlapping the object matching area 20 ′ and the user matching area 10 ′.

The control unit 130 records the object location detected by the first detection unit 121 and the user location detected by the second detection unit 122 in a matrix table stored in the storage unit 140, respectively. Accordingly, the portion where the two positions overlap is determined as the transmission area.

Alternatively, the controller 130 may determine the object matching area 20 'by projecting the object on the transparent display unit 110 as it is, and determine the user matching area 10' by vertically projecting the user. In this case, an area in which an object is visible at the user's location, that is, a transmissive area, may be formed between the object matching area 20 ′ and the user matching area 10 ′. In this case, the control unit 130 may determine a transmission area according to a distance between the object and the transparent display unit 110, a distance between the user and the transparent display unit 110, and a ratio of the distances. That is, the controller 130 determines the object matching area 20 ′ as described above, considering the shape of the object and the size of the object, centering on the point where the surface of the transparent display unit 110 and the object are vertically connected. Can be. In addition, the user matching area 10 ′ may also be determined by considering the shape and size of the user, centering on the point where the surfaces of the user and the transparent display unit 110 are vertically connected. According to this, if the object and the user are positioned to be symmetric to each other vertically from the surface of the transparent display unit 110, the overlapping area between the user matching area 10 'and the object matching area 20' corresponds to the transparent area.

On the other hand, if the object and the user are positioned at an angle of 45 degrees relative to the transparent display unit 110, the center region of the area between the user matching area 10 'and the object matching area 20' is transmitted. It corresponds to the realm. As such, the transmissive area may be calculated according to the user's distance to the object and its angle. This will be described in detail later in the section.

Meanwhile, when the location change of the user or the object or the appearance of a new user or a new object is detected, the controller 130 updates the matrix table according to the detection result.

5B shows an example of a matrix table stored in the storage 140. According to FIG. 5B, the matrix table 500 may be configured in the same manner as the transparent display unit 110 of FIG. 5A divided into a plurality of regions. That is, the matrix table 500 may be formed of a plurality of vertical lines (V ₁ ~ V _x ) and a plurality of horizontal lines (H ₁ ~ H _y ), and data is stored in cells in which each vertical line and each horizontal line intersect. Can be recorded.

According to FIG. 5B, a default value is recorded in each cell in the matrix table 500, a first value that is preset in a cell corresponding to the object's location among cells, and a second value in cells that correspond to the user's location. . In FIG. 5B, the default value, the first value, and the second value are set to 0, 1, and 2, respectively, but this is only a value arbitrarily set for convenience of description and is not limited thereto.

The control unit 130 (V _{n + 4} , H _{m + 2} ), (V _{n + 5} , H _{m + 2} ), (V) in the matrix table 700 according to the result detected by the first sensing unit 121 _{n + 6} , H _{m + 2} ), (V _{n + 7} , H _{m + 2} ), (V _{n + 4} , H _{m + 3} ), (V _{n + 5} , H _{m + 3} ), (V _{n + 6} , H _{m + 3} ), (V _{n + 7} , H _{m + 3} ), (V _{n + 4} , H _{m + 4} ), (V _{n + 5} , H _{m + 4} ), (V _{n + 6} , H _{m + 4} ), (V _{n + 7} , H _{m + 4} ), (V _{n + 4} , H _{m + 5} ), (V _{n + 5} , H _{m + 5} ), (V _{n + 6} , H _{m +5} ), (V _{n + 7} , H _{m + 5} ) records 2 in the cell.

In addition, (V _{n + 3} , H _{m + 1} ), (V _{n + 4} , H _{m + 1} ), (V _{n + 5} ) in the matrix table 500 according to the result detected by the second sensing unit 122. , H _{m + 1} ), (V _{n + 6} , H _{m + 1} ), (V _{n + 3} , H _{m + 2} ), (V _{n + 4} , H _{m + 2} ), (V _{n + 5} , H _{m + 2} ), (V _{n + 6} , H _{m + 2} ), (V _{n + 3} , H _{m + 3} ), (V _{n + 4} , H _{m + 3} ), (V _{n + 5} , H _{m + 3} ), (V _{n + 6} , H _{m + 3} ), (V _{n + 3} , H _{m + 4} ), (V _{n + 4} , H _{m + 4} ), (V _{n + 5} , H _{m + 4} ) , (V _{n + 6} , H _{m + 4} ), (V _{n + 3} , H _{m + 5} ), (V _{n + 4} , H _{m + 5} ), (V _{n + 5} , H _{m + 5} ), ( V _{n + 6} , H _{m + 5} ), (V _{n + 4} , H _{m + 6} ), (V _{n + 5} , H _{m + 6} ), (V _{n + 4} , H _{m + 7} ), (V _{n +5} , H _{m + 7} ), (V _{n + 4} , H _{m + 8} ), (V _{n + 5} , H _{m + 8} ), 1 is recorded in the cell.

The controller 130 is (V _{n + 4} , H _{m + 2} ), (V _{n + 5} , H _{m + 2} ), (V _{n + 6} , H _{m + 2} ), (V) that overlap each other between the two areas. _{n + 4} , H _{m + 3} ), (V _{n + 5} , H _{m + 3} ), (V _{n + 6} , H _{m + 3} ), (V _{n + 4} , H _{m + 4} ), (V _{n + 5} , H _{m + 4} ), (V _{n + 6} , H _{m + 4} ), (V _{n + 4} , H _{m + 5} ), (V _{n + 5} , H _{m + 5} ), (V _{n + 6} , H _{m + 5} ) Record the result of adding 1 and 2 to the third cell.

However, this is only an example and is not necessarily limited thereto. That is, the cell corresponding to the overlapping region between the two regions may not record the sum of the two values, but may record the separately set third value to indicate that the corresponding cell corresponds to the overlapping region.

The control unit 130 compares the area where the information 30 is displayed on the transparent display unit 110 to the matrix table 500. Accordingly, the display position of the information 30 is shifted when three of the cells in the matrix table are recorded (corresponding to the intersection area) and the information display area partially overlaps. Depending on the embodiment, the display position may be shifted even if any one of 1, 2, and 3 of the cells in the matrix table is located in the recorded cell (corresponding to the union area).

5C is a diagram showing a state in which the information display position is changed by the control unit 130. According to FIG. 5C, information 30 displayed in an area overlapping a cell in which any one of 1, 2, or 3 is recorded in the matrix table is (V _{n + 1} , H _m-1 ), (V _n , H _m ), (V _{n + 1} , H _m ), (V _{n + 2} , H _m ), (V _n , H _{m + 1} ), (V _{n + 1} , H _{m + 1} ), (V _{n + 2)} , H _{m + 1} ), (V _n-1 , H _{m + 2} ), (V _n , H _{m + 2} ), (V _{n + 1} , H _{m + 2} ), (V _{n + 2} , H _{m + 2} ), (V _{n + 3} , H _{m + 2} ).

The control unit 130 may determine the moving distance and the moving direction of the information 30 based on the location of the overlap region between the transmission region and the information display region and the distance to other regions around which the discrimination power is not lowered. In FIG. 5C, the 3 or 4 area is shifted from the original position to the upper left, and is displayed at a certain distance from the transmissive area, but is not limited thereto. You can also mark them closely.

Alternatively, the direction of movement of the information display area may be determined in advance by the administrator or the user. For example, the information display area may be set to move in a predetermined direction such as up, down, left, right, diagonal directions based on the location of the object, the user's location, and the user's visible range.

On the other hand, in FIG. 5B, it has been described that the object location, the user location, and the information location are collectively determined using one matrix table 500. However, separate matrix tables are generated for each object, user, and information to generate the matrix tables. The transmission area can also be determined by comparison.

Alternatively, instead of providing a matrix table, the controller 130 combines the image frame capturing the user and the image frame capturing the object into different layers, and in the combined state, the overlapping area between the user area and the object area or the middle thereof One of the regions may be determined as a transmission region. In this case, it is possible to determine whether the information overlaps the transmission area by directly comparing the combined frame and the screen frame including the information.

6 is a view for explaining arrangement positions of the first imaging unit 121-1 and the second imaging unit 122-1. 6 is a view of the transparent display device 100 as viewed from the top. According to FIG. 6, the first imaging unit 121-1 is attached to an upper portion on the opposite side of the user based on the transparent display device 100 to image the object 20. On the other hand, the second imaging unit 122-1 is attached to the upper portion of the user's side based on the transparent display device 100 to image the user 10.

In FIG. 6A, each of the first imaging unit 121-1 and the second imaging unit 122-1 is provided one by one, and is installed in the upper central portion.

In FIG. 6A, when the user 10 is located at the point (a) and the user 10 and the object 20 are arranged side by side, the transparent area on the transparent display device 100 is the user 10 and the object 20 It is formed at a point T (a) where the line connecting the line and the transparent display unit 110 meet. Therefore, the transparent display device 100 displays information in another area that is not the transmissive area T (a).

On the other hand, since the transparent display device 100 shows the object 20 as it is, the image of the object 20 is displayed on the transparent display unit 110 according to the user's location even if the object 20 is in a fixed position. The location and shape are different. That is, in FIG. 6A, when the user is located at point (b), the transmission area is formed at point T (b), and when the user is located at point (c), the transmission area is formed at point T (c). In addition, when the object 20 is in a square cubic shape, when the user is located at point (a) and the eye level is the same as the object 20, it is shown as a square shape, but when it is located at point (b) or point (c) It may be seen as a rectangular shape or a rhombus shape. Therefore, it is necessary to accurately detect the identification area for the object 20 according to the user's position movement.

6B is a diagram for describing a method of calculating a transmissive area based on a user's location and an object's location. In FIG. 6B, a method of estimating the identification area of the object 20 using the trigonometric method will be described even if the user moves. In FIG. 6B, an embodiment of estimating the identification area of the object 20 by using a depth camera or a distance detection sensor, and the like, and then measuring a distance from the object, an arrangement angle, and the like, and using the measured value will be described.

According to FIG. 6B, the first imaging unit 121-1 and the second imaging unit 122-1 may be installed at the upper center as in FIG. 6A, respectively. If the installation positions of the first imaging unit 121-1 and the second imaging unit 122-1 correspond to each other, the points are regarded as the origin (0, 0) and the actual position of the object 20 is L1 (x1, y1), the actual position of the user 10 is assumed to be L2 (x2, y2).

When the first imaging unit 121-1 and the second imaging unit 122-1 are respectively implemented as depth cameras, the first detection unit 121-2 is rearward captured by the first imaging unit 121-1. The distance d1 from the object and the angle θ1 between the object direction and the surface of the transparent display device 100 may be detected using the background image. In addition, the second detection unit 122-2 uses a front background image captured by the second imaging unit 122-1 to distance d2 from the user, an angle between the user direction, and the surface of the transparent display device 100. (θ2) can be detected.

The controller 130 may calculate x1, y1, x2, and y2, respectively, using trigonometric functions. That is, d1 * sinθ1 = y1 and d1 * cosθ1 = x1. Then, d2 * sinθ2 = y2 and d2 * cosθ2 = x2. Accordingly, when x1, y1, x2, and y2 are calculated, a linear equation connecting L1 and L2 points is obtained. That is, an equation such as y = (y1-y2) * x / (x1-x2) + y1- (y1-y2) * x1 / (x1-x2) can be obtained. Accordingly, T, which is an area where an object is visible on the transparent display 110, may be calculated as ((x2y1-x1y2) / (y1-y2), 0). Accordingly, the controller 130 may move the information to be displayed at the calculated T point to the surrounding area.

In FIG. 6B, the T point is described as one coordinate value, but this is for convenience of description, and in reality, all areas within a certain distance around the T point using the size of the object and a straight line distance between the user and the object are transmitted. Can be estimated as

6A and 6B illustrate a case where one of the first and second imaging units 111 and 121 is provided, but each of the imaging units may be provided in plural. That is, when a plurality of imaging units are provided, the identification area for the object may be estimated by using the imaging unit corresponding to the moving direction of the user even if the user moves the position. Accordingly, it is possible to accurately estimate the identification area.

7 is a view for explaining a display method according to an embodiment of the present invention.

7 (a) to 7 (d) show a case where the transparent display device 100 is implemented in the form of a window (eg, a show window).

According to FIGS. 7A to 7D, the transparent display device 100 may sense illuminance in the first direction and the second direction based on the transparent display device 100. For example, the first direction and the second direction may be indoor and outdoor.

First, FIGS. 7 (a) and 7 (b) show a case where the outdoor illumination is high and the indoor illumination is low, and the transparent display device 100 is implemented as a self-luminous element such as an OLED.

As illustrated in FIG. 7A, when the user 10 looks at a window displaying information outdoors, the luminance of the OLED device in the pixel area where the information is displayed may not need to be largely adjusted because the illuminance in the room is low. have.

However, as shown in FIG. 7 (b), when the user 10 looks at a window displaying information indoors, information displayed when the luminance of the OLED element constituting the transparent display is high because the outdoor illumination is high. May not be clearly visible. In this case, the luminance of the OLED element of the corresponding part may be reduced or the color may be darkened to make the displayed information appear more vivid to the user.

7 (c) and 7 (d) show a case in which the outdoor illumination is low and the indoor illumination is high, and the transparent display device 100 is implemented as a backlight element such as an LCD.

Meanwhile, as illustrated in FIG. 7 (c), when the user 10 looks at a window displaying information outdoors, there is no need to greatly adjust the luminance of the backlight in the pixel area where the information is displayed because the indoor illumination is high. Can be.

However, as illustrated in FIG. 7 (d), when the user 10 looks at a window displaying information indoors, the information displayed on the window may not be clearly visible because the outdoor illumination is low. In this case, the luminance of the backlight in the corresponding area may be increased to make the displayed information more clearly visible to the user.

8 is a view for explaining a display method according to another embodiment of the present invention.

8 is a case where an object 810 is present behind a transparent display, the corresponding object 810 is transparently viewed, and a user views information displayed in front of the transparent display.

As shown on the left side of FIG. 8, when the color of the object 810 existing behind the transparent display and the color of the information 820 displayed on the transparent display 110 are the same or similar, the displayed information 820 May not be clearly recognized by the user.

In this case, as shown on the right side of FIG. 8, the color of the displayed information 820 ′ may be changed to a color different from that of the object 810 existing behind and displayed. For example, when the color of the object 810 located at the rear is green, the displayed information 820 'may be changed to red in a complementary relationship with green to be displayed.

9 is a view for explaining a display method according to another embodiment of the present invention.

As illustrated in FIG. 9, the position of the information 920 displayed on the transparent display 110 is changed according to the position 910 ′ of the object 910 existing behind the transparent display 110 illuminating the transparent display. Can be displayed.

10 is a view for explaining a display method according to various embodiments of the present invention.

FIG. 10 (a) shows a case in which the object 1010 existing behind the transparent display is transparent and the colors of the object 1010 are various.

In this case, the information 1021 displayed on the transparent display unit 110 may be various colors that can be identified for various colors of the object 1010, or one that can be identified most on average for various colors of the object 1010. It can be displayed in the color of. For example, the color of "C" is determined by considering the color of an object that illuminates the area where the letter "C" is displayed, and the color of "O" is considered by considering the color of an object that illuminates the area where the letter "O" is displayed. Can decide.

Alternatively, although not shown in the drawings, it is also possible to display the corresponding information 1021 by calculating the color that can be most identified on average for various colors of the object 1010.

 FIG. 10 (b) shows a case in which the object 1011 existing behind the transparent display is transparent, and the shape and color of the object 1011 are various.

In this case, the information 1021 displayed on the transparent display unit 110 may be displayed by changing its shape in a form that is easily recognized by the user. For example, if it is clearly recognized by a user that the information is displayed in the form of text according to the shape and color of the object 1011 that is clearly visible in AXN, the information is displayed in text form 1023, and the information is displayed in the form of an image If it is clearly recognized by the user, information may be displayed in the image form 1024.

10 (c) shows a case in which an object existing behind the transparent display is transparent and the object is a moving object.

When the position of the object 1012 transparently reflected on the transparent display is moved, as shown in FIG. 10 (c), the transparent display unit 110 displays the information 1023 displayed according to the moving state of the object 1012. The display state can be changed and displayed. For example, according to the color of the object 1012, the color of the information 1023 displayed on the area where the object is transparently reflected may be changed so that the displayed information 1023 is clearly recognized by the user.

11 is a view for explaining a display method according to another embodiment of the present invention.

The case where the image 1120 as shown in FIG. 11 (b) is displayed on the transparent display unit 110 reflected by the rear background 1110 as shown in FIG. 11 (a) will be described.

In this case, as illustrated in FIG. 11C, the image 1120 displayed on the transparent display 110 according to the color of the back background 1110 may not be clearly recognized by the user.

In this case, the luminance (or color) of the displayed image 1120 may be adjusted and displayed based on the color of the back background 1110.

Meanwhile, in the various embodiments described above, when the transparent display unit 110 is implemented as a transparent OLED, the transparent thin film transistors provided in each cell in the transparent display unit 110 are turned on / off according to the generated information or content reproduction screen. To express each pixel of the content playback screen. When the display attribute of information needs to be changed as described in the various embodiments described above, the controller 130 can change the attribute displayed in the corresponding pixel using a renderer, a scaler, and the like. Alternatively, when the display position of the information needs to be moved, the controller 130 may change the pixel coordinates of pixels to be displayed differently.

12 is a flowchart illustrating a method of controlling a transparent display device according to an embodiment of the present invention.

According to the control method of the transparent display device illustrated in FIG. 12, background information on a first direction is sensed based on a transparent display unit displaying information (S1210).

Subsequently, the display state of the displayed information is changed based on the detected background information and displayed (S1220).

In this case, the display state of the information may be at least one of a display attribute of the information and a display position of the image information.

 In addition, in step S1210 for detecting background information, the illuminance for the first direction or the illuminance for the first direction and the second direction may be detected. Here, the second direction based on the transparent display unit may be a direction in which the user is located, and the first direction may be an opposite direction, that is, a direction in which a background reflected transparently from the user's perspective exists. In this case, in step S1220 of displaying, the luminance value and the color value of the pixel area corresponding to the information displayed on the transparent display unit may be adjusted and displayed based on the sensed illuminance state.

In addition, step S1210 for sensing background information captures an object located in the first direction, and step S1220 for displaying corresponds to information displayed on the transparent display unit based on color information of the object included in the captured image. The display may be performed by adjusting at least one of a luminance value and a color value of a pixel area.

In addition, step S1210 for detecting background information detects the location of an object located in the first direction, detects the user's location in the second direction, and displays step S1220 for detecting the location of the detected object and the user Based on the position, the area of the object through the transparent display unit is estimated at the user's location, and at least one of the luminance and color values of the pixel area corresponding to the information displayed on the visible area is adjusted. Can be displayed.

In addition, when the position of the object sensed in step S1210 is moved, a region in which the object moved on the transparent display unit is viewed from the user's location is estimated, and a pixel region corresponding to information displayed on the visible region. At least one of a luminance value and a color value may be adjusted.

In addition, in step S1210 for detecting background information, an object positioned in the first direction is imaged and in step S1220 for displaying, information is displayed on the transparent display unit based on color information of the object included in the captured image. Can be changed to display.

As described above, according to various embodiments of the present invention, it is possible to more effectively transmit information displayed on the transparent display based on the back background information.

Meanwhile, methods according to various embodiments of the present disclosure may be programmed and stored in various storage media. Accordingly, methods according to various embodiments described above may be implemented in various types of electronic devices that execute a storage medium.

Specifically, according to an embodiment of the present invention, a configuration for detecting background information for a first direction based on a transparent display unit for displaying information and changing a display state of displayed information based on the detected background information A non-transitory computer readable medium in which a program for sequentially performing a program is stored may be provided.

A non-transitory readable medium means a medium that stores data semi-permanently and that can be read by a device, rather than a medium that stores data for a short time, such as registers, caches, and memory. Specifically, the various applications or programs described above may be stored and provided in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention pertains without departing from the gist of the present invention claimed in the claims. In addition, various modifications can be implemented by those skilled in the art, and these modifications should not be individually understood from the technical idea or prospect of the present invention.

110: transparent display unit 120: detection unit
130: control unit

Claims (10)

Transparent display;
A first sensor detecting a user's position in a first direction;
A second sensor for detecting the illuminance in the first direction and an illuminance in a second direction different from the first direction; And
The transparent display is controlled to control the transparent display to display information, and to adjust the brightness of a pixel area corresponding to the displayed information based on the sensed user's position and the sensed illuminance in the first and second directions. A display device comprising a control unit for controlling. According to claim 1,
The first sensor includes a camera,
The control unit,
Acquiring an image for the second direction through the camera, and controlling the transparent display to adjust the brightness of the pixel area corresponding to the displayed information based on the color of an object included in the acquired image, Display device. According to claim 2,
The control unit,
And controlling the transparent display to move the location of the information displayed on the transparent display based on the color of the object included in the acquired image. According to claim 1,
The control unit,
The position of the object located in the second direction is sensed through the first sensor, and an area through which the object is transmitted is identified on the transparent display based on the sensed user's position and the sensed object's position.
A display device for controlling the transparent display to adjust the brightness of a pixel area corresponding to the identified area among pixel areas in which the information is displayed on the transparent display. The method of claim 4,
The control unit,
When the position of the sensed object is changed, an area through which the object is transmitted is identified on the transparent display based on the sensed user's position and the position of the changed object,
A display device for controlling the transparent display to adjust the brightness and color of the pixel area overlapping the identified area among the pixel areas in which the information is displayed on the transparent display. In the control method of the display device,
Displaying information on a transparent display;
Sensing a position of a user in a first direction, and detecting an illuminance in the first direction and an illuminance in a second direction different from the first direction; And
And adjusting the brightness of the pixel area corresponding to the displayed information based on the sensed user's position and the sensed illuminance in the first and second directions. The method of claim 6,
The adjusting step,
A control method of acquiring an image for the second direction and adjusting the brightness of the pixel area corresponding to the displayed information based on the color of an object included in the acquired image. The method of claim 7,
The adjusting step,
And moving the location of the information displayed on the transparent display based on the color of the object included in the acquired image. The method of claim 6,
The adjusting step,
Sensing a position of an object located in the second direction, and identifying an area through which the object is transmitted on the transparent display based on the sensed user's position and the sensed object's position; And
And adjusting the brightness of the pixel area corresponding to the identified area among the pixel areas on which the information is displayed on the transparent display. The method of claim 9,
The identifying step,
When the position of the sensed object is changed, an area through which the object is transmitted is identified on the transparent display based on the sensed user's position and the position of the changed object,
The adjusting step,
A control method for adjusting brightness and color of a pixel area overlapping the identified area among pixel areas in which the information is displayed on the transparent display.

Images