KR102139751B1 - Display apparatus and control method thereof - Google Patents

Abstract

Disclosed is a display device. The display device includes: a display providing a screen for displaying content, and a sensing unit configured to detect ambient light; And a processor that divides the screen into at least one area and the remaining areas based on the properties of the content, and individually controls the output luminance of each of the divided areas when the ambient illuminance satisfies a preset condition.

Description

Display device and control method thereof {DISPLAY APPARATUS AND CONTROL METHOD THEREOF}

The present invention relates to a display device and a control method thereof, and more particularly, to a display device and a control method for supporting the ambient light detection function.

With the development of electronic technology, various types of electronic devices have been developed and distributed. Particularly, display devices such as mobile devices and TVs, which are most widely used in recent years, have rapidly developed in recent years.

With the proliferation of smartphones and tablet devices, the usage time of mobile display devices increases, and visual fatigue increases accordingly.

In particular, the use time of the mobile display device in night and/or low light environments is increasing. However, when it is used in a dark environment at night or when it is displayed in a bright screen in a power saving state (or in an OFF state), there is a problem that glare may occur or fatigue may be caused to the eyes due to a sudden change in luminance.

Accordingly, a technique capable of adjusting the brightness of the display according to the ambient illumination is used, but as shown in FIG. 19, there is a problem that there is no great effect in that the brightness of the entire display screen is uniformly controlled.

The present invention is in accordance with the above-described need, the object of the present invention, as well as the surrounding illuminance, by adjusting the output luminance value of the display in consideration of the properties of the displayed content display device and a control method that can improve visibility In the offer.

According to an embodiment for achieving the above object of the present invention, the display device, a display providing a screen for displaying content, a sensing unit for detecting the ambient light, and when the ambient light satisfies a predetermined condition, And a processor that divides the screen into at least one area and the remaining areas based on the attributes of the content, and individually controls the output luminance of each divided area.

In addition, in the processor, the luminance of the information displayed in the at least one region is different from the luminance of the information displayed in the other region, or the luminance of the information displayed in the at least one region is the luminance of the information displayed in the other region. First, the output luminance of each region can be individually controlled to reach the target luminance value.

In addition, the event in which the ambient illuminance changes rapidly by a difference greater than or equal to a predetermined threshold, an event in which the screen is switched from a dark screen to a bright screen when the ambient illuminance is less than a specific illuminance, and the state in which the ambient illuminance is less than a specific illuminance In the case of at least one of the events in which the screen is switched from the inactive state to the activated state, the screen may be divided into at least one area and the remaining areas.

In addition, the processor may divide the screen into a region of interest and a region of interest based on the content attribute, and individually control output luminance of the region of interest and the region of interest.

In addition, when the screen is switched from an inactive state to an activated state and the peripheral illuminance is less than a predetermined threshold illuminance, the processor may reach a target luminance value before an output luminance of the non-interested region if the screen is less than a predetermined threshold illuminance. The output luminance of the region of interest and the region of non-interest can be individually controlled.

In addition, when the peripheral illuminance is less than a predetermined threshold illuminance, the processor may individually control each region so that an output luminance of the non-interested region is lower than an output luminance of the region of interest to reduce glare.

In addition, the processor may individually control each region such that the output luminance of the region of interest is lower than that of the non-interested region so that the visibility of the region of interest is increased when the peripheral illumination is equal to or greater than a predetermined threshold illuminance. have.

In addition, the at least one area and the remaining areas are disposed with different display layers, and the processor has an output luminance of the first display layer including the at least one region than the output luminance of the second display layer including the remaining regions. First, the output luminance of each of the first display layer and the second display layer may be individually controlled to reach a target luminance value.

In addition, the processor may divide the gradation section of the content into a gradation section satisfying a preset condition and a remaining gradation section based on the content attribute, and individually control the output luminance of each gradation section.

In addition, when the contrast of the content is high, the processor may control the output luminance of a gradation section above a predetermined threshold to be reduced.

On the other hand, the control method of the display device according to an embodiment of the present invention, determining whether the ambient illumination satisfies a preset condition, and when the ambient illumination satisfies the preset condition, displayed on a screen And dividing the screen into at least one area and the remaining areas based on the properties of the content, and individually controlling the output luminance of each divided area.

In addition, in the step of individually controlling the output luminance, the luminance of the information displayed in the at least one region is different from the luminance of the information displayed in the other region, or the luminance of the information displayed in the at least one region is the rest. The output luminance of each region can be individually controlled to reach the target luminance value before the luminance of the information displayed in the region.

In addition, the step of individually controlling the output luminance may include an event in which the ambient illuminance changes rapidly by a difference greater than or equal to a preset threshold, an event in which the screen is switched from a dark screen to a bright screen while the ambient illuminance is equal to or less than a specific illuminance. And when at least one of the events in which the screen is switched from an inactive state to an active state in a state in which the ambient illuminance is equal to or less than a specific illuminance, the screen may be divided into at least one area and the remaining areas.

In addition, in the step of individually controlling the output luminance, the screen may be divided into a region of interest and a region of interest based on the content attribute, and the output luminance of the region of interest and the region of interest may be individually controlled. .

In addition, in the step of individually controlling the output luminance, when the screen is switched from an inactive state to an activated state and the ambient illuminance is less than a predetermined threshold illuminance, the output luminance of the region of interest is higher than that of the non-interested region. First, the output luminance of the region of interest and the region of interest may be individually controlled to reach a target luminance value.

In addition, in the step of individually controlling the output luminance, when the ambient illuminance is less than a predetermined threshold illuminance, each region is individually so that the output luminance of the non-interested region is lower than the output luminance of the region of interest to reduce glare. Can be controlled.

In addition, the step of individually controlling the output luminance may cause the output luminance of the region of interest to be lower than the output luminance of the non-interested region so that the visibility of the region of interest is increased when the peripheral luminance is equal to or greater than a predetermined threshold illuminance. Each area can be individually controlled.

In addition, the at least one area and the remaining areas are disposed with different display layers, and the controlling of the output luminance individually may include generating an output luminance of the first display layer including the at least one region including the remaining regions. The output luminance of each of the first display layer and the second display layer may be individually controlled to reach a target luminance value before the output luminance of the two display layers.

In addition, in the step of individually controlling the output luminance, the gradation section of the content is divided into a gradation section and a remaining gradation section satisfying a preset condition based on the content attribute, and the output luminance of each gradation section is individually Can be controlled.

In addition, in the step of individually controlling the output luminance, when the contrast of the content is high, the output luminance of a gradation section above a predetermined threshold value may be reduced.

According to various embodiments of the present invention, it is possible to improve a glare phenomenon and a decrease in visibility according to ambient illumination in various display devices.

1 is a view for explaining an implementation example of a display device according to an embodiment of the present invention.
2A and 2B and FIGS. 3A to 3C are diagrams for explaining the need to adjust luminance according to an embodiment of the present invention.
4A is a block diagram showing the configuration of a display device according to an embodiment of the present invention.
4B is a block diagram showing a detailed configuration of the display device shown in FIG. 4A.
5 is a view for explaining various modules stored in the storage unit.
6 is a graph for explaining a method of adjusting luminance of a display according to an embodiment of the present invention.
7A and 7B are diagrams for describing display properties of content according to various embodiments of the present disclosure.
8A and 8B are diagrams for explaining the luminous brightness according to an embodiment of the present invention.
9 is a view for explaining a luminance control method according to an embodiment of the present invention.
10A to 10C and FIG. 11 are diagrams for explaining a luminance control method according to another embodiment of the present invention.
12A and 12B are diagrams for explaining a luminance control method according to another embodiment of the present invention.
13 is a view for explaining a method for determining content attributes according to an embodiment of the present invention.
14 is a diagram for describing a luminance control method according to an implementation example of a display device.
15A and 15B, FIGS. 16A and 16B are diagrams for describing a luminance control method according to another example of implementation of a display device.
17 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.
18 is a flowchart illustrating a method of controlling a display device according to another embodiment of the present invention.
19 is a view for explaining a luminance control method according to the prior art.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a view for explaining an implementation example of a display device according to an embodiment of the present invention.

The display device 100 may be implemented as a mobile phone such as a smart phone, but is not limited thereto, such as a tablet PC, a smart watch, a PMP, a PDA, a notebook PC, a TV, a head mounted display (HMD), and a NED (Near Eye Display) If the device has a display function, such as a large format display (LFD), a digital signage (digital signage), a digital information display (DID), a video wall, or a projector display, the device is not limited and applicable.

The display device 100 includes a liquid crystal display (LCD), organic light-emitting diode (OLED), liquid crystal on silicon (LCoS), digital light processing (DLP), and quantum dot (QD) display panels to provide a display function. It may be implemented to have various types of displays such as.

Such a high-brightness display module may emit light that is unobtrusive depending on the user, and in general, in a low-light environment, people feel two kinds of glare.

As shown in FIG. 2A, when the display device 100 is used at night or in a dark environment, when the display is displayed as a bright screen in a power saving state (or an OFF state or an inactive state), as shown in FIG. 2B according to a sudden change in luminance. Likewise, it causes a dynamic glare or fatigue to the eyes.

Dynamic Glare in the luminance adaptation period refers to glare according to temporal changes, and is glare due to the difference between the stimulation of the previous light and the stimulation of the current light in the time axis. This is the same principle that a person perceives the intensity of a stimulus more when the stimulus value that a person expects is exceeded.

On the other hand, in FIG. 2B, static glare refers to glare represented by the constituent components of the content, and the maximum luminance on the display is the same, but is a glare perceived due to the content components such as contrast ratio. For example, even in the case of objects having the same gradation as shown in FIGS. 3A to 3C, it is the same as the principle that people's eyes can perceive different brightness depending on the gradation of the background area.

Accordingly, the display device 100 according to an embodiment of the present invention may provide by adjusting the brightness of the display in order to reduce various glare phenomena in a specific environment. Various embodiments will be described in detail.

4A is a block diagram showing the configuration of a display device according to an embodiment of the present invention.

According to FIG. 4A, the display device 100 includes a display 110, a sensing unit 120, and a processor 130.

The display 110 may provide various content screens that can be provided through the display device 100. Here, the content may include various content such as images, videos, text, and music, an application execution screen including various content, a GUI (Graphic User Interface) screen, and the like.

Meanwhile, the display 110 has various types of displays, such as a liquid crystal display, an organic light-emitting diode, liquid crystal on silicon (LCoS), and digital light processing (DLP), as described above. Can be implemented as In addition, the display 110 may be implemented with a transparent material and implemented with a transparent display for displaying information.

Meanwhile, the display 110 may be implemented in the form of a touch screen that forms a mutual layer structure with the touchpad, and in this case, the display 110 may be used as a user interface in addition to the output device.

The sensing unit 120 detects ambient light. To this end, the detector 120 may be implemented as an illuminance sensor. In this case, the illuminance sensor can use various photocells, but it is also possible to use a photoelectric tube for measurement of very low illuminance. For example, the CDS illuminance sensor may be provided in the display device 100 to detect illuminance in both directions. In this case, the illuminance sensor may be installed in at least one predetermined area on both sides of the display device 100, but it may also be installed in each pixel unit of both sides. For example, it is also possible to measure the illuminance state of each region or each pixel by installing an illuminance sensor in an enlarged form so that the CMOS sensor corresponds to the size of the display 110.

For example, the CDS illuminance sensor detects the light around the display device 100, and the A/D converter can convert the voltage obtained through the CDS illuminance sensor to a digital value and transmit it to the processor 130.

The processor 130 processes the overall operation of the display device 100.

The processor 130 adjusts the output luminance value of the display 110 based on the ambient illumination and content attributes sensed by the sensing unit 120. Here, adjusting the output luminance value may include controlling the luminance of a display mapped to digital grayscale values or digital grayscale values constituting each content, as well as physical luminance control in general. However, in some cases, it is also possible to consider various surrounding environment information, such as the power state of the display device 100, the user's state (sleep, reading, etc.), and place information, for example, the ambient environment other than the illuminance.

When the ambient illuminance satisfies a preset condition, the processor 130 may divide the screen into at least one region and the remaining regions based on the attribute of the content, and individually control the output luminance value of each region. For example, when the display surrounding environment rapidly changes to a specific illuminance (eg, 100 lux) or less in a bright environment, when the display is switched from a dark screen to a bright screen under a certain illuminance, the ambient illuminance This may be the case when the screen is switched from an inactive state to an activated state in the following state. Here, the output luminance value of each region may include at least one of a maximum brightness value, a maximum color value, and an average brightness value of the content.

Specifically, the processor 130 may individually control the output luminance of each region such that the luminance of information displayed in at least one region is different from the luminance of information displayed in the remaining regions. Alternatively, the processor 130 may individually control the output luminance of each region such that the luminance of the information displayed in at least one region reaches the target luminance value before the luminance of the information displayed in the remaining regions. Here, the target luminance value of each region may be the same or different. Alternatively, the processor 130 may apply differently the shape of the gamma curve applied to at least one region and the shape of the gamma curve provided to the remaining regions. Here, it means a table showing the relationship between the image gradation and display luminance. For example, if a gamma curve of the log type is applied to the region of interest, and an gamma curve of the exp function type is applied to the region of non-interest, the region of interest appears first, and then the region of interest appears slowly. Lose.

According to an embodiment of the present disclosure, the processor 130 may divide the screen into a region of interest and a region of interest based on the content attribute, and individually control the output luminance values of the region of interest and the region of interest.

Specifically, the processor 130 may include various elements constituting content, for example, color information of at least one of images and text, brightness information of at least one of images and text, and objects of at least one of images and text. The region of interest and the region of non-interest can be distinguished based on various content attributes such as placement status and time information on which the content is displayed. Also, the brightness information of the content may include at least one of luminance of at least one object, an area of the object, and a luminance difference between the object and an adjacent object included in a screen displaying the content. In this case, at least one object may be an object having a maximum luminance value among objects included in the screen, but is not limited thereto. For example, not only the object having the maximum luminance value among the objects included in the screen, but also the object having the next highest luminance value may be a criterion for determining the display attribute of the content.

According to another embodiment, the processor 130 classifies a screen of a region of interest and a region of interest based on a priority defined by a user or a manufacturer, and separately controls an output luminance value of the region of interest and the region of interest. Can. For example, if a priority is preset by a user or a producer by information type (eg, clock information, date information, notification information, etc.), a user's interest area and a region of non-interest based on the priority You can also distinguish

Meanwhile, when the screen is activated in an inactive state and the ambient illuminance is less than a predetermined threshold illuminance, the processor 130 outputs the region of interest and the region of interest such that the luminance of the region of interest reaches the target luminance value before the luminance of the region of interest. Luminance values can be individually controlled.

According to another embodiment, when the screen is activated in an inactive state and the ambient illumination is less than a predetermined threshold illumination, the processor 130 may adjust the output luminance of the non-interested region to be lower than the output luminance of the region of interest to reduce glare. The output luminance value of the region can be individually controlled. Here, the inactive state may be a state in which the screen is turned off, such as a screen off state or a standby state.

According to another embodiment, when the screen is activated in an inactive state and the ambient illumination is less than a predetermined threshold illuminance, the processor 130 may allow the luminance of the region of interest to reach the target luminance value before the luminance of the region of interest, The output luminance of the region of interest and the region of interest may be individually controlled such that the target luminance of the region is higher than the target luminance of the region of interest.

According to another embodiment, even if there is no event activated in the inactive state, the processor 130 has a lower output luminance of the region of interest than the output luminance of the region of interest to reduce glare when the peripheral illumination is less than a preset threshold illumination. The output luminance value of each region can be individually controlled.

In addition, when the peripheral illuminance is equal to or greater than a predetermined threshold illuminance, the processor 130 may individually control each region so that the output luminance of the region of interest is lower than that of the non-interested region so that visibility to the region of interest is increased.

However, it is needless to say that the output luminance values may be individually controlled according to respective priorities for a plurality of information in the region of interest or the region of interest.

On the other hand, when the at least one area and the remaining areas described above include information on which different display layers are arranged, the processor 130 outputs each of the first display layer including the at least one area and the second display layer including the remaining area. Luminance can be controlled individually.

Specifically, the processor 130 may individually control the output luminance of each display layer such that the luminance of the first display layer including at least one region is different from the luminance of the second display layer including the remaining regions. Alternatively, the processor 130 may individually control the output luminance of each region such that the luminance of the first display layer including at least one region reaches the target luminance value before the luminance of the second display layer including the remaining regions. Here, the target luminance value of each display layer may be the same or different. Alternatively, the processor 130 may apply differently the shape of the gamma curve applied to the first display layer and the shape of the gamma curve provided to the second display layer.

In this case, the processor 130 may determine at least one of an initial luminance, a target luminance, and a time to reach the target luminance of each layer based on the priority of each display layer that is predetermined or determined in real time.

However, when the at least one area and the remaining areas described above are different pixel areas in the same display layer, the processor 130 may individually control the output luminance of the corresponding pixel area. For example, it may be a case where the display 110 is embodied as a display panel that displays an input image by emitting a plurality of pixels in units of pixels. Here, the plurality of pixels may be embodied as a self-luminous device that emits light itself, such as an organic light emitting diode (OLED), a plasma display panel (PDP), and a light-emitting diode (LED), but is not limited thereto.

In addition, the processor 130 may divide the gradation section of the content into a gradation section satisfying a preset condition and a remaining gradation section based on the content attribute, and individually control the output luminance of each gradation section.

Specifically, the processor 130 may convert the input analog image into a digital image of a predetermined bit (for example, 6-bit or 8-bit) and classify it into a plurality of gradation sections based on the gradation characteristics of the converted digital image. . Here, the gradation means that the change in color density, that is, the bright and dark parts are subdivided into several stages. In general, as the contrast difference is subdivided, the change in color is naturally expressed. In this case, the gradation is good.

The processor 130 may adjust the luminance of a specific grayscale section in a gamma curve indicating the relationship between the grayscale and display luminance of the image.

Specifically, when the contrast of the content is high, the processor 130 may control the output luminance of a gradation section above a predetermined threshold to be reduced. For example, it is possible to control the output luminance of the gradation section outputting white to be reduced.

Meanwhile, the processor 130 displays based on at least one of a preset mathematical time function, a brightness value stored in the LUT, an intensity to synthesize an image to be displayed and an image darker than the corresponding image, and a memory value previously recorded in the Device Driver IC. The output luminance value of (110) can be adjusted to gradually increase.

The processor 130 determines the output luminance adjustment elements according to the properties of each divided region based on the ambient illuminance detected by the detector 120 and individually determines the output luminance values of each region based on the determined elements. I can adjust it.

Specifically, the processor 130 determines at least one of an initial luminance value, a target luminance value, and a luminance change time according to the attribute of each region based on the detected ambient illuminance, and the divided region of each region based on the determined value. It can be adjusted to gradually increase the luminance value. However, at least one of an initial luminance value, a target luminance value, and a luminance change time may be implemented to be changeable according to a user setting.

In this case, the processor 130 may adjust the output luminance value of the display 110 to gradually increase during the determined luminance change time from the determined initial luminance value to the target luminance value.

As an example, the case where the display 110 is implemented as an LCD panel will be described. In general, an LCD panel generates an image by changing the arrangement of liquid crystal molecules due to the voltage difference of electrodes between the upper and lower glass plates by injecting a liquid crystal material, which is an intermediate between solid and liquid, between two thin glass plates specially surface-treated. It has a working principle to display. In this case, since the LCD panel does not emit light by itself, a light source is required to visually recognize the displayed content. That is, by using a lamp as a light source and illuminating the lamp from the rear of the LCD panel, the user can view the image displayed on the screen.

Accordingly, it is possible to assume a case where each region divided in different display layers is disposed in the LCD panel.

In this case, the processor 130 determines the lamp supply voltage control value for controlling the lamp driver for controlling the lamp driver based on the pre-stored value to drive the lamp to provide the determined initial luminance value to each display layer, , It can be gradually increased to provide a determined target luminance value.

For example, the lamp driver may include a voltage control signal generator, a converter, and an inverter. In this case, the voltage control signal generator generates a voltage control signal to control the power supplied from the power supply unit in response to the lamp supply voltage control value transmitted from the processor 130 and transmits the voltage control signal to the converter. The converter adjusts the output voltage of the power supply unit in accordance with the ramp supply voltage control value in the voltage control signal transmitted from the voltage control signal generator. The inverter converts the DC voltage transmitted from the converter to AC voltage and supplies it to the RAM. In this way, the lamp driver may control the converter by dividing the step according to the value sent by the processor 130 to control the brightness of the lamp accordingly. However, this is an example, and it is needless to say that the luminance adjustment method may be performed in various ways depending on the implementation form of the display 110.

As another example, when the display 110 is embodied as an OLED panel that displays an input image by emitting a plurality of self-luminous elements in units of pixels, each region divided into different display layers may be disposed as described above. It may be, but there may be a case where each divided area is a different pixel area in the same display layer.

Meanwhile, the processor 130 may provide a UI screen for adjusting the output luminance value of the display according to a preset event on one area of the display. Accordingly, the user may manually adjust the output luminance value of the display through the UI screen. In this case, the processor 130 may provide a GUI indicating the original luminance value of the corresponding content on the UI screen. Accordingly, the user can appropriately adjust the output luminance value of the display through the corresponding GUI.

4B is a block diagram showing a detailed configuration of the display device shown in FIG. 4A.

According to FIG. 4B, the display apparatus 100 ′ includes a display 110, a sensing unit 120, a processor 130, a storage unit 140, an audio processing unit 150, and a video processing unit 160. Of the configurations shown in FIG. 4B, detailed descriptions of configurations overlapping with those shown in FIG. 4A will be omitted.

The processor 130 includes a RAM 131, a ROM 132, a main CPU 133, a graphics processor 134, first to n interfaces 135-1 to 135-n, and a bus 136.

The RAM 131, the ROM 132, the main CPU 133, the graphic processing unit 134, and the first to n interfaces 135-1 to 135-n may be connected to each other through the bus 136.

The first to n interfaces 135-1 to 135-n are connected to various components described above. One of the interfaces may be a network interface connected to an external device through a network.

The main CPU 133 accesses the storage unit 250 to boot using the O/S stored in the storage unit 140. Then, various operations are performed using various programs, contents, and data stored in the storage 140.

The ROM 132 stores a set of instructions for booting the system and the like. When a turn-on command is input and power is supplied, the main CPU 133 copies the O/S stored in the storage unit 250 to the RAM 131 according to the command stored in the ROM 132, and executes the O/S. Boot the system. When the booting is completed, the main CPU 133 copies various programs stored in the storage 140 to the RAM 131 and executes the programs copied to the RAM 131 to perform various operations.

The graphic processing unit 134 generates a screen including various objects, such as icons, images, and text, by using a calculation unit (not shown) and a rendering unit (not shown). The operation unit (not shown) calculates attribute values such as coordinate values, shapes, sizes, colors, etc. to be displayed according to the layout of the screen based on the received control command. The rendering unit (not shown) generates screens of various layouts including objects based on attribute values calculated by the calculation unit (not shown).

Meanwhile, the operation of the above-described processor 130 may be performed by a program stored in the storage unit 140.

The storage unit 140 stores various data such as an operating system (O/S) software module for driving the broadcast reception device 200 and various multimedia contents. In particular, the storage unit 250 may store programs such as an illuminance calculation module, a content attribute determination module, a luminance adjustment module, and luminance information according to illuminance and content characteristics.

Hereinafter, detailed operations of the processor 130 using a program stored in the storage 140 will be described in detail.

5 is a view for explaining various modules stored in the storage unit.

According to FIG. 5, the storage unit 140 includes a base module 141, a sensing module 142, a communication module 143, a presentation module 144, an illuminance calculation module 145, and a content attribute determination module 146. And a software including a luminance adjustment module 147.

The base module 141 means a basic module that processes a signal transmitted from each hardware included in the display device 100 ′ and transmits it to a higher layer module. The base module 141 is a storage module 141-1 that manages a database (DB) or registry, a security module that supports hardware certification, request permission, secure storage, etc. 141-2) and a network module 141-3 for supporting network connection.

The sensing module 142 is a module that collects information from various sensors and analyzes and manages the collected information. The sensing module 142 may include an illuminance recognition module, a touch recognition module, a head direction recognition module, a face recognition module, a voice recognition module, a motion recognition module, an NFC recognition module, and the like.

The communication module 143 is a module for performing communication with the outside. The communication module 143 is a device module used for communication with an external device, a messenger program, a messaging module such as a short message service (SMS) & multimedia message service (MMS) program, an email program, a call information aggregator program And a telephone module including a module, a VoIP module, and the like.

The presentation module 144 is a module for configuring a display screen. The presentation module 144 may include a multimedia module for reproducing and outputting multimedia content, and a UI rendering module for performing UI and graphic processing.

The illuminance calculation module 145 is a module for calculating illuminance information according to the illuminance signal sensed through the detector 120. To this end, the illuminance calculation module 145 may include a preset algorithm for converting the sensed illuminance signal into illuminance information that the processor 130 can determine.

The content attribute determination module 146 is a module for determining the attribute of content displayed on the screen. To this end, the content attribute determination module 146 may include an algorithm for acquiring various information related to at least one object included in the image frame. For example, a device for determining luminance of at least one object included in a screen displaying content, an area of the object, a luminance difference between the object and an adjacent object, the color of the object, and the time each object is displayed. It may include a set algorithm.

The luminance adjustment module 147 adjusts the output luminance value of each region classified based on the attribute of the content determined by the content attribute determination module 146 according to the ambient illumination calculated by the illuminance calculation module 145 It is a module for. To this end, the brightness adjustment module 147 may include various data and algorithms for determining a brightness adjustment element suitable for each region. However, in the case of a specific application (for example, a call application, an SMS application, etc.), most of the screens provided by the application have similar properties, so the output luminance value of the display may be adjusted according to a preset luminance adjustment element for each application. .

In addition, the display apparatus 100' includes not only audio processing unit 150 for processing audio data, video processing unit 160 for processing video data, but also various audio data processed by audio processing unit 150. It may further include a speaker (not shown) for outputting various notification sounds or voice messages, a microphone (not shown) for receiving user voice or other sound and converting it into audio data.

6 is a graph for explaining a method of adjusting luminance of a display according to an embodiment of the present invention.

According to FIG. 6, when the display area is classified according to the content property, at least one of an initial luminance value, a target luminance value, and a luminance change time may be variably determined according to the peripheral illumination and the display attribute of the corresponding region.

For example, as shown, the initial luminance value (depending on the peripheral illumination and the properties of the corresponding display area (e.g., the gradation of the corresponding display area, the width of the corresponding display area, the degree of interest in objects displayed on the corresponding display area, etc.) 411 to 413), target luminance values 421 to 423 and luminance change times a to c may be variably determined, and graphs 410 to 430 representing output luminance values of the display over time according to the variably determined values ) May be various as shown. However, in the illustrated embodiment, the luminance value is illustrated in a linearly increasing form, but this is only an example, and the luminance value may be increased in various forms such as a stepped wave shape or a quadratic curve shape.

7A and 7B are diagrams for describing display properties of content according to various embodiments of the present disclosure.

According to an embodiment of the present invention, the glare phenomenon may occur to a different degree even in the same luminance according to the display attribute of the content.

For example, when comparing the case of the overall bright content as shown in FIG. 7A and the case where the content with high brightness of light color is displayed on a dark background as shown in FIG. 7B, the case as in FIG. 7B is lower. There is a high possibility of glare even in luminance. Accordingly, the initial luminance value may be set lower in the case of FIG. 7B than in the case of FIG. 7A.

8A and 8B are diagrams for explaining the luminous brightness according to an embodiment of the present invention.

As shown in FIG. 8A, when the output luminance value of the display is gradually increased according to an embodiment of the present invention, the luminous brightness is kept constant, so that it is dazzling compared to the prior art shown in FIGS. 8A and 8B. , Fatigue will not accumulate.

9 is a view for explaining a luminance control method according to an embodiment of the present invention.

As illustrated in FIG. 9, according to an embodiment of the present invention, luminance control may be individually performed for each display layer.

When the displayed content 910 includes a display layer 911 that includes information and a display layer 912 that includes a background, simply increasing the luminance gradually slows down the cognitive speed and may cause inconvenience to the user. have.

In this case, the processor 130 may individually control the luminance of the display layer 911 including information that is an area of interest among the displayed content 910 and the display layer 912 that includes a background that is a region of interest. .

Specifically, as illustrated, the brightness of the display layer 911 including information increases rapidly, and the brightness of the display layer 912 including background increases slowly, so that the brightness of the display layer 911 including information increases. It is possible to reach the target luminance value faster.

In this case, the processor 130 may variously adjust the start point of the luminance increase, the speed at which the luminance increases, the initial luminance value, the target luminance value, etc. for each display layer. Accordingly, it is possible to improve the visibility and recognition speed of information.

For example, the speeds t0, t1, and t2 that are brightened for each layer may be the same for each layer. For example, t0 may be 0. However, in this case, the shape of the lightening curve of each layer may be set differently. For example, when the significant layer is brightened in the log form and the wall-paper layer is brightened in the form of the exp function, the Significant Later is first seen by the human, and then the Wall-paper Layer is gradually seen.

On the other hand, the display layer may be divided into two as illustrated, but the number of display layers may be variously set according to the situation or the information displayed. Alternatively, as described above, each region may be processed as a layer according to the local location of the image. Alternatively, HMD, Near Eye-Display, Projector, etc. can view and process transmitted background information, reflected media, or screen as a single layer.

For example, when the display device 100 is implemented as a mobile device, in the case of a lock screen, clock information is Layer 1, date and day information is Layer 2, and other notification windows such as a messenger or alarm. With Layer 3 and Wall-paper as Layer 4, if the priority is preset by the user or manufacturer, the processor 130 may control each layer to be brightened in turn based on the priority.

Alternatively, the processor 130 controls the layer 1 and the layer 2 containing the text containing the information to be viewed at the same layer group and brightened at the same speed, and at a slightly slower speed, the layer 3 brightens and finally the layer 4 brightens. You may.

Alternatively, the processor 130 may reflect user preferences in each layer. When the user prefers Layer 3, which is other notification such as a messenger, than the clock of Layer 1, it is possible to simultaneously control Layer 1 and Layer 3 to lighten at a high speed and lighten the remaining layers in a predetermined order.

In addition, if it is difficult to assign a priority to the layer, the processor 130 may control the priority to be defined for each layer according to the following rules to brighten up in a speed and curve form suitable for each order.

Layer_Order = α * (peak_contrast)-β * (Average_Y) + γ * (std_dev)

Here, the coefficients of α, β, and γ may vary depending on the display size or ambient illuminance, and the transparent part may be regarded as Black or White depending on the device.

In addition, the layer order defined as described above may be modified according to user preferences or factors preset by the manufacturer.

In addition, the processor 130 may classify and process a specific priority (eg, priority number 2) as a Significant Layer according to the determined priority of each layer, manufacturer policy, or user preference.

Meanwhile, the function for reducing static glare is also similar to the function for reducing dynamic glare. The static glare function can operate when the ambient illumination is darker than the threshold illumination set by the user or manufacturer.

Specifically, the processor 130 may analyze the content by various factors such as the average brightness or maximum brightness value of the content, the distribution of the histogram, and the contrast ratio distribution. Even in this case, the processor 130 may view and process background information transmitted through HMD, Near Eye-Display, and Projector, or a reflected medium or screen as a single layer.

The static galre reduction function may be utilized based on the illuminance, but if there is a contrast that can identify the main elements of the content in terms of visibility, the function can be used only in a part of the high gradation. That is, the processor 130 may differently control the brightness or color of some gradation or some region of the content only with the components of the content regardless of the illuminance.

10A to 10C and FIG. 11 are diagrams for explaining a luminance control method according to another embodiment of the present invention.

As illustrated in FIGS. 10A to 10C, according to another embodiment of the present invention, luminance control may be individually performed for each gradation section based on content attributes. That is, luminance control according to the static galre reduction function described above may be performed.

For example, as illustrated in FIG. 10A, since the content 1010 having a small contrast (contrast) does not cause glare, additional luminance control may not be performed (1110 in FIG. 11 ).

In the case of the content 1020 having a slight contrast (contrast) as shown in FIG. 10B, as illustrated in FIG. 11, the peak luminance value is slightly (for example, in some gradation periods (for example, 200 to 255 with high gradations)). For example, 10%) can be adjusted to be lowered (1120 in FIG. 11).

In addition, in the case of the content 1030 having a high contrast (contrast ratio) such as 10c, as shown in FIG. 11, a large number of peak luminance values (for example, 200 to 255 with high gradations) are large (eg For example, 30%) can be adjusted to be lowered (1130 in FIG. 11).

12A and 12B are diagrams for describing a luminance control method according to another embodiment of the present invention.

In the case of the content 1210 with high contrast as shown in FIG. 12A, as shown in FIG. 12B, that is, by lowering the output luminance value of the high grayscale section, it is possible to improve visibility and reduce power. For example, when the luminance corresponding to the white gradation value of the original shown in FIG. 12A is output at 100%, it is assumed that power is consumed 100%. In this case, as shown in FIG. 12B, when the luminance corresponding to the white gradation value is reduced to 68%, it is considered that power is consumed by about 68", while improving visibility and reducing power.

13 is a view for explaining a method for determining content attributes according to an embodiment of the present invention.

In order to determine the luminance control target among the displayed contents as shown in FIG. 13, attributes such as contrast ratio, overall brightness, local contrast, and color may be considered. In this case, the weight for each attribute may be determined according to the surrounding environment or the purpose of the device.

For example, in the equation below, the influence factor for each content element can be obtained, and accordingly, an object to be controlled can be determined.

Here, Pr_w represents a relative change rate of pupils for each color of color.

14 is a diagram for describing a luminance control method according to an implementation example of a display device.

FIG. 14 assumes that the display apparatus 100 is implemented as a video wall system, and as illustrated, can control the brightness of a specific object to be adjusted in the video wall system individually.

Specifically, based on the surrounding illuminance, when the visibility of the important information 1410 is poor, in order to improve the visibility of the information 1410, providing the information among the entire display panels 100-1 to 100-9 The brightness of some display panels 100-2, 100-3, 100-5, and 100-6 can be individually adjusted. For example, when the ambient light is very bright, the luminance of the area where the corresponding information 1410 is displayed may be adjusted downward to improve visibility.

In this case, the luminance adjustment of the display layer including the information is individually performed on the display panels 100-2, 100-3, 100-5, and 100-6 including the region where the information 1410 is displayed. can do. Alternatively, when each display panel (100-2, 100-3, 100-5, 100-6) is implemented as a self-emissive element that emits light in units of pixels, brightness adjustment of an area where the corresponding information 1410 is displayed It is also possible to perform only.

15A and 15B, FIGS. 16A and 16B are diagrams for describing a luminance control method according to another example of implementation of a display device.

15A and 15B, FIGS. 16A and 16B assume that the display device 100 is implemented as a transparent display, and as illustrated, even in a transparent display, the luminance of a specific object to be adjusted is individually controlled. Can be.

For example, when using the display device 100 having a transparent display as a navigation as shown in FIGS. 15A and 15B, an AR object for guiding a road may be displayed, according to an embodiment of the present invention. The luminance of the AR object can be appropriately adjusted according to the illuminance.

In this case, as shown in FIG. 15A, AR objects 1511 and 1512 for road guidance are provided with low luminance in the outdoor with high illumination, and AR for road guidance in outdoor with low illumination as shown in FIG. 15B. Objects 1521 and 1522 can be provided with high luminance.

As another example, as illustrated in FIGS. 16A and 16B, when a transparent display is provided on a front windshield of a vehicle, an AR object for driving guidance may be displayed on the front transparent display 1620 of the vehicle. According to an example, the luminance of the AR object may be appropriately adjusted according to the ambient illuminance.

In this case, as shown in FIG. 16A, when the weather is bright and the ambient light is high, this provides an AR object 1620 for driving guidance with low luminance, and as shown in FIG. 16B, when the weather is dark and rainy The AR object 1620 for driving guidance may be provided with high luminance. In particular, the luminance of the important information 1621 and 1622 included in the AR object 1620 can be individually adjusted with the rest of the area. It is also possible to additionally provide an AR object 1623, such as the outline of the road, according to the surrounding roughness, as shown.

17 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.

According to the control method of the display device illustrated in FIG. 17, when a preset event occurs (S1710 :Y), ambient light is sensed (S1720 ). Here, the preset event may be an event in which the screen of the display is changed from an inactive state to an activated state, but is not limited thereto.

Subsequently, if the detected ambient illuminance satisfies a preset condition, the screen is divided into at least one area and the remaining areas based on the content attribute (S1730).

Thereafter, the luminance of each divided area is individually controlled (S1740).

In addition, in step S1740, the output luminance of each region may be individually controlled such that the luminance of the information displayed in at least one region is different from the luminance of the information displayed in the remaining regions.

In this case, in step S1730, when the ambient illuminance rapidly changes by a difference greater than or equal to a preset threshold, the screen may be divided into at least one area and the remaining areas.

In addition, in step S1730, in a state in which the ambient illuminance is equal to or less than a specific illuminance, at least one area of the screen is selected in at least one of a case in which the screen is switched from a dark screen to a bright screen and a screen is switched from an inactive state to an active state It can be divided into the remaining areas.

In addition, in steps S1730 and S1740, the screen may be divided into a region of interest and a region of interest based on content attributes, and output luminance of the region of interest and the region of interest may be individually controlled.

In addition, in steps S1730 and S1740, when the screen is switched from the inactive state to the activated state and the ambient illuminance is less than a preset threshold illuminance, the region of interest reaches the target luminance value before the output luminance of the non-interested region is reached. And the output luminance of the non-interested region.

In addition, in steps S1730 and S1740, when the ambient illuminance is less than a predetermined threshold illuminance, each region may be individually controlled such that the output luminance of the non-interested region is lower than the output luminance of the region of interest to reduce glare.

In addition, in steps S1730 and S1740, when the peripheral illuminance is equal to or greater than a predetermined threshold illuminance, each region may be individually controlled such that the output luminance of the region of interest is lower than that of the non-interested region so that visibility to the region of interest is increased.

In addition, in steps S1730 and S1740, the output luminance of each of the first display layer including at least one region and the second display layer including the remaining regions may be individually controlled.

In addition, in steps S1730 and S1740, the gradation section of the content may be divided into a gradation section and a remaining gradation section satisfying a preset condition based on the content attribute, and output luminance of each gradation section may be individually controlled.

In addition, in steps S1730 and S1740, when the contrast of the content is high, it is possible to control the output luminance of the gradation section above a preset threshold to be reduced.

18 is a flowchart illustrating a method of controlling a display device according to another embodiment of the present invention.

According to a control method of a display device according to another embodiment of the present invention illustrated in FIG. 18, first, ambient light is sensed (S1810 ). In this case, the display device may detect the ambient illumination periodically or when a predetermined event occurs (eg, a position change, an event according to the arrival of a preset time). For example, the display device may periodically detect ambient light after 9:00 p.m.

Subsequently, the screen is divided into at least one area and the remaining areas based on the detected ambient light and content attributes (S1820).

Thereafter, the luminance of each divided area is individually controlled (S1830).

Specifically, in step S1830, in which the luminance of each divided region is individually controlled, the luminance of each divided region can be individually controlled based on an attribute of an object displayed in each divided region. For example, as illustrated in FIG. 17, even if there is no event in which the screen is changed from an inactive state to an active state, the luminance of the screen can be appropriately adjusted in real time based on the ambient illumination and the properties of the content.

As described above, according to various embodiments of the present invention, when the display device is used in a night or dark environment, it is possible to prevent glare because it can reflect not only ambient illuminance but also visual adaptation characteristics according to content characteristics.

Meanwhile, methods according to various embodiments of the present disclosure may be programmed and stored in various storage media. Accordingly, methods according to various embodiments described above may be implemented in various types of electronic devices that execute a storage medium.

Specifically, according to an embodiment of the present invention, it is determined whether the ambient illuminance satisfies a preset condition, and if the ambient illuminance satisfies a preset condition, the screen is displayed based on the attribute of the content displayed on the screen. A non-transitory computer readable medium in which a program for dividing into at least one area and the remaining areas and sequentially performing an operation of individually controlling the output luminance of each area is stored may be provided.

The non-transitory readable medium means a medium that stores data semi-permanently and that can be read by a device, rather than a medium that stores data for a short time, such as registers, caches, and memory. Specifically, the various applications or programs described above may be stored and provided in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention pertains without departing from the gist of the present invention claimed in the claims. In addition, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical idea or prospect of the present invention.

100: display device 110: display
120: detection unit 130: processor

Claims (20)

A display providing a screen for displaying content;
A sensing unit that detects ambient illumination; And
When the ambient illuminance satisfies a preset condition, the screen is divided into at least one region and the remaining regions based on the attribute of the content, and the target luminance value is higher than the output luminance of the other regions. A display device comprising; a processor for individually controlling the output luminance of each region to reach the. According to claim 1,
The processor,
And an output luminance of each region is individually controlled such that the luminance of the information displayed in the at least one region is different from the luminance of the information displayed in the remaining region. According to claim 1,
The processor,
An event in which the ambient illuminance changes rapidly by a difference greater than or equal to a predetermined threshold, an event in which the screen is switched from a dark screen to a bright screen when the ambient illuminance is less than a specific illuminance, and the screen is displayed in a state where the ambient illuminance is less than a specific illuminance In the case of at least one of the events switching from the deactivated state to the activated state, the display device characterized in that the screen is divided into at least one area and the remaining areas. According to claim 1,
The processor,
A display device characterized in that the screen is divided into a region of interest and a region of non-interest based on the attribute of the content, and the output luminance of the region of interest and the region of interest is individually controlled. According to claim 4,
The processor,
When the screen is switched from the inactive state to the activated state, and the peripheral illuminance is less than a predetermined threshold illuminance, the region of interest and the ratio so that the output luminance of the region of interest reaches a target luminance value before the output luminance of the region of interest. Display device characterized by individually controlling the output luminance of the region of interest. According to claim 4,
The processor,
If the peripheral illumination is less than a predetermined threshold illumination, the display device, characterized in that for controlling the respective regions so that the output luminance of the region of interest is lower than the output luminance of the region of interest to reduce glare. According to claim 4,
The processor,
When the peripheral illuminance is greater than or equal to a predetermined threshold illuminance, a display device characterized in that each region is individually controlled such that the output luminance of the region of interest is lower than the output luminance of the non-interested region so that visibility to the region of interest is increased. According to claim 1,
The at least one area and the remaining areas are disposed with different display layers,
The processor,
Output of each of the first display layer and the second display layer such that an output luminance of the first display layer including the at least one region reaches a target luminance value before an output luminance of the second display layer including the remaining region. Display device characterized in that the brightness is individually controlled. According to claim 1,
The processor,
A display device characterized in that the gradation section of the content is divided into a gradation section that satisfies a preset condition and a remaining gradation section based on the attribute of the content, and the output luminance of each gradation section is individually controlled. The method of claim 9,
The processor,
If the contrast of the content is high, the display device characterized in that the output luminance of the gradation section above a predetermined threshold is reduced. In the control method of the display device,
Determining whether the ambient illuminance satisfies a predetermined condition; And
When the ambient illuminance satisfies the preset condition, the screen is divided into at least one area and the remaining areas based on the properties of the content displayed on the screen, and the output luminance of the one area is higher than the output luminance of the other area. First, individually controlling the output luminance of each region to reach the target luminance value; control method comprising a. The method of claim 11,
The step of individually controlling the output luminance,
And controlling the output luminance of each region individually so that the luminance of the information displayed in the at least one region is different from the luminance of the information displayed in the remaining region. The method of claim 11,
The step of individually controlling the output luminance,
An event in which the ambient illuminance changes rapidly by a difference greater than or equal to a predetermined threshold, an event in which the screen is switched from a dark screen to a bright screen when the ambient illuminance is less than a specific illuminance, and the screen is displayed in a state where the ambient illuminance is less than a specific illuminance In the case of at least one of the events switching from the deactivated state to the activated state, the control method characterized in that the screen is divided into at least one area and the remaining areas. The method of claim 11,
The step of individually controlling the output luminance,
A control method comprising distinguishing a region of interest and a region of interest based on the attribute of the content, and individually controlling the output luminance of the region of interest and the region of interest. The method of claim 14,
The step of individually controlling the output luminance,
When the screen is switched from the inactive state to the activated state, and the peripheral illuminance is less than a predetermined threshold illuminance, the region of interest and the ratio so that the output luminance of the region of interest reaches a target luminance value before the output luminance of the region of interest. A control method characterized by individually controlling the output luminance of the region of interest. The method of claim 14,
The step of individually controlling the output luminance,
When the peripheral illuminance is less than a predetermined threshold illuminance, a control method characterized in that each region is individually controlled such that an output luminance of the non-interested region is lower than an output luminance of the region of interest to reduce glare. The method of claim 14,
The step of individually controlling the output luminance,
When the peripheral illuminance is greater than or equal to a predetermined threshold illuminance, a control method characterized in that each region is individually controlled such that an output luminance of the region of interest is lower than an output luminance of the non-interested region so that visibility to the region of interest is increased. The method of claim 11,
The at least one area and the remaining areas are disposed with different display layers,
The step of individually controlling the output luminance,
Output of each of the first display layer and the second display layer such that an output luminance of the first display layer including the at least one region reaches a target luminance value before an output luminance of the second display layer including the remaining region. Control method characterized by individually controlling the luminance. The method of claim 11,
The step of individually controlling the output luminance,
A control method characterized in that the gradation section of the content is divided into a gradation section that satisfies a preset condition and a remaining gradation section based on the attribute of the content, and the output luminance of each gradation section is individually controlled. The method of claim 19,
The step of individually controlling the output luminance,
If the contrast of the content is high, the control method characterized in that the output luminance of the gradation section above a predetermined threshold is reduced.

Images