KR20210045227A - Electronic device and operating method for the same - Google Patents

Abstract

The present invention provides a display device capable of preventing sudden brightness changes. According to an embodiment of the present invention, the display device comprises a memory storing one or more instructions and a processor which executes the one or more instructions stored in the memory. The processor receives video content and dynamic metadata and static metadata corresponding to the video content, determines a section in which graphic content is activated while playing the video content based on the dynamic metadata, determines metadata applied to the section in which the graphic content is activated based on profile A data and profile B data included in the dynamic metadata and the static data, and determines the metadata to gradually convert the metadata from the profile B data to the static metadata based on the difference between the profile B data and conversion profile B data generated based on the profile A data.

Description

Display device and its operating method {Electronic device and operating method for the same}

Various embodiments relate to a display device and a method of operating the same, and more particularly, to a display device that reproduces HDR content and a method of operating the same.

While the human-visible brightness range is approximately 10 ^-6 nits to 10 ⁸ nits, the brightness encountered in real life (e.g., 10,000 nits for a light bulb and 0.005 nits or less for the night sky) is considerably wider than that. .

In order to maximize the realism of video, various studies and standardizations have been actively conducted in recent years to provide a high contrast ratio (HDR, High Dynamic Range) that is wider than the dynamic range supported by HDTV.

In HDR video, bright objects appear bright, dark objects appear dark, and details are well visible, whether it is bright or dark objects.

In the case of HDR content, image processing may be performed for each scene of the HDR content based on dynamic metadata reflecting the characteristics of each scene of the HDR content, thereby providing a sharper image quality. However, while the HDR content is being reproduced, when graphic content is provided, there is a problem that a sudden change in brightness occurs.

Various embodiments may provide a display device capable of preventing a sudden change in brightness from occurring and a method of operating the same when graphic content is provided during reproduction of HDR content.

A display device according to an embodiment includes a memory storing one or more instructions and a processor executing the one or more instructions stored in the memory, wherein the processor includes video content, dynamic metadata corresponding to the video content, and Receives static metadata, determines a section in which graphic content is activated during reproduction of the video content, based on the dynamic metadata, and determines profile A data, profile B data, and the static data included in the dynamic metadata. Based on, the meta data applied to the section in which the graphic content is activated is determined, and based on the difference between the profile B data and the conversion profile B data generated based on the profile A data, the meta data is the profile The metadata may be determined to be gradually converted from the B data to the static metadata.

The processor according to an embodiment may determine a section in which the graphic content is activated based on whether Bezier Curve information of the profile B data changes from n to 0.

The processor according to an embodiment may determine a section in which the graphic content is activated based on whether the percentage information of the profile A data gradually changes from the static metadata to a predefined value. have.

The processor according to an embodiment may generate the conversion profile B data by converting percentage information of the profile A data of a section in which the graphic content is activated into Bezier curve information.

The processor according to an embodiment of the present disclosure includes the meta data in the profile B data based on a difference between a coefficient of a first Bezier curve of the profile B data and a coefficient of the second Bezier curve of the transform profile B data. The metadata may be determined to be gradually converted to static metadata.

The processor according to an embodiment may include the first Bezier curve and the second Bezier curve based on a difference between the coefficient of the first Bezier curve of the profile B data and the second Bezier curve of the transform profile B data. The meta data can be determined by applying an IIR filter to the tailored curve.

The processor according to an embodiment, when the coefficient of the first Bezier curve is greater than the coefficient of the second Bezier curve, applies an IIR filter to the first Bezier curve, and the coefficient of the first Bezier curve Until is equal to the coefficient of the second Bezier curve, the first Bezier curve is gradually transformed, and when the coefficient of the first Bezier curve and the coefficient of the second Bezier curve become the same, the second Bezier curve 2 By applying an IIR filter to the Bezier curve and gradually transforming the second Bezier curve, the metadata may be determined.

When the coefficient of the first Bezier curve is smaller than the coefficient of the second Bezier curve, the processor according to an embodiment is the same as the coefficient of the second Bezier curve. Until, the first Bezier curve is determined as the metadata, and when the coefficient of the first Bezier curve and the coefficient of the second Bezier curve become the same, an IIR filter is applied to the second Bezier curve, The meta data may be determined by gradually transforming the second Bezier curve.

The display device according to an embodiment further includes a display, wherein the processor performs tone mapping of the video content and the graphic content by applying the metadata to a section in which the graphic content is activated, and the tone-mapped video The display may be controlled to display content and graphic content.

The display device according to an embodiment may further include an input/output unit for receiving the video content, the dynamic metadata, and the static metadata.

A method of operating a display device according to an embodiment includes the steps of receiving video content, dynamic metadata corresponding to the video content, and static metadata, and based on the dynamic metadata, graphic content is displayed during playback of the video content. Determining a section to be activated, and determining metadata applied to a section in which the graphic content is activated, based on profile A data, profile B data, and the static data included in the dynamic meta data, , The meta data applied to the section in which the graphic content is activated is based on a difference between the profile B data and the conversion profile B data generated based on the profile A data, and the meta data is in the profile B data. It can be determined to be gradually converted to static metadata.

The display device according to an exemplary embodiment may prevent a sudden change in brightness of a screen when switching from dynamic tone mapping to static tone mapping or switching from static tone mapping to dynamic tone mapping.

The display device according to an embodiment may prevent distorting of an image characteristic of a video content during image processing or image quality processing of the video content by detecting whether graphic content is activated.

1 is a diagram illustrating an HDR content reproduction system according to an exemplary embodiment.
FIG. 2 is a diagram referenced to explain a method of performing tone mapping by using static metadata and dynamic metadata corresponding to HDR content by a display device according to an exemplary embodiment.
3 is a diagram illustrating a case in which graphic content is output while HDR content is output by a display device according to an exemplary embodiment.
4 is a block diagram illustrating a configuration of a display device according to an exemplary embodiment.
5 is a diagram illustrating a change in dynamic metadata when graphic content is activated, according to an exemplary embodiment.
6 is a block diagram illustrating in detail the meta data determination unit of FIG. 4.
FIG. 7 is a diagram referenced for explaining an operation method of the IIR filter application unit of FIG. 4.
8 is a flowchart illustrating a method of operating a display device according to an exemplary embodiment.
9 is a detailed flowchart illustrating step 830 (S830) of FIG. 8.
10 is a block diagram illustrating a configuration of a display device according to an exemplary embodiment.
11 is a block diagram illustrating a configuration of a display apparatus 1000 according to another exemplary embodiment.

The terms used in the present specification will be briefly described, and the present invention will be described in detail.

Terms used in the present invention have selected general terms that are currently widely used as possible while taking functions of the present invention into consideration, but this may vary according to the intention or precedent of a technician working in the field, the emergence of new technologies, and the like. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning of the terms will be described in detail in the description of the corresponding invention. Therefore, the terms used in the present invention should be defined based on the meaning of the term and the overall contents of the present invention, not a simple name of the term.

When a part of the specification is said to "include" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary. In addition, terms such as "... unit" and "module" described in the specification mean units that process at least one function or operation, which may be implemented as hardware or software, or as a combination of hardware and software. .

In the embodiments of the present specification, the term “user” refers to a viewer who views an image displayed on an electronic device or a person who controls a function or operation of the electronic device, and may include an administrator or an installer.

Hereinafter, exemplary embodiments will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are attached to similar parts throughout the specification.

1 is a diagram illustrating an HDR content reproduction system according to an exemplary embodiment.

The content creator may provide encoded content based on the brightness and color of an image intended by the creator. In the case of the high dynamic range (HDR) content 10 providing a more vivid image by improving the contrast ratio of the screen, encoding information corresponding to the encoding method may be provided together. For example, according to the next-generation optical disk storage medium standard such as Blu-ray Disc, the HDR content 10 encoded based on the brightness and color of an image intended by the creator will be provided together with related metadata. I can.

Referring to FIG. 1, an HDR content playback system according to an embodiment may include a playback device 200 and a display device 100, and the HDR content 10 includes a hard disk, a floppy disk, and a magnetic tape. It may be stored in a data storage medium 20 including a magnetic medium, an optical recording medium such as a CD-ROM and a DVD, a magneto-optical medium such as a floptical disk, and the like. The HDR content 10 stored in the storage medium may be reproduced through the playback device 200 and displayed through the display device 100.

The playback device 200 may be a Blu-ray player, a Digital Versatile Disc (DVD) player, or the like, but is not limited thereto, and may be implemented as various types of playback devices. In addition, the display device 100 includes a TV, a large format display (LFD), a digital signage (digital signage), a video wall, a mobile phone, a speaker, a tablet PC, a digital camera, a camcorder, a laptop computer, Tablet PC, desktop, e-book terminal, digital broadcasting terminal, PDA (Personal Digital Assistants), PMP (Portable Multimedia Player), navigation, MP3 player, camcorder, IPTV (Internet Protocol Television), DTV (Digital Television), wearable devices It may be implemented in various electronic devices such as (wearable device). In addition, the display device 100 may be a fixed electronic device disposed at a fixed position or a mobile electronic device having a portable form, and may be a digital broadcast receiver capable of receiving digital broadcasts.

When the playback device 200 reproduces the storage medium 20 on which the HDR content is recorded, the HDR content and metadata corresponding to the HDR content are provided to the display device 100 through an input/output unit.

Alternatively, the HDR content 10 according to an embodiment may be transmitted to the display device 100 through the network 30. A server (not shown) according to an embodiment may transmit HDR content to the display device 100 together with metadata through the network 30. In this case, the display device 100 according to an embodiment may include a separate device connected to a TV, for example, a set-top box. That is, the display apparatus 100 may include not only a device that displays an image by itself, but also a device that transmits related data to a display connected to it so that an image can be displayed on a display connected to it.

According to an embodiment, metadata corresponding to HDR content may include static metadata or dynamic metadata.

The static metadata is metadata reflecting the characteristics of the entire HDR content, and means metadata that is fixedly applied to the HDR content. Static metadata applies to all scenes regardless of scene changes. Here, the scene refers to a section having similar quality characteristics, and may be distinguished from a scene according to a spatial change in a scenario that is classified by a content producer such as a conventional movie. That is, even in the same space on a scenario divided by a content creator such as a movie, different scenes may be classified according to the brightness and color of the image. However, it is not limited thereto.

Meanwhile, the dynamic metadata is metadata reflecting the characteristics of each scene of the HDR content, and means metadata dynamically applied to each scene of the HDR content.

Hereinafter, static metadata and dynamic metadata will be described in detail with reference to FIG. 2.

FIG. 2 is a diagram referenced to explain a method of performing tone mapping by using static metadata and dynamic metadata corresponding to HDR content by a display device according to an exemplary embodiment.

HDR content according to an embodiment may be provided together with static metadata or dynamic metadata. Alternatively, the HDR content may be provided together with static metadata and dynamic metadata. For example, content in which only static metadata is provided may be referred to as static HDR content (for example,'HDR 10'), and content in which dynamic metadata is also provided may be referred to as dynamic HDR content (for example,'HDR 10'). +'), but is not limited thereto.

Dynamic metadata according to an embodiment may include profile A data and profile B data. Profile A data may include luminance distribution information (percentile information) of an image, and profile B data may include Bezier Curve information of an image. However, it is not limited thereto.

The display device according to an embodiment may be implemented to support an HDR function. Here, the HDR function may mean a function of performing image quality conversion (or image quality processing) and tone mapping on the HDR content based on metadata provided together with the HDR content and displaying it. Tone mapping is a method of expressing the original tone of the HDR content according to the dynamic range of the display device based on the received metadata. For example, the maximum luminance of the HDR content based on metadata may be mapped to the maximum luminance that can be expressed by the display capability display device of the display device.

The display device according to an embodiment may perform static tone mapping in a static manner. For example, when HDR content and static metadata corresponding to the HDR content are provided, the display device applies the same tone mapping graph based on the static metadata to all frames included in the HDR content, Mapping can be performed. As shown in (a) of FIG. 2, the display device 100 performs static tone mapping by applying the same tone mapping graph 215 to the first to third frames 210 included in the HDR content. can do.

On the other hand, the display apparatus 100 may perform dynamic tone mapping in a dynamic manner. For example, when dynamic metadata corresponding to the HDR content and each scene of the HDR content is provided, the display device applies a different tone mapping graph based on the dynamic metadata for each scene of the HDR content to map the tone of the HDR content. You can do it. As shown in (b) of FIG. 2, the display apparatus 100 includes a first tone mapping graph 225 in the first frame 211 and a second tone mapping graph 235 in the second frame 212. By applying the third tone mapping graph 245 to the third frame 213, dynamic tone mapping may be performed.

3 is a diagram illustrating a case in which graphic content is output while an HDR content is output by a display device according to an exemplary embodiment.

Referring to FIG. 3, a display device according to an embodiment receives HDR content and dynamic metadata corresponding to the HDR content, performs tone mapping of the HDR content based on the dynamic metadata, and performs tone-mapped HDR content. Can be printed.

Meanwhile, as illustrated in FIG. 3, a case in which the graphic content 320 is output during reproduction of the HDR content 310 may occur. The graphic content 320 according to an embodiment may include at least one of an interactive graphic (IG), a presentation graphic (PG), and a graphical user interface (GUI). IG refers to graphic content that can be selected or controlled by the user, such as a main menu graphic provided at a specific point in time (for example, at the initial point of content), and PG is a content that is only displayed unilaterally to the user, such as subtitles and performer information. It means graphic content. In addition, the GUI refers to a UI provided according to a user command, such as a playback control menu. However, in the case of subtitles, if provided throughout the content, it may not be included in the graphic content according to an embodiment of the present invention.

When the graphic content 320 is output, the display device 100 must perform tone mapping by switching from the dynamic tone mapping mode to the static tone mapping mode. For example, in the HDR 10+ standard, an equation to be used for static tone mapping is defined only for profile A data, and profile B data cannot be used. Therefore, when static tone mapping needs to be performed while dynamic tone mapping is performed using Bezier curve information of profile B data, it is necessary to convert from profile B data to profile A data. When switching from profile B data to profile A data, the brightness of an output screen suddenly changes, which may cause viewer discomfort.

In addition, when the graphic content 320 is output, the display device 100 needs to perform image quality processing suitable for the graphic content 320, but when it cannot be determined whether the graphic content 320 is output, the graphic content is displayed. It is judged as a video content image. In this case, during image processing or quality processing of the video content, the characteristics of the actual video content image may be distorted.

In addition, as shown in FIG. 3, while the HDR video content 310 including the letter box 315 is being output, the graphic content 320 is output, and the graphic content 320 is a letter box 315. When overlapping with the area, the display apparatus 100 may not detect the letter box 315. That is, the display apparatus 100 may determine that the letter box 315 does not exist even though the letter box 315 is included in the video content. Accordingly, during image processing or image quality processing of video content, characteristics of an actual video content image may be distorted.

Accordingly, the display device 100 according to an embodiment determines whether the graphic content 320 is activated while the HDR content 310 is being output, and meta data for tone mapping applied to the section in which the graphic content is activated. Can be determined.

This will be described in detail with reference to the drawings below.

4 is a block diagram illustrating a configuration of a display device according to an exemplary embodiment. Referring to FIG. 4, the display apparatus 100 according to an embodiment may include a mode change detection unit 410 and a meta data determination unit 420, and the meta data determination unit 420 may include a meta data conversion unit ( 421), a metadata comparison unit 423, and an IIR filter application unit 425 may be included.

The display apparatus 100 according to an embodiment may perform tone mapping by using dynamic metadata corresponding to HDR content in a section in which graphic content is not output (dynamic tone mapping mode). Alternatively, the display apparatus 100 may perform tone mapping using static metadata corresponding to HDR content in a section in which graphic content is output (static tone mapping mode).

Therefore, when the graphic content is activated while the HDR content is being output, the display device 100 needs to switch from the dynamic tone mapping mode to the static tone mapping mode.

The mode change detector 410 may determine whether graphic content is output based on dynamic metadata corresponding to the HDR content.

Dynamic metadata according to an embodiment may include profile A data and profile B data. Profile A data may include luminance distribution information (percentile information) of an image, and profile B data may include Bezier Curve information of an image. However, it is not limited thereto.

5 is a diagram illustrating a change in dynamic metadata when graphic content is activated, according to an exemplary embodiment.

During reproduction of HDR content according to an embodiment, when graphic content is activated, percentage information of profile A data is gradually changed to a value defined in static metadata. For example, when the value defined in the static metadata is '9', the percentage information gradually changes from '1' to '9'.

In addition, when the graphic content is activated, the Bezier curve information of the profile B data changes from'n' to '0'. In this case, the Bezier curve information may mean the number of points (eg, a knee point or an anchor point) of the Bezier curve, but is not limited thereto. As shown in FIG. 5, when graphic content is activated, Bezier curve information of profile B data changes from '8' to '0'.

In addition, when the graphic content is deactivated (when the output of the graphic content is terminated), the percentage information of the profile A data gradually changes. Referring to FIG. 5, the percentage information of profile A data gradually changes from '9' to '1'. In addition, when the graphic content is deactivated, the Bezier curve information of the profile B data changes from '0' to '8'.

The mode change detection unit 410 may determine a section in which graphic content is activated based on a change in the percentage information of the profile A data and the Bezier curve information of the profile B data. For example, when the percentage information of the profile A data gradually changes to a value defined in the static metadata, and the Bezier curve information of the profile B changes to 0, it may be determined that the graphic content is activated. The mode change detection unit 410 may determine the first time point t1 as a start time point of activation of the graphic content. In addition, the mode change detection unit 410 may determine a graphic content activation end time based on a change in the percentage information of the profile A data and the Bezier curve information of the profile B data, and the section 510 in which the graphic content is activated. Can be determined.

In addition, when only the percentage information of the profile A is changed and the Bezier curve information of the profile B does not change, the mode change detection unit 410 does not activate the graphic content, but the actual image of the HDR content (video content). It can be determined that a change has occurred. When the graphic content is activated, the meta data determiner 420 may determine the meta data applied to the section 510 in which the graphic content is activated.

Hereinafter, a method of determining metadata applied to a section 510 in which graphic content is activated will be described in detail with reference to FIGS. 6 and 7.

FIG. 6 is a block diagram illustrating in detail the meta data determination unit of FIG. 4, and FIG. 7 is a diagram referenced to explain an operation method of the IIR filter application unit of FIG. 4.

Referring to FIG. 6, the meta data converter 421 may generate profile B data (conversion profile B data) based on profile A data. The metadata conversion unit 421 may generate Bezier curve information (second Bezier curve information) of profile B data by using percentage information of profile A data. Also, the meta data conversion unit 421 may generate Bezier curve information (third Bezier curve information) of profile B data by using static meta data.

The metadata comparison unit 423 includes Bezier curve information (first Bezier curve information (Profile B)) of profile B data corresponding to the HDR content and Bezier curve information (first Bezier curve information) generated from the percentage information of the profile A data. 2 Compare the Bezier curve information (B_conv)), and the Infinite Impulse Response (IIR) filter application unit 425 determines metadata applied to the section 510 in which the graphic content is activated, based on the comparison result. You can decide how to apply the IIR filter.

The meta data comparison unit 423 may compare the coefficients of the first Bezier curve and the coefficients of the second Bezier curve. Alternatively, the metadata comparison unit 423 may compare the coefficients of the first Bezier curve, the coefficient of the second Bezier curve, and the coefficient of the third Bezier curve.

When the coefficient of the first Bezier curve and the coefficient of the second Bezier curve are the same (610), the IIR filter application unit 425 performs tone mapping using the first Bezier curve without applying the IIR filter. I can.

In addition, as shown in Figure 7 (a), when the coefficient (B) of the first Bezier curve is greater than the coefficient (A) of the second Bezier curve (620), the IIR filter application unit 425 By applying an IIR filter to the first Bezier curve, the first Bezier curve may be gradually transformed until the coefficient of the first Bezier curve becomes the same as the coefficient of the second Bezier curve. The meta data determiner 420 may determine meta data corresponding to a section in which graphic content is activated (section T1) by using the first Bezier curve to which the IIR filter is applied.

In addition, when the coefficients of the first Bezier curve and the coefficients of the second Bezier curve become the same, the IIR filter application unit 425 applies the IIR filter to the coefficients of the second Bezier curve, The second Bezier curve may be gradually transformed until is equal to the coefficient of the third Bezier curve. The meta data determiner 420 may determine meta data corresponding to a section in which graphic content is activated (section T2) by using the second Bezier curve to which the IIR filter is applied.

In addition, when the coefficients of the second Bezier curve and the coefficient of the third Bezier curve become the same, the metadata determination unit 420 uses the third Bezier curve to determine the meta data corresponding to the section in which the graphic content is activated. You can decide.

Based on the first Bezier curve to which the IIR filter is applied, the second Bezier curve to which the IIR filter is applied, and the third Bezier curve, the display device 100 includes HDR content (video content) and Tone mapping of graphic contents can be performed.

Accordingly, in the section in which the graphic content is activated, a sudden change from the first Bezier curve to the second Bezier curve does not occur (for example, the dotted line graph shown in Fig. 7A), and a rapid screen Changes in brightness can be prevented.

In addition, as shown in (b) of FIG. 7, when the coefficient of the first Bezier curve is smaller than the coefficient of the second Bezier curve (639), the meta data determination unit 420 is Until the coefficient becomes the same as the coefficient of the second Bezier curve, metadata corresponding to the section (T3 section) in which the graphic content is activated may be determined by using the first Bezier curve.

In addition, when the coefficients of the first Bezier curve and the coefficients of the second Bezier curve become the same, the IIR filter application unit 425 applies the IIR filter to the second Bezier curve, The second Bezier curve can be gradually transformed until the coefficients of the 3 Bezier curve become the same. The meta data determiner 420 may determine the converted second Bezier curve as meta data corresponding to the section T4 in which the graphic content is activated.

In addition, when the coefficients of the second Bezier curve and the coefficient of the third Bezier curve become the same, the metadata determination unit 420 uses the third Bezier curve to determine the meta data corresponding to the section in which the graphic content is activated. You can decide.

The display device 100 is based on a first Bezier curve, a second Bezier curve to which an IIR filter is applied, and a third Bezier curve, in a section in which graphic content is activated, tones of HDR content (video content) and graphic content. Mapping can be performed.

Accordingly, in the section in which the graphic content is activated, a rapid transition from the first Bezier curve to the second Bezier curve does not occur (for example, the dotted line graph shown in FIG. 7B), and a rapid screen Changes in brightness can be prevented.

8 is a flowchart illustrating a method of operating a display device according to an exemplary embodiment.

Referring to FIG. 8, the display apparatus 100 according to an embodiment may acquire video content, dynamic metadata corresponding to the video content, and static metadata (S810). Video content according to an embodiment may be HDR content.

When HDR content is stored in a data storage medium and reproduced in a playback device, the display device 100 may receive HDR content, dynamic metadata corresponding to the HDR content, and static metadata through an input/output unit. Alternatively, the display device 100 may receive HDR content, dynamic metadata corresponding to the HDR content, and static metadata from an external server through a network.

The display apparatus 100 according to an embodiment may determine a section in which the graphic content is activated based on dynamic metadata corresponding to the HDR content (S820).

Dynamic metadata according to an embodiment may include profile A data and profile B data. Profile A data may include luminance distribution information (percentile information) of an image, and profile B data may include Bezier Curve information of an image. However, it is not limited thereto.

The display apparatus 100 may determine a section in which graphic content is activated based on the percentage information of the profile A data and the change in Bezier curve information of the profile B data.

For example, when percentage information of Profile A data gradually changes to a value defined in static metadata, and Bezier curve information of Profile B data changes from'n' to '0', graphic content is activated. You can decide to become. Alternatively, if only the percentage information of the profile A data changes and the Bezier curve information of the profile B does not change, it may be determined that a change has occurred in the actual image of the HDR content (video content) rather than the graphic content being activated. have.

The display apparatus 100 according to an exemplary embodiment may determine metadata applied to a section in which graphic content is activated (S830).

Step 830 (S830) will be described in detail with reference to FIG. 9.

9 is a detailed flowchart illustrating step 830 (S830) of FIG. 8.

Referring to FIG. 9, in a period in which graphic content is activated, the display apparatus 100 may convert percentage information of profile A data into second Bezier curve information (S910). Also, the display device 100 may convert static metadata into third Bezier curve information.

The display apparatus 100 may compare the first Bezier curve information and the second Bezier curve information of the profile B data. The display apparatus 100 may compare the coefficients of the first Bezier curve and the coefficients of the second Bezier curve (S920 ).

When the coefficients of the first Bezier curve and the coefficients of the second Bezier curve are the same, the display apparatus 100 may perform tone mapping using the first Bezier curve without applying an IIR filter.

When the coefficient of the first Bezier curve is larger than the coefficient of the second Bezier curve, the display apparatus 100 applies an IIR filter to the first Bezier curve, so that the coefficient of the first Bezier curve is the second Bezier curve. Until the coefficient of is equal to, the first Bezier curve may be gradually transformed (S930). The display apparatus 100 may determine metadata corresponding to a section in which graphic content is activated using the first Bezier curve to which the IIR filter is applied.

When the coefficient of the first Bezier curve is smaller than the coefficient of the second Bezier curve, the display device 100 displays the first Bezier curve until the coefficient of the first Bezier curve becomes the same as the coefficient of the second Bezier curve. Meta data corresponding to a section in which graphic content is activated may be determined using the curve (S940).

When the coefficient of the first Bezier curve and the coefficient of the second Bezier curve become the same, the display apparatus 100 applies an IIR filter to the coefficient of the second Bezier curve, so that the coefficient of the second Bezier curve becomes the third Bezier curve. The second Bezier curve may be gradually transformed until the coefficient of the tailored curve becomes the same (S950). The display apparatus 100 may determine metadata corresponding to a section in which graphic content is activated using the second Bezier curve to which the IIR filter is applied.

Referring to FIG. 8 again, based on the determined metadata, the display apparatus 100 may perform tone mapping of HDR content (video content) and graphic content in a section in which graphic content is activated (S840).

10 is a block diagram illustrating a configuration of a display device according to an exemplary embodiment.

Referring to FIG. 10, the display apparatus 100 according to an exemplary embodiment may include an input/output unit 110, a processor 120, and a memory 130.

The input/output unit 110 according to an exemplary embodiment includes video (eg, video), audio (eg, voice, music, etc.) from the outside of the display device 100 under the control of the processor 120. ) And additional information (eg, EPG, etc.). Alternatively, the input/output unit 110 transmits video, audio, and additional information to an external device under the control of the processor 120. The input/output unit 110 may include one of an HDMI port (High-Definition Multimedia Interface port), a component jack, a PC port, and a USB port. The input/output unit 110 may include a combination of an HDMI port, a component jack, a PC port, and a USB port.

When HDR content according to an embodiment is stored in a data storage medium and played back in an external playback device, the input/output unit 110 provides HDR content from an external playback device, dynamic metadata corresponding to the HDR content, and static metadata. Can be received.

The processor 120 according to an embodiment may control the overall operation of the display device 100. Also, the processor 120 may control other components included in the display apparatus 100 to perform a predetermined operation.

The processor 120 according to an embodiment may execute one or more programs stored in the memory 130. The processor 120 may include a single core, a dual core, a triple core, a quad core, and a multiple of cores. In addition, the processor 120 may include a plurality of processors.

The memory 130 according to an embodiment may store various data, programs, or applications for driving and controlling the electronic device 100.

Also, a program stored in the memory 130 may include one or more instructions. A program (one or more instructions) or an application stored in the memory 130 may be executed by the processor 120.

The processor 120 according to an embodiment includes the operations of the mode change detection unit 410, the meta data conversion unit 421, the meta data comparison unit 423, and the IIR filter application unit 425 illustrated and described in FIG. 4. At least one can be performed or controlled to be performed. For example, while outputting HDR content, the processor 120 may determine whether to output graphic content based on dynamic metadata. For example, whether the percentage information of the profile A data included in the dynamic metadata gradually changes to a preset value, and the Bezier curve information of the profile B data included in the dynamic metadata is changed from'n' to '0'. Depending on whether it is changed to or not, a section in which the graphic content is activated may be determined.

When the graphic content is activated, the processor 120 may determine metadata applied to a section in which the graphic content is activated. The processor 120 may generate Bezier curve information (second Bezier curve information) of the profile B data by using the percentage information of the profile A data. Also, the processor 120 may generate Bezier curve information (third Bezier curve information) of profile B data by using static metadata.

The processor 120 receives Bezier curve information (first Bezier curve information) of the profile B data corresponding to the HDR content and Bezier curve information (second Bezier curve information) generated from the percentage information of the profile A data. A method of applying an IIR filter for determining meta data applied to a section in which graphic content is activated may be determined based on the comparison result and the comparison result. A method of determining an IIR filter application method has been described in detail with reference to FIGS. 6 and 7, and thus a detailed description thereof will be omitted.

The processor 120 may perform tone mapping of the HDR content (video content) and the graphic content in a section in which the graphic content is activated based on the determined metadata. In addition, the processor 120 may control the HDR content and graphic content for which the tone mapping has been performed to be displayed on the display.

In addition, the processor 120 transmits information on whether graphic content is output or a section in which the graphic content is activated to other components in the display device 100, and when image processing or image quality is processed by other components, the graphic content Accordingly, it is possible to prevent the characteristics of the actual video content image from being distorted.

11 is a block diagram illustrating a configuration of a display apparatus 1000 according to another exemplary embodiment.

The display device 1000 of FIG. 11 may be an embodiment of the display device 100 described with reference to FIGS. 1 to 10.

Referring to FIG. 11, a display device 1000 according to an embodiment includes a tuner unit 1040, a processor 1010, a display unit 1020, a communication unit 1050, a sensing unit 1030, an input/output unit. (1070), a video processing unit 1080, an audio processing unit 1085, an audio output unit 1060, a memory 1090, and a power supply unit 1095.

The input/output unit 1070 of FIG. 11 is in the input/output unit 110 of FIG. 10, the processor 1010 of FIG. 11 is in the processor 120 of FIG. 10, and the memory 1090 of FIG. 11 is in FIG. Since each corresponds to the memory 130 of 10, the same description will be omitted.

The tuner unit 1040 according to an embodiment is intended to be received by the electronic device 1000 from among many radio wave components through amplification, mixing, resonance, etc. of a broadcast signal received by wire or wirelessly. It can be selected by tuning only the frequency of the channel. The broadcast signal includes audio, video, and additional information (eg, Electronic Program Guide (EPG)).

The tuner unit 1040 may receive broadcast signals from various sources such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, and Internet broadcasting. The tuner unit 1040 may also receive a broadcast signal from a source such as analog broadcast or digital broadcast.

The communication unit 1050 according to an embodiment may transmit and receive data or signals with an external device or a server under the control of the processor 1010. The processor 1010 may transmit/receive content to/from an external device connected through the communication unit 1050, download an application from the external device, or browse the web. The communication unit 1050 corresponds to the performance and structure of the display device 1000, and provides a wireless LAN 1051 (for example, Wi-Fi), Bluetooth 1052, and wired Ethernet 1053. , IR (infrared), BLE (bluetooth low energy), ultrasound, and zigbee (zigbee) can transmit and receive data or signals in at least one method.

The communication unit 1050 according to an embodiment may receive HDR content, metadata corresponding to the HDR content, and graphic content from an external device.

The video processing unit 1080 processes video data received by the display apparatus 1000. The video processing unit 1080 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion on video data.

The sensing unit 1030 detects a user's voice, a user's image, or a user's interaction, and may include a microphone 1031, a camera unit 1032, and a light receiving unit 1033.

The microphone 1031 receives a user's uttered voice. The microphone 1031 may convert the received voice into an electrical signal and output it to the processor 1010. The user voice may include, for example, a voice corresponding to a menu or function of the electronic device 1000.

The camera unit 1032 may receive an image (eg, a continuous frame) corresponding to a user's motion including a gesture in the camera recognition range. The processor 1010 may select a menu displayed on the electronic device 1000 by using the received motion recognition result or perform a control corresponding to the motion recognition result.

The light receiving unit 1033 receives an optical signal (including a control signal) received from an external control device through a light window (not shown) of the bezel of the display unit 1020. The light receiving unit 1033 may receive an optical signal corresponding to a user input (eg, a touch, a push, a touch gesture, a voice, or a motion) from the control device. A control signal may be extracted from the received optical signal under control of the processor 1010.

The input/output unit 1070 includes video (for example, video), audio (for example, voice, music, etc.) and additional information (for example, from outside the display device 1000) under the control of the processor 1010. For example, EPG, etc.). Alternatively, the input/output unit 1070 transmits video, audio, and additional information to an external device under the control of the processor 1010. The input/output unit 1070 is one of an HDMI port (High-Definition Multimedia Interface port, 1071), a component jack (1072), a PC port (PC port, 1073), and a USB port (USB port, 1074). It may include.

The processor 1010 controls the overall operation of the display device 1000 and a signal flow between internal components of the electronic device 1000 and processes data. The processor 1010 may execute an OS (Operation System) stored in the memory 1090 and various applications when there is a user input or a preset and stored condition is satisfied.

The processor 1010 stores a signal or data input from the outside of the display device 1000, or is used as a storage area corresponding to various tasks performed by the electronic device 1000, a display device 1000 It may include a ROM (ROM) and a processor (Processor) in which a control program for controlling the control program is stored.

The processor 1010 may include a graphic processing unit (not shown). The graphic processing unit (not shown) generates a screen including various objects such as icons, images, texts, etc. using an operation unit (not shown) and a rendering unit (not shown). The operation unit calculates attribute values such as coordinate values, shape, size, color, etc. to be displayed for each object according to the layout of the screen by using the user input sensed through the detection unit 1030. The rendering unit generates screens of various layouts including objects based on the attribute values calculated by the calculation unit. The screen generated by the rendering unit is displayed in the display area of the display unit 1020.

The display unit 1020 converts an image signal, a data signal, an OSD signal, a control signal, and the like processed by the processor 1010 to generate a driving signal. The display unit 1020 may be implemented as a PDP, LCD, OLED, flexible display, or the like, and may also be implemented as a 3D display. In addition, the display unit 1020 may be configured as a touch screen and used as an input device other than an output device.

The audio processing unit 1085 processes audio data. The audio processing unit 1085 may perform various processing such as decoding, amplification, noise filtering, and the like for audio data. Meanwhile, the audio processing unit 1085 may include a plurality of audio processing modules to process audio corresponding to a plurality of contents.

The audio output unit 1060 outputs audio included in a broadcast signal received through the tuner unit 1040 under the control of the processor 1010. The audio output unit 860 may output audio (eg, voice, sound) input through the communication unit 1050 or the input/output unit 1070. Also, the audio output unit 1060 may output audio stored in the memory 1090 under the control of the processor 1010. The audio output unit 1060 may include at least one of a speaker 1061, a headphone output terminal 1062, or an S/PDIF (Sony/Philips Digital Interface: output terminal 1063). The audio output unit 1060 may include A combination of a speaker 1061, a headphone output terminal 1062, and an S/PDIF output terminal 1063 may be included.

The power supply unit 1095 supplies power input from an external power source to components inside the display apparatus 1000 under the control of the processor 1010. Also, the power supply unit 1095 may supply power output from one or more batteries (not shown) located inside the display apparatus 1000 under the control of the processor 1010 to internal components.

The memory 1090 may store various data, programs, or applications for driving and controlling the display apparatus 1000 under the control of the processor 1010. The memory 1090 includes a broadcast reception module, a channel control module, a volume control module, a communication control module, a voice recognition module, a motion recognition module, an optical reception module, a display control module, an audio control module, an external input control module, and a power supply. It may include a control module, a power control module of an external device connected wirelessly (eg, Bluetooth), a voice database (DB), or a motion database (DB). Modules and databases not shown in the memory 1090 include a control function of broadcast reception, a channel control function, a volume control function, a communication control function, a voice recognition function, a motion recognition function, and an optical reception control function in the display device 1000. , A display control function, an audio control function, an external input control function, a power control function, or a power control function of an external device connected by wireless (eg, Bluetooth) may be implemented in a software form. The processor 1010 may perform each function using these software stored in the memory 1090.

Meanwhile, the block diagrams of the display devices 100 and 1000 illustrated in FIGS. 10 and 11 are block diagrams for an exemplary embodiment. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the display devices 100 and 1000 that are actually implemented. That is, if necessary, two or more components may be combined into one component, or one component may be subdivided into two or more components to be configured. In addition, the functions performed by each block are for describing the embodiments, and specific operations or devices thereof do not limit the scope of the present invention.

A method of operating a display device according to an exemplary embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

In addition, a method of operating a display device according to the disclosed embodiments may be included in a computer program product and provided. Computer program products can be traded between sellers and buyers as commodities.

The computer program product may include a S/W program and a computer-readable storage medium in which the S/W program is stored. For example, a computer program product may include a product in the form of a S/W program (eg, a downloadable app) that is electronically distributed through a manufacturer of a broadcast receiving device or an electronic market (eg, Google Play Store, App Store). I can. For electronic distribution, at least a part of the S/W program may be stored in a storage medium or may be temporarily generated. In this case, the storage medium may be a server of a manufacturer, a server of an electronic market, or a storage medium of a relay server temporarily storing SW programs.

The computer program product may include a storage medium of a server or a storage medium of a client device in a system composed of a server and a client device. Alternatively, when there is a third device (eg, a smart phone) that is communicatively connected to a server or a client device, the computer program product may include a storage medium of the third device. Alternatively, the computer program product may include a S/W program itself transmitted from a server to a client device or a third device, or transmitted from a third device to a client device.

In this case, one of the server, the client device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments. Alternatively, two or more of a server, a client device, and a third device may execute a computer program product to distribute and implement the method according to the disclosed embodiments.

For example, a server (eg, a cloud server or an artificial intelligence server) may execute a computer program product stored in the server to control a client device communicating with the server to perform the method according to the disclosed embodiments.

Although the embodiments have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concept of the present invention defined in the following claims are also included in the scope of the present invention. Belongs to.

Claims (20)

In the display device,
A memory that stores one or more instructions; And
A processor that executes the one or more instructions stored in the memory,
The processor,
Receiving video content, dynamic metadata corresponding to the video content, and static metadata, and determining a section in which graphic content is activated during reproduction of the video content, based on the dynamic metadata,
Based on the profile A data, the profile B data, and the static data included in the dynamic metadata, metadata applied to a section in which the graphic content is activated is determined,
Determining the metadata so that the metadata is gradually converted from the profile B data to the static metadata based on a difference between the profile B data and the conversion profile B data generated based on the profile A data, Display device. The method of claim 1,
The processor,
The display device, wherein a section in which the graphic content is activated is determined based on whether Bezier Curve information of the profile B data changes from n to 0. The method of claim 2,
The processor,
The display device, wherein the period in which the graphic content is activated is determined based on whether the percentage information of the profile A data gradually changes from the static metadata to a predefined value. The method of claim 1,
The processor,
The display device, wherein the conversion profile B data is generated by converting percentage information of the profile A data of a section in which the graphic content is activated into Bezier curve information. The method of claim 1,
The processor,
Based on the difference between the coefficient of the first Bezier curve of the profile B data and the coefficient of the second Bezier curve of the transformed profile B data, the metadata is gradually converted from the profile B data to the static metadata. A display device that determines the metadata. The method of claim 5,
The processor,
Based on the difference between the coefficient of the first Bezier curve of the profile B data and the coefficient of the second Bezier curve of the transform profile B data, an IIR filter is applied to the first Bezier curve and the second Bezier curve. , Determining the metadata, a display device. The method of claim 6,
The processor,
When the coefficient of the first Bezier curve is larger than the coefficient of the second Bezier curve, an IIR filter is applied to the first Bezier curve, so that the coefficient of the first Bezier curve is of the second Bezier curve. Until the coefficient is equal to, the first Bezier curve is gradually transformed, and when the coefficient of the first Bezier curve and the coefficient of the second Bezier curve become the same, an IIR filter is applied to the second Bezier curve. Applying and gradually transforming the second Bezier curve to determine the metadata. The method of claim 6,
The processor,
When the coefficient of the first Bezier curve is smaller than the coefficient of the second Bezier curve, the first Bezier curve until the coefficient of the first Bezier curve is the same as the coefficient of the second Bezier curve Is determined as the metadata,
When the coefficient of the first Bezier curve and the coefficient of the second Bezier curve become the same, the meta data is converted by gradually converting the second Bezier curve by applying an IIR filter to the second Bezier curve. To determine, display device. The method of claim 1,
The display device,
Further comprising a display,
The processor,
A display apparatus comprising: applying the metadata to a section in which the graphic content is activated to perform tone mapping of the video content and graphic content, and controlling the display to display the tone-mapped video content and graphic content. The method of claim 1,
The display device,
The display device further comprising an input/output unit for receiving the video content, the dynamic metadata and static metadata. In the operating method of the display device,
Receiving video content, dynamic metadata corresponding to the video content, and static metadata;
Determining a section in which graphic content is activated during reproduction of the video content based on the dynamic metadata; And
Based on the profile A data, the profile B data, and the static data included in the dynamic metadata, determining metadata applied to a section in which the graphic content is activated,
Meta data applied to the section in which the graphic content is activated is based on a difference between the profile B data and the conversion profile B data generated based on the profile A data, and the meta data is the static data in the profile B data. A method of operating a display device, which is determined to be gradually converted into metadata. The method of claim 11,
Determining a section in which the graphic content is activated,
And determining a section in which the graphic content is activated based on whether Bezier Curve information of the profile B data changes from n to 0. The method of claim 12,
Determining a section in which the graphic content is activated,
A display device comprising the step of determining a section in which the graphic content is activated based on whether the percentage information of the profile A data gradually changes from the static metadata to a predefined value. How to operate. The method of claim 11,
The step of determining the meta data,
And generating the converted profile B data by converting percentage information of the profile A data in a section in which the graphic content is activated into Bezier curve information. The method of claim 11,
The step of determining the meta data,
Based on the difference between the coefficient of the first Bezier curve of the profile B data and the coefficient of the second Bezier curve of the transformed profile B data, the metadata is gradually converted from the profile B data to the static metadata. And determining the metadata. The method of claim 15,
The step of determining the meta data,
Applying an IIR filter to the first Bezier curve and the second Bezier curve based on the difference between the coefficient of the first Bezier curve of the profile B data and the coefficient of the second Bezier curve of the transform profile B data, And determining the metadata. The method of claim 16,
The step of determining the meta data,
When the coefficient of the first Bezier curve is greater than the coefficient of the second Bezier curve, an IIR filter is applied to the first Bezier curve, so that the coefficient of the first Bezier curve is the coefficient of the second Bezier curve. Determining the meta data by gradually transforming the first Bezier curve until it becomes equal to <RTI ID=0.0>a</RTI> And
When the coefficient of the first Bezier curve and the coefficient of the second Bezier curve become the same, the meta data is determined by applying an IIR filter to the second Bezier curve and gradually converting the second Bezier curve. Operating method of a display device comprising the step of. The method of claim 16,
The step of determining the meta data,
When the coefficient of the first Bezier curve is smaller than the coefficient of the second Bezier curve, the first Bezier curve until the coefficient of the first Bezier curve is the same as the coefficient of the second Bezier curve Determining as the metadata; And
When the coefficient of the first Bezier curve and the coefficient of the second Bezier curve become the same, the meta data is converted by gradually converting the second Bezier curve by applying an IIR filter to the second Bezier curve. A method of operating a display device comprising the step of determining. The method of claim 11,
The operation method,
Performing tone mapping of the video content and the graphic content by applying the metadata to a section in which the graphic content is activated; And
Further comprising the step of displaying the tone-mapped video content and graphic content. One or more computer-readable recording media in which a program for performing the method of claim 11 is stored.

Images