KR20190132072A - Electronic apparatus, method for controlling thereof and recording media thereof - Google Patents

Abstract

The present invention relates to an electronic device, a control method thereof, and a recording medium thereof, the electronic device comprising: a connection unit; a storage unit; a video processing unit processing a video signal; first and second graphic processing units processing a graphic signal; and a processor which determines the types of the video signal and the graphic signal, which are supportable, based on recognition data of a display device connected through the connection unit, converts one between a first graphic signal related to the video signal from the first graphic processing unit and a second graphic signal stored in the storage unit corresponding to the determined type of the graphic signal, such that the first graphic signal and the second graphic signal may be mixed and outputted, and receives the video signal outputted through the video processing unit from the second graphic processing unit and the graphic signal outputted from the first graphic processing unit, to control such that an output signal based on the received video signal and graphic signal may be transmitted to an external device through the connection unit. Therefore, the graphic signal, composed of a plurality of layers, can undergo a parallel processing by using a GPU operated by the execution of software.

Description

ELECTRICAL APPARATUS, METHOD FOR CONTROLLING THEREOF AND RECORDING MEDIA THEREOF

The present invention relates to an electronic device, a control method thereof, and a recording medium, and more particularly, to an electronic device capable of processing a graphic signal, a control method thereof, and a recording medium.

Optical disc playback devices that include Blu-ray discs (BDs) or Ultra high definition (UHD) BDs, that is, electronic devices such as players, correspond to content stored on discs via wired or wireless interfaces. The video signal is processed and provided to an external device such as a television.

The video signal provided from the electronic device to the external device includes a video signal and a graphic signal. The graphic signal is embedded in the electronic device in addition to the graphic signal included in the content and is used as an on-screen display (OSD) or user interface (UI). There is a case where the graphic signal is further provided.

The two graphic signals as described above may have different characteristics. For example, a graphic signal included in content may follow a high dynamic range (HDR) format, whereas a graphic signal embedded in an electronic device may follow a standard dynamic range (SDR) format.

However, a configuration for processing a graphic signal in an electronic device is often made of a single path, and in this case, it is impossible to process a graphic signal composed of a plurality of layers in parallel corresponding to each characteristic. Done.

Accordingly, any one graphic signal may be provided to an external device without being processed according to its characteristics, and there is a problem in that image distortion is not generated because the graphic signal transmitted from the external device is not normally expressed.

On the other hand, a display device such as a TV is provided with a configuration for processing graphics signals, and in an environment having a mass production facility that produces both a TV and a player, the same graphic processing unit (IC) is used for both devices, thereby increasing productivity and cost. There is a demand to reduce costs.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems. When the graphic signal is composed of a plurality of layers, an electronic device for enabling parallel graphics processing using a GPU operated by execution of software, a control method thereof, and a recording medium. To provide.

In addition, the present invention is to provide an electronic device, a control method and a recording medium suitable for a mass production environment with high productivity and low cost by enabling a hardware chip supporting a single path to be simultaneously used in a playback device and a display device. .

An electronic device according to an embodiment of the present invention includes a connection portion connectable to a display device; Storage unit; A video processor which processes a video signal; First and second graphic processing units which process graphic signals; Read identification data from the display device connected through the connection unit, and determine the format of the video signal and the graphic signal that can be supported by the display device based on the identification data, the first graphic processing unit in the first graphic signal and the storage unit Converts any one of the stored second graphic signals corresponding to the determined graphic signal format, and controls the graphic signal of a single layer to be output by mixing the first graphic signal and the second graphic signal, and the video processor in the second graphic processor. And a processor configured to receive a video signal output from the first graphic processor and a graphic signal output from the first graphic processor, and to transmit an output signal based on the received video signal and the graphic signal to an external device through the connection unit. Here, the first graphic processor may execute a predetermined program and convert one of the first graphic signal and the second graphic signal according to the format of the graphic signal determined by the executed program. As a result, the graphic signal may be processed in parallel using a GPU operated by execution of software in the electronic device.

The second graphic processing unit may include at least one processing module capable of processing the graphic signal and an output module outputting the output signal to the connection unit. Here, the processor sets the graphic signal received from the first graphic processor to bypass the at least one processing module of the second graphic processor by the reference to the setting information stored in the storage unit, and transmits the graphic signal to the output module. When the occurrence of a predetermined event is detected, the second graphic processor sets the second graphic processor to bypass the graphic signal with reference to the setting information from the storage. Or it may include at least one of the user input. Therefore, the hardware chip used in the TV can be applied to the playback apparatus.

According to the determination result, the first graphic processor may perform color space conversion and gamma conversion on any one of the first graphic signal and the second graphic signal. Accordingly, since the graphic signal is converted in accordance with the specification of the external device, image distortion is not generated in the external device.

The first graphic processor may further perform at least one of animation processing, 2D or 3D graphic processing, geometry coordinate processing, acceleration processing, or transparency adjustment on at least one of the first graphic signal and the second graphic signal. Accordingly, various graphics processing using the GPU in the electronic device is supported.

The video signal and the first graphic signal are included in the content, and the first graphic signal includes an IG (interactive graphic) and a presentation graphic (PG), and the second graphic signal is a user interface (UI) or OSD (stored in a storage unit). on screen display). The electronic device may include: an optical disc storage unit storing content including a video signal and a first graphic signal; And a disk loader for reading data from the optical disk storage unit. Thus, both the graphic signal stored in the content and the graphic signal embedded in the playback apparatus itself are effectively processed and displayed.

The video processor converts the video signal to correspond to the determined video signal format according to the determination result, and the second graphic processor may generate the output signal by mixing the changed video signal with the graphic signal output from the first graphic processor. have. Thus, both the video signal and the graphic signal are processed and displayed in accordance with the specification of the external device.

The first graphic processor and the second graphic processor may be integrally provided. Therefore, the graphics chip (SoC) can be used simultaneously for the playback device and the display device, which is suitable for mass production environments.

On the other hand, a control method of an electronic device according to an embodiment of the present invention includes reading identification data from a display device connected through a connection unit, and determining a format of a video signal and a graphic signal supported by the display device based on the identification data; Outputting a video signal to a video processor and outputting a first graphic signal associated with the video signal and a second graphic signal stored in the storage to the first graphic processor; Converting, by the first graphic processor, one of the first graphic signal and the second graphic signal to correspond to the determined graphic signal format; Mixing the first graphic signal with the second graphic signal and outputting a single layer graphic signal to the second graphic processor; Receiving a video signal output from the video processor and a graphic signal output from the first graphic processor in the second graphic processor; And transmitting an output signal based on the received video signal and the graphic signal to the display apparatus through the connection unit. The method may further include executing a predetermined program by the first graphic processor and converting any one of the first graphic signal and the second graphic signal according to the format of the graphic signal determined by the executed program. As a result, the graphic signal may be processed in parallel using a GPU operated by execution of software in the electronic device. Here, the second graphic processing unit includes at least one processing module capable of processing a graphic signal and an output module for outputting an output signal to the connection unit, and received from the first graphic processing unit with reference to the setting information stored in the storage unit. And setting a graphic signal to bypass at least one processing module of the second graphic processor to be delivered to the output module. When a occurrence of a predetermined event is detected, the second graphic processing is performed by referring to setting information from the storage unit. The method may further include setting to bypass the additional graphic signal, and the event may include at least one of booting the electronic device, input of content including a video signal and a graphic signal, or a user input. Therefore, the hardware chip used in the TV can be applied to the playback apparatus.

The converting may include performing color space conversion and gamma conversion on any one of the first graphic signal and the second graphic signal according to the determination result. Accordingly, since the graphic signal is converted in accordance with the specification of the external device, image distortion is not generated in the external device.

In the first graphic processor, performing at least one of animation processing, 2D or 3D graphics processing, geometry coordinate processing, acceleration processing, or transparency adjustment on at least one of the first graphics signal and the second graphics signal; can do. Accordingly, various graphics processing using the GPU in the electronic device is supported.

The video signal and the first graphic signal may be included in the content, the first graphic signal may include IG and PG, and the second graphic signal may include a UI or an OSD stored in the storage. Thus, both the graphic signal stored in the content and the graphic signal embedded in the playback apparatus itself are effectively processed and displayed.

In the video processor, converting the video signal to correspond to the determined video signal format according to the determination result; The method may further include mixing the converted video signal with a graphic signal output from the first graphic processor to generate an output signal. Thus, both the video signal and the graphic signal are processed and displayed in accordance with the specification of the external device.

On the other hand, in a non-volatile recording medium readable by a computer, in which a program of a method executable by a processor of an electronic device according to an embodiment of the present invention is recorded, the method reads identification data from a display device connected through a connection unit. Determining a format of a video signal and a graphic signal supported by the display apparatus based on the identification data; Outputting a video signal to a video processor and outputting a first graphic signal associated with the video signal and a second graphic signal stored in the storage to the first graphic processor; Converting, by the first graphic processor, one of the first graphic signal and the second graphic signal to correspond to the determined graphic signal format; Mixing the first graphic signal with the second graphic signal and outputting a single layer graphic signal to the second graphic processor; Receiving a video signal output from the video processor and a graphic signal output from the first graphic processor in the second graphic processor; And transmitting an output signal based on the received video signal and the graphic signal to an external device through the connection unit. As a result, the graphic signal may be processed in parallel using a GPU operated by execution of software in the electronic device.

According to the electronic device, the control method and the recording medium of the present invention as described above, in the case where the graphic signal is composed of a plurality of layers, the parallel graphics processing is performed using a GPU operated by the execution of software, thereby outputting the output device. In this case, the distortion of the image does not occur.

In addition, the present invention can be used in the playback device and the display device at the same time can be used for graphics processing composed of a plurality of layers while supporting a single path, there is an effect to increase productivity and reduce costs in a mass production environment.

1 is an example of a system including an electronic device and an external device according to an embodiment of the present invention.
2 is a diagram illustrating an example of displaying an image based on a video signal and a graphic signal according to an exemplary embodiment of the present invention.
3 is a diagram illustrating a process of processing a video signal and a graphic signal composed of a plurality of layers in an electronic device according to an embodiment of the present invention.
4 is a block diagram illustrating a configuration of an electronic device according to an embodiment of the present invention.
5 is a block diagram illustrating a configuration of a first graphic processing unit and a second graphic processing unit according to an exemplary embodiment of the present invention.
6 is a block diagram illustrating a configuration of an external device according to an embodiment of the present invention.
7 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present invention.
8 is a diagram illustrating an example in which a video signal and a graphic signal are processed in the first embodiment of the present invention.
9 is a diagram illustrating an example in which a video signal and a graphic signal are processed in the second embodiment of the present invention.
FIG. 10 is a diagram showing an example in which a video signal and a graphic signal are processed in the third embodiment of the present invention.
FIG. 11 is a diagram showing an example in which a video signal and a graphic signal are processed in the fourth embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings will be described embodiments of the present invention; In the drawings, the same reference numerals or symbols refer to components that perform substantially the same function, and the sizes of the components in the drawings may be exaggerated for clarity and convenience of description. However, the technical spirit of the present invention and its core configuration and operation are not limited to the configuration or operation described in the following embodiments. In describing the present invention, when it is determined that the detailed description of the known technology or configuration related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

In an embodiment of the present invention, terms including ordinal numbers, such as first and second, are used only for the purpose of distinguishing one component from other components, and the singular forms "a", "an" and "the" are used in the plural unless the context clearly indicates otherwise. Includes expressions of In addition, in the embodiments of the present invention, the terms 'consist of', 'comprise', 'have', and the like may include one or more other features or numbers, steps, operations, components, parts, or combinations thereof. Or it should be understood that does not exclude the possibility of addition in advance. In addition, in the embodiment of the present invention, the 'module' or 'unit' performs at least one function or operation, and may be implemented in hardware or software or a combination of hardware and software, and integrated into at least one module. Can be implemented. In addition, in an embodiment of the present invention, at least one of the plurality of elements refers to not only all of the plurality of elements, but also each one or a combination thereof excepting the rest of the plurality of elements.

1 is an example of a system including an electronic device and an external device according to an embodiment of the present invention.

As shown in FIG. 1, an electronic device 100 according to an embodiment of the present invention provides a content providing device that provides image content (hereinafter, also referred to as content) to at least one external device 200, that is, a source device. device). The electronic device 100 may be provided as a player for playing content on the external device 200.

The external device 200 operates as a sync device. The external device 200 is wired or wirelessly connected to the electronic device 100 to process data output from the electronic device 100 and display an image based on the data. In addition, the external device 200 may include a video, still image, application, on-screen display (OSD), and a user interface (UI) for controlling various operations based on signals / data stored in an internal or external storage medium. Signal) to display on the screen.

The connection method of the electronic device 100 and the external device 200 may use various wired / wireless standard interfaces.

The electronic device 100 may play or relay content such as an optical disc playback device such as a Blu-ray Disc, a UHD Blu-ray Disc, or a DVD (digital versatile disc), an AV receiver (audio / video receiver), a set-top box, a streaming device, and the like. It includes an overall device for. The electronic device 100 implemented as a streaming device is provided with a receiver for receiving content provided in the form of a file according to real-time streaming from the outside, and the receiver is included in a communication unit (120 of FIG. 4) described later.

The external device 200 is provided with a display (290 of FIG. 6) for displaying an image, and includes a display device such as a television (TV), a mobile device, a laptop or a desktop computer. ) Various devices such as a device (or a monitor connected to a computer main body).

In an embodiment, as illustrated in FIG. 1, the external device 200 may include a television (TV) for processing a broadcast image based on at least one of a broadcast signal, broadcast information, or broadcast data received from a transmission apparatus of a broadcast station. The same display device is included. For example, the external device 200 may wirelessly receive a radio frequency (RF) signal, that is, a broadcast signal transmitted from a broadcasting station, and for this purpose, a tuner for tuning an antenna and a broadcast signal for receiving a broadcast signal for each channel. It may further include.

In the external device 200, a broadcast signal may be received through a terrestrial wave, a cable, a satellite, and the like, and the signal supply source in the present invention is not limited to the electronic device 100 or the broadcast station. That is, any device or station capable of transmitting and receiving data may be included in the signal supply source of the present invention.

The standard of the signal received from the external device 200 may be configured in various ways corresponding to the implementation form of the device, for example, high definition multimedia interface (HDMI), composite video, component video. By using a super video, SCART, specifications, etc., video signals can be received by wire.

In addition, the external device 200 may receive image content by wireless communication from various devices including the electronic device 100 and a server (not shown). According to an embodiment of the present invention, the external device 200 may perform at least one of wireless communication through an access point (AP) or wireless communication directly connected to another device without an AP. For example, the external device 200 may receive content from the electronic device 100 through a wireless communication such as Wi-Fi or Wi-Fi Direct.

In one embodiment, the display device provided as the external device 200 may operate as a smart TV or an IP (Internet Protocol TV). Smart TVs can receive and display broadcast signals in real time, and have a web browsing function that enables the display of real-time broadcast signals and the search and consumption of various contents through the Internet. to be. Smart TVs also include an open software platform that can provide interactive services to users. Accordingly, the smart TV may provide a user with an application that provides various contents, for example, a predetermined service, through an open software platform. Such applications are applications that can provide various kinds of services, and include, for example, applications that provide services such as SNS, finance, news, weather, maps, music, movies, games, and e-books.

In addition, the external device 200 according to an embodiment of the present invention may be a mobile device capable of wireless communication with the electronic device 100. The mobile device can be implemented with a variety of portable digital devices. For example, a smart phone, a smart pad such as a tablet, a personal digital assistant (PDA), as well as a head mounted display. A wearable device that can be worn on a user's body, such as a head mounted display (HMD) device or a smart watch, is also included. The HMD device provides the user with a virtual reality (VR), mixed reality (MR) or augmented reality (AR) environment in which virtual objects are fused to the real world through the display.

In the present invention, the type, number, or connection method of the external device 200 is not limited to that shown in FIG. 1. As another embodiment, only the mobile device is provided as the external device 200, or both the display device and the mobile device are provided. It may be provided to include two or more display devices or two or more mobile devices. As another embodiment, the display device may receive content from the electronic device 100 through wireless communication, or the mobile device may be connected to the electronic device 100 through a wired interface to receive the content.

The video signal provided from the electronic device 100 to the external device 200 includes a video signal and a graphic signal.

2 is a diagram illustrating an example of displaying an image based on a video signal and a graphic signal according to an exemplary embodiment of the present invention.

As shown in FIG. 2, the video signal 310 is displayed as a main image on the display of the external device 200.

The graphic signal 320 corresponds to an OSD or a UI (hereinafter referred to as a graphical user interface (GUI)) displayed for transmitting information to a user or controlling various operations. In an embodiment, the image according to the graphic signal 320 is displayed on the display 290 by being overlaid or overlayed on top of the image based on the video signal, or the image based on the video signal 310 is displayed. It may be displayed in a separate area separate from the area.

According to an embodiment of the present invention, the graphic signal 320 includes a first graphic signal 321 provided in the content and a second graphic signal 322 which is internally embedded in the electronic device 100. The second graphic signal includes a graphic necessary for the operation of the electronic device 100, and the external device 200 may use a graphic for controlling the electronic device 100 as well as a graphic provided from the content. Both the signal 321 and the second graphic signal 322 need to be transmitted to the external device 200.

Data for providing the video signal 310 and the first graphic signal 321 is included in content such as a movie stored in a disc such as BD or DVD or provided in a file form such as streaming. The first graphic signal 321 corresponds to subpictures, subtitles, teletext, and the like included in the content. In an embodiment, the first graphic signal may include an interactive graphic (IG) and a presentation graphic (PG).

FIG. 2 illustrates an example in which the first graphic signal 321 is displayed in such a manner as to cover at least a part of an area of a video signal according to an on-screen graphic function. In the present invention, the first graphic signal 321 is displayed. The form is not limited to FIG. For example, according to the double screen function, the entire screen is divided into a video signal area and a graphic signal area by a predetermined ratio such as 1: 1 or 2: 1, and the graphic signal does not cover the video signal area. The first graphic signal 321 may be implemented to be displayed in the separated graphic area. In addition, the first graphic signal 321 such as a caption may be displayed to overlap the upper portion of the video signal 310.

The second graphic signal 322 is an OSD or UI provided by the electronic device 100 itself and includes a menu item. In an embodiment, the second graphic signal 321 is embedded in a storage unit (170 of FIG. 4, for example, a flash memory) of the electronic device 100, which will be described later.

The video signal and the first graphic signal are configured to have a corresponding format, i.e., a standard, in accordance with the content format thereof.

One of the main factors that determine the quality of the content is the contrast on the screen, and the darkest part (eg black) from the lightest part (eg white) on one screen. As the contrast level distributed to) is subdivided, the image becomes clearer.

In detail, the high dynamic range (HDR) content is expressed by dividing the brightness level up to 1,000 nits of brightness, and the standard dynamic range (SDR) content is expressed by dividing the brightness level up to 100 nits of brightness. The content according to the HDR or SDR may further include metadata, which is additional data related to an attribute of the content, for example, brightness (brightness), in addition to the video signal and the graphic signal displayed as an image.

In the embodiment of the present invention, the video signal and the graphic signal are configured according to the above content format, i.e., the format. That is, in the case of video signals and graphic signals according to the HDR format, gamma has a value according to ST.2084 standard, and colorimetry or color gamut is based on BT.2020 standard. Can have In addition, in the case of a video signal and a graphic signal according to the SDR format, gamma may have a value according to the ST.1886 standard, and colormetry may have a value according to the BT.709 standard.

According to an embodiment, the image signal processed by the electronic device 100 may include a video signal and a graphic signal, and the graphic signal may be composed of a plurality of layers.

3 is a diagram illustrating a process of processing a video signal and a graphic signal composed of a plurality of layers in an electronic device according to an embodiment of the present invention.

In the electronic device 100 according to an exemplary embodiment of the present invention, the first graphic signal and the second graphic signal to be processed may have different formats. As an example, as shown in FIG. 3A, the video signal 410 and the first graphic signal 421 included in the content have a first format (eg, HDR), and the electronic device 100 is used. The second graphic signal 422 embedded therein may have a second format (eg, SDR).

In FIG. 3A, the video signal and the first graphic signal are HDR, and the second graphic signal is SDR. For example, the present invention is not limited thereto. For example, in another embodiment, the video signal and the first graphic signal may be SDR, and the second graphic signal may be HDR. In another embodiment, the video signal and the first graphic signal are HDR, and the second graphic signal may be It may be configured according to a low dynamic range (LDR) format.

As shown in FIG. 3A, when the graphic signal 420 is composed of a plurality of layers having different formats, the graphic signals 421 and 422 need to be processed in parallel / independently corresponding to the formats. .

However, in a chip (SoC) that is typically used as a graphics processing unit in a TV, the graphics processing is performed along a single path configured in series.

When a graphic signal composed of a plurality of layers is processed along a single path, as shown in FIG. 3 (b), two graphic signals 421 and 422 of different formats are combined and displayed as they are, and thus distortion in color of a graphic, etc. May occur. For example, when the SDR to HDR conversion is uniformly performed on the first graphic signal based on HDR and the second graphic signal based on SDR, distortion is generated in the HDR graphic signal.

Accordingly, the electronic device 100 according to the embodiment of the present invention configures a graphic processing unit to process graphic signals composed of a plurality of layers in parallel, so that each graphic signal is processed according to its format, so that graphic distortion does not occur. Do not.

For example, the electronic device 100 converts one of the first graphic signal and the second graphic signal to correspond to a predetermined graphic format so that the formats of the two graphic signals match, and then the first graphic signal and the second graphic. The signals may be mixed and transmitted to the external device 200.

The converting process of the graphic signal includes changing at least one attribute value of the graphic signal. Attribute values to be changed include gamma characteristics (e.g., ST. 2084 gamma to ST.1886 gamma), color gamut characteristics (e.g., BT.2020 color gamut to BT.709 color gamut) And the like.

In an embodiment, the electronic device 100 determines a format of a video signal and a graphic signal that can be supported by the external device 200 that receives the signal, and according to the determination result, any one of the first graphic signal and the second graphic signal is determined. One can be converted to correspond to the determined graphic signal format. Here, the electronic device 100 may further convert the video signal corresponding to the determined video signal format according to the determination result.

In another embodiment, the electronic device 100 converts at least one of the first graphic signal and the second graphic signal to correspond to the default format, regardless of the format supported by the external device 200, thereby converting the format of the two graphic signals. Can be matched. Here, the electronic device 100 may further convert the video signal to correspond to the default format.

A detailed operation of selectively converting a graphic signal or a video signal and transmitting the same will be described in more detail in the following embodiments. Hereinafter, the term 'content', 'image content' or 'content signal' may refer to a video signal corresponding to the content, and providing, transmitting, receiving, processing or converting the content corresponds to the video signal corresponding to the content. Providing, transmitting, receiving, processing or converting. In addition, a video signal or a content signal is defined as a term including a video signal and a graphic signal.

Hereinafter, specific configurations of an electronic device and an external device wired or connected thereto according to an embodiment of the present invention will be described with reference to the accompanying drawings.

4 is a block diagram illustrating a configuration of an electronic device according to an embodiment of the present invention.

As shown in FIG. 2, the electronic device 100 according to an exemplary embodiment of the present invention may include a connection unit 110, a communication unit 120, a video processing unit 130, a first graphic processing unit 140, and a second graphic processing unit. 150, a user input unit 160, a storage unit 170, and a controller 180.

The connection unit 110 allows the electronic device 100 and the external device 200 to be wired. The electronic device 100 may transmit an image signal to the external device 200 through a wired connection 110.

The connection unit 110 may be implemented as a communication circuitry including a data input / output interface in which a communication module (S / W module, chip, etc.) corresponding to various types of communication protocols and a port are combined. . The connection unit 110 basically transmits a signal to the external device 200, but may be provided to transmit and receive a signal in both directions.

In one embodiment, the connection unit 110 is connected to the external device 200 via an HDMI cable, but the connection method is not limited to HDMI.

In an exemplary embodiment, the external device 200 that is wired to the electronic device 100 through the connection unit 110 may be a display device such as a TV, but the present invention is not limited thereto. For example, as another embodiment, the electronic device 100 may be wired to the mobile device through the connection unit 110.

The communication unit 120 performs wireless communication with at least one external device 200. The electronic device 100 may wirelessly transmit an image signal to the external device 200 through the communication unit 120.

The communication unit 120 may be implemented as communication circuitry including a wireless communication module (S / W module, chip, etc.) corresponding to various types of communication protocols.

In one embodiment, the communication unit 120 includes a wireless LAN unit. The WLAN unit may be connected to the external device 200 wirelessly through an access point (AP) under the control of the processor 180. The wireless LAN unit includes a Wi-Fi communication module.

In one embodiment the communication unit 120 The short range communication module supports direct communication between the electronic device 100 and the external device 200 wirelessly without an AP. The near field communication module includes Wi-Fi Direct, Bluetooth, Bluetooth low energy, radio frequency (RF) communication, infrared communication (IrDA), Zigbee, and UWB ( Ultra Wideband) and at least one of NFC (Near Field Communication). When the electronic device 100 directly communicates with the external device 200, the storage unit 170 may include address information (eg, MAC address or IP address) of the external device 200, which is a communication target device. Can be stored.

In the electronic device 100 according to an embodiment of the present invention, the communication unit 120 is provided to perform wireless communication with the external device 200 by at least one of the wireless LAN unit and the short-range communication module according to the performance.

In another embodiment, the electronic device 100 may further include a wired communication module such as Ethernet. In another embodiment, the communication unit 120 may further include a communication module by various communication methods such as mobile communication such as LTE, EM communication including a magnetic field, visible light communication, sound wave communication, and the like.

According to an embodiment, the electronic device 100 may receive content including a video signal and a graphic signal from an external server through the communication unit 120 in a real time streaming manner. For example, the electronic device 100 may receive content in a streaming manner by using a service such as Neckflix or YouTube.

The video processor 130 performs various preset video / audio processing on the video signal output through the connection unit 110 or the communication unit 120. In one embodiment, the video processor 130 is provided to process the video signal of the HDR content or the SDR content, but the type of content processed by the video processor 130 is not limited in the present invention.

In one embodiment, the video processor 130 includes a video processing module 131 capable of converting a video signal of a first format into a video signal of a second format. For example, the video processing module 131 may be implemented as a video processing block in accordance with an extended color gamut YCC (xvYCC) standard that is capable of converting an HDR video signal into an SDR video signal or converting an SDR video signal into an HDR video signal. Can be.

That is, the type of image processing process performed by the video processing unit 130 of the present invention is not limited. For example, among various processes such as resolution conversion, color conversion, color space conversion, brightness conversion, noise reduction, detail enhancement, etc. Performing at least one, the video processor 130 may include components associated with it.

In one embodiment, the video processor 130 may further include additional components such as a decoder, a scaler, and an encoder. In another embodiment, the decoder, scaler, and encoder may be provided as separate components of the electronic device 100 separated from the video processor 130, and the decoder, scaler, and encoder may process graphic signals as well as video signals. have.

The video processor 130 may be implemented as a group of individual components capable of independently performing each of these processes, or may be implemented as a form included in a main system-on-chip (SoC) incorporating various functions. The main SoC may include at least one microprocessor or CPU which is an example of implementing the processor 180 described later.

In one embodiment, the video processor 130 may be implemented as an image board in which various chipsets, memories, electronic components, wirings, etc., for performing each of these processes are mounted on a printed circuit board (PCB). In this case, the video processing unit 130, the first and second graphic processing units 140 and 150, and the processor 180 may be provided in a single image board in the electronic device 100. Of course, this is only an example and may be disposed on a plurality of printed circuit boards communicatively connected to each other.

The first graphic processor 140 and the second graphic processor 150 are provided to process the graphic signal.

5 is a block diagram illustrating a configuration of a first graphic processing unit and a second graphic processing unit according to an exemplary embodiment of the present invention.

As illustrated in FIG. 5, the first graphic processor 140 may include a geometry processor 141 that performs geometry calculation and a pixel processor 142 that processes pixel values according to a formula. , A compositor for mixing and outputting a cache controller 143 managing a cache memory device, a memory management unit (MMU) 144 that manages / controls the access of the first graphic processor 140, and a graphic signal. (compositor) 145. In one embodiment, cache controller 143 becomes a level 2 cache controller.

The geometry processor 141 is a vertex shader for processing vertices of an object, a vertex shader command processor, and a polygon that the pixel processor 142 draws. A polygon list builder unit, a polygon list builder (PLB) command processor, and the like, for generating a list. In one embodiment, geometry processor 141 performs three-dimensional geometry operations.

The pixel processor 142 uses an edge list using a polygon list reader, a reader state word (RSW) unit that tracks the rendering state for each polygon, a vertex loader, and vertex data. A triangle setup unit that computes coefficients for and computes interpolation equations, registers that divide polygons into fragments using coefficients and equations, and for each fragment A fragment shader that computes primitives for the object, a blending unit that blends the current frame buffer value to the computed fragment value, and a variety of tiles for the tiles written to the frame buffer to be fully rendered into the fragment. Tile buffers for performing an operation. In one embodiment, the pixel processor 142 may be provided in plural, for example, four.

The first graphic processor 140 according to an exemplary embodiment of the present invention is implemented as a software, that is, a graphic processing unit (GPU) provided to execute a predetermined program. The first graphic processor 140 may perform various graphic processes by reading a program from the storage unit 170 and executing the program. In this process, data in the storage unit 170 (for example, an expression and a look-up table) may be performed. up table). In one embodiment, the first graphics processing unit 140 is implemented as a high performance graphics processing apparatus having a high processing speed. The first graphic processor 140 may include a plurality of cores to process a large amount of data at one time.

Graphic processing performed by the first graphic processing unit 140 includes conversion of a graphic signal. The first graphic processor 140 may perform color conversion and gamma conversion as conversion of the graphic signal. Color conversion includes color gamut conversion or color space conversion.

In an embodiment, the first graphic processor 140 performs color conversion through an mathematical operation. In addition, the first graphic processor 140 may perform gamma conversion by replacing a value using the lookup table.

In an exemplary embodiment, the first graphic processor 140 may convert at least one of the first graphic signal and the second graphic signal, thereby matching the format of the first and second graphic signals.

The compositor 145 mixes, or mixes, the first graphic signal and the second graphic signal and outputs the same to the second graphic processor 150. The first graphic processor 140 may mix the first graphic signal and the second graphic signal in the compositor 145 with reference to an alpha value representing transparency information. The graphics signal mixed in the compositor 145 is composed of a single layer.

In the present invention, the first graphic processor 140 converts and mixes at least one of the first graphic signal and the second graphic signal as described above so that their formats match. Therefore, in the mixed graphic signal output through the compositor 145, distortion such as color may not occur in the display process.

The first graphic processor 140 may perform animation processing, two-dimensional (2D) or three-dimensional (3D) graphics processing, geometry coordinate processing, acceleration processing, or transparency adjustment on at least one of the first graphics signal and the second graphics signal. At least one of the following may be performed. The animation processing includes movement processing on the stationary UI item. Transparency adjustment may be performed by alpha blending based on transparency information indicating the degree of transparency of the overlapping graphics. Transparency information is commonly referred to as an alpha value, and the alpha value is an example of 8-bit data that can distinguish the degree of transparency of 0 to 255.

That is, in the electronic device 100 according to an embodiment of the present invention, the first graphic processing unit 140 generates a graphic signal by performing calculation for various types of graphic processing by executing software, and the generated graphic signal is 2 is output to the graphics processor 150. Here, the graphic signal output to the second graphic processor 150 may be composed of a single layer.

As illustrated in FIG. 5, the second graphic processor 150 may include a plane processing module (GFXP (graphic plane block) 151, a synchronization module 152, a picture quality enhancement module (GRP_QE) 153, and an output module. (GFXP_OUT block) 154. The output module 154 may be composed of a plurality of blocks, for example, a pre-out block and a post-out block.

In the present invention, a processing module including a plane processing module 151, a synchronization module 152, and an image quality improvement module 153 is defined in the second graphic processing unit 150.

The plane processing module 151 is configured to display graphic data in accordance with the display size. The plane processing module 151 receives the vertical synchronization signal and the horizontal synchronization signal of the display and outputs the graphic data in a desired position in real time, so that a plane and a cursor can be represented. Here, the plane may support full screen.

Specifically, when the external device 200 connected to the electronic device 100 and receiving an image signal is a television supporting an output resolution of 2160x3840 and the resolution of the graphic signal is 2160x3840, the plane processing module 151 may be configured to display the graphic signal. The resolution is scaled up to correspond to 2160x3840, and graphics data (eg, a cursor) is output at a desired coordinate position in real time.

The synchronization module 152 receives a synchronization signal that is a reference of the display from the outside, and generates an active signal for the plane and the cursor. In addition, the synchronization module 152 may mix the output corresponding to the plane and the cursor, respectively, and generate one graphic signal. The synchronization module 152 is reset by the vertical synchronization signal, and register updating is performed.

The image quality enhancement module 153 performs a process for quality enhancement of graphic data. The image quality enhancement module 153 performs graphics processing based on the signal output from the synchronization signal 152.

The image enhancement module 153 includes a de-jagging block for smoothing rough edges of the inclined portion to improve graphic quality, a detail enhancement block for improving graphic sharpness, and color space conversion. And a white balance, brightness, and contrast by adjusting a GMA block for performing color gamut conversion, a gamma block for adjusting a gamma value, and an offset and a gain of an output signal. A conbri block may be provided to perform tuning.

That is, the second graphic processor 150 of the electronic device 100 according to the embodiment of the present invention is a hardware configuration in which a graphic signal is processed in a single path, and is implemented to process a graphic signal of a single layer / plane. .

Accordingly, in the electronic device 100 according to an exemplary embodiment of the present invention, the first graphic processing unit 140 processes a graphic signal composed of a plurality of layers, and the processing modules 151, 152, and 153 of the second graphic processing unit 150. ) Is controlled to bypass.

The output module 154 receives the graphic signal output from the conbri block of the image quality improvement module 153 and the video signal output from the video processing unit 130, and generates an output signal for each scenario to generate an external device 200. To be provided. When the output module 154 is composed of a plurality of blocks, any one block may be selected as an output corresponding to the scenario.

The output module 154 may generate an output signal by performing frame rate conversion. The output signal 154 is an example of the graphic Vx1 output.

The output module 154 includes a mixer 155 that mixes, or merges, the video signal and the graphic signal.

In one embodiment, when the output module 154 is composed of a plurality of blocks, the mixer 155 is implemented as a mixer PRE_MIX provided in any one block, for example, a preout block.

In one embodiment, when the electronic device 100 is a Blu-ray playback device, the output module 154 further includes a formatter 156. When the output module 154 is composed of a plurality of blocks, the formatter 156 is implemented with a formatter PRE_BD_FMT provided in one block, for example, a preout block. The formatter 156 supports a single channel input and has detailed configurations such as YUV to RGB, RGB to RGB, RGB to YUV, Dither, Data Monitor, and YUV Formatter.

The second graphic processor 150 operates to bypass the processing modules 151, 152, and 153 by the graphic signal received from the first graphic processor 140.

In one embodiment, when the processor 180 detects that a predetermined event occurs, the processor 180 bypasses the processing modules 151, 152, and 153 of the second graphic processor 150 with reference to the setting information of the storage unit 170. Set to mode.

In another embodiment, when the second graphic processor 150 detects that a predetermined event occurs, the processing modules 151, 152, and 153 of the second graphic processor 150 refer to the setting information of the storage 170 directly. Can be set to bypass mode.

Here, the event may include booting of the electronic device 100, input of content including a video signal and a graphic signal (for example, reception of content from the outside by streaming), user input (for example, content stored on a disk). User input, etc.) to play the data.

The plane processing module 151, the synchronization module 152, and the image quality improvement module 153 of the second graphic processor 150 may have a plurality of modes operated in response to each scenario, and the graphic signal corresponds to the setting mode. Control to perform the processing / conversion (e.g., color conversion, gamma conversion, etc.). However, the present invention is not limited to the above-described embodiment, so that each module 151, 152, 153 in the second graphic processor 150 may operate according to a setting regardless of a mode.

In the present invention, each processing module (151, 152, 153) has a bypass mode, the module set to the bypass mode can output to the next block without processing the input graphic signal.

The electronic device 100 according to an embodiment of the present invention includes a second graphic processor 150 provided with hardware graphic processing means of a single path configured in series, and is provided without distortion by the first graphic processor 140. Since the graphic layer can be processed, it can be used in display devices such as TVs. That is, the second graphic processor 150 of the electronic device 100 of the present invention may use a graphic chip for TV.

In the present invention, the first graphic processor 140 and the second graphic processor 150 may be provided integrally, but are not limited thereto. That is, in one embodiment, the first graphic processor 140 and the second graphic processor 150 may be implemented to be included in a single chip, but in another embodiment, the first graphic processor 140 and the second graphic processor 140 may be implemented. Each 150 may be implemented in the form of a separate chip.

In another embodiment, the video processor 130, the first graphic processor 140, and the second graphic processor 150 may be integrally provided.

Referring back to FIG. 4, the user input unit 160 transmits various preset control commands or unlimited information to the processor 180 by a user's input. The user input unit 160 includes a keypad (or an input panel) including buttons such as a power key and a menu key provided in the main body of the electronic device 100.

In one embodiment, the user input unit 160 includes an input device for generating a predetermined command / data / information / signal to transmit the electronic device 100 to the electronic device 100 so as to remotely control the electronic device 100. The input device is separated from the main body of the electronic device 100, such as a remote control, to receive a user input. The remote controller may be provided with a touch sensing unit for receiving a user's touch input and / or a motion sensing unit for sensing its own motion by the user. The input device includes a terminal device such as a smart phone installed with a remote control application, and in this case, the user's touch input through the touch screen can be received. In one embodiment, the input device may be implemented as an integrated remote controller capable of controlling both the electronic device 100 and the external device 200.

The input device may perform wireless communication with the main body of the electronic device 100, and the wireless communication may include Bluetooth, infrared communication, RF communication, WLAN, and Wi-Fi Direct.

In one embodiment, the user input unit 160 may further include a voice input unit for receiving a voice / sound spoken by the user. The voice input unit may be implemented as a microphone for receiving a voice signal, and may be installed in a main body or a remote controller of the electronic device 100.

The storage unit 170 is configured to store various data of the electronic device 100. The storage unit 170 may retain data even when power supplied to the electronic device 100 is cut off, and may be provided as a writable nonvolatile memory (Writable ROM) to reflect changes. That is, the storage unit 170 may be provided with at least one of a flash memory, an EPROM, or an EEPROM. The storage unit 170 may further include a volatile memory such as DRAM or SRAM in which the read or write speed of the electronic device 100 is faster than that of the nonvolatile memory.

The data stored in the storage unit 170 includes, for example, an operating system for driving the electronic device 100, and various software, programs, applications, image data, additional data, and the like executable on the operating system.

According to an exemplary embodiment of the present invention, the storage unit 170 stores a second graphic signal, which is a built-in graphic provided by the electronic device 100 itself. In one embodiment, the storage unit 170 is a program executed by the first graphic processor 140 to perform the graphic signal conversion, the processor 180 is executed by the processing module 151 of the second graphic processor 150. , A flash memory for storing a program for mode setting for the second and second 152 and 153.

In one embodiment, the storage unit 170 includes an optical disc storage medium such as Blu-ray, DVD, etc. in which content is stored. The type of content recorded on the optical disk storage medium is not limited, and an example is an Ultra High Definition (UHD) Blu-ray Disc (BD) in which HDR content is stored. The electronic device 100 is provided with a disc loader which reads the stored data by rotating the optical disc when content is played back, and uses a laser from a rotating disc, that is, a UHD BD, BD, DVD, etc., to output a video signal and a graphic signal. Read digital content, including.

The processor 180 controls to operate various components of the electronic device 100. The processor 180 executes a control program (or instruction) to perform such a control operation. The processor 180 includes at least one general-purpose processor that loads at least a part of the control program into the volatile memory from the nonvolatile memory in which the control program is installed, and executes the loaded control program, for example, a CPU (Central Processing) It may be implemented as a unit, an application processor (AP), or a microprocessor.

The processor may include single core, dual core, triple core, quad core, and multiple cores thereof. The processor includes a subprocessor operating in a plurality of processors, for example, a main processor and a sleep mode (for example, only standby power is supplied and does not operate as a content providing device). It may include. In addition, the processor, the ROM, and the RAM are interconnected through an internal bus, and the ROM and the RAM are included in the storage 170.

The processor, which is an example of implementing the processor 180 in the present invention, may be implemented as a form included in a main SoC mounted on a PCB embedded in the electronic device 100. In another embodiment, the main SoC may further include a video processor 130, a first graphics processor 140, and / or a second graphics processor 150.

The control program may include program (s) implemented in at least one of a BIOS, a device driver, an operating system, firmware, a platform, and an application (application). In an embodiment, the application program may be installed or stored in the electronic device 100 at the time of manufacture of the electronic device 100, or may be received based on data received by receiving data of the application program from an external source in future use. It may be installed in the electronic device 100. Data of the application program may be downloaded to the electronic device 100 from an external server such as an application market. Such an external server is an example of the computer program product of the present invention, but is not limited thereto.

In an embodiment, the operation of the processor 180 may be implemented as a computer program stored in a computer program product (not shown) provided separately from the electronic device 100. In this case, the computer program product includes a memory in which instructions corresponding to the computer program are stored, and a processor. The instruction, when executed by the processor, converts the video signal or the graphic signal corresponding to the content of the first format into a video signal or the graphic signal corresponding to the content of the second format and transmits the same to the at least one external device 200. It includes.

In the present invention, the first graphics processing unit 140 may be implemented as a GPU that can read and execute a control program independently. The GPU 140 executes instructions stored in a memory and corresponds to a graphic signal corresponding to a first type of content. May be converted into a graphic signal corresponding to the content of the second format.

Accordingly, the electronic device 100 may download and execute a computer program stored in a separate computer program product to perform an operation of the processor 180.

6 is a block diagram illustrating a configuration of an external device according to an embodiment of the present invention.

As illustrated in FIG. 1, the external device 200 includes a display device such as a television, and receives the image signal provided from the electronic device 100 so as to be displayed on the display 290. However, since the present invention is not limited thereto, the external device 200 may be a wearable device such as a mobile device such as a smartphone or an HMD device that receives an image signal from the electronic device 100. The configuration shown in FIG. 6 is applicable to the external device 200 implemented in various forms, but some configurations may be added or excluded according to the characteristics of the device itself, or the implementation form of the specific configuration may be different.

The implementation manner of the display 290 provided in the external device 200 is not limited. For example, a liquid crystal, a plasma, a light-emitting diode, and an organic light-emitting diode Light emitting diodes, surface-conduction electron-emitters, carbon nano-tubes, nano-crystals and the like can be implemented in various display methods. The display unit may further include additional components (drive units) according to the implementation manner.

In one embodiment, the display 290 is implemented as a touch screen for detecting a user's touch input. The touch input includes single touch and multi touch, and may include various gestures or motion inputs such as tap, click, and directional drag or flick.

The touch screen includes a touch pad positioned on an upper portion of a panel on which an image is displayed. A touch screen displays a user selectable user interface (UI), also referred to as a graphical user interface (GUI). The touch pad and the UI are included in the user input unit 240. The UI may include menu items of the external device 200 or the electronic device 100.

In an embodiment, the display 290 of the external device 200 displays a video signal, a first graphic signal, and a second graphic signal included in content, and the second graphic signal is wired or wirelessly connected to the electronic device 100. Contains menu items related to

In addition to the display 290, the external device 200 according to an embodiment of the present invention, as shown in FIG. 6, the connection unit 210, the communication unit 220, the image processing unit 230, the graphic processing unit 250, The user input unit 260, the storage unit 270, and the processor 260 are provided. However, not all of the above components are essential components, and therefore, the external device 200 may be implemented in a form in which at least some of the above components are excluded. In addition, in addition to the above-described configuration, the external device 200 may further include an additional component, for example, a tuner for tuning a broadcast signal corresponding to a channel.

In an embodiment, the graphic processor 250 of the external device 200 may correspond to an implementation form of the second graphic processor 150 of the electronic device 100.

In the external device 200 according to an embodiment of the present invention, the storage unit 250 may store various information of the external device 200.

In an exemplary embodiment, the storage 250 is provided with an EDID area in which extended display identification data (EDID) is stored. The EDID region is implemented by an electrically erasable and programmable read only memory (EEPROM) provided in correspondence with the connection unit 210 of the external device 200, for example, an HDMI interface, and the EEPROM may be formed in the manufacturing process of the external device 200. Alternatively, the EDID may be written while the program / application is installed or executed in the external device 200.

The electronic device 100 receives an information package such as a resolution, a horizontal frequency, a vertical frequency, a color gamut, and a luminance range that can be supported from the external device 200 as an EDID, and supports a video signal and graphics that can be supported by the external device 200. You can determine the format of the signal. The formats of the video signal and the graphic signal that can be supported correspond to a range of video signals that the external device 200 can represent. Protocol for transmitting EDID is a display data channel (DDC) transmission scheme established by VESA.

In an exemplary embodiment, the external device 200 may have a plurality of ports as the connection unit 210, and an EEPROM in which corresponding EDIDs are stored may be provided for each port. After the electronic device 100 and the external device 200 are connected through the respective connection parts 110 and 210, when the EDID request signal is transmitted from the electronic device 100, EDID is loaded from the EPROM of the corresponding port so that both connection parts are connected. The data is transmitted to the electronic device 100 through the 210 and 110. Here, the processor 180 of the electronic device 100 applies a hot plug detect signal to the connection unit 110, that is, the HDMI interface, so that the EDID request signal is transmitted to the external device 200. You can read the information.

Meanwhile, according to an exemplary embodiment of the present invention, the electronic device 100 may further receive data on a format of a video signal and a graphic signal which can be supported by the external device 200 wirelessly connected through the communication unit 120. The external device 200 may store data about the range of the image signal that can be expressed in the storage unit 250, that is, identification information, and the method of storing the data may be the same as the EDID corresponding to the connection unit 210. It is not limited to this.

As described above, each component provided in the external device 200 corresponds to an implementation form of the component having the same name as the electronic device 100. Therefore, the same name is used for a component that performs the same operation as the electronic device 100 in the external device 200, and detailed description thereof will be omitted in order to avoid duplicate description.

7 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present invention.

As illustrated in FIG. 7, the electronic device 100 receives a user input for playing predetermined content (501). In this case, the processor 180 of the electronic device 300 may receive a user input through a remote controller provided as the user input unit 160, and the received user input may be connected to the reproduced content and the wired or wireless connection of the content. It may include a command to output from the external device 200 (for example, a display device such as a TV).

The content to be reproduced is content stored in an optical disc such as a Blu-ray provided as the storage unit 170 and includes a video signal and a first graphic signal according to a predetermined format. In the electronic device 100 for playing content, a second graphic signal different from the first graphic signal included in the content may be internally embedded. In an exemplary embodiment, the first graphic signal and the second graphic signal may be composed of a plurality of layers having different formats. Specific examples in which the graphic signal is composed of a plurality of layers will be described in more detail with reference to the embodiments of FIGS. 8 to 10 described later.

The processor 180 of the electronic device 100 determines a format of a video signal and a graphic signal supported by the wired or wirelessly connected external device 200 (502). Here, the format that can be supported refers to determining whether or not the display range according to its own format can be normally displayed when the video signal and the graphic signal of a predetermined content format are processed by the external device 200 and displayed as an image. Include. For example, the electronic device 100 may determine whether the television connected through the connection unit 110 is an HDR TV or an SDR TV.

Specifically, the processor 180 loads identification data related to the expression range from the storage unit 270 of the connected external device 200 to obtain information of the external signal 200, and based on the obtained information, The format of the video signal and the graphic signal that can be supported in 200 may be determined. Here, the identification data related to the expression range of the external device 200 may be stored in the storage unit 270 at the time of manufacturing the external device 200, such as an EDID, or at a time when a predetermined program / application is installed or executed in the external device 200. Can be recorded / stored in a predetermined area. In addition, the time point at which the identification data is loaded is not limited, and may include booting the electronic device 100, booting the external device 100, connecting or establishing a connection with the external device 100, or a user input. Can be.

The electronic device 100 converts at least one of the video signal and the first and second graphic signals based on the determination result of step 502 (503). Here, the video signal is converted by the video processor 130, and the first graphic signal or the second graphic signal is converted by the first graphic processor 140.

In an embodiment, the first graphic processor 140 may convert one of the first graphic signal and the second graphic signal to correspond to the format of the graphic signal determined in operation 502. Here, the video processor 130 may further convert the video signal to correspond to the format of the video signal determined in step 502.

In another embodiment, the first graphic processor 140 may convert both the first graphic signal and the second graphic signal to correspond to the format of the graphic signal determined in operation 502. To this end, the first graphic processor 140 may be implemented as a high performance GPU capable of high-speed processing of data signals, and the first and second graphic signals may be simultaneously converted and processed by various methods such as simultaneous / time division / parallel. Can be. Here, the video processor 130 may further convert the video signal to correspond to the format of the video signal determined in step 502.

Through the conversion process of step 503, the video signal, the first graphic signal, and the second graphic signal may have the same format. The first graphic processor 140 may further perform other graphic processing (eg, animation processing, transparency adjustment, etc.) on the first graphic signal and the second graphic signal in addition to the conversion. Specific examples of converting the graphic signal or the video signal will be described in more detail with reference to the embodiments of FIGS. 8 to 10 to be described later.

The first graphic processor 140 mixes the first graphic signal and the second graphic signal and outputs the second graphic signal to the second graphic processor 150 (504). Here, since the mixed graphic signal to be output has the same format in step 503, even if it is mixed and output as a graphic signal of a single layer, distortion does not occur in color or the like.

The second graphic processor 150 receives the mixed graphic signal from the first graphic processor 140 in step 504, merges the video signal, and merges the video signal to the external device 200 through the connection unit 110 or the communication unit 1200. That is, the second graphic processor 150 receives the video signal output from the video processor 130 and the graphic signal output from the first graphic processor 140, and receives the received video signal and graphic. The output signal (mixed signal) based on the signal is controlled to be transmitted to the external device 200 through the connection unit 110 or the communication unit 120. Here, the mixed graphic signal received from the first graphic processor 140 is It passes through the processing modules 151, 152, and 153 set in the pass mode, that is, bypasses them, and passes them to the mixer 155 of the output module 154, where they are mixed with the video signal.

In addition, the external device 200 receives the merged signal, that is, the image signal, in step 505 through the connection unit 210 or the communication unit 220, and controls the received image signal to be displayed on the display 290 (506). .

In the exemplary embodiment illustrated in FIG. 7 as described above, the electronic device 100 determines / determines a format of a video signal and a graphic signal supported by the external device 200, and converts a signal based on the determination result. Although the case has been described as an example, the present invention is not limited thereto.

That is, in another embodiment, the electronic device 100 converts at least one of the video signal and the first and second graphic signals into a predetermined default format without determining a format of a signal supported by the external device 200. Thus, the video signal, the first graphic signal, and the second graphic signal may be implemented to have the same format.

In addition, in the exemplary embodiment illustrated in FIG. 7, the mixed graphic signal is bypassed by the processing module of the second graphic processor 140 and transferred to the mixer 155 as an example. Since the graphic processing that may be performed by the processor 140 is not limited to the conversion, the second graphic processor 140 may perform post processing on the graphic signal mixed by the compositor 145 so as to perform the mixer 155. Embodiments in the form of () will also be implemented.

Hereinafter, according to the control method described with reference to FIG. 7, embodiments in which the electronic device 100 processes the graphic signal and provide the same to the external device 200 will be described.

8 is a diagram illustrating an example in which a video signal and a graphic signal are processed in the first embodiment of the present invention.

As shown in FIG. 8A, the electronic device 100 that performs the operation in the first embodiment is a playback device in which an SDR graphic signal is embedded, and the external device 200 displaying an image displays an HDR image. Each TV is implemented as a possible TV, and the user may play the HDR content stored in the optical disc 171 in the electronic device 100.

The HDR content to be reproduced includes a video signal 610 in HDR format and a graphic signal (first graphic signal) 621 in HDR format. In addition, the storage unit 170 of the electronic device 100 includes an SDR type graphic signal (second graphic signal) 622. That is, in the first embodiment, the graphic signal 620 is composed of a plurality of layers having different formats.

The processor 180 of the electronic device 100 according to the first embodiment bypasses the processing modules 151, 152, and 153 of the second graphic processor 150 with reference to setting information of the storage unit 170. Set to.

As shown in FIG. 8B, when a user input for reproducing the HDR content stored in the disk 171 is received, the video signal 610 is transmitted to the video processor 130 with the first graphic signal 621. The two graphic signals 622 are input to the first graphic processor 140.

The processor 180 determines the format of the video signal and the graphic signal supported by the external device 200 implemented as the HDR TV as HDR using the identification data acquired from the external device 200.

The video processor 130 does not perform conversion on the video signal 610 based on the determination result as described above. That is, since the video signal 610 is configured to have an HDR format that can be supported by the external device 200, the video signal 610 does not need to be converted to a color space or a gamma value. Accordingly, the video signal 610 is processed to bypass the video processing module 131 (for example, the xvYCC processing block) provided to perform the conversion, as shown in FIG. The mixer 155 is transferred to the mixer 155 provided in the output module 154 of the graphic processor 150.

8 and 9, which will be described later, for convenience, only the module 131 related to conversion among the blocks in the video processor 131 is illustrated. However, the video processor 130 of the electronic device 100 of the present invention may be described in detail. As described with reference to FIG. 4, the video signal 610 may not bypass all the blocks in the video processor 130 since the video signal 610 may be implemented to include various video signal processing blocks such as a decoder.

The first graphic processor 140 converts the second graphic signal 622 to correspond to the HDR format based on the determination result as described above. In an exemplary embodiment, as illustrated in FIG. 8B, the first graphic processor 140 executes a program read from the storage unit 170 to perform color space conversion and gamma conversion. ST.2084 conversion) can be performed separately. Here, as shown in FIG. 8B, the first graphic processor 140 includes a transparency process using an alpha value for the second graphic signal (a process of removing the influence of the alpha value or returning the alpha value to the previous one). ) Can be performed further.

The first graphic processor 140 does not perform conversion on the first graphic signal 621 based on the determination result as described above. That is, since the first graphic signal 621 is configured to have an HDR format that can be supported by the external device 200, the first graphic signal 621 does not need to be converted to a color space or a gamma value.

The first graphic signal 621 and the converted second graphic signal 622 are mixed by the compositor 145 to be output to the second graphic processor 150 as a graphic signal of a single layer according to the HDR format.

The second graphic processor 150 receives the mixed HDR graphic signal from the first graphic processor 140, and the mixed HDR graphic signal is set by the processor 180 to the bypass mode by the processing module 151, 152, or 153. ), That is, bypasses and is passed to the mixer 155.

The mixer 155 mixes or merges the HDR graphic signal transmitted as described above with the HDR video signal input from the video processor 130 and outputs the merged HDR video signal to the HDR TV which is the external device 200.

Accordingly, the image signal composed of the HDR video and the HDR graphic is transmitted to the external device 200 so that a high quality image can be displayed without distortion caused by the color of the image.

According to the first exemplary embodiment as described above, independent / parallel processing of the graphic signal 620 having a plurality of layers may be performed by the first graphic processor 140 operating on a software basis in the electronic device 100. do.

9 is a diagram illustrating an example in which a video signal and a graphic signal are processed in the second embodiment of the present invention.

As shown in FIG. 9A, the electronic device 100 operating in the second embodiment is a playback device in which an SDR graphic signal is embedded, and the external device 200 displaying an image displays an SDR image. Each TV is implemented as a possible TV, and the user may play the HDR content stored in the optical disc 171 in the electronic device 100.

The HDR content to be reproduced includes a video signal 710 in HDR format and a graphic signal (first graphic signal) 721 in HDR format. In addition, the storage unit 170 of the electronic device 100 includes an SDR type graphic signal (second graphic signal) 722. That is, in the second embodiment, the graphic signal 721 is composed of a plurality of layers having different formats.

The processor 180 of the electronic device 100 according to the second embodiment bypasses the processing modules 151, 152, and 153 of the second graphic processor 150 with reference to the setting information of the storage unit 170. Set to.

As shown in FIG. 9B, when a user input for reproducing the HDR content stored in the disk 171 is received, the video signal 710 is connected to the video processor 130 with the first graphic signal 721. The two graphic signals 722 are input to the first graphic processor 140.

The processor 180 determines, as SDR, a format of a video signal and a graphic signal that can be supported by the external device 200 implemented as an HDR TV using the identification data obtained from the external device 200.

The video processing module 131 (for example, the xvYCC processing block) of the video processing unit 130 performs color space conversion (2020 RGB to 709 RGB conversion) and gamma conversion on the video signal 710 based on the determination result as described above. ST.2084 to ST.1886 conversion), respectively. In one embodiment, gamma conversion may be performed by a plurality of steps of ST.2084 to leaner de-gamma conversion and linear to ST.1886 gamma conversion, as shown in FIG. 9 (b). The converted video signal 610 is transmitted to the mixer 155 provided in the output module 154 of the second graphic processor 150.

The first graphic processor 140 converts the first graphic signal 721 to correspond to the SDR format based on the determination result as described above. In an exemplary embodiment, as shown in FIG. 9B, the first graphic processor 140 executes a program read from the storage unit 170 to perform color space conversion (2020 RGB to 709 RGB conversion) and gamma conversion (ST.2084 to). ST.1886 conversion) can be performed separately. Here, as illustrated in FIG. 8B, the first graphic processor 140 may further perform transparency processing using an alpha value with respect to the first graphic signal.

The first graphic processor 140 does not perform conversion on the second graphic signal 722 based on the determination result as described above. That is, since the second graphic signal 722 is configured to have an SDR format that can be supported by the external device 200, the second graphic signal 722 does not need to be converted to a color space or a gamma value.

The converted first graphic signal 721 and the second graphic signal 722 are mixed by the compositor 145 to be output to the second graphic processor 150 as a single layer graphic signal according to the SDR format.

The second graphic processor 150 receives the mixed SDR graphic signal from the first graphic processor 140, and the mixed SDR graphic signal is set in the bypass mode by the processor 180 to be the processing module 151, 152, or 153. ), That is, bypasses and is passed to the mixer 155.

The mixer 155 mixes, or merges, the SDR graphic signal transmitted as described above with the SDR video signal input from the video processor 130 and outputs the merged SDR graphic signal to the SDR TV which is the external device 200.

Accordingly, the image signal consisting of SDR video and SDR graphics is transmitted to the external device 200, so that the image can be displayed normally without distortion generated in the color of the image.

According to the second exemplary embodiment as described above, independent / parallel processing of the graphic signal 720 having a plurality of layers may be performed by the first graphic processor 140 operating on a software basis in the electronic device 100. do.

FIG. 10 is a diagram showing an example in which a video signal and a graphic signal are processed in the third embodiment of the present invention.

As shown in FIG. 10A, the electronic device 100 operating in the third embodiment is a playback device in which an HDR graphic signal is embedded, and the external device 200 displaying an image displays an SDR image. Each TV is implemented as a possible TV, and the user may play the HDR content stored in the optical disc 171 in the electronic device 100.

The HDR content to be reproduced includes a video signal 810 in HDR format and a graphic signal (first graphics signal) 821 in HDR format. In addition, the storage unit 170 of the electronic device 100 includes a graphic signal (second graphic signal) 822 in an HDR format. That is, in the third embodiment, the graphic signals 620 are composed of a plurality of layers having the same format.

The processor 180 of the electronic device 100 according to the third embodiment bypasses the processing modules 151, 152, and 153 of the second graphic processor 150 with reference to the setting information of the storage unit 170. Set to.

As shown in FIG. 10B, when a user input for reproducing the HDR content stored in the disk 171 is received, the video signal 810 is transmitted to the video processor 130 and the first graphic signal 821 and the first graphic signal 821. The two graphic signals 822 are input to the first graphic processor 140.

The processor 180 determines, as SDR, a format of a video signal and a graphic signal that can be supported by the external device 200 implemented as an HDR TV using the identification data obtained from the external device 200.

The video processing module 131 (eg, the xvYCC processing block) of the video processing unit 130 performs color space conversion (2020 RGB to 709 RGB conversion) and gamma conversion on the video signal 810 based on the determination result as described above. ST.2084 to ST.1886 conversion), respectively. In one embodiment, gamma conversion may be performed by a plurality of steps of ST.2084 to leaner de-gamma conversion and linear to ST.1886 gamma conversion, as shown in FIG. 10 (b). The converted video signal 810 is transmitted to the mixer 155 provided in the output module 154 of the second graphic processor 150.

The first graphic processor 140 converts the second graphic signal 622 to correspond to the HDR format based on the determination result as described above. In an embodiment, as shown in FIG. 8B, the first graphic processor 140 executes a program read from the storage unit 170 to perform color space conversion (2020 RGB to 709 RGB conversion) and gamma conversion (ST. 2084 to). ST.1886 conversion) can be performed separately.

The first graphic processor 140 converts the first graphic signal 821 to correspond to the SDR format based on the determination result as described above. In addition, the first graphic processor 140 converts the second graphic signal 822 to correspond to the SDR format based on the determination result as described above.

In an exemplary embodiment, as shown in FIG. 10B, the first graphic processor 140 executes a program read from the storage unit 170 to execute color programs for the first and second graphic signals 821 and 822, respectively. Conversion (2020 RGB to 709 RGB conversion) and gamma conversion (ST.2084 to ST.1886 conversion) can be performed in parallel. Here, as illustrated in FIG. 10B, the first graphic processor 140 may further perform transparency processing using alpha values on the first and second graphic signals 821 and 822.

The converted first graphic signal 821 and the second graphic signal 822 are mixed by the compositor 145 to be output to the second graphic processor 150 as a graphic signal of a single layer according to the SDR format.

The second graphic processor 150 receives the mixed SDR graphic signal from the first graphic processor 140, and the mixed SDR graphic signal is set in the bypass mode by the processor 180 to be the processing module 151, 152, or 153. ), That is, bypasses and is passed to the mixer 155.

The mixer 155 mixes, or merges, the SDR graphic signal transmitted as described above with the SDR video signal input from the video processor 130 and outputs the merged SDR graphic signal to the SDR TV which is the external device 200.

Accordingly, the image signal consisting of SDR video and SDR graphics is transmitted to the external device 200, so that the image can be displayed normally without distortion generated in the color of the image.

The third embodiment as described above differs from the first and second embodiments in that both the first graphic signal and the second graphic signal are converted in the format (HDR-> SDR). According to the third exemplary embodiment, independent / parallel processing of the graphic signal 820 having a plurality of layers may be performed by the first graphic processor 140 operating on a software basis in the electronic device 100.

FIG. 11 is a diagram showing an example in which a video signal and a graphic signal are processed in the fourth embodiment of the present invention.

In the fourth embodiment shown in FIG. 11, video content including a video signal and a graphic signal is received by the electronic device 100 in the form of real time streaming. As shown in FIG. 11A, the electronic device 100 performing the operation according to the fourth embodiment is a playback device in which an SDR graphic signal is embedded, and the external device 200 displaying an image displays an HDR image. Each can be implemented as a possible TV.

The streaming SDR content to be played includes an SDR format video signal 910 and an SDR format graphics signal (first graphics signal) 921. In addition, the storage unit 170 of the electronic device 100 includes an SDR type graphic signal (second graphic signal) 922. That is, in the first embodiment, the graphic signals 620 are composed of a plurality of layers having the same format.

The processor 180 of the electronic device 100 according to the fourth embodiment refers to the setting information of the storage unit 170 and transfers the processing modules 151, 152, and 153 of the second graphic processor 150 to the output device. Set the conversion mode accordingly. The HDR to SDR conversion mode is an example of the conversion mode thus set.

In an embodiment, when it is determined that the content input from the outside to the electronic device 100 is received by the real time streaming method, the processor 180 uses the identification data obtained from the external device 200 to determine the external device 200. Determines the formats of video and graphics signals that can be supported. Here, when the external device 200 is an HDR TV, a supportable format is determined as SDR.

In addition, the processor 180 sets a mode of the processing modules 151, 152, and 153 of the second graphic processor 150 to an SDR to DDR conversion mode. When the processing modules 151, 152, and 153 of the second graphic processing unit 150 are set to a mode for converting a graphic signal instead of a bypass module, this information is transmitted to the first graphic processing unit 140. 1 The graphic processor 140 does not perform an operation related to the conversion of the graphic signal.

As shown in FIG. 11 (b), when a user input for reproducing SDR content received through real time streaming is received, the video signal 910 is transmitted to the video processor 130, and the first graphic signal 921 and the first graphic signal 921 are received. The two graphic signals 922 are input to the first graphic processor 140.

The video processing module 131 (eg, the xvYCC processing block) of the video processing unit 130 performs color space conversion and gamma conversion on the SDR video signal 710 based on the determination result as described above. (ST.1886 to ST.2084 conversion) can be performed respectively. In one embodiment, gamma conversion may be implemented to sequentially perform ST.1886 to leaner de-gamma conversion and linear to ST.2084 gamma conversion, as shown in FIG. 11 (b). The converted HDR video signal 610 is transmitted to the mixer 155 provided in the output module 154 of the second graphic processor 150.

The first graphic processor 140 may apply to the first graphic signal 921 and the second graphic signal 922 based on the mode settings of the processing modules 151, 152, and 153 of the second graphic processor 150 as described above. No conversion is done for However, as described with reference to FIG. 5, the first graphic processing unit 140 is implemented to have various graphic processing functions such as animation processing. As shown in FIG. 11B, a second graphic displayed as a UI is shown. An animation process may be performed on the graphic signal 922.

The first graphic signal 621 and the second graphic signal 622 are mixed by the compositor 145 and output to the second graphic processor 150.

The second graphic processor 150 receives the mixed SDR graphic signal from the first graphic processor 140, and the mixed SDR graphic signal is HDR by the processing modules 151, 152, and 153 set to the SDR to DDR conversion mode. It is converted into a graphic signal and transmitted to the mixer 155.

The mixer 155 mixes or merges the HDR graphic signal transmitted as described above with the HDR video signal input from the video processor 130 and outputs the merged HDR video signal to the HDR TV which is the external device 200.

Accordingly, the image signal composed of the HDR video and the HDR graphic is transmitted to the external device 200 so that a high quality image can be displayed without distortion caused by the color of the image.

According to the fourth embodiment as described above, in the electronic device 100 that receives a content including a video signal and a graphic signal in real time from the outside, the first graphic processing unit 140 operating on a software basis may be configured as a UI. Performs animation processing for the graphic signal and converts the graphic signal 920 by the second graphic processor 150 having a hardware configuration along a single processing path, thereby making use of all available resources. Can be processed.

In the embodiment of FIG. 11, the electronic device 100 receives the video signal and the first and second graphic signals in the SDR format, and the external device 200 displaying the image is an HDR TV. It will be readily understood in the art that the format of the content provided by streaming in the present invention, the format of the built-in UI, or the type of TV is not limited thereto.

As mentioned above, the present invention has been described in detail through preferred embodiments, but the present invention is not limited thereto and may be variously implemented within the scope of the claims.

100: electronic device 200: external device
110: connection unit 120: communication unit
130: video processing unit 140: first graphics processing unit
150: second graphics processor 160: user input unit
170: storage unit 180: processor

Claims (20)

In the electronic device,
A connection portion connectable to the display device;
Storage unit;
A video processor which processes a video signal;
First and second graphic processing units which process graphic signals;
Read identification data from a display device connected through the connection unit, and determine a format of a video signal and a graphic signal supported by the display device based on the identification data,
The first graphic processor converts any one of a first graphic signal related to the video signal and a second graphic signal stored in the storage unit to correspond to a format of the determined graphic signal, and the first graphic signal and the second graphic. By mixing the signals to control the output of the graphic signal of a single layer,
The second graphic processing unit receives a video signal output from the video processing unit and a graphic signal output from the first graphic processing unit, and an output signal based on the received video signal and the graphic signal to the display device through the connection unit. An electronic device comprising a processor for controlling the transmission. The method of claim 1,
The first graphic processing unit,
An electronic device that executes a predetermined program and converts one of the first graphic signal and the second graphic signal according to the determined graphic signal format by the executed program. The method of claim 1,
The second graphic processing unit,
At least one processing module capable of processing a graphic signal,
And an output module for outputting the output signal to the connection unit. The method of claim 3,
The processor,
And setting the graphic signal received from the first graphic processing unit to pass the at least one processing module of the second graphic processing unit to the output module by referring to the setting information stored in the storage unit. The method of claim 4, wherein
The processor,
When the occurrence of a predetermined event is detected, the second graphic processor sets the second graphics processor to bypass the graphic signal with reference to the setting information.
The event may include at least one of booting the electronic device, inputting content including the video signal and the graphic signal, or user input. The method of claim 1,
The first graphic processing unit,
The electronic device performs color space conversion and gamma conversion on any one of the first graphic signal and the second graphic signal according to the determination result. The method of claim 6,
The first graphic processing unit,
And at least one of animation processing, 2D or 3D graphics processing, geometry coordinate processing, acceleration processing, or transparency adjustment on at least one of the first graphic signal and the second graphic signal. The method of claim 1,
The video signal and the first graphic signal are included in a content, and the first graphic signal includes an IG (interactive graphic) and a presentation graphic (PG),
The second graphic signal includes a user interface (UI) or an on screen display (OSD) stored in the storage unit. The method of claim 8,
An optical disc storage unit storing contents including the video signal and the first graphic signal; And
And a disk loader for reading data from the optical disk storage unit. The method of claim 1,
The video processor converts the video signal to correspond to the determined video signal format according to the determination result.
And the second graphic processor generates the output signal by mixing the changed video signal with a graphic signal output from the first graphic processor. The method of claim 1,
The first graphic processing unit and the second graphic processing unit are provided integrally. In the control method of an electronic device,
Reading identification data from a display device connected through a connection unit, and determining a format of a video signal and a graphic signal supported by the display device based on the identification data;
Outputting a video signal to a video processor, and outputting a first graphic signal associated with the video signal and a second graphic signal stored in a storage unit of the electronic device to the first graphic processor;
Converting, by the first graphic processor, any one of the first graphic signal and the second graphic signal to correspond to the determined graphic signal format;
Mixing the first graphic signal and the second graphic signal and outputting a single layer graphic signal to a second graphic processor;
Receiving a video signal output from the video processor and a graphic signal output from the first graphic processor in the second graphic processor; And
And transmitting an output signal based on the received video and graphic signals to the display device through the connection unit. The method of claim 12,
And executing a predetermined program by the first graphic processor, and converting one of the first graphic signal and the second graphic signal by the executed program to correspond to the determined graphic signal format. Control method. The method of claim 12,
The second graphic processor may include at least one processing module capable of processing a graphic signal, and an output module configured to output the output signal to the connection unit.
And setting the graphic signal received from the first graphic processing unit to pass the at least one processing module of the second graphic processing unit to the output module by referring to the setting information stored in the storage unit. A control method of an electronic device. The method of claim 14,
When the occurrence of a predetermined event is detected, setting the second graphic processor to bypass the graphic signal by referring to the setting information from the storage unit.
The event may include at least one of booting the electronic device, inputting content including the video signal and the graphic signal, or user input. The method of claim 12,
The converting step,
And performing color space conversion and gamma conversion on any one of the first graphic signal and the second graphic signal according to the determination result. The method of claim 16,
In the first graphic processor, performing at least one of animation processing, 2D or 3D graphics processing, geometry coordinate processing, acceleration processing, or transparency adjustment on at least one of the first graphics signal and the second graphics signal. The control method of the electronic device further comprising. The method of claim 12,
The video signal and the first graphic signal are included in a content, and the first graphic signal includes an IG (interactive graphic) and a presentation graphic (PG),
And the second graphic signal comprises a user interface (UI) or an on screen display (OSD) stored in the storage unit. The method of claim 12,
Converting, by the video processor, the video signal to correspond to the determined video signal format according to the determination result;
And in the second graphic processing unit, mixing the converted video signal with the graphic signal output from the first graphic processing unit to generate the output signal. A non-volatile recording medium readable by a computer, in which a program of a method executable by an electronic device processor is recorded,
The method,
Reading identification data from a display device connected through a connection unit, and determining a format of a video signal and a graphic signal supported by the display device based on the identification data;
Outputting a video signal to a video processor, and outputting a first graphic signal associated with the video signal and a second graphic signal stored in a storage unit of the electronic device to the first graphic processor;
Converting, by the first graphic processor, any one of the first graphic signal and the second graphic signal to correspond to the determined graphic signal format;
Mixing the first graphic signal and the second graphic signal and outputting a single layer graphic signal to a second graphic processor;
Receiving a video signal output from the video processor and a graphic signal output from the first graphic processor in the second graphic processor; And
And transmitting an output signal based on the received video and graphic signals to the display apparatus through the connection unit.

Images