JP2019220752A - Information processing device - Google Patents

Abstract

To provide a technique capable of determining a color gamut of image data with higher accuracy.SOLUTION: The information processing device includes: first acquisition means for acquiring format information on a format of image data; second acquisition means for acquiring range information on a luminance range of the image data; determining means for determining a color gamut of the image data on the basis of the format information and the range information.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an information processing device that determines a color gamut of image data.

  In recent years, the resolution of images has been increased, and for example, images (image contents) having resolutions such as 4K2K (3840 × 2160, 4096 × 2160) and 8K4K (7680 × 4320) are becoming widespread. Further, format information such as image resolution and a transmission method of image data (image signal) are defined by various standardization organizations. For example, ITU (International Telecommunication Union), which is a specialized organization of the United Nations, sets international standards regarding image specifications. More specifically, BT., Which is a standard that defines the resolution and color gamut (colorimetry) of an image, the frame rate, the bit depth per pixel, and the like. 2020 and the like are defined. Information specified by the standard is added (superimposed) to image data as metadata (additional information) and transmitted. The source device, which is the transmitter of the image data, adds the metadata to the image data and transmits the metadata to the sink device, which is the receiver of the image data. The sink device extracts metadata from the received image data and performs image processing based on the metadata on the image data, thereby realizing display and expression according to the specifications of the image data.

  Here, there is a case where the source device transmits image data without adding various types of information specified by the standard due to a defect of the device, an inadequate response to the standard, and the like. For this reason, the sink device may request the user to set various information, or may determine (estimate) various information based on image data.

  According to the technique disclosed in Patent Document 1, when information on a color gamut (color gamut information) is not received, the color gamut of the received image data is estimated from a synchronization signal of the received image data. BT. 2020, BT. 709, BT. In 601 and the like, the resolution and the color gamut are defined on a one-to-one basis, and the color gamut can be estimated from the resolution. According to the technique disclosed in Patent Document 1, the color gamut is estimated using such a relationship between the resolution and the color gamut. As a result, even when color gamut information is not received, it is possible to perform appropriate image processing on the received image data, and it is possible to perform display according to the specifications of the image data.

JP 2009-303278 A

  However, BT. In international standards such as 2100, one color gamut is associated with a plurality of resolutions. In addition, a plurality of resolutions of a certain standard may overlap with a resolution of another standard, and the color gamut may be different between the standards. Therefore, in the method of Patent Document 1 in which the color gamut is estimated from the resolution, the color gamut cannot be uniquely determined from the resolution, and erroneous determination (erroneous estimation) of the color gamut may occur.

Specifically, with respect to HDR (High Dynamic Range), BT. In 2100, 8K4K, 4K2K, and Full HD are defined as resolutions, and BT. A subset (set) of colors defined in 2020 is defined as a color gamut. And BT. 709 specifies Full HD as the resolution, and BT. A subset of the colors defined in 709 is defined as a color gamut. Therefore, for Full HD, BT. 2020 and BT. 709 color gamut exists as a candidate,
Since the color gamut cannot be uniquely determined from the HD, an erroneous determination of the color gamut may occur.

  If the color gamut is incorrectly determined, appropriate image processing is not performed, and a color deviating from the intended color of the image data may be displayed.

  An object of the present invention is to provide a technique capable of determining the color gamut of image data with higher accuracy.

A first aspect of the present invention provides:
First acquisition means for acquiring format information on a format of image data;
Second acquisition means for acquiring range information on a luminance range of the image data;
Determining means for determining a color gamut of the image data based on the format information and the range information,
An information processing apparatus characterized by having:

A second aspect of the present invention provides:
Obtaining format information about the format of the image data;
Obtaining range information on a luminance range of the image data;
Determining a color gamut of the image data based on the format information and the range information;
An information processing method comprising:

  A third aspect of the present invention is a program for causing a computer to function as each unit of the information processing device described above.

  According to the present invention, the color gamut of image data can be determined with higher accuracy.

FIG. 2 is a block diagram illustrating a configuration example of a projector according to the embodiment. 4 is a flowchart illustrating an operation example of the projector according to the embodiment. FIG. 2 is a block diagram illustrating an example of an internal configuration of an image receiving unit according to the embodiment. 4 is a flowchart illustrating an operation example of the projector according to the embodiment. 4 is a diagram illustrating an example of a relationship between resolution, HDR metadata, and a color gamut according to the embodiment FIG. 2 is a diagram illustrating an example of a data structure of HDR metadata according to the embodiment.

  Hereinafter, embodiments of the present invention will be described. Hereinafter, an example of a projector including the information processing apparatus according to the present embodiment will be described.

<Overview of projector>
FIG. 1 is a block diagram illustrating a configuration example of a projector 100 according to the present embodiment. The control unit 101 controls each functional unit of the projector 100. The control unit 101 is connected to each function unit using the bus 133, and can perform access such as transmission of a control instruction to each function unit, transmission and reception of data with each function unit, and the like. .

The operation unit 102 receives an operation from a user. The power supply unit 103 is connected to the projector 10
0 controls the power supply to each functional unit. The liquid crystal unit 104 includes one liquid crystal panel, three liquid crystal panels, and the like, and forms an image (a transmittance distribution corresponding to the image) on the liquid crystal panel. In the present embodiment, it is assumed that the liquid crystal unit 104 (liquid crystal panel) has a resolution of 4096 Pixel × 2160 Line. The liquid crystal driving unit 105 drives the liquid crystal unit 104 based on the image data (image signal) input to the liquid crystal driving unit 105 so that an image is formed on the liquid crystal unit 104. The light source 106 supplies light to the liquid crystal unit 104. The projection optical system 107 projects an optical image obtained by supplying light emitted from the light source 106 to the liquid crystal unit 104 on a screen (display surface) (not shown). The light source control unit 108 controls the light amount of the light source 106 and the like. The optical system control unit 109 controls operations of a zoom lens and a focus lens of the projection optical system 107, and adjusts a zoom magnification and a focus of a projection image (an image displayed on a screen by the projection of the projection optical system 107). Do.

  The image receiving units 110 and 111 receive (acquire) image data (image signals) from an external device. The external device is, for example, a BD (Blu-ray (registered trademark)) recorder, an STB (Set Top Box), or the like, and is a device that can receive and transmit a digital image signal based on a digital broadcasting data system defined by the ITU. It is. The image receiving units 110 and 111 are input terminals such as, for example, HDMI (High-Definition Multimedia Interface) (registered trademark).

  Depending on the type of image interface standard, the transmission method of image data, the number of signal lines, and the like are determined. For example, there are a separate clock system for separating and transmitting a data signal and a clock signal for forming a pixel, an embedded clock system for embedding a clock signal in a data signal, and the like. HDMI employs a separate clock system, and a data signal is received at an HDMI input terminal based on a transmitted clock signal.

  Inside the image receiving units 110 and 111, an Extended Display Identification Data (EDID) (not shown) indicating format information on a format of image data receivable by the projector 100 is held. Then, the image receiving units 110 and 111 can notify the external device of the EDID based on a request from the external device. In addition, an HPD (Hot Plug Detect) line is included in the connection line with the external device, and the image receiving units 110 and 111 notify the external device via the HPD line that the image receiving units 110 and 111 are connected to the external device. can do. Furthermore, the image receiving units 110 and 111 can also perform measurement, analysis of an image format, acquisition (extraction) of metadata added (superimposed) on the image data, and the like for the received image data. External devices connected to the image receiving units 110 and 111 output image data based on format information (information such as resolution, frame rate, bit depth, and support for HDR content, etc.) included in the EDID.

The USB interface 112 transmits and receives various data such as image data (image files) to and from the outside. A pointing device, a keyboard, a USB flash memory, or the like may be connected to the USB interface 112. The communication unit 114 transmits and receives various data such as image data (image files) and various command signals to and from an intranet or the Internet. For example, the communication unit 114 is a communication device such as a wired LAN or a wireless LAN. The internal memory 115 stores various data (various files) such as image data and user setting data. The internal memory 115 is, for example, a semiconductor memory or a hard disk.

The image processing unit 116 performs various types of image processing on the image data input to the image processing unit 116. For example, the image processing unit 116 converts the number of pixels of the image data to match the number of pixels of the liquid crystal panel, or doubles the number of frames and the frame rate of the image data for AC driving of the liquid crystal panel. . Further, the image processing unit 116 performs other image processing (such as luminance correction processing and color correction processing) for displaying a suitable image. In the AC driving of the liquid crystal panel, the applied voltage of the liquid crystal panel can be formed by using the characteristic of the liquid crystal panel that an image (transmittance distribution corresponding to the image) can be formed even when the applied voltage of the liquid crystal is a positive voltage or a negative voltage. Can be alternately switched between. At this time, since the liquid crystal driving unit 105 needs to alternately output the driving signal for the positive voltage and the driving signal for the negative voltage to the liquid crystal unit 104, the image processing unit 116 determines the number of frames of the image data. And double the frame rate. The liquid crystal driving unit 105 generates a driving signal based on the image data (processed image data) obtained by the image processing unit 116, and drives the liquid crystal unit 104 with the generated driving signal.

  When an image (optical image) is projected on a screen from an oblique direction, a projected image distorted in a trapezoidal shape or the like may be obtained. The image processing unit 116 also performs keystone correction for deforming the shape of the image so as to eliminate such distortion. In the keystone correction, at least one of a horizontal magnification (an enlargement ratio or a reduction ratio) of an image displayed on the liquid crystal panel and a vertical magnification of the image is changed. Thereby, the distortion of the image on the liquid crystal panel is canceled by the distortion of the image generated at the time of projection, and a projection image with reduced distortion (no distortion) is obtained. For example, a projected image close to (equal to) a rectangular image having a normal aspect ratio is obtained. The keystone correction may be automatically performed based on a tilt angle obtained by a tilt sensor 117 described later, or may be performed by a user operating the operation unit 102 or the like.

  The tilt sensor 117 detects the tilt of the projector 100. The timer 118 detects the operation time of the projector 100, the operation time of each functional unit, and the like. The thermometer 119 measures the temperature of the light source 106, the temperature of the liquid crystal unit 104, the outside air temperature, and the like. The cooling unit 120 cools the projector 100 by, for example, releasing the heat inside the projector 100 to the outside. The cooling unit 120 includes, for example, a heat sink and a fan. The file reproducing unit 121 decodes encoded file data or the like based on an instruction from the control unit 101. The infrared receiving unit 122 receives infrared light from a remote controller or other device attached to the projector 100 and sends a signal corresponding to the infrared light to the control unit 101. The infrared receivers 122 are respectively installed at a plurality of locations in the front-rear direction of the projector 100, for example.

  The focus detection unit 123 detects a distance between the projector 100 and the screen, and detects a focal length of light to be projected. The imaging unit 124 captures an image of the screen direction. The screen photometer 125 measures the amount of light and the brightness of the light reflected by the screen. The display unit 128 is arranged on the main body of the projector 100, and displays the status of the projector 100, a warning, and the like. The display control unit 129 controls display on the display unit 128. The battery 130 supplies power to the power supply unit 103 when power is not supplied from the outside to the projector 100 (power supply input unit 131 described later). It is a battery that supplies power. The power input unit 131 rectifies the voltage of the AC power from the outside into a predetermined voltage, and supplies the rectified power to the power supply unit 103. The RAM 132 is used as a memory in which programs stored in the internal memory 115 are expanded, a frame memory for image data, and the like.

<General operation of projector>
A normal operation example of the projector 100 will be described. The control unit 101 outputs an instruction to supply power to each functional unit to the power supply unit 103 in response to a power-on instruction from the operation unit 102, and sets the state of each functional unit to a standby state. To After the power is supplied to each functional unit, the control unit 101 outputs an instruction to start the light emission of the light source 106 to the light source control unit 108. Next, the control unit 101 outputs an instruction for adjusting the projection optical system 107 to the optical system control unit 109 based on information on the focus obtained by the focus detection unit 123 and the like. Then, the optical system control unit 109 operates the zoom lens and the focus lens of the projection optical system 107 so that the projection light forms an image on the screen. This prepares for projection.

  Next, the image processing unit 116 performs, for example, a combining process of arranging an image in a predetermined layout on the image data input to the image receiving unit 110, a resolution conversion to a resolution suitable for the liquid crystal unit 104, a gamma correction, and a brightness unevenness. Apply reduction correction, keystone correction, etc. Then, the liquid crystal driving section 105 drives the liquid crystal section 104 based on the image data (processed image data) after the image processing by the image processing section 116. As a result, an image (transmittance distribution corresponding to the image) based on the processed image data is formed on the liquid crystal unit 104.

  Then, the light emitted from the light source 106 passes through the liquid crystal unit 104, is guided to the projection optical system 107, passes through the projection optical system 107, and is projected on a screen. During projection, the control unit 101 detects the temperature of the light source 106 and the like using the thermometer 119, and operates the cooling unit 120 based on the detection result. For example, the control unit 101 operates the cooling unit 120 so that the light source 106 is cooled when the temperature of the light source 106 becomes 40 degrees or higher.

  When a power-off instruction is given by the operation unit 102, the control unit 101 outputs an instruction for performing termination processing to each functional unit. Then, when the preparation for the termination is completed, the power supply unit 103 terminates the power supply to each functional unit. The cooling unit 120 continues to operate for a while after the power is turned off, and cools the projector 100.

<Operation from image data reception to image projection>
An operation example of projecting an image based on the image data received by the image receiving unit 110 will be described with reference to the flowchart in FIG. As described above, the projector 100 has the two image receiving units 110 and 111. The operation when projecting an image based on the image data received by the image receiving unit 111 is the same as the operation when projecting an image based on the image data received by the image receiving unit 110.

  In step S101, the control unit 101 monitors (polls) the image receiving unit 110 and detects that an external device is connected to the image receiving unit 110 via an HDMI cable. Note that the image receiving unit 110 may output a predetermined signal (interrupt signal) to the control unit 101 according to the connection of the external device. Then, when there is an interrupt signal from the image receiving unit 110, the control unit 101 may determine that an external device is connected.

  When the connection of the external device is detected, in step S102, the control unit 101 issues an instruction for outputting the HPD signal (a notification that the image receiving unit 110 and the external device are connected) to the image receiving unit 110. Output to As a result, the image receiving unit 110 enables (asserts) the HPD signal, and sends the HPD signal to an external device via the HPD line assigned (assigned) for the HPD signal among a plurality of lines of the HDMI cable. Is output.

  The external device that has received the HPD signal requests the projector 100 for EDID. In step S103, when receiving an EDID request from the external device, the image receiving unit 110 reads the EDID held in the RAM (not shown) inside the image receiving unit 110, and outputs the read EDID to the external device ( Notice. Specifically, the image receiving unit 110 outputs EDID to an external device via a DDC (Display Data Channel) line assigned (assigned) for EDID among a plurality of lines of the HDMI cable. When the external device succeeds in acquiring (reading) the EDID from the projector 100, the external device starts transmitting image data based on the format information included in the acquired EDID.

When the transmission of the image data from the external device is started, in step S104, the image receiving unit 1
Reference numeral 10 performs reception processing of image data transmitted from the external device.

  The receiving process in step S104 will be described in detail with reference to FIG. FIG. 3 is a block diagram illustrating an example of the internal configuration of the image receiving unit 110. In HDMI, a TMDS (Transition Minimized Differential Signaling) method is adopted, and a synchronization signal receiving unit 1101 receives a TMDS clock signal rxSYNC of image data rxDATA. A CR (Clock Recovery) unit 1102 generates a clock signal recCLK for receiving (sampling) the image data rxDATA based on the TMDS clock signal rxSYNC received by the synchronization signal receiving unit 1101. The CR unit 1102 is configured using a PLL circuit or the like. The image data receiving unit 1103 receives the image data rxDATA based on the clock signal recCLK generated by the CR unit 1102.

  Information indicating horizontal synchronization timing, vertical synchronization timing, effective display timing, and the like is added to the image data rxDATA. The image receiving unit 110 (for example, the synchronization signal receiving unit 1101) can use a frequency counter circuit to measure (acquire) format information fmtDATA relating to a format such as a synchronization frequency and a resolution from the information and the TMDS clock signal. . The acquired format information fmtDATA is output to the FMT data holding unit 1104, and is recorded in the FMT data holding unit 1104 in a state where other functional units such as the control unit 101 can read out.

  Further, the image receiving unit 110 (for example, the image data receiving unit 1103) can also acquire metadata metaDATA included in a blanking period of the image data rxDATA. The acquired metadata metaDATA is output to the metadata holding unit 1105 together with the acquisition information indicating that the metadata metaDATA has been acquired, and the metadata holding unit 1105 is readable by other functional units such as the control unit 101. 1105. A holding area is determined for each type of information included in the metadata metaDATA, and information stored in a corresponding holding area is updated (overwritten) with the acquired information for each type. At this time, the acquisition information indicating that the metadata metaDATA has been acquired is also updated. The image data receiving unit 1103 outputs the image data rxDATA together with the synchronization signal to the image processing unit 116 as image data videoDATA based on the received information indicating the horizontal synchronization timing, the vertical synchronization timing, the effective display timing, and the like. The synchronization signal is a horizontal synchronization signal or a vertical synchronization signal.

  Subsequent to the reception processing in step S104, in step S105, the control unit 101 reads each data from the FMT data holding unit 1104 and the metadata holding unit 1105 to the RAM 132. In the process of reading the metadata into the RAM 132, the control unit 101 reads out the acquisition information (information indicating whether or not the metadata has been acquired) held in the metadata holding unit 1105 into the RAM 132. Then, when the acquisition information indicating that the metadata has been acquired is read, the control unit 101 reads the metadata to the RAM 132.

Next, in step S106, the control unit 101 outputs an instruction for executing the color gamut (colorimetry) application process to the image processing unit 116. Then, the image processing unit 116 performs a color gamut applying process on the image data input to the image processing unit 116 according to an instruction from the control unit 101. Normally, the control unit 101 executes a color gamut application process based on color gamut information (information on the color gamut of the image data received by the image receiving unit 110) included in the metadata read from the image receiving unit 110 to the RAM 132. , To the image processing unit 116. For example, a plurality of LUTs (Lookup Tables) respectively corresponding to a plurality of color gamuts are predetermined. The control unit 101 selects one of a plurality of LUTs (or a plurality of color gamut) according to the color gamut information read from the metadata holding unit 1105, and sends an instruction corresponding to the selection result to the image processing unit 116. Output to As a result, the image processing unit 116 performs a color gamut application process including a conversion process using an LUT according to the color gamut information. The LUT is generated based on the internal system and performance of the projector 100. The LUT is a table for converting pixel values (colors and the like) of image data. 2020 and BT. 709 is a table for converting image data based on a color gamut defined by a standard such as 709 into image data that matches the color reproduction capability of the projector 100.

  In step S106, when the color gamut information has not been acquired, a process (exception process) different from the above-described process in a normal state is performed. Details of the process of step S106 including the exception process will be described later.

  Next, in step S107, the image processing unit 116 performs a resolution conversion process on the image data after the color gamut application process so that the resolution of the image data matches the resolution of the liquid crystal unit 104. The image processing unit 116 outputs the image data (processed image data) after the resolution conversion processing to the liquid crystal driving unit 105. The liquid crystal driving unit 105 drives the liquid crystal unit 104 based on the processed image data to form an image (transmittance distribution) on the liquid crystal unit 104 based on the processed image data.

  Then, in step S108, the projection optical system 107 projects the light emitted from the light source 106 and transmitted through the liquid crystal unit 104 onto a screen. Thereby, a projection image based on the image data received by the image receiving unit 110 is displayed on the screen.

<Details of Operation in Step S106>
Details of the operation in step S106 will be described with reference to the flowchart in FIG.

  In step S201, control unit 101 determines whether or not color gamut information regarding the color gamut of the image data received by image receiving unit 110 has been acquired. Specifically, the control unit 101 refers to the acquisition information (information indicating whether or not metadata has been acquired) read out to the RAM 132 in step S105 in FIG. 2 and determines whether or not there is color gamut information. If it is determined that there is color gamut information (acquired), the process proceeds to step S213. In step S213, control unit 101 reads color gamut information from RAM 132. Then, in step S214, control unit 101 determines a color gamut based on the read color gamut information, and instructs image processing unit 116 to execute a color gamut application process based on the color gamut. The processing of steps S213 and S214 is the above-described normal processing. On the other hand, when it is determined that there is no color gamut information (not acquired), the process proceeds to step S202.

  In the present embodiment, the image data receiving unit 1103 and the like further obtain range information on the luminance range (dynamic range) of the image data received by the image receiving unit 110. For example, a standard (such as BT.2100) relating to HDR (High Dynamic Range) specifies the handling of HDR metadata relating to the luminance range of image data. And BT. HDR metadata can be obtained (extracted) from image data corresponding to 2100 or the like. In the processing in steps S202 to S205, the color gamut of the image data is determined (estimated) based on the format information on the format of the image data received by the image receiving unit 110 and the HDR metadata on the luminance range of the image data. ) Is done. Specifically, the format information includes resolution information on the resolution of the image data, and the color gamut is determined based on the resolution information and the HDR metadata.

The standard table 200 of FIG. 5 shows the relationship between the resolution of image data, HDR metadata, and color gamut in each standard defined by the ITU. Reference numeral 201 denotes a standard name, reference numeral 202 denotes a resolution, reference numeral 203 denotes presence or absence and contents of HDR metadata, and reference numeral 204 denotes a color gamut. BT. 601, the resolution is 720 × 480, there is no HDR metadata, and the color gamut is BT. 601 (a color gamut defined by BT.601). BT. In 709, the resolution is 1920 × 1080 (Full HD), there is no HDR metadata, and the color gamut is BT. 709 range. BT. In 2020, the resolution is 3840 × 2160 (4K2K), there is no HDR metadata, and the color gamut is BT. 2020 range. BT. 2100 specifies three types of resolutions, 1920 × 1080, 3840 × 2160, and 7680 × 4320 (8K4K), and the presence of HDR metadata. As a color gamut when the SDR (Standard Dynamic Range) narrower than the HDR is indicated in the HDR metadata, BT. 709 defined range is defined. As a color gamut when HDR is indicated by HDR metadata, BT. A 2020 defined range is defined.

  In the present embodiment, the color gamut can be specified with high accuracy (uniquely) by paying attention to the relationship shown in FIG. 5 and further considering not only the resolution but also the presence or absence and contents of HDR metadata. .

  In step S202, control unit 101 determines whether or not HDR metadata relating to the luminance range of the image data received by image receiving unit 110 has been acquired. Specifically, when the HDR metadata is transmitted from the external device, the control unit 101 also reads the HDR metadata into the RAM 132 in step S105 in FIG. In step S202, the control unit 101 determines whether the HDR metadata has been read out to the RAM 132.

  An example of the data structure of the HDR metadata will be described with reference to FIG. Here, it is assumed that HDR metadata is transmitted from an external device based on the InfoFrame defined by CEA (Consumer Technology Association), and a data structure based on the InfoFrame will be described. In the InfoFrame, a storage area of InfoFrame Type information indicating the type of the InfoFrame is specified at the beginning. Next, a storage area for information indicating Version of the data structure and a storage area for information indicating the data length of HDR metadata are defined in order.

  In the HDR metadata 300, a storage area 301 is an EOTF (Electro-Optical Transfer Function) storage area indicating an EOTF (Electro-Optical Transfer Function) system indicating a relationship between image data (gradation values) and luminance. The information in the storage area 301 is also range information on the luminance range of the image data. In the present embodiment, it is assumed that three bits are allocated to the storage area 301.

  Information 3011 indicates EOTF information stored in the storage area 301. EOTF information “0” corresponds to SDR, and EOTF information “1” to “3” corresponds to HDR. The EOTF information “2” is an SMPTE (Society of Motion Picture and Television Engineers) ST. It corresponds to the EOTF method specified in 2084. SMPTE ST. The EOTF method specified in 2084 is also called “PQ (Perceptual Quantizer) method” or the like. Although the EOTF method is not assigned to the EOTF information “4” to “7”, various EOTF methods can be assigned. The EOTF method assigned to the EOTF information “0” to “7” can be changed.

If it is determined in step S202 that there is HDR metadata, in step S203, the control unit 101 determines whether the luminance range of the image data received by the image receiving unit 110 is HDR. Specifically, the control unit 101 determines that the EOTF information is “1” to “3”.
Is determined. If the luminance range is determined to be HDR, the control unit 101 determines in step S204 that the color gamut of the image data received by the image receiving unit 110 is BT. 2020 is determined to be within the specified range. If it is determined that the luminance range is not HDR (is SDR), in step S205, the control unit 101 determines that the color gamut of the image data received by the image receiving unit 110 is BT. It is determined that the value falls within the 709 specified range. If the EOTF information is “0”, it is determined that the luminance range is SDR. When the EOTF information is any of “4” to “7”, the luminance range may be determined to be SDR, or the luminance range may be determined to be HDR. In step S202, it may be determined that there is no HDR metadata. When the color gamut is determined, the image processing unit 116 is instructed to execute a color gamut application process based on the color gamut.

  If it is determined in step S202 that there is no HDR metadata, in steps S206 to S212, the control unit 101 determines whether or not the image data of the image data based on the resolution of the image data received by the image receiving unit 110. Determine the color gamut. The resolution information has been read from the FMT data holding unit 1104 to the RAM 132 in step S105 of FIG. 2, and the control unit 101 refers to the resolution information read to the RAM 132.

  In step S206, control unit 101 determines that the resolution of the image data received by image receiving unit 110 is BT. A determination is made as to whether or not the data conforms to the rule of 601 (720 × 480). Here, BT. Although the number 480 of vertical effective lines corresponding to the BT. Since only the total number of vertical lines is defined in 601, the total number of vertical lines (525 lines, 625 lines, etc.) may be used for the determination. The resolution is BT. If the control unit 101 determines that the color gamut of the image data received by the image receiving unit 110 is equal to the BT. 601 is determined to be within the specified range.

  In step S206, when the resolution is BT. If it is determined that the resolution of the image data received by the image receiving unit 110 is BT. Judgment is made as to whether or not it conforms to the rules of 709 (1920 × 1080). The resolution is BT. If the control unit 101 determines that the color gamut of the image data received by the image receiving unit 110 is BT. It is determined that the value falls within the 709 specified range.

  In step S208, when the resolution is BT. If the control unit 101 determines that the resolution of the image data received by the image receiving unit 110 is BT. Then, it is determined whether or not the data conforms to the rules of 2020 (3840 × 2160). The resolution is BT. If the control unit 101 determines that the color gamut of the image data received by the image receiving unit 110 is BT. 2020 is determined to be within the specified range.

  If the resolution is BT. If it is determined that the image data does not conform to the rules of BT.2020, the standard of the image data received by the image receiving unit 110 is BT. 601, BT. 709 and BT. 2020. Therefore, in step S212, control unit 101 determines that the color gamut of the image data received by image receiving unit 110 is BT. It is determined that the value falls within the 709 specified range. In step S212, another color gamut may be adopted.

  As described above, according to the present embodiment, the color gamut of the image data can be determined with higher accuracy by further considering the presence or absence and the content of the range information. Specifically, color gamut information is not obtained, and a plurality of assumed standards are BT. The color gamut can be determined (estimated) with high accuracy even in situations including 2100 and the like.

  The present embodiment is merely an example, and the present invention includes a configuration obtained by appropriately modifying or changing the configuration of the present embodiment within the scope of the present invention. For example, various information (format information, color gamut information, range information, and the like), a method of acquiring various information, various standards of image data, various resolutions of image data, various color gamuts of image data, and the like are examples. Is possible.

  In the flowchart of FIG. 2, the reading of the metadata and the format information (step S105) is performed only once, but is not limited to this. For example, HDR metadata may be transmitted for each frame of image data. Therefore, the HDR metadata may be obtained and read into the RAM 132 for each frame in synchronization with the transmission timing of each frame, and the color gamut of the image data may be determined (estimated) for each frame.

  The color gamut may be determined (estimated) by further considering bit depth information regarding the bit depth of the image data included in the format information. Specifically, with respect to HDR, it is defined that the bit depth is 10 bits or more. Therefore, in step S202, control unit 101 may further determine whether or not the bit depth of the image data received by image receiving unit 110 is 10 bits or more. If the bit depth is less than 10 bits, the process may proceed to step S206 regardless of the presence or absence of HDR metadata. That is, when the bit depth is less than 10, the color gamut of the image data is BT. Regardless of the information other than the bit depth information. It may be determined that the color gamut is not 2020.

  Also in the case where the image receiving unit 111 receives image data, the same effect can be obtained by the same processing as the case where the image receiving unit 110 receives image data. The process of determining the color gamut of image data to be displayed and the process of determining the color gamut of image data not to be displayed may be performed in parallel. Here, an image based on the image data received by one of the image receiving unit 110 and the image receiving unit 111 is displayed, and an image based on the image data received by the other of the image receiving unit 110 and the image receiving unit 111 is displayed. Consider the case when it is not displayed. In this case, the process of determining the color gamut of the received image data may be performed as background processing along with the process of determining the color gamut of the received image data on the one hand. Thereby, the display of the image based on the image data received on the other side can be started smoothly (in a short time and with the disturbance of the image suppressed). Similar parallel execution is possible for image processing based on the determined color gamut.

  Depending on the system configuration inside the projector 100, the displayed image may be disturbed when the image processing in the image processing unit 116 changes. Therefore, when the image processing changes, the control unit 101 may perform control so that the display of the image is temporarily stopped and the image processing is performed in that state (non-display state). Here, a case is considered in which color gamut information is not acquired and HDR metadata is acquired for each frame. In this case, the control unit 101 may detect a change in range information between frames. Then, when detecting a change in the range information, the control unit 101 may temporarily stop displaying the image and perform control so that image processing is performed in that state (non-display state). .

  The control unit 101 may always determine the color gamut in the processing of steps S202 to S212 without using the color gamut information. That is, it may be assumed that color gamut information is not acquired. The example in which the determined color gamut is different between HDR and SDR has been described. However, the determined color gamut may be different between a plurality of luminance ranges corresponding to HDR, or the determined color gamut may be different from SDR. The color gamut to be determined may be different between a plurality of luminance ranges.

Although the example of the projector has been described, the information processing apparatus according to the present embodiment may not be an apparatus provided in the projector. For example, the information processing device according to the present embodiment may be a device (a repeater such as an amplifier, a conversion device, or the like) that receives image data, converts the image data into processed image data, and transmits the processed data to the outside. Good. The information processing apparatus according to the present embodiment may be an apparatus that, when color gamut information is not added to image data, outputs the image data to the outside with color gamut information related to the determined color gamut added. Good.

  Each functional unit of the present embodiment may or may not be individual hardware. The functions of two or more functional units may be realized by common hardware. Each of a plurality of functions of one functional unit may be realized by individual hardware. Two or more functions of one functional unit may be realized by common hardware. Also, each functional unit may or may not be realized by hardware. For example, the device may have a processor and a memory in which a control program is stored. Then, the functions of at least some of the functional units of the device may be realized by the processor reading out the control program from the memory and executing the control program.

<Other embodiments>
The present invention supplies a program for realizing one or more functions of the above-described embodiments to a system or an apparatus via a network or a storage medium, and one or more processors in a computer of the system or the apparatus read and execute the program. It can also be realized by the following processing. Further, it can be realized by a circuit (for example, an ASIC) that realizes one or more functions.

100: Projector 101: Control unit 110, 111: Image receiving unit 1101: Synchronous signal receiving unit 1103: Image data receiving unit

Claims (15)

First acquisition means for acquiring format information on a format of image data;
Second acquisition means for acquiring range information on a luminance range of the image data;
Determining means for determining a color gamut of the image data based on the format information and the range information,
An information processing apparatus comprising: The format information includes resolution information related to the resolution of the image data,
The information processing apparatus according to claim 1, wherein the determination unit determines a color gamut of the image data based on the resolution information and the range information. A third acquisition unit that acquires color gamut information related to a color gamut of the image data,
The determining means includes:
When the color gamut information is obtained, determine the color gamut of the image data based on the color gamut information,
The information processing apparatus according to claim 2, wherein when the color gamut information is not acquired, a color gamut of the image data is determined based on the resolution information and the range information. In the processing for determining the color gamut of the image data based on the resolution information and the range information,
When the resolution of the image data is the first resolution and range information on a first luminance range has been acquired, the first color gamut is determined as the color gamut of the image data;
When the resolution of the image data is the first resolution and the range information has not been obtained, a second color gamut different from the first color gamut is determined as the color gamut of the image data. 4. The information processing apparatus according to claim 2, wherein The first resolution is a Full HD or 4K2K resolution;
When the first resolution is a Full HD resolution,
The first luminance range is HDR (High Dynamic Range),
The first color gamut is BT. 2020 color gamut,
The second color gamut is BT. 709 color gamut,
When the first resolution is a 4K2K resolution,
The first luminance range is an SDR (Standard Dynamic Range),
The first color gamut is BT. 709 color gamut,
The second color gamut is BT. The information processing apparatus according to claim 4, wherein the information processing apparatus has a color gamut of 2020. In the processing for determining the color gamut of the image data based on the resolution information and the range information,
When the resolution of the image data is the second resolution and range information on a second luminance range has been obtained, a third color gamut is determined as the color gamut of the image data;
Different from the third color gamut when the resolution of the image data is the second resolution and range information on a third luminance range narrower than the second luminance range is obtained. The information processing apparatus according to claim 2, wherein a fourth color gamut is determined as a color gamut of the image data. The second resolution is a Full HD, 4K2K, or 8K4K resolution;
The second luminance range is HDR (High Dynamic Range),
The third luminance range is an SDR (Standard Dynamic Range),
The third color gamut is BT. 2020 color gamut,
The fourth color gamut is BT. The information processing apparatus according to claim 6, wherein the color gamut is 709. The format information includes bit depth information regarding a bit depth of the image data,
The apparatus according to claim 2, wherein the determination unit further considers the bit depth information in a process of determining a color gamut of the image data based on the resolution information and the range information. An information processing apparatus according to claim 1. In the process of determining the color gamut of the image data based on the resolution information and the range information, the determination unit may be configured to determine a color gamut of the image data other than the bit depth information when the bit depth of the image data is less than 10 bits. Of the image data is BT. The information processing apparatus according to claim 8, wherein it is determined that the color gamut is not the gamut of 2020. The second obtaining means obtains the range information for each frame of the image data,
The information processing apparatus according to claim 1, wherein the determination unit determines a color gamut of the image data for each frame. Acquisition means for acquiring the image data,
The information processing apparatus according to claim 1, further comprising: a processing unit configured to perform image processing on the image data based on the color gamut determined by the determination unit. Acquisition means for acquiring the image data,
A processing unit that generates processed image data by performing image processing on the image data based on the color gamut determined by the determination unit;
Detecting means for detecting a change in the range information between frames of the image data,
Control means for displaying the image on a display unit, such that the display of the image based on the processed image data is temporarily stopped when a change in the range information is detected by the detection means,
The information processing apparatus according to claim 10, further comprising: Image data to be displayed, and acquisition means for acquiring the image data not to be displayed, further comprising:
The process of determining the color gamut of the image data to be displayed and the process of determining the color gamut of the image data not to be displayed are performed in parallel. The information processing device according to item. Obtaining format information about the format of the image data;
Obtaining range information on a luminance range of the image data;
Determining a color gamut of the image data based on the format information and the range information;
An information processing method comprising:   A program for causing a computer to function as each unit of the information processing apparatus according to claim 1.