JP7271490B2 - Information processing device and information processing method - Google Patents

Description

The present invention relates to an information processing device and an information processing method.

Various standards such as PQ (Perceptual Quantizer) and HLG (Hybrid Log-Gamma) have been proposed as standards for image data having a wide dynamic range (wide luminance range). These wide dynamic ranges are called "HDR (High Dynamic Range)". On the other hand, a conventional dynamic range (dynamic range narrower than HDR) is called "SDR (Standard Dynamic Range)". By using each brightness of HDR, a wide range of image representation from very dark dark areas to very bright bright areas is possible.

HDR standards include, for example, HDR10 established by the US CTA (Consumer Technology Association). In HDR10, peak luminance (maximum luminance) and maximum frame average luminance in the entire moving image content (moving image) are defined as metadata (static metadata). The maximum frame average luminance is the maximum luminance of a plurality of frame average luminances respectively corresponding to a plurality of frames (average luminance of images (frame images) corresponding to the frames).

HDR standards include ST2094-40 established by the US SMPTE (Society of Motion Picture and Television Engineers). In ST2094-40, peak luminance and maximum frame average luminance for each partial period of moving images are specified as metadata (dynamic metadata). Specifically, the peak brightness and maximum frame average brightness of each scene and each frame of a moving image are defined as dynamic metadata.

HDR standards include BT. 2408-1 Operational practices in HDR television production. BT. 2408-1 Operational practices in HDR television production considers the impact on the user when the luminance changes significantly, and states that changes in peak luminance and average luminance should be managed.

At the production site of HDR images (images with HDR), in order to check whether each luminance of HDR can be used, a function that displays the luminance distribution of each frame individually with a waveform monitor, luminance histogram, etc. is used. there is Patent Literature 1 discloses a technique of drawing a portion of a luminance histogram that changes between frames in a color different from that of other portions in order to allow the user to intuitively grasp the change in luminance distribution between frames. there is

Furthermore, some devices, such as display devices for business use, are equipped with a function of displaying a graph showing temporal changes in frame peak luminance (peak luminance of a frame image) and temporal changes in frame average luminance. At the production site of HDR images, such a function is used to check and manage temporal changes in frame peak luminance and temporal changes in frame average luminance.

FIG. 10 shows an example of a conventional graphic image showing temporal changes in frame peak luminance and temporal changes in frame average luminance. In the graphic image 1000 of FIG. 10, a graph 1001 showing temporal change 1002 of frame peak luminance and temporal change 1003 of frame average luminance is drawn. The horizontal axis of graph 1001 indicates the time position (frame), and the vertical axis of graph 1001 indicates luminance. In the upper right part of the graphic image 1000, numerical values of the frame peak luminance and the frame average luminance of the final frame are drawn. Numerical values of the peak luminance (Maximum Content Light Level) and the maximum frame average luminance (Maximum Frame Average Light Level) of the entire moving image are drawn in the upper left part of the graphic image 1000 . Numerical values of the peak luminance and the maximum frame average luminance during a partial period such as the period during which the graphic image 1000 is displayed may be drawn. These pieces of information can be obtained from metadata (HDR10 or metadata defined by ST2094-40) included in HDMI (High-Definition Multimedia Interface) data or the like. Such information can also be obtained by analyzing the moving image data itself.

JP 2010-113288 A

Using the technology disclosed in Patent Document 1, the user can grasp the luminance distribution of each frame and changes in the luminance distribution in a relatively short period such as a period of two frames. However, the user cannot easily grasp the change in luminance distribution over a relatively long period such as the period of the entire moving image or the period of a scene. For example, the user cannot grasp in a short time how many pixels having what luminance (luminance level) exist at each time position in a relatively long period of time. By displaying the graphic image 1000 in FIG. 10, the user can grasp the time change 1002 of the frame peak luminance and the time change 1003 of the frame average luminance. However, the user cannot grasp the luminance distribution (luminance level distribution) of each frame and the temporal change of the luminance distribution.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a technology that enables a user to easily (intuitively) grasp temporal changes in luminance level distribution over a relatively long period of time.

According to a first aspect of the present invention, the HDR moving image is obtained based on acquisition means for acquiring a gradation value of a pixel in an HDR moving image, and information on a correspondence relationship between the gradation value and the gradation value and absolute luminance. generating means for generating a graph having a first axis indicating the time position of the moving image and a second axis indicating the absolute luminance, the generating means adding the coordinates of the graph to the time position corresponding to the coordinates , one of a plurality of colors is set according to the number of pixels with absolute luminance corresponding to the coordinates, and the plurality of colors includes a first color, a second color, and a third color , the generation means makes the color of the coordinates closer to the first color as the number of pixels corresponding to the coordinates increases, and adjusts the color of the coordinates to the first color as the number of pixels corresponding to the coordinates decreases. A color is set to the coordinate so that the color of the coordinate is closer to the second color .
A second aspect of the present invention is an acquisition means for acquiring information about luminance levels of pixels in a moving image, and a first axis indicating the time position of the moving image and a second axis indicating the luminance level based on the information. and generating means for generating a graph having the coordinates of the graph, the generating means depending on the number of pixels of the brightness level corresponding to the coordinates at the time position corresponding to the coordinates, setting any one of a plurality of colors, the plurality of colors including a first color, a second color and a third color; When a pixel with a corresponding luminance level exists and the luminance level is out of a predetermined range, the coordinates are set to a predetermined color indicating that the luminance level is out of the range, and the generating means generates the color of the coordinates. However, as the number of pixels corresponding to the coordinates increases, the color of the coordinates approaches the first color, and as the number of pixels corresponding to the coordinates decreases, the color of the coordinates approaches the second color. and setting a color at the coordinates .
A third aspect of the present invention is an acquisition means for acquiring information about luminance levels of pixels in a moving image, and a first axis indicating the time position of the moving image and a second axis indicating the luminance level based on the information. and image processing means for converting the color of a pixel in the moving image into a conversion color according to the luminance level of the pixel when the false color function is enabled. wherein the generating means sets one of a plurality of colors to the coordinates of the graph according to the number of pixels having the luminance level corresponding to the coordinates at the time position corresponding to the coordinates. and the plurality of colors includes a first color, a second color, and a third color, and the generation means has the false color function enabled, and the time position corresponding to the coordinates of the graph If a pixel having a brightness level corresponding to the coordinates exists in the coordinate, a conversion color corresponding to the brightness level corresponding to the coordinates is set to the coordinates, and the generating means sets the color of the coordinates to the coordinates. Colors are added to the coordinates so that the color at the coordinates approaches the first color as the number of pixels corresponding to the coordinates increases, and the color at the coordinates approaches the second color as the number of pixels corresponding to the coordinates decreases. is an information processing apparatus characterized by setting

According to a fourth aspect of the present invention, the HDR moving image is obtained based on acquisition means for acquiring an HDR moving image, and information on the correspondence relationship between the gradation value of a pixel in the HDR moving image and the gradation value and the absolute luminance. generating means for generating a graph having a first axis indicating the time position of and a second axis indicating the absolute luminance; and a display means for displaying a synthesized moving image obtained by synthesizing the HDR moving image after the conversion processing and the graph, and the generating means is arranged at the coordinates of the graph and at the coordinates of the graph. One of a plurality of colors is set according to the number of pixels with absolute luminance corresponding to the coordinate at the corresponding time position, and the plurality of colors are a first color, a second color, and a third color. The color of the coordinate is closer to the first color as the number of pixels corresponding to the coordinate increases, and the color of the coordinate becomes closer to the first color as the number of pixels corresponding to the coordinate increases. In the display device , a color is set to the coordinates so that the color of the coordinates becomes closer to the second color as the number of colors decreases .
A fifth aspect of the present invention is an acquisition means for acquiring a moving image, and a first axis indicating the time position of the moving image and a second axis indicating the luminance level based on information about luminance levels of pixels in the moving image. image processing means for performing compression processing for compressing the luminance level range of the moving image to a predetermined range; the moving image after the compression processing; and the graph. and display means for displaying a moving image, wherein the generation means indicates the number of pixels of the luminance level before the compression processing corresponding to the coordinates at the time position corresponding to the coordinates in the graph. correspondingly, any one of a plurality of colors is set, the plurality of colors including a first color, a second color and a third color, and the generating means generates at a time position corresponding to the coordinates of the graph If there is a pixel with a luminance level corresponding to the coordinates and the luminance level is out of the predetermined range, the generating means sets a predetermined color indicating that the coordinates are out of the range, and The color of the coordinate becomes closer to the first color as the number of pixels corresponding to the coordinate increases, and the color of the coordinate becomes closer to the first color as the number of pixels corresponding to the coordinate decreases.
The display device is characterized in that a color is set at the coordinates so as to approximate the second color .
A sixth aspect of the present invention is an acquisition means for acquiring a moving image, and a first axis indicating the time position of the moving image and a second axis indicating the luminance level, based on information about luminance levels of pixels in the moving image. and image processing means for converting the color of a pixel in the moving image into a converted color according to the luminance level of the pixel when the false color function is enabled. and display means for displaying a synthesized moving image obtained by synthesizing the moving image after the conversion processing and the graph, and the generating means stores the coordinates of the graph at the time position corresponding to the coordinates , setting any one of a plurality of colors according to the number of the pixels having the luminance level corresponding to the coordinates, the plurality of colors including a first color, a second color and a third color; When the false color function is set to be valid and a pixel having a brightness level corresponding to the coordinates exists at the time position corresponding to the coordinates of the graph, the generation means generates a value corresponding to the coordinates at the coordinates. The conversion color is set according to the luminance level, and the generation means makes the color of the coordinate closer to the first color as the number of pixels corresponding to the coordinate increases, and the color of the coordinate becomes closer to the first color. In the display device , a color is set to the coordinates so that the color of the coordinates becomes closer to the second color as the number of corresponding pixels decreases.

According to a seventh aspect of the present invention, the HDR moving image is obtained based on an acquisition step of acquiring a gradation value of a pixel in an HDR moving image, and information on a correspondence relationship between the gradation value and the gradation value and the absolute luminance. and a generating step of generating a graph having a first axis indicating the time position of the moving image and a second axis indicating the absolute luminance, wherein the generating step includes, in the coordinates of the graph, the time position corresponding to the coordinates , one of a plurality of colors is set according to the number of pixels with absolute luminance corresponding to the coordinates, and the plurality of colors includes a first color, a second color, and a third color , in the generating step, the color of the coordinate becomes closer to the first color as the number of pixels corresponding to the coordinate increases, and the color of the coordinate becomes closer to the first color as the number of pixels corresponding to the coordinate decreases. and setting a color at the coordinates so that the color of the coordinates approaches the second color .
An eighth aspect of the present invention is an acquisition step of acquiring information about luminance levels of pixels in a moving image; and, in the generating step, in the coordinates of the graph, depending on the number of pixels of the luminance level corresponding to the coordinates at the time position corresponding to the coordinates, setting any one of a plurality of colors, the plurality of colors including a first color, a second color and a third color; When a pixel with a corresponding luminance level exists and the luminance level is out of a predetermined range, the coordinates are set to a predetermined color indicating that the luminance level is out of the range, and in the generating step, a color of the coordinates is set. However, as the number of pixels corresponding to the coordinates increases, the color of the coordinates approaches the first color, and as the number of pixels corresponding to the coordinates decreases, the color of the coordinates approaches the second color. and setting a color at the coordinates .
A ninth aspect of the present invention is an acquisition step of acquiring information about luminance levels of pixels in a moving image; and a converting step of converting the color of a pixel in the moving image into a converted color according to the luminance level of the pixel when the false color function is enabled. , in the generating step, one of a plurality of colors is set to the coordinates of the graph according to the number of the pixels having the luminance level corresponding to the coordinates at the time position corresponding to the coordinates; The plurality of colors includes a first color, a second color, and a third color, and in the generating step, the false color function is enabled, and at the time position corresponding to the coordinates of the graph, If there is a pixel with a luminance level corresponding to the coordinates, a conversion color corresponding to the luminance level corresponding to the coordinates is set to the coordinates, and in the generating step, the color of the coordinates is the color corresponding to the coordinates. Colors are set at the coordinates so that the color at the coordinates becomes closer to the first color as the number of pixels increases, and the color at the coordinates becomes closer to the second color as the number of pixels corresponding to the coordinates decreases. An information processing method characterized by:
A tenth aspect of the present invention is a program for causing a computer to function as each means of the above-described information processing apparatus or each means of the above-described display device.

According to the present invention, it is possible for the user to easily (intuitively) grasp the time change of the luminance level distribution over a relatively long period of time.

Block diagram showing a configuration example of a display device according to the present embodiment A diagram showing an example of a graphic image according to the present embodiment. FIG. 4 is a diagram showing an example of how to represent the luminance distribution according to the present embodiment; A diagram showing an example of a graphic image according to the present embodiment. A diagram showing an example of a graphic image according to the present embodiment. The figure which shows an example of the setting information which concerns on this embodiment. Flowchart showing an example of the processing flow of the display device according to the present embodiment A diagram showing an example of the correspondence relationship among gradation values, the number of pixels, and luminance according to the present embodiment. A diagram showing an example of a graph according to the present embodiment. A diagram showing an example of a conventional graphic image A diagram showing an example of a graphic image according to the present embodiment.

Embodiments of the present invention will be described below. An example in which the display device incorporates the information processing device according to the present embodiment will be described, but the information processing device according to the present embodiment may be a separate device (such as a personal computer) from the display device.

FIG. 1 is a block diagram showing a configuration example of a display device according to this embodiment. The display device 100 in FIG. 1 has an input unit 101, an image analysis unit 102, an image processing unit 103, a graphics synthesis unit 104, a display unit 105, a display control unit 106, a memory unit 107, and a graphics generation unit .

The input unit 101 acquires target moving image data and outputs the target moving image data to the image analysis unit 102 . The target moving image data is, for example, HDR (high dynamic range) moving image data conforming to HDR10, HDR10+, PQ, HLG, etc., and represents a moving image (moving image content). The target moving image data may be SDR (standard dynamic range) moving image data conforming to gamma 2.2 or the like. In this embodiment, the input unit 101 acquires frame image data (image data representing an image (frame image) corresponding to a frame) from an external device for each frame of a target moving image (moving image represented by target moving image data). do. The input unit 101 then outputs the acquired frame image data to the image analysis unit 102 . The input unit 101 is an input terminal conforming to standards such as SDI (Serial Digital Interface) and HDMI (High-Definition Multimedia Interface). The external device is an imaging device, a playback device, or the like. Note that the display device 100 may have a storage unit that stores moving image data, and the input unit 101 may acquire the moving image data recorded in the storage unit from the storage unit as target moving image data.

The image analysis unit 102 acquires the target moving image data output from the input unit 101 , analyzes the target moving image data, outputs the analysis result to the display control unit 106 , and outputs the target moving image data to the image processing unit 103 .

Specifically, the image analysis unit 102 analyzes the target moving image data, and acquires pixel information regarding the brightness (absolute brightness; brightness level) of each pixel at each time position (each frame) of the target moving image as an analysis result. . In this embodiment, the image analysis unit 102 analyzes frame image data output from the input unit 101 . The pixel information indicates the number of pixels present in the frame image represented by the frame image data for each of the plurality of possible gradation values of the frame image data output from the input unit 101 . When the gradation value of the frame image data is a 10-bit value (0-1023), the pixel information indicates the number of pixels present for each of 0-1023.

Furthermore, the image analysis unit 102 acquires metadata corresponding to the target moving image data from the target moving image data, and outputs the acquired metadata to the display control unit 106 as an analysis result. The metadata is, for example, data stored in an InfoFrame defined by HDMI, ANC (Ancillary) data stored in a blanking section defined by SDI, and the like.

The image processing unit 103 generates processed moving image data by performing image processing on the target moving image data output from the image analyzing unit 102 . The image processing unit 103 then outputs the processed moving image data to the graphics combining unit 104 .

Specifically, a gradation curve (correspondence relationship between gradation value and luminance; gradation characteristics) is set from the display control unit 106 to the image processing unit 103 . Gradation curves such as HLG and PQ are set to display (process) HDR (high dynamic range) images. A tone curve such as gamma 2.2 is set for displaying (processing) SDR (standard dynamic range) images. A gradation range such as a limited range or a full range is also set from the display control unit 106 to the image processing unit 103 . The limited range and full range are gradation ranges to which a set luminance range (luminance range such as HLG and PQ; original range) is assigned. The limited range is a part of the range of gradation values that the target moving image data can take, and the full range is the entire range of gradation values that the target moving image data can take. The image processing unit 103 converts each gradation value of the target moving image data according to the set gradation curve and gradation range (gradation conversion processing).

Here, there is a function (display method) of compressing the original range and displaying the moving image. In particular, such a function is often used when displaying HDR images. In this embodiment, the luminance range (HDR range) after compression is also set from the display control unit 106 to the image processing unit 103 . The image processing unit 103 converts each gradation of the target moving image data so that the gradation value corresponding to the luminance in the original range is converted into the gradation value corresponding to the luminance in the HDR range according to the set HDR range. Convert values (mapping process). Here, consider the case where HLG is set, the original range is the luminance range of 0 to 1000 cd/m ² , and the HDR range of 0 to 600 cd/m ² is set. In this case, tone values in the luminance range of 0 to 600 cd/m ² are not converted, and tone values corresponding to luminance higher than 600 cd/m ² correspond to 600 cd/m ² (upper limit luminance). Converted to gradation values (clip processing).

As an assist function for checking the luminance distribution (luminance level distribution) of an image, a false color function ( display method). In this embodiment, enabling/disabling of the false color function is also set from the display control unit 106 to the image processing unit 103 . When the false color function is enabled, the display control unit 106 notifies the image processing unit 103 of the correspondence relationship between the luminance (luminance range) and the conversion color. The image processing unit 103 converts the color of each pixel of the target moving image data into a converted color according to the notified correspondence relationship (color conversion process).

The graphic synthesizing unit 104 synthesizes the processed moving image data (each frame image data) output from the image processing unit 103 with the graphic data output from the graphic generating unit 108 to generate synthetic moving image data. The graphic synthesizing unit 104 then outputs the synthetic moving image data to the display unit 105 . When graphic data is not output from the graphic generating unit 108 , the graphic synthesizing unit 104 outputs the processed moving image data to the display unit 105 . Graphic data is processed by OSD (On Screen Dis
play) is image data representing a graphic image such as an image. Synthetic moving image data represents a moving image (compositing moving image) in which a graphic image is superimposed on a processed moving image (moving image represented by processed moving image data).

The display unit 105 displays a moving image based on the moving image data (synthesized moving image data or processed moving image data) output from the graphic synthesizing unit 104 on the display screen. The display unit 105 is, for example, a liquid crystal display unit having a liquid crystal panel and a backlight unit, an organic EL display panel, or the like.

The display control unit 106 controls processing of each block of the display device 100 . The memory unit 107 stores programs, parameters, and the like. For example, the display control unit 106 is an arithmetic processing circuit that executes a program stored in the memory unit 107 and controls processing of each block of the display device 100 . Note that the display control unit 106 acquires operation information corresponding to the user operation performed by the user (user operation) on a button (not shown) provided on the display device 100. good too. Then, the display control unit 106 may perform switching of control, detailed setting of control, and the like according to the operation information.

In this embodiment, the display control unit 106 controls the processing of the image processing unit 103 and the graphics generation unit 108 based on the analysis result (pixel information) output from the image analysis unit 102, user operation on the display device 100, and the like. Control. Specifically, the display control unit 106 controls setting information such as gradation curve (HLG, PQ, gamma 2.2, etc.), gradation range (limited range or full range), HDR range, enable/disable of false color function, etc. is determined according to the user operation (operation information). Then, the determined setting information is output (set) to the image processing unit 103 . Furthermore, the display control unit 106 outputs (sets) the determined setting information and the analysis result output from the image analysis unit 102 to the graphics generation unit 108 . Note that, immediately after the display device 100 is started, initial information (predetermined information) of the setting information is set, or the previous setting is continued.

The graphics generator 108 generates graphic data and outputs it to the graphics synthesizer 104 . In the present embodiment, the graphics generation unit 108 generates a time axis indicating the time position (frame) of the target moving image and a target A graph is generated having a luminance axis indicating the luminance of the moving image. Specifically, the graphic generation unit 108 generates graphic data representing a graphic image in which the graph is drawn based on the analysis result and the setting information. In this embodiment, each coordinate in the graph indicates the number of corresponding pixels. That is, the above graph shows temporal changes in luminance distribution over a relatively long period of time in the target moving image.

FIG. 2 shows an example of a graphic image according to this embodiment. FIG. 2 shows an example where the gradation curve is HLG and the original range is the luminance range of 0 to 1000 cd/m ² . In the graphic image 200 of FIG. 2, a graph 201 is drawn showing the temporal change 202 of the frame peak luminance of the target moving image and the temporal change 203 of the frame average luminance. The frame peak luminance is the peak luminance (maximum luminance; maximum luminance level; peak luminance level) of the frame image, and the frame average luminance is the average luminance (average luminance level) of the frame image. The horizontal axis of graph 201 is the time axis, and the vertical axis of graph 201 is the luminance axis. In the upper right part of the graphic image 200, numerical values of the frame peak luminance and the frame average luminance of the final frame are drawn. In the upper left part of the graphic image 200, numerical values of the peak luminance (Maximum Content Light Level) and the maximum frame average luminance (Maximum Frame Average Light Level) of the entire target moving image are drawn. The maximum frame average luminance is the maximum luminance of a plurality of frame average luminances respectively corresponding to a plurality of frames. Numerical values of the peak luminance and the maximum frame average luminance during a partial period such as the period during which the graphic image 200 is displayed may be drawn. These pieces of information can be obtained from metadata (HDR10 or metadata defined by ST2094-40) included in HDMI (High-Definition Multimedia Interface) data or the like. Such information can also be obtained by analyzing the moving image data itself.

In this embodiment, the area 204 is used to indicate the time change of the luminance distribution. Specifically, at each coordinate of region 204, the number of corresponding pixels is indicated. Since the frame peak luminance can be grasped from the luminance distribution, the temporal change 202 of the frame peak luminance need not be drawn. The temporal change 203 of the frame average luminance, the upper right numerical value of the graphic image 200, the upper left numerical value of the graphic image 200, and the like may also be omitted from drawing.

FIG. 3 shows an example of how to represent the luminance distribution according to this embodiment. In this embodiment, as shown in FIG. 3, the number of pixels is indicated by shading. In the example of FIG. 3, a light color is drawn at coordinates with few pixels, a dark color is drawn at coordinates with many pixels, and no drawing is performed at coordinates with no pixels. For example, white with RGB values of (255, 255, 255) is set at coordinates where no pixels exist, and gray with RGB values of (192, 192, 192) is set at coordinates with few pixels. It is also possible to set black with RGB values of (0, 0, 0) at the coordinates where there are many .

FIG. 3 shows an example with a peak luminance of 400 cd/m ² . In FIG. 3A, there are pixels in each of four luminance ranges of 0-50 cd/m ² , 50-100 cd/m ² , 100-200 cd/m ² and 200-400 cd/m ² . And there are more low-luminance pixels than high-luminance pixels. Specifically, the number of pixels from 0 to 50 cd/ ^m2 is the largest, the number of pixels from 50 to 100 cd/ ^m2 is greater than the number of pixels from 100 to 200 cd/ ^m2 , and the ^number of pixels from 200 to 400 cd/m2 is the least. In (B) of FIG. 3, pixels exist in a luminance range of 0 to 400 cd/m ² , and pixels of each luminance exist evenly. In FIG. 3C, there are only pixels of 0 cd/m ² and pixels of 400 cd/m ² , and pixels of other brightness are not present.

Note that the method of determining the gradation is not particularly limited. For example, when the ratio of the number of pixels to the total number of pixels in the frame image is 10% or more, the darkest color is drawn. The shading may be determined according to the ratio of numbers. The density may be determined according to the number of pixels so that the darkest color is rendered when the number of pixels is 100 or more, and the lighter the color is rendered as the number of pixels is smaller. When the number of pixels is 100 or more, the darkest color is drawn, and when the number of pixels is 99 or less, the color of the maximum density multiplied by the ratio "number of pixels / 100" is drawn. , the gradation may be determined according to the number of pixels and the ratio.

FIG. 4 shows an example of a graphic image in which the number of pixels is indicated by shading. In the first four frames, pixels exist for all luminances within the luminance range up to the peak luminance, and colors are drawn with a density corresponding to the number of pixels. From the 5th frame onwards, there are no intermediate brightness pixels, only high brightness pixels and low brightness pixels exist, and colors are drawn according to the number of pixels in high brightness and low brightness areas It is By displaying the graphic image of FIG. 4, the user can easily check the brightness distribution of each frame in a relatively long period of the target moving image in terms of gradation, and easily see how many pixels having which brightness are present in each frame. can be (intuitively) grasped.

In addition, in FIG. 4, the horizontal width of each frame is shown wide for easy understanding of the invention. However, in reality, it is preferable to narrow the horizontal width of each frame as shown in FIG. 11, because it is possible to confirm temporal changes over a long period of time at once. FIG. 11 is a diagram showing another example of a graphic image according to this embodiment.

Note that the number of pixels may be indicated by a change in color other than gradation. For example, a color closer to blue may be drawn as the number of pixels is smaller, and a color closer to red may be drawn as the number of pixels is larger. That is, at least one of hue, saturation, and lightness may be varied according to the number of pixels so that the user can recognize changes in the number of pixels in the direction of the luminance axis and/or the direction of the time axis. For example, when displaying a graphic image in black and white, it is sufficient to vary only the brightness according to the number of pixels.

Coordinates corresponding to luminance within a predetermined range where corresponding pixels exist may be further indicated in a predetermined color. FIGS. 5A and 5B show an example of a graphic image in which coordinates corresponding to luminance within a predetermined range are indicated in a predetermined color. In FIGS. 5(A) and 5(B), the number of pixels is indicated by shading as in FIG.

FIG. 5A shows an example in which a corresponding pixel exists and coordinates corresponding to luminance outside the HDR range are colored with a predetermined color (warning color). FIG. 5A shows an example in which the HDR range of 0-400 cd/m ² is set. In FIG. 5(A), the coordinates corresponding to the presence of corresponding pixels and luminances higher than 400 cd/m ² are colored with a warning color (shading is maintained). By displaying the graphic image of FIG. 5(A), the user can easily (intuitively) understand that the brightness outside the HDR range is used by checking the portion colored with the warning color. can.

FIG. 5B shows an example in which the coordinates at which the corresponding pixels exist are colored with the transformation color of the false color function (the transformation color corresponding to the luminance corresponding to the coordinates). In FIG. 5B, the converted colors are gray at 0 to 50 cd/m ² , green at 50 to 100 cd/m ² , yellow at 100 to 200 cd/m ² , and orange at 200 to 400 cd/m ² . , 400-1000 cd/m ² are associated with red. For this reason, coordinates corresponding to 0 to 50 cd/m ² where there are corresponding pixels are colored grey. As in the case of FIG. 5A, the gradation is maintained, and the gradation is changed according to the number of pixels for each color. For example, in the green range of 50 to 100 cd/m ² , the coordinates with few pixels are set to green with RGB values of (0, 255, 0), and the coordinates with many pixels are set with RGB values of (0, 0). 100, 0) dark green may be set. Coordinates corresponding to other luminances are similarly colored with conversion colors corresponding to the other luminances. By displaying the graphic image of FIG. 5(B), the user can check the shade and color of each portion (each coordinate), and can more easily (more intuitively) grasp the luminance distribution.

Note that the false color function is enabled so that the coloring shown in FIG. 5B is performed when the false color function is enabled and the coloring shown in FIG. 5B is not performed when the false color function is disabled. Enabled/disabled of coloring in FIG. 5(B) may be switched according to /disabled. The coloring shown in FIG. 5B may be performed regardless of whether the false color function is enabled or disabled. Although the luminance distribution is colored in FIGS. 5A and 5B, the frame peak luminance and the frame average luminance may be colored similarly to the luminance distribution.

It should be noted that depending on the user operation, etc., the rendering of the luminance distribution (drawing of shading in the area 204 in FIG. 2) is enabled/disabled, the coloring outside the HDR range (FIG. 5A) is enabled/disabled, and the false color is enabled/disabled. Enabling/disabling of the function coloring with the conversion color (FIG. 5B) may be switched. FIG. 6 is a table showing an example of setting information regarding graph generation according to the present embodiment. In the example of FIG. 6, as the setting information of the setting item "distribution display", "ON" to draw the luminance distribution or "OFF" not to draw the luminance distribution is set. As the setting information of the setting item "false color coloring", "false color interlocking" which performs coloring with the conversion color according to the activation of the false color function (interlocking), always coloring with the conversion color "ON" or "OFF" for not coloring with the conversion color is set. As the setting information of the setting item “coloring outside the range”, “ON” for coloring outside the HDR range or “OFF” for not coloring outside the HDR range is set. The display control unit 106 controls the user operation (
These setting information are set in the graphic generation unit 108 according to the operation information) and the like.

FIG. 7 is a flowchart showing an example of the processing flow of the display device 100. As shown in FIG. For example, frame image data acquired by the input unit 101 is updated in a state in which generation (display) of graphs such as changes in frame peak luminance over time is enabled, and the analysis result of the image analysis unit 102 is notified to the graphic generation unit 108. Then, the processing flow of FIG. 7 starts. Even when the setting information such as the gradation curve, gradation range, HDR range, and enable/disable of the false color function is changed by the user operation, and the changed setting information is notified to the graphics generation unit 108, the display shown in FIG. Processing flow begins.

In step S701, the graphic generation unit 108 calculates the frame peak luminance and the frame average luminance of the target frame image data (frame image data to be processed; frame image data output from the image analysis unit 102), and draws them on a graph. do. That is, in the present embodiment, the input unit 101 sequentially acquires a plurality of frame image data (for each frame), and sequentially draws information on the plurality of frame image data on the graph.

A specific example of how to determine the frame peak luminance and the frame average luminance will be described.

The graphics generation unit 108 converts each gradation value of the target frame image data into luminance based on the analysis result (pixel information) and setting information (gradation curve and gradation range) output from the display control unit 106 .

FIG. 8 shows an example of pixel information (correspondence between gradation values and the number of pixels) and correspondence between gradation values and luminance after conversion. FIG. 8 shows an example in which the resolution of the frame image represented by the target frame image data (the number of pixels in the horizontal direction×the number of pixels in the vertical direction) is 1920×1080 pixels, that is, the total number of pixels of the frame image is 2073600 pixels. indicates FIG. 8 shows an example in which the gradation value of the target frame image data is a 10-bit value (0 to 1023). In FIG. 8, the number of pixels having a tone value of 940 is 1,036,800 pixels, and the number of pixels having a tone value of 64 is 1,036,800 pixels.

Here, it is assumed that HLG is set as a gradation curve and a limited range of 64 to 940 gradation values is set. Therefore, the graphic generation unit 108 converts the gradation range from gradation value 64 to gradation value 940 into the luminance range of HLG (luminance range from 0 cd/m ² to 1000 cd/m ² ). In the gradation range from gradation value 64 to gradation value 940, the change in luminance with respect to the change in gradation value follows HLG. Further, the graphic generation unit 108 converts tone values smaller than 64 to 0 cd/m ² and converts tone values greater than 940 to 1000 cd/m ² (clip processing).

A plurality of tables (a plurality of tables corresponding to a plurality of combinations of one of a plurality of gradation curves and one of a plurality of gradation ranges) are prepared in advance as shown in FIG. The above conversion may be performed using a table corresponding to range setting information. The conversion may be performed by calculation using a calculation formula corresponding to setting information of the gradation curve and the gradation range among the plurality of calculation formulas corresponding to the plurality of combinations.

In FIG. 8, a luminance range of 0 cd/m ² to 1000 cd/m ² is used as the HLG luminance range, but the luminance specified by HLG is relative luminance, and the HLG luminance range (absolute luminance range) ) can be changed. For example, the luminance range of HLG can be changed to a luminance range of 0 cd/m ² to 2000 cd/m ² . When the luminance range of HLG changes, the correspondence relationship between the gradation value and the luminance after conversion also changes.

After the above conversion, the graphic generation unit 108 determines the largest gradation value in which pixels exist from the pixel information. Then, the graphic generation unit 108 determines the luminance corresponding to the determined gradation value (luminance after conversion) as the frame peak luminance. In the example of FIG. 8, a pixel exists and the largest gradation value is 940, and the gradation value 940 is converted to a luminance of 1000 cd/m ² by the above conversion. Therefore, 1000 cd/m ² is determined as the frame peak luminance.

Further, the graphic generation unit 108 calculates the product of the number of pixels and the luminance after conversion (the number of pixels×luminance) for each gradation value, and calculates the sum of the calculation results (multiplied values). As a result, the sum of luminance of all pixels is obtained. Then, the graphic generation unit 108 calculates the frame average luminance by dividing the sum of luminance of all pixels by the total number of pixels (sum of luminance of all pixels/total number of pixels). In the example of FIG. 8, 500 cd/m ² is calculated as the frame average luminance from "1036800 pixels×1000 cd/m ² +1036800 pixels×0 cd/m ² /2073600 pixels".

Returning to the description of FIG. In step S702, the graphic generation unit 108 determines whether the setting information of the setting item "distribution display" in FIG. 6 is "ON". If it is "ON", the process proceeds to step S703. In the case of "OFF", the luminance distribution is not drawn on the graph, and this processing flow ends.

In step S703, the graphic generation unit 108 determines whether coloring is performed with the conversion color of the false color function based on the setting information of the setting item "false color coloring" in FIG. 6 and whether the false color function is enabled/disabled. determine whether or not If coloring with the conversion color is to be performed, the process proceeds to step S704, and if coloring with the conversion color is not to be performed, the process proceeds to step S705. Specifically, when the setting information of the setting item "false color coloring" in FIG. , the process proceeds to step S704. When the setting information of the setting item "false color coloring" is "false color interlocking" and the false color function is disabled, and when the setting information of the setting item "false color coloring" is "OFF", step S705 Processing proceeds to .

In step S704, the graphic generation unit 108 generates the target image based on the color information (correspondence relationship between luminance and converted color) output from the display control unit 106 and the conversion result (the number of pixels of each luminance) in step S701. Graph the luminance distribution of the frame image data. Specifically, the luminance distribution is colored with the conversion color of the false color function and drawn. As a result, a graphic image as shown in FIG. 5B is generated and displayed.

In step S705, the graphic generation unit 108 determines whether or not the setting information of the setting item "out-of-range coloring" in FIG. 6 is "ON". If "ON", the process proceeds to step S706, and if "OFF", the process proceeds to step S707.

In step S706, the graphics generation unit 108 graphs the luminance distribution of the target frame image data based on the HDR range output from the display control unit 106 and the conversion result (number of pixels of each luminance) in step S701. draw. Specifically, the brightness distribution is rendered by coloring outside the HDR range. As a result, a graphic image as shown in FIG. 5A is generated and displayed.

In step S707, the graphic generation unit 108 draws the luminance distribution of the target frame image data on a graph without coloring based on the conversion result (the number of pixels of each luminance) in step S701. As a result, a graphic image as shown in FIG. 4 is generated and displayed.

Note that an example has been described in which the frame peak luminance, the frame average luminance, and the luminance distribution are drawn (added) for each frame and the graph is updated for each frame, but this need not be the case. For example, the frame peak luminance, frame average luminance, and luminance distribution may be drawn (added) every two frames to update the graph every two frames. As a result, the graph update frequency and the amount of information to be drawn can be reduced. In this case, the frame peak luminance, frame average luminance, and luminance distribution may be thinned every two frames. That is, the frame peak luminance, frame average luminance, and luminance distribution may be information corresponding to one frame. The frame peak luminance, frame average luminance, and luminance distribution may be averages of two frames of information.

Although the example of analyzing the 10-bit target moving image data with 10-bit accuracy has been described, the 10-bit target moving image data may be analyzed with a lower accuracy than 10 bits. For example, the number of pixels with gradation values of 0 to 3, the number of pixels with gradation values of 4 to 6, and the like may be counted with 8-bit accuracy.

Although the example using the absolute luminance as the luminance level has been described, the luminance level is not limited to the absolute luminance. For example, a gradation value may be used as the luminance level. In that case, the conversion from the gradation value to the luminance is not performed, the peak gradation value (maximum gradation value) of the frame image is determined as the frame peak luminance, and the average gradation value of the frame image "APL (AveragePicture
Level)" may be determined as the frame average luminance. The type of luminance level may be switched as appropriate. Absolute luminance may be used as the luminance level when set to process HDR images, for example when tone curves such as HLG or PQ are set. Then, when settings are made for processing an SDR image, for example, when a gradation curve such as gamma 2.2 is set, the gradation value may be used as the luminance level.

Although the example in which the frame image data is obtained for each frame and the graph is updated for each frame has been described, this need not be the case. For example, a moving image file (entire target moving image data) may be obtained, all frame image data may be analyzed, and a graph in which the luminance distribution of all frame image data is drawn may be generated all at once. Only one moving image file may be obtained, or a plurality of moving image files to be reproduced in order may be obtained. When a plurality of moving image files are acquired, a graph showing luminance distribution of the plurality of moving image files may be generated.

FIG. 9 shows an example of a graph generated based on a moving image file. FIG. 9 shows an example in which two moving image files with file names “video — 001.mov” and “video — 002.mov” are reproduced continuously. In FIG. 9, the file names of two moving image files are drawn on the time axis (timeline). Also shown are the frame peak luminance, the frame average luminance, and the temporal change in the luminance distribution of the two moving image files. By displaying such a graph, the user can check the change over time of the luminance distribution of a plurality of moving image files, and when the plurality of moving image files are played continuously, the moving image files are switched in a suitable manner. You can easily (intuitively) grasp whether As a result, the user can appropriately edit each moving image file (editing efficiency is improved). A plurality of moving image files are, for example, a plurality of moving image files that are assumed to be connected to form one moving image file.

Although the example of analyzing the target moving image data and acquiring the frame peak luminance, the frame average luminance, and the pixel information has been described, this need not be the case. If at least one of frame peak luminance, frame average luminance, and pixel information is included in metadata corresponding to the target moving image data, the information may be obtained from the metadata. At that time, the metadata may be metadata added to the target video data (metadata included in the target video data), or may be metadata (metafile) independent of the target video data. good too.

Although an example in which the number of pixels is indicated by gradation has been described, only the presence or absence of pixels may be indicated by binary values. For example, in the above graph, drawing may be performed at coordinates where corresponding pixels exist, and drawing may not be performed at coordinates where corresponding pixels do not exist. Regarding the presence/absence of pixels, if the number of pixels is equal to or greater than a predetermined threshold, it may be determined as "present", and if it is less than the threshold, it may be determined as "absent". For example, if the number of pixels is 10 or more, it may be set as "yes", and if it is less than 10 pixels, it may be set as "no". The predetermined threshold may be variable according to user settings.

As described above, according to the present embodiment, pixel information regarding the luminance (luminance level) of each pixel at each time position of a moving image is obtained. Based on the pixel information, a graph having a time axis and a brightness axis (brightness level axis) is generated, which indicates the presence or absence or the number of corresponding pixels by coordinates. This makes it possible for the user to easily (intuitively) grasp the temporal change in the luminance level distribution over a relatively long period of time.

Each block of the present embodiment (FIG. 1) may or may not be individual hardware. Functionality of two or more blocks may be implemented by common hardware. Each of multiple functions of one block may be implemented by separate hardware. Two or more functions of one block may be implemented by common hardware. Also, each block may or may not be implemented by hardware. For example, a device may have a processor and a memory in which a control program is stored. At least some of the functions of the blocks of the device may be implemented by the processor reading out and executing the control program from the memory.

It should be noted that the present embodiment (including the modifications described above) is merely an example, and a configuration obtained by appropriately modifying or changing the configuration of the present embodiment within the scope of the gist of the present invention can also be applied to the present invention. include.

<Other embodiments>
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in the computer of the system or apparatus reads and executes the program. It can also be realized by processing to It can also be implemented by a circuit (for example, ASIC) that implements one or more functions.

100: Display device 102: Image analysis unit 108: Graphics generation unit

Claims (22)

Acquisition means for acquiring a gradation value of a pixel in an HDR moving image;
A graph having a first axis indicating a time position of the HDR moving image and a second axis indicating the absolute luminance is generated based on the grayscale value and information on the correspondence relationship between the grayscale value and the absolute luminance. a generating means;
has
The generating means sets the coordinates of the graph to one of a plurality of colors according to the number of pixels with absolute luminance corresponding to the coordinates at the time position corresponding to the coordinates,
the plurality of colors includes a first color, a second color and a third color;
The generation means makes the color of the coordinates closer to the first color as the number of pixels corresponding to the coordinates increases, and the color of the coordinates decreases as the number of pixels corresponding to the coordinates decreases. Set the color to the coordinates so that the color approaches the second color
An information processing device characterized by: 2. The generating means sets the color according to the number of the pixels to the coordinates of the coordinates of the graph at which the pixels of the corresponding absolute luminance are present at the corresponding time positions. The information processing device according to . If a pixel with absolute luminance corresponding to the coordinates of the graph exists at a time position corresponding to the coordinates of the graph and the absolute luminance is outside a predetermined range, the generation means determines that the coordinates are out of range. 3. The information processing apparatus according to claim 1, wherein a predetermined color is set to indicate that. an image processing means for converting the color of a pixel in the HDR moving image into a conversion color according to the absolute luminance of the pixel when the false color function is enabled;
When the false color function is enabled and there is a pixel with absolute luminance corresponding to the coordinates at the time position corresponding to the coordinates of the graph, the generating means converts the coordinates to the coordinates 4. The information processing apparatus according to claim 1, wherein the conversion color is set according to the absolute luminance corresponding to . The information processing apparatus according to any one of claims 1 to 4, wherein the generating means draws a graph showing a temporal change in maximum absolute luminance of the HDR moving image on the graphic image showing the graph. . The information processing apparatus according to any one of claims 1 to 5, wherein the generating means draws a graph showing a temporal change in average absolute luminance of the HDR moving image on the graphic image showing the graph. . When the acquiring means acquires the gradation value of a pixel in the SDR moving image, the generating means causes the second axis to represent the gradation value instead of the absolute luminance based on the gradation value of the SDR moving image. 7. The information processing apparatus according to any one of claims 1 to 6, which generates a graph. 8. The method according to any one of claims 1 to 7 , wherein the first color, the second color, and the third color are colors different in at least one of color, saturation, and brightness. information processing equipment. 9. The information processing apparatus according to claim 8 , wherein the first color, the second color, and the third color are colors that differ only in lightness. 9. The information processing apparatus according to claim 8 , wherein each of said first color, said second color and said third color is white, gray or black. 11. The information processing apparatus according to any one of claims 1 to 10 , wherein said acquisition means acquires the gradation value of each pixel of a plurality of frame images included in said HDR moving image. The generating means determines colors of coordinates of the graph based on pixel information in each of the plurality of frame images,
12. The information processing apparatus according to claim 11 , wherein the pixel information is information indicating the number of pixels present in the frame image for each of the gradation values. obtaining means for obtaining information about luminance levels of pixels in a moving image;
generating means for generating a graph having a first axis indicating the time position of the moving image and a second axis indicating the luminance level based on the information;
has
The generation means sets the coordinates of the graph to one of a plurality of colors according to the number of pixels having a brightness level corresponding to the coordinates at the time position corresponding to the coordinates,
the plurality of colors includes a first color, a second color and a third color;
If a pixel having a brightness level corresponding to the coordinates of the graph exists at a time position corresponding to the coordinates of the graph and the brightness level is outside a predetermined range, the generation means determines that the coordinates are out of range. Set a predetermined color to indicate that
The generation means makes the color of the coordinates closer to the first color as the number of pixels corresponding to the coordinates increases, and the color of the coordinates decreases as the number of pixels corresponding to the coordinates decreases. Set the color to the coordinates so that the color approaches the second color
An information processing device characterized by: 14. The information processing apparatus according to claim 13 , further comprising control means for determining said predetermined range according to a user's operation. obtaining means for obtaining information about luminance levels of pixels in a moving image;
generating means for generating a graph having a first axis indicating the time position of the moving image and a second axis indicating the luminance level based on the information;
image processing means for converting the color of a pixel in the moving image into a conversion color corresponding to the luminance level of the pixel when the false color function is enabled;
has
The generation means sets the coordinates of the graph to one of a plurality of colors according to the number of pixels having a brightness level corresponding to the coordinates at the time position corresponding to the coordinates,
the plurality of colors includes a first color, a second color and a third color;
When the false color function is enabled and a pixel having a brightness level corresponding to the coordinates exists at the time position corresponding to the coordinates of the graph, the generating means generates the coordinates at the coordinates. Set the conversion color according to the luminance level corresponding to
The generation means makes the color of the coordinates closer to the first color as the number of pixels corresponding to the coordinates increases, and the color of the coordinates decreases as the number of pixels corresponding to the coordinates decreases. Set the color to the coordinates so that the color approaches the second color
An information processing device characterized by: Acquisition means for acquiring an HDR video;
A first axis indicating the time position of the HDR moving image and a second axis indicating the absolute luminance based on the gradation value of the pixel in the HDR moving image and the information of the correspondence relationship between the gradation value and the absolute luminance. generating means for generating a graph having
image processing means for performing conversion processing for converting tone values of pixels in the HDR moving image based on the correspondence information;
display means for displaying a synthesized video obtained by synthesizing the HDR video after the conversion processing and the graph;
has
The generating means sets the coordinates of the graph to one of a plurality of colors according to the number of pixels with absolute luminance corresponding to the coordinates at the time position corresponding to the coordinates,
the plurality of colors includes a first color, a second color and a third color;
The generation means makes the color of the coordinates closer to the first color as the number of pixels corresponding to the coordinates increases, and the color of the coordinates decreases as the number of pixels corresponding to the coordinates decreases. Set the color to the coordinates so that the color approaches the second color
A display device characterized by: Acquisition means for acquiring a moving image;
generating means for generating a graph having a first axis indicating the time position of the moving image and a second axis indicating the luminance level based on information about luminance levels of pixels in the moving image;
image processing means for performing compression processing for compressing the range of luminance levels of the moving image to a predetermined range;
display means for displaying a synthesized moving image obtained by synthesizing the compressed moving image and the graph;
has
The generation means selects one of a plurality of colors for the coordinates of the graph according to the number of pixels of the luminance level before compression processing corresponding to the coordinates at the time position corresponding to the coordinates. and set
the plurality of colors includes a first color, a second color and a third color;
When a pixel having a luminance level corresponding to the coordinates of the graph exists at a time position corresponding to the coordinates of the graph and the luminance level is outside the predetermined range, the generation means generates a pixel at the coordinates outside the range. set a predetermined color to indicate that
The generation means makes the color of the coordinates closer to the first color as the number of pixels corresponding to the coordinates increases, and the color of the coordinates decreases as the number of pixels corresponding to the coordinates decreases. Set the color to the coordinates so that the color approaches the second color
A display device characterized by: Acquisition means for acquiring a moving image;
generating means for generating a graph having a first axis indicating the time position of the moving image and a second axis indicating the luminance level based on information about luminance levels of pixels in the moving image;
image processing means for performing conversion processing for converting the color of a pixel in the moving image into a converted color according to the luminance level of the pixel when the false color function is set to be valid;
display means for displaying a synthesized moving image obtained by synthesizing the converted moving image and the graph;
has
The generation means sets the coordinates of the graph to one of a plurality of colors according to the number of pixels having a brightness level corresponding to the coordinates at the time position corresponding to the coordinates,
the plurality of colors includes a first color, a second color and a third color;
When the false color function is enabled and a pixel having a luminance level corresponding to the coordinates exists at a time position corresponding to the coordinates of the graph, the generating means generates a pixel corresponding to the coordinates. setting the conversion color according to the luminance level to be used ;
The generation means makes the color of the coordinates closer to the first color as the number of pixels corresponding to the coordinates increases, and the color of the coordinates decreases as the number of pixels corresponding to the coordinates decreases. Set the color to the coordinates so that the color approaches the second color
A display device characterized by: an obtaining step of obtaining a grayscale value of a pixel in an HDR moving image;
A graph having a first axis indicating a time position of the HDR moving image and a second axis indicating the absolute luminance is generated based on the grayscale value and information on the correspondence relationship between the grayscale value and the absolute luminance. a generation step;
has
In the generating step, one of a plurality of colors is set to the coordinates of the graph according to the number of pixels with absolute luminance corresponding to the coordinates at the time position corresponding to the coordinates;
the plurality of colors includes a first color, a second color and a third color;
In the generating step, the color of the coordinate becomes closer to the first color as the number of pixels corresponding to the coordinate increases, and the color of the coordinate becomes closer to the first color as the number of pixels corresponding to the coordinate decreases. Set the color to the coordinates so that the color approaches the second color
An information processing method characterized by: an obtaining step of obtaining information about the luminance level of pixels in the video;
generating, based on the information, a graph having a first axis indicating the time position of the moving image and a second axis indicating the luminance level;
has
In the generating step, one of a plurality of colors is set to the coordinates of the graph according to the number of the pixels having the brightness level corresponding to the coordinates at the time position corresponding to the coordinates;
the plurality of colors includes a first color, a second color and a third color;
In the generating step, when a pixel having a brightness level corresponding to the coordinates exists at a time position corresponding to the coordinates of the graph and the brightness level is outside a predetermined range, the coordinate is out of range. Set a predetermined color to indicate that
In the generating step, the color of the coordinate becomes closer to the first color as the number of pixels corresponding to the coordinate increases, and the color of the coordinate becomes closer to the first color as the number of pixels corresponding to the coordinate decreases. Set the color to the coordinates so that the color approaches the second color
An information processing method characterized by: an obtaining step of obtaining information about the luminance level of pixels in the video;
generating, based on the information, a graph having a first axis indicating the time position of the moving image and a second axis indicating the brightness level;
a converting step of converting the color of a pixel in the moving image into a converted color according to the luminance level of the pixel when the false color function is enabled;
has
In the generating step, one of a plurality of colors is set to the coordinates of the graph according to the number of the pixels having the brightness level corresponding to the coordinates at the time position corresponding to the coordinates;
the plurality of colors includes a first color, a second color and a third color;
In the generating step, when the false color function is enabled and a pixel having a brightness level corresponding to the coordinates exists at a time position corresponding to the coordinates of the graph, Set the conversion color according to the luminance level corresponding to
In the generating step, the color of the coordinate becomes closer to the first color as the number of pixels corresponding to the coordinate increases, and the color of the coordinate becomes closer to the first color as the number of pixels corresponding to the coordinate decreases. Set the color to the coordinates so that the color approaches the second color
An information processing method characterized by: A program for causing a computer to function as each means of the information processing apparatus according to any one of claims 1 to 15 or each means of the display device according to any one of claims 16 to 18 .

Images