JP5791244B2 - Image processing apparatus, display apparatus, and control method thereof - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing system, and a control method for the image processing apparatus.

  Conventionally, there is a dynamic mode in which image quality adjustment parameters are adaptively changed according to the characteristics of a displayed video as a preset of image quality related processing provided in a display device. In addition, there is a type in which RAW format image data is input to a display device, and a user can perform editing processing such as image quality correction on the RAW format still image data. Patent Document 1 proposes a display control device that stops image-related processing in the dynamic mode when editing processing of still image data in RAW format is performed on a display device.

  Patent Document 2 discloses an information display screen control system for a stadium that can automatically control the display screen based on display control data added to a teletext program. Patent Document 3 discloses a product information display device that can reliably change the POP display at a specified time without congesting the line.

JP 2009-300541 A JP 2000-050250 A JP 2008-119233 A

  In addition to the dynamic mode described above, the image quality-related processing preset provided in the display device includes a faithful reproduction mode in which no image is created and a cinema mode suitable for movies. The viewer can view the video with the desired image quality by selecting one of the preset image quality modes or setting the image quality related processing in detail.

  On the other hand, the creator of the video content performs an image quality mode and image quality-related processing selected on the display device when displaying the video content so that the viewer can view the video content with an image quality closer to the intention of the creator. You may want to specify.

  With the techniques described in Patent Documents 1 to 3, the image quality-related processing of the display device cannot be controlled according to the intention of the creator of the video content. Therefore, the viewer may not be able to view the video content with the image quality intended by the creator of the video content.

It is an object of the present invention to provide an image processing device , a display device, and a control method thereof that allow a viewer to view video content with an image quality close to the intention of the creator of the video content.

The present invention includes an input unit that receives input of control information for controlling the operation of the display device;
An adding unit for adding control information input to the input unit to image data;
A recording unit for storing the image data to which the control information is added;
With
The control information includes an information for controlling a frame rate conversion process performed when the display device displays image data.

The present invention includes a step of receiving input of control information for controlling the operation of the display device;
Adding input control information to the image data;
Storing the image data to which the control information is added in a recording unit;
Have
The control information is a control method for an image processing device, including information for controlling a frame rate conversion process performed when the display device displays image data.

It is possible to provide an image processing device , a display device, and a control method thereof that allow a viewer to view video content with an image quality close to the intention of the creator of the video content.

1 is a block diagram illustrating a schematic configuration of an image processing apparatus according to a first embodiment. Diagram showing development parameters and display device control data Example of raw image data and display device control data FIG. 7 is a block diagram illustrating a schematic configuration of a display device according to a second embodiment. Flowchart explaining display device control data analysis unit Flowchart of image quality parameter determination processing of display device control data analysis unit

Example 1
A first embodiment of the present invention will be described with reference to FIGS. In the image processing apparatus according to the first embodiment, the content creator adds and saves (records) control information for controlling the operation of the display device to the image data of the content. The control information is control information for controlling processing related to display image quality (image quality related processing) performed when the display device displays image data.

FIG. 1 is a block diagram illustrating a schematic configuration of the image processing apparatus according to the first embodiment.
The image processing apparatus 100 in FIG. 1 is a component of the image processing system according to the present invention. A development parameter generation unit 101, a recording unit 103, a development processing unit 104, a display unit 105, and a communication unit 106 are included. These components are connected by a bus. The development parameter generation unit 101 includes a display device control data addition unit 102. An operation unit 107 is connected to the image processing apparatus 100 wirelessly or by wire.

  The image processing apparatus 100 is an apparatus that develops and reproduces RAW-format image data and records development parameters in association with (added to) the RAW image data on a storage device such as an optical disk or a memory card. The image processing apparatus 100 is, for example, a PC (Personal Computer), a DVD (Digital Versatile Disc) recorder, an HDD (Hard Disk Drive) recorder, a digital video camera, or the like. When RAW image data recorded with associated development parameters is input to a display device having a function of developing RAW image data, the RAW image data is developed according to the associated development parameters and displayed (reproduced) on the display device. Is done.

The RAW image data is image data in a format that holds information obtained by a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor. Development is a process for creating image data in JPEG format, MPEG format, TIFF format, etc. from RAW image data. In development, for example, image quality adjustment processing relating to color depth, white balance, saturation, contrast, hue, sharpness, color space, frame rate, and the like is performed. The development parameter is a set value of the image quality adjustment processing performed in the development, and is stored separately from the RAW image data or added to the RAW image data. Development parameters determine what quality the content creator intends to have the viewer view the image,
Represents. The creator of the moving image content can develop the RAW image data with development parameters common to the entire moving image, or can develop the RAW image data by changing the development parameter for each frame or scene.

  The recording unit 103 is a device that can read a fixed storage device such as an HDD or a removable storage medium such as an optical disk or a memory card. The recording unit 103 directly captures RAW image data from an imaging apparatus such as a digital video camera, or stores RAW image data via a removable medium on which the RAW image data is recorded. When the RAW image data is stored in the recording unit 103, the image processing apparatus 100 is in a state where development processing can be performed on the RAW image data. The recording unit 103 also stores development parameter data associated with the RAW image data.

  The development parameter generation unit 101 generates development parameters for performing development by the development processing unit 104 on the RAW image data stored in the recording unit 103. Examples of development parameters are shown in FIG. The development parameter generation unit 101 generates development parameters in accordance with a development instruction that the user inputs to the image processing apparatus 100 using the operation unit 107 (input unit).

  The display device control data adding unit 102 (adding unit) adds display device control data to the development parameter. The display device control data is data in which control information for controlling image quality related processing of the display device is stored. Here, the display device is a device such as a digital television (not shown in FIG. 1) that can develop RAW image data and display the developed image data. The display device is a device for the viewer to reproduce (display) RAW image data generated by the content creator using the image processing device 100. The display device has a function of adjusting display image quality when developing and displaying RAW image data. The image quality-related processing provided in the display device includes, for example, dynamic processing that adaptively adjusts color, brightness, and the like according to the characteristics of the image data, image quality mode that adjusts to an appropriate image quality according to the genre of the video content, and frame rate Conversion, contrast adjustment, etc. The image quality-related processing that can be executed is different for each display device. The image processing apparatus 100 can acquire processing capability information, which is information on image quality-related processing that can be executed (or cannot be executed) by the display device, via the communication unit 106 (receiving unit). The communication unit 106 performs communication between the image processing apparatus 100 and the display device. The image processing apparatus 100 presents image quality-related processing that can be executed by the display device to the user (content creator) based on the processing capability information acquired via the communication unit 106. The user can determine the display device control data so as not to include the control information of the image quality related processing that cannot be executed by the display device, according to the presented image quality related processing.

  The creator of the moving image content can input control information of image quality related processing that is commonly applied to the display of the entire moving image data (full volume), or for each portion of the moving image data (for each frame or scene). Control information that changes the display image quality can also be input. For example, when the content is a movie, the creator can input the control information of the image quality related processing so that the entire movie is displayed with the image quality mode set to the cinema mode. In addition, the content creator can input control information for image quality related processing so that only a specific scene is executed and displayed.

The display device control data adding unit 102 adds the display device control data storing the control information of the image quality related process input by the operation of the content creator to the RAW image data, or saves it in association with the RAW image data. An example of the display device control data is shown in FIG. The display device control data adding unit 102 can add display device control data to the RAW image data as a part of the development parameters as shown in FIG. 2 at the timing before development, after development, or at the time of development. Alternatively, the display device control data adding unit 102 may store display device control data separately from the development parameters and associate them with the development parameters and the RAW image data. In the following, an embodiment will be described in which display device control data is added to RAW image data as part of development parameters as shown in FIG.

The development processing unit 104 develops the RAW image data according to the development parameter (a in FIG. 2) generated by the development parameter generation unit 101, and converts it into MPEG moving image data.
The display unit 105 is a device for confirming the moving image data developed by the development processing unit 104 as a video. As described above, the display device control data is for controlling image quality related processing of a display device (not shown), and the display unit 105 confirms a change in display image quality according to the display device control data. Not for.

  The operation unit 107 is a device such as a remote controller that allows a user to perform an operation for inputting an instruction to the image processing apparatus 100. While viewing the developed RAW image data displayed on the display unit 105, the user operates the operation unit 107 to adjust the development parameters for each scene or frame or the entire moving image content, and to determine display device control data. It can be performed.

FIG. 3 is a diagram showing the relationship between the display device control data added to the RAW image data by the display device control data adding unit 102 and the RAW image data along the time axis t.
The RAW image data illustrated in FIG. 3 is photographed with the vertical frequency switched to 60 Hz or 120 Hz, and development parameters are already determined for scenes A, B, and C. Here, the image quality related processing of the display device that can be controlled based on the display device control data is the following five types. That is, (1) dynamic process ON / OFF control, (2) image quality mode control, (3) FRC method control, (4) contrast ratio control, and (5) environment sensor ON / OFF control.

(1) Dynamic processing is adaptive image processing that changes according to the feature amount of input image data. In the dynamic process ON / OFF control, whether to perform this dynamic process is switched.
(2) In the image quality mode control, one of three image quality modes is selected: a dynamic mode that increases the overall contrast, a faithful reproduction mode that does not create an image, and a standard mode that performs standard image creation.
(3) The FRC method is a frame rate conversion (FRC) method for converting the vertical frequency from 60 Hz to 120 Hz. In the FRC method control, one of the two methods is selected. One is a method of generating an interpolated frame image inserted between two continuous frame images of 60 Hz moving image data and converting it into 120 Hz moving image data. The other is a method of increasing the number of frames by simple copying without performing interpolation (indicated as OFF).
(4) In contrast ratio control, the ratio between the black level and the white level is adjusted.
(5) The environmental sensor is an illuminance sensor that detects the brightness of the viewing environment or a human sensor that detects whether there is a person in the vicinity of the display device. In the environmental sensor ON / OFF control, whether or not to reflect the detection result by the environmental sensor in the image processing is switched.

Hereinafter, processing for adding display device control data to RAW image data for each scene will be described.
Assume that the content creator intends to display the scene A by performing standard image creation processing on the display device. Therefore, the content creator adds the following display device control data in association with the RAW image data of the scene A.
(1) Dynamic processing ON / OFF control: ON
(2) Image quality mode: Standard mode (3) FRC method: Interpolation (4) Contrast ratio: default
(5) Environmental sensor ON / OFF control: default
Here, default indicates a default process executed by the display device when the display device control data is not particularly set.

The scene B is 120 Hz moving image data, and it is assumed that the content creator intends to display the display device without performing image creation processing on the display device. Therefore, the content creator adds the following display device control data in association with the scene B / RAW image data.
(1) Dynamic processing ON / OFF control: OFF
(2) Image quality mode: faithful reproduction mode (3) FRC method: OFF to display a 120 Hz video as it is
(4) Contrast ratio: 5000: 1
(5) Environmental sensor ON / OFF control: OFF to prevent scene appearance from changing
The development parameter (a) illustrated in FIG. 2 and display device control data (b) added as a part thereof are development parameters and display device control data associated with the RAW image data of the scene B.

It is assumed that the content creator intends to display the scene C in the same manner as the scene A, with the display device displayed with a high contrast. Therefore, the content creator adds the following display device control data in association with the RAW image data of the scene C.
(1) Dynamic processing ON / OFF control: ON
(2) Image quality mode: Dynamic mode (3) FRC method: Interpolation (4) Contrast ratio: default
(5) Environmental sensor ON / OFF control: default

  As described above, the display device control data is determined for each scene of the moving image content, and is added to the RAW image data together with the development parameters. Here, the determined display device control data is stored in the recording unit 103 in association with the RAW image data as part of the development parameter.

  As described above, when the content creator stores the RAW image data in association with the display device control data and the development parameter, the content creation is performed when the viewer develops and displays the RAW image data on the display device. Display with the image quality intended by the user. Therefore, the content creator can provide the viewer with a video close to the intended video.

In this embodiment, the example in which the display device control data is added as a part of the development parameters of the RAW image data has been described. However, display device control data may be stored in association with image data in MPEG format or JPEG format generated by development from RAW image data. Further, the image processing apparatus according to the present embodiment can be applied to RAW image data of moving images and still images.
Note that the image quality related processing is not limited to the above, but can include, for example, luminance adjustment control, gamma adjustment control, filter control, color temperature adjustment control, contrast adjustment control, local dimming control, and the like.

(Example 2)
A second embodiment of the present invention will be described with reference to FIGS. 2 and 4 to 6.
FIG. 4 is a block diagram illustrating a schematic configuration of the display device according to the second embodiment.
The display device 400 in FIG. 4 is a component of the image processing system according to the present invention. The display device 400 includes a development processing unit 401, a display device control data analysis unit 402, an image processing unit 403, a display unit 404, and a communication unit 405. Here, the display unit 404 is a liquid crystal panel. These components are assumed to be connected by a bus. An operation unit 406 is connected to the display device 400 wirelessly or by wire.

  When the RAW image data and development parameters stored in association therewith are input, the display device 400 performs development processing based on the development parameters and generates developed image data (RGB data). In this embodiment, it is assumed that the display device control data is stored as a part of the development parameters as shown in FIG. The display device 400 sets parameters for image quality related processing performed by the image processing unit 403 on the developed image data based on display device control data input as part of the development parameters. The display device 400 displays developed moving image data that has undergone image processing based on the setting. The display device 400 includes a display unit 404 that displays moving image data at a vertical frequency of 120 Hz.

  The development processing unit 401 receives input of RAW image data and display device control data (image input unit). The development processing unit 401 performs development on input RAW image data according to the development parameter (a in FIG. 2) attached to the RAW image data, and converts it into moving image data (RGB data). The development processing unit 401 transmits the display device control data (b in FIG. 2) stored as a part of the development parameters to the display device control data analysis unit 402.

  The display device control data analysis unit 402 analyzes the display device control data received from the development processing unit 401 and determines parameters for image processing (image quality related processing) to be executed by the image processing unit 403. The display device control data analysis unit 402 transmits the determined image quality-related processing parameters to the image processing unit 403 and the display unit 404 in association with moving image data (RGB data).

Hereinafter, the contents of the process executed by the display device control data analysis unit 402 will be described with reference to the flowcharts of FIGS. 5 and 6.
The flowchart of FIG. 5 is a flowchart showing the basic processing contents executed by the display device control data analysis unit 402.

  In step S <b> 501, the display device control data analysis unit 402 confirms whether there is display device control data associated with the moving image data input from the development processing unit 401. If the display device control data exists, the display device control data analysis unit 402 proceeds to step S502. When the display device control data does not exist, the setting of the image quality related processing parameter based on the display device control data is not performed, and the processing of this flowchart ends. When there is no display device control data, the image processing unit 403 performs image quality related processing as usual. The display device control data analysis unit 402 that executes the process of step S501 functions as the “determination unit” of the present invention.

In step S502, the display device control data analysis unit 402 notifies the user that there is display device control data associated with the moving image data, and notifies the user whether to apply the display device control data for display. A message to be inquired is displayed on the display unit 404.
In step S503, in response to the inquiry message in step S502, the user inputs, from the operation unit 406, an answer as to whether the display device control data is applied to the display of moving image data.

In step S504, if the user instruction input in step S503 is “Apply display device control data to display of moving image data”, the display device control data analysis unit 402 proceeds to step S505. When the user's support input in step S503 is “Do not apply display device control data to display of moving image data”, image quality related processing parameters are not set based on the display device control data, and The process ends. When the display device control data is not applied to the display of moving image data, the image processing unit 403 performs normal image quality related processing as in the case where the display device control data is not associated with (not added to) the moving image data. Is done.

  In step S <b> 505, the display device control data analysis unit 402 analyzes the display device control data, and acquires stored image quality related process control information. For example, the display device control data analysis unit 402 acquires the type of image quality related processing in which control information is stored in the display device control data, the control parameter of each image quality related processing, and the value and range of the control parameter. Then, the display device control data analysis unit 402 determines whether the image processing unit 403 can execute the image quality related processing in which the control information is stored in the display device control data.

  In step S506, if the image processing unit 403 can execute all the image quality related processes included in the display device control data based on the analysis result in step S505, the display device control data analysis unit 402 proceeds to step S512. If there is control information for image quality related processing that cannot be executed by the image processing unit 403 in the display device control data, the display device control data analysis unit 402 proceeds to step S507. That the image processing unit 403 is not executable means that the display device 400 does not have a configuration for executing the image quality-related processing, or there is a configuration for executing the image quality-related processing, but the control information This means that the value of the parameter specified in is outside the feasible range.

In step S507, the display device control data analysis unit 402 notifies the user that the image quality related processing included in the display device control data cannot be executed, and performs the image quality related processing defined in the display device control data. Ask the user whether to execute partially. Here, the display device control data analysis unit 402 displays processing that cannot be executed by the image processing unit 403 among the image quality related processing included in the display device control data on the display unit 404 and presents it to the user as reference information. You may do it.
In step S508, in response to the inquiry in step S507, the user inputs an instruction from the operation unit 406 as to whether or not to execute the image quality related processing included in the display device control data partially.

  In step S509, the display device control data analysis unit 402 switches whether to execute the image quality related process included in the display device control data partially or not according to the user instruction input in step S508. When the image quality related process included in the display device control data is partially executed, the display device control data analysis unit 402 proceeds to step S510. On the other hand, when not executing all the image quality related processing included in the display device control data, the display device control data analysis unit 402 does not set the image quality related processing parameter based on the display device control data, and the processing of this flowchart ends. It becomes. When all the image quality related processing included in the display device control data is not executed, the image processing unit 403 performs the normal image quality related processing as in the case where the display device control data is not associated with (not added to) the moving image data. Processing is performed.

Here, a description will be given of partially executing the image quality related processing included in the display device control data. For example, it is assumed that the display device 400 is not provided with an environmental sensor. Then, the environmental sensor ON / OFF control specified in the display device control data of FIG. 2b cannot be executed by the display device 400, but other controls can be executed according to the control information specified in the display device control data. is there. The display device control data analysis unit 402 displays, on the display unit 404, for example, control information of image quality related processing that cannot be executed by the display device 400 among the control information defined in the display device control data, and displays the user (viewing) Person). The user can check image quality related processing that cannot be executed on the display device 400 and determine whether or not to partially execute image quality related processing other than the image quality related processing that cannot be executed on the display device 400. For example, when the user determines that the environmental sensor ON / OFF control does not significantly affect the image quality, the user partially executes the image quality related processing defined in the display device control data other than the environmental sensor ON / OFF. You can make a choice.

  In step S510, the display device control data analysis unit 402 determines a process to be executed in the display device 400 among the image quality related processes in which the control information is stored in the display device control data. For example, in the image quality related processing in which the control information is stored in the display device control data, a decision is made to execute other than environmental sensor ON / OFF control.

  In step S511, the display device control data analysis unit 402 displays on the display unit 404 the image quality-related processing content to be executed based on the control information stored in the display device control data determined in step S510. In step S511, the display device control data analysis unit 402 may confirm with the user whether there is no problem with the image quality-related processing determined to be executed in step S510.

In step S512, the display device control data analysis unit 402 executes control of the display device 400 based on the display device control data. That is, the display device control data analysis unit 402 determines parameters to be instructed to the image processing unit 403 and the display unit 404 for the image quality related processing determined to be executed based on the display device control data.
The processing contents in step S512 will be described based on the image quality mode control parameter determination processing as an example with reference to the flowchart of FIG.

  In step S601, the display device control data analysis unit 402 refers to the setting value of the image quality mode control stored in the display device control data, and determines the image quality mode. If the set value of the image quality mode control is the faithful reproduction mode, the display device control data analysis unit 402 proceeds to step S602. When the set value of the image quality mode control is the cinema mode, the display device control data analysis unit 402 proceeds to step S603. If the set value of the image quality mode control is the standard mode, the display device control data analysis unit 402 proceeds to step S604. If the set value of the image quality mode control is the dynamic mode, the display device control data analysis unit 402 proceeds to step S605.

In step S <b> 602, the display device control data analysis unit 402 sets an image creation OFF parameter in the image processing unit 403. Accordingly, the image processing unit 403 outputs the input image data to the display unit 404 as it is without performing image creation processing.
In step S603, the display device control data analysis unit 402 sets parameters for the cinema mode. In this embodiment, the parameter setting for cinema mode is defined as setting the color temperature to 6500K (Kelvin) and bringing the gamma curve closer to the faithful reproduction mode than the standard. Therefore, the display device control data analysis unit 402 sets parameters (for example, RGB gain values) for setting the color temperature to 6500K for the image processing unit 403, sets a gamma curve, and performs the processing of this flowchart. Exit.

In step S604, the display device control data analysis unit 402 sets parameters for the standard mode. The parameter setting for the standard mode is a parameter setting for a standard image creation process of the display device 400. For example, the display device control data analysis unit 402 sets the image processing unit 403 to increase the middle luminance of the gamma curve. To do. In addition, the display device control data analysis unit 402 sets the display unit 404 so that the backlight of the display unit 404 does not become too bright.

  In step S605, the display device control data analysis unit 402 sets parameters for the dynamic mode. For example, the display device control data analysis unit 402 sets the image processing unit 403 to increase the gamma curve from low luminance. Further, the display device control data analysis unit 402 sets the display unit 404 to brighten the backlight of the liquid crystal panel.

  Through these processes, the display device control data analysis unit 402 sets image quality-related processing parameters for the image processing unit 403 and the display unit 404 in accordance with the control information stored in the display device control data. The display device control data analysis unit 402 determines various parameters related to image quality related processing in addition to the above-described dynamic processing ON / OFF control and image quality mode control, as in the above flowchart, and the image processing unit 403. Or the display unit 404. The image quality related processing includes, for example, brightness adjustment, gamma adjustment, filter control, color temperature adjustment, environment sensor valid / invalid switching, frame rate conversion method, contrast adjustment, local dimming control, and the like.

The image processing unit 403 performs image processing on the moving image data (RGB data) developed by the development processing unit 401 in accordance with the image processing parameters set by the display device control data analysis unit 402.
The display unit 404 performs control specific to the display panel, such as backlight luminance control, in accordance with the image processing parameters set by the display device control data analysis unit 402.

The communication unit 405 is a communication unit (transmission unit) for transmitting information on image quality related processing that can be controlled by the display apparatus 400 to the image processing apparatus. The image processing apparatus acquires information on image quality related processing (processing capability information) that can be executed by the display apparatus 400 from the communication unit 405, so that the image processing apparatus can perform image quality related processing that cannot be executed by the display apparatus 400. It is possible to prevent the control information from being stored in the display device control data. For example, when a user (content creator) inputs display device control data, a GUI is configured so that a parameter setting for image quality related processing that cannot be performed by the display device cannot be performed, or a warning is notified. Can do. If the content creator determines the display device control data so that the display device 400 does not include the control information of the image quality related processing that cannot be executed, step S505 is always Yes. The operation burden on the viewer is reduced. In addition, the content creator can determine the display device control data so that a video display closer to his / her intention can be obtained within the limited range of the image quality-related processing capability of the display device 400.

  The operation unit 406 is, for example, a remote controller, and can input an instruction to the display device 400 when the user operates the operation unit 406. In the present embodiment, the operation unit 406 is used for input by the user in steps S503 and S508. It is an interface between the display device 400 and the user together with messages displayed on the display unit 404.

  According to the display device of the second embodiment, when RAW image data associated with display device control data is input, image quality-related processing is controlled according to the display device control data, and the viewer has an image quality close to the intention of the content creator. Can provide content. The viewer can view the content with the image quality close to the intention of the content creator without setting the image quality related processing parameter by himself / herself when viewing the content.

In this embodiment, the display device control data is described as an example of being added in association with the RAW image data as a part of the development parameter. However, the developed RAW image data (moving image data such as MPEG format) is developed. Display device control data may be associated with each other. Also, a display device that receives input of moving image data in MPEG format and display device control data associated or added thereto and displays moving image data while controlling image quality related processing according to the display device control data, It is included within the scope of the present invention. In this embodiment, the RAW image data may be a moving image or a still image. Even when the display device of this embodiment is applied to RAW image data of a still image, the display device is configured so that still image data such as JPEG format developed from RAW image data and display device control data are input in association with each other. can do.

100: Image processing device, 102: Display device control data adding unit, 103: Recording unit, 107: Operation unit

Claims (10)

An input unit that receives input of control information for controlling the operation of the display device;
An adding unit for adding control information input to the input unit to image data;
A recording unit for storing the image data to which the control information is added;
With
The image processing apparatus, wherein the control information includes information for controlling a frame rate conversion process performed when the display apparatus displays image data. A receiving unit that receives from the display device processing capacity information that is information related to processing that can be executed by the display device;
The image processing apparatus according to claim 1, wherein the input unit receives an input of control information of a process that can be executed by the display device based on the processing capability information received by the receiving unit. Information for controlling the frame rate conversion process is:
Generate an interpolated frame to be inserted between two consecutive frame images of image data and increase the number of frames, or perform frame rate conversion processing, or duplicate the frame image of image data to increase the number of frames the image processing apparatus according to claim 1 or 2, characterized in that it comprises information for controlling whether to perform frame rate conversion processing by the method. The image data includes RAW image data,
The control information includes processing related to a development parameter when the display device develops the RAW image data and a display image quality performed when the display device displays image data generated by developing the RAW image data. for controlling an image processing apparatus according to any one of claims 1 to 3 comprising, information associated with the development parameters. The image data includes moving image data,
The control information includes control information related to display image quality commonly applied to display of the entire moving image data, and control information related to display image quality applied to each frame or scene of the moving image data. When the image processing apparatus according to any one of claims 1 4 including.
Receiving an input of control information for controlling the operation of the display device;
Adding input control information to the image data;
Storing the image data to which the control information is added in a recording unit;
Have
The method for controlling an image processing apparatus, wherein the control information includes information for controlling a frame rate conversion process performed when the display apparatus displays image data. Further comprising the step of receiving processing capacity information, which is information relating to processing that can be executed by the display device, from the display device;
The method for controlling an image processing apparatus according to claim 6 , wherein in the step of accepting the input, an input of control information of a process that can be executed by the display device is accepted based on the processing capability information received in the receiving step. Information for controlling the frame rate conversion process is:
Generate an interpolated frame to be inserted between two consecutive frame images of image data and increase the number of frames, or perform frame rate conversion processing, or duplicate the frame image of image data to increase the number of frames 8. The method of controlling an image processing apparatus according to claim 6 , further comprising information for controlling whether to perform frame rate conversion processing by the method. The image data includes RAW image data,
The control information includes processing related to a development parameter when the display device develops the RAW image data and a display image quality performed when the display device displays image data generated by developing the RAW image data. for controlling, the control method of the image processing apparatus according to any one of claims 6 8, including the information associated with the development parameter, the. The image data includes moving image data,
The control information includes control information related to display image quality commonly applied to display of the entire moving image data, and control information related to display image quality applied to each frame or scene of the moving image data. The control method of the image processing apparatus of any one of Claim 6 to 9 containing these.

Images