WO2018092711A1

WO2018092711A1 - Image processing device, image processing method, and program

Info

Publication number: WO2018092711A1
Application number: PCT/JP2017/040732
Authority: WO
Inventors: 小塚　雅之; 柏木　吉一郎; 山本　雅哉; 上坂　靖; 美裕森
Original assignee: パナソニックＩｐマネジメント株式会社
Priority date: 2016-11-17
Filing date: 2017-11-13
Publication date: 2018-05-24

Abstract

Provided is an image processing device which makes it possible to obtain still image data for printing high-quality printed matter. The image processing device is provided with: an acquisition unit which acquires first still image data which is obtained by capturing an image and of which the brightness range is defined by a first dynamic range, and capability information indicating the printing capability of a printing device; a conversion unit which, in accordance with the printing capability indicated by the capability information acquired by the acquisition unit, converts the first still image data acquired by the acquisition unit into second still image data of which the brightness range is defined by a second dynamic range narrower than the first dynamic range; and an output unit which outputs the second still image data obtained by the conversion by the conversion unit to the printing device.

Description

IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND PROGRAM

The present disclosure relates to an image processing apparatus and an image processing method.

Patent Document 1 discloses an imaging device that records a wide dynamic range HDR (High Dynamic Range) still image by combining a plurality of images with different exposures.

JP, 2015-056807, A

In the technique disclosed in Patent Document 1, it is difficult to obtain still image data for printing high-quality printed matter.

The present disclosure provides an image processing apparatus and an image processing method that can obtain still image data for printing high-quality printed matter.

An image processing apparatus according to an embodiment of the present disclosure includes an acquisition unit that acquires first still image data obtained by imaging and having a luminance range defined by a first dynamic range, and capability information indicating the printing capability of the printing apparatus; Defining the first still image data acquired by the second dynamic range having a luminance range narrower than the first dynamic range according to the printing capability indicated by the capability information acquired by the acquiring unit And an output unit for outputting the second still image data converted by the converting unit to the printing apparatus.

In the image processing method according to the present disclosure, the first still image data obtained by imaging and having a luminance range defined by a first dynamic range is acquired, and the acquired capability information indicating the printing capability of the printing apparatus is acquired. 1 Still image data is converted into second still image data defined in a second dynamic range whose luminance range is narrower than the first dynamic range according to the printing capability indicated by the acquired capability information. The converted second still image data is output to the printing apparatus.

Note that these general or specific aspects may be realized by a system, a method, an integrated circuit, a computer program, or a recording medium such as a computer readable CD-ROM, and the system, the method, the integrated circuit, the computer program And any combination of recording media.

The image processing apparatus and the image processing method in the present disclosure can obtain still image data for printing high-quality printed matter.

FIG. 1 is a schematic view for explaining the evolution of video technology. FIG. 2 is a schematic view for explaining the HDR display technology. FIG. 3A is a schematic view for explaining a PQ (Perceptual Quantization) method. FIG. 3B is a schematic view for explaining the HLG (Hybrid Log Gamma) method. FIG. 4 is a diagram showing an example of an HDR image corresponding to HDR and an example of an SDR image corresponding to SDR (Standard Dynamic Range) in comparison. FIG. 5 is a diagram showing an example of a scale of luminance when capturing an image. FIG. 6 is a diagram showing an example of the luminance of a captured image. FIG. 7A is a view showing an example of the luminance as a result of mastering the original image shown in FIG. 6 into the SDR image. FIG. 7B is a view schematically showing an example of the relationship between the original signal value and the SDR signal value for converting (mastering) the original signal value into the SDR signal value. FIG. 8A is a view showing an example of the luminance as a result of mastering the original image shown in FIG. 6 into the HDR image. FIG. 8B is a view schematically showing an example of the relationship between the original signal value and the HDR signal value for converting (mastering) the original signal value into the HDR signal value. FIG. 9 is a schematic diagram for describing an imaging device compatible with HDR or SDR, a file format of image data obtained by the imaging device, and a display device for displaying image data or a printing device for printing image data. It is. FIG. 10 is a schematic diagram for describing an HDR imaging mode in which an image with an expanded dynamic range is obtained by combining two images. FIG. 11 is a schematic diagram for explaining an HDR shooting mode for obtaining an image with an expanded dynamic range by combining two images. FIG. 12 is a schematic view for explaining an HDR image captured for HDR display. FIG. 13 is a schematic view for explaining the problem in the case of causing the SDR printing apparatus to print an image. FIG. 14 is a block diagram schematically showing an example of the hardware configuration of the image processing apparatus according to the first embodiment. FIG. 15 is a block diagram schematically showing a first example of a functional configuration of the image processing apparatus in the first embodiment. FIG. 16 is a diagram showing an example of the result of printing the test pattern according to the first embodiment on a sheet. FIG. 17 shows a signal value of the first dynamic range and a signal value of the second dynamic range for converting from the first dynamic range to the second dynamic range in the conversion section shown in the first embodiment. It is a figure which shows an example of a relationship typically. FIG. 18 is a flowchart showing an example of the operation of the image processing apparatus according to the first embodiment. FIG. 19 is a block diagram schematically showing an example of a functional configuration of the image processing apparatus in the first modification of the first embodiment. FIG. 20 is a block diagram schematically showing an example of a functional configuration of the image processing apparatus in the second modification of the first embodiment. FIG. 21 is a block diagram schematically showing an example of a functional configuration of the image processing apparatus according to the third modification of the first embodiment. FIG. 22 is a schematic diagram for explaining an example of the image processing apparatus according to the first embodiment (or the first to fifth modifications). FIG. 23 is a diagram schematically illustrating a first example of a communication protocol between the display device and the printing device in the embodiment. FIG. 24 is a diagram schematically showing a second example of the communication protocol between the display device and the printing device in the embodiment. FIG. 25 is a diagram schematically illustrating a third example of the communication protocol between the display device and the printing device in the embodiment. FIG. 26 is a diagram schematically showing a fourth example of the communication protocol between the display device and the printing device in the embodiment.

(Purpose of this disclosure)
The present disclosure is to provide a new user value of HDR still images and a new photographic culture using two technologies of HDR (High Dynamic Range) display technology and HDR imaging technology. The above new user value is to improve the sense of realism and to cause whiteout (in which the gradation of a bright area is lost, also referred to as white collapse) and black collapse (in which the gradation of a dark area is lost) ) Is to generate still image data with reduced and the like. In addition, the above-mentioned new photographic culture refers to a display device corresponding to HDR display (hereinafter referred to as “HDR display device”), which is an HDR still image obtained by imaging with a camera compatible with HDR still image imaging. It is to display and appreciate. The HDR display device is, for example, an HDRTV (HDR television set), an HDR compatible tablet terminal, an HDR compatible smartphone, an HDR compatible PC (Personal Computer), an HDR compatible display, or the like. HDR still images are also referred to as HDR photographs.

The present disclosure is compatible with SDR display but not with HDR display (hereinafter referred to as “SDR display device”) and SDR still image printing but with HDR still images Provided are an image processing apparatus and an image processing method capable of generating still image data that can be displayed or printed even in a printing apparatus not compatible with printing (hereinafter referred to as "SDR printing apparatus"). That is, the present disclosure is applicable not only to an apparatus compatible with HDR still image processing but also an apparatus compatible with SDR still image processing but not to HDR still image processing. The present invention also provides an image processing apparatus and an image processing method capable of improving the convenience of HDR still image data by providing still image data capable of reproducing HDR still images. Note that, in the present disclosure, reproduction of an HDR still image includes display of the HDR still image and printing by image processing the HDR still image. That is, in the present disclosure, playback includes display and printing.

(Background of HDR display technology)
FIG. 1 is a schematic view for explaining the evolution of video technology.

Up until now, the main focus has been on expanding the number of display pixels in order to improve the image quality of video. Then, in place of the conventional 720 × 480 pixel Standard Definition (SD) video, a 1920 × 1080 pixel High Definition (HD) video is in widespread use.

In recent years, an Ultra High Definition (UHD) image of 3840 × 2160 pixels or an image of 4096 × 2160 pixels (so-called 4K image) having a larger number of pixels has been proposed for further improvement of the image quality. In addition to 4K video, expansion of luminance range (hereinafter also referred to as "dynamic range"), expansion of color gamut, increase of frame rate, and the like are also studied.

With regard to the dynamic range, HDR (High) is used as a method for expressing bright light such as specular reflection light that is difficult to express in current television signals with brightness closer to reality while maintaining dark area gradation. Dynamic Range) has been proposed. The conventional television signal is called SDR (Standard Dynamic Range), and has a maximum luminance of 100 nit. On the other hand, in HDR, it is assumed that the maximum luminance is expanded to 1000 nit or more. Further, standardization of mastering display standards is also in progress in the Society of Motion Picture and Television Engineers (SMPTE), International Telecommunication Union-Radiocommunication Sector (ITU), and the like. Specific applications of HDR include broadcast, packaged media (Blu-ray (registered trademark) Disc etc.), Internet distribution, etc., as with HD and UHD.

(HDR display technology)
FIG. 2 is a schematic view for explaining the HDR display technology.

HDR is not just a scheme to realize a very bright television set. HDR refers to the luminance range (dynamic range) of a video as BT. From 0.1 nit-100 nit defined in the standard of 709 (Broadcasting Service (Television) 709), for example 0-10 as defined in ST 2084 in SMPTE (Society of Motion Picture and Television Engineers) Expand to 000 nit to enable the representation of bright images such as bright sun, sky and reflection of light rays that could not be expressed conventionally, or to record light and dark areas simultaneously Method. Here, the brightness is an optical brightness and is a physical quantity that represents the brightness of the light source. In HDR, a video (packaged video) to be subjected to grading processing (processing to adjust the color and tone of the video) after imaging, ST 2084 (PQ method) suitable for video delivered to IP (Internet Protocol), etc. There are two methods, Hybrid Log Gamma (HLG method) suitable for broadcast video and video captured by the user.

As described above, the HDR display technology includes the HLG method capable of achieving compatibility between SDR and HDR, and the PQ method not having simple display compatibility between SDR and HDR. The PQ method is also referred to as the HDR 10 method.

FIG. 3A is a schematic view for explaining the PQ method. FIG. 3B is a schematic view for explaining the HLG method.

As shown in FIG. 3A, the PQ scheme is a scheme in which there is no compatibility between SDR and HDR. In this scheme, SDR and HDR are graded separately and transmitted separately. Moreover, in the case of this method, when displaying a video reproduced by Ultra HD Blu-ray (registered trademark) on a SDRTV (a television set compatible with SDR but not compatible with HDR), , SDR conversion is required to convert HDR video data into SDR video data.

As shown in FIG. 3B, 2100 Hybrid Log Gamma (HLG) of ITU-R (The ITU Radio communication Sector) is a method having compatibility between SDR and HDR. In this case, grading for HLG is performed, and only the HLG stream is transmitted. The HLG stream is compatible with SDR. For this reason, when displaying video data of HDR on SDRTV, SDR conversion which converts video data of HDR into video data of SDR is unnecessary.

FIG. 4 is a diagram comparing and showing an example of an HDR image corresponding to HDR and an example of an SDR image corresponding to SDR. In FIG. 4, a HDR image and an SDR image show a single image with a relatively large difference in brightness, in which a relatively dark scene in a room and a relatively bright scene outside a window are mixed.

The HDR image is an image obtained by reproducing the HDR still image data or the HDR video data. The SDR image is an image obtained by reproducing SDR still image data or SDR moving image data. As illustrated in the upper part of FIG. 4, in the HDR image, both the relatively bright scenery outside the window and the relatively dark scenery in the room are expressed with appropriate brightness. On the other hand, in the SDR image, as illustrated in the lower part of FIG. 4, when the exposure is adjusted so that a relatively bright scene outside the window is expressed, the relatively dark scene in the room becomes too dark. Some parts are blacked out and difficult to see. Temporarily, if the exposure is adjusted so that the indoor scenery is properly represented, the scenery outside the window will be too bright and some of the windows will be blown out, making it difficult to see (not shown) . Thus, HDR images are difficult to realize in SDR images, with overexposure and overexposure in a single image with a relatively large difference between bright and dark scenes. It is possible to realize an image with high tonality with both of them reduced.

FIG. 5 is a diagram showing an example of a scale of luminance when capturing an image.

When an object is imaged by a camera, generally, as shown in FIG. 5, 18% gray at which the reflectance is 18% is used as the reference point of brightness. 18% gray is a standard reflectance which is a standard of brightness. The number of Stops shown in FIG. 5 relatively represents the luminance, and the luminance at 18% gray is a reference point, and the number of Stops of the reference point is zero. The Stop number is defined to increase by one each time the luminance is doubled and to decrease by one each time the luminance is halved.

When an object is captured by a camera, the luminance obtained from the camera image sensor (for example, a complementary metal-oxide semiconductor (CMOS) or a charge coupled device (CCD)) is an aperture, shutter speed, sensitivity setting, etc. It changes according to the exposure by. That is, the luminance obtained from the image sensor has different values according to the exposure, even if the subject with the same brightness is imaged. For this reason, the value of the Stop number itself is not an absolute value but a relative value. That is, the Stop number can not represent luminance.

In addition, when an object is imaged by a camera, the exposure is usually adjusted according to the brightness of the object. For example, when an image of a night scene shown as an example of a dark subject in (1) of FIG. 5 is captured by a camera, generally, the dark area occupying a large part of the image is not blackened. By setting the shutter speed slow down, opening the aperture, etc., the exposure adjustment is performed on the camera so that the gradation of the dark area is expressed and the bright area with relatively small area in the image is overexposed. .

When an image of a daytime indoor scene shown in FIG. 5 (2) as an example of a medium-brightness subject is captured by a camera, in general, the exposure is such that the balance between the dark part and the bright part is improved. Make adjustments to the camera.

When imaging a daytime outdoor scene shown as an example of a bright subject in (3) of FIG. 5 with a camera, generally, most of the image is set by setting the shutter speed to be fast, the aperture to be narrowed, etc. Adjust the exposure to the camera to prevent overexposure in the bright area that occupies the.

In order to convert the relative brightness thus obtained into an absolute brightness, it is necessary to calculate the relative relationship of the exposure from the reference point.

FIG. 6 is a diagram showing an example of the luminance of a captured image.

The captured image shown in FIG. 6 is hereinafter referred to as an original image 70. In the original image 70, an area of a pixel having a luminance of 18 nit corresponding to 0 Stop which is a reference of brightness is shown as an area A. Further, in the original image 70, a region of a pixel having a luminance of 90 nit corresponding to 2.3 Stops is shown as a region B. Further, in the original image 70, a region of a pixel having a luminance of 2.3 nit corresponding to substantially black -3 Stops is shown as a region C. In the original image 70, a region of a pixel having a luminance of 1150 nit corresponding to 6 Stops is shown as a region D. Region D includes pixels obtained by imaging the sun, and very bright luminance (for example, the brightest luminance in the original image 70) is obtained. In the original image 70, a region of pixels having a luminance of 290 nit corresponding to 4 Stops is shown as a region E. The area indicated by the area E includes pixels obtained by imaging a location causing specular reflection.

Next, SDR grading processing (mastering processing) for converting the original image 70 into an SDR image will be described.

In the SDR grading process, an image (original image) of content having a high luminance component of 100 nit or more, which is captured by a camera, is BT. This processing is conversion processing to conform to a broadcast standard such as 709, and is realized by performing knee curve processing on an original image. The knee curve process is a process of converting an input signal by a knee curve. The knee curve is an input / output conversion curve which compresses a gain for an input signal having a predetermined value (knee point) or more and outputs the compressed signal. In the SDR grading process, the gain is set to 1 for luminance below a certain value (knee point) in the original image (that is, the input luminance is output as it is), and for luminance above a certain value (knee point). Compresses the gain so that it falls within a predetermined luminance. The predetermined luminance may be, for example, the maximum luminance that can be displayed by a display device that displays the image after processing. When conforming to 709, it may be 100 nit. Therefore, for example, when performing the SDR grading process on the original image 70, the brightness of the current image 70 is held as it is linearly up to the knee point (for example, around 80 nit) in the normal grading process. Reduces each luminance so that the maximum luminance of the current image 70 falls within 100 nit.

FIG. 7A is a view showing an example of the luminance as a result of mastering the original image 70 shown in FIG. 6 on the SDR image 71. As shown in FIG. FIG. 7B is a diagram schematically showing an example of the relationship between the original signal value and the SDR signal value for converting the original signal value into the SDR signal value (hereinafter, also referred to as “mastering”). The original signal value is the luminance in the luminance range of 0 nit to the maximum luminance (for example, 1150 nit) of the original image (for example, the original image 70) (hereinafter referred to as "the luminance of the original image"). Is the brightness in the brightness range of SDR (hereinafter referred to as “brightness of SDR”). Although the maximum value of the original signal value is 10000 in FIG. 7B, the maximum value of the original signal value changes depending on the original image. For example, for the original image 70 shown in FIG. 6, the maximum value of the original signal value is 1150.

In the original image 70, the pixel corresponding to 0.sub.Stop is a pixel having a reference luminance as a reference of brightness. Therefore, even after converting the original image 70 into the SDR image 71 by mastering the original image 70 into the SDR image 71, the brightness (18 nit) of the original image 70 corresponding to 0 Stop in the original image 70 is not changed. The luminance (18 nit) of the SDR is assumed (refer to the area indicated by the area A in the SDR image 71 of FIG. 7A).

Here, an example will be described in which mastering from the original image 70 to the SDR image 71 is performed by the knee curves shown in FIG. 7B. However, the maximum value of the original signal value shown in FIG. 7B is not 10000 but 1150. Also, the knee point is 90. In this mastering, in the luminance range (0 to 90 nit) equal to or lower than the luminance of the original image 70 corresponding to 90 nit of the original image 70, the luminance of the original image 70 is set as the luminance of SDR without changing. That is, pixels of 0 to 90 nit in the original image 70 become pixels of 0 to 90 nit in the SDR image 71 after mastering. In the luminance range (90 to 1150 nit) of the original image 70 larger than the luminance of the original image 70 corresponding to 90 nit of the original image 70, the luminance of the original image 70 is set to the SDR luminance of the luminance range of 90 to 100 nit. Perform linear conversion. That is, pixels of 90 to 1150 nit in the original image 70 are pixels of 90 to 100 nit in the SDR image 71 after mastering.

For example, even if the original image 70 is converted to the SDR image 71 by mastering from the original image 70 to the SDR image 71, the pixels corresponding to 90 nit in the original image 70 are the original image 70 corresponding to 90 nit in the original image 70. The luminance is assumed to be the luminance of SDR without changing (refer to the area indicated by area B in the SDR image 71 of FIG. 7A).

Further, for example, even after the original image 70 is converted into the SDR image 71 by mastering the original image 70 to the SDR image 71, the pixels corresponding to 2.3 nit in the original image 70 are the same as the original image 70. The luminance of the original image 70 corresponding to 2.3 nit in the above is the luminance of the SDR without changing (refer to the area indicated by the area C in the SDR image 71 of FIG. 7A).

On the other hand, for example, in the mastering of the original image 70 to the SDR image 71, the pixel corresponding to 1150 nit in the original image 70 sets the luminance of the original image 70 corresponding to 1150 nit in the original image 70 to 100 nit, which is the maximum luminance of SDR. Convert (refer to the area indicated by D in the SDR image 71 of FIG. 7A).

Further, for example, in the mastering of the original image 70 to the SDR image 71, the pixel corresponding to 290 nit in the original image 70 converts the luminance of the original image 70 corresponding to 290 nit in the original image 70 to 95 nit (FIG. 7A Refer to the area indicated by the area E in the SDR image 71).

FIG. 8A is a view showing an example of the luminance as a result of mastering the original image 70 shown in FIG. 6 into the HDR image 72. As shown in FIG. FIG. 8B is a view schematically showing an example of the relationship between the original signal value and the HDR signal value for converting (mastering) the original signal value into the HDR signal value. The HDR signal value is the luminance in the luminance range of the HDR (hereinafter referred to as “the luminance of the HDR”). In this embodiment, in mastering from the original image 70 to the HDR image 72, it is assumed that the luminance up to 2000 nit is permitted to be the luminance of the HDR. On the other hand, as described above, the maximum luminance of the original image 70 is 1150 nit. Therefore, in the HDR image 72, the luminance of the original image 70 can be held as it is.

In the original image 70, the pixel corresponding to 0.sub.Stop is a pixel having a reference luminance as a reference of brightness. Therefore, regarding the pixel, even after converting the original image 70 to the HDR image 72 by mastering from the original image 70 to the HDR image 72, the luminance in the original image 70 is not changed but is set as the HDR luminance (see FIG. An area indicated by an area A in the HDR image 72 of 8A).

Similarly, for example, a pixel corresponding to 90 nit in the original image 70, a pixel corresponding to 2.3 nit in the original image 70, a pixel corresponding to 1150 nit in the original image 70, and a pixel corresponding to 290 nit in the original image 70 For each of the above, also after converting the original image 70 to the HDR image 72 by mastering from the original image 70 to the HDR image 72, the luminance of the original image 70 is made the luminance of the HDR without changing (FIG. 8A In the HDR image 72, the areas indicated by area B, area C, area D, and area E are referred to).

FIG. 9 is a schematic diagram for describing an imaging device compatible with HDR or SDR, a file format of image data obtained by the imaging device, and a display device for displaying image data or a printing device for printing image data. It is.

The HDR imaging device 10 illustrated in FIG. 9 corresponds to imaging in HDR. The HDR imaging device 10 includes an HDR imaging unit 11, an SDR imaging unit 14, a conversion unit 12, and a JPEG compression unit 13. The HDR imaging device 10 can respond to the image data obtained by imaging in the HDR imaging mode in the HDR imaging unit 11 being displayed on the SDR display device 40 or being printed on the SDR printing device 50. It is configured. Specifically, in the HDR imaging device 10, HDR still image data of an HDR image obtained by imaging in the HDR imaging mode in the HDR imaging unit 11 is converted into SDR still image data in the conversion unit 12. Then, in the HDR imaging apparatus 10, the SDR still image data obtained by the conversion in the conversion unit 12 is JPEG-compressed in the JPEG compression unit 13, and the SDR still image data in the JPEG format obtained by the compression is output. . Further, in the HDR imaging device 10, the SDR still image data of the SDR image obtained by imaging in the conventional imaging mode (SDR imaging mode) in the SDR imaging unit 14 is also JPEG-compressed by the JPEG compression unit 13, SDR still image data in JPEG format obtained by compression is output.

The SDR imaging device 20 includes an SDR imaging unit 21 and a JPEG compression unit 22. In the SDR imaging device 20, SDR still image data of an SDR image obtained by imaging in the SDR imaging unit 21 as in the case where imaging is performed in the conventional imaging mode (SDR imaging mode) in the HDR imaging device 10 Is JPEG-compressed by the JPEG compression unit 22, and the SDR still image data of JPEG format obtained by the compression is output.

Therefore, in the HDR display device 30, the SDR display device 40, and the SDR printing device 50, SDR still image data obtained by SDR converting HDR still image data by HDR imaging or SDR still image data by SDR imaging is acquired Then, the SDR image based on the SDR still image data is reproduced (displayed or printed).

Next, the HDR shooting mode will be described with reference to FIGS. 10 and 11.

FIG. 10 and FIG. 11 are schematic diagrams for describing the HDR imaging mode for obtaining an image in which the luminance range (dynamic range) is expanded by combining two images.

Some smartphones, digital cameras, and the like have an HDR shooting mode capable of capturing an image having a wide luminance range (dynamic range). In the HDR shooting mode, as shown in FIGS. 10 and 11A, double exposure (the same subject is photographed a plurality of times in different exposure states to obtain HDR image data having a wide luminance range (dynamic range), The two SDR images obtained by the above method are synthesized so as to fall within the luminance range defined by the SDR. As a result, as shown in (b) of FIG. 10 and FIG. 11, it becomes possible to display the HDR image on the SDR display device.

Next, an HDR image captured for HDR display will be described using FIG. 12.

FIG. 12 is a schematic view for explaining an HDR image captured for HDR display.

As shown in FIG. 12, the HDR image for HDR display is captured in a brightness range (dynamic range) in which the brightness of the scene to be captured is wider than that in the SDR shooting mode. A grading process is performed on the image data obtained by this imaging to generate an HDR image for HDR display, and the HDR image is transmitted to each device and reproduced. The HDR image can not be displayed on the SDR display device as it is because the luminance range (dynamic range) is wider than the SDR image. In order to display the HDR image on the SDR display device, conversion from the HDR image to the SDR image is required.

On the other hand, in the HDR imaging mode described with reference to FIGS. 10 and 11, the combined image is generated so as to fall within the luminance range defined by the SDR. Therefore, the HDR display device 30 and the SDR display device 40 ( Or, it is possible to reproduce with both the SDR printing apparatus 50).

Returning to FIG. 9, the description will be continued. BACKGROUND In recent years, HDR display devices such as HDRTV that can display HDR image data for displaying an HDR image without performing SDR conversion have been proposed.

On the other hand, in a camera having an HDR shooting mode (HDR imaging function), unlike HDRTV, HDR technology is mainly used for the purpose of backlight correction and the like. And, still images captured by the camera using the HDR technology may be reproduced by the SDR display device or the SDR printing device. Therefore, the camera is provided with an imaging element capable of generating HDR image data for video, and the HDR image captured in the HDR imaging mode is SDR converted although imaging using the HDR technology is possible. May output SDR still image data. As described above, in a camera having an HDR imaging function, HDR image data is generated although it is possible to generate HDR image data having a wide luminance range (dynamic range) that makes use of the display capability of HDRTV. There was a case that did not.

FIG. 13 is a schematic view for explaining the problem in the case of causing the SDR printing apparatus 50 to print an image.

In order to take advantage of the HDR display function of HDRTV (for example, HDR display device 30), when HDR image data for HDR display is generated, the HDR image data is not converted into SDR image data, and the HDR image data as it is Can be displayed on HDRTV.

The HDR imaging device 10A illustrated in FIG. 13 includes an HDR imaging unit 11, an SDR imaging unit 14, a conversion unit 12, a JPEG compression unit 13, an HDR image correction unit 15, and a high efficiency video coding (HEVC) compression unit 16 And. The HDR imaging device 10A performs the HDR image correction in the HDR image correction unit 15 in order to generate the HDR image data.

The HDR image correction unit 15 uses, for example, the HDR data (for example, HDR-EOTF (HDR-Electro-Optical Transfer Function) such as a PQ curve) to capture the RAW data obtained by performing imaging by the HDR imaging unit 11. , 10-bit image that can be displayed by the HDR display device 30) compatible with the HDR 10 standard. Then, the HDR imaging device 10A transmits the HDR image data obtained by the HDR image correction unit 15 to the HDRTV (for example, the HDR display device 30) from the HEVC compression unit 16 via HDMI (registered trademark, High-Definition Multimedia Interface), for example. Output to). Thereby, in the HDR TV (for example, the HDR display device 30) which has received the HDR image data, the HDR image according to the HDR image data is displayed.

In addition, pseudo-HDR conversion is performed on HDR image data, and a pseudo-HDR image in SDR format obtained by the pseudo-HDR conversion is output to the SDR display device 40 to display the SDR image data on the SDR display device 40. Higher quality images can be displayed. The pseudo-HDR conversion is to convert an HDR image into an SDR-format image (pseudo-HDR image) having a luminance range (dynamic range) in accordance with the maximum luminance value that can be displayed by the SDR display device 40.

However, in the SDR printing apparatus 50, HDR image data can not be printed with high quality. Therefore, the SDR printing apparatus 50 prints SDR image data obtained by performing imaging in the conventional SDR imaging mode. That is, in the SDR printing apparatus 50, even if high quality HDR image data is obtained, it is not possible to print a high quality image based on high quality HDR image data.

Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of well-known matters and redundant descriptions of substantially the same configurations may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art.

It should be noted that the attached drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and they are not intended to limit the claimed subject matter.

Further, each drawing is not necessarily strictly illustrated, and is a schematic view appropriately omitted in order to clearly show the present disclosure. In each of the drawings, substantially the same components may be denoted by the same reference numerals and descriptions thereof may be omitted or simplified.

(1. Embodiment 1)
In the present embodiment, an image processing apparatus is disclosed that generates still image data for enabling the SDR printing apparatus 50 to print high-quality images.

(1-1. Configuration)
FIG. 14 is a block diagram schematically showing an example of the hardware configuration of the image processing apparatus 100 according to the first embodiment.

As illustrated in FIG. 14, the image processing apparatus 100 has a hardware configuration including a central processing unit (CPU) 101, a main memory 102, a storage 103, an input interface (IF) 104, and a communication interface (interface) 105. And.

The CPU 101 is a processor that executes a control program stored in the storage 103 or the like.

The main memory 102 is a volatile storage area used as a work area used when the CPU 101 executes a control program. The main memory 102 can be configured by, for example, a semiconductor memory or the like.

The storage 103 is a non-volatile storage area that holds a control program, content, and the like. The storage 103 can be configured by, for example, a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

The input IF 104 is a keyboard, a mouse, a touch pad, a button, a touch panel, or the like.

The communication IF 105 is a communication interface that communicates with another device via a communication network. The other devices are, for example, a printing device 200, an input device 300, and the like described later. The communication IF 105 is, for example, a wireless LAN (Local Area Network) interface conforming to the IEEE 802.11a, b, g, n standards, but the third generation mobile communication system (3G), the fourth generation mobile communication system (4G) Or a wireless communication interface conforming to a communication standard used in a mobile communication system such as LTE (registered trademark, LONG Term Evolution), or a wireless communication interface conforming to the Bluetooth (registered trademark) standard May be The communication IF 105 may be a wired communication interface such as a wired LAN interface or a USB (Universal Serial Bus) interface.

FIG. 15 is a block diagram schematically showing a first example of a functional configuration of the image processing apparatus in the first embodiment.

The image processing apparatus 100 includes an acquisition unit 110, a conversion unit 120, and an output unit 130. The image processing apparatus 100 may be realized as an apparatus incorporated in an imaging apparatus or may be realized as a single apparatus. Further, the printing apparatus 200 is connected to the image processing apparatus 100 by wired connection or wireless connection. The printing apparatus 200 is an example of the SDR printing apparatus 50 shown in FIG.

The acquisition unit 110 acquires the first still image data D1 acquired by imaging and the capability information I1 indicating the printing capability of the printing apparatus 200. The first still image data D1 is still image data whose luminance range is defined by the first dynamic range. The first dynamic range is, for example, HDR (High Dynamic Range).

The acquisition unit 110 may acquire, for example, paper information indicating the type of paper used for printing by the printing apparatus 200 (or the paper set in the printing apparatus 200) as the capability information I1. The paper information may be included, for example, in an instruction when the user causes the printing apparatus 200 to print an image (hereinafter, also referred to as a “printing instruction”).

The acquisition unit 110 may also acquire, as the capability information I1, a print result obtained by printing a specific pattern (hereinafter also referred to as a “test pattern”) on a sheet used for printing by the printing apparatus 200. The acquisition unit 110 may acquire the print result by the user inputting the print result to the image processing apparatus 100 (or the printing apparatus 200). The print result will be described later.

The acquisition unit 110 may acquire the first still image data D1 from, for example, an imaging device, an information terminal, or a storage device connected to the image processing apparatus 100 by wire connection or wireless connection. The acquisition unit 110 for acquiring the first still image data D1 may be realized by, for example, the communication IF 105 (see FIG. 14).

The acquisition unit 110 may acquire, for example, a print instruction including paper information as the capability information I1 by receiving an input operation from the user. The acquisition unit 110 for acquiring the capability information I1 may be realized by, for example, the input IF 104 (see FIG. 14). The acquisition unit 110 may acquire the capability information I1 without acquiring the print instruction.

The conversion unit 120 converts the first still image data D1 acquired by the acquisition unit 110 into second still image data D2 according to the printing capability indicated by the capability information I1 acquired by the acquisition unit 110. The second still image data D2 is still image data defined in a second dynamic range whose luminance range is narrower than the first dynamic range.

When the capability information I1 is paper information including information indicating the type of paper, the conversion unit 120 refers to the information indicating a predetermined relationship to indicate the paper indicated by the paper information acquired by the acquisition unit 110. Identify the reflected brightness that corresponds to the type of The information indicating the predetermined relationship is information indicating the relationship between the plurality of types of sheets and the reflection luminance corresponding to each of the plurality of types of sheets. Then, the converting unit 120 converts the first still image data D1 into the second still image data D2 with the brightness range (dynamic range) in which the reflection brightness specified by the paper information is the maximum brightness as the second dynamic range. . The reflection luminance is the luminance of the light reflected by the sheet when the sheet is irradiated with the light of the specified luminance. The prescribed luminance may be defined, for example, as luminance representing general indoor brightness, or may be any other arbitrarily determined luminance. Then, the information indicating the predetermined relationship (the relationship between the types of the plurality of sheets and the reflection luminance) irradiates light of the prescribed luminance to the plurality of types of sheets in advance, and the light is reflected on each sheet It can be obtained from the result of measuring the brightness of the received light. The information indicating the predetermined relationship may be represented, for example, by a table representing the relationship between the types of paper and the reflection luminance, or may be stored in the storage 103. Further, the information indicating the predetermined relationship may be acquired from an external information processing apparatus (not shown) via the communication network.

When the capability information I1 acquired by the acquisition unit 110 includes information indicating the print result, the conversion unit 120 sets the luminance range (dynamic range) determined according to the print result as the second dynamic range. Then, the conversion unit 120 converts the first still image data D1 into second still image data D2 based on the second dynamic range.

The conversion unit 120 may be realized by, for example, the CPU 101, the main memory 102, the storage 103 (see FIG. 14), and the like. The conversion unit 120 may be realized by a dedicated circuit configured of a semiconductor integrated circuit or the like.

The output unit 130 outputs the second still image data D2 converted from the first still image data D1 by the conversion unit 120 to the printing apparatus 200. The output unit 130 may be realized by, for example, the communication IF 105 (see FIG. 14).

The printing apparatus 200 receives the second still image data D2 from the image processing apparatus 100 and a print instruction from the user. Then, the printing apparatus 200 prints the still image indicated by the received second still image data D2 on the sheet of the type specified in the received print instruction.

The image processing apparatus 100 may output a print instruction for printing a test pattern to the printing apparatus 200, and may cause the printing apparatus 200 to print the test pattern. The image processing apparatus 100 may also include a display (not shown). Alternatively, a display may be connected to the image processing apparatus 100. Then, the image processing apparatus 100 outputs, to the printing apparatus 200, a print instruction to execute printing of the test pattern, and then an input for allowing the user to input a print result obtained by printing the test pattern on a sheet. The instructions may be displayed on a display. The input instruction may be, for example, a message, an image, or a UI (User Interface), which prompts the user to input a print result obtained from a sheet on which the test pattern is printed.

FIG. 16 is a diagram showing an example of the result of printing the test pattern 150 according to the first embodiment on a sheet.

In the present embodiment, for example, a test pattern 150 shown in FIG. 16 is printed on a sheet P1 used for printing by the printing apparatus 200 as a specific pattern (test pattern). The test pattern 150 shown as an example in FIG. 16 includes patterns 1 to 3 and patterns 4 to 6. In patterns 1 to 3, as shown in FIG. 16, in the area on the upper left side (upper left side in FIG. 16) on paper P1, three blacks serving as the comparison reference are arranged in parallel in the longitudinal direction. Gray is arranged in the area on the right side, and the density of each gray becomes lighter in order from the top. That is, with respect to patterns 1 to 3, with the three blacks arranged on the left side (left side in FIG. 16) of sheet P1 as a comparison reference, the grays arranged on the right side of each black are three steps from dark gray to light gray Is a changing pattern. As shown in FIG. 16, in patterns 4 to 6, three whites serving as a comparison reference are arranged in parallel in the vertical direction in the area on the lower left side (lower left side in FIG. 16) of paper P1. Gray is arranged in the area on the right side, and the density of each gray becomes lighter in order from the top. That is, with respect to the patterns 4 to 6, the grays arranged on the right side of each white are compared with the light gray to the light gray 3 based on three whites arranged on the left side (left side in FIG. 16) of the paper P1. It is a pattern that changes in stages. As shown in FIG. 16, in the patterns 1 to 6, numerals 1 to 6 for distinguishing the patterns 1 to 6 from each other are described in parallel.

The arrangement positions of the patterns 1 to 6 are not limited to the arrangement positions shown in FIG. Each pattern may be arranged in the lateral direction. Also, patterns other than the patterns 1 to 6 may be included in the test pattern 150. The number of patterns included in the test pattern 150 may be five or less, or seven or more. For example, in addition to the patterns 1 to 6, one or more patterns in which gray density is more finely changed may be further included in the test pattern 150 shown in FIG.

In the image processing apparatus 100, for example, with reference to the paper P1 on which the test pattern 150 is printed, image processing is performed on numbers of patterns (or patterns which can not be discriminated) which can discriminate the gradation of black or white and gray as comparison reference. An input instruction prompting the user to input to the device 100 (or the printing device 200) is shown to the user, for example, through a display or the like. On the other hand, in the image processing apparatus 100, a table in which combinations (for example, nine combinations) of each number of patterns 1 to 3 and each number of patterns 4 to 6 and a luminance range (dynamic range) are associated. Are stored, for example, in the storage 103 or the like. Then, when the user performs an input operation according to the input instruction, the image processing apparatus 100 acquires a combination of the numbers of patterns 1 to 6. In the present embodiment, the combination of the numbers obtained in this manner is referred to as "print result". The combination of the numbers is an example of the print result. In the test pattern 150 shown in FIG. 16, for example, alphabets, symbols, other characters, or a combination thereof may be used instead of the numbers.

In the image processing apparatus 100, two numbers input by the user (that is, any one of the patterns 1 to 3) out of the luminance range previously associated with each of, for example, nine combinations of the numbers of patterns 1 to 6 One luminance range corresponding to the number and any of the patterns 4 to 6) is selected as the second dynamic range corresponding to the sheet. A concrete example of those operations is shown. For example, in the image processing apparatus 100, the user inputs, to the user, the number of the smallest pattern capable of determining the gradation of the patterns 1 to 3 and the number of the largest pattern capable of determining the gradation of the patterns 4 to 6. An input instruction prompting to do is displayed through a display or the like. Then, the image processing apparatus 100 selects the luminance range previously associated with the combination of the pattern numbers based on the numbers of the two patterns input by the user according to the input instruction, and selects the second selected luminance range. Dynamic range. Thus, the second dynamic range is determined in the image processing apparatus 100.

FIG. 17 shows signal values in the first dynamic range and signal values in the second dynamic range for converting from the first dynamic range to the second dynamic range in conversion section 120 shown in the first embodiment. It is a figure showing typically an example of a relation of. The signal value of the first dynamic range is, for example, the luminance in the HDR, and the signal value of the second dynamic range is the luminance in the luminance range (dynamic range) having the maximum luminance smaller than the maximum luminance of the HDR. is there.

In a display device, an image is displayed by adjusting the intensity of light emission of RGB (Red, Green, Blue), which is the three primary colors of light, for each pixel. Therefore, in the display device, the image is represented by absolute luminance. On the other hand, in a printing apparatus, an image is displayed by printing a plurality of paints including CMYK (Cyan, Magenta, Yellow, blacK) on a sheet. The image printed on the sheet is expressed by the intensity of light reflected according to the paint applied to the sheet. Therefore, the maximum brightness in the image is the brightness of the white (paper white) area where the paint is not applied. Further, the brightness of the light reflected on the sheet changes depending on the type of the sheet (reflectance of the sheet), the brightness of the light irradiated to the sheet, the angle of the light irradiated to the sheet, and the like.

Therefore, in order to print a high-quality image with an extended luminance range (dynamic range) on a sheet, the type of sheet, the type and brightness of the light source illuminating the environment in which the sheet on which the image is printed is installed, etc. It is effective to perform conversion processing to convert the signal level of the HDR image from the first dynamic range to the second dynamic range, assuming that

For example, as shown in FIG. 17, the converting unit 120 sets the first dynamic range to a second dynamic range in which the upper limit of the expressive capability of the sheet (that is, the brightness represented by the white of the sheet) is the maximum brightness. By performing conversion processing, HDR image data as the first still image data D1 is converted into second still image data D2. The maximum luminance represented by the white of the sheet can be determined, for example, from the reflectance of the sheet. The conversion unit 120 calculates the brightness of the reflected light (hereinafter referred to as “reflection brightness”) when light of a prescribed brightness is reflected on the white of the paper using, for example, the reflectance of the paper, and the calculated reflection The luminance may be set as the upper limit of the expressive ability of the sheet.

Further, the conversion unit 120 obtains the maximum luminance in the first still image data D1, and converts the luminance range (dynamic range) by converting the luminance range (dynamic range) so that the maximum luminance in the first still image data D1 becomes the reflection luminance. The first still image data D1 may be converted into the second still image data D2.

(1-2. Operation)
FIG. 18 is a flowchart showing an example of the operation of the image processing apparatus 100 according to the first embodiment.

The acquisition unit 110 acquires the first still image data D1 (step S101).

The acquisition unit 110 acquires the capability information I1 (step S102).

The conversion unit 120 generates the second still image data based on the second dynamic range corresponding to the print capability indicated by the capability information I1 acquired by the acquisition unit 110, based on the first still image data D1 acquired by the acquisition unit 110. It converts to D2 (step S103).

The output unit 130 outputs the second still image data D2 converted from the first still image data D1 by the conversion unit 120 to the printing apparatus 200 (step S104).

(1-3. Effects etc.)
As described above, in the present embodiment, the image processing apparatus obtains the first still image data obtained by imaging and the luminance range defined by the first dynamic range and the capability information indicating the printing capability of the printing apparatus. A second dynamic range having a luminance range narrower than the first dynamic range according to the acquiring unit and the first still image data acquired by the acquiring unit according to the printing capability indicated by the capability information acquired by the acquiring unit And a output unit configured to output the second still image data converted by the conversion unit to the printing apparatus.

Further, in the present embodiment, the image processing method acquires first still image data obtained by imaging and having a luminance range defined by the first dynamic range, and acquires capability information indicating the printing capability of the printing apparatus. Converting the acquired first still image data into second still image data defined in a second dynamic range whose luminance range is narrower than the first dynamic range according to the printing capability indicated by the acquired capability information , Outputting the converted second still image data to the printing apparatus.

The image processing apparatus 100 is an example of an image processing apparatus. The first still image data D1 is an example of first still image data. The printing apparatus 200 is an example of a printing apparatus. The capability information I1 is an example of the capability information. The acquisition unit 110 is an example of an acquisition unit. The second still image data D2 is an example of second still image data. The conversion unit 120 is an example of a conversion unit. The output unit 130 is an example of the output unit.

For example, in the example shown in the first embodiment, the image processing apparatus 100 has the ability to indicate the first still image data D1 obtained by imaging and having the luminance range defined by the first dynamic range and the printing capability of the printing apparatus 200. The acquisition unit 110 for acquiring the information I1 and the first still image data D1 acquired by the acquisition unit 110 are compared with the first dynamic range according to the printing capability indicated by the capability information I1 acquired by the acquisition unit 110. Also, a converter 120 for converting the second still image data D2 defined by the second dynamic range having a narrow luminance range, and an output unit for outputting the second still image data D2 converted by the converter 120 to the printing apparatus 200 And 130.

Further, in the example shown in the first embodiment, the image processing method executed by the image processing apparatus 100 acquires the first still image data D1 obtained by imaging and in which the luminance range is defined by the first dynamic range. (Step S101) The capability information I1 indicating the printing capability of the printing apparatus 200 is acquired (step S102), and the acquired first still image data D1 is subjected to a first processing according to the printing capability indicated by the acquired capability information I1. The second still image data D2 defined in the second dynamic range having a narrower luminance range than the dynamic range is converted (step S103), and the converted second still image data D2 is output to the printing apparatus 200 (step S104) .

The image processing apparatus 100 configured in this manner converts the first still image data D1 into second still image data D2 defined by the second dynamic range determined according to the printing capability of the printing apparatus 200. The second still image data D2 can be output to the printing apparatus 200. Therefore, the image processing apparatus 100 can cause the printing apparatus 200 to print an image based on the first still image data D1 in a luminance range (dynamic range) corresponding to the print capability of the printing apparatus 200. Therefore, the image processing apparatus 100 can cause the printing apparatus 200 to print an image based on the first still image data D1 with high quality.

In the image processing apparatus, the acquisition unit may acquire paper information indicating the type of paper used for printing by the printing apparatus as the capability information. The conversion unit indicates the sheet information acquired by the acquisition unit by referring to the relationship between the types of a plurality of sheets and the reflection luminance of the light reflected by the sheet when the sheets are irradiated with light. The reflected luminance corresponding to the type of paper may be specified. Then, the conversion unit may convert the first still image data into the second still image data, with the luminance range in which the specified reflection luminance is the maximum luminance as the second dynamic range.

For example, in the example described in the first embodiment, in the image processing apparatus 100, the acquisition unit 110 acquires paper information indicating the type of paper used for printing by the printing apparatus 200 as the capability information I1. The paper information acquired by the acquisition unit 110 by referring to the relationship between the types of a plurality of sheets and the reflection luminance of the light reflected by the sheets when the sheets are irradiated with light. Identify the reflection brightness corresponding to the type of paper indicated by. Then, the converting unit 120 converts the first still image data D1 into the second still image data D2 with the luminance range in which the specified reflection luminance is the maximum luminance as the second dynamic range.

The image processing apparatus 100 configured in this manner converts the first still image data D1 into second still image data D2 defined by the second dynamic range based on the type of paper used for printing by the printing apparatus 200. The second still image data D2 can be output to the printing apparatus 200. Therefore, the image processing apparatus 100 can cause the printing apparatus 200 to print an image based on the first still image data D1 in a luminance range (dynamic range) according to the expressive ability of the sheet. Therefore, the image processing apparatus 100 can cause the printing apparatus 200 to print an image based on the first still image data D1 with high quality.

In the image processing apparatus, the acquisition unit may acquire, as the capability information, a print result obtained by printing the specific pattern on the sheet used for printing by the printing apparatus. The conversion unit may convert the first still image data into the second still image data, using the luminance range determined according to the print result acquired by the acquisition unit as the second dynamic range.

The test pattern 150 shown in FIG. 16 is an example of a specific pattern. The combination of the numbers of patterns 1 to 6 at which the image processing apparatus 100 can obtain the image processing apparatus 100 from the user who has referred to the paper P1 on which the test pattern 150 shown in FIG.

For example, in the example shown in the first embodiment, in the image processing apparatus 100, the acquiring unit 110 obtains the capability information I1 by printing the specific pattern on the sheet used for printing by the printing apparatus 200. Get the printed result. The conversion unit 120 converts the first still image data D1 into the second still image data D2 as the second dynamic range, which is the luminance range determined according to the print result acquired by the acquisition unit 110.

In the image processing apparatus 100 configured in this manner, a specific pattern is printed on a sheet used for printing by the printing apparatus 200, and a print result based on the sheet P1 on which the specific pattern is printed is acquired from the user and acquired. The second dynamic range can be determined according to the printing result. Then, the image processing apparatus 100 converts the first still image data D1 into second still image data D2 defined by the second dynamic range, and outputs the second still image data D2 to the printing apparatus 200. can do. That is, the image processing apparatus 100 can easily estimate the expressive ability of the sheet used for printing by the printing apparatus 200 (that is, the luminance range in which the luminance represented by the white of the sheet is the maximum luminance), The second dynamic range can be easily determined by setting the luminance range (dynamic range) suitable for the second dynamic range as the second dynamic range. Therefore, the image processing apparatus 100 can cause the printing apparatus 200 to print an image based on the first still image data D1 with high quality.

In the image processing apparatus, the first dynamic range may be HDR.

For example, in the example shown in the first embodiment, in the image processing apparatus 100, the first dynamic range is HDR.

Therefore, the image processing apparatus 100 can print an image based on the first still image data D1 with high quality without losing the luminance range (dynamic range) of the first still image data D1 corresponding to HDR as much as possible. It can be printed on 200.

(1-4. Modification of Embodiment 1)
Next, Modifications 1 to 5 of Embodiment 1 will be described with reference to FIGS. 19 to 21. In the following description, components substantially the same as the components described in the first embodiment will be assigned the same reference numerals as the components and descriptions thereof will be omitted. In the following description, each of the

image processing apparatuses

100A, 100B, and 100C is an example of the image processing apparatus. Each of the

acquisition units

110A, 110B, and 110C is an example of an acquisition unit. The conversion unit 120C is an example of a conversion unit. Each of the printing devices 200A and 200B is an example of a printing device.

(1-4-1. Modified example 1)
First, a first modification of the first embodiment will be described.

FIG. 19 is a block diagram schematically showing an example of a functional configuration of the image processing apparatus 100A in the first modification of the first embodiment.

The image processing apparatus 100A includes an acquisition unit 110A, a conversion unit 120, and an output unit 130. The image processing apparatus 100A according to the first modification differs from the image processing apparatus 100 according to the first embodiment in that the capability information I1 is acquired from the input device 300. The other configuration in the image processing apparatus 100A is substantially the same as that of the image processing apparatus 100 in the first embodiment, and thus the detailed description will be omitted.

Similar to the acquisition unit 110 in the image processing apparatus 100 according to the first embodiment, the acquisition unit 110A acquires the first still image data D1 and the capability information I1.

Similar to the acquisition unit 110 in the image processing apparatus 100 according to the first embodiment, the acquisition unit 110A is, for example, an imaging device or an information terminal to which the first still image data D1 is wired or wirelessly connected to the image processing apparatus 100A. Or from a storage device or the like. Acquisition part 110A which acquires the 1st still picture data D1 may be realized by communication IF105 (refer to Drawing 14), for example.

The acquisition unit 110A may acquire, for example, the capability information I1 from the input device 300 wired or wirelessly connected to the image processing apparatus 100A. As in the first embodiment, the capability information I1 acquired by the acquisition unit 110A may be paper information or a print result. The acquisition unit 110A that acquires the capability information I1 may be realized by, for example, the communication IF 105 (see FIG. 14).

The input device 300 is, for example, an information terminal for the user to output a print instruction to the printing device 200, and is, for example, a smartphone, a tablet terminal, or a PC. The input device 300 includes an input IF and a communication IF (not shown), and transmits a print instruction including paper information input at the input IF to the image processing apparatus 100A using the communication IF. The input IF provided in the input device 300 may have, for example, the same configuration as the input IF 104 (see FIG. 14). Further, the communication IF provided in the input device 300 may be configured to be able to communicate with the image processing apparatus 100A, and may be, for example, the same configuration as the communication IF 105 (see FIG. 14).

As described above, the image processing apparatus 100A may obtain a print instruction including the capability information I1 via the external input device 300. In addition, the image processing apparatus 100A may acquire, from the input device 300, the print result input to the input device 300 by the user.

(1-4-2. Modified Example 2)
Next, a second modification of the first embodiment will be described.

FIG. 20 is a block diagram schematically showing an example of a functional configuration of the image processing apparatus 100B in the second modification of the first embodiment.

The image processing apparatus 100 </ b> B includes an acquisition unit 110 </ b> B, a conversion unit 120, and an output unit 130. The image processing apparatus 100B according to the second modification differs from the image processing apparatus 100 according to the first embodiment in that the capability information I1 is acquired from the printing apparatus 200A. The other configuration in the image processing apparatus 100B is substantially the same as that of the image processing apparatus 100 in the first embodiment, and thus the detailed description will be omitted.

Similar to the acquisition unit 110 in the first embodiment and the acquisition unit 110A in the first modification, the acquisition unit 110B acquires the first still image data D1 and the capability information I1.

Similar to the acquisition unit 110 in the image processing apparatus 100 according to the first embodiment, the acquisition unit 110B is, for example, an imaging device or an information terminal to which the first still image data D1 is wired or wirelessly connected to the image processing apparatus 100B. Or from a storage device or the like. Acquisition part 110B which acquires the 1st still picture data D1 may be realized by communication IF105 (refer to Drawing 14), for example.

The acquiring unit 110B may acquire, for example, the capability information I1 from the printing apparatus 200A wired or wirelessly connected to the image processing apparatus 100B. As in the first embodiment and the first modification, the capability information I1 acquired by the acquisition unit 110B may be paper information or a print result. The acquisition unit 110B that acquires the capability information I1 may be realized by, for example, the communication IF 105 (see FIG. 14).

The printing apparatus 200A includes an input IF 201 for the user to input a print instruction to the printing apparatus 200A. When the printing apparatus 200A receives a print instruction to the input IF 201 from the user, the printing apparatus 200A transmits the print instruction to the image processing apparatus 100B via a communication IF (not shown) included in the printing apparatus 200A. The input IF 201 is configured to include, for example, one or more of a touch panel, an input button, a display, and the like. The communication IF included in the printing apparatus 200A may be configured to be able to communicate with the image processing apparatus 100B, and may be, for example, the same configuration as the communication IF 105 (see FIG. 14).

Thus, the image processing apparatus 100B may obtain a print instruction including the capability information I1 via the printing apparatus 200A. In addition, the image processing apparatus 100B may acquire, from the printing apparatus 200A, the print result input to the printing apparatus 200A by the user.

(1-4-3. Modification 3)
Next, a third modification of the first embodiment will be described.

FIG. 21 is a block diagram schematically showing an example of a functional configuration of the image processing apparatus 100C in the third modification of the first embodiment.

The image processing apparatus 100C includes an acquisition unit 110C, a conversion unit 120C, and an output unit 130. The image processing apparatus 100C according to the third modification differs from the image processing apparatus 100B according to the second modification in that the capability information I2 different from the capability information I1 is acquired from the printing apparatus 200B. Further, the processing in the conversion unit 120C in the image processing apparatus 100C in the modification 3 is different from the processing in the conversion unit 120 in the modification 2. The other configuration in the image processing apparatus 100C is substantially the same as that of the image processing apparatus 100B in the second modification, and thus the detailed description is omitted.

The acquisition unit 110C acquires the first still image data D1 and the capability information I2.

Similar to the acquisition unit 110 in the image processing apparatus 100 according to the first embodiment, the acquisition unit 110C is, for example, an imaging device or an information terminal to which the first still image data D1 is wired or wirelessly connected to the image processing apparatus 100C. Or from a storage device or the like. The acquisition unit 110C that acquires the first still image data D1 may be realized by, for example, the communication IF 105 (see FIG. 14).

The acquisition unit 110C acquires the capability information I2 from the printing apparatus 200B wired or wirelessly connected to the image processing apparatus 100C. Specifically, the acquisition unit 110C is configured to scan a sheet used for printing by the printing apparatus 200B (for example, a sheet without printing before printing) as the capability information I2 by the scanner 202 of the printing apparatus 200B. To obtain a scan image obtained by The acquisition unit 110C is realized by, for example, the communication IF 105 (see FIG. 14).

The conversion unit 120C specifies the maximum luminance corresponding to the sheet scanned by the scanner 202, based on the luminance (reflection luminance) of the scan image acquired by the acquisition unit 110C. Then, the conversion unit 120C determines the second dynamic range based on the maximum luminance. That is, the conversion unit 120C converts the first still image data into the second still image data with the luminance range (dynamic range) in which the reflection luminance identified based on the capability information I2 is the maximum luminance as the second dynamic range. The conversion unit 120C is realized by, for example, the CPU 101, the main memory 102, the storage 103, and the like (see FIG. 14).

The converter 120C may change the conversion process according to the type of the scanner 202. For example, the conversion unit 120C may correct the luminance of the obtained image according to at least one of the brightness of the light source of the scanner 202 and the sensitivity of the image sensor of the scanner 202. For example, the conversion unit 120C may correct the luminance of the image such that the luminance of the obtained image decreases as the brightness of the light source of the scanner 202 increases. In addition, for example, the conversion unit 120C may correct the luminance of the image such that the luminance of the obtained image decreases as the sensitivity of the image sensor of the scanner 202 increases. In this case, the image processing apparatus 100C stores, in the storage 103, correction information in which information representing the type of the scanner 202 and information representing correction processing for correcting the luminance of the image are associated in advance. It is also good. Further, the image processing apparatus 100C acquires information representing the type of the scanner 202 from the printing apparatus 200B, identifies the correction processing corresponding to the acquired information representing the type of the scanner 202 from the correction information, and performs the identified correction processing. Thus, conversion processing according to the type of scanner 202 may be performed. In the present modification, the correction information may not be stored in the storage 103. The image processing apparatus 100C may acquire correction information from an external information processing apparatus via the communication IF 105 (see FIG. 14).

The printing apparatus 200 </ b> B includes a scanner 202. The printing apparatus 200B can obtain a scanned image by scanning the sheet used for printing with the printing apparatus 200B (for example, a sheet without printing before printing) with the scanner 202. The printing apparatus 200B transmits the obtained scan image as the capability information I2 to the image processing apparatus 100C via a communication IF (not shown) included in the printing apparatus 200B.

For example, the image processing apparatus 100C may include a display. Then, the image processing apparatus 100C may display a scan instruction on the display. This scan instruction is a message, an image, or a UI, etc. for prompting the user to scan a sheet used for printing by the printing apparatus 200B by the scanner 202 provided in the printing apparatus 200B connected to the image processing apparatus 100C. May be In this case, the image processing apparatus 100C may determine whether the printing apparatus 200B includes the scanner 202 by performing wired communication or wireless communication with the printing apparatus 200B connected to the image processing apparatus 100C. Further, the image processing apparatus 100C displays a scan instruction for prompting the user to scan the sheet on the display, and the printing apparatus 200B scans the sheet, and when the scanned image of the sheet is obtained by the scan, the printing apparatus The control for causing the image processing apparatus 100C to transmit the obtained scan image may be performed on 200B.

As described above, in the image processing apparatus according to this modification, the acquisition unit may acquire, as the capability information, a scanned image obtained by scanning a sheet used for printing by the printing apparatus. The conversion unit specifies the reflection luminance of the light reflected by the paper when the light is irradiated to the paper based on the luminance of the scan image acquired by the acquisition unit, and the specified reflection luminance is the maximum luminance. The first still image data may be converted into second still image data with the luminance range to be set as a second dynamic range.

The capability information I2 is an example of the capability information.

For example, in the example shown in the third modification, in the image processing apparatus 100C, the acquisition unit 110C acquires a scanned image obtained by scanning a sheet used for printing by the printing apparatus 200B as the capability information I2. The conversion unit 120C specifies the reflection luminance of the light reflected by the paper when the light is irradiated to the paper based on the luminance of the scan image acquired by the acquisition unit 110C, and specifies the specified reflection luminance. The first still image data D1 is converted into second still image data D2 as a second dynamic range, which is the luminance range to be the maximum luminance.

In the image processing apparatus 100C configured as described above, the scanner 202 scans a sheet used for printing by the printing apparatus 200B to acquire a scan image, and the second dynamic range is set according to the acquired scan image. It can be decided. Then, the image processing apparatus 100C converts the first still image data D1 into second still image data D2 defined by the second dynamic range, and outputs the second still image data D2 to the printing apparatus 200B. be able to. That is, the image processing apparatus 100C can easily estimate the expressive ability of the sheet used for printing by the printing apparatus 200B (that is, the luminance range with the luminance represented by the white of the sheet as the maximum luminance), and the expressive ability of the sheet The second dynamic range can be easily determined by setting the luminance range (dynamic range) suitable for the second dynamic range as the second dynamic range. Therefore, the image processing apparatus 100C can cause the printing apparatus 200B to print an image based on the first still image data D1 with high quality.

The image processing apparatus 100C may acquire the print result input to the printing apparatus 200B by the user from the printing apparatus 200B.

(1-4-4. Modification 4)
Next, a fourth modification of the embodiment will be described.

In the first embodiment (and the first to third modifications of the first embodiment), the image processing apparatus 100 (100A, 100B or 100C) is an independent apparatus separate from the printing apparatus 200 (200A or 200B). Although the configuration example has been described, the present disclosure is not limited to this configuration. For example, the printing apparatus 200 may be incorporated in the image processing apparatus 100 or the image processing apparatus 100A, the printing apparatus 200A may be incorporated in the image processing apparatus 100B, and the printing apparatus 200B is incorporated in the image processing apparatus 100C. It may be In this case, the communication IF 105 capable of communicating with the printing apparatus 200 (200A or 200B) may be omitted in the image processing apparatus 100 (100A, 100B or 100C).

(1-4-5. Modification 5)
Next, a fifth modification of the first embodiment will be described.

In the first embodiment and the first to fourth modifications, the configuration example in which the converting unit 120 (120C) performs the process of converting the first still image data D1 into the second still image data D2 has been described. It is not limited to this configuration.

When the maximum luminance of the first still image data D1 is smaller than the reflection luminance corresponding to the sheet (reflection luminance specified by the paper information or reflection luminance acquired from the scan image), the conversion unit 120 (120C) The conversion from the first still image data D1 to the second still image data D2 may not be performed.

In this case, the acquisition unit 110 (110A, 110B, or 110C) acquires the first still image data D1, and further has a third dynamic range whose luminance range (dynamic range) is narrower than the first dynamic range. The defined third still image data D3 is obtained (see FIG. 22). The third dynamic range is, for example, SDR (Standard Dynamic Range).

Note that the acquisition unit 110 (110A, 110B, or 110C) adds the third still image data D3 to the image processing apparatus 100 (100A, 100B, or 100C) as when acquiring the first still image data D1. It may be acquired from an imaging device, an information terminal, a storage device, or the like connected by wire or wirelessly. For example, an imaging device (for example, the HDR imaging device 10 illustrated in FIG. 9 or the like illustrated in FIG. 9) that captures an object and generates the first still image data D1 generates a third still with the first still image data D1 when capturing the object. If the image data D3 can also be generated, the acquisition unit 110 (110A, 110B, or 110C) can acquire the third still image data D3 from the imaging device.

Then, the output unit 130 outputs the third still image data D3 acquired by the acquisition unit 110 (110A, 110B or 110C) to the printing apparatus 200 (200A or 200B).

That is, in the image processing apparatus according to the fifth modification, the acquiring unit acquires the first still image data, and further, a third still defined by a third dynamic range whose luminance range is narrower than the first dynamic range. Image data may be acquired. When the maximum luminance of the first still image data is smaller than the reflection luminance corresponding to the sheet, the conversion unit does not convert the first still image data into the second still image data, and the output unit is acquired by the acquisition unit. The acquired third still image data may be output to the printing apparatus.

The third still image data D3 is an example of third still image data.

For example, in the example shown in the fifth modification, in the image processing apparatus 100 (100A, 100B, or 100C), the acquisition unit 110 (110A, 110B, or 110C) acquires the first still image data D1 and further And acquiring third still image data D3 defined in a third dynamic range whose luminance range is narrower than the first dynamic range. When the maximum luminance of the first still image data D1 is smaller than the reflection luminance corresponding to the sheet, the conversion unit 120 (120C) does not convert the first still image data D1 into the second still image data D2, The output unit 130 outputs the third still image data D3 acquired by the acquisition unit 110 (110A, 110B or 110C) to the printing apparatus 200 (200A or 200B).

The image processing apparatus 100 (100A, 100B, or 100C) configured in this way detects the third still image of SDR when the maximum brightness of the first still image data D1 of HDR is smaller than the reflection brightness corresponding to the sheet. The image data D3 can be output to the printing apparatus 200 (200A or 200B), and an image based on the third still image data D3 can be printed on the printing apparatus 200 (200A or 200B).

For example, the maximum luminance of the first still image data D1 is smaller than the reflection luminance corresponding to the sheet used for printing in the printing apparatus 200 (200A or 200B). Therefore, the first still image data D1 to the second still image Even when conversion processing to data D2 is performed, a high quality image may not be printed by the printing apparatus 200 (200A or 200B). In such a case, the image processing apparatus 100 (100A, 100B, or 100C) does not perform conversion processing from the first still image data D1 to the second still image data D2, and the third still image data D3 of SDR is processed. It outputs to the printing apparatus 200 (200A or 200B). Therefore, according to the configuration example shown in the fifth modification, in the image processing apparatus 100 (100A, 100B, or 100C), the load associated with the conversion process can be reduced.

(1-5. Summary)
FIG. 22 is a schematic diagram for describing an example of the image processing apparatus 100 (100A, 100B, or 100C) in the first embodiment (or the first to fifth modifications).

As illustrated in FIG. 22, the image processing apparatus 100 (100A, 100B, or 100C) acquires the first still image data D1 that is an HDR image, and outputs the first still image data D1 to the HDR display apparatus 30 as it is. Since the HDR display device 30 supports HDR, the first still image data D1 can be displayed with high quality.

The image processing apparatus 100 (100A, 100B, or 100C) obtains the first still image data D1 and the capability information I1 (I2) of the SDR printing apparatus 50. Then, the image processing apparatus 100 (100A, 100B, or 100C) converts the first still image data D1 into the second still image data D2 based on the acquired capability information I1 (I2), and converts the second still image data D1. The data D2 is output to the SDR printing apparatus 50. The SDR printing apparatus 50 can not print the first still image data D1 as it is. However, since the SDR printing apparatus 50 corresponds to the second still image data D2 converted from the first still image data D1 in the image processing apparatus 100 (100A, 100B, or 100C), the second still image data An image based on the second still image data D2 can be printed on a sheet using D2. Further, since the second still image data D2 is defined in a luminance range (dynamic range) wider than the third still image data D3 which is an SDR image, the second still image data D2 is higher in quality than the SDR image by the third still image data D3. Images can be printed on paper.

In addition, the image processing apparatus 100 (100A, 100B, or 100C) detects the first still image data D1 to the second still image when the maximum brightness of the first still image data D1 is smaller than the reflection brightness corresponding to the sheet. The third still image data D3 is output to the SDR printing apparatus 50 without conversion to the data D2. Since the SDR printing apparatus 50 corresponds to the third still image data D3 which is an SDR image, the image based on the third still image data D3 can be printed as it is.

(1-6. Example of communication protocol)
Next, with reference to FIGS. 23 to 26, examples (first to fourth examples) of the communication protocol in the present embodiment will be described. In the following description, the same reference numerals are given to constituent elements substantially the same as one another, and redundant description will be omitted.

FIG. 23 is a view schematically showing a first example of a communication protocol between the display device 400 and the printing device 500 in the embodiment.

The display device 400 is a device having an image display function or an image reproduction function such as, for example, a television set, a video recorder, a video player, or a digital camera. The printing apparatus 500 is an apparatus having a printing function such as a printer.

The communication protocol of the display device 400 includes a USB physical layer 440 as a physical layer, a PTP Transport layer 430 as a transport layer, a DPS layer 420 as a conversion layer, and a DPS application layer 410 as an application layer in order from the lower level. Is configured. The communication protocol of the printing apparatus 500 includes a USB physical layer 540 as a physical layer, a PTP Transport layer 530 as a transport layer, a DPS layer 520 as a conversion layer, and a DPS application layer 510 as an application layer in order from the lower level. Is configured. Although FIG. 23 shows a configuration example in which the USB

physical layers

440 and 540 are used as the physical layer, and the display device 400 and the printing device 500 are USB-connected, the display device 400 and the printing device 500 are used. May be connected by wireless communication (for example, Wi-Fi).

FIG. 23 illustrates a configuration example in which the Picture Transfer Protocol (PTP) defined as ISO 15740 is used in the transport layer. The conversion layer defines an I / F (InterFace) for the application layer, and converts input / output from the application layer into a PTP protocol. In the DPS layer, DPS Discovery exists to negotiate whether the display device 400 and the printing device 500 have mutually corresponding functions. The DPS Discovery 421 exists in the DPS Layer 420, and the DPS Discovery 521 exists in the DPS Layer 520.

In the case where the display device 400 and the printing device 500 are connected by USB, the connection of the USB cable to the display device 400 and the printing device 500 is taken as an opportunity to establish the interconnection in PTP. The printing apparatus 500 mutually confirms the connection partner by

DPS Discovery

421 and 521. After that, the display device 400 that holds the still image to be printed provides the file as the storage server 412 to the printing device 500 that is the storage client 511. The printing apparatus 500 receives a request from the display apparatus 400 to be the Print Client 411 as the Print Server 512. The Print Client 411 of the display device 400 inquires the Print Server 512 about the capability of the printer, and appropriately displays the result of the inquiry on a UI (User Interface) of the display device 400.

In addition, a list of still images is displayed on the display device 400, and the user selects a still image to be printed from among the displayed images, and the user issues a print instruction to the display device 400. In the case, the display device 400 requests the Print Server 512 to print the instructed still image. The printing apparatus 500 requests the storage server 412 of the display apparatus 400 as a storage client 511 for a file corresponding to a still image for which printing is instructed. In response to the request, the display device 400 notifies the printing device 500 of the held still image as a file.

FIG. 24 is a diagram schematically showing a second example of the communication protocol between the display device 400A and the printing device 500A in the embodiment.

Similarly to the first example, the display device 400A is a device having an image display function or an image reproduction function, such as a television set, a video recorder, a video player, or a digital camera. The printing apparatus 500A is an apparatus having a printing function, such as a printer, as in the first example.

The communication protocol of the display device 400A is configured to include a TCP / IP layer 440A, a UPnP layer 430A, a Control Middle layer 420A, and an application layer 410A in order from the lower side. The communication protocol of the printing apparatus 500A includes a TCP / IP layer 540A, a UPnP layer 530A, a Control Middle layer 520A, and an application layer 510A in order from the lower side.

The communication protocol of the display device 400A and the printing device 500A uses Wi-Fi as a physical layer (not shown), and employs TCP /

IP layers

440A and 540A as a transport layer thereon. The display device 400A and the printing device 500A use UPnP as a protocol for mutually discovering a connection partner on the TCP /

IP layers

440A and 540. After the display device 400A and the printing device 500A mutually recognize the connection partner by the function of the

UPnP layer

430A, 530A, the actual print data is obtained with the help of the

Control Middle layer

420A, 520A which performs control of the print job etc. , Between the display device 400A and the printing device 500A. The printer has its own print command for each model, and in a PC (Personal Computer), the driver can absorb the difference in the print command for each print. In the display device 400A such as a television set or a video recorder, unlike such a PC, it is difficult to take a mechanism of installing a driver. Therefore, the display device 400A may use a general-purpose printing description language.

An example of such a language is XHTML-print specified by W3C. In printing using XHTML-print, the display device 400A creates a print instruction based on the XHTML-print content 411A, and sends the created print instruction to the printing device 500A. In the printing apparatus 500A, based on the print instruction described in XHTML-print, the XHTML drawing processing unit 511A performs layout processing and rasterization processing of an image file or a text character string, and generates data to be actually printed. The print processing unit 512A prints the data thus obtained.

FIG. 25 is a diagram illustrating a third example of the communication protocol between the display device 400B and the printing device 500B in the embodiment.

The display device 400B is, for example, a device having an image display function or an image reproduction function such as a television set, a video recorder, a video player, or a digital camera, as in the first and second examples. The printing apparatus 500B is an apparatus having a printing function, such as a printer, as in the first and second examples. Note that the printing apparatus 500B is an apparatus that does not support HDR and does not support SDR only when printing the first still image data D1.

The communication protocol of the display device 400B is configured to include a Wi-Fi layer 440B, a PTP Transport layer 430, a DPS layer 420, and a DPS application layer 410B in order from the lower side. The communication protocol of the printing apparatus 500B is configured to include a Wi-Fi layer 540B, a PTP Transport layer 530, a DPS Layer 520, and a DPS application layer 510 in order from the lower side.

The communication protocol between the display apparatus 400B and the printing apparatus 500B shown in the third example is based on the communication protocol using PTP shown in the first example. The Print Client 411 of the display device 400B recognizes the function of the printing device 500B, which is the connection partner, through communication with the Print Server 512 of the printing device 500B.

For example, when the printing device 500B can handle only SDR still image data such as 8 bits JPG, the display device 400B can pass the HDR still image data held by the display device 400B as it is to the printing device 500B. Can not. In such a case, the display device 400B adjusts the HDR still image data held by the display device 400B with the grading module 413B in accordance with the function of the printing device 500B to generate an 8 bits JPG file. That is, the display device 400B creates an 8 bits JPG file from the HDR still image data in accordance with the function of the printing device 500B.

The display device 400B provides the 8 bits JPG file obtained from the HDR still image data to the printing device 500B as a response to the request from the Storage Client 511 of the printing device 500B. That is, the display device 400B shown in the third example is configured to include any of the

image processing devices

100 and 100A to 100C described in the first embodiment and the first to fifth modifications.

Although the above-mentioned example explained the composition which display device 400B creates the still picture data of 8 bits JPG file according to the function of printing device 500B, this indication is not limited to this composition. The display device 400B may create in advance an 8 bits JPG file corresponding to the HDR still image file. For example, in order to correspond to a printing apparatus that can receive only 8 bits JPG files, the digital camera may use an image obtained by imaging, first still image data D1 corresponding to HDR, and 8 bits JPG files (for example, It is desirable to generate in both formats of 3 still image data D3).

However, sRGB and BT. Unlike the display device 400B in which a standard display environment such as 709 is specified, in the printing device 500B, the print quality may differ depending on the type of paper and ink used for printing. Therefore, in some cases, it is better for the display device 400B to change the grading method when creating the 8 bits JPG file from the HDR still image file, in accordance with the settings and capabilities of the printing device 500B. Therefore, the display device 400B may create an 8 bits JPG file each time according to the settings and capabilities of the printing device 500B.

The printing apparatus 500B may be the printing apparatus 200 (200A or 200B).

FIG. 26 is a diagram schematically showing a fourth example of a communication protocol between the display device 400C and the printing device 500C in the embodiment.

In the fourth example, as in the third example, the display device 400C is a device having an image display function or an image reproduction function, such as a television set, a video recorder, a video player, or a digital camera. The printing apparatus 500C is an apparatus having a printing function such as a printer as in the third example, and when printing the first still image data D1, the printing apparatus 500C is not compatible with HDR and only compatible with SDR. Not a device.

The communication protocol of the display device 400C is configured to include a Wi-Fi layer 440B, a PTP Transport layer 430, a DPS Layer 420, and a DPS application layer 410 in order from the lower side. The communication protocol of the printing apparatus 500C is configured to include a Wi-Fi layer 540B, a PTP Transport layer 530, a DPS Layer 520, and a DPS application layer 510C in order from the lower side.

The communication protocol between the display apparatus 400C and the printing apparatus 500C shown in the fourth example is the processing performed by the grading module 413B of the display apparatus 400B in the third example, compared to the configuration shown in the third example. Is different from that performed by the grading module 513C of the printing apparatus 500C. That is, the printing apparatus 500C shown in the fourth example is configured to include any of the

image processing apparatuses

The Storage Server 412 of the display device 400C provides the HDR still image data as it is to the printing device 500C as a response to the request from the Storage Client 511 of the printing device 500C. In the printing device 500C, the grading module 513C appropriately grades and prints the received HDR still image data according to the type of paper and ink used in the printing device 500C, the setting regarding the printing quality, and the like.

The printing apparatus 500C may be the printing apparatus 200 (200A or 200B).

(Other embodiments)
As described above, Embodiment 1 and Modifications 1 to 5 have been described as examples of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to this, and can also be applied to embodiments in which changes, replacements, additions, omissions, and the like have been made. In addition, it is also possible to combine the constituent elements described in the first embodiment and the first to fifth modifications into a new embodiment.

Therefore, other embodiments will be exemplified below.

Although the absolute luminance value is used as the luminance information used in the first still image data D1, when the second still image data D2 is generated, the absolute luminance value is used instead. The luminance calculated from the STOP number of each part of the light and dark part of the photographed picture may be used. That is, the conversion unit 120 (120C) may convert the first still image data D1 into the second still image data D2 using relative luminance without using the absolute luminance of the first still image data D1.

In the embodiment, the printing capability has been described as the capability represented by the reflectance of a single sheet or the like. However, the printing capability may be an addition characteristic to which the printing characteristic of the printing apparatus is added. That is, the printability may also take into consideration the characteristics of the ink of the printing apparatus and the characteristics of the ejection of the ink. Then, the first dynamic range of the first still image data D1, the type of paper, the type and brightness of the light source, and the luminance range (dynamic range) that can be expressed by the characteristics of the ink are considered. One still picture data D1 may be converted into second still picture data D2.

Instead of the signal conversion process being performed by the conversion unit 120, the ink ejection amount of the printing apparatus may be controlled so as to obtain the same effect as the signal conversion process. That is, instead of generating the second still image data D2, the ink discharge amount of the printing apparatus may be controlled such that the printed product equivalent to the case where the second still image data D2 is printed is output by the printing apparatus. .

In the first embodiment and the first to fifth modifications, each component may be configured by dedicated hardware (for example, an electronic circuit including a semiconductor integrated circuit), or a software program suitable for each component may be used. It may be realized by execution by a processor. Each component may be realized by a program execution unit such as a central processing unit (CPU) or processor reading and executing a software program recorded in a recording medium such as a hard disk or a semiconductor memory.

Further, division of functional blocks in the block diagrams shown in the drawings in the respective embodiments is merely an example. For example, a plurality of functional blocks may be realized as one functional block, or one functional block may be divided into a plurality, or some functions may be transferred to another functional block. Also, the functions of multiple functional blocks may be processed in parallel by a single piece of hardware or software, or may be processed in time division. Also, some functions of the plurality of functional blocks may be realized by hardware, and the remaining functions may be realized by software.

Further, the order in which the steps in the flowchart illustrated in the embodiment are performed is merely an example, and the steps may be performed in an order different from the order described in the embodiment. Also, some of the above steps may be performed simultaneously with other steps (ie, in parallel).

Here, software for realizing the image processing method according to each of the above-described embodiments is the following program.

That is, this program acquires the first still image data obtained by imaging and having the luminance range defined by the first dynamic range in the computer, and acquires the acquired capability information indicating the printing capability of the printing apparatus. 1) Still image data converted into second still image data defined by a second dynamic range whose luminance range is narrower than the first dynamic range according to the printing capability indicated by the acquired capability information, 2. Execute an image processing method for outputting still image data to the printing apparatus.

The image processing method, a computer program that causes a computer to execute the image processing method, and a computer readable recording medium recording the program are included in the scope of the present disclosure. Here, as a computer readable recording medium, for example, a flexible disk, a hard disk, a CD-ROM, an MO, a DVD, a DVD, a DVD-ROM, a DVD-RAM, a BD (Blu-ray (registered trademark) Disc), a semiconductor memory, Etc. can be mentioned. The computer program is not limited to one recorded in the above recording medium, and may be transmitted via a telecommunication line, a wireless or wired communication line, a network such as the Internet, or the like.

Further, some or all of the components constituting each of the above-described devices may be configured from an IC card or a single module that can be attached to or detached from each device.

In addition, some or all of the components constituting each of the above-described devices may be configured by one LSI (Large Scale Integration).

Each processing unit is not limited to an LSI or an IC, and may be realized by a dedicated circuit or a general-purpose processor. Alternatively, it may be realized by an FPGA (field programmable gate array) capable of programming the circuit configuration, or a reconfigurable processor capable of reconfigurable connection and setting of circuit cells in the LSI.

Also, the above program may be recorded on a recording medium and distributed or distributed. For example, by installing the distributed program in the apparatus and causing the processor of the apparatus to execute the program, the apparatus can perform various processes.

In addition, the computer program or the digital signal in the present disclosure may be transmitted via a telecommunication line, a wireless or wired communication line, a network such as the Internet, data broadcasting, and the like.

In addition, the present disclosure may be implemented by another independent computer system by recording and transporting a program or digital signal on a recording medium, or by transporting a program or digital signal via a network or the like. It is also good.

Moreover, in the embodiment, each process (each function) may be realized by centralized processing by a single device (system), or realized by distributed processing by a plurality of devices. It is also good.

As described above, the embodiment has been described as an example of the technology in the present disclosure. For that purpose, the attached drawings and the detailed description are provided.

Therefore, among the components described in the attached drawings and the detailed description, not only components essential for solving the problem but also components not essential for solving the problem in order to exemplify the above-mentioned technology May also be included. Therefore, the fact that those non-essential components are described in the attached drawings and the detailed description should not immediately mean that those non-essential components are essential.

In addition, since the above-described embodiment is for illustrating the technique in the present disclosure, various modifications, replacements, additions, omissions, and the like can be made within the scope of the claims or the equivalents thereof.

The present disclosure is applicable to an image processing apparatus and an image processing method that can obtain still image data for printing high-quality printed matter. Specifically, a video display device such as a television set or display, a video reproduction device such as a video recorder or video player, an imaging device such as a digital camera or video camera, a terminal device such as a smartphone or tablet computer, printing such as a printer The present disclosure is applicable to an apparatus or a computer apparatus such as a PC or a server.

1, 2, 3, 4, 5, 6

pattern

10, 10A HDR imaging device 11 HDR imaging unit 12 conversion unit 13 JPEG compression unit 14 SDR imaging unit 15 HDR image correction unit 16 HEVC compression unit 20 SDR imaging device 21 SDR imaging unit 22 JPEG Compressing Unit 30 HDR Display Device 40 SDR Display Device 50

SDR Printing Device

100, 100A, 100B, 100C Image Processing Device 101 CPU
102 Main memory 103 Storage 104 Input IF
105 Communication IF
110, 110A, 110B,

110C acquisition unit

120, 120C conversion unit 130 output unit 150 test patterns 200, 200A, 200B printing apparatus 201 input IF
202 Scanner 300

Input device

400, 400A, 400B,

400C Display device

410, 410B, 510, 510C

DPS application layer

410A, 510A Application layer 411 Print Client
411A XHTML-print content 412 Storage Server
413B, 513C Grading Module
420,520 DPS Layer
420A, 520A

Control Middle layer

421, 521 DPS Discovery
430, 530

PTP Transport Layer

430A,

530A UPnP Layer

431A, 531A UPnP Discovery
440, 540 USB

physical layer

440A, 540A TCP /

IP layer

440B, 540B Wi-

Fi layer

500, 500A, 500B, 500C Printer 511 Storage Client
512 Print Server
511A XHTML drawing processing unit 512A Print processing unit D1 First still image data D2 Second still image data D3 Third still image data I1 and I2 Capability information P1 Paper

Claims

An acquisition unit configured to acquire first still image data obtained by imaging and having a luminance range defined by a first dynamic range, and capability information indicating the printing capability of the printing apparatus;
A second dynamic range whose luminance range is narrower than the first dynamic range according to the printing capability indicated by the capability information acquired by the acquiring unit; A converter for converting the second still image data defined by the range;
An output unit that outputs the second still image data converted by the conversion unit to the printing apparatus;
Image processing device.
The acquisition unit acquires paper information indicating a type of paper used for printing by the printing apparatus as the capability information,
The conversion unit is
The sheet of paper indicated by the paper information acquired by the acquisition unit by referring to the relationship between the types of paper and the reflection luminance of the light reflected by the paper when the paper is irradiated with light. Identify the reflected luminance corresponding to the type;
The first still image data is converted into the second still image data, with the luminance range in which the identified reflection luminance is the maximum luminance as the second dynamic range.
The image processing apparatus according to claim 1.
The acquisition unit acquires, as the capability information, a scanned image obtained by scanning a sheet used for printing by the printing apparatus.
The conversion unit is
Identifying the reflection luminance of the light reflected by the sheet when the sheet is irradiated with light, based on the luminance of the scan image acquired by the acquisition unit;
The first still image data is converted into the second still image data, with the luminance range in which the identified reflection luminance is the maximum luminance as the second dynamic range.
The image processing apparatus according to claim 1.
The acquisition unit acquires, as the capability information, a print result obtained by the printing apparatus printing a specific pattern on a sheet used for printing by the printing apparatus.
The conversion unit converts, as the second dynamic range, the first still image data into the second still image data, using the luminance range determined according to the print result acquired by the acquisition unit.
The image processing apparatus according to claim 1.
The acquisition unit acquires the first still image data, and further acquires third still image data defined in a third dynamic range whose luminance range is narrower than the first dynamic range.
When the maximum luminance of the first still image data is smaller than the reflection luminance corresponding to the sheet, the conversion unit does not convert the first still image data to the second still image data, and the output is performed. The unit outputs the third still image data acquired by the acquisition unit to the printing apparatus.
The image processing apparatus according to any one of claims 2 to 4.
The first dynamic range is HDR (High Dynamic Range),
The image processing apparatus according to any one of claims 1 to 5.
The image processing apparatus further includes the printing apparatus.
The image processing apparatus according to any one of claims 1 to 6.
Acquiring first still image data obtained by imaging and having a luminance range defined by a first dynamic range;
Obtain capability information that indicates the printing capability of the printing device,
Second still image data defined in a second dynamic range whose luminance range is narrower than the first dynamic range in accordance with the print capability indicated by the acquired capability information indicating the acquired first still image data Convert to
Outputting the converted second still image data to the printing device;
Image processing method.
A program for causing a computer to execute the image processing method according to claim 8.