JP2020086395A - Imaging apparatus, control method and program for the same - Google Patents

Abstract

To provide an imaging apparatus that prevents a viewer from having visual stimulation when multiple images are switched each other and does not take long time for switching the images.SOLUTION: An imaging apparatus 100 capable of taking an image in an SDR format and an HDR format includes a converter 107 to convert an image in the HDR format to an image in the SDR format, a storage to store the image taken in the SDR format, the image taken in the HDR format and the converted image in the SDR format through the converter 107, and a display controller 110 to show the image taken in the SDR format and the image taken in the HDR format on a display 111. When showing multiple images sequentially on the display 111, the display controller 110 shows not the image taken in the HDR format but the corresponding converted image in the SDR format through the converter 107 on the display 111.SELECTED DRAWING: Figure 1

Description

The present invention relates to an image pickup apparatus, a method for controlling the image pickup apparatus, and a program, and more particularly to an image pickup apparatus capable of shooting in SDR format and HDR format.

In recent years, a high dynamic range video signal (HDR format image) capable of expressing a luminance in a significantly wider range than a standard dynamic range video signal (SDR format image, hereinafter referred to as SDR image) that has been conventionally used. , Hereinafter referred to as HDR image). The HDR image has a maximum luminance of 10000 nits as compared with 100 nits of the SDR image, and has a wide dynamic range, which enables bright expression. In addition, SMPTE ST. A standardized PQ curve is adopted as 2084, and more gradations are allocated to the dark part than to the light part based on human perception characteristics, so that the color depth can be suppressed to 10 bits and the dark part to the bright part can be suppressed. Achieves smooth gradation. Note that SDR is an abbreviation for Standard Dynamic Range, HDR is an abbreviation for High Dynamic Range, and PQ is an abbreviation for Perceptual Quantizer.

On the other hand, an image display method called a slide show is known in which a plurality of images are sequentially switched and continuously displayed.

Japanese Patent Application Laid-Open No. 2004-242242 describes that, in an image display method in which a special effect is applied when images are switched in a slide show, a crossfade effect is added when the images are switched.

JP, 2011-33943, A

When switching is performed for two images having greatly different visual characteristic values such as brightness and hue, the viewer may feel a visual stimulus when the images are switched. When the HDR image and the SDR image are mixed, the brightness difference is large, and the viewer may feel a visual stimulus. Further, the image display method described in Patent Document 1 has a problem that it takes time until the next video is displayed when the image is switched. Therefore, continuous switching display of a plurality of images cannot be performed lightly.

The present invention has been made in view of the above problems, and an object of the present invention is to provide an imaging device that suppresses a viewer from feeling a visual stimulus when switching between a plurality of images, and that does not take a long time for image switching display. To do.

In order to achieve the object, an imaging device according to one aspect of the present invention is an imaging device capable of shooting in an SDR format and an HDR format, and converts an image captured in the HDR format into an image in the SDR format. A conversion unit, a storage unit that stores the image captured in the SDR format, the image captured in the HDR format, and the image in the SDR format converted by the conversion unit, and the image captured in the SDR format And a display control unit for displaying an image captured in the HDR format on a display unit, and the display control unit, when displaying a plurality of images in order on the display unit, is captured in the HDR format. Instead of the image, the image in the SDR format converted by the conversion unit corresponding to the image is displayed on the display unit.

According to the present invention, it is possible to provide an imaging device that suppresses a viewer from feeling a visual stimulus when switching between a plurality of images, and that does not take a long time for image switching display.

Other aspects of the present invention will be clarified in the embodiments described below.

3 is a block diagram of the image pickup apparatus of Embodiment 1. FIG. 3 is an image transition diagram of Example 1. FIG. 3 is a flowchart of a control method of the first embodiment. 6 is a block diagram of an image pickup apparatus of Example 2. FIG. FIG. 7 is an image transition diagram of the second embodiment. 6 is a flowchart of a control method of Example 2.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Hereinafter, description will be given with reference to FIGS. However, the following embodiments are merely examples, and the present invention is not limited to the following embodiments. 1 is a block diagram showing a configuration of an image pickup apparatus 100 according to a first embodiment of the present invention.

The image capturing apparatus 100 is an image capturing apparatus capable of acquiring images in SDR format (SDR mode) and HDR format (HDR mode). That is, the imaging apparatus 100 has not only the SDR mode for shooting a normal still image or a moving image (SDR image) but also an HDR shooting mode for shooting an HDR still image or an HDR moving image (HDR image). Further, the imaging device 100 can reproduce and display the captured SDR image or HDR image.

In the block diagram shown in FIG. 1, the lens unit 101 constitutes an optical system for forming a subject image on the image pickup surface of the image pickup device 102, and has a zoom function, a focus adjustment function, and an aperture adjustment function.

The image sensor 102 has a configuration in which a large number of photoelectric conversion elements are arranged, and converts the subject optical image formed by the lens unit 101 into a video signal in pixel units. The image sensor 102 may be, for example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charged Coupled Device) image sensor.

In the image pickup processing unit 103, after the scratches and the like caused by the image pickup element 102 are corrected, image processing is performed on an image to be recorded/displayed. Further, it has a function of generating an HDR image or an SDR image from a video signal from the image sensor 102.

The operation unit 104 allows a user to input various instructions such as image reproduction and display execution to the image display apparatus 100. The operation unit 104 provides a user interface for operating the imaging device 100. The operation unit 104 includes various buttons such as a power button, a menu button, and a shooting button, and the various buttons include switches, a touch panel, and the like.

The CPU 105 centrally controls each block constituting the image pickup apparatus 100, and includes a microcomputer and the like inside. Further, the CPU 105 controls the imaging device 100 according to a user instruction input via the operation unit 104. Note that, here, the case where the CPU 105 controls the image pickup apparatus 100 based on an operation input through the operation unit 104 has been described as an example, but the present invention is not limited to this. For example, the CPU 105 may control the image capturing apparatus 100 based on a request input from a remote controller (not shown), a mobile terminal (not shown), or the like via the communication unit of the image capturing apparatus 100. The CPU 105 also executes a computer program stored in a non-volatile memory (not shown) to control the operation of each unit (each functional block) of the imaging device 100 via the internal bus.

The storage unit 106 stores the image data from the image processing unit 103 in a recording medium (not shown) such as an SD card.

When the image data stored in the storage unit 106 is an HDR image, the SDR conversion unit 107 generates an SDR image from the stored HDR image and stores the SDR image separately from the HDR image. Remember.

The reading unit 108 reads the image data from the storage unit 106 and outputs it to the subsequent stage. The image data to be read is specified by the user through the operation unit 104.

The case of a slide show will be described with reference to FIG. In the case of a normal slide show, starting from the image 201 designated by the user through the operation unit 104, the image data stored thereafter is read out in the order of 202, 203, 204 at regular time intervals. Here, when the read image data includes HDR images 202 and 204, the SDR images 202 ′ and 204 ′ corresponding to the HDR images generated by the SDR conversion unit 107 are read.

The switching unit 109 selects and selects, based on a signal from the CPU 105, a path that is an output of the imaging processing unit 103, in which the image of the subject can be confirmed in real time at the time of shooting and a path for playing the image stored in the storage unit 106. The other image signal is output to the subsequent stage. In the case of a slide show, the switching unit 109 selects a path for reproducing the image stored in the storage unit 106.

The image processing unit 110 has a resizing function, a panel gamma adjustment function, and the like for converting into optimum image data to be displayed on the display unit 111. The image processing unit 110 also functions as a display control unit that controls the display unit 111.

The display unit 111 is a display, and is, for example, an EVF (electric view finder) or a liquid crystal monitor. In this embodiment, a display built in the image pickup apparatus 100 is illustrated, but an external display connected to the image pickup apparatus 100 by a cable or a network may be used as the display unit.

Only SDR images are displayed on the display unit 111, such as 201, 202', 203, and 204'. As a result, a situation in which HDR and SDR images are alternately displayed does not occur. Also, the transition time for switching to the HDR or SDR image is the same as in the case of the normal slide show.

The order of the image data to be read may be the file name of the image data, the information of the stored date and time, or the order specified by the user.

Next, with reference to FIG. 3, a flow of a control method of the imaging device 100 according to the present embodiment will be described. It is assumed that an SDR image has already been generated in the storage unit 106 by the SDR conversion unit 107 for the HDR captured image. Further, this control method is executed by the CPU 105 controlling each unit.

First, in s301, when an instruction to execute a slide show is given from the operation unit 104 by the user, the process proceeds to s302, and the image data is read from the storage unit 106. The type of whether the image data read in s303 is an HDR image or an SDR image is acquired. In s304, it is determined whether the image data is an HDR image or an SDR image. In the case of the HDR image, the process proceeds to s305, and the HDR images 202 and 204 are read out, and the SDR images 202' and 204' generated by the SDR conversion unit 107 are read out. As a result, the display unit 111 displays images such as 201, 202', 203, and 204'.

After these processes are finished, it is judged in s307 whether or not the slide show is finished, and if it is not finished, the process returns to s302 to repeatedly process the next image data. If it is finished, it is finished at s308.

As described above, in the present embodiment, even when the HDR and SDR images are displayed alternately, when the HDR image is displayed, the HDR image is replaced with the SDR image generated in advance and displayed. Therefore, according to the image pickup apparatus of the present embodiment, it is possible to prevent the viewer from feeling a visual stimulus at the time of image switching, and to prevent the image switching display from taking a long time.

In this embodiment, a method of suppressing visual stimulus at the time of image switching by replacing the HDR image with an SDR image generated in advance and displaying it, that is, by unifying the slide show with the SDR image has been described. However, the visual stimulus at the time of image switching may be suppressed by replacing the SDR image with an HDR image generated in advance and displaying it, that is, by unifying the slide show with the HDR image.

In the first embodiment, the case where the HDR image and the SDR image are alternately displayed on the display unit 111 has been described, but in the present embodiment, the case where the HDR images to be displayed are continuous (here, three times) will be described. In addition, it is assumed that an SDR image has already been generated in the storage unit 106 by the SDR conversion unit 107 for the HDR captured image.

In the block diagram of the present embodiment, as shown in FIG. 4, a brightness control unit 401 attached to the display unit 111 is added from the first embodiment. In addition, the CPU 105 is provided with a function of counting the number of continuously displayed HDR images during the slide show.

The slide show image transition of this embodiment will be described with reference to FIG. HDR images captured by the image capturing apparatus 400 are 501, 502, and 503, and at the same time as the capturing, the SDR conversion unit 107 generates SDR images 511, 512, and 513, and together with the HDR images 501, 502, and 503, the storage unit 106. Save to. When the HDR images displayed in the slide show are consecutive three times in the order of 501, 502, and 503, the 501 and 502 respectively read the SDR images 511 and 512 generated by the SDR conversion unit 107 from the storage unit 106. In addition, the brightness control unit 401 performs brightness control such that the brightness distributions 521 and 522 are gradually increased, and images are displayed as images 511' and 512' on the display unit 111. That is, the image 512 ′ is a simple display in which the SDR image 512 is set brighter than the brightness required for the original SDR display. For the third image, the captured HDR image 503 is read from the storage unit 106, and the brightness control unit 401 sets the original HDR brightness as the brightness distribution 523, and the original HDR image 503' is displayed.

Next, with reference to FIG. 6, a flow of a control method of the imaging device 400 according to the present embodiment will be described. This control method is executed by the CPU 105 controlling each unit.

First, in the processing of s601, the initialization processing of the counting function of the number of continuously displayed HDR images is performed (n=0). Next, in s301, when the execution of the slide show is instructed by the operation of the operation unit 104, the process proceeds to s302, and the image data is read from the storage unit 106. The type of whether the image data read in s303 is an HDR image or an SDR image is acquired.

Next, the brightness control unit 401 is controlled from s602 to s606. When n=0 in s602, the process proceeds to s603, and the luminance a (luminance distribution 521) for displaying the SDR image is set. If not n=0, the process proceeds to s604. In s604, when n=1, a luminance intermediate between the luminance b (luminance distribution 523) required for HDR display and the luminance a (luminance distribution 521) required for SDR display, for example, (a+b)/2 (luminance distribution 522). To set. If not n=1, that is, if n≧2, the process proceeds to s606. In s606, the luminance b (luminance distribution 523) when displaying the HDR image is set.

Next, in s304, it is determined whether the image data is an HDR image or an SDR image. If the image is an HDR image, the flow advances to s607 to check the n value. If n≧2, the process proceeds to s608, and the HDR image 503 that is the captured image is read as it is. If n≧2 is not satisfied, the process proceeds to s305, and the images 501 and 502 are read out as SDR images 511 and 512 respectively generated by the SDR conversion unit 107. By adding the control by the brightness control unit 401 to this, the display unit 111 gradually becomes brighter in the order of the images 511′ and 512′, and the third image 503′ displays the original HDR display. Becomes

After that, the process shifts to s609, and the count value n=n+1 is executed in order to count the number of continuously displayed HDR images.

If the image is not the HDR image in s304, the process proceeds to s306, the SDR image that is the captured image is read as it is, then proceeds to s610, and the count value is initialized (n=0). Here, when the count value n is initialized in s610, the display brightness of s603 is selected at the time of the next image display, and the display brightness is switched to that corresponding to the immediate SDR display. This is because the HDR image to the SDR image, that is, the sudden transition from bright to dark causes the viewer to feel less visual stimulus.

In s307, it is determined whether or not the slide show is finished. If it is not finished, the process returns to s302 to repeatedly process the next image data. If it is finished, the process is finished at s307.

As described above, when the HDR images are continuously displayed, the display image is gradually brightened, and the HDR image is finally displayed. As a result, it is possible to provide an opportunity to display the original HDR image while suppressing the viewer from feeling a visual stimulus.

Also in this embodiment, instead of unifying the slide show with the SDR image, the slide show may be unified with the HDR image. That is, the SDR image may be displayed after displaying a predetermined number of HDR images, or the brightness may be gradually lowered when displaying the predetermined number of HDR images.

[Other Examples]
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. It can also be realized by the processing. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes can be made within the scope of the gist thereof.

100 image pickup device 106 storage unit 107 SDR conversion unit (conversion unit)
110 Image processing unit (display control unit)
111 display

Claims (8)

An imaging device capable of shooting in SDR format and HDR format,
A conversion unit for converting an image captured in the HDR format into an image in the SDR format;
A storage unit that stores the image captured in the SDR format, the image captured in the HDR format, and the image in the SDR format converted by the conversion unit;
A display control unit configured to display an image shot in the SDR format and an image shot in the HDR format on a display unit,
When the display control unit sequentially displays a plurality of images on the display unit, the display unit displays the SDR format image converted by the conversion unit corresponding to the image instead of the image captured in the HDR format. An imaging device characterized by displaying on a display unit. When continuously displaying a plurality of images corresponding to the image captured in the HDR format, the display control unit converts the image captured in the HDR format in the conversion unit corresponding to the image instead of the image captured in the HDR format. The image pickup apparatus according to claim 1, wherein the image captured in the HDR format is displayed on the display unit after the image in the SDR format is displayed. The display control unit displays a predetermined number of images in the SDR format converted by the conversion unit, and then displays the image captured in the HDR format on the display unit. The imaging device according to. The image pickup apparatus according to claim 3, wherein the display control unit gradually raises the brightness when displaying the image in the SDR format converted by the predetermined number of the conversion units. An imaging device capable of shooting in SDR format and HDR format,
A conversion unit for converting an image shot in the SDR format into an image in the HDR format;
A storage unit that stores the image captured in the SDR format, the image captured in the HDR format, and the HDR format image converted by the conversion unit;
A display control unit configured to display an image shot in the SDR format and an image shot in the HDR format on a display unit,
When the display control unit sequentially displays a plurality of images on the display unit, the display unit displays the HDR format image converted by the conversion unit corresponding to the image instead of the image captured in the SDR format. An imaging device characterized by displaying on a display unit. A method for controlling an imaging device capable of shooting in SDR format and HDR format,
Converting an image taken in the HDR format into an image in the SDR format;
Storing an image captured in the SDR format, an image captured in the HDR format, and an image in the SDR format converted by the conversion unit,
A step of displaying an image captured in the SDR format and an image captured in the HDR format on a display unit,
In the step of displaying on the display unit, when a plurality of images are sequentially displayed on the display unit, instead of the image captured in the HDR format, the SDR format converted by the conversion unit corresponding to the image is displayed. A control method comprising displaying an image on the display unit. A method for controlling an imaging device capable of shooting in SDR format and HDR format,
Converting an image taken in the SDR format into an image in the HDR format;
Storing an image captured in the SDR format, an image captured in the HDR format, and the HDR format image converted by the conversion unit,
A step of displaying an image captured in the SDR format and an image captured in the HDR format on a display unit,
In the step of displaying on the display unit, when a plurality of images are sequentially displayed on the display unit, instead of the image captured in the SDR format, the HDR format converted by the conversion unit corresponding to the image is displayed. A control method comprising displaying an image on the display unit. A program for causing a computer to execute each step of the control method according to claim 6.

Images