JP2014225786A - Imaging device, control method therefor, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device, a control method therefor, and a program that are capable of obtaining image data in accordance with lens characteristics and sensor characteristics of another imaging device.SOLUTION: An imaging device 100 acquires emulation information for determining a photographing condition and converting image data, performs photographing under a photographing condition determined by the acquired emulation information, and converts image data obtained by the photographing using the emulation information.

Description

  The present invention relates to an imaging apparatus, a control method thereof, and a program.

  In recent years, digital cameras and digital video cameras have become widespread in the television and movie industries. At the production site of television and movies, before the actual filming, the staff performs a location hunting (hereinafter referred to as “provisional shooting”) to search for the location and search for the best angle in advance. It is regarded as important because it greatly affects the degree of completion.

  These provisional shootings are required to shoot under the same shooting conditions as the actual shooting as much as possible. However, it is difficult to make all the shooting conditions the same for the temporary shooting and the actual shooting, and the work load for preparing shooting equipment such as cameras and monitors equivalent to that for the actual shooting is also large. It has become a challenge.

  Therefore, in recent years, a method for correcting image data according to virtually any camera characteristic has been proposed.

  As an example thereof, an interchangeable lens type digital camera, a virtual captured image generation method, and a virtual captured image display method that can display a virtual captured image by an interchangeable lens that is not attached are disclosed (for example, see Patent Document 1). .

  In this Patent Document 1, it is introduced that it is a merit that a user can experience an image when taking a picture with a lens that is not attached without preparing and exchanging the lens. The proposed camera may be used for temporary shooting.

JP 2009-253372 A

  However, the camera proposed in Patent Document 1 can save the trouble of exchanging the interchangeable lens, but does not take into account the difference in the image pickup device of the camera body, and is the same camera as in the actual shooting. There is a problem that it is necessary to prepare and shoot.

  An object of the present invention is to provide an imaging apparatus capable of obtaining image data in accordance with lens characteristics and sensor characteristics of another imaging apparatus, a control method therefor, and a program.

  In order to achieve the above object, the imaging apparatus according to claim 1 is configured so that image data obtained by imaging with the imaging apparatus is image data that matches characteristics of a lens and an imaging element of another imaging apparatus. By acquisition means for acquiring emulation information for determining imaging conditions and converting image data, imaging means for imaging under imaging conditions determined by the emulation information acquired by the acquisition means, and by the imaging means Conversion means for converting image data obtained by photographing using the emulation information is provided.

  According to the present invention, determination of shooting conditions and emulation information for converting image data are acquired, shooting is performed under shooting conditions determined by the acquired emulation information, and image data obtained by shooting is acquired. Since the conversion is performed using the emulation information, it is possible to provide an imaging apparatus capable of obtaining image data in accordance with the lens characteristics and sensor characteristics of other imaging apparatuses, a control method therefor, and a program.

It is a figure for demonstrating the outline | summary at the time of provisional photography and real photography. It is a figure which shows schematic structure of the digital camera as an imaging device which concerns on this Embodiment. It is a figure which shows the real camera information, the real lens information, temporary camera information, and temporary lens information which are memorize | stored in the non-volatile memory in FIG. FIG. 4A is a diagram showing emulation information stored in the nonvolatile memory in FIG. 2, and FIG. 4B is a diagram for explaining color space conversion processing. It is a flowchart which shows the procedure of the whole emulation process performed by the system control part in FIG. It is a figure for demonstrating the HDR synthetic | combination performed when the emulation information regarding a dynamic range is acquired. It is a flowchart which shows the procedure of the emulation process (sensor) performed by the system control part in FIG. FIG. 8A is a diagram showing emulation information stored in the nonvolatile memory in FIG. 2, and FIGS. 8B and 8C are diagrams for explaining the color emulation processing. It is a flowchart which shows the procedure of the emulation process (color tone) performed by the system control part in FIG. It is a flowchart which shows the procedure of the multiple emulation presentation process performed by the system control part in FIG. It is a figure which shows the example of a user interface displayed on the display part in FIG.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram for explaining the outline at the time of provisional shooting and at the time of actual shooting.

  FIG. 1A shows an outline of provisional shooting when a compact camera is used as an example of the imaging apparatus according to this embodiment.

  FIG. 1B shows an outline at the time of actual shooting when a professional video camera is used.

  In FIG. 1A, the compact camera acquires emulation information, takes a picture with the emulation information, generates converted image data, and outputs it as a file.

  On the other hand, during actual shooting, shooting is performed using an imaging device such as a commercial digital video camera, and desired color data is generated by a color grading device and output as a file.

  FIG. 2 is a diagram illustrating a schematic configuration of a digital camera 100 as an imaging apparatus according to the present embodiment.

  In FIG. 2, the lens group 101 includes a zoom lens and a focus lens. The shutter 102 has an aperture function.

  The imaging unit 103 is an imaging element such as a CCD or CMOS element that converts an optical image into an electrical signal. The A / D converter 104 converts the analog signal output from the imaging unit 103 into a digital signal and outputs the digital signal to the memory control unit 107 and the image processing unit 105.

  The image processing unit 105 performs various image processing on the image data output from the A / D converter 104.

  For example, the image processing unit 105 performs predetermined calculation processing on the captured image data, and performs exposure control and distance measurement control in the system control unit 50 based on the obtained calculation result.

  As a result, the image processing unit 105 performs TTL (through the lens) AF (autofocus) processing, AE (automatic exposure) processing, and EF (flash pre-emission) processing. Further, the image processing unit 105 performs predetermined calculation processing on the captured image data, and also performs TTL AWB (auto white balance) processing based on the obtained calculation result.

  The image data output from the A / D converter 104 is stored in the memory 106 via the image processing unit 105 and the memory control unit 107 or via the memory control unit 107.

  The memory 106 also has a video memory, and stores image data to be displayed on the display unit 109 in addition to image data captured by the imaging unit 103. The memory 106 has a sufficient storage capacity for storing a predetermined number of still images, a moving image and sound for a predetermined time.

  The D / A converter 108 converts image data to be displayed on the display unit 109 stored in the memory 106 into an analog signal and outputs the analog signal to the display unit 109. Thus, the display image data stored in the memory 106 is displayed on the display unit 109 via the D / A converter 108.

  The display unit 109 displays an image on a display device such as an LCD according to the analog signal from the D / A converter 108. The operation unit 115 is used for a user to input various operation instructions.

  An interface 110 is an interface with the recording medium 111. The recording medium 111 is a memory card or a hard disk.

  The system control unit 50 controls the entire system of the digital camera 100. The system control unit 50 executes a program stored in the non-volatile memory 114, thereby executing processing shown in a flowchart described later.

  The system timer 112 measures the time used for various controls and the time of a built-in clock. In the system memory 113, constants and variables for operation of the system control unit 50, a program read from the nonvolatile memory 114 described later, and the like are expanded.

  The nonvolatile memory 114 serving as a storage unit can be electrically erased or stored, and for example, an EEPROM or the like is used. The nonvolatile memory 114 stores constants, programs, and the like for operating the system control unit 50.

  FIG. 3 is a diagram illustrating the real camera information 401, the real lens information 402, the temporary camera information 403, and the temporary lens information 404 stored in the nonvolatile memory 114 in FIG.

  In FIG. 3, the production camera information 401 and the temporary camera information 403 include information such as model name information, moving image format information, still image format information, sensor information, exposure information, dynamic range information, and pixel number information. include.

  On the other hand, both the actual lens information 402 and the provisional lens information 404 include information such as the lens name, lens type, lens configuration, focal length, shortest shooting distance, zoom ratio, and color.

  The real camera information 401, the real lens information 402, the temporary camera information 403, and the temporary lens information 404 described above are stored in the nonvolatile memory 114 as a table of emulation information.

  4A is a diagram showing the emulation information 501 stored in the nonvolatile memory 114 in FIG. 2, and FIG. 4B is a diagram for explaining the color space conversion processing.

  The emulation information 501 shown in FIG. 4A shows emulation information related to the dynamic range as an example. The camera model name, the dynamic range, the emulation information A and B, etc. at the time of actual shooting and temporary shooting are shown. Contains information.

  In FIG. 4A, it is shown that the dynamic range of the temporary camera is 10 eV with respect to the dynamic range of 12 eV of the production camera, and the emulation information A includes two images taken with exposure of ± 1 step. It shows that HDR synthesis is performed.

FIG. 4B shows, as an example, ITU-R BT. The contents of converting RGB values of image data in the color space RGB ₇₀₉ defined by 709 and SRGB into the XYZ color space and converting from the XYZ color space to the RGB value of the ACES color space RGB _ACES are shown.

  The ACES (Academy Color Encording Specification) color space was proposed by the American Academy of Motion Picture Arts and Science (AMPAS) and standardized in SMPTE. .

RGB values (R ₇₀₉ , G ₇₀₉ , B ₇₀₉ ) of the image data in the color space RGB ₇₀₉ are _converted into RGB values (R _ACES , G _ACES , B _ACES ) of the image data in the color space RGB _ACES using the matrix M _{709 → ACES.} Convert to

  FIG. 5 is a flowchart showing a procedure of the entire emulation process executed by the system control unit 50 in FIG.

  In FIG. 5, emulation information regarding the lens, sensor, and color space described in FIGS. 3 and 4 is acquired (step S301). This step S301 is for determining imaging conditions and converting the image data so that the image data obtained by imaging with the imaging device is image data that matches the characteristics of the lenses and imaging elements of the other imaging devices. This corresponds to an acquisition means for acquiring the emulation information.

  Next, shooting conditions are determined based on the acquired lens and sensor emulation information, shooting is performed under the determined shooting conditions, and image data obtained by shooting is converted by the image processing unit 105 (step S302).

  Then, the color space conversion processing described in FIG. 4B is performed using the emulation information regarding the color space. Steps S302 and 303 correspond to conversion means for converting image data obtained by photographing using emulation information.

  Next, the image data is converted using image adjustment parameters other than the emulation information (step S304). The image adjustment parameter indicates, for example, an image adjustment parameter for finely adjusting the color tone of the entire image so as to obtain a director's desired image. Assume that the image adjustment parameter file is stored in advance in the nonvolatile memory 114 or the recording medium 111. Note that this step is omitted when image adjustment using image adjustment parameters other than emulation information is unnecessary.

  Then, the image data converted in the above steps S302 to 304 is stored in the memory 106 (step S305), the stored image data is displayed on the display unit 109 (step S306), and this process ends.

  Note that when storing the image data in step S305, the emulation information acquired in step S301, the image data obtained by shooting in step S302, the image data after conversion in step S302, and in step S303. Each of the converted image data and the image adjustment parameter file used in step S304 may be stored as necessary. Further, information indicating the mutual relationship between the image data may be stored. That is, the image data obtained by photographing may be stored in the storage unit, and the converted image data may be stored in the storage unit every time conversion is performed using the emulation information.

  This makes it possible to easily extract the image data of each processing process, and easily convert the image data even when it is necessary to change the emulation information or image adjustment parameters later. It becomes possible.

  FIG. 6 is a diagram for explaining HDR synthesis performed when emulation information regarding the dynamic range is acquired.

  In FIG. 6, the vertical direction indicates the width of the dynamic range of the image, and each arrow indicates the range of the dynamic range of the captured image data.

  FIG. 6A is a diagram for explaining HDR composition of two images obtained by photographing exposure with ± 1 step as shown in the emulation information A of FIG.

  In FIG. 6A, (1) the dynamic range of the production camera is 12 eV, and (2) the dynamic range of the temporary camera is 10 eV, so the dynamic range is not enough as much as 2 eV.

  Therefore, (3) HDR composite of an image shot with a temporary camera with +1 stage exposure and (4) an image shot with a temporary camera with -1 stage exposure is equivalent to 12 eV with the temporary camera. An image can be obtained.

  FIG. 6B is a diagram for explaining HDR composition of four images obtained by photographing the exposure with ± 1/2 steps shown in the emulation information B of FIG.

  In FIG. 6B, (1) the dynamic range of the temporary camera is 10 eV with respect to the dynamic range of 12 eV of the actual camera, so the dynamic range is not enough as much as 2 eV. In (3) to (6), an image equivalent to 12 eV can be obtained with the temporary camera by HDR synthesizing four images taken with the temporary camera in half-step exposure.

  An emulation process when performing the HDR synthesis described above will be described.

  FIG. 7 is a flowchart showing the procedure of the emulation process (sensor) executed by the system control unit 50 in FIG.

  7 is a process corresponding to steps S301 and S302 in FIG.

  In FIG. 7, the dynamic range emulation information of the sensor is acquired (step S701). Specifically, the camera model name, the dynamic range of each camera, and the emulations A and B at the time of actual shooting and temporary shooting described with reference to FIG. 4 are acquired.

  Next, shooting conditions of the digital camera 100 are set based on the dynamic range emulation information acquired in step S701 (step S702).

  For example, when the acquired emulation information is the emulation information A shown in FIG. 4, it is a shooting condition for shooting two images with an exposure of ± 1 step.

  Photographing is performed under the photographing conditions set in this manner (step S703), and it is determined whether there is another emulation (step S704).

  As a result of the determination in step S704, if there is nothing else to emulate (NO in step S704), this process ends. On the other hand, as a result of the determination in step S704, if there is another emulation (YES in step S704), the process returns to step S702. For example, when the emulations A and B are acquired, the processing for the emulation B is performed as another emulation after the processing for the emulation A is completed.

  As described above, the imaging apparatus 100 according to the present embodiment acquires sensors and color space emulation information of other imaging apparatuses, and sensors and color spaces of other imaging apparatuses based on the acquired emulation information. The image data matching the characteristics of the image data is generated and the data of each processing step is recorded and displayed.

  As a result, the user can virtually generate an image of another imaging device. For example, an image equivalent to the dynamic range of a large camera can be obtained with a small camera without preparing a large camera for use in actual shooting. Can be obtained.

  In the above description, the example of acquiring the dynamic range emulation information of the sensor has been described. However, the emulation information is not limited to the dynamic range.

  For example, it may be emulation information related to sensor type information, aspect ratio information, pixel size information, pixel number information, aperture ratio information, pixel pitch information, filter arrangement information, and the like.

  For example, when the emulation information of the sensor aspect ratio is acquired, the panoramic image is taken with a temporary camera in accordance with the aspect ratio of the sensor at the time of actual shooting to match the aspect ratio at the time of actual shooting.

  For example, when the aspect ratio at the time of actual shooting is 16: 9 and the aspect ratio at the time of temporary shooting is 3: 2, the ratio is set to 16: 9 by panoramic shooting or trimming.

  In addition, for example, when emulating information on the number of pixels of the sensor is acquired, the number of pixels of the sensor at the time of provisional shooting is smaller than the number of pixels of the sensor at the time of actual shooting, so there is a possibility that the entire image becomes blurred Therefore, edge enhancement processing is performed to match the image quality when shooting with the number of pixels of the sensor at the time of actual shooting.

  In the above embodiment, the digital camera has been described as an example, but the present invention is not limited to this. For example, a digital video camera can have a similar configuration.

  The number of emulation information may be one, or two or more. When there are a plurality of emulation information, the emulation processing time becomes long. Therefore, the user may set the emulation processing time in advance, and processing may be performed from the emulation information having a high priority in the processing time range.

  In the above embodiment, the emulation is performed based on the emulation information in the database recorded in the nonvolatile memory 114 or the recording medium 111 inside the digital camera 100. However, the present invention is not limited to this. The database may be external.

  In that case, the system control unit 50 determines whether or not there is emulation information corresponding to the combination of the camera at the time of actual shooting and the camera at the time of temporary shooting in an external database via a communication I / F (not shown). When there is a corresponding emulation information by searching, the emulation information is obtained.

  In the above embodiment, the emulation information, which is conversion information for adjusting to the characteristics of other cameras, has been described as being recorded in advance in the nonvolatile memory 114 or the recording medium 111. However, the present invention is not limited to this. Instead, the camera information such as the model name / file format shown in FIG. 4 and the lens information such as the model name / focal length are acquired, and the emulation information is stored in the digital camera 100 based on the acquired camera information / lens information. You may make it the structure produced | generated by.

  In addition, although the example which produces | generates the image data of a professional digital video camera virtually using a compact digital camera was demonstrated in FIG. 1, it is not restricted to this, A compact digital using a professional digital camera is demonstrated. Image data matching the characteristics of the camera may be generated.

  Next, a description will be given of a process of acquiring emulation information related to the color of the lens of another camera and generating image data matching the color of the lens of the other camera based on the acquired emulation information.

  FIG. 8A is a diagram showing the emulation information 901 stored in the nonvolatile memory 114 in FIG. 2, and FIGS. 8B and 8C are diagrams for explaining the color emulation processing. is there.

  Emulation information 901 in FIG. 8A indicates emulation information regarding the color of the lens. The color of the lens refers to the spectral transmission characteristics and RGB balance of the lens.

  In FIG. 8A, the emulation information 901 includes emulation information indicating the lens model name, lens color information, and RGB conversion coefficients at the time of actual shooting and provisional shooting.

The emulation information indicates a matrix L _{color_atoA} shown in FIG. Using this matrix L _{color_atoA} , the RGB values (R, G, B) are converted into (R ′, G ′, B ′), so that the lens color at the time of temporary shooting is changed to the color of the lens at the time of actual shooting. It comes to match the taste.

  FIG. 8C shows an XY chromaticity diagram. Points 1103, 1104, and 1105 are plotted on the XY chromaticity diagram of the pixel value RGB points of the image data captured by the temporary camera.

On the other hand, points 1106, 1107, and 1108 are obtained by plotting pixel values RGB of image data captured by the lens used in the production camera obtained by converting the points 1103, 1104, and 1105 with the matrix _{Lcolor_atoA} .

  In addition, although the example which used the matrix for emulation information was demonstrated, it is not restricted to this, The pixel value of the pixel value of the image data image | photographed with the temporary camera and the corresponding color of the lens of the production camera The correspondence table may be emulation information.

  FIG. 9 is a flowchart showing a procedure of emulation processing (color tone) executed by the system control unit 50 in FIG.

  The process shown in FIG. 9 is a process corresponding to steps S301 and S302 in FIG.

  In FIG. 9, the emulation information of the color of the lens described in FIG. 8 is acquired (step S1001).

  Next, photographing is performed (step S1002), and the image data is converted as described with reference to FIG. 8 based on the lens color emulation information acquired in step S1001 (step S1003).

  Then, it is determined whether or not there are other emulations (step S1004).

  As a result of the determination in step S1004, if there is nothing else to emulate (NO in step S1004), this process ends. On the other hand, as a result of the determination in step S1004, if there is another emulation (YES in step S1004), the process returns to step S1003.

  In the process described with reference to FIG. 9, lens emulation information of another imaging device is acquired, and image data matching the lens characteristics of the other imaging device is generated based on the acquired emulation information.

  This makes it possible for the user to generate images that are virtually matched to the characteristics of other imaging devices. For example, a small camera equivalent to a large camera can be used without preparing a large camera for use in actual shooting. An image can be obtained.

  In the above description, the example in which the emulation information related to the color of the lens is acquired has been described. However, the emulation information is not limited to the color of the lens. For example, it may be emulation information relating to lens type information, F value information, focal length information, depth of field information, distortion information, peripheral dimming information, and the like.

  For example, in the case of emulation information relating to the focal length, the focal length range of the lens at the time of temporary shooting corresponding to the focal length range of the lens at the time of actual shooting is converted and obtained.

  Furthermore, at the time of provisional shooting, the user can arbitrarily switch the focal length value at the provisional camera and the focal length value at the production camera and display them on the display unit 109 so that the user can set the focal length value at the time of production photography. You can figure out what to do.

Further, the information for emulating the filter characteristics of the sensor may be used as the emulation information. The filter characteristic of the sensor is, for example, the characteristic of an infrared cut filter of a low-pass filter in front of the CMOS sensor. In this case, the matrix L _{color_atoA} for converting from the temporary camera to the color of the real camera is as _follows : Furthermore, it is emulated using a matrix that takes into account the filter characteristics of the sensor.

  Next, a process for presenting a plurality of emulation patterns to the user and enabling the user to select them will be described.

  The emulation pattern is a combination pattern of a real camera and a lens to be mounted at the time of actual photographing. For example, when there are lens candidates A, B, C, etc. that can be attached to the production camera A with respect to the production camera A at the time of production shooting, the production camera A and the lens candidates A, B, C. Are all combined patterns.

  Therefore, in the processing described below, first, emulation information about the dynamic range of another camera and emulation information about the color of the lens are obtained, and the dynamic range and the other camera's dynamic range and the color information of the lens are selected based on the selected emulation pattern. Image data matching the color of the lens is generated.

  In addition, an emulation evaluation value is calculated for each emulation pattern. This emulation evaluation value is a value that becomes larger as the image data at the time of provisional shooting is closer to the image data shot at the time of actual shooting.

  For example, when the evaluation value is in the range of 1 to 100 and the case of the dynamic range is described, the evaluation value is 100 if the dynamic range of the camera at the time of actual shooting is completely supplemented by the camera at the time of temporary shooting.

  Further, regarding the color of the lens, the color of the lens is completely matched. That is, in the XY chromaticity diagram shown in FIG. 8C, the plot points of the pixel values RGB of the points 1103, 1104, and 1105 are shown. If the pixel value RGB plot point of the image data captured by the lens used in the production camera can be matched, the lens color emulation evaluation value is 100.

  The final emulation evaluation value is obtained by dividing the obtained emulation evaluation value by the number of items of emulation.

  For example, when the dynamic range emulation evaluation value is 100 and the lens color emulation evaluation value is 50, the final emulation evaluation value is 75 since (100 + 50) / 2.

  FIG. 10 is a flowchart showing the procedure of the multiple emulation presentation process executed by the system control unit 50 in FIG.

  Note that the process shown in FIG. 10 is a process corresponding to the process from the start of the process of FIG. 5 to step S302.

  In FIG. 10, a plurality of emulation information is acquired (step S1201). In this case, the emulation information of the dynamic range and the color of the lens is acquired.

  Next, an emulation pattern is generated based on the emulation information acquired in step S1201 (step S1202). This step S1202 corresponds to generating means for generating an emulation pattern in which a plurality of emulation information is combined.

  Then, the above-described emulation evaluation value is calculated for each emulation pattern generated in step S1202 (step S1203). In step S1203, for each generated emulation pattern, an emulation evaluation value that increases as the image data obtained by imaging with the imaging device is closer to the image data obtained by imaging with another imaging device is calculated. Corresponds to the calculating means.

  Emulation patterns are presented to the user using the display unit 109 in descending order of the emulation evaluation value calculated in step S1203 (step S1204). This presentation example will be described later. This step S1204 corresponds to presentation means for presenting information indicating the emulation pattern to the user using the display unit in descending order of the calculated emulation evaluation value.

  Then, the emulation pattern selected by the user via the operation unit 115 is acquired from the emulation patterns presented in step S1204 (step S1205). Next, photographing is performed (step S1206), image data is converted based on the selected emulation pattern (step S1207), and this processing is terminated.

  As described above, in the processing of FIG. 10, the image data obtained by photographing is shot under the shooting conditions determined by the emulation information of the emulation pattern selected by the user among the presented emulation patterns. Conversion is performed using the emulation information of the emulation pattern selected by the user.

  FIG. 11 is a diagram showing an example of a user interface displayed on the display unit 109 in FIG.

  FIG. 11A is a diagram illustrating an example in which emulation patterns are presented in descending order of emulation evaluation value.

  In FIG. 11A, 1) to 4) display the combination of the real camera and the lens and the emulation evaluation value.

  By selecting a desired emulation pattern from these, the user can acquire image data according to the emulation pattern.

  FIG. 11B is a diagram showing an example of a screen for selecting an item of emulation information that the user wants to prioritize.

  This is a screen that is displayed when the user selects an emulation information item that the user wants to prioritize in order of the emulation pattern in which the emulation evaluation value of the emulation information item that the user wants to prioritize increases. In the case of FIG. 11B, an example in which an item of emulation information related to the dynamic range is selected by the user is shown.

  In the process described with reference to FIG. 10, the dynamic range of another imaging device and the emulation information of the lens are acquired, a plurality of emulation patterns are generated based on the acquired emulation information, and selected from the generated emulation patterns. On the basis of the emulation pattern, image data matching the dynamic range of other imaging devices and the color of the lens is generated.

  This makes it possible for the user to generate images that are virtually matched to the characteristics of other imaging devices. For example, a small camera equivalent to a large camera can be used without preparing a large camera for use in actual shooting. An image can be obtained.

  In the above description, the example in which the emulation information regarding the dynamic range and the color of the lens is acquired has been described. However, the emulation information is not limited thereto. For example, it may be emulation information relating to lens type information, F value information, focal length information, depth of field information, distortion information, peripheral dimming information, and the like.

  According to the present embodiment, determination of shooting conditions and emulation information for converting image data are acquired (step S301), and shooting is performed under shooting conditions determined by the acquired emulation information. Since the obtained image data is converted using the emulation information (step S302), the image data can be obtained in accordance with the lens characteristics and sensor characteristics of other imaging devices.

(Other embodiments)
The present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program code. It is a process to be executed. In this case, the program and the storage medium storing the program constitute the present invention.

50 System Control Unit 100 Imaging Device 105 Image Processing Unit 106 Memory 114 Nonvolatile Memory

Claims (21)

An imaging device,
Emulation information for determining imaging conditions and converting image data so that image data obtained by imaging with the imaging device is image data that matches the characteristics of the lenses and imaging elements of other imaging devices. Obtaining means for obtaining
Photographing means for photographing under photographing conditions determined by the emulation information obtained by the obtaining means;
An image pickup apparatus comprising: conversion means for converting image data obtained by photographing by the photographing means using the emulation information.   The emulation information includes lens emulation information for matching with the characteristics of the lens of the other imaging device, sensor emulation information for matching with the characteristics of the imaging element of the other imaging device, and information on the other imaging device. 2. The imaging apparatus according to claim 1, further comprising color space emulation information for matching with the color space.   The lens emulation information includes at least one of lens type information, F-number information, focal length information, depth of field information, distortion information, peripheral dimming information, and color information. The imaging apparatus according to claim 2.   The sensor emulation information includes at least one of image sensor type information, aspect ratio information, pixel size information, pixel number information, aperture ratio information, pixel pitch information, filter array information, and dynamic range information. The imaging apparatus according to claim 2.   The imaging apparatus according to claim 2, wherein the color space emulation information includes color space type information.   Storing the image data obtained by the photographing by the photographing unit in the storage unit, and storing the converted image data in the storage unit every time the conversion unit is converted using the emulation information. The imaging device according to any one of claims 1 to 5, wherein the imaging device is characterized. Generating means for generating an emulation pattern combining a plurality of the emulation information;
For each of the emulation patterns generated by the generation unit, an emulation evaluation value that increases as the image data obtained by photographing with the imaging device is closer to the image data obtained by photographing with another imaging device. A calculating means for calculating;
Presenting means for presenting information indicating an emulation pattern to the user using a display unit in descending order of the emulation evaluation value calculated by the calculating means,
The photographing means is photographed under photographing conditions determined by the emulation information of the emulation pattern selected by the user among the emulation patterns presented by the presenting means,
7. The conversion unit according to claim 1, wherein the conversion unit converts image data obtained by photographing by the photographing unit using emulation information of an emulation pattern selected by the user. The imaging apparatus of Claim 1. A method for controlling an imaging apparatus,
Emulation information for determining imaging conditions and converting image data so that image data obtained by imaging with the imaging device is image data that matches the characteristics of the lenses and imaging elements of other imaging devices. An acquisition step to acquire,
A shooting step of shooting under shooting conditions determined by the emulation information acquired by the acquiring step;
A control method comprising: a conversion step of converting image data obtained by photographing in the photographing step using the emulation information.   The emulation information includes lens emulation information for matching with the characteristics of the lens of the other imaging device, sensor emulation information for matching with the characteristics of the imaging element of the other imaging device, and information on the other imaging device. 9. The control method according to claim 8, further comprising color space emulation information for matching with the color space.   The lens emulation information includes at least one of lens type information, F-number information, focal length information, depth of field information, distortion information, peripheral dimming information, and color information. The control method according to claim 9.   The sensor emulation information includes at least one of image sensor type information, aspect ratio information, pixel size information, pixel number information, aperture ratio information, pixel pitch information, filter array information, and dynamic range information. The control method according to claim 9.   The control method according to claim 9, wherein the color space emulation information includes color space type information.   Storing the image data obtained by the photographing in the photographing step in the storage unit, and storing the converted image data in the storage unit every time the conversion is performed by the conversion step using the emulation information. The control method according to any one of claims 8 to 12, characterized in that: A generation step of generating an emulation pattern combining a plurality of the emulation information;
For each of the emulation patterns generated by the generation step, an emulation evaluation value that increases as the image data obtained by photographing with the imaging device is closer to the image data obtained by photographing with another imaging device. A calculating step for calculating;
A presentation step of presenting information indicating an emulation pattern to a user using a display unit in descending order of the emulation evaluation value calculated by the calculation step;
In the shooting step, shooting is performed under shooting conditions determined by the emulation information of the emulation pattern selected by the user among the emulation patterns presented in the presenting step,
14. The conversion step according to any one of claims 8 to 13, wherein the conversion step converts image data obtained by photographing in the photographing step using emulation information of an emulation pattern selected by the user. The control method according to claim 1. A program for causing a computer to execute a control method of an imaging apparatus,
The control method is:
Emulation information for determining imaging conditions and converting image data so that image data obtained by imaging with the imaging device is image data that matches the characteristics of the lenses and imaging elements of other imaging devices. An acquisition step to acquire,
A shooting step of shooting under shooting conditions determined by the emulation information acquired by the acquiring step;
A conversion step of converting image data obtained by photographing in the photographing step using the emulation information.   The emulation information includes lens emulation information for matching with the characteristics of the lens of the other imaging device, sensor emulation information for matching with the characteristics of the imaging element of the other imaging device, and information on the other imaging device. 16. The program according to claim 15, further comprising color space emulation information for matching with the color space.   The lens emulation information includes at least one of lens type information, F-number information, focal length information, depth of field information, distortion information, peripheral dimming information, and color information. The program according to claim 16.   The sensor emulation information includes at least one of image sensor type information, aspect ratio information, pixel size information, pixel number information, aperture ratio information, pixel pitch information, filter array information, and dynamic range information. The program according to claim 16.   The program according to claim 16, wherein the color space emulation information includes color space type information.   Storing the image data obtained by the photographing in the photographing step in the storage unit, and storing the converted image data in the storage unit every time the conversion is performed by the conversion step using the emulation information. The program according to any one of claims 15 to 19, wherein the program is characterized by the following. A generation step of generating an emulation pattern combining a plurality of the emulation information;
For each of the emulation patterns generated by the generation step, an emulation evaluation value that increases as the image data obtained by photographing with the imaging device is closer to the image data obtained by photographing with another imaging device. A calculating step for calculating;
A presentation step of presenting information indicating an emulation pattern to a user using a display unit in descending order of the emulation evaluation value calculated by the calculation step;
In the shooting step, shooting is performed under shooting conditions determined by the emulation information of the emulation pattern selected by the user among the emulation patterns presented in the presenting step,
21. The method according to claim 15, wherein the converting step converts image data obtained by photographing in the photographing step using emulation information of an emulation pattern selected by the user. The program according to item 1.

Images