JP2007274661A - Imaging apparatus, image reproducing device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a means for generating an image file by which a reduced image can be reproduced in a display form of the same aspect ratio as a main image and the reduced image can be reproduced with favorable appearance even in a display form of an aspect ratio different from the main image, and a means for enabling the reduced image to be reproduced with favorable appearance in the display form of the same aspect ratio as the main image. <P>SOLUTION: An imaging section picks up an object image and generates a main image. A photography setting section sets the number of recording pixels in the main image and an aspect ratio of the main image either to a first aspect ratio corresponding to a picture size with the maximum number of recording pixels or to a second aspect ratio different from the first aspect ratio. A reduction image generating section generates a first image of the first aspect ratio containing a reduction image resulting from the reduction of the main image while maintaining the second aspect ratio in the case that the main image is set to the second aspect ratio. An image file generating section generates an image file containing data of the main image, data of the first image, and first management data indicating the aspect ratio of the main image. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an imaging device, an image reproducing device, and a program that support image data having a plurality of aspect ratios.

In recent years, electronic cameras equipped with a shooting mode for generating a main image with an aspect ratio of 9:16 are being commercialized in consideration of display on a so-called wide TV corresponding to the HDTV (High Definition TeleVision) standard. is there.
On the other hand, the DCF (Design Rule for Camera File system) standard for electronic cameras stipulates that thumbnail images, which are reduced images of the main image, are created with an aspect ratio of 3: 4. In addition, according to the manufacturer's standard for electronic cameras, a display image having an aspect ratio of 3: 4 may be included in an image file in addition to a thumbnail image. Therefore, when generating the main image with an aspect ratio of 9:16, there is a problem in what format the thumbnail image is generated.

Patent Document 1 discloses an electronic camera that generates a thumbnail image of a DCF standard using a reduced image of a main image whose aspect ratio is converted to 3: 4 when the main image is shot at an aspect ratio of 9:16. Has been. Patent Document 1 also discloses a video output method for re-converting and displaying the above thumbnail image to an aspect ratio of 9:16.
JP 2005-109927 A

  However, the following points are pointed out regarding the reproduction of thumbnail images shown in Patent Document 1. That is, in an image playback device that does not support the video output method of Patent Document 1, a thumbnail image is played back without performing an aspect ratio re-conversion process, and thus a distorted image that is crushed from the left and right is played back. The Rukoto. Therefore, in the technique of Patent Document 1, there is room for improvement in that a display image at the time of reproduction becomes unsightly except for a dedicated image reproduction apparatus that supports a specific video output method.

  The present invention is to solve the above-mentioned problems of the prior art. The purpose of the present invention is to allow a dedicated image reproduction device to reproduce a reduced image in a display format having the same aspect ratio as that of the main image, and to view the reduced image in a display format having a different aspect ratio from that of the normal image reproduction device. It is to provide means for generating an image file that can be reproduced with good quality. It is another object of the present invention to provide a means for reproducing a reduced image with a display format having the same aspect ratio as that of the main image.

  An imaging apparatus according to a first aspect of the present invention includes an imaging unit, a shooting setting unit, a reduced image generation unit, and an image file generation unit. The imaging unit captures a subject image and generates a main image. The shooting setting unit sets the number of recording pixels of the main image, and sets the aspect ratio of the main image to the first aspect ratio corresponding to the image size with the maximum number of recording pixels, and the second aspect ratio different from the first aspect ratio. And set to either. The reduced image generation unit generates a first image having a first aspect ratio including a reduced image obtained by reducing the main image while maintaining the aspect ratio at the second aspect ratio when generating the main image at the second aspect ratio. To do. The image file generation unit includes first image data having a second aspect ratio, first image data having a first aspect ratio, and first management data indicating that the main image has a second aspect ratio. One image file is generated.

  In the imaging device according to the first aspect, when the reduced image generation unit generates the main image with the first aspect ratio, the reduced image generation unit reduces the main image while maintaining the aspect ratio at the first aspect ratio, and outputs the second image. Generate. Then, the image file generation unit includes data of the main image having the first aspect ratio, data of the second image having the first aspect ratio, and second management data indicating that the main image has the first aspect ratio; It is preferable to generate a second image file including

In the imaging device according to the first aspect, when the main image is generated with the second aspect ratio, the imaging unit generates a captured image with the first aspect ratio including the main image with the second aspect ratio. The reduced image generation unit preferably generates the first image by reducing the captured image.
In the imaging device according to the first aspect, it is preferable that the reduced image generation unit adds a mark indicating that the reduced image has the second aspect ratio to a portion other than the reduced image in the first image.

In the imaging device according to the first aspect, the first image is preferably at least one of a thumbnail image conforming to the DCF standard and a display image used for display on the image display device of the imaging device.
The second aspect of the present invention is an image playback device capable of playing back a first image file and a second image file. Here, the first image file includes data of the main image having the second aspect ratio, a reduced image obtained by reducing the main image while maintaining the aspect ratio at the second aspect ratio, and a first aspect different from the second aspect ratio. Data of the first image set to the ratio and first management data indicating that the main image has the second aspect ratio. The second image file includes data of the main image having the first aspect ratio, data of the second image obtained by reducing the main image while maintaining the aspect ratio at the first aspect ratio, and the main image having the first aspect ratio. Second management data indicating that there is. The image reproduction device includes a data reading unit, a determination unit, and a display output unit. The data reading unit reads at least one data of the first image file and the second image file. The determination unit determines the aspect ratio of the main image of the read image file based on the first management data or the second management data. The display output unit cuts out a reduced image from the first image of the first image file and outputs the reduced image to the image display device when the determination unit determines that the main image has the second aspect ratio.

In the image reproduction device according to the second aspect, the display output unit may output the second image of the second image file to the image display device when the determination unit determines that the main image has the first aspect ratio. preferable.
In the image reproduction device of the second aspect, the first image is preferably at least one of a thumbnail image compliant with the DCF standard and a display image used for display on the image display device of the imaging device.

  A third aspect of the present invention is a program executed by a control unit of an image reproduction device capable of reproducing a first image file and a second image file. Here, the first image file includes data of the main image having the second aspect ratio, a reduced image obtained by reducing the main image while maintaining the aspect ratio at the second aspect ratio, and a first aspect different from the second aspect ratio. Data of the first image set to the ratio and first management data indicating that the main image has the second aspect ratio. The second image file includes data of the main image having the first aspect ratio, data of the second image obtained by reducing the main image while maintaining the aspect ratio at the first aspect ratio, and the main image having the first aspect ratio. 2nd management data which shows. Then, the program executes a first step of reading at least one data of the first image file and the second image file into the control unit, and the main image of the read image file based on the first management data or the second management data. The control unit includes a second step of determining an aspect ratio and a third step of cutting out a reduced image from the first image of the first image file and outputting it to the image display device when the main image has the second aspect ratio. Let it run.

The program of the third aspect preferably further includes a fourth step of outputting the second image of the second image file to the image display device when the main image has the first aspect ratio.
An imaging apparatus according to a fourth aspect of the present invention includes an imaging unit, a shooting setting unit, a reduced image generation unit, and an image file generation unit. The imaging unit captures a subject image and generates a main image. The shooting setting unit sets the number of recording pixels of the main image, and sets the aspect ratio of the main image to a first aspect ratio corresponding to an image size that maximizes the number of recording pixels, and a second aspect different from the first aspect ratio. Set to one of the ratios. When the main image is generated at the second aspect ratio, the reduced image generation unit includes a first image having a first aspect ratio including a reduced image obtained by reducing the main image while maintaining the aspect ratio at the second aspect ratio; A second image is generated by reducing the main image while maintaining the aspect ratio at the second aspect ratio. The image file generation unit generates an image file including main image data, first image data, and second image data.

In the imaging device according to the fourth aspect, it is preferable that the image file generation unit further includes management data indicating presence / absence of data of the second image in the image file.
In the imaging device according to the fourth aspect, it is preferable that the first image is at least one of a thumbnail image conforming to the DCF standard and a display image used for display on the image display device of the imaging device.

In the imaging device according to the fourth aspect, the second image is a display image used for display on the image display device, and is preferably generated with an image size conforming to the standard of the image display device.
In the imaging device according to the fourth aspect, it is preferable that the reduced image generation unit adjusts the image size by adding blank data to the reduced image when the first image is generated.

  The fifth aspect of the present invention is an image playback apparatus capable of playing back image files. Here, the image file includes data of the main image having the second aspect ratio, a reduced image obtained by reducing the main image while maintaining the aspect ratio at the second aspect ratio, and has a first aspect ratio different from the second aspect ratio. The set first image data and the second image data obtained by reducing the main image while maintaining the aspect ratio at the second aspect ratio are included. The image reproduction device includes a data reading unit, a determination unit, and a display output unit. The data reading unit reads image file data. The determination unit determines whether the second image data exists in the read image file. The display output unit outputs the second image to the image display device when the data of the second image is included.

In the image reproduction device according to the fifth aspect, it is preferable that the image file further includes management data indicating the presence / absence of data of the second image, and the determination unit performs determination based on the management data.
In the image reproduction device according to the fifth aspect, it is preferable that the first image is at least one of a thumbnail image compliant with the DCF standard and a display image used for display on the image display device of the imaging device.

The image reproduction device according to the fifth aspect may further include a detection unit that detects a display aspect ratio of the image display device. And it is preferable that a display output part selects the image output to an image display apparatus from either a 1st image or a 2nd image according to a display aspect ratio.
The image reproduction apparatus according to the fifth aspect may further include an operation unit that receives an input for designating an aspect ratio of a display image from a user. And it is preferable that a display output part selects the image output to an image display apparatus from either a 1st image or a 2nd image according to input.

  The sixth aspect of the present invention is a program executed by a control unit of an image playback apparatus capable of playing back an image file. Here, the image file includes data of the main image having the second aspect ratio and a reduced image obtained by reducing the main image while maintaining the aspect ratio, and is set to the first aspect ratio different from the second aspect ratio. Image data and second image data obtained by reducing the main image while maintaining the aspect ratio are included. The program includes a first step of reading the image file data into the control unit, a second step of determining the presence or absence of the second image data in the read image file, and a second step when the second image data is included. The control unit executes the third step of outputting the two images to the image display device.

In the program of the sixth aspect, it is preferable that the image file further includes management data indicating the presence / absence of data of the second image, and the determination is performed based on the management data in the second step.
An imaging apparatus according to a seventh aspect of the present invention includes an imaging unit, a shooting setting unit, a reduced image generation unit, and an image file generation unit. The imaging unit captures a subject image and generates a main image. The shooting setting unit sets the number of recording pixels of the main image, and sets the aspect ratio of the main image to the first aspect ratio corresponding to the image size with the maximum number of recording pixels, and the second aspect ratio different from the first aspect ratio. And set to either. When the main image is generated at the second aspect ratio, the reduced image generation unit includes a first image having a first aspect ratio including a reduced image obtained by reducing the main image while maintaining the aspect ratio at the second aspect ratio; A second image is generated by reducing the main image while maintaining the aspect ratio at the second aspect ratio. The image file generation unit generates a first main image file and a first reduced image file. The first main image file includes main image data having the second aspect ratio and first image data having the first aspect ratio. The first reduced image file includes data of the second image having the second aspect ratio.

  In the imaging device according to the seventh aspect, when the main image is generated with the first aspect ratio, the reduced image generation unit generates a third image obtained by reducing the main image while maintaining the aspect ratio at the first aspect ratio. To do. The image file generation unit preferably generates a second main image file including main image data having a first aspect ratio and third image data having a first aspect ratio.

  In the imaging device according to the seventh aspect, when the main image is generated at the first aspect ratio, the reduced image generation unit includes a reduced image obtained by reducing the main image while maintaining the aspect ratio at the first aspect ratio. A fourth image having the second aspect ratio is further generated. The image file generation unit preferably further generates a second reduced image file including data of the fourth image having the second aspect ratio.

In the imaging device according to the seventh aspect, when the reduced image generation unit generates the main image with the first aspect ratio, the reduced image generation unit further generates a fifth image obtained by reducing the main image while maintaining the aspect ratio at the first aspect ratio. Generate. The image file generation unit preferably further generates a second reduced image file including data of the fifth image having the first aspect ratio.
In the imaging device according to the seventh aspect, the first image and the third image may be at least one of a thumbnail image compliant with the DCF standard and a display image used for display on the image display device of the imaging device. preferable.

In the imaging device according to the seventh aspect, the second image and the fourth image are display images used for display on the image display device, and are generated with an image size conforming to the standard of the image display device. It is preferable.
In the imaging device according to the seventh aspect, the image file generation unit includes a first association process for associating the first main image file with the first reduced image file, the second main image file, and the second reduced image file. It is preferable to further execute any one of the second association processing for associating with each other.

Particularly in the above case, the image file generation unit includes the first management data indicating the presence of the first reduced image file in the first main image file in the first association process. In the second association process, it is preferable to include second management data indicating the presence of the second reduced image file in the second main image file.
In particular, in the above case, the image file generation unit assigns a file name indicating a relationship with the first main image file to the first reduced image file in the first association process. In the second relevance process, it is preferable that a file name indicating the relevance with the second main image file is given to the second reduced image file.

  Particularly in the above case, a first folder that records at least one of the first main image file and the second main image file, and a second folder that records at least one of the first reduced image file and the second reduced image file. And a recording unit having a folder. In the first association process, the image file generation unit records the first main image file in the first folder and the first reduced image file in the second folder. In the second association process, it is preferable that the second main image file is recorded in the first folder and the second reduced image file is recorded in the second folder.

  In the eighth aspect of the present invention, the first main image file, the first reduced image file associated with the first main image file, the second main image file, and the second main image file are associated with each other. An image reproduction apparatus capable of reproducing a second reduced image file. Here, the first main image file includes data of the first main image having the second aspect ratio, a reduced image obtained by reducing the first main image while maintaining the aspect ratio at the second aspect ratio, and the second aspect ratio. And data of the first image set to a different first aspect ratio. The first reduced image file includes data of a second image obtained by reducing the first main image while maintaining the aspect ratio at the second aspect ratio. The second main image file includes data of a second main image having a first aspect ratio and data of a third image obtained by reducing the second main image while maintaining the aspect ratio at the first aspect ratio. The second reduced image file includes data of a fourth image having a second aspect ratio including a reduced image obtained by reducing the second main image while maintaining the aspect ratio at the first aspect ratio. The image reproduction device includes a data reading unit, a determination unit, and a display output unit. The data reading unit reads data of the first main image file, the first reduced image file, the second main image file, and the second reduced image file. The determination unit determines whether or not there are the first reduced image file and the second reduced image file. When the determination unit determines that there is the first reduced image file or the second reduced image file, the display output unit outputs the second image data or the fourth image data to the image display device when the reduced image having the second aspect ratio is reproduced. Output.

  In the image reproducing device according to the eighth aspect, the first main image file further includes first management data indicating the presence of the first reduced image file. The second main image file further includes second management data indicating the presence of the second reduced image file. The determination unit preferably determines the presence / absence of the first reduced image file based on the first management data, and determines the presence / absence of the second reduced image file based on the second management data.

  In the image reproducing device according to the eighth aspect, the first reduced image file has a file name indicating the relationship with the first main image file. The second reduced image file has a file name indicating relevance with the second main image file. The image playback device further includes a file detection unit that detects at least one of the first reduced image file and the second reduced image file based on the file name. And it is preferable that a determination part determines the presence or absence of a 1st reduction image file and a 2nd reduction image file based on the detection result of a file detection part.

  In the image reproducing device according to the eighth aspect, the data reading unit includes a first folder including at least one data of the first main image file and the second main image file, the first reduced image file, and the second reduced image. Each data is read from a recording means having a second folder containing at least one of the data and the file. The determination unit determines whether or not the second folder exists. The display output unit preferably outputs the data of the second folder to the image display device when reproducing the reduced image having the second aspect ratio.

In the image reproduction device of the eighth aspect, the second image and the fourth image are display images used for display on the image display device, and are generated with an image size conforming to the standard of the image display device. It is preferable.
The image reproduction apparatus according to the eighth aspect further includes a detection unit that detects the display aspect ratio of the image display apparatus. The display output unit outputs the first image and the third image having the first aspect ratio or the second image and the fourth image having the second aspect ratio to the image display device according to the display aspect ratio. Preferably, the image to be selected is selected.

The image reproduction apparatus according to the eighth aspect further includes an operation unit that receives an input for designating an aspect ratio of a display image from a user. The display output unit outputs an image to the image display device from any one of the first image and the third image having the first aspect ratio or the second image and the fourth image having the second aspect ratio in accordance with the input. Is preferably selected.
The ninth aspect of the present invention relates to the first main image file, the first reduced image file associated with the first main image file, the second main image file, and the second main image file. This is a program executed by the control unit of the image reproducing apparatus capable of reproducing the second reduced image file. Here, the first main image file includes data of the first main image having the second aspect ratio, a reduced image obtained by reducing the first main image while maintaining the aspect ratio at the second aspect ratio, and the second aspect ratio. And data of the first image set to a different first aspect ratio. The first reduced image file includes data of a second image obtained by reducing the first main image while maintaining the aspect ratio at the second aspect ratio. The second main image file includes data of a second main image having a first aspect ratio and data of a third image obtained by reducing the second main image while maintaining the aspect ratio at the first aspect ratio. The second reduced image file includes data of a fourth image having a second aspect ratio including a reduced image obtained by reducing the second main image while maintaining the aspect ratio at the first aspect ratio. The program includes a first step of reading data of the first main image file, the first reduced image file, the second main image file, and the second reduced image file, and the presence / absence of the first reduced image file and the second reduced image file. When the second step determines that there is a first reduced image file or a second reduced image file and the second step determines that there is a second reduced image file, the second image data or the fourth image data is reproduced when the reduced image having the second aspect ratio is reproduced. And causing the control unit to execute a third step of outputting to the image display device.

  In the program of the ninth aspect, the first main image file further includes first management data indicating the presence of the first reduced image file. The second main image file further includes second management data indicating the presence of the second reduced image file. In the second step, preferably, the presence / absence of the first reduced image file is determined based on the first management data, and the presence / absence of the second reduced image file is determined based on the second management data.

  In the program according to the ninth aspect, the first reduced image file has a file name indicating the relationship with the first main image file. The second reduced image file has a file name indicating relevance with the second main image file. The program further includes a fourth step of detecting at least one of the first reduced image file and the second reduced image file based on the file name. In the second step, it is preferable to determine the presence or absence of the first reduced image file and the second reduced image file based on the detection result in the fourth step.

  In the program of the ninth aspect, in the first step, the first folder including at least one data of the first main image file and the second main image file, the first reduced image file, the second reduced image file, Each data is read from a recording means having a second folder including at least one of the data. In the second step, the presence or absence of the second folder is determined. In the third step, it is preferable to output the data of the second folder to the image display device when reproducing the reduced image having the second aspect ratio.

According to the imaging apparatus of the present invention, a dedicated image reproduction device can reproduce a reduced image in a display format having the same aspect ratio as that of the main image, and can also reduce a display format having a different aspect ratio from that of the normal image reproduction device. An image file can be generated that can be viewed and reproduced with good quality.
Further, according to the image reproduction apparatus of the present invention, a reduced image can be reproduced with good appearance in a display format having the same aspect ratio as the main image.

(Description of the first embodiment)
FIG. 1 is a block diagram showing the configuration of the electronic camera of the first embodiment.
In the electronic camera according to the first embodiment, the aspect ratio of the captured image (main image) at the time of release can be set to either 3: 4 or 9:16. In the first embodiment, an example of an electronic camera will be described in which when a main image is generated with the maximum number of recording pixels, the main image has an image size of 2304 pixels × 3072 pixels (aspect ratio 3: 4). In the first embodiment, the description will be made on the assumption that an exchangeable image file format for digital still cameras (JIF) -JPEG image file, which is a basic file of the DCF standard, is generated.

  The electronic camera includes a photographing optical system 11, an image sensor 12, an analog processing unit 13, an A / D conversion unit 14, a timing generator (TG) 15, a digital processing unit 16, a color interpolation processing unit 17, Reduced image generation unit 18, compression / decompression processing unit 19, memory 20, DMA (Direct Memory Access) controller 21, CPU 22, recording I / F 23, monitor driver 24 and monitor 25, HDTV output unit 26 , An SDTV (Standard Definition TeleVision) output unit 27, an operation unit 28, an attitude sensor 29, and a system bus 30. The digital processing unit 16, color interpolation processing unit 17, reduced image generation unit 18, compression / decompression processing unit 19, memory 20, DMA controller 21, CPU 22, recording I / F 23, monitor driver 24, HDTV output unit 26 and SDTV output Each unit 27 is connected via a system bus 30.

The photographing optical system 11 is composed of a plurality of lens groups including a zoom lens and a focusing lens. The photographing optical system 11 serves to form an image of a light beam from a subject on the light receiving surface of the image sensor 12. For convenience, FIG. 1 shows a single lens as the photographing optical system 11.
The imaging element 12 has a light receiving surface in which a plurality of light receiving elements are arranged in a matrix. The image sensor 12 photoelectrically converts a subject image by a light receiving element to generate an analog image signal. The output of the image sensor 12 is connected to the analog processing unit 13. Note that the effective pixel area of the image sensor 12 in the first embodiment includes an image area necessary for obtaining the number of recorded pixels of 2304 pixels in length × 3072 pixels in width and ring pixels around the image area. It has become a size.

  Further, in the light receiving element of the image pickup element 12, any one of red (R), green (G), and blue (B) color filters is disposed on the light receiving surface side. The color filters are arranged according to a known Bayer arrangement. Therefore, each light receiving element of the imaging element 12 outputs an image signal corresponding to the color of the color filter by color separation in the color filter. For example, the light receiving element of the red color filter outputs an image signal whose output value indicates the brightness relating to red. In addition, regarding the image sensor 12, the arrangement of the light receiving elements and the illustration of the color filter are omitted.

Further, in the photographing mode for photographing the main image, the image sensor 12 captures the main image at the time of release and also outputs a through image at a predetermined interval during standby for photographing. The through image data is used for various arithmetic processes by the CPU 22 and display on the monitor 25.
The analog processing unit 13 is an analog front-end circuit that performs analog signal processing on the output of the image sensor 12. The analog processing unit 13 has a CDS circuit and a gain circuit inside. The CDS circuit of the analog processing unit 13 reduces the noise component of the output of the image sensor 12 by correlated double sampling. The gain circuit of the analog processing unit 13 amplifies the gain of the input signal based on an instruction from the CPU 22. In the gain circuit described above, the imaging sensitivity corresponding to the ISO sensitivity can be adjusted.

The A / D conversion unit 14 performs A / D conversion on the analog image signal output from the analog processing unit 13. The output of the A / D conversion unit 14 is input to the digital processing unit 16.
The TG 15 supplies timing pulses to the image sensor 12, the analog processing unit 13, and the A / D conversion unit 14 based on instructions from the CPU 22. The drive timing of the image sensor 12, the analog processing unit 13, and the A / D conversion unit 14 is controlled by the timing pulse of the TG 15.

The digital processing unit 16 performs various types of image processing such as white balance processing and gradation correction processing on the digital image signal output from the A / D conversion unit 14.
The color interpolation processing unit 17 performs color interpolation processing on the digital image signal output from the digital processing unit 16. Since the image sensor 12 can obtain only one color for each pixel corresponding to the light receiving element, the RAW data of the image sensor 12 is a mosaic-like image with respect to color. The color interpolation processing unit 17 generates an image in which all the colors (RGB) are aligned in all pixels by performing interpolation using color information obtained from surrounding pixels. For example, the color interpolation processing unit 17 generates green data corresponding to red pixels by interpolating from surrounding green pixels. Similarly, the color interpolation processing unit 17 generates blue data corresponding to red pixels by interpolating from surrounding blue pixels.

  The reduced image generation unit 18 generates an Exif standard thumbnail image and a display image (view image) optimized for display on the monitor 25 based on the image data corresponding to the main image. Here, since there is no definition in the Exif standard for view images, each camera manufacturer can uniquely define the image data size (number of pixels and image size) of the view image. However, since it is necessary to ensure compatibility with other types of electronic cameras and playback apparatuses, the view images are generated with an image data size that conforms to the standards of each manufacturer. The image data sizes of the thumbnail image and the view image will be described later.

The compression / decompression processing unit 19 executes processing for compressing image data in the JPEG format at the time of recording and processing for expanding compressed image data at the time of reproduction.
The memory 20 temporarily records the data of the main image in the pre-process and post-process of various image processes. The memory 20 is used as a work area of the CPU 22 and can also record data indicating the state of various settings of the electronic camera by the user. Further, data of an image size table described later is recorded in the memory 20.

The DMA controller 21 controls DMA transfer performed between the memory 20 and each device based on a request from the CPU 22.
The CPU 22 controls the operation of each part of the electronic camera according to the sequence program. Further, the CPU 22 executes various arithmetic processes (for example, AF calculation and AE calculation) necessary for the operation of the electronic camera.

  Furthermore, the CPU 22 generates an image file that conforms to the Exif standard. In the image file, there are recorded main image data, thumbnail image data, view image data, and a header portion including data of the photographing conditions (exposure time, aperture value, imaging sensitivity, etc.) of the main image. The Of the data contained in the image file, data that is not supported by the Exif standard (special data such as view image data) is stored in the image file using the Excite MakerNote tag. The header 22 editing operation and the image file generating operation by the CPU 22 are performed using the work area of the memory 20.

  A connector for connecting the recording medium 31 is formed on the recording I / F 23. Then, the recording I / F 23 executes writing / reading of an image file with respect to the recording medium 31 connected to the connector. The recording medium 31 is composed of a hard disk, a memory card incorporating a semiconductor memory, or the like. In FIG. 1, a memory card is illustrated as an example of the recording medium 31.

The monitor driver 24 controls the display of the monitor 25 by outputting a drive signal to the monitor 25 based on an instruction from the CPU 22.
The monitor 25 is a liquid crystal monitor with an aspect ratio of 3: 4. For example, the monitor 25 can reproduce and display an image included in an image file, display information on the header section, display a menu screen for changing settings, and the like. The monitor 25 also functions as an electronic viewfinder that displays a through image as a moving image in the shooting mode.

  The HDTV output unit 26 has a video terminal (for example, a D terminal) for outputting an HDTV video signal from the electronic camera to the outside. The HDTV output unit 26 outputs an HDTV video signal of an image to be reproduced to an image display device (not shown) corresponding to HDTV. The HDTV output unit 26 can also detect the connection state with the image display device based on the output of the plug insertion detection pin of the video terminal.

The SDTV output unit 27 has a video terminal for outputting an SDTV video signal from the electronic camera to the outside. Then, the SDTV output unit 27 outputs an SDTV video signal of an image to be reproduced to an image display device (not shown) corresponding to the SDTV.
The operation unit 28 receives various user operations on the electronic camera. The output of the operation unit 28 is connected to the CPU 22. The operation unit 28 includes a power button, a release button, a cross key, a determination button, and the like. The power button receives a power on / off input from the user. The release button receives an instruction input for starting an exposure operation from the user. The cross key and the determination button accept, for example, an electronic camera mode switching operation (switching between shooting mode and playback mode, launching a menu screen), an input operation on the menu screen, and the like from the user.

  The posture sensor 29 detects the photographing posture of the electronic camera. The output of the attitude sensor 29 is connected to the CPU 22. The posture sensor 29 according to the first embodiment is configured such that the electronic camera is held in a normal position (or upside down with respect to the normal position) and the electronic camera is placed with the right hand side or the left hand side facing up. The shooting posture in the vertical position can be detected. Note that the shooting posture data detected by the posture sensor 29 is recorded in the header portion of the image file.

Hereinafter, the operation of the electronic camera of the first embodiment will be described.
First, as a premise for shooting, the user needs to launch a menu screen and input the image data size setting to the electronic camera in advance. Note that the display processing and operations on the menu screen shown below are all controlled by the CPU 22.
The electronic camera of the first embodiment has an image size table in which image data sizes that can be selected by the user are registered. The user operates the operation unit 28 on the menu screen to select a desired image data size from the image size table and input it to the electronic camera. As a result, the image data size for the electronic camera is set. Note that setting data indicating the image data size selected by the user is recorded in the memory 20 by the CPU 22.

  FIG. 2 shows an example of the image size table of the first embodiment. In the first embodiment, the image data size of the main image can be selected from three types from the first size to the third size. In the first size, the main image is set to 2304 pixels × 3072 pixels (aspect ratio 3: 4). The second size is set such that the main image is 480 pixels high by 640 pixels wide (aspect ratio 3: 4). In the third size, the main image is set to 1728 vertical pixels × 3072 horizontal pixels (aspect ratio 9:16).

In any case of the first size to the third size, the image data sizes of the thumbnail image and the view image are unified to a prescribed size. Therefore, the thumbnail image and view image data generated by the electronic camera of the first embodiment will not be unreproducible if it is an image playback device corresponding to each standard.
Specifically, the image data size of the thumbnail image is set to 120 pixels long × 160 pixels wide (aspect ratio 3: 4) in accordance with the Exif standard. In the first embodiment, the image data size of the view image is set to 240 vertical pixels × 320 horizontal pixels (aspect ratio 3: 4) corresponding to QVGA. Therefore, the thumbnail image and view image data of the first embodiment are compatible with other electronic cameras.

Next, the image display size in the image size table of FIG. 2 will be described. The image display size indicates a reference image size when a thumbnail image or a view image is reproduced and displayed by the image reproducing apparatus corresponding to the file format unique to the first embodiment. The image display size is defined according to the aspect ratio of the main image.
In the case of the first size and the second size, the aspect ratio of the main image matches the aspect ratio of the thumbnail image and the view image. That is, in the above case, since the thumbnail image and the view image are generated with the same aspect ratio as the main image, it is preferable to display each image with a unified image size during reproduction. Therefore, the image display size of the thumbnail image and the view image in the above case is set to be the same as the image data size. Specifically, the image display sizes of the thumbnail images in the first size and the second size are set to 120 pixels vertically × 160 pixels horizontally (aspect ratio 3: 4). Similarly, the image display size of the view image is set to 240 vertical pixels × 320 horizontal pixels (aspect ratio 3: 4).

  On the other hand, in the case of the third size, the aspect ratio of the main image does not match the aspect ratio of the thumbnail image and the view image. That is, in the above case, it is preferable to reproduce and display the thumbnail image and the view image in a display format corresponding to the main image. Therefore, in the above case, the image display sizes of the thumbnail image and the view image are set to have an aspect ratio of 9:16. Specifically, the image display size of the thumbnail image in the third size is set to 90 pixels vertically × 160 pixels horizontally (aspect ratio 9:16). Similarly, the image display size of the view image is set to 180 vertical pixels × 320 horizontal pixels (aspect ratio 9:16). Note that the sizes of the main image, the thumbnail image, and the view image in the first size and the third size are schematically shown in FIG.

Next, the operation of the shooting mode in the first embodiment will be described. FIG. 4 is a flowchart showing an example of the operation of the electronic camera in the shooting mode.
Step 101: When the electronic camera is set to the shooting mode by the user's mode switching operation, the CPU 22 starts to acquire a through image. Specifically, the CPU 22 controls the TG 15, the digital processing unit 16, the color interpolation processing unit 17, and the reduced image generation unit 18 to sequentially generate through image data at a period of 1/30 seconds. The reduced image generation unit 18 outputs through image data with an image size of 240 vertical pixels × 320 horizontal pixels. Then, the CPU 22 controls the monitor driver 24 to display the through image on the monitor 25 as a moving image. Therefore, the user can perform framing for determining the shooting composition based on the through image displayed on the monitor 25.

  Here, the CPU 22 changes the display state of the through image on the monitor 25 according to the setting state of the image data size. Specifically, the CPU 22 acquires the setting of the image data size from the setting data in the memory 20. When the image data size is the first size or the second size, the CPU 22 controls the monitor driver 24 to display the entire through image on the monitor 25. In this case, the through image of 240 pixels in length × 320 pixels in width (aspect ratio 3: 4) is displayed on the monitor 25 as a moving image.

  On the other hand, when the image data size is the third size, the CPU 22 controls the monitor driver 24 to display on the monitor 25 a horizontally long through image obtained by trimming the top and bottom of the image. Specifically, the CPU 22 controls the monitor driver 24 so that the area from the 31st line to the 210th line from the top of the through image is displayed on the monitor 25. In this case, the monitor 25 displays a moving image of a through image of vertical 180 pixels × horizontal 320 pixels (aspect ratio 9:16). Thereby, the electronic camera can display a through image corresponding to the shooting range in the main image.

Step 102: The CPU 22 determines whether or not the release button is half-pressed. When the release button is half-pressed (YES side), the process proceeds to S103. On the other hand, when the release button is not half-pressed (NO side), the CPU 22 waits for a half-press operation of the release button.
Step 103: The CPU 22 executes a known contrast detection AF control. Further, the CPU 22 executes a known AE calculation based on the through image data. By this AE calculation, shooting conditions such as exposure time, aperture value, and imaging sensitivity are determined.

Step 104: The CPU 22 determines whether or not the release button has been fully pressed. When the release button is fully pressed (YES side), the process proceeds to S105. On the other hand, when the release button is not fully pressed (NO side), the CPU 22 waits for the release button to be fully pressed.
Step 105: The CPU 22 performs photographing of the subject in response to the release button being fully pressed. First, the CPU 22 adjusts a diaphragm (not shown) and sets a gain in the analog processing unit 13 based on the photographing condition acquired in S103. And CPU22 drives the image pick-up element 12 via TG15 based on the exposure time acquired by S103. As a result, an image signal of the main image is generated by the image sensor 12. In the first embodiment, it is assumed that the CPU 22 drives the image sensor 12 by reading all pixels in all cases from the first size to the third size.

  Step 106: The CPU 22 generates image data of the main image based on the image signal acquired by the photographing at S105. First, the CPU 22 instructs the color interpolation processing unit 17 to perform color interpolation processing on image data. The color interpolation processing unit 17 performs color interpolation on the image data for one screen that has passed through the analog processing unit 13 and the A / D conversion unit 14 and is buffered in the memory 20. The image data after color interpolation is temporarily recorded in the memory 20.

  Then, the CPU 22 generates image data of the main image with the image data size set by the user based on the setting data. In the case of the first size, the CPU 22 uses the image data after color interpolation as it is as the image data of the main image. In the case of the second size, the CPU 22 performs interpolation processing and thinning processing on the image data after color interpolation to generate image data of the main image. In the case of the third size, the CPU 22 cuts out the image data after color interpolation into a predetermined size and generates image data of the main image. Specifically, in the case of the third size, the CPU 22 cuts out the pixels in the area from the 289th line to the 2016th line from the above image data, and the main image data of 1728 vertical pixels × 3072 horizontal pixels Is generated. In the first embodiment, the compression / decompression processing unit 19 executes JPEG compression processing on the main image data.

  Step 107: The CPU 22 instructs the reduced image generation unit 18 to generate thumbnail images and view images. The reduced image generation unit 18 performs resolution conversion on the image data after color interpolation recorded in the memory 20 while maintaining the aspect ratio, and generates thumbnail image data and view image data. As described above, both the thumbnail image and the view image are generated with an aspect ratio of 3: 4. When the image data size is the third size, the thumbnail image and the view image include a reduced image having an aspect ratio of 9:16 corresponding to the main image.

When the image data size is the third size, the reduced image generation unit 18 adds the following marks to the thumbnail image and the view image to indicate that the aspect ratio of the main image is 9:16. To do.
First, the reduced image generating unit 18 adds a display indicating the range of the main image to the thumbnail image and the view image (see FIG. 3). Specifically, the reduced image generation unit 18 combines the broken lines extending in the horizontal direction from the top of the thumbnail image to the 15th line and the 106th line by image processing. Similarly, the reduced image generation unit 18 combines the broken lines extending in the horizontal direction from the top of the view image to the 30th and 211st rows by image processing. Thereby, when the thumbnail image and the view image are reproduced and displayed in the aspect ratio of 3: 4, the range of the main image is indicated by the broken line in the reproduced image.

  Secondly, the reduced image generation unit 18 adds a character display indicating the aspect ratio of the main image to the thumbnail image and the view image (see FIG. 3). Specifically, the reduced image generation unit 18 performs image processing on 9:16 characters in an area not included in the main image (upper or lower area separated by the broken line) in the thumbnail image and the view image. Synthesize with As a result, when the thumbnail image and the view image are reproduced and displayed in an aspect ratio of 3: 4, the reproduced image shows the aspect ratio of the main image.

Step 108: The CPU 22 associates the main image data generated in S106, the thumbnail image data and view image data generated in S107, and the header data to generate one image file.
Here, the CPU 22 records the above-described shooting condition data, address information of each image (correspondence between the image data and the address in the image file), and the like in the header portion of the image file. In addition, the CPU 22 records the image display size data of the thumbnail image and the view image (also serving as data indicating the aspect ratio of the main image) in the header portion using the MakerNote tag. The above image file is finally recorded on the recording medium 31. This completes the shooting operation for one frame. Note that the CPU 22 may then return to S102 to capture the next frame.

Next, the operation in the playback mode in the first embodiment will be described. FIG. 5 is a flowchart showing an example of the operation of the electronic camera in the playback mode. The electronic camera in this playback mode can display the playback image of the image file on the monitor 25 or an external image display device (television). In the first embodiment, an example in which the reproduced image is displayed on the monitor 25 will be described.
Step 201: When the electronic camera is set to the playback mode by the user's mode switching operation, the CPU 22 displays an index screen on which a plurality of thumbnail images are arranged on the monitor 25 (see FIG. 6). In this index screen, thumbnail images for 12 frames can be displayed on one screen. On the index screen, the user can designate and input an image to be enlarged and displayed on the electronic camera by operating an icon on the screen by the operation unit 28. Note that the display processing and operation on the index screen are both controlled by the CPU 22.

  Hereinafter, the operation of the electronic camera in S201 will be described. First, the CPU 22 instructs the recording I / F 23 to read data of thumbnail images to be displayed on the index screen. At this time, if the number of image files on the recording medium 31 is 12 or less, the CPU 22 acquires thumbnail images from all the image files. On the other hand, when the number of image files on the recording medium 31 exceeds 12, the CPU 22 refers to the header portion of the image file and acquires thumbnail images for 12 frames in order from the image file with the oldest shooting date and time.

Next, the CPU 22 generates thumbnail display data to be displayed on the index screen based on the data of each thumbnail image. The CPU 22 refers to the image display size data of the thumbnail image in the header portion of the image file, and generates thumbnail display data as follows.
When the image display size is 120 pixels vertically × 160 pixels horizontally (or when the image display size data is not in the header portion), the CPU 22 performs a thinning process on the thumbnail image data, and the aspect ratio is 3: 4. To generate thumbnail display data.

  On the other hand, when the image display size is vertical 90 pixels × horizontal 160 pixels, the CPU 22 cuts out the area from the 16th line to the 105th line from the top of the thumbnail image data. The clipped image is an image corresponding to the main image with a size of 90 pixels vertically × 160 pixels horizontally. Then, the CPU 22 performs thinning processing on the cut-out image data to generate thumbnail display data with an aspect ratio of 9:16.

Further, the CPU 22 refers to the header portion of each image file and obtains the shooting posture data of the main image. Then, the CPU 22 executes vertical / horizontal conversion of the thumbnail display data photographed at the vertical position.
Thereafter, the CPU 22 writes an image in the frame memory in the monitor driver 24 based on the thumbnail display data. Then, the monitor driver 24 displays each thumbnail image on the index screen of the monitor 25.

  Here, in the index screen of FIG. 6, T1 to T3, T5, T7, and T8 are thumbnail images having an image display size of 120 pixels vertically × 160 pixels horizontally (aspect ratio 3: 4). T12 is an image obtained by performing vertical / horizontal conversion and reduction processing on a thumbnail image having an image display size of 120 pixels vertically × 160 pixels horizontally (aspect ratio 3: 4). T4, T6, T9, and T10 are thumbnail images having an image display size of 90 pixels vertically × 160 pixels horizontally (aspect ratio 9:16). T11 is an image obtained by performing vertical / horizontal conversion and reduction processing on a thumbnail image having an image display size of 90 pixels vertically × 160 pixels horizontally (aspect ratio 9:16). In the thumbnail images of T4, T6, and T9 to T11, reduced images having the same aspect ratio as the main image are displayed.

Step 202: The CPU 22 determines whether or not a designation of a thumbnail image to be enlarged is input. If there is a designated input (YES side), the process proceeds to S203. On the other hand, when there is no designation input (NO side), the CPU 22 continues to display the index screen and waits for the designation input from the user.
Step 203: The CPU 22 enlarges and displays the view image corresponding to the image designated in S202 on the monitor 25 alone. In S203, the CPU 22 displays the view image on the monitor 25 in a size matching the size of the monitor 25 (see FIG. 7).

Hereinafter, the operation of the electronic camera in S203 will be described. First, the CPU 22 instructs the recording I / F 23 to read view image data. The recording I / F 23 reads view image data from the image file of the recording medium 31.
Next, the CPU 22 generates view image display data to be displayed on the monitor 25 based on the view image data. The CPU 22 refers to the image display size data of the view image in the header part of the image file, and generates the view image display data as follows.

If the image display size is 240 vertical pixels x 320 horizontal pixels (or if the image display size data is not in the header section), the CPU 22 performs interpolation processing on the view image data to match the number of pixels on the monitor. View image display data having an aspect ratio of 3: 4 is generated.
On the other hand, when the image display size is 180 vertical pixels × 320 horizontal pixels, the CPU 22 cuts out the region from the 31st row to the 210th row from the top of the view image data. The cut out image becomes an image corresponding to the main image with a size of vertical 180 pixels × horizontal 320 pixels. Then, the CPU 22 performs interpolation processing and thinning processing on the cut-out image data to generate view image display data with an aspect ratio of 9:16.

Further, the CPU 22 refers to the header portion of each image file and obtains the shooting posture data of the main image. Then, the CPU 22 performs vertical / horizontal conversion on the view image data shot in the vertical position.
Thereafter, the CPU 22 writes an image in the frame memory in the monitor driver 24 based on the view image display data. Then, the monitor driver 24 displays a view image on the monitor 25.

  Here, FIG. 7A shows a state in which a view image having an aspect ratio of 3: 4 is displayed on the monitor 25 in the horizontal position. FIG. 7B shows a state in which a view image having an aspect ratio of 9:16 is displayed on the monitor 25 in the horizontal position. FIG. 7C shows a state in which a view image having an aspect ratio of 3: 4 is displayed on the monitor 25 in the vertical position. FIG. 7D shows a state in which a view image having an aspect ratio of 9:16 is displayed on the monitor 25 in the vertical position. FIG. 7E shows a state in which the same view image as FIG. 7B is output from the HDTV output unit 26 to the wide television (aspect ratio 9:16) and displayed.

  In the first embodiment, a case where an image file corresponding to the third size is played back by another image playback device will be described. Here, the description will be made on the assumption that playback is performed on another electronic camera that supports the Exif standard and the view image standard but does not support the above-described image display in the third size. The main configuration of the other electronic camera is almost the same as that of the electronic camera shown in FIG.

  Other electronic cameras cannot read the image display size data incorporated in the header portion of the image file, and the setting of the image display size is ignored during reproduction. Therefore, in any case of the first size to the third size, the thumbnail image and the view image are respectively displayed on the monitor 25 in a state where the aspect ratio is 3: 4 in accordance with each standard.

  FIG. 8 shows a display example of an index screen by another electronic camera. The thumbnail images (T1 to T12) displayed on the index screen in FIG. 8 correspond to the thumbnail images with the same sign on the index screen in FIG. The thumbnail images T4, T6, and T9 to T11 in FIG. 8 are all displayed in the aspect ratio of 3: 4 without the display image being trimmed to 9:16 as shown in FIG. Yes. Therefore, in the thumbnail images of T4, T6, and T9 to T11 in FIG. 8, the entire image including the reduced image of the main image is displayed.

  In thumbnail images T4, T6, and T9 to T11 in FIG. 8, 9:16 characters added by image processing and a broken line indicating the range of the main image having an aspect ratio of 9:16 are displayed. ing. Therefore, it is relatively easy to estimate the state of the main image from the thumbnail images T4, T6, and T9 to T11. Note that the thumbnail images T1 to T3, T5, T7, and T8 in FIG. 8 are displayed in substantially the same manner as the index screen in FIG.

  Similarly, FIG. 9A shows a state in which a view image having an aspect ratio of 9:16 is displayed on the monitor 25 in the horizontal position in another electronic camera. FIG. 9B shows a state in which a view image having an aspect ratio of 9:16 is displayed on the monitor 25 in the vertical position in another electronic camera. In both cases of FIGS. 9A and 9B, 9:16 characters added by image processing and a broken line indicating the range of the main image having an aspect ratio of 9:16 are displayed. Yes. Note that the display of a view image with an aspect ratio of 3: 4 is the same as that in FIG.

(Description of Second Embodiment)
Next, operations in the shooting mode and the playback mode by the electronic camera of the second embodiment will be described. In the electronic camera according to the second embodiment, when a main image is shot at an aspect ratio of 9:16, a thumbnail image and a view image having an aspect ratio of 3: 4 and a thumbnail image and a view having an aspect ratio of 9:16 are used. This is different from the first embodiment in that each image is generated. Here, in the electronic camera of the following embodiment, components having substantially the same functions as those of the electronic camera of the first embodiment are denoted by the same reference numerals, and description thereof is partially omitted. In addition, in each operation of the electronic camera of the following embodiment, a difference from the first embodiment will be described, and a duplicate description with the first embodiment will be omitted.

  FIG. 10 shows an example of the image size table of the second embodiment. Also in the second embodiment, the image data size of the main image can be selected from three types from the first size to the third size. Here, in the image size table of FIG. 10, the image data size of the main image is set to the same size as the table of FIG. In the image size table of FIG. 10, the image data sizes of the thumbnail image and the view image in the first size and the second size are also set to the same size as the table of FIG. In the second embodiment, the image display size corresponds to the image data size. Therefore, the CPU 22 does not need to set the image display size in any of the first size to the third size.

  On the other hand, in the image size table of FIG. 10, two image data sizes of the thumbnail image and the view image are set for the third size. The image data sizes of the first thumbnail image and the first view image in FIG. 10 are respectively set to the same size as the table in FIG. That is, the first thumbnail image and the first view image data of the second embodiment are compatible with other electronic cameras. Therefore, the data of the first thumbnail image and the first view image described above cannot be played back if the image playback device is compatible with each standard.

  On the other hand, the second thumbnail image and the second view image are for display on a dedicated image playback device. Here, the image data size of the second thumbnail image is set to 90 pixels vertically × 160 pixels horizontally (aspect ratio 9:16). Furthermore, the image data size of the second view image is set to 360 vertical pixels × 640 horizontal pixels (aspect ratio 9:16). The image data size of the second view image is a size optimized in accordance with the standard of the image display device. Note that the sizes of the third-size main image, the first and second thumbnail images, and the first and second view images in the second embodiment are schematically shown in FIG.

Next, the operation of the shooting mode in the second embodiment will be described. Here, when the image data size is set to the first size or the second size in the second embodiment, the operation is the same as that of the first embodiment. Therefore, in the following description, it is assumed that the image data size is set to the third size.
When the subject is photographed in the second embodiment, the CPU 22 outputs a trimming process command to the digital processing unit 16. When receiving the trimming processing command, the digital processing unit 16 records only the data from the 289th line to the 2016th line in the image data read out from the image sensor 12 in the memory 20, and stores the data in the other lines. Delete the data. Therefore, the digital processing unit 16 outputs image data of vertical 1728 pixels × horizontal 3072 pixels (aspect ratio 9:16). Thereafter, the image data is subjected to color interpolation processing, compression processing, and the like to generate main image data of the third size. The image data after color interpolation is temporarily recorded in the memory 20.

  Next, the CPU 22 instructs the reduced image generation unit 18 to generate the first thumbnail image, the second thumbnail image, the first view image, and the second view image. The reduced image generation unit 18 performs resolution conversion while maintaining the aspect ratio for the color-interpolated image data recorded in the memory 20, and obtains the second thumbnail image data and the second view image data. Generate.

  The reduced image generation unit 18 adjusts the image data size of the second thumbnail image to generate data of the first thumbnail image. Specifically, the reduced image generation unit 18 adds black margin data of 15 pixels by 160 pixels to the top and bottom of the second thumbnail image. In this way, data of the first thumbnail image of 120 pixels vertically × 160 pixels horizontally (aspect ratio 3: 4) is generated. Here, the black data is data in which the values of RGB colors are (R, G, B) = (0, 0, 0).

  Similarly, the reduced image generation unit 18 adjusts the image data size of the second view image to generate data of the first view image. Specifically, the reduced image generation unit 18 converts the image data size of the second view image into 180 vertical pixels × 320 horizontal pixels (aspect ratio 9:16). After that, the reduced image generation unit 18 adds black margin data of 30 pixels vertically by 320 pixels horizontally above and below the second view image. In this way, data of the first view image of 240 vertical pixels × 320 horizontal pixels (aspect ratio 3: 4) is generated. The first thumbnail image and the first view image include a reduced image having an aspect ratio of 9:16 corresponding to the main image.

  Then, the CPU 22 associates the main image data, the first thumbnail image data, the second thumbnail image data, the first view image data, the second view image data, and the header data. Thus, one image file is generated. The CPU 22 of the second embodiment manages data indicating that the second thumbnail image and the second view image are recorded, address information of each image (correspondence between the image data and the address in the image file), etc. Is recorded in the header part.

Next, the operation in the playback mode in the second embodiment will be described. In particular, in the second embodiment, an example will be described in which an electronic camera displays a reproduced image on an external image display device (such as a television).
First, the CPU 22 sets the aspect ratio of the display image output to the image display device. For example, the CPU 22 sets the aspect ratio of the display image to either 3: 4 or 9:16 based on a user input from the operation unit 28. Alternatively, the CPU 22 may automatically set the aspect ratio of the display image to 9:16 when the HDTV output unit 26 is connected to the image display device.

When the electronic camera is set to the playback mode by the user's mode switching operation, the CPU 22 displays an index screen on the image display device via the HDTV output unit 26 or the SDTV output unit 27.
Here, when the setting of the image data size is the first size or the second size, the CPU 22 generates thumbnail display data from the thumbnail image data in the same manner as in the first embodiment. On the other hand, when the setting of the image data size is the third size, the CPU 22 reads the second thumbnail image with reference to the management data. Then, the CPU 22 performs a thinning process on the data of the second thumbnail image to generate thumbnail display data having an aspect ratio of 9:16. Note that the CPU 22 performs vertical / horizontal conversion of the thumbnail display data as necessary based on the data of the photographing posture of the main image.

Thereafter, the CPU 22 writes an image in the frame memory of the HDTV output unit 26 or the SDTV output unit 27 based on the thumbnail display data. Then, the HDTV output unit 26 or the SDTV output unit 27 displays each thumbnail image on the index screen of the image display device. The index screen of the second embodiment has the same format as in FIG.
When there is a designation input of a thumbnail image to be enlarged, the CPU 22 enlarges and displays the view image corresponding to the designated image on the monitor 25 alone.

Here, when the aspect ratio of the display image is set to 9:16, the CPU 22 displays the view image as follows. In the case of an image file corresponding to the first size or the second size, the CPU 22 adjusts the image size of the display image, for example, by adding margins to the left and right of the view image (note that the display state in this case is illustrated) (Omitted).
In the case of an image file corresponding to the third size, the CPU 22 outputs the data of the second view image to the image display device. The state in which the second view image is displayed on the image display device having an aspect ratio of 9:16 has the same format as that in FIG. Since the data of the second view image is optimized to the standard of the image display device as described above, the CPU 22 can quickly display the view image on the image display device having an aspect ratio of 9:16. In addition, since the resolution of the second view image is higher than that of the first view image, the user can view a clearer image on the image display device.

  On the other hand, when the aspect ratio of the display image is set to 3: 4, the CPU 22 displays the view image as follows. In the case of an image file corresponding to the first size or the second size, the CPU 22 performs interpolation processing on the view image data and outputs it to the image display device. The display format of the view image in this case is the same as that shown in FIGS. In the case of an image file corresponding to the third size, the CPU 22 performs interpolation processing on the data of the first view image and outputs the data to the image display device. FIG. 12A shows a state in which the first view image is displayed in the horizontal position on the image display device having an aspect ratio of 3: 4. FIG. 12B shows a state in which the first view image is displayed in the vertical position on the image display device having an aspect ratio of 3: 4.

In the second embodiment, a case where an image file corresponding to the third size is played back by another image playback device will be described. Here, as in the first embodiment, the description is based on the premise of playback on another electronic camera that supports the Exif standard and the view image standard but does not support the above-described third size image display. I do.
Other electronic cameras cannot read the data of the second thumbnail image and the data of the second view image in the image file. For this reason, when the image file is reproduced by another electronic camera, the data of the first thumbnail image and the data of the first view image are used.

  FIG. 13 shows a display example of an index screen by another electronic camera in the second embodiment. The thumbnail images (T1 to T12) displayed on the index screen shown in FIG. 13 correspond to the thumbnail images with the same signs on the index screens shown in FIGS. T4, T6, and T9 to T11 on the index screen in FIG. 13 are first thumbnail images. In T4, T6, and T9 to T11 (first thumbnail images), reduced images having the same aspect ratio as the main image are displayed.

Moreover, the display of the 1st view image by another electronic camera is shown in FIG. FIG. 14A shows a state in which the first view image is displayed in a horizontal position on an image display device having an aspect ratio of 3: 4 by another electronic camera. FIG. 14B shows a state in which the first view image is displayed in a vertical position on an image display device having an aspect ratio of 3: 4 by another electronic camera.
(Description of the third embodiment)
Next, operations in the shooting mode and the playback mode by the electronic camera of the third embodiment will be described.

  In the shooting mode of the third embodiment, the CPU 22 generates a set of a main image file and a reduced image file. Specifically, when the user performs shooting with the aspect ratio of the main image set to 9:16, the CPU 22 generates a first main image file and a first reduced image file. When the user performs shooting with the aspect ratio of the main image set to 3: 4, the CPU 22 generates a second main image file and a second reduced image file. A reduced image of the main image is recorded in each of the first reduced image file and the second reduced image file.

For example, in the second embodiment, it may be difficult to record the high-resolution reduced image data together with the main image data in one image file. However, according to the third embodiment, the same effect as in the second embodiment can be obtained by recording high-resolution reduced image data in the reduced image file.
FIG. 15 is a diagram schematically showing the first main image file and the first reduced image file.

The first main image file includes first main image data, first thumbnail image data, first view image data, and first management data. The first main image file records each data in a data structure conforming to the Exif standard.
Further, the aspect ratio of the first main image is set to 9:16. As an example, the image data size of the first main image in FIG. 15 is set to vertical 1728 pixels × horizontal 3072 pixels (aspect ratio 9:16).

  The first thumbnail image and the first view image are generated from the first main image by the reduced image generation unit 18. The image data size of the first thumbnail image is set to 120 pixels vertically × 160 pixels horizontally (aspect ratio 3: 4) in accordance with the Exif standard. Further, the data size of the first view image is set to 240 vertical pixels × 320 horizontal pixels (aspect ratio 3: 4) corresponding to QVGA. Therefore, the data of the first thumbnail image and the first view image is ensured to be compatible with the image reproducing device corresponding to each standard.

  Here, the aspect ratio of the first thumbnail image and the first view image is different from the aspect ratio of the first main image. Therefore, the reduced image generation unit 18 generates the first thumbnail image and the first view image in the following manner. Specifically, when generating the first thumbnail image, the reduced image generating unit 18 reduces the data of the first main image to 90 pixels vertically × 160 pixels horizontally (aspect ratio 9:16). Then, the reduced image generation unit 18 adds the black margin data of 15 pixels in the vertical direction and 160 pixels in the horizontal direction to the upper and lower sides of the reduced image to generate the data of the first thumbnail image.

  Similarly, when generating the first view image, the reduced image generating unit 18 reduces the data of the first main image to 180 vertical pixels × 320 horizontal pixels (aspect ratio 9:16). Then, the reduced image generation unit 18 generates the data of the first view image by adding black margin data of 30 pixels vertically and 320 pixels horizontally to the top and bottom of the reduced image. Therefore, the first thumbnail image and the first view image include a reduced image obtained by reducing the first main image with an aspect ratio of 9:16.

  The first management data is data indicating that the first reduced image file exists separately from the first main image file. In the third embodiment, the first management data includes data of the file name of the first reduced image file. In the third embodiment, in each main image file, an address for recording management data is defined in advance. Note that the data of the first view image and the first management data are recorded in the first main image file using the MakerNote tag.

On the other hand, the first reduced image file includes data of the second thumbnail image and data of the second view image. Each image of the first reduced image file is an image to be displayed on a dedicated image reproduction device. Then, the second thumbnail image and the second view image are generated from the first main image by the reduced image generation unit 18.
Here, the image data size of the second thumbnail image is set to 90 pixels vertically × 160 pixels horizontally (aspect ratio 9:16). Furthermore, the image data size of the second view image is set to 360 vertical pixels × 640 horizontal pixels (aspect ratio 9:16). The aspect ratio of the second thumbnail image and the second view image is the same as that of the first main image. Therefore, the reduced image generation unit 18 can reduce the first main image without changing the aspect ratio and generate the data of the second thumbnail image and the second view image. Note that the image data size of the second view image is a size optimized in accordance with the standard of the image display device.

  Further, the CPU 22 assigns a file name indicating the relevance to the first main image file to the first reduced image file. As an example, the CPU 22 gives the first reduced image file a file name obtained by combining the name indicating the first reduced image file and the file name of the related first main image file. Alternatively, the CPU 22 may share the file names of the first main image file and the first reduced image file while making the extensions of both different. In this case, the CPU 22 can recognize the relevance by the file name. Further, the CPU 22 can identify each image file by the extension.

FIG. 16 is a diagram schematically showing the second main image file and the second reduced image file.
The second main image file includes second main image data, third thumbnail image data, third view image data, and second management data. The second main image file records each data in a data structure conforming to the Exif standard.
Further, the aspect ratio of the second main image is set to 3: 4. As an example, the image data size of the second main image in FIG. 16 is set to 2304 pixels long × 3072 pixels wide (aspect ratio 3: 4).

  The third thumbnail image and the third view image are generated from the second main image by the reduced image generation unit 18. The image data size of the third thumbnail image is set to 120 pixels vertically × 160 pixels horizontally (aspect ratio 3: 4) in accordance with the Exif standard. Further, the data size of the third view image is set to 240 vertical pixels × 320 horizontal pixels (aspect ratio 3: 4) corresponding to QVGA. Therefore, the data of the third thumbnail image and the third view image is also ensured to be compatible with the image reproducing device corresponding to each standard. The aspect ratio of the third thumbnail image and the third view image is the same as that of the second main image. Therefore, the reduced image generation unit 18 can reduce the main image without changing the aspect ratio and generate the data of the third thumbnail image and the third view image.

The second management data is data indicating that a second reduced image file exists separately from the second main image file. In the third embodiment, the second management data includes data of the file name of the second reduced image file. Note that the data of the third view image and the second management data are recorded in the second main image file using the MakerNote tag.
On the other hand, the second reduced image file includes the data of the fourth view image, the fifth thumbnail image, and the fifth view image. Each image of the second reduced image file is an image to be displayed on a dedicated image reproduction device. Then, the fourth view image, the fifth thumbnail image, and the fifth view image are generated from the second main image by the reduced image generation unit 18.

  Here, the image data size of the fourth view image is set to 360 vertical pixels × 640 horizontal pixels (aspect ratio 9:16). Therefore, like the second view image, the image data size of the fourth view image is optimized in accordance with the standard of the image display device. The aspect ratio of the fourth view image is different from the aspect ratio of the second main image. Therefore, the reduced image generation unit 18 generates the fourth view image in the following manner. Specifically, the reduced image generating unit 18 reduces the data of the second main image to 360 vertical pixels × horizontal 480 pixels (aspect ratio 3: 4). Then, the reduced image generation unit 18 adds the black margin data of 360 pixels × 80 pixels to the left and right of the reduced image to generate the data of the fourth view image. Therefore, the fourth view image includes a reduced image obtained by reducing the second main image with an aspect ratio of 3: 4.

  Similar to the third thumbnail image, the image data size of the fifth thumbnail image is set to 120 pixels vertically × 160 pixels horizontally (aspect ratio 3: 4). Further, the data size of the fifth view image is set to 240 vertical pixels × 320 horizontal pixels (aspect ratio 3: 4), as in the third view image. Normally, the same data as the third thumbnail image and the third view image is recorded as the data of the fifth thumbnail image and the fifth view image.

  The fifth thumbnail image and the fifth view image are recorded in the second reduced image file in order to perform high-speed image display with a dedicated image reproduction device. Since a second main image having a large amount of data is recorded in the second main image file, it takes a relatively long time to read out the third thumbnail image and the third view image. Therefore, in the present embodiment, high-speed image display is realized by storing the fifth thumbnail image and the fifth view image in the second reduced image file that has a small amount of data and can be read out in a relatively short time. Is. When the second main image is taken in the vertical position, the reduced image generation unit 18 may generate the fifth thumbnail image and the fifth view image in a state in which the image has been converted in the vertical and horizontal directions (when the vertical and horizontal conversion is performed). (The illustration is omitted).

Further, the CPU 22 assigns a file name indicating relevance to the second main image file to the second reduced image file. Note that the method of naming the second reduced image file is the same as that for the first reduced image file and the first main image file, and therefore, a duplicate description is omitted.
In the shooting mode of the third embodiment, the CPU 22 records the main image file and the reduced image file separately in different folders of the recording medium 31. Specifically, the CPU 22 records the first main image file and the second main image file in the first folder. Further, the CPU 22 records the first reduced image file and the second reduced image file in the second folder.

Next, the operation in the playback mode in the third embodiment will be described. In the third embodiment, as in the second embodiment, an example in which an electronic camera displays a reproduced image on an external image display device will be described.
The CPU 22 sets the aspect ratio of the display image output to the image display device. For example, the CPU 22 sets the aspect ratio of the display image to either 3: 4 or 9:16 based on a user input from the operation unit 28. Alternatively, when the HDTV output unit 26 is connected to the image display device, the CPU 22 may automatically set the aspect ratio of the display image to 9:16.

  When the electronic camera is set to the playback mode by the user's mode switching operation, the CPU 22 displays an index screen on the image display device via the HDTV output unit 26 or the SDTV output unit 27. The format of the index screen in the third embodiment is the same as that in FIG. Further, when the user inputs a designation of a thumbnail image to be enlarged, the CPU 22 enlarges and displays the view image corresponding to the designated thumbnail image on the image display device alone.

Here, reading of image data in the playback mode in the electronic camera of the third embodiment will be described with reference to the flowchart of FIG.
Step 301: The CPU 22 selects a main image file to be displayed from a group of main image files in the first folder of the recording medium 31.
Step 302: The CPU 22 determines whether or not the aspect ratio of the image display device is set to 9:16. If the aspect ratio is set to 9:16 (YES side), the process proceeds to S303. On the other hand, when the aspect ratio is set to 3: 4 (NO side), the process proceeds to S308.

  Step 303: The CPU 22 retrieves management data (first management data or second management data) from the main image file (first main image file or second main image file) selected as the display target in S301. In the third embodiment, since the address of management data is defined in this image file, the CPU 22 can directly access the management data. Therefore, the CPU 22 can quickly determine the presence / absence of management data and read the management data.

  Step 304: The CPU 22 determines whether there is management data in the main image file based on the search result in S303. If there is management data in the image file (YES side), the process proceeds to S305. On the other hand, when there is no management data in the main image file (NO side), the process proceeds to S308. In addition, as said case, the case where the image file of a display object is an image file image | photographed with the other electronic camera etc. correspond.

Step 305: The CPU 22 reads a reduced image file (first reduced image file or second reduced image file) associated with the main image file selected as a display target from the second folder of the recording medium 31. Specifically, the CPU 22 searches for the reduced image file based on the file name of the reduced image file recorded in the management data.
Step 306: The CPU 22 determines whether or not the reduced image file has been read (successful reading) in S305. If the reading is successful (YES side), the process proceeds to S307. On the other hand, if reading of the reduced image file fails due to damage or deletion of the reduced image file (NO side), the process proceeds to S308.

  Step 307: The CPU 22 outputs the thumbnail image or view image data of the reduced image file read in S305 to the image display device. Here, compared with the image file of the first embodiment and the second embodiment and the main image file of the present embodiment, the data amount of the reduced image file is relatively small because there is no data of the main image. Therefore, in the case of the third embodiment, the CPU 22 can read image data from the reduced image file at a higher speed than reading from the main image file.

Hereinafter, the case where the CPU 22 reads the first reduced image file in S305 will be specifically described. In this case, in displaying the index screen, the CPU 22 outputs the data of the second thumbnail image to the image display device.
In displaying an enlarged image, the CPU 22 outputs data of the second view image to the image display device. Since the data of the second view image is optimized to the standard of the image display device as described above, the CPU 22 can quickly display the second view image on the image display device. In addition, since the resolution of the second view image is higher than that of the first view image, the user can view a clearer image on the image display device.

Next, the case where the CPU 22 reads the second reduced image file in S305 will be specifically described. In this case, in displaying the index screen, the CPU 22 outputs the data of the fifth thumbnail image to the image display device.
In displaying the enlarged image, the CPU 22 outputs the data of the fourth view image to the image display device. Since the data of the fourth view image is optimized to the standard of the image display device as described above, the CPU 22 can quickly display the fourth view image on the image display device. In addition, since the resolution of the fourth view image is higher than that of the third view image, the user can view a clearer image on the image display device.

Step 308: In this case, (1) when the aspect ratio of the display image is set to 3: 4, (2) when reading an image file taken with another electronic camera, (3) a reduced image of the second folder Either the file is damaged or it has been erased.
In the case of S308, the CPU 22 reads out the thumbnail image and the view image from the image file corresponding to the Exif standard. Then, the CPU 22 outputs data of each image to the image display device. In particular, when the first main image file is a display target, the CPU 22 outputs data of the first thumbnail image and the first view image to the image display device. If the second main image file is to be displayed, the CPU 22 outputs the data of the third thumbnail image and the third view image to the image display device. Above, description of the flowchart of FIG. 17 is complete | finished.

  Even when the aspect ratio setting of the display image is 3: 4, the CPU 22 may read the image of the reduced image file with priority over the image of the main image file. In particular, when displaying the enlarged image, when the CPU 22 processes and displays the data of the second view image or the fourth view image, it displays more than when generating the enlarged image from the first view image or the third view image. A high resolution image is displayed on the device.

  When the aspect ratio of the display image is set to 3: 4 and the second main image file is a display target, the CPU 22 stores the data of the fifth thumbnail image and the fifth view image of the second reduced image file. May be output to the image display device. In this case, the CPU 22 can display the enlarged image at a higher speed than when reading the data of the third view image from the main image file. Furthermore, when the fifth thumbnail image and the fifth view image are generated by converting the main image captured in the vertical position in advance to the horizontal and vertical directions, the CPU 22 directly reads out each of these images, so that the vertical and horizontal conversion processing at the time of reproduction is unnecessary. Become. For this reason, it is possible to display an image at a higher speed.

Next, a case where an image file generated by the electronic camera of the third embodiment is played back by another image playback device will be described. Here, the description will be made on the premise of reproduction on another electronic camera that supports the Exif standard and the view image standard but does not support the reduced image file.
In other electronic cameras, the data of the first main image file and the second main image file are compliant with the Exif standard and can be read out. On the other hand, other electronic cameras cannot read the first management data and the second management data. Therefore, in the other electronic cameras, when reproducing the main image file, the first reduced image file and the second reduced image file that are related to each main image file cannot be read.

  Therefore, when each main image file is played back by another electronic camera, the thumbnail image (first thumbnail image or third thumbnail image) and view image (first view image or third view) recorded in the main image file are reproduced. Image) will be used. The thumbnail image and the view image are displayed on the display device in an aspect ratio of 3: 4 in accordance with the respective standards.

(Supplementary items of the embodiment)
(1) In the above embodiment, an example in which an image is reproduced by an electronic camera has been described. However, according to the present invention, a reproduction-only device (viewer) having a function of reproducing an image file based on the image display size data of the first embodiment, or a general-purpose computer that executes an image reproduction program is used. An image reproduction device similar to an electronic camera may be configured.

Further, a similar image playback device is configured by a playback-only device that plays back an image file or a general-purpose computer that executes an image playback program based on the second thumbnail image or the second view image of the second embodiment. Also good.
(2) The relationship between the aspect ratio of the image sensor 12 and the aspect ratio of the image data in the present invention is not limited to the example of the above embodiment. For example, the present invention can be applied to a case where the image sensor 12 has an aspect ratio of 9:16 and a 3: 4 image is generated.

  (3) The configuration of the electronic camera of the above embodiment is merely an example. For example, a dedicated circuit (ASIC) in which functions such as a digital processing unit 16, a color interpolation processing unit 17, a reduced image generation unit 18, and a compression / decompression processing unit 19 are integrated is provided in an electronic camera, and image file generation processing is performed with this ASIC May be performed. In the above embodiment, an example in which the CPU 22 executes the interpolation process and the thinning process has been described. However, the digital process unit 16, the reduced image generation unit 18, and the like may bear the above process.

(4) In the second embodiment, it is not always necessary to record management data in the header portion of the image file corresponding to the third size. For example, an address for arranging the second thumbnail image and the second view image is determined in advance in the image file, and the image reproducing apparatus determines the type of the image file based on whether there is image data at this address. May be.
(5) In the second embodiment, the image data size of the second view image may be set to vertical 720 pixels × horizontal 1280 pixels (aspect ratio 9:16).

  (6) In the second embodiment, the example in which the digital processing unit 16 performs the trimming process in the case of the third size imaging has been described, but the present invention is not limited thereto. For example, when shooting in the third size in the second embodiment, only a predetermined range of image signals may be read from the image sensor 12 in advance by partial reading. Alternatively, the trimming process of the main image data may be performed by the CPU 22, and the trimming process of the second thumbnail image data and the second view image data may be performed by the reduced image generation unit 18. In this case, the reduced image generation unit 18 may perform a process of converting the blank portions of the first thumbnail image data and the first view image data to black.

(7) In the third embodiment, the association between each main image file and the reduced image file is not limited to the method shown in the embodiment. For example, in the third embodiment, the CPU 22 may record a plurality of main image files and reduced image files in the same folder without dividing them into separate folders.
In the third embodiment, the CPU 22 may record path data indicating the storage location of the reduced image file in the management data of the main image file. In this case, the same effect as in the above embodiment can be obtained even if the file names of the main image file and the reduced image file are not related.

In the third embodiment, the CPU 22 may generate a folder for each pair of the main image file and the reduced image file, and record the pair of the main image file and the reduced image file in the same folder. In this case, the main image file and the reduced image file are associated with each other by each folder.
Furthermore, in the third embodiment, the CPU 22 may record the main image file and the reduced image file in separate folders, while omitting management data from the main image file. Then, the CPU gives a file name related to the main image file to the reduced image file. In this case, the CPU 22 reproduces each image by directly referring to the second folder during reproduction. When referring to the main image data in image printing or the like, the CPU 22 may access the main image file in the first folder based on the file name.

The block diagram which shows the structure of the electronic camera of 1st Embodiment. The figure which shows an example of the image size table of 1st Embodiment. The figure which shows each image of 1st size and 3rd size typically Flow chart showing an example of the operation of the electronic camera in shooting mode Flow chart showing an example of operation of electronic camera in playback mode The figure which shows an example of the index screen in 1st Embodiment. The figure which shows the display example of the view image The figure which shows the example of a display of the index screen by the other electronic camera in 1st Embodiment. The figure which shows the example of a display of the view image by another electronic camera The figure which shows an example of the image size table of 2nd Embodiment. The figure which shows typically each image of the 3rd size in 2nd Embodiment. The figure which shows the state which displayed the 1st view image on the image display apparatus of aspect ratio 3: 4 The figure which shows the example of a display of the index screen by the other electronic camera in 2nd Embodiment. The figure which shows the state which displayed the 1st view image in the image display apparatus of aspect ratio 3: 4 in another electronic camera. Schematic diagram showing a first main image file and a first reduced image file in the third embodiment Schematic diagram showing a second main image file and a second reduced image file in the third embodiment Flowchart for explaining reading of image data in the reproduction mode of the third embodiment

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 ... Imaging optical system, 12 ... Image sensor, 13 ... Analog processing part, 14 ... A / D conversion part, 16 ... Digital processing part, 17 ... Color interpolation processing part, 18 ... Reduced image generation part, 22 ... CPU, 23 ... Recording I / F, 25 ... Monitor, 26 ... HDTV output unit, 27 ... SDTV output unit, 28 ... Operation unit, 31 ... Recording medium

Claims (43)

An imaging unit that captures a subject image and generates a main image;
The number of recording pixels of the main image is set, the aspect ratio of the main image is set to a first aspect ratio corresponding to an image size that maximizes the number of recording pixels, and a second aspect ratio different from the first aspect ratio. A shooting setting section to be set to one of
When generating the main image at the second aspect ratio, the first image having the first aspect ratio including a reduced image obtained by reducing the main image while maintaining the aspect ratio at the second aspect ratio is generated. A reduced image generation unit;
The first image data including the main image data having the second aspect ratio, the first image data having the first aspect ratio, and first management data indicating that the main image has the second aspect ratio. An image file generator for generating an image file;
An imaging apparatus comprising: The imaging device according to claim 1,
The reduced image generation unit generates the second image by reducing the main image while maintaining the aspect ratio at the first aspect ratio when generating the main image at the first aspect ratio.
The image file generation unit indicates the data of the main image having the first aspect ratio, the data of the second image having the first aspect ratio, and the main image having the first aspect ratio. An imaging apparatus that generates a second image file including second management data. The imaging device according to claim 1,
When generating the main image with the second aspect ratio, the imaging unit generates the captured image with the first aspect ratio including the main image with the second aspect ratio;
The reduced image generation unit generates the first image by reducing the captured image. The imaging device according to claim 1,
The reduced image generation unit adds a mark indicating that the reduced image has the second aspect ratio to a portion of the first image other than the reduced image. The imaging device according to claim 1,
The first image is at least one of a thumbnail image conforming to a DCF standard and a display image used for display on an image display device of the imaging device. The first aspect ratio is set to a first aspect ratio different from the second aspect ratio, including data of the second aspect ratio main image and a reduced image obtained by reducing the main image while maintaining the aspect ratio at the second aspect ratio. A first image file including data of one image and first management data indicating that the main image has the second aspect ratio;
The main image data having the first aspect ratio, the second image data obtained by reducing the main image while maintaining the aspect ratio at the first aspect ratio, and the main image having the first aspect ratio. An image reproducing apparatus capable of reproducing a second image file including second management data indicating:
A data reading unit for reading data of at least one of the first image file and the second image file;
A determination unit for determining an aspect ratio of the main image of the read image file based on the first management data or the second management data;
A display output unit that cuts out the reduced image from the first image of the first image file and outputs it to an image display device when the determination unit determines that the main image has the second aspect ratio;
An image reproducing apparatus comprising: The image reproduction apparatus according to claim 6, wherein
The display output unit outputs the second image of the second image file to an image display device when the determination unit determines that the main image has the first aspect ratio. apparatus. The image reproduction apparatus according to claim 6, wherein
The image reproduction device according to claim 1, wherein the first image is at least one of a thumbnail image conforming to a DCF standard and a display image used for display on an image display device of an imaging device. The first aspect ratio is set to a first aspect ratio different from the second aspect ratio, including data of the second aspect ratio main image and a reduced image obtained by reducing the main image while maintaining the aspect ratio at the second aspect ratio. A first image file including data of one image and first management data indicating that the main image has the second aspect ratio;
The main image data having the first aspect ratio, the second image data obtained by reducing the main image while maintaining the aspect ratio at the first aspect ratio, and the main image having the first aspect ratio. For the control unit of the image reproducing apparatus capable of reproducing the second image file including the second management data indicating
A first step of reading at least one data of the first image file and the second image file into the control unit;
A second step of determining an aspect ratio of the main image of the read image file based on the first management data or the second management data;
A third step of cutting out the reduced image from the first image of the first image file and outputting it to an image display device when the main image has the second aspect ratio;
Is executed by the control unit. The program according to claim 9,
The program further comprising: a fourth step of outputting the second image of the second image file to an image display device when the main image has the first aspect ratio. An imaging unit that captures a subject image and generates a main image;
The number of recording pixels of the main image is set, and the aspect ratio of the main image is set to a first aspect ratio corresponding to an image size that maximizes the number of recording pixels, and a second aspect ratio different from the first aspect ratio. A shooting setting section to be set to one of
When generating the main image at the second aspect ratio, the first image having the first aspect ratio including a reduced image obtained by reducing the main image while maintaining the aspect ratio at the second aspect ratio; A reduced image generation unit that generates a second image obtained by reducing the main image while maintaining a ratio at the second aspect ratio;
An image file generation unit that generates an image file including the main image data, the first image data, and the second image data;
An imaging apparatus comprising: The imaging device according to claim 11,
The imaging apparatus, wherein the image file generation unit further includes management data indicating presence / absence of data of the second image in the image file. The imaging device according to claim 11,
The first image is at least one of a thumbnail image conforming to a DCF standard and a display image used for display on an image display device of the imaging device. The imaging device according to claim 11,
The image pickup apparatus, wherein the second image is a display image used for display on an image display apparatus, and is generated with an image size conforming to a standard of the image display apparatus. The imaging device according to claim 11,
The reduced image generation unit adjusts an image size by adding margin data to the reduced image when generating the first image. The first aspect ratio is set to a first aspect ratio different from the second aspect ratio, including data of the second aspect ratio main image and a reduced image obtained by reducing the main image while maintaining the aspect ratio at the second aspect ratio. An image reproducing apparatus capable of reproducing an image file including data of one image and data of a second image obtained by reducing the main image while maintaining an aspect ratio at the second aspect ratio,
A data reading unit for reading data of the image file;
A determination unit for determining presence or absence of data of the second image in the read image file;
A display output unit that outputs the second image to an image display device when the data of the second image is included;
An image reproducing apparatus comprising: The image reproduction apparatus according to claim 16, wherein
The image file further includes management data indicating presence / absence of data of the second image,
The determination unit performs the determination based on the management data. The image reproduction apparatus according to claim 16, wherein
The image reproduction device according to claim 1, wherein the first image is at least one of a thumbnail image conforming to a DCF standard and a display image used for display on an image display device of an imaging device. The image reproduction apparatus according to claim 16, wherein
A detector that detects a display aspect ratio of the image display device;
The image reproduction device, wherein the display output unit selects an image to be output to the image display device from either the first image or the second image according to the display aspect ratio. The image reproduction apparatus according to claim 16, wherein
It further includes an operation unit that accepts an input for specifying the aspect ratio of the display image from the user,
The image output device according to claim 1, wherein the display output unit selects an image to be output to the image display device from one of the first image and the second image in accordance with the input. Data of a main image having a second aspect ratio, data of a first image including a reduced image obtained by reducing the main image while maintaining the aspect ratio and set to a first aspect ratio different from the second aspect ratio; With respect to the control unit of the image reproducing apparatus capable of reproducing the image file including the second image data reduced while maintaining the aspect ratio of the main image,
A first step of reading data of the image file into the control unit;
A second step of determining the presence or absence of data of the second image in the read image file;
A third step of outputting the second image to an image display device when the data of the second image is included;
Is executed by the control unit. The program according to claim 21, wherein
The image file further includes management data indicating presence / absence of data of the second image,
The program according to claim 2, wherein the determination is performed based on the management data in the second step. An imaging unit that captures a subject image and generates a main image;
The number of recording pixels of the main image is set, the aspect ratio of the main image is set to a first aspect ratio corresponding to an image size that maximizes the number of recording pixels, and a second aspect ratio different from the first aspect ratio. A shooting setting section to be set to one of
When generating the main image at the second aspect ratio, the first image having the first aspect ratio including a reduced image obtained by reducing the main image while maintaining the aspect ratio at the second aspect ratio; A reduced image generation unit that generates a second image obtained by reducing the main image while maintaining a ratio at the second aspect ratio;
An image file generation unit for generating a first main image file and a first reduced image file,
The first main image file includes data of the main image having the second aspect ratio, and data of the first image having the first aspect ratio,
The imaging apparatus according to claim 1, wherein the first reduced image file includes data of the second image having the second aspect ratio. The imaging device according to claim 23,
The reduced image generation unit generates a third image obtained by reducing the main image while maintaining the aspect ratio at the first aspect ratio when generating the main image at the first aspect ratio.
The image file generation unit generates a second main image file including data of the main image having the first aspect ratio and data of the third image having the first aspect ratio. Imaging device. The imaging apparatus according to claim 24,
The reduced image generation unit includes the second aspect ratio including a reduced image obtained by reducing the main image while maintaining the aspect ratio at the first aspect ratio when generating the main image at the first aspect ratio. Further generating a fourth image of
The imaging apparatus, wherein the image file generation unit further generates a second reduced image file including data of the fourth image having the second aspect ratio. The imaging apparatus according to claim 24,
The reduced image generation unit further generates a fifth image obtained by reducing the main image while maintaining the aspect ratio at the first aspect ratio when the main image is generated at the first aspect ratio.
The imaging apparatus, wherein the image file generation unit further generates a second reduced image file including data of the fifth image having the first aspect ratio. The imaging device according to claim 23 or claim 24,
The imaging device, wherein the first image and the third image are at least one of a thumbnail image conforming to a DCF standard and a display image used for display on an image display device of the imaging device. The imaging device according to claim 23 or claim 25,
The second image and the fourth image are display images used for display on an image display device, and are generated with an image size conforming to a standard of the image display device. . The imaging device according to claim 23 or claim 25,
The image file generation unit associates a first association process for associating the first main image file with the first reduced image file, and an association between the second main image file and the second reduced image file. One of the second association processes is further executed. The imaging device according to claim 29,
The image file generation unit includes first management data indicating the presence of the first reduced image file in the first association image in the first association process, and includes the second reduced image in the second association process. An image pickup apparatus comprising second management data indicating the existence of a file in the second main image file. The imaging device according to claim 29,
The image file generation unit assigns a file name indicating a relationship with the first main image file to the first reduced image file in the first association process, and the second file in the second association process. An image pickup apparatus, wherein a file name indicating relevance with an image file is assigned to the second reduced image file. The imaging device according to claim 29,
A first folder that records at least one of the first main image file and the second main image file; and a second folder that records at least one of the first reduced image file and the second reduced image file. Further comprising a recording unit having
In the first association process, the image file generation unit records the first main image file in the first folder, records the first reduced image file in the second folder, and performs the second association. In the processing, the second main image file is recorded in the first folder, and the second reduced image file is recorded in the second folder. A first main image file, a first reduced image file associated with the first main image file, a second main image file, and a second reduced image file associated with the second main image file; A reproducible image reproducing device,
The first main image file includes data of a first main image having a second aspect ratio, a reduced image obtained by reducing the first main image while maintaining the aspect ratio at the second aspect ratio, and the second aspect. The first image data set to a first aspect ratio different from the ratio,
The first reduced image file includes data of a second image obtained by reducing the first main image while maintaining an aspect ratio at the second aspect ratio;
The second main image file includes data of a second main image having the first aspect ratio, and data of a third image obtained by reducing the second main image while maintaining the aspect ratio at the first aspect ratio. ,
When the second reduced image file includes data of the fourth image having the second aspect ratio including a reduced image obtained by reducing the second main image while maintaining the aspect ratio at the first aspect ratio.
A data reading unit for reading data of the first main image file, the first reduced image file, the second main image file, and the second reduced image file;
A determination unit for determining presence or absence of the first reduced image file and the second reduced image file;
When the determination unit determines that there is the first reduced image file or the second reduced image file, the image display device displays the data of the second image or the fourth image when reproducing the reduced image having the second aspect ratio. A display output unit for outputting to
An image reproducing apparatus comprising: The image playback device according to claim 33, wherein
The first main image file further includes first management data indicating the presence of the first reduced image file, and the second main image file further includes second management data indicating the presence of the second reduced image file. Including
The determination unit determines whether or not the first reduced image file exists based on the first management data, and determines whether or not the second reduced image file exists based on the second management data. Playback device. The image playback device according to claim 33, wherein
The first reduced image file has a file name indicating relevance to the first main image file, and the second reduced image file has a file name indicating relevance to the second main image file. And
A file detector for detecting at least one of the first reduced image file and the second reduced image file based on the file name;
The image reproduction device according to claim 1, wherein the determination unit determines whether or not the first reduced image file and the second reduced image file exist based on a detection result of the file detection unit. The image playback device according to claim 33, wherein
The data reading unit includes a first folder including at least one data of the first main image file and the second main image file, and at least one of the first reduced image file and the second reduced image file. Reading each data from a recording means having a second folder containing the data;
The determination unit determines the presence or absence of the second folder,
The display output unit outputs data of the second folder to the image display device when reproducing a reduced image having the second aspect ratio. The image reproduction device according to any one of claims 33 to 36,
The second image and the fourth image are display images used for display on the image display device, and are generated with an image size conforming to a standard of the image display device. Image playback device. The image reproduction device according to any one of claims 33 to 36,
A detector that detects a display aspect ratio of the image display device;
In accordance with the display aspect ratio, the display output unit is any one of the first image and the third image having the first aspect ratio or the second image and the fourth image having the second aspect ratio. An image reproduction apparatus, wherein an image to be output to the image display apparatus is selected. The image reproduction device according to any one of claims 33 to 36,
It further includes an operation unit that accepts an input for specifying the aspect ratio of the display image from the user,
In response to the input, the display output unit outputs the first image and the third image having the first aspect ratio from the second image and the fourth image having the second aspect ratio. An image reproducing apparatus, wherein an image to be output to an image display apparatus is selected. A first main image file, a first reduced image file associated with the first main image file, a second main image file, and a second reduced image file associated with the second main image file; For the control unit of the reproducible image playback device,
The first main image file includes data of a first main image having a second aspect ratio, a reduced image obtained by reducing the first main image while maintaining the aspect ratio at the second aspect ratio, and the second aspect. The first image data set to a first aspect ratio different from the ratio,
The first reduced image file includes data of a second image obtained by reducing the first main image while maintaining an aspect ratio at the second aspect ratio;
The second main image file includes data of a second main image having the first aspect ratio, and data of a third image obtained by reducing the second main image while maintaining the aspect ratio at the first aspect ratio. ,
When the second reduced image file includes data of the fourth image having the second aspect ratio including a reduced image obtained by reducing the second main image while maintaining the aspect ratio at the first aspect ratio.
A first step of reading data of the first main image file, the first reduced image file, the second main image file, and the second reduced image file;
A second step of determining the presence or absence of the first reduced image file and the second reduced image file;
When the second step determines that there is the first reduced image file or the second reduced image file, the data of the second image or the fourth image is displayed when the reduced image having the second aspect ratio is reproduced. A third step of outputting to the device;
Is executed by the control unit. The program according to claim 40,
The first main image file further includes first management data indicating the presence of the first reduced image file, and the second main image file further includes second management data indicating the presence of the second reduced image file. Including
In the second step, the presence / absence of the first reduced image file is determined based on the first management data, and the presence / absence of the second reduced image file is determined based on the second management data. program. The program according to claim 40,
The first reduced image file has a file name indicating relevance to the first main image file, and the second reduced image file has a file name indicating relevance to the second main image file. And
A fourth step of detecting at least one of the first reduced image file and the second reduced image file based on the file name;
In the second step, the presence / absence of the first reduced image file and the second reduced image file is determined based on the detection result in the fourth step. The program according to claim 40,
In the first step, at least one of a first folder including data of at least one of the first main image file and the second main image file, at least one of the first reduced image file and the second reduced image file. Reading each data from a recording means having a second folder containing the data;
In the second step, the presence or absence of the second folder is determined,
In the third step, the second folder data is output to the image display device when the reduced image having the second aspect ratio is reproduced.

Images