JP4484775B2 - Playback apparatus and playback method - Google Patents

Description

  The present invention relates to a reproduction processing technique for reading and reproducing a thumbnail image from a recording medium such as a memory card in which a main image and a thumbnail image are recorded together.

  2. Description of the Related Art Conventionally, digital cameras that take still images and record them as digital data on a memory card are known.

  As a still image recording format in this type of digital camera, a format called DCF (Design Rule for Camera File system) is known.

  DCF is a file recording format for digital cameras, and the format is determined based on Exif (Exchangeable image file format).

  FIG. 8 shows the structure of a DCF basic file defined by DCF.

  The DCF basic file 1800 includes Exif information 1802 including thumbnail data 1803 including main image data 1804 compressed and encoded according to the JPEG method, thumbnail image data 1807 obtained by reducing the screen size (number of pixels) of the main image data 1804, and Is stored.

  Here, the DCF defines that the screen size of the thumbnail image data 1807 is set to 160 × 120 pixels regardless of the aspect ratio of the main image. In general, the Exif information 1802 also stores the width (number of pixels) of the main image and the height (number of pixels) of the main image.

  On the other hand, in recent years, digital cameras that can capture not only images with an aspect ratio of 4: 3 or an aspect ratio of 3: 2 but also still images with an aspect ratio of 16: 9 have appeared.

  A thumbnail image is stored when a main image (FIG. 10) with an aspect ratio of 16: 9 captured by a digital camera is stored as a DCF basic file. The thumbnail image is a letterbox format (FIG. 11) in which a black image is padded in the upper and lower areas with respect to a reduced image obtained by reducing the entire main image, or a squeeze format in which the aspect ratio is reduced to 4: 3 (horizontal direction). FIG. 15) is common.

  In addition, recent digital cameras have a function of shooting not only still images but also moving images. In such a digital camera, captured moving image data is stored in a memory card as an AVI format DCF extended image file.

  The DCF extended image file 1900 (FIG. 9) defined by the DCF is image data in which the main image is stored in a format different from JPEG, and the DCF stores a thumbnail image 1910 of a reduced image corresponding to the DCF extended image file. It is recommended that.

  In general, in a moving image, a reduced image of one specific frame (for example, the first frame) in a series of moving image data is used as a thumbnail image.

  The format of the thumbnail file 1910 is obtained by adding Exif information 1912 to the thumbnail data 1803 of the basic DCF file 1800.

  That is, the thumbnail image 1913 of the thumbnail file 1910 is also defined as 160 × 120 pixels. Generally, the Exif information 1912 stores the file format, image width, and image height of the related extended image file 1900.

  Such digital cameras generally have an index screen display function for displaying reduced images of image files stored in a memory card side by side on one screen (for example, Patent Document 1).

  The resolution of a display device such as an LCD of a digital camera is lower than that of a TV monitor or the like, and the number of pixels of image data recorded as a main image is generally about several million pixels. Therefore, a large load is applied to the decoder.

For this reason, when displaying the index screen, it is often the case that only the thumbnail images are read from the memory card and displayed as an index screen, rather than the main image data being decoded and displayed in a reduced size.
JP 2001-197445 A

  However, when the index screen is displayed using thumbnail images as described above, when the aspect ratio of the main image is 16: 9 and the thumbnail images are stored in letterbox format, the index screen 1200 shown in FIG. 4 is displayed. It becomes like this. In other words, thumbnail images 1201 and 1204 are displayed with padding with unnecessary black images above and below the reduced image.

  When the main image has an aspect ratio of 16: 9 and the thumbnail images are stored in a squeeze format, the vertically long thumbnail images 2001 and 2004 are displayed as in the index screen 2000 shown in FIG.

  In order to prevent this, an index image may be generated by reading out the main image instead of the thumbnail image from the memory card, and then decoding and reducing it.

  However, the image size of the main image is increasing year by year. In particular, when a large-size data such as main image data is processed on a device with limited resources such as a memory or CPU such as a digital camera, the processing load increases and the index screen display becomes slow. There is.

  The present invention has been made to solve the above-described problems, and its object is to quickly display a thumbnail image having the same aspect ratio as the main image when the aspect ratio of the thumbnail image is different from the aspect ratio of the main image. It is to realize a reproduction processing technology that can be displayed on the screen.

In order to solve the above problems, a playback device of the present invention is a playback device that plays back a plurality of main image data and thumbnail image data for the plurality of main image data from a recording medium,
A plurality of thumbnail images are displayed on the same screen with the same aspect ratio as that of the main image data corresponding to the thumbnail image data of the plurality of screens, and the number of vertical pixels of the plurality of thumbnail images is the same. Generating means for generating index image data indicating the index screen displayed with the number of pixels, and output means for outputting the index image data to a display device, the generating means in the same file as the thumbnail image data Information on the aspect ratio of the main image data corresponding to the thumbnail image data is read from the stored additional information, and the format of the thumbnail image data is a main image area corresponding to the aspect ratio of the main image data and other areas. Or the main image data. Read the format information to determine whether the lateral squeeze format with a reduced number of pixels, the generating means further if the format information is of the letterbox format, the other of the thumbnail image data The main image area excluding the area is extracted, and in the case of the squeeze format, the number of pixels in the horizontal direction of the thumbnail image data is expanded so as to be the same as the aspect ratio of the main image data .

The reproduction method of the present invention is a reproduction method in a reproduction apparatus for reproducing a plurality of main image data and thumbnail image data for the plurality of main image data from a recording medium, and corresponds to the thumbnail image data of a plurality of screens. An index screen displaying a plurality of thumbnail images on the same screen with the same aspect ratio as that of the main image data and displaying the number of vertical pixels of the plurality of thumbnail images with the same number of pixels. A generation step of generating index image data to be displayed, and an output step of outputting the index image data to a display device. In the generation step, the thumbnail image is obtained from additional information stored in the same file as the thumbnail image data. Read information about the aspect ratio of the main image data corresponding to the data. In addition, the thumbnail image data format is a letterbox format consisting of a main image area corresponding to the aspect ratio of the main image data and other areas, or the number of pixels in the horizontal direction of the main image data is reduced. The format information for determining whether the format is a squeeze format is read. In the generation step, when the format information is in the letterbox format, the main image area excluding the other area of the thumbnail image data In the case of the squeeze format, the number of pixels in the horizontal direction of the thumbnail image data is enlarged so as to be the same as the aspect ratio of the main image data .

  According to the present invention, when the aspect ratio of the thumbnail image is different from the aspect ratio of the main image, a thumbnail image having the same aspect ratio as the main image can be quickly displayed on the index screen.

  The best mode for carrying out the present invention will be described below in detail with reference to the accompanying drawings.

  The embodiment described below is an example as means for realizing the present invention, and should be appropriately modified or changed according to the configuration and various conditions of the apparatus to which the present invention is applied. It is not limited to the embodiment.

[First Embodiment]
The first embodiment is a process for generating and displaying an index screen with the same aspect ratio as the main image for a 4: 3 aspect ratio letterbox thumbnail image having a main image with an aspect ratio of 16: 9.

  FIG. 1 is a block diagram showing the configuration of the image reproducing apparatus according to the first embodiment of the present invention.

  In FIG. 1, a CPU 102 of an image reproduction apparatus 100 is connected to a RAM 103, a ROM 104, a key operation processing unit 105, an input image processing circuit 111, an output image processing circuit 121, and an AFE (Analog Front End) 142 via a bus 101. Yes. The CPU 102 operates according to a control program stored in the ROM 104, and uses the RAM 103 as a temporary information storage location during operation. The state of the key operation by the user is held in the key operation processing unit 105, and the control program of the CPU 102 periodically acquires the state of the key operation from the key operation processing unit 105. The control program of the CPU 102 controls the AFE 142, the input image processing circuit 111, and the output image processing circuit 121 based on the acquired state of the key operation, and generates and displays an index screen described later.

  The AFE 142 operates based on the control program, and outputs a captured image obtained by controlling the CCD 141 to the input image processing circuit 111.

  The input image processing circuit 111 operates based on the control of the control program, performs image processing on the captured image input from the AFE 142, and outputs the processed image to the output image processing circuit 121. Further, the JPEG codec 112 and the card control unit 115 are controlled, and the RAM 114 is used as a temporary information storage location during operation.

  The output image processing circuit 121 performs image processing on the image input from the input image processing circuit 111 according to the control program. Further, the LCD control unit 126, the speaker control unit 127, the video output control unit 128, and the digital I / F 129 are controlled, and the RAM 124 is used as a temporary information storage place during operation.

  The image playback apparatus 100 is provided with a memory card slot (not shown), and the card control unit 115 reads / writes data from / to the memory card C set in the slot.

<Index screen display>
First, image index screen display will be described.

  The image playback apparatus 100 is provided with a mode dial (not shown). When the user sets the mode dial to the playback mode, the control program of the CPU 102 acquires the mode dial status from the key operation processing unit 105 and plays back the image. Move to the mode to perform.

  In the mode for performing the reproduction operation, the control program controls the input image processing circuit 111 as follows to display the index screen of the image recorded on the memory card.

  FIG. 2 shows the state of data stored in the memory card C attached to the image playback device 100 in the present embodiment. As shown in FIG. 2, the memory card C stores two DCF basic files (IMG — 0001.JPG, IMG — 0002.JPG). In addition, two DCF extended image files (MVI_0003.AVI, MVI_0004.AVI) and two thumbnail files (MVI_0003.THM, MVI_0004.THM) corresponding to them are stored.

  FIG. 3 shows information relating to image data stored in the memory card.

  IMG — 0001. The image data stored in the JPG is 1920 × 1080 pixel still image data having an aspect ratio of 16: 9, and IMG — 0002. The image data stored in the JPG is still image data having an aspect ratio of 4: 3 with 1440 × 1080 pixels. In these files, main image data and thumbnail image data are stored in pairs. On the other hand, MVI_0003. The image data stored in the AVI is 640 × 480 pixel moving image data having an aspect ratio of 4: 3, and MVI — 0004. The image data stored in the AVI is moving image data having an aspect ratio of about 16: 9 with 848 × 480 pixels. Only the main image data is stored in these files. In the thumbnail files of these files, additional information regarding the file format of the main image data file, the width and height (number of pixels) of the main image data, and thumbnail images are stored. Data is stored.

  The control program of the CPU 102 controls the card control unit 115 and acquires file list information stored in the memory card. Only a DCF basic file with a file name extension of JPG and a thumbnail file with THM are extracted, and thumbnail image data is reproduced in order from the smallest four characters in the latter half of the file name, and displayed side by side as an index screen.

  The control program of the CPU 102 stores the background image in the RAM 114 via the input image processing circuit 111 prior to the reproduction of the thumbnail image data. As the background image, a natural image or graphics stored in the memory card C or the ROM 104, or graphics drawn by the control program or painting with a specific color can be selected.

  FIG. 7 shows the layout of the index screen and the allocation frame.

  Here, the dimension represents the number of pixels on the display screen. The display screen 1400 has 848 × 480 pixels and an aspect ratio of about 16: 9, and a background image 1401 is painted on the entire surface. Although the thumbnail image data is composed of 160 × 120 pixels, since this apparatus mainly handles 16: 9 image data, the allocation frames 1402 to 1405 for displaying the thumbnail image data have 384 × 216 pixels and an aspect ratio. 16: 9.

Here, an index screen generation and display process performed by the control program of the CPU 102 will be described. In the present embodiment, the following processing is executed according to the state of thumbnail image data displayed on the index screen.
(1) When the thumbnail image data is stored in the DCF basic file and the aspect ratio of the main image data is 16: 9 First, in the file list of FIG. 3, the file storing the thumbnail image data to be reproduced first is IMG_0001. . It becomes JPG. IMG — 0001. JPG is determined to be a DCF basic file 1800 (FIG. 8) from the extension JPG.

  The control program of the CPU 102 controls the input image processing circuit 111 and reads only the SOI (Start Of Image) 1801 and Exif information 1802 from the top of the file using the card control unit 115 from the memory card C. Store in the RAM 114. Here, the SOI 1801 has a fixed length. The Exif information 1802 has an unfixed length, but the size of the Exif information is stored in the head area, so that only the SOI 1801 and the Exif information 1802 can be read by reading them first. Exif information 1802 stores thumbnail image data 1807 and main image data width and height information.

  The control program of the CPU 102 obtains the width and height of the main image data from the Exif information stored in the RAM 114 via the input image processing circuit 111. Here, IMG — 0001. The main image data 1600 (FIG. 10) stored in the JPG has w0 = 1920, h0 = 1080, and an aspect ratio of 16: 9. Therefore, it is determined that the thumbnail image data 1700 (FIG. 11) included in the Exif information has the reduced image 1701 of the main image data allocated at the center position of the screen and padded with black images 1702 and 1703 evenly at the top and bottom. To do. That is, the thumbnail image data is w1 = 160 and h2 = 120, and it is determined that h1 = 90 and ht = hb = 15 from the aspect ratio of the main image data.

The control program of the CPU 102 controls the JPEG codec 112 of the input image processing circuit 111, decodes the thumbnail image data 1807 of the Exif information 1802 stored in the RAM 114, and stores it in the RAM 114. Subsequently, a 160 × 90 pixel area (reduced image) 1701 is extracted from the decoded thumbnail image data 1700 and is allocated to the first allocation frame 1402 of the background image 1401 (FIG. 7) stored in the RAM 114. Since the first allocation frame 1402 has 384 × 216 pixels and an aspect ratio of 16: 9 as in the reduced image 1701, the reduced image 1701 is enlarged and allocated to the entire allocation frame with the same aspect ratio as the main image data.
(2) When the thumbnail image data is stored in the DCF basic file and the aspect ratio of the main image data is 4: 3 In the file list in FIG. 3, the file storing the thumbnail image data to be reproduced second is IMG_0002. It becomes JPG. IMG_0002. JPG is determined to be a DCF basic file 1800 from the extension JPG.

  The control program of the CPU 102 is the above IMG_0001. Similar to JPG, IMG — 0002. The JPG Exif information is read and stored in the RAM 114.

  The control program of the CPU 102 obtains the width and height of the main image data from the Exif information stored in the RAM 114 via the input image processing circuit 111. Here, IMG — 0002. The main image data stored in the JPG is 1440 × 1080 pixels and has an aspect ratio of 4: 3. Therefore, it is determined that the thumbnail image data included in the Exif information is 160 × 120 pixels, and is an image obtained by reducing the entire main image data.

The control program of the CPU 102 controls the JPEG codec 112 of the input image processing circuit 111, decodes the thumbnail image data of the Exif information stored in the RAM 114, and stores it in the RAM 114. Subsequently, the decoded thumbnail image data is allocated to the second allocation frame 1403 of the background image 1401 (FIG. 7) stored in the RAM 114. The second allocation frame 1403 has 384 × 216 pixels and has an aspect ratio different from that of the reduced image. For this reason, the reduced image is enlarged from the center of the second allocation frame 1403 (FIG. 12) to the area 1411 of 288 × 216 pixels while maintaining the same aspect ratio as the main image data so that the entire reduced image can be accommodated. The left and right areas 1412 and 1413 remain as background images.
(3) When the thumbnail image data is stored in the DCF extended image file and the aspect ratio of the main image data is 4: 3 In the file list of FIG. 3, the file storing the thumbnail image data to be reproduced third is MVI_0003. . THM. MVI_0003. THM is determined as a thumbnail file 1910 (FIG. 9) related to the DCF extension file 1900 (MVI — 0003.AVI) from the extension THM.

  The control program of the CPU 102 controls the input image processing circuit 111, reads the thumbnail file 1910 (MVI — 0003.THM) from the memory card using the card control unit 115, and stores it in the RAM 114. The Exif information 1912 of the thumbnail file 1910 stores the file format of the related extended image file 1900 and information on the width and height of the main image data stored in the extended image file. The thumbnail file 1910 stores thumbnail image data 1913 that is a reduced image of the main image data stored in the DCF extension file 1900.

  The control program of the CPU 102 obtains the width and height of the main image data stored in the related extended image file 1900 from the Exif information stored in the RAM 114 via the input image processing circuit 111. Here, the main image data stored in the extended image file 1900 has 640 × 480 pixels and an aspect ratio of 4: 3. Therefore, it is determined that the thumbnail image data included in the Exif information is 160 × 120 pixels, and is an image obtained by reducing the entire main image data.

The control program of the CPU 102 controls the JPEG codec 112 of the input image processing circuit 111, decodes the thumbnail image data 1913 stored in the RAM 114, and stores it in the RAM 114. Subsequently, the decoded thumbnail image data is allocated to the third allocation frame 1404 of the background image 1401 (FIG. 7) stored in the RAM 114. The third allocation frame 1404 has 384 × 216 pixels and has an aspect ratio different from that of the reduced image. Therefore, the IMG_0002. Similar to the JPG thumbnail image data, the reduced image data is enlarged and allocated to 288 × 216 pixels from the center of the third allocation frame while maintaining the same aspect ratio as the main image data. Leave.
(4) When the thumbnail image data is stored in the DCF extended image file and the aspect ratio of the main image data is 16: 9 In the file list of FIG. 3, the file storing the thumbnail image data to be reproduced fourth is MVI_0004. . THM. MVI_0004. THM is determined as a thumbnail file related to the DCF extension file (MVI — 0004.AVI) from the extension THM.

  The control program of the CPU 102 is the above MVI_0003. Similar to THM, a thumbnail file (MVI — 0004.THM) is read from the memory card and stored in the RAM 114.

  The control program of the CPU 102 obtains the width and height information of the main image data stored in the related extended image file from the Exif information of the thumbnail file stored in the RAM 114 via the input image processing circuit 111. . Here, the main image data stored in the extended image file has 848 × 480 pixels and an aspect ratio of about 16: 9. Therefore, the thumbnail image data is the IMG_0001. Similar to the JPG thumbnail image data, it is determined that the reduced image of the main image data of the extended image file is assigned to the center position of the screen, and the top and bottom are evenly padded with black images.

  The control program of the CPU 102 controls the JPEG codec 112 of the input image processing circuit 111, decodes the thumbnail image data stored in the RAM 114, and stores it in the RAM 114. Subsequently, a 160 × 90 pixel area (reduced image) is extracted from the decoded thumbnail image data, and is allocated to the fourth allocation frame 1405 of the background image 1401 (FIG. 7) stored in the RAM 114. Since the fourth allocation frame 1405 has 384 × 216 pixels and has an aspect ratio of 16: 9, which is almost the same as the reduced image, the reduced image is enlarged and allocated to the entire allocation frame with the same aspect ratio as the main image data. .

  As a result, when the thumbnail image data corresponding to the main image data having an aspect ratio of 16: 9 is in a letterbox format having an aspect ratio different from that of the main image data, only the effective area is extracted from the thumbnail image data. Process the thumbnail image data with the same aspect ratio as the image data. Thereby, the index display screen 1500 shown in FIG. 6 is obtained.

  Then, IMG — 0001. JPG thumbnail image 1502, IMG_0002. JPG thumbnail image 1503, MVI_0003. THM thumbnail image 1504, MVI — 0004. An index screen 1500 to which the THM thumbnail image 1505 is assigned is generated (FIG. 6).

  The control program of the CPU 102 controls the input signal processing circuit 111 and outputs the image data of the index screen 1500 stored in the RAM 114 to the output signal processing circuit 121. Then, the output signal processing circuit 121 is controlled to display an index screen 1500 on the LCD 125 via the LCD control unit 126. Further, the image data of the index screen 1500 is output to the external monitor 130 via the video output control unit 128.

[Second Embodiment]
The second embodiment is different from the first embodiment in that thumbnail image data having main image data with an aspect ratio of 16: 9 is not a letterbox format but a squeeze format.

<Index display>
(1) When thumbnail image data is stored in a DCF basic file and the aspect ratio of main image data is 16: 9 In the file list of FIG. JPG is a DCF basic file, and a control program for the CPU 102 is stored in the RAM 114 via the input image processing circuit 111. The width and height of the main image are obtained from the JPG Exif information. Here, IMG — 0001. The main image data 1600 (FIG. 10) stored in the JPG has w0 = 1920, h0 = 1080, and an aspect ratio of 16: 9. Therefore, the thumbnail image data 2200 (FIG. 15) included in the Exif information is 160 × 120 pixels, and is a squeeze format in which the reduced image of the main image data is reduced in the horizontal direction so that the aspect ratio is 4: 3. The reduced image 2201 is determined.

The control program of the CPU 102 controls the JPEG codec 112 of the input image processing circuit 111, decodes the thumbnail image data 1807 of the Exif information 1802 stored in the RAM 114, and stores it in the RAM 114. Next, the decoded 160 × 120 pixel reduced image 2201 is allocated to the first allocation frame 1402 of the background image 1401 (FIG. 7) stored in the RAM 114. Since the first allocation frame 1402 has 384 × 216 pixels and an aspect ratio of 16: 9 as in the main image data, the reduced image 2201 that is enlarged and allocated to the entire allocation frame has the same aspect ratio 16: as the main image data. 9 is displayed.
(2) When the thumbnail image data is stored in the DCF basic file and the aspect ratio of the main image data is 4: 3 In the file list of FIG. JPG is a DCF basic file, and the control program of the CPU 102 is stored in the RAM 114 via the input image processing circuit 111. The width and height of the main image data are obtained from the JPG Exif information. Here, IMG — 0002. The main image data stored in the JPG is 1440 × 1080 pixels and has an aspect ratio of 4: 3. Therefore, it is determined that the thumbnail image data included in the Exif information is 160 × 120 pixels, and is an image obtained by reducing the entire main image data.

The control program of the CPU 102 controls the JPEG codec 112 of the input image processing circuit 111, decodes the thumbnail image of Exif information stored in the RAM 114, and stores it in the RAM 114. Subsequently, the decrypted reduced image is allocated to the second allocation frame 1403 of the background image 1401 (FIG. 7) stored in the RAM 114. The second allocation frame 1403 has 384 × 216 pixels and has an aspect ratio different from that of the reduced image. For this reason, the same aspect as that of the main image data is provided in the area 1411 of 288 × 216 pixels from the center of the second allocation frame 1403 (FIG. 12) so that the entire reduced image can be accommodated in the same aspect ratio as that of the main image data. The reduced image is enlarged and assigned with the ratio. At that time, the left and right regions 1412 and 1413 are left as background images.
(3) When thumbnail image data is stored in the DCF extended image file and the aspect ratio of the main image data is 4: 3 In the file list of FIG. THM is a thumbnail file 1910 (FIG. 9) related to the DCF extension file 1900 (MVI — 0003.AVI). The control program of the CPU 102 obtains the width and height information of the main image data stored in the related extended image file 1900 from the Exif information of the thumbnail file stored in the RAM 114 via the input image processing circuit 111. obtain. Here, the main image data stored in the extended image file 1900 has 640 × 480 pixels and an aspect ratio of 4: 3. Therefore, it is determined that the thumbnail image data included in the Exif information is 160 × 120 pixels, and is an image obtained by reducing the entire main image data.

The control program of the CPU 102 controls the JPEG codec 112 of the input image processing circuit 111, decodes the thumbnail image data 1913 stored in the RAM 114, and stores it in the RAM 114. Subsequently, the decoded thumbnail image data is allocated to the third allocation frame 1404 of the background image 1401 (FIG. 7) stored in the RAM 114. The third allocation frame 1404 has 384 × 216 pixels and has an aspect ratio different from that of the reduced image. Therefore, the IMG_0002. Similar to the JPG thumbnail image data, the reduced image data is enlarged and allocated to 288 × 216 pixels from the center of the third allocation frame while maintaining the same aspect ratio as the main image data. Leave.
(4) When the thumbnail image data is stored in the DCF extended image file and the aspect ratio of the main image data is 16: 9 In the file list of FIG. THM is a thumbnail file related to the DCF extension file (MVI — 0004.AVI). The control program of the CPU 102 obtains the width and height information of the main image data stored in the related extended image file from the Exif information of the thumbnail file stored in the RAM 114 via the input image processing circuit 111. Here, the main image data stored in the extended image file has 848 × 480 pixels and an aspect ratio of about 16: 9. Therefore, the thumbnail image data is the IMG_0001. Similar to the JPG thumbnail image data, it is determined to be a squeeze-type reduced image having 160 × 120 pixels and reduced in the horizontal direction so that the reduced image of the main image data has an aspect ratio of 4: 3.

  The control program of the CPU 102 controls the JPEG codec 112 of the input image processing circuit 111, decodes the thumbnail image data stored in the RAM 114, and stores it in the RAM 114. Subsequently, a reduced image of 160 × 120 pixels is allocated to the fourth allocation frame 1405 of the background image 1401 (FIG. 7) stored in the RAM 114 from the decoded thumbnail image data. Since the fourth allocation frame 1405 has 384 × 216 pixels and an aspect ratio of 16: 9 as in the reduced image data, the reduced image 2201 enlarged and allocated to the entire allocation frame has the same aspect ratio 16 as that of the main image data. : Displayed at 9.

  As a result, even when the thumbnail image data corresponding to the main image data having an aspect ratio of 16: 9 is in a squeeze format having an aspect ratio different from that of the main image data, the number of pixels in the horizontal direction is expanded to be the same as the main image data. Process to thumbnail image data of aspect ratio. Thereby, the index display screen 1500 shown in FIG. 6 is obtained.

[Third Embodiment]
The third embodiment differs from the first and second embodiments in that it determines whether a thumbnail image having main image data with an aspect ratio of 16: 9 is in a letterbox format or a squeeze format. .

  That is, the Exif information 1802 of the DCF basic files (IMG — 0001.JPG, IMG — 0002.JPG) stored in the memory card stores thumbnail image data and information indicating the format of the thumbnail image data.

  Also, the Exif information 1912 of the thumbnail file for the DCF extended image file stores information indicating the file format of the related extended image file 1900 and the format of the thumbnail image data. Note that the DCF extended image file is MVI_0003. AVI, MVI_0004. AVI and its thumbnail file are MVI_0003. THM, MVI_0004. THM.

  Here, the information indicating the format of the thumbnail image data includes information that can discriminate between three types: (a) normal format, (b) letterbox format, and (c) squeeze format.

  The control program of the CPU 102 obtains information indicating the format of thumbnail image data from the Exif information stored in the RAM 114 via the input image processing circuit 111.

  When the obtained information is in (a) normal format, it is determined that the main image data has an aspect ratio of 4: 3, and the thumbnail image data is an image obtained by reducing the entire main image data. For the DCF basic file, an index screen display and generation process similar to (2) in the first embodiment is performed. For the thumbnail file for the DCF extended image file, the same index screen display and generation processing as in (3) in the first embodiment is performed. Note that the same index screen display and generation processing as in (2) in the second embodiment is performed for the former, and the same index screen display and generation processing as in (3) in the second embodiment is performed for the latter. You can get similar results by doing so.

  When the obtained information is in (b) letterbox format, the main image data has an aspect ratio of 16: 9, and the thumbnail image data has a reduced image of the entire main image data allocated to the center position of the screen, and the top and bottom are It is determined that the black image is evenly padded. For the DCF basic file, the same index screen display and generation process as (1) of the first embodiment, and for the thumbnail file for the DCF extended image file, (4) of the first embodiment. A similar index screen display and generation process is performed.

  When the obtained information is in (c) squeeze format, the main image data has an aspect ratio of 16: 9, and the thumbnail image data has a horizontal direction so that the reduced image of the entire main image data has an aspect ratio of 4: 3. It is determined that the reduced image is a squeeze-type reduced image. For the DCF basic file, the same index screen display and generation processing as in (1) of the second embodiment, and for the thumbnail file for the DCF extended image file, (4) of the second embodiment. A similar index screen display and generation process is performed.

  As a result, even when the letterbox format and the squeeze format are mixed as thumbnail image data corresponding to the main image data having an aspect ratio of 16: 9, the index display screen 1500 shown in FIG. Is obtained.

  In the present embodiment, the case where the aspect ratio of the main image data is 16: 9 or 4: 3, the aspect ratio of the index screen is 16: 9, and the aspect ratio of the reduced image allocation frame is 16: 9 is taken as an example. I gave it as an explanation. However, the object of the present invention can be achieved even when the aspect ratios are different.

  In the present embodiment, four thumbnail images are displayed on one index screen. However, even when only one thumbnail image is displayed, particularly when the aspect ratio of the index screen and thumbnail image data is different. The object of the present invention is achieved. Further, the object of the present invention can be achieved even if thumbnail images other than one or four are displayed.

  In the text, the aspect ratio is described in the order of horizontal: vertical, and the number of pixels is described in the order of horizontal × vertical.

[Other Embodiments]
The embodiment according to the present invention has been described in detail using specific examples. However, the present invention can take an embodiment as a system, apparatus, method, program, storage medium (recording medium), or the like. is there. Specifically, the present invention may be applied to a system composed of a plurality of devices, or may be applied to an apparatus composed of a single device.

  Further, it goes without saying that the object of the present invention can be achieved even if any part of the functional blocks and flowchart shown in FIG. 1 is realized by a hardware circuit or by software processing using a computer.

  Note that the present invention includes a case where the present invention is achieved by directly or remotely supplying a software program (a program corresponding to the flowchart shown in the figure) that realizes the functions of the above-described embodiments to a system or apparatus. In that case, a computer such as a system reads and executes the program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, or the like.

  Examples of the recording medium (storage medium) for supplying the program include a flexible disk, a hard disk, an optical disk, and a magneto-optical disk. In addition, there are MO, CD-ROM, CD-R, CD-RW, magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R) and the like.

  As another program supply method, it is also possible to connect to an Internet home page using a browser of a client computer and download the computer program itself of the present invention from the home page. It can also be supplied by downloading a compressed file including an automatic installation function to a recording medium such as a hard disk. It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, the present invention includes a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and a user who satisfies predetermined conditions downloads key information for decryption from a homepage via the Internet. You can also In this case, the downloaded key information is used to execute the encrypted program and install it on the computer.

  In addition to the functions of the above-described embodiments being realized by the computer executing the read program, the OS or the like operating on the computer based on the instruction of the program may be a part of the actual processing. Alternatively, it can be realized by performing all of them.

  Furthermore, after the program read from the recording medium is written in the memory of a function expansion board inserted into the computer or a function expansion unit connected to the computer, the CPU of the board or the like performs a part of the actual processing. Alternatively, it can be realized by performing all of them.

  According to the embodiment, thumbnail image data having the same aspect ratio as that of the main image data is displayed on the index screen, and the number of pixels in the vertical direction of each thumbnail image data is displayed with the same number of pixels. Thereby, when the aspect ratio of the thumbnail image data is different from the aspect ratio of the main image data, the same thumbnail image data as the aspect ratio of the main image data can be quickly displayed on the index screen.

  Specifically, the letterbox format or squeeze format thumbnail image data of the main image data having an aspect ratio of 16: 9 has the same aspect ratio as that of the main image data and has a wider feeling of the aspect ratio of 16: 9. Can be displayed on the index screen. In addition, the thumbnail image data having the aspect ratio of 4: 3 of the main image data having the aspect ratio of 4: 3 is displayed on the index screen having the same aspect ratio as that of the main image data and having a wider feeling of the aspect ratio of 16: 9. Can be displayed.

  Further, it is determined whether the thumbnail image data of the main image data having an aspect ratio of 16: 9 is letterbox format, squeeze format, or thumbnail image data having an aspect ratio of 4: 3 of main image data having an aspect ratio of 4: 3. It can be displayed on the index screen with the same aspect ratio as the image data.

1 is a block diagram illustrating a configuration of an image reproduction device according to a first embodiment of the present invention. It is a figure which illustrates the file structure stored in the recording medium. It is a figure which illustrates the file information stored in the recording medium. It is a figure which illustrates the 1st index screen concerning a prior art. It is a figure which illustrates the 2nd index screen concerning a prior art. It is a figure which illustrates the index screen of this embodiment. It is a figure which shows the layout of the allocation screen of the index screen and thumbnail image in this embodiment. It is a figure which illustrates the structure of a DCF basic file. It is a figure which illustrates the structure of a DCF extended image file and a thumbnail file. It is a figure which illustrates the main image of 16: 9. FIG. 6 is a diagram illustrating a letterbox format thumbnail image having an aspect ratio different from that of a main image having an aspect ratio of 16: 9 in the first embodiment. It is a figure which illustrates the allocation frame which allocated the reduced image of 4: 3. It is a figure which illustrates the 3rd index screen concerning a prior art. It is a figure which illustrates the 4th index screen concerning a prior art. FIG. 10 is a diagram illustrating a squeeze thumbnail image having an aspect ratio different from that of a main image having an aspect ratio of 16: 9 in the second embodiment.

Explanation of symbols

100 Image Playback Device 101 CPU Bus 102 CPU
103 RAM
104 ROM
105 Key operation processing unit 111 Input image processing circuit 112 JPEG codec 114 RAM
115 Card control unit 121 Output image processing circuit 122 Speaker control unit 124 RAM
125 LCD
126 LCD control unit 127 Speaker control unit 128 Video output control unit 129 Digital IF
130 External monitor 141 CCD
142 AFE
C Memory card

Claims (9)

A playback device for playing back a plurality of main image data and thumbnail image data for the plurality of main image data from a recording medium,
A plurality of thumbnail images are displayed on the same screen with the same aspect ratio as that of the main image data corresponding to the thumbnail image data of the plurality of screens, and the number of vertical pixels of the plurality of thumbnail images is the same. Generating means for generating index image data indicating an index screen displayed with the number of pixels;
Output means for outputting the index image data to a display device ,
The generation unit reads information on an aspect ratio of main image data corresponding to the thumbnail image data from additional information stored in the same file as the thumbnail image data, and the format of the thumbnail image data is the main image data. Read out format information to determine whether the letterbox format is composed of a main image area corresponding to the aspect ratio of the image and other areas, or the squeeze format with the number of pixels in the horizontal direction of the main image data reduced. ,
The generating means further extracts the main image area excluding the other area of the thumbnail image data when the format information is the letterbox format, and when the format information is the squeeze format, as the same as the aspect ratio data, it characterized by expanding the number of pixels in the horizontal direction of the thumbnail image data reproducing apparatus.   The main image data is a moving image,
  The playback apparatus according to claim 1, wherein the thumbnail image data and the additional information are stored in a file generated separately from the main image data. The playback apparatus according to claim 1 or 2 , wherein the aspect ratio of the main image data is obtained from additional information stored in the same file as the thumbnail image data. The thumbnail image data includes letterbox format image data having an aspect ratio of 4: 3 having a main image having an aspect ratio of 16: 9, and squeeze format image having an aspect ratio of 4: 3 having a main image having an aspect ratio of 16: 9. and data, an aspect ratio of 4: the aspect ratio having a main image of 3 4: reproducing apparatus according to any one of claims 1 to 3, characterized in that it comprises a third image data. The format information includes whether the thumbnail image data having an aspect ratio of 4: 3 having the main image data having an aspect ratio of 16: 9 is in a letterbox format, a squeeze format, or an aspect having the main image data having an aspect ratio of 4: 3. 5. The playback apparatus according to claim 1 , wherein the playback apparatus is information for determining whether the thumbnail image data has a ratio of 4: 3. The index screen has an aspect ratio of 16: 9, and further includes a plurality of allocation frames with an aspect ratio of 16: 9 for displaying the thumbnail image data.
To any one of claims 1 to 5, further comprising an allocation means for allocating each of the plurality of thumbnail image data is enlarged to the entire leave the allocation frame of the main image data and the same aspect ratio The reproducing apparatus as described. A playback method in a playback device for playing back a plurality of main image data and thumbnail image data for the plurality of main image data from a recording medium,
A plurality of thumbnail images are displayed on the same screen with the same aspect ratio as that of the main image data corresponding to the thumbnail image data of the plurality of screens, and the number of vertical pixels of the plurality of thumbnail images is the same. A generation step of generating index image data indicating an index screen displayed with the number of pixels;
An output step of outputting the index image data to a display device ,
In the generating step, information on the aspect ratio of the main image data corresponding to the thumbnail image data is read from the additional information stored in the same file as the thumbnail image data, and the format of the thumbnail image data is the main image data Read out format information to determine whether the letterbox format is composed of a main image area corresponding to the aspect ratio of the image and other areas, or the squeeze format with the number of pixels in the horizontal direction of the main image data reduced. ,
In the generating step, the main image area excluding the other area of the thumbnail image data is extracted when the format information is the letterbox format, and the main image is extracted when the format information is the squeeze format. as the same as the aspect ratio of the data, reproduction how to characterized by expanding the number of pixels in the horizontal direction of the thumbnail image data. A program for causing a computer to execute the reproduction method according to claim 7 . A computer-readable storage medium storing the program according to claim 8 .

Images