JP2007036314A - Photographing apparatus and method, image region extract apparatus and method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a photographing apparatus and an image region extract apparatus capable of more quickly trimming an image expressed in CCD-RAW data. <P>SOLUTION: In the case of recording the CCD-RAW data on a recording medium, the photographing apparatus records a confirmation image resulting from applying prescribed signal processing to the CCD-RAW data and cross-reference information denoting the cross-reference between a coordinate system on the CCD-RAW data and a coordinate system on the confirmation image together with the CCD-RAW data onto the recording medium. The image region extract apparatus receives designation of a trimmed region of the displayed confirmation image, references the cross-reference information to extract a cross-referenced region of the CCD-RAW data corresponding to the designated region and applies signal processing to the CCD-RAW data on the cross-referenced region. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a photographing apparatus and method such as a digital camera capable of recording image data, in particular raw image data that has not undergone signal processing, on a recording medium, an image region extracting device and method for extracting a trimming region from an image, The present invention also relates to a program for causing a computer to execute a photographing method and an image region extraction method.

  A typical digital camera converts an image signal obtained from an image sensor such as a CCD into 10-bit or 12-bit digital data, and performs various signal processing such as synchronization, white balance adjustment processing, gamma adjustment, and resizing processing. After being applied, the data is compressed according to a compression method such as JPEG encoding and recorded on a recording medium. Since this type of digital camera performs lossy compression at the time of image recording, a sufficiently good image quality may not always be obtained at the time of reproduction or printing. In addition, since the recorded image has already been subjected to various signal processing, the image quality may deteriorate if the user himself / herself performs further signal processing on the reproduced image.

  On the other hand, the signal processing is not performed in the camera, and the analog image signal for each pixel output from the image sensor is A / D converted, and then the raw image data (hereinafter referred to as CCD-RAW) without any signal processing. Data) is recorded as it is.

  Here, unlike JPEG data, CCD-RAW data is not subjected to signal processing necessary for playback and display on a liquid crystal monitor of a digital camera. Therefore, when CCD-RAW data is played back, all necessary signal processing is performed. Must be done and takes time. For this reason, playback and frame advance on the digital camera are not performed comfortably, and the user feels uncomfortable.

For this reason, a method has been proposed in which an image for confirmation in a format (for example, JPEG format) that can be immediately played back by a digital camera when an image is captured is generated and recorded on a recording medium together with CCD-RAW data ( Patent Document 1). According to this method, it is possible to immediately confirm the contents of the CCD-RAW data by reproducing the confirmation image.
JP 2003-244507 A

  By the way, there is a case where a confirmation image (hereinafter referred to as a confirmation image) is reproduced and the contents of the image are confirmed, and only a desired area on the image is trimmed and reproduced or printed out. However, the confirmation image has a smaller number of pixels than the raw image data, and the angle of view is also smaller than the image represented by the raw image data. Therefore, when performing trimming, it is necessary to perform signal processing on the raw image data to reproduce the raw image instead of the confirmation image, and to perform trimming by setting an area on the reproduced raw image. , Processing is time consuming.

  The present invention has been made in view of the above circumstances, and an object thereof is to enable trimming more rapidly.

An imaging apparatus according to the present invention includes an imaging unit that acquires raw image data that has not been subjected to predetermined signal processing by imaging, and a confirmation image generation unit that generates the confirmation image by performing the predetermined signal processing on the raw image data. In the photographing apparatus provided with a recording control means for recording the confirmation image together when recording the raw image data on a recording medium,
Generating correspondence information representing a correspondence relationship between a coordinate system on the image represented by the raw image data and a coordinate system on the confirmation image, and recording the correspondence information together with the raw image data and the confirmation image; The apparatus further includes correspondence information recording means for recording on a medium.

An image region extraction device according to the present invention comprises a confirmation image display control means for displaying the confirmation image acquired by the photographing device of the present invention on a display device;
Area designation means for accepting designation of an area on the displayed confirmation image;
Signal processing means for extracting a corresponding area corresponding to the designated area in the raw image data with reference to the correspondence information and performing predetermined signal processing on the raw image data in the extracted corresponding area; It is characterized by comprising.

An imaging method according to the present invention includes an imaging unit that acquires raw image data that has not undergone predetermined signal processing by imaging, and a confirmation image generation unit that performs the predetermined signal processing on the raw image data to generate a confirmation image. When recording the raw image data on a recording medium, in a shooting method in a shooting apparatus including a recording control unit that also records the confirmation image,
Generating correspondence information representing the correspondence between the coordinate system on the image represented by the raw image data and the coordinate system on the confirmation image;
The correspondence information is recorded on the recording medium together with the raw image data and the confirmation image.

The image region extraction method according to the present invention displays the confirmation image acquired by the photographing apparatus of the present invention on a display device,
Accepting designation of the area on the displayed confirmation image,
Referring to the correspondence information, extracting a corresponding region corresponding to the designated region in the raw image data, and performing predetermined signal processing on the raw image data in the extracted corresponding region, To do.

  In addition, you may provide as a program for making a computer perform the imaging | photography method and image area extraction method by this invention.

  According to the photographing apparatus and method of the present invention, when the raw image data and the confirmation image are recorded together, the correspondence between the coordinate system on the image represented by the raw image data and the coordinate system on the confirmation image is determined. Corresponding correspondence information is generated and recorded together with the raw image data and the confirmation image on the recording medium.

  Further, according to the image region extraction apparatus and method of the present invention, when a confirmation image is reproduced and designation of a region to be trimmed on the reproduced confirmation image is accepted, the correspondence information is referred to and designated in the raw image data. A corresponding region corresponding to the selected region is extracted, and predetermined signal processing is performed on the extracted corresponding region.

  As described above, in the present invention, it is only necessary to perform predetermined signal processing only on the corresponding region corresponding to the region specified using the confirmation image without performing predetermined signal processing on the entire raw image data. Therefore, trimming can be performed at higher speed using the raw image data.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a control system of a digital camera to which the photographing apparatus according to the present embodiment is applied. As shown in FIG. 1, the digital camera 10 according to the present embodiment is provided with an imaging unit 18. The imaging unit 18 is provided with a lens 18A, a mechanical shutter, and a diaphragm (not shown), and makes light incident from the lens 18A enter the CCD 18B via the diaphragm when the mechanical shutter is open. It is a configuration.

  Further, the digital camera 10 is provided with a strobe 12 and emits light manually or automatically under the control of the strobe controller 14 as necessary.

  Each control device including the imaging unit 18 and the strobe control unit 14 of the digital camera 10 is connected by a bus 16 and its operation is controlled by the CPU 20. Each control device is supplied with power from the battery 22 and is operable.

  A system memory (RAM or ROM) 24, a nonvolatile memory 26, a timer function unit 28, and a calendar / clock function unit 30 are connected to the bus 16 as control devices.

  An I / O port 32 is connected to the bus 16, and a signal from an operation / display system 36 attached to a housing 34 (see FIG. 2 described later) of the digital camera 10 is connected to the I / O port 32. I / O is made.

  FIG. 2 is a rear perspective view of the digital camera 10 according to the present embodiment. As shown in FIG. 2, a liquid crystal monitor (LCD) 38 is disposed on the back side of the housing 34 of the digital camera 10 (the side opposite to the side where the imaging unit 18 is disposed). An upper part of the LCD 38 is provided with a frame number display unit 40 which is a part of the operation / display system 36. For example, a shooting frame number is displayed by a 7-segment liquid crystal display.

  Further, as the operation / display system 36, a circular up / down / left / right key 42 applied to frame switching, item selection, and the like of an image displayed on the LCD 38 is disposed on the right side of the LCD 38 on the back side of the housing 34. ing. By tilting the axis of the circular up / down / left / right key 42 in the up / down / left / right direction, the contact points of the different switches are switched when tilted, and the switching signal is input to the I / O port 32. .

  Below the up / down / left / right key 42, a menu button 44, an execute button 46, and a cancel button 48 are arranged in the vertical direction. A release button 50 and a mode setting dial 52 are provided on the upper surface of the housing 34.

  When the mode setting dial 52 and the menu button 44 are operated, a setup screen 54 for making various settings is displayed on the LCD 38, for example, as shown in FIG.

  The execute button 46 is operated on the setup screen 54 at the time of determination after function selection by the up / down / left / right key 42, and the cancel button 48 is operated at the time of cancellation of the determined function.

  Returning to FIG. 1, a memory card slot 60 to which a memory card 58 as a recording medium can be attached and detached is connected to the bus 16 via a card I / F 56. The image data photographed by the imaging unit 18 is recorded in the memory card 58 loaded in the memory card slot 60.

  Here, in the present embodiment, as a recording mode of image data to the memory card 58, a JPEG recording control function for recording JPEG data subjected to signal processing and compressed in JPEG format, and a raw image without compression A CCD-RAW recording control function for recording data (CCD-RAW data) is set.

  FIG. 4 is a diagram showing a file structure recorded on the memory card 58 by the JPEG recording control function. As shown in FIG. 4, the file structure recorded on the memory card 58 by the JPEG recording control function is classified into a tag information area 62, a thumbnail area 64, and a main image area 66. Note that each area is the same as a general JPEG file structure, and a detailed description thereof will be omitted.

  FIG. 5 is a diagram showing a file structure recorded on the memory card 58 by the CCD-RAW recording control function. As shown in FIG. 5, the file structure recorded on the memory card 58 by the CCD-RAW recording control function is classified into a header block area 68, a display image block area 70, and a CCD-RAW image block area 74. .

  The header block area 68 corresponds to the JPEG data in the CCD-RAW data, the CCD-RAW pixel number storage unit for storing the number of pixels of the CCD-RAW data (RW × RH), in addition to the manufacturer identifier storage unit and the format identifier storage unit. A JPEG equivalent region upper left point coordinate storage unit for storing the coordinates (RW0, RH0) of the upper left point of the region to be processed, a JPEG field angle equivalent width storage unit for storing a width RW1 corresponding to the field angle of the JPEG data in the CCD-RAW data, It is classified into a JPEG field angle equivalent height storage unit that stores the height RH1 corresponding to the field angle of JPEG data in the CCD-RAW data, and a JPEG pixel number storage unit that stores the number of pixels of JPEG data (JW × JH). Yes.

  The number of pixels of the CCD-RAW data (RW × RH), the coordinates of the upper left point of the area corresponding to the JPEG data in the CCD-RAW data (RW0, RH0), and the angle of view of the JPEG data in the CCD-RAW data. The coordinate system on the image in which the width RW1, the height RH1 corresponding to the angle of view of JPEG data in the CCD-RAW data, and the number of JPEG data pixels (JW × JH) are represented by the CCD-RAW data, and the confirmation image Is correspondence information representing a correspondence relationship with a coordinate system on JPEG data. FIG. 6 is a diagram showing a coordinate system of correspondence information on CCD-RAW data.

  The display image block area 70 stores the JPEG file structure as it is, and details thereof are classified into a tag information area 62, a thumbnail area 64, and a display image area 66.

  That is, when an image is reproduced for image confirmation on the LCD 38 of the digital camera 10 or a personal computer, JPEG data (for example, VGA (640 × 480 pixels)) stored in the display image block area 70 or Thumbnail image data is read out.

  The CCD-RAW image block area 74 is classified into a reproduction parameter set storage unit 100 and a CCD-RAW data storage unit 102. The image data stored in the CCD-RAW data storage unit 102 becomes the substance of the captured raw image data. It is assumed that the aspect ratios of images represented by CCD-RAW data and JPEG data are the same.

  At the time of shooting, a signal input to the imaging unit 18 is sent to the A / D conversion unit 104.

  The A / D converted image data in the A / D conversion unit 104 is sent to the signal processing unit 106 in response to an instruction from the CPU 20, such as synchronization, white balance adjustment processing, gamma adjustment, and resizing processing. The signal is processed and further sent to the compression / decompression unit 108 for compression processing (JPEG), or sent to the memory card slot 60 via the card I / F 56 as it is. .

  The image data recorded on the memory card 58 is read based on a reproduction display instruction from the CPU 20, stored in the frame memory 110, and displayed on the LCD 12 under the control of the LCD control unit 112. At this time, characters, character data, and the like are displayed on the LCD 112 together with the image display based on the image data controlled by the OSD (on-screen display unit) 114.

  An external I / F 116 is connected to the bus 16 and can be directly connected to an external control device such as a personal computer (hereinafter referred to as a personal computer 120) via a connector 118. A memory card is connected to the personal computer 120. The image data recorded in 58 can be transmitted.

  The operation of the digital camera of this embodiment will be described below.

  Before shooting with the digital camera 10, the mode setting dial 52 is operated to display the setup screen 54 on the LCD 38.

  On the setup screen 54, shooting conditions are set. First, when the recording mode is selected (highlighted) by the up / down / left / right key 42 and the execution button is operated, the recording mode can be selected. In the recording mode item, as shown in FIG. 3, modes of JPEG / FINE, JPEG / BASIC, and CCD-RAW are set.

  In FIG. 3, JPEG / FINE, JPEG / BASIC, and CCD-RAW are displayed, and the recording mode to be selected is selected (inverted display) by the up / down / left / right key 42, and the execution button 46 is operated.

  Similarly, JPEG pixel count, sharpness, and beep sound items are selected and set as necessary.

  In the photographing mode, a preview photographed by the imaging unit 18 is displayed on the LCD 38, and photographing is executed by operating the release button 50 when a predetermined angle of view is determined.

  When the recording mode is JPEG / FINE or JPEG / BASIC, the data imaged by the imaging unit 18 is sent to the A / D conversion unit 104 and A / D converted to generate digital image data.

  Thereafter, the signal processing unit 106 performs signal processing on the digital image data, and the compression / decompression unit 108 compresses the digital image data and records it as JPEG data in the memory card 58.

  FIG. 7 is a flowchart showing processing performed when the recording mode is CCD-RAW. The processing is started by shooting, and the data captured by the imaging unit 18 is recorded in the memory card 58 as CCD-RAW data in a state where only A / D conversion is performed by the A / D conversion unit 104. (Step ST1).

  At the same time, in the case of this CCD-RAW recording mode, processing similar to that for JPEG / FINE or JPEG / BASIC is executed in the recording mode, and it is compressed as a confirmation image for reproduction on the LCD 38 for confirmation. JPEG data (VGA) is generated and stored in the display image block area 70 of the CCD-RAW data (step ST2).

  Further, it corresponds to the number of pixels of the CCD-RAW data (RW × RH), the coordinates of the upper left point of the area corresponding to the JPEG data in the CCD-RAW data (RW0, RH0), and the angle of view of the JPEG data in the CCD-RAW data. The width RW1, the height RH1 corresponding to the angle of view of JPEG data in the CCD-RAW data, and the number of JPEG data pixels (JW × JH) are generated as correspondence information (step ST3), and the header block area of the CCD-RAW data 68 in each storage unit (step ST4), and the process is terminated.

  In the playback mode, when the index mode is selected, the thumbnail image data is read from the thumbnail area 64 of each image area recorded on the memory card 58 regardless of the recording mode, and is displayed on the LCD. The indexed images are displayed in a matrix.

  At this time, in the CCD-RAW file format, thumbnail image data is read from the thumbnail area 64 provided as a part of the display image block area 70.

  Even when the one-image playback mode is selected, if it is recorded in the JPEG file format, the compressed JPEG data is read from the main image area 66 and decompressed by the compression / decompression unit 108. After being expanded in the frame memory 110, it is displayed on the LCD 38. On the other hand, when recorded in the CCD-RAW file format, JPEG data as a confirmation image is read from the main image area 66 of the display image block area 70, decompressed by the compression / decompression unit 108, and frame memory After being expanded to 110, it is displayed on the LCD 38.

  Next, as described above, when the CCD-RAW data is transmitted to an external device such as a personal computer or the CCD-RAW data recorded on the memory card 58 is displayed on the external device using the viewer software, and further trimming is performed. The process will be described. Note that the processing described below is performed by viewer software.

  FIG. 8 is a flowchart showing processing when trimming is performed.

  Processing is started when an instruction to reproduce the CCD-RAW data is issued, and JPEG data as a confirmation image is read from the main image area 66 of the display image block area 70 in the CCD-RAW data (step ST11). After being expanded, it is displayed as a confirmation image on the monitor of the external device (step ST12).

  Subsequently, designation of an area on the displayed confirmation image is accepted (step ST13). FIG. 9 is a diagram for describing designation of a region on the displayed confirmation image. As shown in FIG. 9, the number of pixels of the confirmation image represented by the JPEG data is (JW × JH), and an area of width JTW and height JTH is designated with reference to the start point (JTW0, JTH0) on the confirmation image. Shall be.

  Next, the correspondence information stored in the header block 68 of the CCD-RAW data is referred to, and the corresponding region corresponding to the designated region on the CCD-RAW data is extracted (step ST14). Hereinafter, extraction of the corresponding area will be described in detail.

  FIG. 10 is a diagram for explaining extraction of corresponding areas. As shown in FIG. 10, the starting point (JTW0, JTH0), width JTW, and height JTH on the confirmation image represented by the JEPG data are the starting point (RTW0, RTH0), width RTW, and height RTH in the CCD-RAW data. Correspond to each. Therefore, by referring to the correspondence information, the corresponding region can be extracted by obtaining the start point (RTW0, RTH0), width RTW, and height RTH in the CCD-RAW data.

  First, since the aspect ratio is fixed between the CCD-RAW data and the JPEG data, the magnification α for converting the confirmation image into the CCD-RAW data coordinate system can be calculated by the following equation (1). it can.

α = JW / RW1 = JH / RH1 (1)
Therefore, the width RTW and the height RTH can be calculated by the following equations (2) and (3).

RTW = JTW × α (2)
RTH = JTH × α (3)
The starting points (RTW0, RTH0) can be calculated by the following equations (4) and (5).

RTW0 = RW0 + JTW0 × α (4)
JTW0 = RH0 + JTH0 × α (5)
Then, development is performed by performing signal processing only on the CCD-RAW data of the extracted corresponding area (step ST15), the extracted area is displayed (step ST16), and the process ends.

  As described above, in the present embodiment, since it is only necessary to perform signal processing only on the corresponding region corresponding to the region designated using the confirmation image without performing signal processing on the entire CCD-RAW data. Trimming can be performed at high speed.

  In the above embodiment, trimming is performed by the personal computer. However, when trimming is performed by the digital camera, the corresponding area may be extracted from the CCD-RAW data using the corresponding information in the same manner as described above. Good.

  In the above embodiment, JPEG data is stored in the display image block area 70 for CCD-RAW data. For example, CCD-RAW data and JPEG data have the same file names with different extensions only. For example, the CCD-RAW data and the JPEG data may be associated with each other and stored in the memory card 58.

1 is a block diagram showing a control system of a digital camera to which a photographing apparatus according to an embodiment is applied. Rear perspective view of the digital camera according to the present embodiment Figure showing the setup screen Schematic diagram showing the file structure of JPEG data Schematic diagram showing the file structure of CCD-RAW data The figure which shows the coordinate system of the corresponding information on CCD-RAW data A flowchart showing processing performed when the recording mode is CCD-RAW. Flow chart showing processing when trimming is performed The figure for demonstrating designation | designated of the area | region on the displayed confirmation image Figure for explaining extraction of corresponding area

Explanation of symbols

10 Digital Camera 16 Bus 18 Imaging Unit 18B CCD
20 CPU
38 LCD
54 Setup screen 58 Memory card (recording medium)
68 Header block area 70 Display image block area 74 CCD-RAW image block area 102 CCD-RAW data storage section 104 A / D conversion section 106 Signal processing section 108 Compression / decompression section

Claims (6)

Imaging means for acquiring raw image data that has not been subjected to predetermined signal processing by photographing, confirmation image generating means for generating a confirmation image by performing the predetermined signal processing on the raw image data, and recording the raw image data In a recording apparatus comprising a recording control means for recording the confirmation image together when recording on a medium,
Generating correspondence information representing a correspondence relationship between a coordinate system on the image represented by the raw image data and a coordinate system on the confirmation image, and recording the correspondence information together with the raw image data and the confirmation image; An imaging apparatus, further comprising correspondence information recording means for recording on a medium. Confirmation image display control means for displaying the confirmation image acquired by the photographing apparatus according to claim 1 on a display device;
Area designation means for accepting designation of an area on the displayed confirmation image;
Signal processing means for extracting a corresponding area corresponding to the designated area in the raw image data with reference to the correspondence information and performing predetermined signal processing on the raw image data in the extracted corresponding area; An image area extracting apparatus comprising: Imaging means for acquiring raw image data that has not been subjected to predetermined signal processing by photographing, confirmation image generating means for generating a confirmation image by performing the predetermined signal processing on the raw image data, and recording the raw image data When recording on a medium, in a shooting method in a shooting apparatus provided with a recording control means for recording the confirmation image together,
Generating correspondence information representing the correspondence between the coordinate system on the image represented by the raw image data and the coordinate system on the confirmation image;
An imaging method, wherein the correspondence information is recorded on the recording medium together with the raw image data and the confirmation image. Displaying the confirmation image acquired by the photographing apparatus according to claim 1 on a display device;
Accepting designation of the area on the displayed confirmation image,
Referring to the correspondence information, extracting a corresponding region corresponding to the designated region in the raw image data, and performing predetermined signal processing on the raw image data in the extracted corresponding region, Image region extraction method. Imaging means for acquiring raw image data that has not been subjected to predetermined signal processing by photographing, confirmation image generating means for generating a confirmation image by performing the predetermined signal processing on the raw image data, and recording the raw image data When recording on a medium, in a program for causing a computer to execute a photographing method in a photographing apparatus including a recording control unit that records the confirmation image together,
A procedure for generating correspondence information representing a correspondence relationship between a coordinate system on the image represented by the raw image data and a coordinate system on the confirmation image;
And a program for recording the correspondence information on the recording medium together with the raw image data and the confirmation image. A procedure for displaying the confirmation image acquired by the photographing apparatus according to claim 1 on a display device;
A procedure for accepting designation of an area on the displayed confirmation image;
A procedure for extracting a corresponding area corresponding to the designated area in the raw image data with reference to the correspondence information and performing predetermined signal processing on the raw image data in the extracted corresponding area. A program for causing a computer to execute an image region extraction method characterized by the above.

Images