JP2006270488A - Imaging apparatus and image processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus capable of easily and surely performing the processing of separating only a specified object from an image including a plurality of objects and preserving and outputting it. <P>SOLUTION: The imaging apparatus comprises: a CCD 41 capable of simultaneously imaging first and second objects; an image information acquisition means 51 for acquiring imaged image information; a focus distance information acquisition means 52 for respectively acquiring first focus distance information and second focus distance information; and an information composition means 53 for embedding the first and second focus distance information in the image information. Thus, since the first focus distance information and the second focus distance information can be embedded in the image information of the first and second objects imaged simultaneously by the CCD 41, image processing based on the first focus distance information and the second focus distance information, trimming processing of segmenting the first object or the second object or the like for instance, is easily and surely performed. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a digital image pickup apparatus that picks up an image of a subject (or “shooting”), and more particularly, to an image pickup apparatus having a function of trimming (cutting out) a captured image. The present invention also relates to an image processing method for a captured image, and more particularly, to an image processing method for trimming a captured image.

  Digital imaging devices that image a subject include, for example, a digital still camera (hereinafter referred to as “digital camera”), a portable telephone having an imaging function (hereinafter referred to as “mobile phone”), and the like. Such digital imaging devices are rapidly spreading.

  In a digital camera (digital imaging device), a captured image is converted into image data (digital data) and recorded in a memory inside the camera or a recording medium (removable medium) such as a removable IC card. The image (image data) thus recorded can be displayed on a liquid crystal monitor attached to the camera, and can be printed and viewed with a home personal printer or the like. It is also possible to capture the recorded image data into a personal computer, send the captured image data by e-mail via the Internet, and order a photo print via a print service site.

  In addition, it is convenient to use an image (image data) taken with a digital camera in DTP (DeskTop Publishing) which performs editing / publishing work on a computer. When a photographic image taken with a conventional silver salt camera is used, it is necessary to digitize the photographic image. That is, a photographic image is read from an original such as a reversal film using a scanner device, and the read image is converted into digital image data and input to a computer. However, since the image (image data) taken by the digital camera has already been digitized, the troublesome work using the scanner device is not necessary.

  In DTP work, the required image is often a part of the image rather than the entire image. For this reason, trimming is performed to cut out only the necessary portion of the image from the entire image. As a trimming technique, there is a technique in which a necessary image portion on a document is set in advance by specifying the position and size of a rectangular area, and then only the image of the portion set by the scanner device is read from the document. . In addition, the computer displays an image on the display based on the image data, draws a rectangular area to be cut out on the display screen, sets the position and size of the image necessary for cutting, and trims the image data Some perform processing. A technique relating to such trimming processing using an image processing apparatus such as a computer is described in Patent Document 1, for example.

Along with the high performance and high functionality of digital cameras, digital cameras having image processing / editing functions have also appeared, and digital cameras having such functions can also perform trimming processing. A digital camera having such a trimming function is described in Patent Document 2, for example.
JP 2004-153513 A JP 2004-172655 A

  The image processing apparatus described in Patent Document 1 displays an image based on image data on a display unit and displays a frame representing a cutout region on the image so as to overlap the image. The cutout area is initially set to be a rectangle having a predetermined aspect ratio at a position, and an instruction to change at least one of the position and size of the cutout area represented by the frame displayed on the display unit is received and the change instruction When the image is received, the cutout area is changed in accordance with the change instruction, and cutout image data obtained by cutting out an image portion in the cutout area from the image data is generated.

  As a result, a frame representing the cutout area is superimposed and displayed on the image of the display means so as to be a rectangle with a predetermined aspect ratio, and the position and size of the cutout area can be changed as necessary. Then, cut-out image data obtained by cutting out the image portion in the cut-out area from the image data is created. Here, the cutout area is initially set at a predetermined position on the image, for example, at the center of the image, and therefore, in the initial state, the display means cuts out to a predetermined position on the image based on the image data. A frame representing the area is displayed. Therefore, if the predetermined position is determined in advance as a position where there is often a necessary part on the image, at least the position change (setting) of the position and size of the cutout area can be made unnecessary. Since it is only necessary to make fine adjustments even if necessary, it is possible to reduce the work burden on the user when setting the cutout region more than in the past.

  In addition, the digital camera described in Patent Document 2 includes a region designation unit that displays a captured image or a read image on an image display unit, and that specifies a partial region to be trimmed from the displayed image. The trimming range presenting means for presenting the designated trimming range on the screen of the image display means; and the capacity calculating means for calculating the capacity of the image data within the designated trimming range, The image data capacity within the trimming range is displayed on the image display means together with the designated trimming range.

  Thus, the user can easily grasp the image range cut out from the entire image and can know in advance the size (capacity) of the image data of the image generated by the trimming. As a result, trimming can be performed with a simple operation, and the trimming range and the capacity of the image data can be compared in real time, which is effective in determining the trimming range.

  However, both the image processing apparatus described in Patent Document 1 and the digital camera described in Patent Document 2 are trimmings that cut out a region formed in a rectangle from the entire image, and are shown on the image. It does not trim a specific subject. That is, when only a specific subject is cut out from an image including a plurality of subjects, a rectangular region including the specific subject can be cut out, but the cut out region is only a rectangle and has the shape of the specific subject. Cutting based on this is not possible. Further, if it is attempted to perform the clipping process based on the shape of a specific subject, it is necessary to repeat a very troublesome work.

  The present invention has been made in view of the various problems as described above, and an object of the present invention is to easily and reliably perform a process of separating and storing and outputting only a specific subject from an image including a plurality of subjects. An object of the present invention is to provide an imaging device that can perform the above-described operation. It is another object of the present invention to provide an image processing method capable of easily and reliably performing processing for separating and storing and outputting only a specific subject from an image including a plurality of subjects.

  In order to achieve the above object, in the imaging apparatus of the present invention, an imaging unit capable of simultaneously imaging a first subject and a second subject, the first subject and the second subject captured by the imaging unit, Image information acquisition means for acquiring the image information, and first focal length information relating to the focal length of the first subject and second focal length information relating to the focal length of the second subject. It has an information acquisition means and an information processing means for embedding the first and second focal length information in the image information. Accordingly, the first focal length information and the second focal length information can be embedded in the image information of the first subject and the second subject that are simultaneously imaged by the imaging unit. Image processing based on the second focal length information, for example, trimming processing for cutting out the first subject or the second subject can be easily and reliably performed.

  Further, the imaging apparatus of the present invention further includes a separating unit that separates the image of the first subject or the image of the second subject based on the difference between the first and second focal length information. It is characterized by. Accordingly, the process of separating only the first subject image or the second subject image from the first subject image and the second subject image simultaneously captured by the imaging unit is easily and reliably performed. Is possible.

  In the imaging apparatus according to the aspect of the invention, the separation unit may further use at least one of a recognition function using approximate colors or a straight line or curve recognition function in a complementary manner, and the image of the first subject or the second object. It is characterized by separating images of subjects. Thereby, the separation means can separate the image of the first subject or the second subject more accurately.

  Furthermore, the image pickup apparatus of the present invention is characterized by having at least one of storage means for storing the image information in which the first and second focal length information is embedded, or output means for outputting. As a result, the image information of the first subject and the image information of the second subject can be stored and / or output in a state of being integrated or separated.

  According to the image processing method of the present invention, in the image processing method for an image including the first subject and the second subject, the difference between the focal length of the first subject and the focal length of the second subject. A recognition process for recognizing each of the first subject and the second subject, and a storage processing step for separating one of the subjects recognized in the recognition step and selectively storing them as separate image information. Or any one of output processing steps for selectively outputting as separate image information.

  Thus, based on the difference between the focal length of the first subject and the focal length of the second subject from the image including the first subject and the second subject, the first and second subjects. Can be recognized separately, and one recognized subject can be separated and selectively saved and output as separate image information, so that only a specific subject can be cut out from an image containing multiple subjects and saved or output. It is possible to carry out the processing easily and reliably.

  Hereinafter, as an embodiment of an imaging apparatus and an image processing method according to the present invention, a digital camera which is one of imaging apparatuses will be described with reference to FIGS. The embodiments described below do not limit the invention according to the claims, and all the combinations of features described in the embodiments are not necessarily essential to the solution means of the invention. Absent.

  FIG. 1 is a front view showing an appearance of a digital camera 10 as an imaging apparatus according to the present invention. 2 is a plan view of the same, and FIG. 3 is a rear view of the same. First, an outline of the digital camera 10 will be described with reference to FIGS.

  As shown in FIG. 1, a photographing lens 12, a finder window 14, a focal length detection sensor 15, a strobe 16, a strobe light control sensor 18, and the like are disposed on the front of the digital camera 10. In addition, an imaging element (hereinafter referred to as “CCD”) 41 (see FIG. 4) (not shown in FIG. 1) is disposed in the imaging position of the taking lens 12 inside the digital camera 10. The focal length detection sensor 15 irradiates infrared rays or the like, detects infrared rays or the like reflected and returned to the subject, and detects the focal length of the subject.

  Next, as shown in FIG. 2, a shutter button 22, a power switch 24, a zoom enlarge button 26, and a zoom reduce button 28 are disposed on the upper surface of the digital camera 10. The shutter button 22 is configured in a two-stage manner, and the automatic focusing (AF) and automatic exposure control (AE) are activated in a “half-pressed” state in which the shutter button 22 is lightly pressed and stopped to lock AF and AE. Shooting (imaging), which will be described later, is performed by further pressing from “half press” to “full press”.

  As will be described later, the zoom enlargement button 26 and the zoom reduction button 28 are connected to the taking lens 12 via the operation board 47 and the aperture control unit 45 (see FIG. 4). By performing the pressing operation, it is possible to adjust to an arbitrary photographing magnification within a predetermined range.

  Next, as shown in FIG. 3, a character display unit 35, a liquid crystal display unit (hereinafter referred to as “LCD”) 38, a mode switch 30, a cross cursor button 32, a finder 34, and the like are arranged on the back of the digital camera 10. It is installed.

  The character display unit 35 displays information on the camera state, shooting mode, etc. (so-called shooting status). For example, a built-in battery remaining amount check display (not shown), the number of frames that can be shot, a flash Display of the presence or absence of light emission is performed. Further, a strobe button 36 for setting the presence or absence of strobe light emission and a macro button 37 for setting macro photography are arranged beside the character display portion 35.

  The LCD 38 mainly displays an image. The LCD 38 displays an image (through video) photographed by the photographing lens 12 so that an image desired to be photographed can be confirmed at the time of photographing. The recorded image is read from the memory card 74 to be reproduced and displayed.

  The mode switch 30 is formed of a ring member disposed on the outer periphery of the cross cursor button 32, and is rotatable in both the clockwise direction and the counterclockwise direction. The mode switch 30 changes the function (mode) of the camera. By rotating the mode switch 30, for example, a shooting mode for shooting, a playback mode for playing back a shot image, and digital A setting mode for registering / changing various settings of the camera 10 can be selected.

  The cross cursor button 32 includes a center button and keys (up / down / left / right keys) arranged on any one of the upper, lower, left and right edges. The cross cursor button 32 tilts when the up / down / left / right key is pressed, and can input instructions in the corresponding four directions (up, down, right, left). Input is also possible by pressing. The cross cursor button 32 is used as an operation button for instructing selection of various setting items in the above-described setting mode, change of setting contents, and forwarding / returning of playback frames. In addition to this, the cross cursor button 32 is also used as an operation unit of a trimming processing unit 60 (see FIG. 4), which will be described later, and the cursor pointing to the subject to be trimmed is pressed by the up / down / left / right keys. The subject can be selected by moving according to four directions (up, down, right, left).

  A memory slot 19 (see FIGS. 1 and 3) into which a memory card 74 (see FIG. 4) as a recording medium is inserted is disposed on the side surface of the digital camera 10. In the digital camera 10 according to the present embodiment, a captured image (image information) is recorded and stored in the memory card 74 by the built-in card reader / writer device 73 (see FIG. 4). It is also possible to read out the recorded image (image information) to the digital camera 10.

  Next, an internal configuration (control unit) of the digital camera 10 and its function will be described with reference to FIG. FIG. 4 is a block diagram showing an internal configuration (control unit) of the digital camera 10 and its function.

  The control unit of the digital camera 10 mainly includes an operation board 47, a CPU 40, an image information processing unit 50, a trimming processing unit 60, a memory (DRAM) 70, and the like.

  The operation board 47 is circuit-connected to each of the various operation units shown in FIGS. 1 to 3, and operations of these operation units by the photographer (for example, pressing operation of the shutter button 22 and rotation operation of the mode switch 30). Based on the above, a signal is output from the operation board 47 to the CPU 40. That is, as shown in FIG. 4, the operation board 47 is connected to the shutter button 22, the zoom enlargement button 26, the zoom reduction button 28, and the cross cursor button 32, and is connected to the photographing lens 12 via the aperture control unit 45. It is connected. As described above, when the zoom enlargement button 26 and the zoom reduction button 28 are pressed, the aperture control unit 45 controls the focus lens and the zoom lens (not shown) constituting the photographing lens 12 to obtain a desired photographing magnification. Adjustment is possible. As described above, by pressing the shutter button 22, the zoom enlargement button 26, the zoom reduction button 28, and the cross cursor button 32, an instruction signal corresponding to each button is output from the operation board 47 to the CPU 40.

  The CPU 40 outputs a control signal to the image information processing unit 50 based on the input of the instruction signal from the operation board 47, and intensively processes various data in the digital camera 10. That is, the CPU 40 performs each process described later integrally with the focal distance calculation unit 46, the image information processing unit 50, the trimming processing unit 60, and the like, and further controls each circuit comprehensively.

  The CCD 41 as an image sensor converts the subject light captured and imaged from the photographing lens 12 into a signal charge having an amount corresponding to the amount of incident light. The signal charges are sequentially read from the CCD 41 as voltage signals (image signals) and transmitted to the analog signal processing unit 42. The image sensor is not limited to such a CCD, and a CMOS image sensor or the like may be used.

  The analog signal processing unit 42 performs necessary analog processing such as sampling and white balance adjustment on the image signal transmitted from the CCD 41. The analog-processed image signal is converted into image data (digital data) by the A / D conversion unit 43 and output to the image information processing unit 50. The CCD 41, the analog signal processing unit 42, and the A / D conversion unit 43 operate in synchronization with the timing signal from the timing generator (T / G) 48.

  The focal length calculation unit 46 generates focal length data (digital data) based on signals from the CCD 41 and the aperture control unit 45. That is, as shown in FIG. 4, the aperture control unit 45 is connected to the focal length detection sensor 15, and transmits a signal related to the focal length detected by the focal length detection sensor 15 to the focal length calculation unit 46. In the present embodiment, a focal length corresponding to a predetermined pixel (for example, a pixel arranged with an interval of 100 pixels) in the CCD 41 is detected by the focal length detection sensor 15, and the focal length calculation unit 46 performs the predetermined distance calculation. Focal length data corresponding to the pixel is generated, and the focal length data is output to the image information processing unit 50.

  The image information processing unit 50 combines the image data output from the A / D conversion unit 43 and the focal length data output from the focal length calculation unit 46 to generate image information in which the focal length information is embedded. To do. That is, the image information processing unit 50 includes an image information acquisition unit 51, a focal length information acquisition unit 52, and an information composition unit 53, as shown in FIG. The image information acquisition means 51 acquires image data that can be combined after performing digital processing such as gamma correction on the image data output from the A / D converter 43 as necessary. The focal length information acquisition unit 52 performs digital processing such as correction of the focal length data output from the focal length calculation unit 46, and acquires focal length information that can be combined. The information synthesizing unit 53 embeds the focal length information acquired by the focal length information acquiring unit 52 in the image information acquired by the image information acquiring unit 51 to generate combined image information.

  The memory card 74 is a detachable recording medium that records and stores the composite image information. When the mode switch 30 (see FIG. 3) is set to the shooting mode and a recording instruction is input by pressing the shutter button 22 (see FIG. 2), a control signal is output from the CPU 40 to the image information processing unit 50, and one frame is output from the CCD 41. Minute image data is read into the image information processing unit 50, and after the processing described above is performed in the image information processing unit 50, the composite image information is written into the memory (RAM) 70. The composite image information written in the memory (RAM) 70 is compressed by the compression / decompression circuit 72 and is recorded and stored in the memory card 74 by the card reader / writer device 73.

  As described above, the LCD 38 displays an image (through moving image) photographed by the photographing lens 12. That is, when the mode switch 30 is set to the shooting mode, image data is continuously read from the CCD 41 into the image information processing unit 50, and image information digitally processed by the image information acquisition unit 51 is written into the display memory 80. It is. The image information in the display memory 80 is sequentially rewritten with the newly read image information, whereby a through moving image is displayed on the LCD 38. Since the image displayed on the LCD 38 only needs to be grasped by the photographer, an image having a smaller number of pixels (having a lower resolution) than that of a liquid crystal monitor generally used in a personal computer or the like is used. Accordingly, the image information written in the display memory 80 is similarly used with low resolution.

The LCD 38 can also display an image (image information) recorded and stored in the memory card 74 as described above. That is, when the mode switch 30 is set to the reproduction mode and reproduction of any image information recorded on the memory card 74 is designated by a predetermined operation, the image information is read from the memory card 74 by the card reader / writer device 73. After being decompressed by the compression / decompression circuit 72, digital processing is performed by the image information processing unit 50 and displayed on the LCD 38 via the display memory 80.
Next, the trimming process that constitutes a part of the characteristic part of the present invention will be described. In this specification, trimming mainly means that only a specific subject is separated from an entire image including a plurality of subjects, and further, image information of the separated subject is recorded, stored, or output. May be included.

  The trimming processing unit 60 performs processing (trimming processing) for cutting out image information of a specific subject from the composite image information generated by the image information processing unit 50. It is also possible to read out the composite image information recorded and stored in the memory card 74 and perform the same trimming process on this composite image information.

  As shown in FIG. 4, the trimming processing unit 60 includes subject recognition means 61 and image separation means 62. The subject recognition unit 61 includes a distance information recognition unit 61a, an approximate color recognition unit 61b, and a straight line / curve recognition unit 61c, and recognizes a plurality of subjects that can be trimmed from the entire composite image information. The distance information recognition unit 61a recognizes a plurality of subjects that can be trimmed based on the distance information embedded in the composite image information. The approximate color recognition unit 61b recognizes a plurality of subjects based on the approximate color (or similar color). The straight line / curve recognition unit 61c recognizes a plurality of subjects by predicting a straight line or a curve.

  The image separating unit 62 separates a specific subject from the plurality of subjects recognized by the subject recognizing unit 61, and the image information of the separated subject (may be combined image information. The same applies hereinafter). Generate. Since the image information of the separated subject is transmitted to the display memory 80 and displayed on the LCD 38, the separated subject can be easily confirmed. The separated image information of the subject can be sent to a memory (RAM) 70 and can be recorded and stored in a memory card 74 via a compression / decompression circuit 72 and a card reader / writer device 73.

  Next, the recognition of a plurality of subjects by the subject recognition means 61 will be described in detail with reference to FIG. FIG. 5 shows a first photographed image 100 and a second photographed image 200 obtained by photographing the subject X and the subject Y at the same time. In the first captured image 100 shown in FIG. 5A, the subject X and the subject Y are separated from each other. On the other hand, in the second captured image 200 shown in FIG. 5B, the subject X and the subject Y partially overlap, and the vicinity of the lower left end of the subject Y is hidden behind the subject X and cannot be seen ( For convenience of explanation, the outline of the subject Y is indicated by a one-dot chain line). 5A and 5B, it is assumed that the focal length of the subject X is shorter than the focal length of the subject Y, unlike the focal length of the subject X and the focal length of the subject Y.

  As described above, the image information processing unit 50 (information synthesizing unit 53) generates the composite image information in which the focal length information is embedded in the image information, so that the composite image information of the first and second photographed images 100 and 200 is included. Includes the focal length information of the subject X and the focal length information of the subject Y, respectively.

  First, subject recognition in the first captured image 100 shown in FIG. 5A will be described. The distance information recognition unit 61a can recognize that the subject X and the subject Y are included based on the difference in the focal length information embedded in the composite image information of the first captured image 100. In the first captured image 100, as described above, since the subject X and the subject Y are separated from each other, the image separation unit 62 separates the selected subject X or the image of the subject Y and separates the separated subject X. Alternatively, the image information of the subject Y is generated.

  Next, subject recognition in the second captured image 200 shown in FIG. 5B will be described. When the subject X and the subject Y partially overlap as in the second captured image 200, in addition to the recognition by the distance information recognition unit 61a, the approximate color recognition unit 61b and the straight line / curve recognition unit 61c. Recognition is also performed in a superimposed manner. That is, in the second captured image 200, all images of the subject X are shown, but a part of the subject Y (near the lower left corner) is not shown hidden.

  Here, when the trimming process of the subject X is selected, the distance information recognition unit 61a indicates that the subject X and the subject Y are included based on the difference in focal length information, as in the first captured image 100. And the subject X is separated by the image separation means 62, and image information of the separated subject X is generated. On the other hand, when the trimming process for the subject Y is selected, it is recognized that the subject X and the subject Y are included based on the difference in the focal length information, and the contour of the subject X and the contour of the subject Y are further determined. Since they intersect, it is predicted that there is a portion hidden behind the subject X in the image of the subject Y with a long focal length. Then, the straight line / curve recognition means 61c predicts the shape of the contour of the subject Y. For example, when the contour is indicated by a straight line or a curve, the contour of the hidden part is predicted (the straight line or the curve is extended). ), The image of the subject Y is complemented. In this way, the subject Y subjected to the prediction complement is separated by the image separation unit 62, and the image information of the subject Y after the prediction supplement is generated.

  Further, in the second captured image 200 shown in FIG. 5B, for example, when the subject X and the subject Y are pictures or photos pasted on the same wall surface, the subject X and the subject Y are substantially the same. Has a focal length of. In such a case, it is difficult for the distance information recognition unit 61a to recognize that the subject X and the subject Y are included. However, the approximate color recognition unit 61 b and the straight line / curve recognition unit 61 c can recognize that the subject X and the subject Y are included in the second captured image 200. In particular, when the subject X and the subject Y show different colors, the approximate color recognizing means 61b recognizes the subject X and the subject Y, respectively, and the straight line / curve recognizing means 61c, as described above, The contour and the contour of the subject Y are recognized, and further, the contour of the portion where the subject Y is hidden is predicted and complemented.

  As described above, in this embodiment, the recognition by the distance information recognition unit 61a, the recognition by the approximate color recognition unit 61b, and the recognition by the straight line / curve recognition unit 61c are performed. Furthermore, accurate image information of the subject Y can be generated by the prediction complementing process by the straight line / curve recognition means 61c.

  Next, a flow from simultaneous shooting (imaging) of a plurality of subjects to trimming of a specific subject in the digital camera 10 according to the present invention will be described with reference to FIG. FIG. 6 is a flowchart showing a flow of processing from photographing (imaging) of a subject to trimming.

  First, when shooting with the digital camera 10, the mode switch 30 is operated to select a shooting mode (step S10). While focusing on the subject to be photographed, the zoom enlargement button 26 and the zoom reduction button 28 are pressed to adjust to an arbitrary photographing magnification within a predetermined range. At this time, since the through moving image is displayed on the LCD 38, the pose of the subject to be photographed can be determined while checking the display image on the LCD 38.

  Subsequently, the subject is photographed by pressing the shutter button 22 (inputting a recording instruction) (step S11). As described above, by this pressing operation, after each processing is performed in the image information processing unit 50, the composite image information is written in the memory (RAM) 70, and the composite image information subjected to the compression processing is stored in the memory card. 74 is recorded and saved (step S12).

  Next, the mode of the digital camera 10 is switched in order to perform trimming processing of the photographed subject (step S13). In the digital camera 10 according to the present embodiment, the trimming function is one function included in the playback mode, so the crosshair cursor button 32 is operated to select the trimming function (step S20).

  Next, the cross cursor button 32 or the like is further operated to select an image (composite image information) to be trimmed, and a subject to be trimmed is selected. Subsequently, object recognition based on the difference in focal length information by the distance information recognition means 61a (step S22), object recognition by the approximate color recognition means 61b (step S23), and object recognition by the straight line / curve recognition means 61c. (Step S24) is sequentially performed. When a plurality of subjects included in the image are recognized by the subject recognition unit 61 (distance information recognition unit 61a, approximate color recognition unit 61b, straight line / curve recognition unit 61c) (step S25), trimming of the selected subject is performed. Processing (step S30) is executed.

  On the other hand, if a plurality of subjects are not recognized in the image in step S25, it is possible to select whether or not to perform steps S22 to S24 again after expanding the threshold range. For example, in the recognition by the distance information recognition unit 61a (step S22), a set of pixels having substantially the same focal length is recognized as one subject, but in the case of a three-dimensional subject, each focal length varies depending on the structure of the subject. . Therefore, the focal length range (threshold value) that can be recognized as one subject is expanded. Similarly, in the recognition by the approximate color recognition means 61b (step S23), the approximate color range (threshold value) is expanded, and in the recognition by the straight line / curve recognition means 61c (step S24), a straight line / curve recognizable range (step S24). Threshold) is expanded.

  Next, in the trimming process in step S30, as described above, the image separation means 62 separates the selected subject, generates image information of the separated subject, and the image information is stored in the memory (RAM ) 70, and further recorded and stored in the memory card 74 via the compression / decompression circuit 72 and the card reader / writer device 73. Also, the image information of the separated subject is sent to the display memory 80 as described above, and only the separated subject image is displayed on the LCD 38.

  Although the embodiment of the present invention has been described above, according to the digital camera 10 of the present invention, the CCD 41 that can simultaneously image the first subject and the second subject, and the first subject imaged by the CCD 41. And image information acquisition means 51 for acquiring image information of the second subject, first focal length information relating to the focal length of the first subject, and second focal length information relating to the focal length of the second subject. The image processing apparatus includes a focal length information acquisition unit 52 that acquires the information and an information synthesis unit 53 (information processing unit) that embeds the first and second focal length information in the image information.

  Accordingly, the first focal length information and the second focal length information can be embedded in the image information of the first subject and the second subject that are simultaneously imaged by the CCD 41. It is possible to easily and reliably perform image processing based on the two focal length information, for example, trimming processing for cutting out the first subject or the second subject.

  In addition, according to the digital camera 10 of the present invention, the image separation unit 62 that separates the image of the first subject or the image of the second subject based on the difference between the first and second focal length information. (Separation means) is further provided. As a result, it is possible to easily and reliably perform the process of separating only the image of the first subject or the second subject from the images of the first subject and the second subject captured simultaneously by the CCD 41. It is.

  Further, according to the digital camera 10 of the present invention, the image separating unit 62 further includes a recognition function using approximate colors (recognition by the approximate color recognition unit 61b) or a straight line or curve recognition function (straight line / curve recognition unit 61c). The image of the first subject or the image of the second subject is separated by using at least one of (recognition by the above) in a complementary manner. As a result, the image separation unit 62 can more accurately separate the image of the first subject or the second subject.

  Further, according to the digital camera 10 of the present invention, storage means (card reader / writer device 73, memory card 74) for recording and storing the composite image information in which the first and second focal length information are embedded, or , At least one LCD 38 (output means) for output display. As a result, the image information of the first subject and the image information of the second subject can be stored and / or output in a state of being integrated or separated.

  In addition, according to the image processing method of the present invention, in the image processing method in the captured images 100 and 200 including the subject X (first subject) and the subject Y (second subject), the focal length of the subject X Based on the difference in the focal length of the subject Y, a recognition step (steps S22 and S25) for recognizing the subject X and the subject Y, respectively, and one subject recognized in the recognition step are separated and selectively separated. A storage processing step of recording and saving the image information on the memory card 74 or an output processing step of selectively outputting and displaying on the LCD 38 as separate image information (step S30). It is said.

  Thereby, from the captured images 100 and 200 including the subject X and the subject Y, the subject X and the subject Y can be recognized and recognized based on the difference between the focal length of the subject X and the focal length of the subject Y, respectively. Since one subject can be separated and selectively stored and output as separate image information, it is possible to easily and reliably perform a trimming process that cuts out and saves and outputs only a specific subject from an image including a plurality of subjects. It is possible to implement.

  Note that the scope of the present invention is not limited to the above-described embodiments, and can be applied to various other embodiments as long as they do not contradict the description of the claims. For example, in the embodiment of the present invention, the digital camera 10 has been described. However, the image capturing apparatus is not particularly limited to a digital camera as long as the image capturing apparatus can capture a plurality of subjects at the same time. It may be a portable telephone or the like.

  The image processing method according to the present invention is not limited to image processing in a digital camera, and may be image processing in an image processing apparatus such as a computer.

  Imaging means capable of simultaneously imaging the first and second subjects, image information acquisition means for acquiring image information, focal length information acquisition means for acquiring focal length information, and information processing for embedding focal length information in image information And other electronic devices can be applied without being limited to the digital camera.

  Further, in an image processing method for an image including a first subject and a second subject, a recognition step for recognizing the first subject and the second subject based on the difference in focal length If the image processing method includes a storage processing step for separating one subject and selectively storing it as separate image information, or an output processing step for output, image processing in a digital camera However, the present invention can be widely used for image processing in general image processing apparatuses represented by computers.

1 is a front view showing an external appearance of a digital camera 10 as an imaging apparatus according to the present invention. It is a top view which shows the external appearance of the digital camera 10 as an imaging device which concerns on this invention. It is a rear view which shows the external appearance of the digital camera 10 as an imaging device which concerns on this invention. 2 is a block diagram showing an internal configuration (control unit) of the digital camera 10 and its function. FIG. The 1st picked-up image 100 which image | photographed the subject X and the subject Y simultaneously, and the 2nd picked-up image 200 are shown. It is a flowchart which shows the flow of a process from imaging | photography (imaging) of a to-be-photographed object to trimming.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Digital camera, 12 Shooting lens, 14 Finder window, 15 Focal length detection sensor, 16 Strobe, 18 Strobe light control sensor, 19 Memory slot, 22 Shutter button, 24 Power switch, 26 Zoom enlarge button, 28 Zoom reduce button, 30 Mode switch, 32 Cross cursor button, 34 Finder, 35 Character display, 36 Strobe button, 37 Macro button, 38 Liquid crystal display (LCD), 40 CPU, 41 Image sensor (CCD), 42 Analog signal processor, 43 A / D conversion unit, 45 aperture control unit, 46 focal length calculation unit, 47 operation board, 48 timing generator (T / G), 50 image information processing unit, 51 image information acquisition unit, 52 focal length information acquisition unit, 53 information Compositing means, 60 trimming processing unit, 61 subject recognition Means 61a Distance information recognition means 61b Approximate color recognition means 61c Line / curve recognition means 62 Image separation means 70 Memory (RAM) 72 Compression / decompression circuit 73 Card reader / writer device 74 Memory card 100 1 shot image, 200 2nd shot image

Claims (5)

Imaging means capable of simultaneously imaging the first subject and the second subject;
Image information acquisition means for acquiring image information of the first subject and the second subject imaged by the imaging means;
Focal length information acquisition means for acquiring first focal length information about the focal length of the first subject and second focal length information about the focal length of the second subject;
An image processing apparatus comprising: information processing means for embedding the first and second focal length information in the image information. 2. The apparatus according to claim 1, further comprising a separation unit configured to separate the image of the first subject or the image of the second subject based on the difference between the first and second focal length information. Imaging device. The separating means further separates the image of the first subject or the image of the second subject by complementarily using at least one of a recognition function using approximate colors or a straight line or curve recognition function. The imaging apparatus according to claim 2, characterized in that: The imaging apparatus according to claim 1, further comprising at least one of a storage unit that stores the image information in which the first and second focal length information are embedded, or an output unit that outputs the image information. . In an image processing method for an image including a first subject and a second subject,
A recognition step for recognizing the first subject and the second subject, respectively, based on the difference between the focal length of the first subject and the focal length of the second subject;
Either one of the storage processing step of separating one subject recognized in the recognition step and selectively storing it as separate image information, or the output processing step of selectively outputting as separate image information; And an image processing method.

Images