JP4540580B2 - camera - Google Patents

Description

  The present invention relates to a camera that enjoys image appreciation by combining a plurality of images for display or printing, and a control method therefor. The present invention also relates to a program for causing a computer to execute the control method and a recording medium on which such a program is recorded.

  A conventional image appreciation style will be described with reference to FIGS. A conventional user takes a picture with a camera as shown in FIG. 1 (A), then prints each image individually as shown in FIG. 1 (B), and pastes it on an album as shown in FIG. 1 (C). Save it. Then, as shown in FIG. 1D, an appreciation method is generally used in which an album is turned to look back on memories at the time of shooting. Especially in the case of a film camera, the image is not developed until it is developed, so the general appreciation method is to print all the frames and put them in the album except for the really failed photos. In addition, users gave only special ones to others.

  On the other hand, digital cameras have recently become the mainstream in place of film cameras, but there is a great need for digital cameras in the culture of presenting prints. It is still fun to give beautiful photos as gifts.

And since digital images are easy to edit and edit, in the age of digitization, when you print the same single photo, you don't just print the photo of the person alone. A plurality of images are arranged on one screen by processing such as image synthesis, and a print with a richer atmosphere is created. Specifically, a new image is created by adjusting and arranging the size on one screen as shown in FIG. 2B from images taken separately as shown in FIG. A composite image blended into one image as shown in (C) is also created. Japanese Laid-Open Patent Publication No. 2000-215212 also proposes a photo collage creation method for classifying an image by an identifier attached to the image to create an album.
JP 2000-215212 A

  A single image can be created by combining a plurality of images as described above using a personal computer in which dedicated software is installed. The same applies to the print image. However, if a plurality of images are combined, an image rich in atmosphere is not always obtained. In other words, in order to obtain a combination image with a rich atmosphere, it is important to select not only a simple image processing technique but also an image to be combined.

  However, it is not easy for inexperienced users to know which images can be combined with a richer atmosphere and to print the images, and it is not easy to create an appropriate combination image at present. An appropriate combination image is selected, and a camera capable of creating an appropriate combination image even by a beginner is desired.

The present invention has been made in view of the above problems, and an object of the present invention is to provide a camera that appropriately selects a combined image to be used for creating a combined image.

1) In order to achieve the above-described object, a camera according to the present invention includes a recording control unit that records a captured image in an image memory, a feature extraction unit that detects the number of people in the captured image, Based on the detection of the feature detection unit, a selection unit that selects a sub-image from the image memory for the specified image among the images recorded in the image memory, and the specified image and the selected image An image processing unit that forms one image from at least two images, and the selection unit is configured to cope with a case where the designated image is determined to be a portrait image based on detection by the feature detection unit. A collective image in which a plurality of people gather is selected from the image memory as a sub-image to be performed.

2) Further, in the camera according to the present invention, the recording control unit records the number of persons detected by the feature extracting unit together with a photographed image in the image memory.

3) In the camera according to the present invention, if the selection unit determines that no person is included in the specified image based on the detection by the feature detection unit, the sub-image corresponding to the specified image is displayed. As described above, an image in which no person is photographed is selected from the image memory.

ADVANTAGE OF THE INVENTION According to this invention, the camera which can select appropriately the digital camera, especially the combined image used for combined image preparation can be provided.

  Hereinafter, the present invention will be described with reference to the illustrated embodiments.

  Embodiment 1 of the present invention will be described below with reference to FIGS. FIG. 3 is a block diagram of the camera 10 which is an embodiment of the present invention.

  The camera 10 includes a photographing lens 2 for forming an image of the subject 11, an image pickup device 3 for photoelectrically converting an optical image, an A / D conversion means 4 for converting an electrical signal from the image pickup device 3 into digital data, white Image processing means 5 for performing balance adjustment, gamma correction, image compression / decompression processing, and processing for forming one image from a plurality of images as will be described later, an image memory 6 comprising a non-volatile memory (for example, a flash or a hard disk), an image A recording control unit 1a for recording an image in the memory 6 is provided.

  The photographing lens 2 has a zoom lens (not shown), and is provided with zoom control means 2b for controlling the zoom position. The zoom control means 2b has a lens drive motor.

  In addition, a focusing means 2a for focusing the photographing lens 2 at the time of photographing is provided. The focusing means 2a is composed of an actuator or the like, and it exhibits the highest contrast according to the contrast signal of the image output from the image processing means 5 so that the photographing lens 2 is focused at a position where the subject image is most clearly reflected. In this way, the position of the taking lens 2 is controlled.

  Further, the camera 10 includes a switch 12a and a switch 12b for notifying operation status, an image feature extracting means 8 for extracting image features, which is a feature of the present invention, and a clock 8a for detecting the shooting date and time. Display means 9 (for example, composed of an LCD) for displaying an image being photographed or recorded, and transmission means 7 for outputting image data to a printer 20 connected as an external device are provided.

  The camera 10 is provided with a CPU 1 that controls the entire sequence of the camera 10. The CPU 1 controls the zoom control unit 2b, the focusing unit 2a, the image processing unit 5, the feature extraction unit 8, the transmission unit 7, and the like. Further, the CPU 1 has a recording control unit 1a for recording image data in the image memory 6 and a selection unit 1b, which will be described in detail later, as functional units by performing control according to the program.

  Hereinafter, the operation of the camera 10 will be briefly described. The CPU 1 determines the user's operation by detecting the operation state of the switch 12a and the switch 12b. Then, when there is an instruction for photographing, the photographing lens 2 is controlled by the focusing means 2a, the zoom control means 2b, etc., and photographing is performed.

  The image of the subject 11 passing through the photographing lens 2 is formed on the image sensor 3 and output, and is converted into a digital image signal by the A / D conversion means 4. Further, the image signal is subjected to white balance adjustment, gamma correction and compression by the image processing means 5, and is recorded in the image memory 6 as image data by the recording control unit 1a.

    Further, the CPU 1 detects the distance L of the subject from the lens position when the focus is adjusted by the focus adjusting unit 2a, and detects the zoom position information Z from the zoom control unit 2b. The feature extraction unit 8 extracts the characteristics (brightness, color, etc.) of each captured image from the data indicating the feature L of the subject, the zoom position information Z, and the image feature output by the image processing unit 5. The extracted feature data such as the subject distance L and the zoom position information Z are recorded together with the image data in the image memory 6 by the recording control unit 1a.

The image recorded in the image memory 6 is reproduced and displayed on the display means 9. When the printer 20 is connected to the camera 10 as an external device, the image data recorded in the image memory 6 is output from the image processing unit 5 to the printer 20 via the transmission unit 7 according to the instruction. The Then, it is printed out from the printer 20 as a photograph 20a. Further, as will be described later, an image formed as one image by the image processing means 5 from a plurality of images (for example, two images) recorded in the image memory 6 is also displayed on the display means 9 and printed out. The

  FIG. 4A is a perspective view of the appearance of the camera 10 as viewed from the back. A display unit 9 made of a large LCD is mounted on the rear surface of the camera 10. A cross key type switch as a switch 12 a and a single switch are arranged at a position where the user can operate with the right thumb of the user next to the display unit 9. A switch 12b which is a switch is arranged. A printer connector 14 is provided on the lower surface of the camera 10. On the screen of the display means 9, for example, as shown in the figure, two screens are displayed: a main screen 9a having a large area and a sub-screen 9b having a small area. In order to double the enjoyment of viewing by displaying two images, a group photo image contrasting with the main image of portrait shooting is selected here as the image of the sub-screen 9b. Details will be described later.

FIG. 4B is an example of a printed image in which the two images displayed in FIG. 4A are printed. A printer 20 is connected to the camera 10, and image data of an image formed by combining two images displayed on the main screen 9 a and the sub screen 9 b in FIG. 4A is transmitted from the image processing unit 5 to the transmission unit 7. And output to the printer 20 to obtain a print as shown in FIG.

  By printing an image in which a plurality of images are combined in this way, it is possible to create a print with a larger amount of information than one frame-by-frame print that has been systematized and used habitually until now. It is possible to provide nice prints that you can enjoy taking.

  FIG. 5 is a flowchart for explaining shooting / playback processing in the camera of the first embodiment. This flowchart is a main flowchart for the process of setting an image composed of two images for reproduction and printing shown in FIGS. 4A and 4B. This process is mainly executed by the CPU 1 reading the program stored in the CPU 1 or stored in an external ROM (not shown) and the feature extraction means 8.

  Steps S1 and S11 in FIG. 5 are steps for determining whether the operation of the camera 10 is a shooting sequence or a playback mode. First, an operation of a release switch (not shown) is detected, and when a release operation is detected (step S1Y), a shooting sequence is started. The focusing unit 2a performs focusing control (step S2), and then photographing is performed (step S3).

  After the photographing is completed, the subject distance L is detected from the focusing position of the photographing lens 2 (step S4). Next, the brightness information B in the screen is detected from the output of the image sensor 3 (step S5), the zoom position information Z at the time of shooting is detected from the output of the zoom control means 2b (step S6), and the clock means 8a is used. Then, time information T at the time of photographing is detected (step S7), and color information C is detected from the output from the image sensor 3 (step S8).

  Further, the number N of the faces of the subject is recognized from the image data by the built-in program for recognizing the face and the number N of people is detected (step S9). The number of faces is determined by detecting the faces of persons included in the image from the color of human skin using the eyes and nose.

  The information detection from step S4 to step S10 is performed by the feature extraction means 8 under the control of the CPU 1. The information thus obtained is recorded in the image memory 6 by the recording control unit 1a together with the image data as information (L, B, Z, C, N, T) attached to the photographed image (step S10).

  On the other hand, when the release operation is not detected (step S1N), the process proceeds to step S11. Step S11 is a step of determining whether the mode is the playback mode or the shooting mode. When the user has set the playback mode (step S11Y), the last captured image is displayed on the display means 9 (step S12).

  In this display state, the user's operation of the multi-screen switch 12b is determined (step S13). When the multi-screen display operation is not performed (step S13N), the user's image switching operation is further determined (step S14). If there is a switching operation (step S14Y), another image is read from the image memory 6 and displayed on the full screen (step 15), and the process returns to step S11. On the other hand, if there is no switching operation in step S14 (N), the process directly returns to step S11.

  On the other hand, when an operation for multi-screen display is detected (step S13Y), the user is caused to designate a main image to be displayed on the main screen 9a of the display means 9 from the images recorded in the image memory 6 (step S21). When this designation is not made, the image displayed in step S12 is set as the main image. This designation detects the operation of the switch 12a (cross key switch) and sequentially switches the images.

  After the main image is designated, sub-image selection is performed (step S22). In this step, based on the accompanying information L, B, Z, C, and N added to the main image in step S10 described above, an image that contrasts with the main image is selected as a sub image. .

  6 and 7 are flowcharts for explaining the details of the sub-image selection processing. This sub-image selection is mainly executed by the selection means 1b as a part of the control function of the CPU 1.

  First, the part described in the flow of FIG. 6 in the sub image selection process is characterized in that a sub image is selected according to the current date and time. In other words, as the first stage of sub-image selection, sub-images are selected from images close to the shooting date and time of the main image. At this time, the more sub-image candidates, the more appropriate image selection can be made. If it is widened, an image unrelated to the main image is selected as the sub image. Therefore, the range is appropriately set in consideration of the interval between the current date and time of reproduction and the shooting date and time when selecting.

  First, for the main image designated by the user, the time information T added to the main image is read out, and the shooting date / time information is calculated therefrom, and this is set to Do (step S31). Next, the information Dop of the operation date / time (current) during the multi-screen reproduction is calculated from the clock 8a (step S32).

  Next, a time difference ΔD between the operation date / time Dop and the main image shooting date / time Do is calculated (step S33). This is because when the sub-image related to the main image is selected from the main image, if the current time and the main image shooting time are separated from each other in time, the shooting time of the two images of the sub image is separated from the main image. However, it focuses on the fact that it can be recollected as a memory of the same era.

  FIG. 8 is a diagram for conceptually explaining this state. The horizontal axis is the time axis, the left direction is the past, and the right direction is the current direction. The vertical axis indicates the number of images recorded in the image memory 6. Assume that the image shooting is concentrated on a range of dates and times such as travel. When the operation time point is a time point Dop1 close to the main image capturing time Do, for example, it becomes unnatural unless it is selected from sub-images from images captured in a narrow period (candidate 1) that is the same day as the main image. It is necessary to select in the range of 1.

  On the other hand, when the operation time point is Dop2, which is a time point after returning from the trip, the photos of any day are arranged in the head as a record of the same trip date as long as it is a trip. This is because there is no problem even if it is selected from the period of candidate 2 wider than candidate 1.

  Returning to FIG. 6, it is determined whether the time difference ΔD is longer than 1 day (step S34). If longer than 1 day (step S34Y), it is further determined whether the time difference ΔD is longer than 7 days (step S34). S35) When longer than 7 days (step 35Y), the process proceeds to step 36. Then, three days before and after the shooting date (Do) of the main image are set as the candidate range of the sub image (step 36).

  On the other hand, when the time difference ΔD is 7 days or less in step S35 (step S35N), one day before and after the main image shooting date and time (Do) is set as the sub image candidate range (step S37).

  In step S34, when the time difference ΔD is 1 day or less (step S34N), the same date as the main image shooting date and time (Do) is set as the sub image candidate range (step S38).

  As described above, if it is a recent image, an event on the same day as that image is preferable as in step S38, and if it is a memory that has passed for a while, there is a difference of about ± 3 days as in step S36. However, it is possible to recollect naturally as memories of the same period.

  As described above, the candidate shooting date / time range is switched according to the reproduction (operation) time and the elapsed shooting time, so that the candidate range for selecting the sub image can be appropriately set.

  After steps S36, S37, and S38, the process proceeds to step S41 in FIG. FIG. 7 is a flowchart for explaining the requirements for further narrowing down the sub-images from the images included in the candidate range set in the flow of FIG. Note that the number of displayed sub-images is not limited to one, but a plurality of sub-images may be used. However, in the following description, the number of sub-images will be described as one for simplification.

  In step S41, the number of candidate images corresponding to the candidate range set in any of steps S36, S37, and S38 among the images recorded in the image memory 6 is photographed attached to each image data. Judgment based on date and time. Then, it is determined whether there are a plurality of candidate images (step S41). If there are not a plurality of candidate images, that is, if the number of candidates is 1 or less (step S41N), the process proceeds to step S42.

  Next, it is determined whether there is one candidate image. If there is one (step S42Y), the candidate image is determined as a sub-image (step S44), and this subroutine is terminated.

  However, when there is no candidate (step S42N), a default image irrelevant to the image data selected as the candidate from the date in the above steps S36, S37, S38, etc. is selected (step S43), and this is selected as the sub-image. (Step S44). As this default image, for example, an image obtained by processing the main image into a black and white image by the image processing means 5 or decorating like a painting may be used. Further, if a decoration image for a default image is recorded in the image memory 6 in advance, an image other than the image taken by the user can be used as a sub image.

  On the other hand, when there are a plurality of candidate images in step S41 (step S41Y), the process proceeds to step 51. Thereafter, the sub-image is narrowed down by performing determination based on the distance L of the subject and determination based on image brightness information B, color information C, and the like.

  First, a sub image is selected based on the distance L of the subject. The object distance at the time of main image shooting is set to Lo, and this Lo is compared with a short distance L01 (for example, 1.5 m) (step S51). When Lo <L01 (step S51Y), the process proceeds to step S52. In this case, if the main subject is a person, it is estimated that the photograph is a close-up picture of the person.

  Then, an image photographed at a distance of L> L03 (medium distance, L03 is 4 m, for example) is set as a candidate image (step S52). That is to say, with respect to the photograph of the main image up, the screen can be changed by arranging the photograph in which more people are reflected as a sub-image as a sub-image 9b in FIG. Because it is.

  Next, it is determined whether there is a candidate corresponding to L> L03 (step S53). If there is no candidate (step S53Y), the process proceeds to step 54. On the contrary, an image shorter than the proximity distance L04 (for example, 1 m) is selected as a sub-image candidate (step S54). This is because the image captured at close distance (macro) is estimated to be a subject different from the up person who is the main image.

Next, one candidate corresponding to step 54 is determined (step S64). When the number of candidates is 1, this is determined as a sub-image (step S44). 9, an image determined in this way as a sub-image, a display example of an image formed from two images of the sub image and the main image. 9a in FIG. 9 is a main image that has been shot up, and 9c is a sub-image that has been shot in macro. In this way, by arranging the macro-photographed image as a sub-image relative to the up-photographed image, the screen can be changed.

  On the other hand, when there is no candidate or a plurality of candidates in step 54 (step S64N), the process proceeds to step S55 for another selection method.

  Next, the process returns to step S51. When the main image is not Lo <L01 (short distance, L01 is, for example, 1.5 m) (step S51N), the process proceeds to step S61. An image photographed with L <L02 (for example, 1.2 m) is selected from the image memory 6 as a sub image candidate, and the process proceeds to step S62. This is because, since the main image is presumed not to be an up-photo, an image taken at a short distance is suitable as a sub-image.

  Then, it is determined whether or not there is a candidate in step S61 (step S62). If there is no candidate (step S62Y), an image shot at L> L05 (medium distance, L05 is 5 m, for example) is set as a sub-image candidate. (Step S63). Then, it is determined whether there is one sub-image candidate with L> L05 (step S64). If there is one (step S64Y), this is determined as a sub-image (step S44).

  On the other hand, if there is no candidate in step S63 or if it cannot be narrowed down to one, the process proceeds to step 55 (step S64N).

  In step S55, it is determined whether the main image is dark based on the brightness (luminance) information B attached to the main image. When it is determined that the main image is dark (step S55Y), a bright and colorful image is further selected as a sub image candidate based on the brightness information B and color information C of each image data of the candidate image (step S56). . Then, it is determined whether or not the number of candidates has become one (step S57). When the number is one (step S57Y), this is determined as a sub-image (step S44).

  On the other hand, when the number of candidates is not 1 (step S57N) and 0 (step S58Y), the default image is determined as a sub-image (step S43).

  On the other hand, when there are still a plurality of candidates (step S58N), an image whose photographing point is close to the main image is selected as a sub image (step S59), and this is determined as a sub image (step S44).

  Next, the process returns to step S55. When the main image is not dark (step S55N), that is, when it is bright, it is first determined from the time information T attached to the main image whether the main image is shot at night (step S71).

  When it is determined that the main image is an image captured at night (step S71Y), an image captured with flash is selected as a sub image candidate (step S72). When the main image is not a night image (step S72N), a bright image is selected as a sub image candidate based on the color information C (step S73). Then, the process proceeds to step S57. Since step S57 and subsequent steps are the same as described above, a description thereof will be omitted.

  Returning to the main flowchart of FIG. The image determined as the sub image by the sub image selection by the selection means 1b is displayed (step S23). At this time, the image processing means 5 forms one image from the two images of the main image and the sub image so that the main image is arranged on the main screen 9a and the sub image is arranged on the sub screen 9b. Then, the combined image is displayed on the display means 9 as the main screen 9a and the sub screen 9b.

  If the user does not like the sub-image as a result of viewing the display, the user performs an image switching operation with the switch 12a. When image switching by the user is detected (step S24Y), the next candidate image is displayed as a sub-image. At this time, an image having a large change from the main image is selected from the images leaked at the time of selection in the sub image selection in step S22.

  As described above, in this embodiment, the shooting date / time range as the sub image candidate is switched according to the playback (operation) time and the elapsed time of the shooting time, so that the selection range of the sub image candidate can be appropriately set. Furthermore, the subject distance, brightness information, color information, and time information are added to the main image as shooting information at the time of shooting, and the image recorded in the image memory is recorded based on these information at the time of sub-image selection. The sub-image candidates are selected from among the images of the subject distance in contrast to the main image and the brightness and color of the main image, so even users unfamiliar with the camera can select the appropriate sub-image. It is possible to create a reproduction display with change and an effective print.

  As described above, with this camera, an image shot under shooting conditions different from or contrasting with the main image is selected as a sub-image, and an image obtained by combining this with the main image is created and played back or printed. . If you show only similar pictures, you will be bored, but with such a display and print, two or more images can complement each other to convey a rich image to the viewer.

  Next, Example 2 will be described with reference to FIG. The second embodiment is an example in which zoom information is further added to the distance information of the subject to estimate the shooting situation, and a sub-image contrasting with the main image is selected. That is, when the camera is a camera with a zoom lens, the sub image is selected in consideration of not only the distance information but also the position information of the zoom lens. Since the block diagram of the camera 10 is the same as that of FIG. 3 which is the block diagram of the first embodiment, the illustration is omitted.

FIG. 10 is a flowchart illustrating a sub image selection process according to the second embodiment. This example is different from the first embodiment only in the contents of sub-image selection, and the overall processing is the same as that of FIG. 5 of the first embodiment, so the entire flowchart is omitted. The sub-image selection process is mainly executed by the selection unit 1b which is a function of the CPU 1, as in the first embodiment.

  The zoom position information Zo at the time of main image shooting is detected from the main image data (step S81). Subsequently, the distance Lo of the subject of the main image is detected from the main image data (step S82).

  Here, the reason why the shooting situation of the main image can be estimated from Zo and Lo will be described with reference to FIG. FIG. 11 is a diagram for explaining that the ratio of the human face to the width in the screen can be obtained from the subject distance Lo and the zoom focal length Zo. It is the schematic diagram which looked at the condition where the inside of the camera 10 and the subject 11 were lined up from the top.

When the horizontal width of the imaging surface of the image sensor 3 is S and the width Fw of the person's face passes through the lens 2 and the length imaged on the image sensor 3 is Sw, the ratio of the human face to the width in the screen is , S: Sw.
On the other hand, since Sw = (Zo / Lo) × Fw as can be seen from the figure, the ratio of the human face to the width in the screen is S: Sw = S: (Zo / Lo) × Fw. Here, since S and Fw (about 15 cm) are substantially constant, (Zo / Lo) corresponds to a variable corresponding to the proportion of the person in the screen. Using this, in this embodiment, Zo / Lo is compared with predetermined values (αo, β, α2) to determine the state of the person photograph (for example, whether it is up). However, β <αo <α2 is established.

  Returning to FIG. It is determined whether Zo / Lo> αo in the main image (step S83). If YES is determined (step S83Y), it is determined that the main image is a person-up photo (step S91).

  Then, an image corresponding to Zo / Lo <β is selected from the image memory 6 as a sub image candidate (step S92), and the process proceeds to step S93. This is because, for a main image that is a person-up photo, a distant view-like image is effective as a sub-image.

  On the other hand, if it is determined that Zo / Lo> αo is not satisfied in the main image (step S83N), the process proceeds to step S84. Then, it is determined whether Zo / Lo <β in the main image (step S84). If Zo / Lo <β (step S84Y), it is determined that the main image is a distant view (step S95).

  Then, an image corresponding to Zo / Lo> α2 is selected from the image memory 6 as a sub image candidate (step S96), and the process proceeds to step S93. This is because, for a main image that is a distant view photo, a photo (macro photo) that attempts to take a large image of a small object with a short focus and a long focal length is effective as a contrasting sub-image.

  On the other hand, in the determination that Zo / Lo <β is not satisfied in the main image (step S84N), it is determined that the main image is a normal snapshot (step S85). At this time, since the main image is a normal snapshot, sub-image candidateization is not performed based on the distance data, and the process proceeds to step S93.

  In step S93, the color information C is further used from the sub-image candidates obtained in steps S92 and S96 to select a brighter color with priority. The sub image is determined as described above (step S94).

  Through the above processing, the sub-image that is accented with respect to the main image and is varied is selected using the zoom information at the time of shooting. Then, it is possible to create one piece of work that is composed of these two images.

Next, Example 3 will be described with reference to FIG. Example 3 is an example in which a sub-image is selected based on the number of persons. In the first and second embodiments, an image contrasting with the main image is selected as a sub-image mainly using zoom information at the time of shooting, subject distance, and brightness information. However, in this embodiment, such a concept is extended. The number of people in the screen is checked, and the image contrasted with the main image is set as a sub-image according to the information. Since the block diagram of the camera 10 is the same as that of FIG. 3 which is the block diagram of the first embodiment, the illustration is omitted.

FIG. 12 is a flowchart illustrating a sub image selection process according to the third embodiment. This example differs from the first example only in the contents of sub-image selection, and the overall processing is the same as that of FIG. 5 of the first example, so the entire flowchart is omitted. Sub-image selection is mainly executed by the selection unit 1b , which is a function of the CPU 1, as in the first embodiment.

  As described in the first embodiment, in step 9 of FIG. 5, detection in each image is performed by the feature extraction unit 8 that detects the face of a person included in the image from the color of the human skin using the eyes and nose. The number-of-persons information N is detected from the number-of-faces-number information, and the number-of-peoples information N is also attached to the image and recorded in step 10. The number information N is used in the following steps.

  First, in step S110 in FIG. 12, it is determined whether there is a person in the main image. When there is no person in the main image (step S110Y), an image in which no person is shown is set as a sub image (step S111). Since a photograph without a person is selected as a main image, an image with no person is selected as a sub-image, and a contrasting image is selected from information different from the number of persons. For example, an image which is contrasted in terms of color vividness or an image with a significantly different shooting distance is selected.

  On the other hand, when a person is shown in the main image (step S110N), the process proceeds to step 112. Further, when it is determined that one person is included in the main image (step S112Y), a photograph in which two or more persons are reflected is selected as a sub image (step S113).

  On the other hand, when it is determined that two or more people are included in the main image (step S112N), the group photo is selected as a sub image (step S114). As described above, it is possible to change the image by arranging the contrasting images according to the number of photographed people, and to create an image that looks good.

Finally, an example of printing by a camera as described in the first, second, and third embodiments will be described. FIG. 13 is a perspective view illustrating a state in which print paper is output from the printer 20 to which the camera 10 is docked. FIG. 12A shows the camera 10 and the printer 20 to which the camera 10 is docked, and FIG. 12B shows a state in which an image composed of two images, ie, a main image and a sub image, is printed.

The camera 10 is inserted into the upper surface of the rectangular printer 20 from an oblique direction with the rear surface facing forward. First, in FIG. 2A, the camera 10 is in a normal playback mode, and the main image 9 designated by the user is displayed large on the display unit 9 of the camera 10.

If the multi-screen is selected by the user and the current main image is designated as the main image as it is, a sub-image contrasting with the main image is automatically selected by the above-described sub-image selection processing. As shown in FIG. 5B, the display unit 9 displays two images of the main image 9a and the selected sub image 9b with different sizes. When the print instruction is, the same image as the image displayed, printed processed in the printer 20, is output from the printer 20. If such a camera system is used, anyone can easily obtain a print with a large amount of emotional information from two pieces of image information.

  According to the present invention, even a user who is unfamiliar with photography can create a print in which two or more images are arranged and changed.

  The selection means 1b is realized by the control processing of the CPU 1 according to the program. That is, the program itself realizes the functions of the above-described embodiment, and the program itself constitutes the present invention. To do.

  These programs may be in the form of a recording medium other than the ROM described above, or may be stored in a recording medium that can be attached to and detached from the camera. Further, a storage device such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium, and the program may be provided to the camera via the communication network. Alternatively, it goes without saying that such a program is also included in the embodiment of the present invention even when the functions of the above-described embodiment are realized in cooperation with other application software or the like.

  In the first to third embodiments, the display control process is described as being realized by executing the program by the CPU 1, but the present invention is not limited to this. For example, part or all of each process is realized by hardware. You may make it do.

  In the above embodiment, the camera is described as a single camera. However, the present invention may be applied to a camera unit such as a camera-equipped mobile phone.

  The present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the components without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

The figure which shows the conventional series of photography appreciation methods of taking a photograph and appreciating the photographed photograph with an album. (A) is a diagram showing images taken separately, (B) is a diagram showing images created by reducing layout from the separate images, and (C) is a diagram showing images synthesized from the separate images. FIG. 2 is a block diagram showing an electrical internal configuration of the camera of Embodiment 1. 1A is a perspective view of the appearance of the camera of FIG. 1 as viewed from the back side, and FIG. 2B is a diagram showing a print using an image output from the camera. 3 is a flowchart illustrating camera shooting and reproduction processing according to the first exemplary embodiment. 6 is a flowchart illustrating the first half of a subroutine process related to sub image selection in the flowchart of FIG. 5 according to the first embodiment. 6 is a flowchart illustrating the second half of a subroutine process related to sub image selection in the flowchart of FIG. 5 according to the first embodiment. 6 is a graph for explaining that the candidate range is changed according to the interval between the operation date and time and the shooting date and time in the first embodiment. 6 is a diagram illustrating an example of an image in which a sub image selected based on a subject distance is combined with a main image in Embodiment 1. FIG. 9 is a flowchart illustrating a sub image selection process according to the second embodiment. In Example 2, it is a figure explaining calculating | requiring the ratio for which a person's face occupies the width | variety within a screen from object distance Lo and zoom focal distance Zo. 9 is a flowchart illustrating a sub image selection process according to the third embodiment. (A) is a perspective view showing the printer 20 and the camera 10 docked on the printer 20 and displaying the main image on the display means 9, and (B) shows the main image and the sub-image on the display means 9 of the camera 10. FIG. 4 is a perspective view showing a state in which a displayed image is printed from the printer 20.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... CPU, 1a ... Recording control part , 1b ... Selection part , 2 ... Shooting lens, 2a ... Focusing means, 2b ... Zoom control means, 3 ... Imaging element, 4 ... A / D conversion means 5 ... Image processing means, 6 ... Image memory, 7 ... Transmission means, 8 ... Feature extraction means, 8a ... Clock, 9 ... Display means, 9a ... Main screen, 9b ... Sub-screen, 10 ... Camera, 1 1 ... subject,
1 2 a, 1 2 b ... switch, 1 4 ... printer connector, 2 0 ... printer,
20 a ... printed paper, L ... subject distance , Z ... zoom position information, B ... brightness information, C ... color information, T ... time information, N ... number of people information, Dop ... operation date and time information, Do ... Date and time information of main image, Δ D ... Time difference, S ... Horizontal width of imaging surface, F w ... Width of human face, S w ... Length formed on imaging device 3

Claims (3)

A recording control unit for recording the captured image in an image memory;
A feature extraction unit for detecting the number of people in the captured image;
A selection unit that selects, from the image memory, a sub-image for an image designated among the images recorded in the image memory based on the detection of the feature detection unit;
An image processing unit that forms one image from at least two of the designated image and the selected image.
The selection unit selects, from the image memory, a group image in which a plurality of people gather as corresponding sub-images when it is determined that the designated image is a portrait image based on the detection of the feature detection unit. A camera characterized in that it does. The camera according to claim 1, wherein the recording control unit records the number of persons detected by the feature extraction unit in the image memory together with an image captured as shooting information . If the selection unit determines that no person is included in the designated image based on the detection by the feature detection unit, the selection unit selects an image that does not include a person as a sub-image for the designated image. The camera of claim 1, wherein the camera is selected from a memory .