JP2003338955A - Camera with advising functions - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera with advising functions, having the function for advising before photographing so as not to photograph a failure frame picture at photographing. <P>SOLUTION: This camera is provided with an electronic view finder 16 which displays an object image as an animation on a liquid crystal display; an optimum frame judging means 13 which decides whether the current frame is optimum, by detecting at least either the position of a person area in a photographic picture plane or the occupancy ratio in the picture plane of the person area; and a superimposing display means 14, which superimposes an advise image for the optimum frame by superposing the object image in the electronic view finder, when deciding it is not the optimum frame by the optimum frame deciding means 13. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a camera with an advice function, and more specifically, an advice function having a function of judging whether or not the composition of a photograph taken at the time of shooting is appropriate and advising the photographer of the optimum composition. With attached camera.

[0002]

2. Description of the Related Art As is well known, in recent years, the automation of cameras has advanced, and it has become common for cameras to automatically set the focus and exposure properly just by pressing a release button. Easy without taking a failure photo,
And now I can take good pictures accurately.

On the other hand, since the composition setting when determining the composition at the time of taking a picture is left to the subjectivity of the photographer, it is possible to realize a camera for automatically taking a picture that does not make the composition feel uncomfortable or uncomfortable. It has not been. However,
Setting a stable composition is a relatively difficult technique for beginners to take pictures, and because beginners often cannot afford to be aware of the composition when taking pictures, it is especially necessary to take pictures of "background and people". In the case of performing, there is a problem that a photograph having a composition in which the background and the person are out of balance is taken after the photographing.

Therefore, in order to deal with such a problem, in Japanese Patent Laid-Open No. 2001-167253, the characteristic information extracted from the photographed image is compared with predetermined composition data and the evaluation result is given to the photographer. A camera to advise is proposed.

[0005]

However, the camera proposed in Japanese Unexamined Patent Application Publication No. 2001-167253 gives advice to an image after being photographed, and advises the composition at the time of photographing. Since it is not a thing, it is only useful for future reference.

As a practical matter, it is more beneficial for the photographer to advise the subject to be photographed of the composition.

The object of the present invention has been made in view of the above circumstances, and an advice function having a function of giving advice before taking a picture so as not to take a picture of a failed composition especially when taking a picture of a person or the like at the time of shooting. To provide a camera with.

[0008]

In order to achieve the above-mentioned object, a camera with an advice function according to the present invention comprises an electronic viewfinder for displaying a subject image as a moving image on a liquid crystal display device, and a photographing screen. Position of person area,
Alternatively, by detecting at least one of the occupation ratios of the person area in the screen, the optimum composition determination means for determining whether or not the current photo composition is optimum, and the optimum composition determination means, the optimum composition determination means If determined, the electronic viewfinder further comprises superimpose display means for superimposing an advice image for optimum composition on the subject image, and the above-mentioned advice function is provided. The camera also
A portrait shooting mode and another shooting mode can be set, and when the portrait mode is set, the optimum composition determination means is operated, and the advice image is a trimming mask. It is characterized by being an image or a contour image of a person.

Further, it is provided with a finder for observing a subject image, and a superimposing means for superimposing and displaying in the finder, advice information on an optimum position of a person in a photographing screen or an occupation ratio. Is characterized by.

Further, at least one of the finder for observing the subject image and the position of the person area in the photographing screen or the occupation ratio of the person area in the screen is detected to determine whether the current composition is optimal. If the optimum composition judging means for judging whether or not it is not the optimum composition is judged by the optimum composition judging means, the advice image for the optimum composition is superimposed on the subject image in the viewfinder. And a superimpose display means.

[0011]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a perspective view of a camera with an advice function according to an embodiment of the present invention as viewed from the back.

A camera with an advice function according to an embodiment of the present invention is a so-called digital camera for picking up an image of a subject with an image pickup device and storing it in a memory device (neither is shown), as shown in FIG. An electronic viewfinder 2 is provided on the rear surface of the camera body 1 for displaying an image captured through a taking lens as a moving image on a liquid crystal display device provided in the viewfinder. The electronic viewfinder 2 determines the shooting composition and shutter timing by viewing the displayed moving image, like the optical viewfinder in the conventional silver halide camera.

FIG. 2 is a block diagram showing the overall configuration of the electric circuit of the camera with an advice function showing one embodiment of the present invention.

As shown in FIG. 2, this digital camera has an image pickup unit 100 whose main part has a mechanical member relating to image pickup and image formation, and an electric circuit, an image pickup control unit 200, a processing unit 300, and a display unit. And 400.

The image pickup unit 100 comprises a taking lens 101 including a focus lens and a zoom lens, an aperture 104, a shutter 105, a CCD 106, and an image processing circuit 107, and the CCD 106.
Is for forming a subject image captured by the taking lens 101 on a light receiving surface and accumulating charges in each sensor element (not shown) of the CCD 106 according to the light amount of the formed subject image. The image processing circuit 107 is
The analog signal output from the CCD 106 is R,
The color components are separated into G and B components, the white balance is adjusted, and then converted into an electronic image and output to the processing unit 300.

The image pickup control unit 200 includes a zoom drive circuit 204, a focus drive circuit 205, an aperture drive circuit 206, a shutter drive circuit 207, an image pickup system CPU 201 for controlling them, a distance measuring circuit 202, and photometry. And a circuit 203.

The zoom drive circuit 204, the focus drive circuit 205, the aperture drive circuit 206, and the shutter drive circuit 207 each have a drive means such as a stepping motor, and are controlled by the image pickup system CPU 201 to take the image. Drive control of the lens 101, the diaphragm 104, and the shutter 105 is performed.

The distance measuring circuit 202 measures the distance to the subject in response to the depression of a release switch (not shown), and the photometric circuit 203 measures the subject brightness and the measured distance data. The subject brightness data is sent to the imaging system CPU 201.

The image pickup system CPU 201 controls the image pickup unit 100 and the image pickup control unit 200, and based on photographing information such as zoom magnification instructed by the photographer, the zoom drive circuit 204 and the focus. The drive circuit 205 is controlled to adjust the zoom magnification and focus of the taking lens 101, and the aperture value and shutter speed are determined based on the RGB digital signal integrated value of one image frame, that is, AE information. According to the determined value, the diaphragm drive circuit 206 and the shutter drive circuit 207 respectively adjust the diaphragm amount of the diaphragm 104 and open and close the shutter 105.

Further, the image pickup system CPU 201, based on the photometric data from the photometric circuit 203, outputs the aperture 10
Adjust the aperture amount of 4. Furthermore, when the photographer gives an instruction to capture an image, the CCD 106 starts accumulating charges, and after the shutter time calculated from the photometric data by the above-described means elapses, the accumulated charges are accumulated.
It is controlled to output to 07.

The processing unit 300 includes the input switch group 306 and the entire digital camera, especially the processing unit 3.
00, a processing system CPU 301 for controlling itself, a compression / expansion processing circuit 302 controlled by the processing CPU 301, a captured image non-volatile memory 303, and a reference data non-volatile memory 3
04, a contour processing circuit of the contour image extraction circuit 305, and a main bus 307.

The compression / expansion processing circuit 302 compresses (encodes) the electronic image data output from the image processing circuit 107 so as to store it in the non-volatile memory 303 for the photographed image, or the non-volatile memory for the photographed image. Sex memory 303
It is a circuit for decompressing (decoding) the compressed image data read from the.

The input switch group 306 connected to the processing system CPU 301 includes a release switch which is interlocked with the operation of a release button, a mode setting switch which sets the portrait photographing mode and other modes, and a zoom switch which is interlocked with the zooming operation. Etc. are included (none are shown).

Non-volatile memory for reference data 304
Is for storing model composition data, a predetermined value for comparison, a mask image, a contour image, etc. used in an optimum composition determination unit 13 (see FIG. 3) described later, and the contour image extraction circuit 305 is , A contour image extraction unit 12 (see FIG.
Refer to) is a circuit corresponding to.

The main bus 307 connects the processing system CPU 301, the compression / expansion processing circuit 302, the photographed image non-volatile memory 303, the reference data non-volatile memory 304, and the contour image extraction circuit 305 to each other. Data is exchanged between the circuits via the main bus 307.

The display unit 400 comprises a display control circuit 401, an in-viewfinder liquid crystal display device 402 controlled by the display control circuit 401, an exterior surface liquid crystal display device 403, and a sounding device 404. 401
Corresponds to an image display control unit 15 (see FIG. 3) described later, and the in-viewfinder liquid crystal display device 402.
Corresponds to the electronic viewfinder 2 and corresponds to an image display unit 16 (see FIG. 3) described later. Further, the sounding device 404 includes electric parts such as a speaker and will be described later. Audio information output unit 17 (see FIG. 3)
Is equivalent to.

Further, the display control circuit 401 is connected to the main bus 307 in the processing unit 300 and exchanges data with each other.

As described above, the camera with the advice function according to the present invention is roughly configured.

FIG. 3 is a block diagram showing the configuration of an electric circuit for explaining in detail the advice function of the camera with the advice function according to the embodiment of the present invention, and FIG.
5 to FIG. 5. FIG. 5 is a diagram showing an example of the “model composition”, and FIG. 6 is a diagram showing a method of detecting the contour image of the imaged person image.

Here, the "exemplary composition" varies depending on the subjectivity of the photographer and the photographing conditions.
In the case of a so-called “commemorative photo”, in which a person and a landscape are taken together, a photograph in which the size of the person and the background is appropriately balanced as shown in FIG. 4 is the “model composition” and the intention of the photographer is In the case of a portrait, the composition in which a person is emphasized and photographed is generally the “model composition” as shown in FIG.

Therefore, when it is clear that the camera with the advice function of the present invention is for portrait photography,
That is, when the "portrait photographing mode" is selected by the input switch group 306 (see FIG. 2), advice is given by superimposing display.

As shown in FIG. 3, the subject image picked up by the image pickup section 10 is converted into electronic image data by the image processing section 11. Incidentally, the image pickup unit 10 and the image processing unit 11
Corresponds to the image pickup unit 100 described above (see FIG. 2).

The electronic image data converted by the image processing unit 11 is sent to the image display control unit 15, and the image display control unit 15 converts the electronic image data into a format suitable for display, and The image is displayed on the image display unit 16 corresponding to the electronic viewfinder 2. Since this series of operations is repeated, a moving image of the subject is displayed on the image display unit 16. The image display control unit 15 and the image display unit 16 are the display unit 40 described above.
It corresponds to 0 (see FIG. 2).

On the other hand, the electronic image data generated by the image processing unit 11 is also sent to the contour image extracting unit 12. The contour image extraction unit 12 detects a contour image portion of a person from the electronic image data and specifies the person range in the photographing screen from the information.

As shown in FIG. 6, the method of identifying the person range from the electronic image data is as follows. First, the electronic image 30 captured by the image capturing section 10 is vertically, for example, 200 ×.
The image is resized to an image having a horizontal resolution of 300, and the outline image 31 of the person is extracted based on the image. This contour image 3
The method of extracting 1 is, for example, a method of detecting an edge portion where the contrast changes abruptly and making a determination by comparing the edge shape with a human shape, or an area that matches a human shape centering on an area having a skin color component. A known method such as a method for determining the above may be used.

Next, a region 32 surrounding the contour image 31 (hereinafter, referred to as
(Person area 32) is set, and the
Coordinate P of the corner₁(X₁, y₁), P_Two(X_Two, y_Two), P_Three
(X _Three, y_Three), P_Four (X_Four, y_Four), And Centro
Mark P₀(X₀, y₀) Is detected.

The information on each coordinate of the person area 32 detected in this way is sent to the optimum composition judging section 13 to judge whether or not the current image has an "optimal composition". The optimum composition judgment unit 13 constitutes an optimum composition judgment means in the present invention.

Specifically, first, the coordinates (P ₁
~ P ₄ ) calculates the ratio of the person in the screen (size of the person in the screen) from the information. Next, it is determined from the calculation result whether or not the size of the subject in the screen is appropriate. There are several possible subject size patterns that determine stable composition in portrait photography, but it is generally preferable that the upper half of the subject be within the screen as shown in FIG. Therefore, if the in-screen ratio of the person is less than or equal to the predetermined value,
It can be judged that the person in the screen is small, and it is judged that it is not the "optimal composition".

Another factor of the "optimal composition" is the position of the person. In other words, even if the proportion of the person in the screen is appropriate, if the person is placed in the center of the screen, a vague photograph with no spread or movement will be generated, but as shown in FIG. Central A
The problem can be remedied by arranging them in a position shifted to the left and right. Therefore, the optimum composition determination unit 13 compares the above-described information of the center coordinate P ₀ with the center position A of the screen, and if the difference is smaller than a predetermined value, the person is placed in the center of the screen. It is judged that it is not the “best composition”.

In general, "composition" means "to most effectively and aesthetically arrange a subject on the screen based on the photographer's expression intention and aim in order to emphasize the subject of the photograph." If is appropriate, the screen is neat and the viewer can feel a sense of stability. Therefore, the "optimal composition" in the present invention is the above-mentioned "composition with a sense of stability". Also, “place most effectively and aesthetically”
Is a method empirically cultivated. Also,
The “predetermined value” is a “design value determined by analyzing a composition that a general photographer recognizes as a composition with a sense of stability”.

As described above, the optimum composition determination unit 13
Has a function of determining whether or not the composition is optimum by using at least one of the above determination methods. still,
The contour image extraction unit 12 and the optimum composition determination unit 13
It corresponds to the above-mentioned processing unit 300 (see FIG. 2).

When the optimum composition judging section 13 judges that the composition is "optimal composition", the voice information output section 17
Will announce that it is an "optimal composition." Specifically, advice messages such as "It is a good composition.""I think it is better to shoot with this composition." Are issued by voice. The voice information output unit 17 corresponds to the display unit 400 described above.

On the other hand, when it is determined that the composition is not the optimum composition, the superimposing image setting unit 14 instructs the image display control unit 15 to perform superimposing display. In response to this instruction, the image display control unit 15
Sends the superimposed image to the image display unit 16 in order to superimpose the advice image on the moving image display. The superimpose image setting unit 14 corresponds to the display unit 400 described above. Further, the voice information output unit 17 may be notified that the composition is not “optimal composition”, and specifically, an advice message such as “Let's shift it to the right a little more” may be issued by voice. The superimpose image setting unit 14 constitutes superimpose display means.

Here, FIGS. 7 to 8 are views showing an example of the superimposed display.

There are several possible forms of superimpose display. For example, there is a method of indicating a trimming range as shown in FIG. This is to display an opaque or semi-transparent mask 33 on an unnecessary portion on the current photographing screen so that the photographer recognizes that the unnecessary portion is unnecessary. The photographer who saw
It suffices to perform zooming or close so that the mask area 33 is eliminated, that is, the non-mask area 34 fills the photographing screen.

The mask area 33 is superimposed by the superimpose image setting unit 14 on the basis of the size of the photographing screen, in-screen ratio information of the person area 32, center position information, and model composition data. Image setting section 1
An area is selected from a mask image storage unit (not shown) provided in the area 4.

As another form of superimpose display, an example in which a contour image 35 of a person is displayed on the electronic viewfinder as shown in FIG. 8 is also conceivable. The outline image 35 is the superimposed image setting unit 14
However, based on the size of the photographing screen, the in-screen ratio information of the person area 32, the center position information, and the model composition data, from a contour image storage section (not shown) provided in the superimpose image setting section 14. Select an area. Alternatively, the contour image extracted by the contour image extraction unit 12 may be appropriately enlarged and displayed in a superimposed manner.

In the camera with an advice function according to the embodiment of the present invention configured as described above, when the portrait photographing mode is set by the input switch group 306, it is displayed on the electronic viewfinder 2 at the time of photographing. The optimum composition judging section 13 judges whether or not the optimum composition is "optimal composition" by comparing with a preset "optimal composition", and based on the judgment, the superimpose image setting section. The "optimal composition" is photographed by superimposing the "optimal composition" on the image display section 16 (the electronic viewfinder 2) by 14 or by notifying by voice by the audio information output section 17. Can give advice to others.

In the above embodiment, the electronic viewfinder 2 is provided in the finder to prevent camera shake. However, the invention is not limited to this. As shown in FIG. Electronic viewfinder 3 on top
May be provided. By disposing in this way, the camera body 1 can be formed in a small size and the cost can be reduced.

Further, in the above embodiment, the subject image is observed by the electronic viewfinder, but the subject image can be visually recognized by the optical viewfinder device used in the conventional silver halide camera. May be. In that case, a liquid crystal display device that displays the advice image of the optimal composition as described above, and a half mirror that guides the image displayed on the liquid crystal display device into the finder optical path and allows observation with being superimposed on the subject image. It may be provided in the finder device.

Further, when the portrait photographing mode is selected, the superimposing function always works and gives advice, but the invention is not limited to this. For example, as shown in FIG. Needless to say, the pause function 4 may be provided and the advice function may be executed by pressing this button.

Further, although the advice function is executed in the portrait photographing mode for picking up a portrait image, the present invention is not limited to this. It goes without saying that it may be applied to the above.

[Additional Notes] According to the embodiment of the present invention described in detail above, the following configurations can be obtained. That is, (1) image pickup means for picking up a subject, image processing means for converting the subject image signal picked up by the image pickup means into electronic image data, image display means for displaying the electronic image data, and the electronic image. Contour image extracting means for detecting a contour image of a person from the data and specifying a person area in the photographing screen based on the detection result, a position of the person area, and / or
Alternatively, based on the size information, an optimal composition determination means for determining whether or not the optimal composition, and the position of the person region, if it is determined by the optimal composition determination means is not the optimal composition, And / or superimpose image setting means for selectively setting an image to be superimposed and displayed on the image display means based on size information, and a superimpose image set by the superimpose image setting means. A camera with an advice function, comprising: an image display control means for controlling the image display means so that an impose image is displayed together with the electronic image data.

(2) In the above-mentioned appendix 1, when the optimum composition judging means judges that the composition is not the optimum composition, or when it is judged that the composition is the optimum composition, a voice information output for notifying this is given. Parts.

[0055]

As described above, according to the present invention, it is possible to provide a camera with an advice function having a function of giving advice before taking a picture so as not to take a picture of a failed composition at the time of shooting.

[Brief description of drawings]

FIG. 1 is a perspective view of a camera with an advice function showing one embodiment of the present invention as seen from the rear side,

FIG. 2 is a block diagram showing an overall configuration of an electric circuit of a camera with an advice function, showing an embodiment of the present invention;

FIG. 3 is a block diagram showing the configuration of an electric circuit for explaining in detail the advice function of the camera with the advice function according to the embodiment of the present invention;

FIG. 4 is a photographed image diagram showing an example of “exemplary composition” when the photographer's intention is “person and landscape”;

FIG. 5 is a photographed image diagram showing an example of “exemplary composition” when the photographer's intention is “portrait”;

FIG. 6 is a diagram showing a method of detecting a contour image of a captured human image;

FIG. 7 is a diagram showing an example of a superimposed display by indicating a trimming range in a captured image,

FIG. 8 is a diagram showing an example of superimposed display by displaying a contour image of a person on an electronic viewfinder in a captured image.

[Explanation of symbols]

2 ... Electronic viewfinder 13 ... Optimal composition determination section (optimal composition determination means) 14 ... Superimposed image setting section (superimposed display means) 33 ... Trimming mask image 35 ... Human contour image 306 ... Input switch group

Claims (5)

[Claims] 1. An electronic viewfinder that displays a subject image as a moving image on a liquid crystal display device, and at least one of a position of a person area in a shooting screen and an occupation ratio of the person area in the screen, The optimum composition judging means for judging whether or not the photograph composition is optimum, and when the optimum composition judging means judges that it is not the optimum composition, the optimum composition is superimposed on the subject image in the electronic viewfinder. A camera with an advice function, comprising: superimpose display means for superimposing an advice image for 2. The camera with an advice function can further set a portrait shooting mode and another shooting mode. When the portrait mode is set, the optimum composition determination means is operated. The camera with an advice function according to claim 1, wherein the camera has an advice function. 3. The camera with an advice function according to claim 1, wherein the advice image is a trimming mask image or a contour image of a person. 4. A viewfinder for observing a subject image, and superimposing means for superimposing, on the viewfinder, advice information about an optimum human position in a photographing screen or an occupation ratio. A camera with an advising feature. 5. Whether the current composition is optimal by detecting at least one of the finder for observing the subject image, the position of the person area in the shooting screen, and the occupation ratio of the person area in the screen. When it is determined by the optimal composition determination means that determines whether or not the optimal composition is determined by the optimal composition determination means, the image is superimposed on the subject image in the viewfinder,
A camera with an advice function, comprising: superimpose display means for superimposing an advice image for optimal composition, and: