JP2007258953A - Automatic photography system and instrument - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To photo an object automatically with suitable layout without using a wireless tag. <P>SOLUTION: The automatic photography system comprising a means for inputting an image including an object photoed with a camera, a means for storing the image, a means for detecting the object included in the image, and a camera control means for controlling zoom operation and angle operation of the camera according to computed amount of zoom and amount of angle is further provided with a layout regulation means for detecting one or more similar objects from the image based on the representative features of object stored, and computing the amount of zoom and the amount of angle such that the entirety of a detected object is arranged suitably on the screen. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an automatic photographing system and an automatic photographing apparatus.

  Conventionally, in an amusement facility such as a theme park or an amusement park, an automatic photographing system for automatically taking a commemorative photo or a snapshot of a visitor has been proposed (for example, see Patent Document 1). In the automatic photographing system, for example, a radio tag such as RFID (Radio Frequency Identification) is used to automatically photograph a group as a subject at a suitable timing using a digital camera or the like.

In this case, the user as the subject has in advance a wireless tag that stores identification information unique to the user, for example, the name and address of the user, and uses the wireless communication at the shooting location to identify the subject. After confirming the position and the number of people, shooting is carried out.
JP 2005-099165 A

  However, the conventional automatic photographing system is expensive because a wireless tag and a transmission / reception device are required according to the number of subjects. In addition, it takes time and effort to record identification information on the wireless tag, and it is complicated to carry the wireless tag, and the wireless tag may be lost. Further, since the screen angle is not adjusted immediately before shooting, there is a possibility that the subject is not shot with a suitable layout, that is, an appropriate subject size and position on the photograph.

  The present invention solves the problems of the conventional automatic photographing system, detects similar subjects from the image based on the characteristics of typical subjects accumulated in advance, and the entire subject is preferably displayed on the screen. An object of the present invention is to provide an automatic photographing system and an automatic photographing device capable of automatically photographing a subject with a suitable layout without using a wireless tag by calculating an adjustment amount of a camera to be arranged. To do.

  Therefore, in the automatic photographing system of the present invention, an image input unit that inputs an image including a subject photographed by a camera, an image storage unit that accumulates the image, and a subject detection that detects a subject included in the image. Means and a camera control means for controlling the zoom operation and angle operation of the camera according to the calculated zoom amount and angle amount, and based on the characteristics of a representative subject that has been accumulated, It has layout adjusting means for detecting one or more similar subjects from the image and calculating the zoom amount and the angle amount so that the entire detected subject is suitably arranged on the screen.

  In another automatic photographing system of the present invention, the automatic photographing system further includes a transmission unit that transmits the image to a display device, and an information display device that includes a unit that receives and displays the transmitted image.

  In still another automatic photographing system of the present invention, the layout adjusting unit further includes the layout adjusting unit so that the entire subject is suitably arranged on the screen in accordance with the designated type of subject and the number of subjects. The zoom amount and the angle amount are calculated.

  In still another automatic photographing system according to the present invention, the layout adjusting unit may be configured to display an image based on characteristics of a subject photographed in advance by a user of the camera, instead of the accumulated representative subject. One or more similar subjects are detected from the inside.

  In still another automatic photographing system according to the present invention, the layout adjusting means may further include, in advance, a similar subject detected based on the accumulated characteristics of the representative subject by the user of the camera. A subject similar to the characteristics of the photographed subject is detected, and the zoom amount and the angle amount are calculated so that the entire detected subject is suitably arranged on the screen.

  In still another automatic photographing system of the present invention, the layout adjusting means further includes: 1 in the image based on the characteristics of the specific subject selected by the user of the camera from the subjects photographed in advance. The above similar subject is detected.

  In still another automatic photographing system of the present invention, the layout adjusting unit calculates the zoom amount by comparing the size of the entire image and the size of the entire subject.

  In still another automatic photographing system of the present invention, the layout adjusting unit calculates the angle amount from the top, bottom, left and right margins of the subject area.

  In still another automatic photographing system of the present invention, the layout adjusting means calculates the angle amount so that the position of the entire subject is centered, right justified, left justified, top justified, and bottom justified.

  In the automatic photographing apparatus of the present invention, automatic photographing including a camera disposed at a predetermined position, a camera adjustment device that adjusts a zoom operation and an angle operation of the camera, and a control device that controls the camera adjustment device. The control device detects a similar subject from images captured by the camera based on the registered subject characteristics, and the detected subject is preferably arranged on the screen. The zoom operation and the angle operation of the camera are adjusted.

  In another automatic photographing apparatus of the present invention, the registered subject is a subject photographed in advance by a user of the camera.

  In still another automatic photographing device of the present invention, the control device further includes an image photographed by the camera based on a feature of a subject preselected by a user of the camera from among registered subjects. A similar subject is detected from the inside.

  According to the present invention, the automatic photographing system and the automatic photographing device detect similar subjects from images based on the characteristics of representative subjects accumulated in advance, and the entire subject is suitably arranged on the screen. Such an adjustment amount of the camera is calculated. Therefore, a subject can be automatically photographed with a suitable layout without using a wireless tag.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram showing a configuration of an automatic photographing system according to the first embodiment of the present invention.

  As shown in the figure, the automatic photographing system according to the present embodiment is a kind of computer that includes an arithmetic means such as a CPU and MPU, a storage means such as a magnetic disk and a semiconductor memory, an input / output interface, and the like, and operates according to a program. Or an image acquisition unit 11 serving as an image input unit, a photographing recording unit 12 serving as an image storage unit, a processed image storage unit 13 and a representative object storage unit 18, an object region detection unit 14 serving as a subject detection unit, and a layout. It has a photographing determination unit 15 as an adjustment unit, a camera control unit 16 as a camera control unit, and a voice instruction unit 17. The automatic photographing system is used as a control device for an automatic photographing device (not shown).

  In addition to the automatic photographing system, the automatic photographing device includes a camera disposed at a predetermined position, a camera adjusting device for adjusting the camera, a sound output device such as a loudspeaker, and an operation device operated by an operator. Have Here, the camera includes an image pickup device such as a CCD (Charge Coupled Device) and a CMOS (Complementary Metal Oxide Semiconductor), an optical lens, a communication interface, and the like, which can be connected to the automatic photographing system and photographed. As long as an image can be output in the form of electronic data, it may be a digital still camera that shoots a still image, a digital video camera that shoots a movie, or any form It may be.

  Further, the camera adjustment device can tilt the camera in the horizontal direction and the vertical direction to move the shooting range of the camera left and right and up and down, that is, perform panning operation and tilting operation as an angle operation. It is something that can be done. Furthermore, the camera adjustment device can adjust the size of the shooting range by changing the shooting mode from close-up to telephoto by a focus variable mechanism such as a zoom lens, that is, a zoom operation can be performed. It is.

  Furthermore, the operating device includes an input device such as an input key and a pointer, a display device such as a CRT, a liquid crystal display, and an LED (Light Emitting Diode) display, and the operator operates to input operating conditions.

  Then, the automatic photographing device uses one or more persons, buildings such as buildings, monuments, objects such as objects, landscapes, etc. as subjects, for example, visitors in entertainment facilities such as theme parks, amusement parks, etc. It may be used to shoot children, children, students, guardians, etc. at events such as entrance ceremony, kindergarten, school, etc., sports events, excursions, etc. It may be used for photographing vacationers or the like in sightseeing spots, scenic spots, etc., or may be used for photographing any subject at any place at any opportunity.

  Here, the image acquisition unit 11 functions as an image input unit, and acquires an image of a subject such as a person or a landscape photographed by the camera from the camera. The photographing recording unit 12 functions as an image storage unit, and stores the image acquired by the image acquisition unit 11 in a memory. Further, the processed image storage unit 13 temporarily stores a subject layout adjustment image, and the representative object storage unit 18 stores a representative image or feature (template) of an object as a detected subject as a representative object. The object area detecting unit 14 detects the position of the object from the image using the representative object. Further, the photographing determination unit 15 functions as a layout adjustment unit, and determines the appropriateness of the layout based on the arrangement of the objects in the image. The camera control unit 16 functions as camera control means, calculates the zoom amount and angle amount (panning amount and tilting amount) of the camera, controls the operation of the camera adjustment device, and controls the shooting range of the camera. Adjust the size and position. In addition, the voice instruction unit 17 notifies the adjustment status of the shooting range and position of the camera by voice output from the voice output device.

  Next, the operation of the automatic photographing apparatus having the above configuration will be described. Here, an operation when a group photo is taken, that is, when a plurality of persons are taken as subjects, will be described.

  FIG. 2 is a diagram showing a detection process of an object area in the first embodiment of the present invention, FIG. 3 is a diagram showing an operation of zoom adjustment in the first embodiment of the present invention, and FIG. FIG. 5 is a flowchart showing the operation of the automatic photographing apparatus according to the first embodiment of the present invention.

  First, the camera takes an image. At this time, the camera is in a preview state. Then, an image is input and is temporarily captured in the processed image storage unit 13 as an image for layout adjustment.

  Subsequently, the object region detection unit 14 detects the position of the object using a representative object stored in advance in the representative object storage unit 18, for example, a face template as shown in FIG. For example, template matching is performed on the entire image, and the start point Psn (x, y) and the end point Pen (x, y) of the circumscribed rectangle (c) shape as shown in FIG. ) Is recorded (n = 1... N).

  Then, a rectangle surrounding all the detected objects, that is, the coordinates of the object region as shown in FIG. In the case of the example shown in FIG. 2, for example, it can be obtained by the following equations (1) and (2).

Upper left Ps (x, y) of object area = Ps1 (x, y) (1)
Lower right Pe (x, y) of object area = Pe3 (x, y) (2)
Next, the shooting determination unit 15 determines the suitability of the object layout based on the screen and the position and size of the object area. For example, the determination can be made under the condition of the following expression (3) using the ratio between the image size (W, H) and the object area size (OW, OH). However, (OW, OH) = Pe (x, y) −Ps (x, y).

Conditional expression = ({RMin <(OW / W) <RMax} | {RMin <(OH / H)
<RMax}) & | {Ps (x, y) + Pe (x, y)} / 2
− (W / 2, H / 2) | <PMax (Equation 3)
Here, Rmin and RMax are the lower limit and the upper limit of the ratio between the screen and the object, and PMax is the upper limit of the distance between the center of the screen and the center position of the object. Note that the values of Rmin, RMax, and PMax are set in advance.

  When the condition of the expression (3) is satisfied, that is, the shooting determination unit 15 determines the appropriateness of the object layout based on the screen and the position and size of the object area, and “appropriate layout” If it is determined, the layout adjustment image temporarily captured in the processed image storage unit 13 is stored in the memory, that is, the photographing recording unit 12 as a photograph. Note that the voice instruction unit 17 may give an instruction by voice, and a new photograph of the subject may be saved as a photograph.

  On the other hand, when the condition of the expression (3) is not satisfied, that is, the photographing determination unit 15 determines the appropriateness of the object layout on the basis of the screen and the position and size of the object area. When it is determined as “layout”, the camera control unit 16 determines the zoom amount Rz of the camera. The zoom amount Rz can be obtained from the image size (W, H) and the object area size (OW, OH) by the following equation (4), for example.

Rz = min (A * W / OW, B * H / OH) -1 Formula (4)
However, A is the ratio of the ideal object width to the image width, and B is the ratio of the ideal object height to the image height. Rz> 0 means zooming in, and Rz <0 means zooming out.

  As a result, as shown in FIG. 3A, when the image before adjustment is large, the zoom amount Rz becomes negative and the zoom-out is performed. As shown in FIG. A large image can be obtained. Further, as shown in FIG. 3B, when the image before adjustment is small, the zoom amount Rz becomes positive and zoom-in is performed, and as shown in FIG. 3C, an appropriate size is obtained. Images can be obtained.

  Next, the camera control unit 16 determines the amount of movement of the camera angle, that is, the angle amount (dx, dy). For example, the angle amounts (dx, dy) of the camera can be determined from the margin amount of the screen as shown in FIG. 4A by the following formulas (5) to (8).

Horizontal movement amount dx = + DX Expression (5) (when ML> MR)
Horizontal movement amount dx = −DX Expression (6) (when ML <MR)
Vertical movement amount dy = + DY (7) (when MA <MB)
Vertical movement amount dy = −DY (8) (when MA> MB)
Here, ML and MR are left and right margin amounts, MA and MB are upper and lower margin amounts, and DX and DY are appropriate movement amounts.

  As a result, as shown in FIG. 4A, when the position of the object region is shifted from the center of the screen, it is moved by the horizontal movement amount dx and the vertical movement amount dy, as shown in FIG. As described above, an image with an appropriate position of the object region can be obtained.

  Subsequently, the camera control unit 16 controls the operation of the camera adjustment device according to the zoom amount Rz and the angle amount (dx, dy) determined as described above, and performs panning operation and tilting as zoom operation and angle operation. Operate and adjust the camera position. Then, after the position of the camera is adjusted, the image is input again, and is temporarily taken into the processed image storage unit 13 as an image for layout adjustment, and the subsequent operations are repeated. At this time, the voice instruction unit 17 may announce “Adjusting” by voice.

Next, a flowchart will be described.
Step S1: An image is input.
Step S2: The position of the object is detected.
Step S3: Determine the coordinates of the object area.
Step S4: The suitability of the object layout is determined based on the screen and the position and size of the object area. If the object layout is appropriate, the process proceeds to step S8. If the object layout is not appropriate, the process proceeds to step S5.
Step S5: The zoom amount Rz is determined.
Step S6: Determine the amount of movement of the angle.
Step S7: Adjust the camera position.
Step S8: The picture is stored in the memory.

  Thus, in the present embodiment, when taking a group photo, a plurality of subjects can be automatically taken with an appropriate layout. For this reason, a subject who has joined the shooting from the middle, such as a person in charge of the camera, does not protrude from the photograph.

  Next, a second embodiment of the present invention will be described. In addition, about what has the same structure as 1st Embodiment, the description is abbreviate | omitted by providing the same code | symbol. The description of the same operation and the same effect as those of the first embodiment is also omitted.

  FIG. 6 is a diagram showing a configuration of an automatic photographing system according to the second embodiment of the present invention.

  As shown in the figure, the automatic photographing system according to the present embodiment designates the type and number of objects that are objects of the object area, and the ratio and position of the object area that are parameters for adjusting the layout. The image capturing condition input unit 21 and the image capturing condition storage unit 22 that records the image capturing conditions designated by the image capturing condition input unit 21 are further included. The shooting condition input unit 21 and the shooting condition storage unit 22 are added in front of the object area detection unit 14. Here, the ratio of the object area is the ratio of the object area to the screen, and the position of the object area is centering, right alignment, left alignment, top alignment, bottom alignment, and the like. Since other points are the same as those in the first embodiment, description thereof is omitted.

  Next, the operation of the automatic photographing apparatus in this embodiment will be described.

  FIG. 7 is a diagram showing the camera adjustment operation according to the shooting conditions in the second embodiment of the present invention, FIG. 8 is a diagram showing a representative object database in the second embodiment of the present invention, and FIG. It is a flowchart which shows operation | movement of the automatic imaging device in the 2nd Embodiment of invention.

  First, the photographing condition input unit 21 displays a photographing condition input screen as shown in FIG. 7A on the display device of the operation device, and a user or the like operates the operation device to input photographing conditions. . Then, the shooting condition input unit 21 sets the type and number of objects to be the object area, and the ratio and position of the object area, which are parameters for adjusting the layout. Here, it is assumed that the ratio of the object area is set to 80 [%] and the position is set to centering.

  Subsequently, the camera takes an image. At this time, the camera is in a preview state. Then, an image is input and is temporarily captured in the processed image storage unit 13 as an image for layout adjustment.

  Subsequently, the object area detecting unit 14 uses a facial template from representative objects stored in the representative object storing unit 18 in advance, for example, a template stored in a representative object database as shown in FIG. Detect the position of the object. For example, template matching is performed on the entire image, and the position where the matching rate is high, that is, the start point Psn (x, y) and the end point Pen (x, y) of the circumscribed rectangle as shown in FIG. (N = 1... N).

  Next, the rectangle surrounding the number of objects designated by the input of the photographing condition, that is, the coordinates of the object area is obtained from the detected object. In this case, as a method for selecting an object, for example, the following equation (9) is used to preferentially select an object whose center is close to the center of the screen, that is, an object having a small value of equation (9). There is a way.

nth object = | {Psn (x, y) + Pen (x, y)} / 2
− (W / 2, H / 2) | Equation (9)
The selection can also be made based on the set position of the object area. For example, when the object area is left-justified, the object on the left side of the screen can be preferentially selected.

  As a result, as shown in FIG. 7B, even if an object such as a pedestrian who passes by chance is included in the image, objects other than the number specified by the input of the shooting conditions are objects of the object area. It will be handled as a non-target object. Then, the position of the camera is adjusted with respect to the set object area.

  Subsequently, the shooting determination unit 15 determines the appropriateness of the layout based on the ratio (r) of the object area designated by the input of shooting conditions. For example, in the equation (3), it is possible to set conditions such as RMin = r−α and RMax = r + α, and determine the appropriateness of the layout. Here, α is an allowable rate.

  Further, the third term of the expression (3) may be modified and applied as follows based on the position designated by the input of the photographing condition.

(Ps (x) <PMax) ... When left-justified (W-Pe (x) <PMax) ... When right-justified (Ps (y) <PMax) ... When justified (H-Pe ( y) <PMax)... In the case of lowering, the determination method is the same as in the first embodiment, and when the condition of the expression (3) is satisfied, “appropriate layout” If the condition of the expression (3) is not satisfied, it is determined as “inappropriate layout”.

  If the layout is determined to be “appropriate”, the layout adjustment image temporarily stored in the processed image storage unit 13 is stored as a photograph in the memory, that is, the photographing recording unit 12. Note that the voice instruction unit 17 may give an instruction by voice, and a new photograph of the subject may be saved as a photograph.

  On the other hand, when it is determined that the layout is “inappropriate”, the camera control unit 16 determines the zoom amount Rz of the camera based on the ratio (r) of the object area designated by the input of the shooting condition. For example, the zoom amount Rz can be determined by setting A = B = r according to the equation (4).

  Subsequently, the camera control unit 16 determines the movement amount of the camera angle, that is, the angle amount (dx, dy), based on the position designated by the input of the shooting condition. For example, the camera angle amount (dx, dy) can be determined from the screen margin amount by the following equations (10) to (13).

Horizontal movement amount dx = + DX Expression (10) (when ML + α> MR + β)
Horizontal movement amount dx = −DX Expression (11) (in the case of ML + α <MR + β)
Vertical movement amount dy = + DY (12) (in the case of MA + γ <MB + ζ)
Vertical movement amount dy = −DY (13) (in the case of MA + γ> MB + ζ)
Here, α, β, γ, and ζ are values determined by the position designated by the input of the imaging condition. For example, α = β = γ = ζ = 0 is set for centering, and α = 10 and β = γ = ζ = 0 are set for left alignment. As a result, as shown in FIG. 7C, an image with an appropriate position of the object region can be obtained.

  Subsequently, the camera control unit 16 controls the operation of the camera adjustment device according to the zoom amount Rz and the angle amount (dx, dy) determined as described above, and performs panning operation and tilting as zoom operation and angle operation. Operate and adjust the camera position. Then, after the position of the camera is adjusted, the image is input again, and is temporarily taken into the processed image storage unit 13 as an image for layout adjustment, and the subsequent operations are repeated. At this time, the voice instruction unit 17 may announce “Adjusting” by voice.

Next, a flowchart will be described.
Step S11: An imaging condition is input.
Step S12: An image is input.
Step S13: The position of the object is detected.
Step S14: Determine the coordinates of the object area.
Step S15: The suitability of the object layout is determined based on the screen and the position and size of the object area. If the object layout is appropriate, the process proceeds to step S19. If the object layout is not appropriate, the process proceeds to step S16.
Step S16 The zoom amount Rz is determined.
Step S17: Determine the amount of movement of the angle.
Step S18: The camera position is adjusted.
Step S19: The picture is stored in the memory.

  As described above, in the present embodiment, the type of object and the number of objects are designated, so that a pedestrian who has accidentally passed is prevented from entering the photograph, and the designated number of subjects are arranged with an appropriate layout. You can shoot. Furthermore, since the ratio and position of the object area are designated, automatic shooting can be performed with a layout that suits the user's preference.

  Next, a third embodiment of the present invention will be described. In addition, about the thing which has the same structure as 1st and 2nd embodiment, the description is abbreviate | omitted by providing the same code | symbol. Also, the description of the same operations and effects as those of the first and second embodiments is omitted.

  FIG. 10 is a diagram showing a configuration of an automatic photographing system according to the third embodiment of the present invention.

  As shown in the figure, the automatic image capturing system according to the present embodiment extracts object features (such as image and face part positions and object texture) from objects such as a person's face and a sign taken by a user. An extraction unit 31, an object feature storage unit 32 that records the features of the object extracted by the object feature extraction unit 31, an object selection unit 33 that selects a subject from the object feature storage unit 32, and the object selection unit A selection object recording unit 34 for recording the subject selected by the computer 33 is further provided. The object feature extracting unit 31, the object feature accumulating unit 32, the object selecting unit 33, and the selected object recording unit 34 are added to the preceding stage of the object area detecting unit 14. Since other points are the same as those in the first embodiment, description thereof is omitted.

  Next, the operation of the automatic photographing apparatus in this embodiment will be described. First, the operation of an object registration process for registering the characteristics of an object to be included in a photograph will be described.

  FIG. 11 is a flowchart showing the operation of the object registration process in the third embodiment of the present invention.

  First, the camera captures an object to be photographed, such as a human face, a signboard, etc., and inputs an image.

  Next, the object feature extraction unit 31 extracts features of the photographed object. Here, as features to be extracted, for example, contour information obtained by applying a Sobel filter (for example, see Non-Patent Document 1) to an image, and in particular, in the case of a face image, a personal identification template (for example, Patent Document 2). Of course, it is also possible to treat the image itself obtained by photographing with a camera as a feature.

[Non-patent document 1] “Image recognition theory” Makoto Nagao, Corona Inc. [Non-patent document 2] “Robust recognition system“ Smartface ”robust to changes in facial orientation and facial expression” Osamu Yamaguchi et al. (1) IEICE paper Magazine, D-II, vol. J84-D-II, no. 6, pp. 1045-1052, 2001
Then, the feature of the object extracted by the object feature extraction unit 31 is stored in the database, that is, the object feature storage unit 32.

Next, a flowchart will be described.
Step S21: An image is input.
Step S22: Extract features of the object.
Step S23: The extracted object features are stored, and the process is terminated.

  Next, the layout adjustment process will be described.

  FIG. 12 is a diagram showing a specific object detection and photographing result in the third embodiment of the present invention, and FIG. 13 is a flowchart showing an operation of layout adjustment processing in the third embodiment of the present invention.

  First, the object selection unit 33 displays a detection object selection screen as shown in FIG. 12A on the display device of the operation device. Then, the user or the like operates the operation device to select several objects to be included in the photograph from the registered object list registered in the object feature storage unit 32. When the determination button is pressed, a face as shown in FIG. 12B is determined as a detection object.

  Subsequently, the camera takes an image. At this time, the camera is in a preview state. Then, an image is input and is temporarily captured in the processed image storage unit 13 as an image for layout adjustment.

  Subsequently, the object area detection unit 14 selects a face template from the representative objects stored in the representative object storage unit 18 in advance, for example, the templates stored in the representative object database as shown in FIG. To detect the position of the object. For example, template matching is performed on the entire image, and the position where the matching rate is high, that is, the start point Psn (x, y) and the end point Pen (x, y) of the circumscribed rectangle as shown in FIG. (N = 1... N).

  Then, as shown in FIG. 12C, a region having a high similarity to the determined object as shown in FIG. 12B is detected from the detected objects by template matching. Authenticate.

  Subsequently, the rectangle surrounding all the authenticated objects, that is, the coordinates of the object area as shown in FIG.

  Next, the shooting determination unit 15 determines the suitability of the object layout based on the screen and the position and size of the object area. For example, the determination can be made using the ratio of the image size and the object area size under the condition as in the above equation (3).

  When the condition of the expression (3) is satisfied, that is, the shooting determination unit 15 determines the appropriateness of the object layout based on the screen and the position and size of the object area, and “appropriate layout” If it is determined, the layout adjustment image temporarily captured in the processed image storage unit 13 is stored in the memory, that is, the photographing recording unit 12 as a photograph. Note that the voice instruction unit 17 may give an instruction by voice, and a new photograph of the subject may be saved as a photograph.

  On the other hand, when the condition of the expression (3) is not satisfied, that is, the photographing determination unit 15 determines the appropriateness of the object layout on the basis of the screen and the position and size of the object area. When it is determined as “layout”, the camera control unit 16 determines the zoom amount Rz of the camera.

  Next, the camera control unit 16 determines the amount of movement of the camera angle, that is, the angle amount (dx, dy). Thereby, as shown in FIG. 12D, an image with an appropriate position of the object region can be obtained.

  Subsequently, the camera control unit 16 controls the operation of the camera adjustment device according to the zoom amount Rz and the angle amount (dx, dy) determined as described above, and performs panning operation and tilting as zoom operation and angle operation. Operate and adjust the camera position. Then, after the position of the camera is adjusted, the image is input again, and is temporarily taken into the processed image storage unit 13 as an image for layout adjustment, and the subsequent operations are repeated. At this time, the voice instruction unit 17 may announce “Adjusting” by voice.

Next, a flowchart will be described.
Step S31: Select an object.
Step S32: An image is input.
Step S33 Object authentication is performed.
Step S34: The position of the object is detected.
Step S35: Determine the coordinates of the object area.
Step S36: The suitability of the object layout is determined based on the screen and the position and size of the object area. If the object layout is appropriate, the process proceeds to step S40. If the object layout is not appropriate, the process proceeds to step S37.
Step S37 The zoom amount Rz is determined.
Step S38: Determine the amount of movement of the angle.
Step S39: The camera position is adjusted.
Step S40: Save in the memory as a photograph.

  As described above, in the present embodiment, it is possible to register and specify an object to be included in a photograph in advance. Therefore, in the second embodiment, since the subject is specified by the number of people, the person or object to be photographed may not be selected, but in this embodiment, the person or object that the user wants to photograph is regarded as the subject. It can be surely put in the photograph.

  Next, a fourth embodiment of the present invention will be described. In addition, about the thing which has the same structure as the 1st-3rd embodiment, the description is abbreviate | omitted by providing the same code | symbol. Explanation of the same operations and effects as those of the first to third embodiments is also omitted.

  FIG. 14 is a diagram showing a configuration of an automatic photographing system according to the fourth embodiment of the present invention.

  As shown in the figure, the automatic photographing system according to the present embodiment further includes a transmission unit 41 as a transmission unit for transmitting the acquired image to the display device 50 via the network 42. The transmission unit 41 is added to the subsequent stage of the image acquisition unit 11. The network 42 is, for example, a telephone network or the Internet, but is a wireless or wired public communication network, a dedicated communication network, an intranet, a LAN (Local Area Network), a WAN (Wide Area Network), public communication. Any communication line network such as a VPN (Virtual Private Network) using a line network or a satellite communication line network may be used, or a combination of these may be used as appropriate.

  The display device 50 is, for example, an information display device such as a personal computer, a mobile phone, a PDA (Personal Digital Assistant), a display-only terminal, etc., which can communicate via the network 42, and Any type of device may be used as long as it can display an image. The display device 50 includes a receiving unit 51 for receiving an image and an image display unit 52 as a display device for displaying the received image, including a CRT, a liquid crystal display, an LED display, and the like. Since other points are the same as those in the first embodiment, description thereof will be omitted.

  Next, operations of the automatic photographing apparatus and the display apparatus 50 in the present embodiment will be described.

  FIG. 15 is a flowchart showing operations of the automatic photographing apparatus and the display apparatus according to the fourth embodiment of the present invention.

  First, the operation of the automatic photographing apparatus will be described. In this case, first, the camera takes an image. At this time, the camera is in a preview state. Then, an image is input and is temporarily captured in the processed image storage unit 13 as an image for layout adjustment.

  Subsequently, the transmission unit 41 transmits the image acquired from the image acquisition unit 11 to the reception unit 51 of the display device 50.

  Subsequently, the automatic photographing apparatus performs a layout adjustment process. Since the layout adjustment process is the same as the operations in steps S2 to S8 described in the first embodiment, the description thereof is omitted.

  Next, the operation of the display device 50 will be described. In this case, first, the receiving unit 51 receives the image transmitted by the transmitting unit 41. And the image display part 52 displays the image which the receiving part 51 received.

Next, a flowchart will be described.
Step S41: An image is input.
Step S42 The transmission unit 41 transmits the image to the reception unit 51 of the display device 50.
Step S43: Layout adjustment processing is performed.
Step S44 The receiving unit 51 receives the image transmitted by the transmitting unit 41.
Step S45 The image display unit 52 displays the image received by the receiving unit 51.

  As described above, in the present embodiment, the image being subjected to the layout adjustment process is displayed on the image display unit 52 of the display device 50, so that the user can view the image before photographing by viewing the image display unit 52. The state of the layout can be confirmed.

  In the first to fourth embodiments, the zoom amount and the angle amount are determined based on the position and size of the screen and the object area, and the zoom operation and the angle operation are performed to adjust the camera position. However, by installing the camera in an appropriate state to some extent, the same effect can be obtained even if the zoom operation or the angle operation is omitted.

  In addition, the present invention can obtain the same effect by using not only a digital still camera that captures still images but also a digital video camera that captures moving images.

  Furthermore, the present invention is not limited to the above-described embodiment, and various modifications can be made based on the spirit of the present invention, and they are not excluded from the scope of the present invention.

It is a figure which shows the structure of the automatic imaging | photography system in the 1st Embodiment of this invention. It is a figure which shows the detection process of the object area | region in the 1st Embodiment of this invention. It is a figure which shows the operation | movement of zoom adjustment in the 1st Embodiment of this invention. It is a figure which shows the operation | movement of angle adjustment in the 1st Embodiment of this invention. It is a flowchart which shows operation | movement of the automatic imaging device in the 1st Embodiment of this invention. It is a figure which shows the structure of the automatic imaging | photography system in the 2nd Embodiment of this invention. It is a figure which shows the operation | movement of the camera adjustment according to the imaging conditions in the 2nd Embodiment of this invention. It is a figure which shows the representative object database in the 2nd Embodiment of this invention. It is a flowchart which shows operation | movement of the automatic imaging device in the 2nd Embodiment of this invention. It is a figure which shows the structure of the automatic imaging | photography system in the 3rd Embodiment of this invention. It is a flowchart which shows the operation | movement of the object registration process in the 3rd Embodiment of this invention. It is a figure which shows the specific object detection and imaging | photography result in the 3rd Embodiment of this invention. It is a flowchart which shows the operation | movement of the layout adjustment process in the 3rd Embodiment of this invention. It is a figure which shows the structure of the automatic imaging | photography system in the 4th Embodiment of this invention. It is a flowchart which shows operation | movement of the automatic imaging device and display apparatus in the 4th Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 Image acquisition part 12 Shooting | recording recording part 13 Processed image storage part 14 Object area | region detection part 15 Shooting determination part 16 Camera control part 18 Representative object storage part 41 Transmission part 50 Display apparatus 52 Image display part

Claims (12)

(A) an image input means for inputting an image including a subject photographed by a camera;
(B) image storage means for storing the image;
(C) subject detection means for detecting a subject included in the image;
(D) an automatic photographing system having camera control means for controlling the zoom operation and the angle operation of the camera according to the calculated zoom amount and angle amount,
(E) One or more similar subjects are detected from the image based on the characteristics of the representative subject that has been stored, and the zoom amount and the detected amount of the subject are suitably arranged on the screen. An automatic photographing system comprising layout adjusting means for calculating an angle amount. (A) transmitting means for transmitting the image to a display device;
The automatic photographing system according to claim 1, further comprising: (b) an information display device provided with means for receiving and displaying the transmitted image. The layout adjustment unit calculates the zoom amount and the angle amount so that the entire subject is preferably arranged on the screen in accordance with the type of the designated subject and the number of subjects. The automatic shooting system described. 2. The layout adjusting unit detects one or more similar subjects from an image based on characteristics of a subject previously captured by a user of the camera instead of a representative subject that has been accumulated. Or the automatic imaging | photography system of 2. The layout adjusting means detects a subject similar to the feature of the subject photographed in advance by the user of the camera from among similar subjects detected based on the characteristics of the representative subject that has been accumulated, The automatic photographing system according to claim 1, wherein the zoom amount and the angle amount are calculated so that the entire detected subject is suitably arranged on the screen. 6. The layout adjustment unit according to claim 4 or 5, wherein one or more similar subjects are detected from an image based on characteristics of a specific subject selected by a user of the camera from subjects photographed in advance. The automatic shooting system described. 6. The automatic photographing system according to claim 1, wherein the layout adjustment unit calculates the zoom amount by comparing the size of the entire image and the size of the entire subject. 6. The automatic photographing system according to claim 1, wherein the layout adjustment unit calculates the angle amount from left, right, up, left, and right margins of a subject area. 6. The automatic photographing system according to claim 1, wherein the layout adjusting unit calculates the angle amount so that the position of the entire subject is centered, right-justified, left-justified, top-justified, and bottom-justified. (A) a camera disposed at a predetermined position;
(B) a camera adjustment device for adjusting the zoom operation and the angle operation of the camera;
(C) an automatic photographing device having a control device for controlling the camera adjustment device,
(D) The control device detects a similar subject from images captured by the camera based on the registered subject characteristics, and the detected subject is preferably arranged on the screen. An automatic photographing apparatus characterized by adjusting a zoom operation and an angle operation of a camera. The automatic photographing apparatus according to claim 10, wherein the registered subject is a subject photographed in advance by a user of the camera. The said control apparatus detects a similar to-be-photographed object from the image image | photographed with the said camera based on the characteristic of the to-be-photographed object previously selected by the user of the camera from the registered to-be-photographed objects. Automatic photographing device.

Images