JP2011234216A - Consecutively shot image processing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a consecutively shot image processing system that can facilitate confirmation of an intended image from consecutively shot images without necessity of an operation by an operator themselves to select the intended image.SOLUTION: Detection condition setting means 33 sets a condition for detecting an intended image. Detection means 34 detects an image that satisfies a detection condition set in advance out of consecutively shot images. Specific information adding means 35 adds specific information to the image detected by the detection means 34. Confirming the intended image out of the consecutive shooting image is facilitated by using the specific information.

Description

  The present invention relates to a continuous image processing apparatus that processes continuous images.

  Conventionally, some imaging devices such as a digital still camera have a continuous shooting function for continuously shooting a plurality of images. After shooting, from a large number of continuous images on a monitor of the imaging device. It takes time and effort to find and confirm the desired image.

  Therefore, there is a technique for making it easy to check images even when there are a large number of images.

  For example, when an operator selects a desired image from a large number of continuous shot images, a predetermined range of continuous shot images centered on the selected image is displayed on the same screen of the monitor, and the continuous shot images are displayed. The movement of the moving body can be confirmed (for example, refer to Patent Document 1).

  In addition, by selecting a desired image from a plurality of images displayed on the same screen of the monitor and inserting a bookmark image that displays information such as the shooting date and time at the position of the selected image, Only the bookmark image is displayed as an index, or the image after the bookmark image is displayed by selecting the bookmark image, thereby making it easy to check the image (see, for example, Patent Document 2).

  In addition, although it is a video camera, an index is inserted by the operator's operation during movie shooting, so that the image that is the frame at the index position is displayed in a thumbnail, or the images before and after the image at the desired index are the same. It can be displayed on the screen (see, for example, Patent Document 3).

JP-A-10-277193 (page 4, FIG. 3) JP 2007-124071 (pages 12-17, FIGS. 13-21) JP 2003-33348 A (page 4-5, FIG. 2-5)

  As described above, there is a technique that makes it easy to check an image when there is a large amount of images. However, it is necessary for the operator to search and select a desired image from among a large number of images. Therefore, there is a problem that takes time and effort.

  In addition, when inserting an index during movie shooting, the operator must insert the index by himself / herself. Insertion may not be possible.

  The present invention has been made in view of the above points, and provides a continuous image processing apparatus that does not require an operator to select and can easily confirm a desired image from continuous images. Objective.

  The continuous shot image processing apparatus according to claim 1, wherein a detection condition setting means for setting a detection condition for detecting a desired image and an image satisfying the detection condition are detected from continuously shot images. And a specific information providing means for adding specific information to the image detected by the detecting means.

  The continuous-shot image processing device according to claim 2 is the continuous-shot image processing device according to claim 1, wherein the detection condition setting unit sets a plurality of detection conditions and sets a priority order among the plurality of detection conditions. The detection unit is configured to detect an image satisfying a detection condition having a high priority when there are a plurality of images satisfying the detection condition from continuously shot images taken continuously.

  The continuous-shot image processing device according to claim 3 is the continuous-shot image processing device according to claim 1 or 2, further comprising shooting scene specifying means for specifying a shooting scene, wherein the detection condition setting means is provided for each shooting scene. The detection means detects an image satisfying the detection condition set for each of the shooting scenes from continuously shot images continuously shot.

  The continuous-shot image processing device according to claim 4 is the continuous-shot image processing device according to claim 3, wherein the shooting scene specifying unit is configured to at least change the shape of a subject from a continuously shot image, and The shooting scene is specified in accordance with the shooting scene specifying conditions for the movement of the subject, the recognition of the face, and the detection of the moving subject.

  According to a fifth aspect of the present invention, in the continuous image processing apparatus according to the third aspect, the photographing scene specifying means can select and operate from a plurality of preset photographing scenes. .

  The continuous image processing device according to claim 6 is the continuous image processing device according to any one of claims 1 to 5, wherein an image to which specific information is added is selected from the plurality of continuous image groups on the same screen. The display control means to display is provided.

  According to the continuous image processing apparatus of claim 1, by setting in advance detection conditions for detecting a desired image, an image satisfying the detection condition is selected from continuously captured images. Automatic detection and specific information can be automatically assigned to the detected image, eliminating the need for the operator to select and using the specific information to confirm the desired image from the continuous shots It can be done easily.

  According to the continuous shot image processing apparatus of claim 2, in addition to the effect of the continuous shot image processing apparatus of claim 1, a plurality of images satisfying the detection condition are continuously selected from continuously shot images. When an image exists, an image satisfying a detection condition having a high priority is detected, so that a desired image can be easily detected.

  According to the continuous image processing apparatus of claim 3, in addition to the effect of the continuous image processing apparatus of claim 1 or 2, a setting is made for each shooting scene from continuously shot images that are continuously shot. Since an image satisfying the detection condition that is set is detected, a desired image can be easily detected.

  According to the continuous image processing apparatus according to claim 4, in addition to the effect of the continuous image processing apparatus according to claim 3, at least a change in the shape of the subject from the continuously captured images that are taken continuously, The shooting scene can be automatically specified according to the shooting scene specifying conditions for the movement of the subject, the recognition of the face, and the detection of the moving subject.

  According to the continuous image processing apparatus described in claim 5, in addition to the effect of the continuous image processing apparatus described in claim 3, a desired shooting scene is selected from a plurality of preset shooting scenes. Can be set.

  According to the continuous image processing apparatus of claim 6, in addition to the effect of the continuous image processing apparatus of any one of claims 1 to 5, specific information is given from a plurality of continuous image groups. Since the displayed images are displayed on the same screen, a desired image can be easily confirmed from a plurality of continuous shot image groups.

[BRIEF DESCRIPTION OF THE DRAWINGS] It is a block diagram of the continuous-shot image processing apparatus which shows one embodiment of this invention. It is a block diagram of the imaging device provided with the continuous shooting image processing apparatus same as the above. It is a table | surface which shows the relationship between the imaging | photography scene specific conditions and imaging | photography scene of a continuous shooting image processing apparatus same as the above. It is a flowchart which specifies the imaging | photography scene of a continuous-shot image processing apparatus same as the above. It is explanatory drawing explaining the continuous shooting image which assign | provides specific information for every imaging | photography scene with a continuous shooting image processing apparatus same as the above, (a) is explanatory drawing in the case of the shooting scene of a firework, (b) is a photography shooting scene of sports. (C) is an explanatory diagram in the case of an event shooting scene, and (d) is an explanatory diagram in the case of a moving object shooting scene.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  As shown in FIG. 2, a camera 11 as a photographing device is a digital still camera having a continuous photographing function, and records photographed image data on a recording medium 12 such as a memory card as digital data.

  The camera 11 includes a lens 14, a strobe 15, a microphone 16, an imaging device 17 such as a CCD, a double correlation sampling circuit (CDS) 18, an analog / digital converter (A / D) 19, a first image memory 20, and image data. A processing unit 21, a second image memory 22, a compression / decompression circuit 23, a display device 24 such as a liquid crystal panel (LCD), an operation unit 25 including a release switch and other switches, a timing generator (TG) 26, a memory controller 27 A control unit 28 for controlling the camera 11, a power supply circuit (not shown), and the like.

  The control unit 28 includes a CPU, a working RAM, a ROM that records preset values or programs, and the like. This control unit 28 has an automatic exposure control function that automatically controls exposure, an automatic focus control function that automatically controls focus, an automatic white balance control function that automatically controls white balance, a face recognition function that recognizes the face of a subject, and a continuous A continuous shooting function for shooting images, a function of a continuous shot image processing device for making it easy to check continuous shot images, a moving image shooting function for shooting moving images, and the like. In face recognition, a part that has features in the shape of eyes, nose, mouth, etc. is searched from the image, and if the similarity is high, it is regarded as a face, and statistics that detect image features such as skin color and eye shape. A known face detection technique such as a technique using a physical analysis can be used.

  In the camera 11, the field light captured through the lens 14 is converted into an electrical signal by the imaging device 17. The conversion timing of the electric signal is controlled by the control unit 28 through the timing generator 26. The electrical signal output from the imaging device 17 is subjected to signal processing by the double correlation sampling circuit 18 and then converted to digital data by the analog-digital converter 19. This digital data is temporarily recorded in the first image memory 20 as image data. The image data temporarily recorded in the first image memory 20 is subjected to predetermined image processing by the image data processing unit 21. The image data subjected to this image processing is displayed on the display device 24 and recorded in the second image memory 22.

  Here, the control unit 28 uses the image data recorded in the first image memory 20 to perform automatic exposure control and automatic focus control. That is, the control unit 28 determines the appropriate exposure amount and lens driving amount calculated based on the shooting situation (scene) determined from the image data recorded in the first image memory 20 and the position (distance) of the subject. Depending on the on / off state of the strobe 15, the timing and amount of irradiation of the strobe light, appropriate automatic exposure control and automatic focus control according to the subject are performed. Then, the control unit 28 controls the timing control of the timing generator 26 based on the obtained exposure amount, etc., controls the driving of the lens 14 according to the obtained lens driving amount, and turns on / off the obtained strobe 15 The strobe 15 is controlled based on the timing and amount of strobe light irradiation.

  When the operator presses the release switch, which is the shutter button of the operation unit 25, halfway down, the camera is ready to shoot, determines the exposure and focus, and when the user presses the release switch fully, The shooting state is entered, and the strobe 15 irradiates the subject with the strobe light at the timing and irradiation amount set by the control unit 28 as necessary to compensate for the lack of light in the object field. The exposure is performed for a predetermined exposure time controlled to output an electrical signal based on the accumulated charge, and the white balance processing, edge enhancement processing, color correction processing, and the like are performed by the image data processing unit 21 via the first image memory 20. Image data that has been subjected to processing such as γ correction processing is recorded on the recording medium 12 via the second image memory 22.

  The image data recorded in the recording medium 12 can be displayed on the display device 24 by the operation of the operation unit 25 by the operator.

  In addition, by selecting the continuous shooting function, for example, the camera 11 continuously shoots at a predetermined interval while the release switch is being pressed. The basic processing up to recording continuously shot images to the recording medium 12 is the same as when shooting a single image, but it is easy to check the continuously shot images by the function of the continuous image processing device. Processing is performed.

  Next, FIG. 1 shows a block diagram of the continuous image processing apparatus.

  The continuous image processing device 31 has the following functions.

  A function of the shooting scene specifying means 32 for specifying a shooting scene. Examples of the shooting scene include sports, fireworks, moving objects, and events as shown in FIG. However, the present invention is not limited to these, and other shooting scenes may be used. The shooting scene specifying means 32 can automatically specify a shooting scene, or can be manually set by the operation unit 25, and can be selected by the operation unit 25. . In the case of automatic, at least a change in the shape of the subject, change in brightness, movement of a stationary subject, change in sound, recognition of a face, and recognition of a moving subject from continuously shot images that are continuously shot. A shooting scene is automatically specified according to a shooting scene specifying condition such as detection. This shooting scene specifying condition is the same as at least a part of detection conditions described later. Further, in the case of manual operation, it is possible to arbitrarily select from a plurality of preset shooting scenes.

  A function of detection condition setting means 33 for setting a detection condition for detecting a desired image from continuously shot images. In the detection condition setting means 33, the operation unit 25 sets a plurality of detection conditions for each shooting scene, and sets a priority order among the plurality of detection conditions for each shooting scene. The detection conditions and priorities for each shooting scene may be set in advance so as to be optimal for the shooting scene, and the operator can arbitrarily change them using the operation unit 25.

  A function of the detection means 34 for detecting an image satisfying the detection condition from continuously shot images that are continuously shot. The detection means 34 detects images satisfying the detection condition set for each photographing scene from continuously photographed images, and if there are a plurality of images satisfying the detection condition, the priority ranking is detected. An image satisfying a high detection condition is detected.

  A function of specific information adding means 35 for adding specific information (bookmark information) to the image detected by the detecting means 34. The identification information may be any information as long as an image can be identified, and is recorded together with shooting conditions recorded as incidental information in the image data.

  A function of the display control means 36 for causing the display device 24 to display an image to which specific information is given from among the continuously shot images. In this display control means 36, when there are a plurality of continuous shot image groups, only images to which specific information is given from among the plurality of continuous shot image groups are displayed on the same screen of the display device 24, or specified. It is also possible to display an image to which information is given and a predetermined range of images before and after this image on the same screen of the display device 24.

  And as shown in FIG. 3, as a detection condition, there exist the following, for example.

1. 1. Moment when a stationary object (subject) moves Instant sound (impact sound)
3. The moment when the environmental sound is loudest (peak volume)
4). Dark → Bright → Dark light moments (peaks with a certain change in brightness)
5). 5. The moment when the movement of the moving object (subject) is the largest. 6. The moment when the moving object (subject) occupies a certain percentage of the angle of view. The moment when the moving object (subject) enters the center (or designated area) of the image. 8. When a face is recognized 10. The moment when the facial expression changes (smile, crying face) The moment when the subject is most focused (the others are blurred)
11. The moment when the shape of the moving object (subject) changes (fireworks open, etc.)
However, the detection conditions are not limited to these, and other detection conditions may be used.

  FIG. 3 shows specific shooting scene examples for each shooting scene, and shows whether each detection condition can be applied for each shooting scene example. In FIG. 3, “◯” indicates a detection condition to which detection information should be given priority, “Δ” indicates a detection condition that is considered to be detected, and “X” indicates a detection condition that is not detected.

  For example, in a sports shooting scene, in the case of a golf swing, it is considered that detection conditions 1, 2, 5, 8, and 9 are detected. If a golf ball impacts with a club is a desired image. The detection conditions 1 and 2 are suitable, and a high priority is set for any one of the detection conditions 1 and 2.

  Next, with reference to the flowchart in FIG. 4 and the explanatory diagram in FIG. 5, the specific information adding process by the continuous image processing apparatus 31 will be described. Here, a case where the shooting scene is automatically specified is shown.

  At the time of continuous shooting by the camera 11, it is determined whether or not the shape of the moving object has changed (corresponding to the detection condition 11) from a plurality of continuous images captured by the imaging device 17 and stored in the first image memory 20 ( Step 1) If the shape of the moving object has changed, it is determined whether the brightness of the light in the dark → light → dark has changed more than a certain value (corresponding to the detection condition 4) (step 2). Only changes in the shape of the moving object may be detected in shooting scenes of sports, fireworks, moving objects, and events, but only the fireworks change the brightness of dark → bright → dark light more than a certain level Therefore, in this case, it is automatically identified as a shooting scene of fireworks (step 3).

  When it is specified that the scene is a fireworks shooting scene, an image satisfying the detection condition is detected based on detection conditions and priorities for preset fireworks shooting scenes, and there are a plurality of images satisfying the detection condition. Gives specific information to an image satisfying a detection condition having a high priority (step 4). That is, as shown in FIG. 5 (a), in the case of a continuous shot image of a shooting scene of fireworks, it is considered that the detection conditions 2 to 9 and 11 are detected. Among these images, detection conditions 4, 6, and 7 are suitable. In particular, since detection condition 4 is most suitable, fireworks are set by setting detection condition 4 to the highest priority in advance. Specific information can be given to the image at the moment when is opened (the fourth image from the left in FIG. 5A).

  When a fireworks shooting scene is set by manual operation, the shooting scene is not specified, and an image at the moment when the fireworks are opened is detected under detection condition 4, and specific information is given to the image. To do.

  Also, if the shape of the moving object does not change from a plurality of continuous shot images (NO in step 1), or if the brightness of the bright light in the dark → light → dark does not change more than a certain value (NO in step 2), it is stationary. It is determined whether the object that has been moved (corresponding to the detection condition 1) (step 5), and if the stationary object has moved, whether the sound (impact sound) detected by the microphone 16 has been sounded (detection condition) 2) (step 6). When a stationary object moves and a sound (impact sound) sounds, it is automatically identified as a sports shooting scene (step 7).

  When it is specified that the scene is a sports shooting scene, an image satisfying the detection condition is detected based on detection conditions and priorities for sports shooting scenes set in advance, and there are a plurality of images satisfying the detection condition. Gives specific information to an image satisfying a detection condition having a high priority (step 8). That is, as shown in FIG. 5 (b), it is considered that detection conditions 1 to 3 and 5 to 11 are detected in the case of a continuous shot image of a sports shooting scene. If the moment is a desired image, the detection condition 1 or 2 is suitable, and by setting the detection condition 1 or 2 to the highest priority in advance, an image of the moment of impact of the golf swing ( Specific information can be given to the third image from the left in FIG. As for the moment of soccer shot or the start of land, specific information can be given to the image of the soccer shot or the image of the start of the land as in the case of the impact of the golf swing.

  When a sports shooting scene is set by manual operation, the shooting scene is not specified and, for example, under the detection condition 1 or 2, for example, a golf swing impact moment, a soccer shot moment, a land An image at the start time of is detected and specific information is given to the image.

  If there is no motion of a stationary object from a plurality of continuous shot images (NO in step 5) or no sound (impact sound) sounds (NO in step 6), there is face recognition (detection) It is determined whether or not there is a change in the facial expression (smile, crying face) (corresponding to detection condition 9) and whether the number of faces exceeds a certain value (corresponding to condition 8) (step 9). If there is face recognition and there is a change in facial expression (smiling face, crying face) or the number of faces exceeds a certain value, it is automatically identified as an event shooting scene (step 10).

  When it is specified that the scene is an event shooting scene, an image satisfying the detection condition is detected based on detection conditions and priorities for a preset event shooting scene, and there are a plurality of images satisfying the detection condition. Gives specific information to an image satisfying a detection condition having a high priority (step 11). That is, as shown in FIG. 5C, in the case of a continuous shot image of an event shooting scene, it is considered that detection conditions 2, 3, 5 to 11 are detected. In this case, detection conditions 3, 7 to 8 are suitable among them, and by setting one of these detection conditions to the highest priority in advance, an image of the moment that was excited at the party Specific information can be given to (the third image from the left in FIG. 5C). Also, in the case of athletic meet, like the party, specific information can be given to the image at the moment of excitement.

  In addition, when the shooting scene of the event is set by manual operation, the shooting scene is not specified, and an image obtained when the event is excited at one of the detection conditions 3, 7 to 8, for example, at an athletic meet or a party. And specific information is given to the image.

  If there is no face recognition from a plurality of continuous shot images or the number of faces is not more than a certain value (NO in step 9), there is a detection of a moving object, and whether the moving object occupies a certain proportion of the angle of view ( It is determined whether the moving object enters the center (or designated area) of the image (corresponding to detection condition 7) (corresponding to detection condition 6) (step 12). When the moving object is moving from the beginning and the moving object occupies a certain proportion of the angle of view or the moving object enters the center (or designated area) of the image, it is automatically identified as the shooting scene of the moving object ( Step 13).

  If it is determined that the scene is a moving object shooting scene, an image satisfying the detection condition is detected based on a preset detection condition and priority order for the moving object shooting scene, and there are a plurality of images satisfying the detection condition. In this case, specific information is assigned to an image satisfying a detection condition having a high priority (step 14). That is, as shown in FIG. 5 (d), in the case of a continuous shot image of a shooting scene of a moving object, it is considered that detection conditions 2, 3, 5 to 11 are detected. For example, a train has a constant angle of view. The detection condition 6 is the most suitable of these, and the detection condition 6 is set to the highest priority in advance so that the train has a constant angle of view. Specific information can be given to the instantaneous image (the third image from the left in FIG. 5D). Also, for the moment when a car or a running person occupies a certain proportion of the angle of view, specific information can be given to the image at the moment when the car or a running person occupies a certain proportion of the angle of view, as in the case of a train.

  If a shooting scene of a moving object is set manually, the shooting scene is not specified and, for example, a certain ratio of the angle of view of a car, a train, or a person running is met under detection condition 6 or 7. Is detected, and specific information is given to the image.

  If no moving object is detected from a plurality of continuous shot images (NO in step 12), it is identified as another shooting scene (step 15), and the desired detection is performed using all detection conditions 1-11. An image is specified, and specific information is given to the desired image (step 16).

  Then, the continuous shot image to which the specific information is given in this way is recorded on the recording medium 12.

  According to the auto preview function of the camera 11 and the display operation by the operation unit 25, the display control unit 36 of the continuous shot image processing device 31 displays only the image to which specific information is given from the continuous shot images. Can be displayed on the screen. Furthermore, an image to which specific information is added and an image in a predetermined range before and after this image can be displayed on the same screen of the display device 24. In addition, when there are a plurality of continuous shot image groups, only images to which specific information is given can be displayed on the same screen of the display device 24 as thumbnails from the plurality of continuous shot image groups.

  As described above, according to the continuous shot image processing device 31, by setting a detection condition for detecting a desired image in advance, an image satisfying the detection condition can be selected from continuously shot images continuously shot. Automatic detection and specific information can be automatically assigned to the detected image, eliminating the need for the operator to select and using the specific information to confirm the desired image from the continuous shots It can be done easily.

  Further, since a plurality of images satisfying the detection condition are detected from continuously shot images that are continuously photographed, an image satisfying the detection condition having a high priority is detected, so that a desired image can be easily detected.

  Furthermore, since the image satisfying the detection condition set for each shooting scene is detected from the continuously shot images that are continuously shot, it is easy to detect a desired image.

  Also, from continuously shot images that are continuously shot, shooting scenes can be selected according to shooting scene specifying conditions such as at least a change in the shape of the subject, movement of a stationary subject, face recognition, and detection of a moving subject. Can be automatically identified. Alternatively, a desired shooting scene can be selected and set from a plurality of preset shooting scenes.

  In addition, since the image to which the specific information is given is displayed on the same screen from the plurality of continuous shot image groups, it is possible to easily confirm a desired image from the plurality of continuous shot image groups.

  In the above embodiment, the camera 11 includes the continuous image processing device 31. However, for example, the software of the continuous image processing device 31 is applied to a personal computer, and the camera 11 is changed to the personal computer. The captured continuous shot image may be processed.

31 Continuous image processing device
32 Shooting scene identification method
33 Detection condition setting method
34 Detection means
35 Specific information provision means
36 Display control means

Claims (6)

Detection condition setting means for setting a detection condition for detecting a desired image;
Detecting means for detecting an image satisfying the detection condition from continuously shot images continuously shot;
A continuous image processing apparatus, comprising: specific information adding means for adding specific information to an image detected by the detecting means. The detection condition setting means sets a plurality of detection conditions and sets a priority order among the plurality of detection conditions,
The detection means detects an image satisfying a detection condition having a high priority when there are a plurality of images satisfying the detection condition from continuously shot images taken continuously. 3. The continuous shot image processing apparatus according to 2. A shooting scene specifying means for specifying a shooting scene;
The detection condition setting means sets a detection condition for each shooting scene,
The continuous image processing apparatus according to claim 1, wherein the detection unit detects an image satisfying a detection condition set for each of the shooting scenes from continuously shot images taken continuously. . The shooting scene specifying unit is configured to detect at least a change in the shape of a subject, movement of a stationary subject, face recognition, and detection of a moving subject from continuous shooting images that are continuously shot. The continuous-shot image processing apparatus according to claim 3, wherein a shooting scene is specified. The continuous image processing apparatus according to claim 3, wherein the shooting scene specifying unit is operable to select from a plurality of preset shooting scenes. The continuous shot image according to any one of claims 1 to 5, further comprising display control means for displaying an image to which specific information is given from a plurality of continuous shot image groups on the same screen. Processing equipment.

Images