JP2013117908A - Image processor, image processing method, and imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processor, an image processing method, and an imaging apparatus capable of facilitating operations for selecting a small number of pieces of image data from among pieces of image data on many consecutively photographed still images, and generating a synthetic image obtained by synthesizing pieces of the selected image data.SOLUTION: An image processor includes: an image recording part which records a plurality of series of still images consecutively photographed in time series; a range specification input part which is operated by an operator, and outputs specific range information representing specific ranges which are time series ranges specified by the operator among time series ranges in which the plurality of series of still images are included; an image selection part which specifies the plurality of series of still images included in the specific ranges from among the plurality of series of still images based on the specific range information, and selects the plurality of still images matching to a predetermined condition to be read from the image recording part as the selected images; an image synthesis part which generates a synthetic image obtained by synthesizing each of the selected images; and a display part which displays the synthetic image.

Description

  The present invention relates to an image processing device, an image processing method, and an imaging device.

  2. Description of the Related Art In recent years, various functions for improving convenience are being installed one after another in an imaging apparatus such as a digital camera, in addition to taking pictures. As one of them, for example, a function of image composition for generating a new photograph by combining a plurality of photographs can be considered. By using this image composition function, for example, image data of a plurality of frames included in moving image data can be synthesized as image data of one still image.

  In order to obtain a composite image result desired by the user (user) of the digital camera, a plurality of frames in the range where the subject or scene in which the user is interested are captured from the moving image data. It is desirable to use the original input image for performing the above process. As a method for selecting a frame and a method for extracting a specific range from moving image data, for example, techniques disclosed in Patent Document 1 and Patent Document 2 have been proposed.

  In the technique disclosed in Patent Document 1, a plurality of still images are extracted from moving image data, and a new still image is obtained by synthesizing image data of the extracted still images. In Patent Document 1, first, a user designates a specific subject captured in a moving image as a subject of interest. Thereafter, the image processing apparatus extracts the movement of the subject of interest from the image data of the subsequent moving image frame, and selects a frame necessary for the image composition processing from the extraction result.

  Further, the technique disclosed in Patent Document 2 discloses a method of extracting a moving image frame in a range desired by a user from recorded moving image data. In the method disclosed in Patent Document 2, a user performs a gesture operation when each frame is continuously reproduced as a moving image or when each frame is displayed side by side in time series. Thus, the user designates the start point (in point) and end point (out point) of the range of the desired moving image frame while confirming each frame as the moving image.

  In this way, when performing image composition processing, it is possible to easily grasp the contents of moving image data by selecting a frame of moving image data or extracting a specific range of moving image data. The convenience of the digital camera can be improved.

  Also, with the speeding up of digital cameras, not only moving images, but also the speed of continuous shooting of still images (hereinafter referred to as “continuous shooting”) has increased. It has become shorter and more still image data can be obtained in the same shooting time. This makes it possible to improve the convenience of the digital camera, such as easily grasping the locus of the moving subject.

JP 2008-167220 A JP 2010-277183 A

  However, the moving image data actually shot includes a subject other than the subject of interest and the background. In addition, the photographed subject itself, the direction of the camera, and the background may be moving. For this reason, when extracting the motion of the subject of interest in the technique disclosed in Patent Literature 1, the subject of interest is not always detected well, and the user may not be able to obtain a desired composite image. .

  In the technique disclosed in Patent Document 2, when a desired moving image frame range is designated, the user needs to check each frame in the moving image data one by one. For this reason, it takes a long time to extract a specific range desired by the user.

  Further, if image data of all still images obtained by continuous shooting are combined, the load in the image combining process increases. For this reason, it is conceivable to reduce the load in image composition processing by compositing a predetermined number of image data on the basis of when continuous shooting is started or ended. However, an image obtained by synthesis (hereinafter referred to as “composite image”) is not necessarily an image desired by the user of the digital camera.

  FIG. 7 is a diagram illustrating an example of an image (composite image) generated by image synthesis using continuously shot still images. FIG. 7A shows a composite image desired by the user, and FIG. 7B shows a composite image obtained by combining image data of all still images. Further, FIG. 7C shows a composite image obtained by combining image data of a predetermined number of still images with reference to the time when continuous shooting is ended, and FIG. 7D shows the start of continuous shooting. A synthesized image obtained by synthesizing image data of a predetermined number of still images on the basis of the above is shown.

  As shown in FIG. 7A, the composite image desired by the user is an object moving by so-called multi-flash photography, in which balls are evenly dispersed at a certain distance in the image. It is a composite image such as a still image obtained by photographing the trajectory of (ball). However, when the image data of all the still images taken by continuous shooting are combined into one composite image, a composite image in which balls are evenly captured in the image is generated as shown in FIG. 7B. You can, but the ball is very close to the image. Here, in order to reduce the load of the image composition processing, a predetermined number of still image data (in FIG. 7, six still image data) is synthesized into one composite image. think of. At this time, if the continuous shooting is started as a reference, a composite image as shown in FIG. 7C is generated, and if the continuous shooting is ended as a reference, as shown in FIG. 7D. A composite image is generated. In the combined images shown in FIGS. 7C and 7D, the load in the image combining process can be reduced by reducing the number of balls in the image. It becomes a composite image with the ball in the position.

  The present invention has been made on the basis of the above-described problem recognition, and facilitates and selects an operation when selecting a small number of image data from among many still image data that have been taken continuously. An object of the present invention is to provide an image processing apparatus, an image processing method, and an imaging apparatus capable of generating a composite image obtained by combining image data.

  In order to solve the above-described problems, an image processing apparatus according to the present invention includes an image recording unit that records a series of still images taken continuously in time series, and the image recording unit that is operated by an operator. A range specification that outputs specified range information indicating a specified range that is a time-series range specified by the operator among all ranges that are a time-series range including a series of still images recorded in Based on the input unit and the specified range information, a series of the plurality of still images included in the specified range is identified from the series of the plurality of still images recorded in the image recording unit, and the identification is performed. The plurality of still images that meet a predetermined condition are selected from the series of the plurality of still images, and each of the selected plurality of still images is read from the image recording unit as a selected image. image And selecting section, characterized in that it comprises an image combining unit for generating a composite image by combining each of the selected image, and a display unit for displaying the composite image.

  The range designation input unit of the present invention comprises a start position designation means for designating a start position of the designated range, and an end position designation means for designating an end position of the designated range, When one or both of the start position specifying means and the end position specifying means is changed by the operator, the position information of the start position specifying means and the position information of the end position specifying means are Output as the specified range information, and the image selection unit, based on the position information of the start position specifying unit and the position information of the end position specifying unit, included in the specified range information, A series of the plurality of still images included in the designated range from the position to the position of the end position designation means is specified.

  The range specification input unit of the present invention outputs the specified range information every time one or both of the start position specifying means and the end position specifying means is changed by the operator, The image selection unit specifies a series of still images each time the position information of the start position specifying unit and the position information of the end position specifying unit included in the specified range information are changed, A plurality of the still images that meet a predetermined condition are selected and read out as the selected image from the image recording unit, and the image composition unit performs the selection every time the selected image is read out from the image recording unit. A composite image obtained by combining each of the images is generated, and the display unit displays the composite image every time the composite image is generated.

  In the image processing apparatus of the present invention, as the condition, the number of the still images to be selected from the specified series of the plurality of still images is determined in advance. Each of the predetermined number of the still images is selected so that the time when the still images are taken is equal.

  In the image processing apparatus of the present invention, as the condition, a time interval at which the still image to be selected from the specified series of the plurality of still images is captured is determined in advance. In the designated range, each of the still images in which the time at which the still image was taken is the predetermined time interval is selected.

  Further, the image processing method of the present invention is a time series including the still images recorded in an image recording unit that records a series of still images that are operated by an operator and continuously photographed in time series. A range designation input step for outputting designated range information representing a designated range that is a time-series range designated by the operator among all the ranges that are ranges of the image, and the image recording unit based on the designated range information A series of the plurality of still images included in the designated range is identified from among the series of the plurality of still images recorded in the predetermined range, and a predetermined number is determined from the identified series of the plurality of still images. An image selection step of selecting a plurality of still images that meet a condition, and reading each of the selected plurality of still images from the image recording unit as a selected image, and combining each of the selected images An image synthesizing step of generating a composite image, characterized in that it comprises a display step of displaying the composite image.

  Further, an imaging apparatus according to the present invention includes an imaging unit that outputs an image signal obtained by imaging a subject, and a series of a plurality of images that are continuously captured in time series by performing image processing on the image signal output from the imaging unit. An image signal processing unit that generates a still image, an image recording unit that records a series of still images generated by the image signal processing unit, and a series of images that are operated by an operator and recorded in the image recording unit A range designation input unit for outputting designated range information representing a designated range that is a time-series range designated by the operator among all ranges that are a time-series range including the plurality of still images; and the designation Based on the range information, a series of the plurality of still images included in the designated range is identified from the series of the plurality of still images recorded in the image recording unit, and the identified series of the plurality of the plurality of the images From still images An image selection unit that selects a plurality of still images that meet a predetermined condition, reads each of the selected plurality of still images from the image recording unit as a selected image, and combines each of the selected images. An image composition unit that generates the composite image and a display unit that displays the composite image.

  According to the present invention, it is possible to facilitate an operation when selecting a small number of image data from a large number of image data of still images taken continuously, and to generate a composite image obtained by combining the selected image data. The effect of being able to be obtained.

1 is a block diagram illustrating a schematic configuration of an image processing apparatus according to an embodiment of the present invention. In the image processing apparatus of this embodiment, it is the figure which showed typically an example of the method of designating the range of the image used for the process of image composition. FIG. 6 is a diagram schematically illustrating an example of a process for designating a range of an image to be subjected to image composition processing in the image processing apparatus according to the present embodiment. It is the figure which showed typically an example of the image composition process in the image processing apparatus of this embodiment. It is the flowchart which showed the procedure of the image composition process in the image processing apparatus of this embodiment. It is the figure which showed an example of the image produced | generated by the image composition process in the image processing apparatus of this embodiment. It is the figure which showed an example of the image produced | generated by the image composition using the still image continuously shot.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram illustrating a schematic configuration of an image processing apparatus according to the present embodiment. In FIG. 1, an image processing apparatus 100 includes a recording medium 1, a media interface (I / F) unit 2, a memory unit 3, a composition processing unit 4, a video interface (I / F) unit 5, and a display device. 6, an operation device 7, and a CPU 8.

  The image processing apparatus 100 stores image data of many still images (hereinafter also referred to as “continuous-shot images”) recorded on the recording medium 1 and photographed continuously at high speed (hereinafter referred to as “high-speed continuous shooting”). The original image data used for image composition processing is selected from (hereinafter referred to as “continuous-shot image data”). Then, the image processing apparatus 100 generates and generates image data (hereinafter referred to as “synthesized image data”) by combining the original image data (hereinafter referred to as “selected image data”) used for the selected image composition process. An image of the composite image data (hereinafter also referred to as “composite image”) is displayed on the display device 6.

  The image processing apparatus 100 illustrated in FIG. 1 can be applied to an imaging apparatus such as a digital camera, for example. When the image processing apparatus 100 is applied to an imaging apparatus, in addition to the components of the image processing apparatus 100 illustrated in FIG. 1, imaging including an imaging element that converts a subject light incident on the lens and the lens into an image signal. A component such as an image signal processing unit that performs image processing on the image signal output from the image capturing unit and the image capturing unit to generate continuous shot image data is added. Even when the image processing apparatus 100 is applied to an imaging apparatus, a series of image data that has been continuously shot at high speed is recorded on the recording medium 1 as continuously shot image data, and thereafter the operation of the image processing apparatus 100 described below. I do. In this case, a method for recording a series of continuous shot image data on the recording medium 1 is the same as a method for recording a series of image data continuously shot at high speed in a conventional imaging apparatus on the recording medium. Therefore, in the following description, a detailed description of the configuration and operation unique to the imaging apparatus when the image processing apparatus 100 is applied to the imaging apparatus is omitted.

  The recording medium 1 records continuous shot image data that the image processing apparatus 100 performs image synthesis processing. In FIG. 1, the recording medium 1 is also a component of the image processing apparatus 100, but the recording medium 1 is a recording medium that can be attached to and detached from the image processing apparatus 100.

  The CPU 8 controls the components of the image processing apparatus 100, that is, the entire image processing apparatus 100. The operation device 7 is a user interface such as buttons and switches operated by the user of the image processing apparatus 100. Note that the operation device 7 is not configured only with buttons and switches, and may be configured to include, for example, a touch panel. In the following description, the operation device 7 will be described as a touch panel.

  The user operates the operation device 7 by a method to be described later, and designates a range of continuous shot image data used for image composition processing from the continuous shot image data recorded on the recording medium 1. At this time, the operation device 7 outputs to the CPU 8 information indicating the range of continuous shot image data specified by the user and used for image composition processing. Then, the CPU 8 performs an image composition process from continuous image data recorded on the recording medium 1 based on information representing the range of the continuous image data used for the image composition process input from the operation device 7. A plurality of selected image data to be used is selected, and each component of the image processing apparatus 100 is controlled based on the selected result.

  The media I / F unit 2 drives the recording medium 1 in accordance with the control from the CPU 8, and among the continuous shooting image data recorded on the recording medium 1, a plurality of selected continuous shooting image data, that is, image The processing apparatus 100 reads a plurality of selected image data used for image composition processing. Then, the media I / F unit 2 outputs the plurality of read selected image data to the memory unit 3.

  The memory unit 3 temporarily stores a plurality of selected image data input from the media I / F unit 2. Then, the memory unit 3 outputs each of the stored selected image data to the synthesis processing unit 4 in accordance with control from the synthesis processing unit 4.

  The synthesis processing unit 4 performs image synthesis processing to synthesize each selected image data input from the memory unit 3 into one synthesized image in accordance with control from the CPU 8 to generate one synthesized image data. . Then, the composition processing unit 4 outputs the generated one composite image data to the video I / F unit 5.

  The video I / F unit 5 converts one composite image data input from the composition processing unit 4 into a video signal to be displayed on the display device 6, and converts the converted composite image data video signal to the display device 6. Output to.

  The display device 6 includes a display device such as an LCD (Liquid Crystal Display), for example, and displays an image (composite image) of composite image data corresponding to the video signal input from the video I / F unit 5.

  In FIG. 1, the display device 6 and the operation device 7 are shown as separate components, but in the image processing apparatus 100, the display device 6 (LCD) and the operation device 7 (touch panel) are integrated. It may be configured. With this configuration, the user can operate the image processing apparatus 100 by operating the operation device 7 while confirming the composite image displayed on the display device 6. In the following description, it is assumed that the display device 6 and the operation device 7 are integrally configured.

  Here, a method for operating the image processing apparatus 100 by the user, that is, a method for selecting selected image data used for image composition processing will be described. FIG. 2 is a diagram schematically illustrating an example of a method for designating a range of an image used for image composition processing in the image processing apparatus 100 of the present embodiment. In FIG. 2, an image displayed on the display device 6 when the display device 6 and the operation device 7 are integrally configured is shown as a display screen 10.

  On the display screen 10, a composite image 9 and knobs 11 and 12 are displayed. The composite image 9 is an image of composite image data generated by the composite processing unit 4. Knobs 11 and 12 are knobs (slide bars) for performing a gesture operation when the user designates an image range to be used for image composition processing. The positions of the knobs 11 and 12 are the positions of the continuous shot image data for starting the image synthesis processing and the image synthesis processing in the range of all continuous shot image data that may be subjected to the image synthesis processing. Each position of the continuous shot image data is relatively represented.

  When the user moves the knobs 11 and 12 left and right while pressing the knobs 11 and 12, the operation device 7 detects the pressed position, that is, the positions of the knobs 11 and 12, and information on the positions of the detected knobs 11 and 12 is detected. Are output to the CPU 8 as information representing the range of the continuous shot image data used for the image composition processing designated by the user.

  The CPU 8 calculates the range of the image used for the image composition process designated by the user based on the information representing the range of the continuous shot image data used for the image composition process input from the operation device 7. More specifically, the CPU 8 specifies a series of continuous shot image data included between the knob 11 and the knob 12 by a calculation process of an image range used for the image composition process. Then, the CPU 8 selects a plurality of selected image data to be used for image composition processing from the continuous shot image data recorded on the recording medium 1 based on the result of specifying the continuous shot image data.

  When the CPU 8 selects the selected image data, for example, the number of selected image data to be used for the image composition process is determined in advance, and a predetermined number of continuous image data is selected from the specified continuous image data. select. At this time, the CPU 8 is configured so that the interval between the continuous shot image data selected as the selected image data is equal, that is, the shooting time interval in each selected continuous shot image data is equal. The continuous image data is selected as selected image data. As a result, it is possible to generate composite image data in which a moving subject is photographed at equal intervals.

  More specifically, for example, consider a case where a series of n (n: positive integer, n ≧ 3) still images that have been continuously shot at high speed are recorded on the recording medium 1. At this time, the CPU 8 calculates a series of m (m: positive integer, 3 ≦ m ≦ n) consecutive images included between the knob 11 and the knob 12 by calculating the range of the image used for the image composition process. Specify image data. Then, the CPU 8 selects predetermined s (s: positive integer, 3 ≦ s ≦ m) continuous shot image data as selection image data so that the intervals of the continuous shot image data are equal. To do. As a result, it is possible to generate composite image data in which a moving subject is captured s times at equal intervals.

  Next, the range of images used for image composition processing in the image processing apparatus 100 of the present embodiment will be described. FIG. 3 is a diagram schematically illustrating an example of processing for designating a range of an image to be subjected to image composition processing in the image processing apparatus 100 according to the present embodiment. FIG. 3 shows the relationship between the positions of the knobs 11 and 12 and the continuous shot image data.

  In the display 13 shown in FIG. 3, the knobs 11 and 12 shown in FIG. 2 that are operated when the user designates the range of the image used for the image composition processing are shown. In FIG. 3, the distance A indicates the distance from the left end position of the movable range of the knob 11 to the current position, and the distance B indicates the distance from the right end position of the movable range of the knob 11 to the current position. Yes. Similarly, the distance C indicates the distance from the left end position of the movable range of the knob 12 to the current position, and the distance D indicates the distance from the right end position of the movable range of the knob 12 to the current position. When the user moves the positions of the knobs 11 and 12 to the left and right by the gesture operation, the distances A to D change. The operation device 7 outputs information on the distances A to D to the CPU 8.

  In FIG. 3, the continuous-shot image data group 14 represents a series of continuous-shot image data recorded on the recording medium 1 in time series from the left. Note that each continuous-shot image data in the continuous-shot image data group 14 is not displayed on the display device 6. The continuous shot image data 15 indicates the first continuous shot image data in a series of continuous shot image data included in the continuous shot image data group 14, and the continuous shot image data 16 is included in the continuous shot image data group 14. Of the series of continuous shot image data included, the last continuous shot image data is shown. The continuous-shot image data 17 is a series of continuous-shot image data included in the continuous-shot image data group 14. The continuous-shot image data 17 is relatively represented by the knob 11 and corresponds to the position at which the image composition processing starts. Image data is shown. The continuous-shot image data 18 is a series of continuous-shot image data included in the continuous-shot image data group 14. The continuous-shot image data 18 is relatively represented by the knob 12 and corresponds to the position at which the image composition processing is terminated. Image data is shown.

  In FIG. 3, the number E indicates the number of continuous shot images from the continuous shot image data 15 to the continuous shot image data 17, and the number F indicates the number of continuous shot images from the continuous shot image data 17 to the continuous shot image data 16. Indicates the number of sheets. Similarly, the number G indicates the number of continuous shot images from the continuous shot image data 15 to the continuous shot image data 18, and the number H indicates the number of continuous shot images from the continuous shot image data 18 to the continuous shot image data 16. ing.

  The CPU 8 selects the continuous shot image data 17 and the continuous shot image data 18 as selection image data based on the information of the distances A to D input from the operation device 7. As described above, the positions of the knobs 11 and 12 are within the range of the continuous shot image data group 14, the position of the continuous shot image data 17 that starts the image combining process, and the continuous shot image that ends the image combining process. Each position of the data 18 is represented relatively. Therefore, the CPU 8 selects continuous shot image data at a position where the following expression (1) is satisfied as the continuous shot image data 17. Further, the CPU 8 selects the continuous shot image data at the position where the following expression (2) is satisfied as the continuous shot image data 18. The continuous shot image data 17 and the continuous shot image data 18 selected here are selected image data, respectively.

    A: B = E: F (1)

    C: D = G: H (2)

  When the knob 11 is moved to the left or right by the user's gesture operation, the CPU 8 selects again the continuous shot image data at the position where the above formula (1) is satisfied as the continuous shot image data 17. When the knob 12 is moved to the left or right by the user's gesture operation, the CPU 8 again selects the continuous shot image data at the position where the above equation (2) is satisfied as the continuous shot image data 18. In this way, the CPU 8 re-selects the continuous shot image data 17 or the continuous shot image data 18 every time the position of the knob 11 or 12 is moved to the left or right by the user's gesture operation.

  Further, the CPU 8 determines a predetermined number of continuous shot images from the continuous shot image data included between the knobs 11 and 12 based on the information of the distances A to D input from the operation device 7. The data is selected so that the interval between the continuous shot image data is equal. At this time, the CPU 8 determines the interval between the continuous shot image data 17 and the continuous shot image data 18 and the continuous shot image data from the continuous shot image data 17 to the continuous shot image data 18. Select continuous-shot image data at equal intervals. More specifically, since two continuous-shot image data of the continuous-shot image data 17 and the continuous-shot image data 18 have already been selected, the CPU 8 determines the predetermined number-two continuous-shot image data. Is selected from continuous shot image data between continuous shot image data 17 and continuous shot image data 18. Each continuous shot image data selected here is also selected image data.

  Next, the image composition process in the image processing apparatus 100 of the present embodiment will be described. FIG. 4 is a diagram schematically illustrating an example of image composition processing in the image processing apparatus 100 of the present embodiment. FIG. 4 shows the relationship between the selected image data selected by the CPU 8 and the image composition processing by the composition processing unit 4.

  In FIG. 4, the selected image data group 19 represents the selected image data selected by the CPU 8 arranged in time series from the left. Each selected image data in the selected image data group 19 is a predetermined number of continuous-shot image data selected so that the interval between the continuous-shot image data is equal. FIG. 4 shows a case where the predetermined number is six.

  As can be seen from FIG. 4, the selected image data group 19 is an image data group in which the continuous shot image data included in the continuous shot image data group 14 is thinned to reduce the number of images. As a result, compared to the case where all continuous shot image data included in the continuous shot image data group 14 is subjected to image combining processing into one composite image, the load of the image combining processing of the combining processing unit 4 can be reduced. . That is, although a long processing time is required for the image synthesizing process by the synthesizing unit 4, the image processing apparatus 100 according to the present embodiment reduces the number of image data to be subjected to the image synthesizing process as in the selected image data group 19. By (thinning out), the processing time required for the image composition process can be shortened.

  The composite processing unit 4 generates one composite image data 21 by combining all the selected image data included in the selected image data group 19 into one composite image by the image composite processing 20 shown in FIG. Then, the composition processing unit 4 outputs the generated one composite image data 21 to the video I / F unit 5.

  Thereafter, the synthesized image data 21 generated by the synthesis processing unit 4 is converted into a video signal by the video I / F unit 5 and displayed on the display device 6. An example of the composite image of the composite image data 21 displayed on the display device 6 is the composite image 9 shown in FIG.

  Next, the procedure of image composition processing in the image processing apparatus 100 of the present embodiment will be described. FIG. 5 is a flowchart showing a procedure of image composition processing in the image processing apparatus 100 of the present embodiment.

  When the image composition processing by the image processing apparatus 100 is started, first, in step S1, the CPU 8 sets (initializes) the initial position where the knobs 11 and 12 are displayed. The initial position for displaying the knobs 11 and 12 may be a predetermined position. For example, the first position where the knobs 11 and 12 are displayed is set at a position represented by the following expression (3).

A: B = 1: 2
C: D = 2: 1 (3)

  Further, the operation device 7 outputs information on the distances A to D as shown in FIGS. 3 and 4 to the CPU 8.

  Subsequently, in step S2, the CPU 8 selects the selected image as shown in FIG. 4 by the above formula (1) and the above formula (2) based on the information on the distances A to D input from the operation device 7. Each selected image data of the data group 19 is selected.

  Subsequently, in step S <b> 3, the CPU 8 controls the media I / F unit 2 in order to read each selected image data included in the selected selected image data group 19. As a result, the media I / F unit 2 reads a plurality of continuous shot image data selected by the CPU 8 among the continuous shot image data recorded on the recording medium 1 as selected image data, and outputs the selected image data to the memory unit 3. To do. The memory unit 3 temporarily stores each selected image data input from the media I / F unit 2.

  Subsequently, in step S4, the CPU 8 causes the composition processing unit 4 to start image composition processing. As a result, the composition processing unit 4 generates one composite image data 21 as shown in FIG. 4 by composing each selected image data once stored in the memory unit 3 into one composite image. Then, the composition processing unit 4 outputs the generated composite image data 21 to the video I / F unit 5.

  Subsequently, in step S <b> 5, the video I / F unit 5 converts the combined image data 21 input from the combining processing unit 4 into a video signal, and outputs the converted video signal of the combined image data 21 to the display device 6. To do. The display device 6 displays a composite image of the composite image data 21 corresponding to the video signal input from the video I / F unit 5.

  Subsequently, in step S6, the CPU 8 determines whether or not the position of the knob 11 or 12 has been changed by the user's gesture operation. In this determination, the CPU 8 determines that either one or both of the distances A and B and / or the distances C and D are changed from the operation device 7 due to the change of either or both of the knobs 11 and 12. Judgment is made based on whether or not it is output.

  As a result of the determination in step S6, when it is determined that the position of either the knob 11 or 12 has been changed by the user's gesture operation, the process returns to step S2 and is input from the operation device 7 again. From the selection of each selected image data of the selected image data group 19 based on the information of the distances A to D, the image composition process is repeated.

  Further, as a result of the determination in step S6, if it is determined that neither position of the knobs 11 and 12 has been changed by the user's gesture operation, whether or not the position of the knob 11 or 12 in step S6 has been changed. Repeat the determination.

  By such an operation, the image processing apparatus 100 selects and selects each selected image data of the selected image data group 19 used for the image composition process every time the user changes the position of the knob 11 or 12 by a gesture operation. Further, it is possible to repeatedly read a plurality of selected image data from the recording medium 1, generate composite image data 21 by image composition processing of the composition processing unit 4, and display a composite image of the composite image data 21 on the display device 6. .

  Here, an example of a composite image that has been subjected to image composition processing by the image processing apparatus 100 will be described. FIG. 6 is a diagram illustrating an example of an image (composite image) generated by image composition processing in the image processing apparatus 100 according to the present embodiment. FIG. 6 shows the relationship between the positions of the knobs 11 and 12 and the composite image 9 when the predetermined number is six. As shown in FIG. 6, when the user changes the positions of the knobs 11 and 12 by a gesture operation, different composite images 9 corresponding to the positions of the knobs 11 and 12 are displayed.

  FIG. 6A shows a case where the position of the knob 11 and the position of the knob 12 are separated from each other within the range of all continuous shot image data. In this case, the CPU 8 selects six continuous shot image data from among all the continuous shot image data so that the interval between the continuous shot image data is equal. As a result, the composite image 9 becomes an image in which the balls in the composite image 9 are evenly distributed at a certain distance.

  In this way, as shown in FIG. 6A, the image processing apparatus 100 apparently continuously captures six consecutively shot image data from a series of still images that have been continuously shot at high speed. The synthesized image 9 obtained by synthesizing the still images with a reduced speed (successively taken at a low speed) can be displayed. Note that the composite image 9 shown in FIG. 6A can be said to be a still image obtained by shooting the trajectory of a moving subject (ball) by multi-flash shooting.

  In FIG. 6 (b), the position of the knob 11 and the position of the knob 12 are brought close to each other so that they are close to the right side in the range of all continuous image data, that is, close to the position when high-speed continuous shooting is finished. Shows the case. In this case, the CPU 8 selects six continuous shot image data from the latter half of the continuous shot image data so that the interval between the continuous shot image data is equal. As a result, the composite image 9 becomes an image in which the balls in the composite image 9 appear to be biased backward in time.

  In FIG. 6 (c), the position of the knob 11 and the position of the knob 12 are brought close to each other so that they are close to the left side within the range of all continuous shot image data, that is, close to the position when high-speed continuous shooting is started. Shows the case. In this case, the CPU 8 selects six continuous shot image data from the first half of the continuous shot image data so that the interval between the continuous shot image data is equal. As a result, the composite image 9 becomes an image in which the balls in the composite image 9 appear to be biased forward in time.

  As described above, in the image processing apparatus 100, the user can display different composite images 9 by changing the positions of the knobs 11 and 12 by a gesture operation. In other words, the user may perform a gesture operation for changing the positions of the knobs 11 and 12 so that the composite image 9 becomes a desired image.

  As described above, according to the embodiment for carrying out the present invention, the user designates a range of an image to be used for image composition processing by a simple gesture operation. Then, an image to be used for the image composition process is selected from the images included in the range of the image to be used for the designated image composition process so that the shooting time intervals are equal. This makes it possible to easily select a predetermined number of still images used for image composition processing from among still images taken continuously in time series.

  According to the embodiment for carrying out the present invention, one synthesized image obtained by subjecting each selected still image to image synthesis processing is sequentially generated, and the generated synthesized image is sequentially displayed. Accordingly, the user can sequentially change the range of the image used for the image synthesis process by the gesture operation until the synthesized image becomes a desired image while checking the displayed synthesized image in real time.

  As described above, according to the mode for carrying out the present invention, the user does not check or select the original image used for the image composition process as in the conventional technique, and the image A desired composite image can be obtained from a series of still images that have been continuously shot at high speed without being aware of the number of original images used in the composition process. That is, according to the mode for carrying out the present invention, the user can check the individual still images and check the start point (in point) and the end point as in the technique disclosed in Patent Document 2, for example. It is not necessary to designate (out point), and a desired composite image can be obtained by performing a simple operation while paying attention only to the displayed composite image.

  In the present embodiment, the number of selected image data to be used for image composition processing is determined in advance, and the CPU 8 determines the shooting time of continuous shot image data from the range of continuous shot images designated by the user. An example has been described in which a predetermined number of continuous shot image data is selected as selection image data so that the intervals are equal. However, the method by which the CPU 8 selects the selected image data is not limited to the form for carrying out the present invention. For example, it is also possible to determine the interval of continuous-shot image data to be selected in advance and select continuous-shot image data at a predetermined interval from the specified continuous-shot image data. When continuous image data is selected as selected image data by this method, it is possible to generate composite image data in which the number of images captured in the composite image data differs depending on the speed of movement of the subject. More specifically, it is possible to generate composite image data in which a fast-moving subject is photographed less frequently and a slow-moving subject is photographed more frequently.

  Further, in the present embodiment, an example has been described in which the number of selected image data used for image composition processing is determined in advance, and the shooting time intervals of continuous shot image data to be selected are equal intervals. However, the number of selected image data used for image composition processing and the shooting time interval of continuous shot image data to be selected are not limited to the mode for carrying out the present invention. It can also be configured to be able to. In this case, for example, on the display screen 10 shown in FIG. 2, a knob (slide bar) for setting the number of selected image data used for image composition processing on the left and right of the composite image 9 and the continuous-shot image data to be selected. A knob (slide bar) for setting the shooting time interval is arranged. Then, the user moves the position of these knobs up and down by a gesture operation, thereby changing the number of selected image data used for image composition processing and the shooting time interval of the continuous shot image data to be selected. You can also In this case, when selecting the selected image data, the CPU 8 selects the set number of continuous shot image data at the set intervals based on the position information of these knobs input from the operation device 7. Will do.

  Further, in the present embodiment, an example has been described in which the user designates an image range to be used for image composition processing with the knob 11 and the knob 12. However, the method for designating the range of the image used by the user for the image composition process is not limited to the mode for carrying out the present invention.

  Further, in the present embodiment, an example in which the composite image 9 and the knobs 11 and 12 are arranged as in the display screen 10 shown in FIG. 2 is shown, but the arrangement of the composite image 9 and the knobs 11 and 12 is shown. However, the present invention is not limited to the mode for carrying out the present invention.

  Further, in the present embodiment, a case has been described in which the composite image data 21 generated by the composite processing unit 4 is displayed on the display device 6 as a composite image. However, the processing after the composite processing unit 4 generates the composite image data 21 is not limited to the form for carrying out the present invention. For example, when the composite image of the composite image data 21 is displayed on the display device 6 and it is determined that the composite image is desired by the user, the final composite image data 21 is obtained by operating the operation device 7 by the user. The recording medium 1 can also be configured to record.

  In the present embodiment, it has been described that the image processing apparatus 100 can be applied to an imaging apparatus such as a digital camera. However, a system to which the image processing apparatus is applied is not limited to the present embodiment. In addition, any system can be applied as long as it is a system that generates a desired composite image from a series of still images that are continuously shot at high speed.

  The embodiment of the present invention has been described above with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes various modifications within the scope of the present invention. It is.

DESCRIPTION OF SYMBOLS 100 ... Image processing apparatus 1 ... Recording medium (image recording part)
2. Media interface (I / F) section (image selection section)
3. Memory unit (image selection unit)
4 ... Composition processing unit (image composition unit)
5 ... Video interface (I / F) section (display section)
6. Display device (display unit)
7 ... Operation device (range specification input part)
8 ... CPU (image selection unit)
9 ... Composite image 10 ... Display screen 11 ... Knob (start position designation means)
12 ... Knob (End position designation means)
13 ... Display (start position designation means, end position designation means)
14: Continuous image data group 15: Continuous image data (still image)
16: Continuous image data (still images)
17 ... Continuous image data (still image, selected image)
18 ... Continuous shot image data (still image, selected image)
19 ... Selected image data group 20 ... Image composition processing 21 ... Composite image data (composite image)

Claims (7)

An image recording unit that records a series of still images taken continuously in time series;
A designated range that is a time-series range designated by the operator, out of a whole range that is a time-series range including a series of the plurality of still images that are operated by the operator and recorded in the image recording unit. A range specification input section for outputting specified range information representing
Based on the designated range information, a series of the plurality of still images included in the designated range is identified from among the series of the plurality of still images recorded in the image recording unit, and the identified series of the plurality of still images An image selection unit that selects a plurality of the still images that meet a predetermined condition from the still images, and reads each of the selected plurality of still images from the image recording unit as a selection image; ,
An image synthesis unit that generates a synthesized image obtained by synthesizing each of the selected images;
A display unit for displaying the composite image;
An image processing apparatus comprising: The range designation input unit is:
Start position specifying means for specifying the start position of the specified range;
An end position specifying means for specifying an end position of the specified range;
Comprising
When one or both of the start position specifying means and the end position specifying means is changed by the operator, the position information of the start position specifying means and the position information of the end position specifying means are Output as the specified range information,
The image selection unit
The designation from the position of the start position designation means to the position of the end position designation means based on the position information of the start position designation means and the position information of the end position designation means included in the designation range information Identifying a series of said still images included in a range;
The image processing apparatus according to claim 1. The range designation input unit is:
The specified range information is output every time one or both of the start position specifying means and the end position specifying means are changed by the operator,
The image selection unit
Each time the position information of the start position specifying means and the position information of the end position specifying means included in the specified range information is changed, a series of the still images are specified, and a predetermined condition A plurality of the still images that match, and read from the image recording unit as the selected image,
The image composition unit
Each time the selected image is read from the image recording unit, a combined image is generated by combining the selected images.
The display unit
Each time the composite image is generated, the composite image is displayed.
The image processing apparatus according to claim 2. As the condition, the number of the still images to be selected from the specified series of the still images is predetermined,
The image selection unit
Selecting each of the predetermined number of the still images so that the time at which the still images were taken are equally spaced in the designated range;
The image processing apparatus according to claim 3. As the condition, an interval of time at which the still image to be selected from the specified series of the still images is captured is determined in advance.
The image selection unit
Selecting each of the still images in which the time at which the still image was taken in the designated range is a predetermined time interval;
The image processing apparatus according to claim 3. Recorded in an image recording unit that is operated by an operator and records a series of still images taken continuously in time series, and within the entire range that is the time series range including the still images, A range specification input step for outputting specified range information representing a specified range that is a time-series range specified by an operator;
Based on the designated range information, a series of the plurality of still images included in the designated range is identified from among the series of the plurality of still images recorded in the image recording unit, and the identified series of the plurality of still images An image selection step of selecting a plurality of still images that meet a predetermined condition from the still images, and reading each of the selected plurality of still images from the image recording unit as a selected image; ,
An image synthesis step of generating a synthesized image obtained by synthesizing each of the selected images;
A display step for displaying the composite image;
An image processing method comprising: An imaging unit that outputs an image signal of a subject image;
An image signal processing unit that performs image processing on the image signal output from the imaging unit, and generates a series of still images that are continuously captured in time series;
An image recording unit that records a series of still images generated by the image signal processing unit;
A designated range that is a time-series range designated by the operator, out of a whole range that is a time-series range including a series of the plurality of still images that are operated by the operator and recorded in the image recording unit. A range specification input section for outputting specified range information representing
Based on the designated range information, a series of the plurality of still images included in the designated range is identified from among the series of the plurality of still images recorded in the image recording unit, and the identified series of the plurality of still images An image selection unit that selects a plurality of the still images that meet a predetermined condition from the still images, and reads each of the selected plurality of still images from the image recording unit as a selection image; ,
An image synthesis unit that generates a synthesized image obtained by synthesizing each of the selected images;
A display unit for displaying the composite image;
An imaging apparatus comprising:

Images