JP2005142696A - Still picture data generating apparatus and still picture data generating method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To generate still picture data which has high image quality and in the center of which a principal object is located from a plurality of image data consecutive in time series. <P>SOLUTION: A frame image data particularizing section 22 particularizes one optional frame image data from moving picture data MD acquired by a moving picture data acquisition section 21. A consecutive frame image data acquisition section 23 acquires frame image data consecutive to the particularized frame image data such as frame image data before/after the particularized frame image data by one frame. A principal object image data particularizing section 24 uses the particularized frame image data and the acquired consecutive frame image data to particularize principal object image data corresponding to the central object of the particularized frame image data. A still picture data generating section 26 uses the particularized principal object image data and decorative image data acquired by a decorative image data acquisition section 25 to generate still picture data. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a technique for generating (cutting out) still image data from a plurality of image data continuous in time series.

  The moving image data obtained by photographing with a video camera or the like is composed of a plurality of frame image data (or field image data) continuous in time series. The continuous shot image data obtained by continuous shooting with a digital still camera or the like is also composed of a plurality of image data continuous in time series as image files. A user designates a desired scene (scene) of such moving image data, and uses the image data of the designated scene as still image data, so that the moving image data, continuous image data, and the like are configured in time series. A technique for cutting out still image data from a plurality of continuous image data is known. When the moving image data is composed of a plurality of image data, frame image data corresponding to the designated scene is used as still image data.

  Also, a technique has been put to practical use in which image data is pasted on decorative image data, for example, frame type decorative image data, and an output image in which the image is surrounded by the decorative image is output on a paper medium. In this technique, when image data is pasted on decoration image data, layout control information including a script describing the arrangement position and arrangement size of the image data with respect to the decoration image data is used.

  The layout control information is associated with individual decoration image data, and the user simply selects the decoration image data and the image data to be pasted, and the image data resized to a predetermined size is displayed at a predetermined position of the decoration image data. An image pasted and surrounded by a decoration image can be obtained as an output image (see, for example, Patent Document 1).

JP 2000-165647 A

  However, in the conventional still image data cutout technology, since the cutout scene is determined by the user, it is not always possible to obtain still image data in which the main subject is located at the center. When there is a motion, there is a problem that blurring is conspicuous in the main subject in the cut out still image data.

  Furthermore, even though the moving image data is composed of a plurality of frame image data, only the frame image data corresponding to the scene specified by the user is used, and the still image is fully utilized by utilizing the characteristics of the moving image data. It could not be said that it was generating data.

  Therefore, there is a problem that even if the cut out still image data is pasted on the decoration image data, the main subject cannot be arranged at the center of the arrangement position, and an output result with high image quality cannot be obtained. .

  The present invention has been made to solve the above-described problem, and still image data having high image quality from a plurality of time-sequential image data such as moving image data and continuous-shot image data and having a main subject at the center. The purpose is to generate

  In order to solve the above-described problem, a first aspect of the present invention provides a still image data generation device that generates still image data from a plurality of image data continuous in time series. The still image data generation device according to the first aspect of the present invention includes a specifying unit that specifies one image data as specific image data from the plurality of image data continuous in time series, and an image continuous to the specific image data. A main subject image in the specific image data, using continuous image data acquisition means for acquiring data as continuous image data from the plurality of image data continuous in time series, the specific image data, and the continuous image data A main subject image data specifying unit for specifying data and a still image data generating unit for generating still image data having the specified main subject image data as a center.

  According to the still image data generation device according to the first aspect of the present invention, the main subject image data in the specific image data is specified using the specific image data and the continuous image data, and the specified main subject image data is Since still image data provided at the center can be generated, still image data with high image quality and a main subject located at the center is generated from a plurality of time-sequential image data such as moving image data or continuous shot image data. be able to.

  The still image data generation device according to the first aspect of the present invention further decorates the main subject image data and obtains decorative image data having an arrangement position of one or a plurality of the main subject image data. An acquisition unit, wherein the main subject image data is specified by specifying a slight change area in the specific image data using the specific image data and the continuous image data; The generation may be performed by extracting the main subject image data by cutting out the fine change region, and combining the extracted main subject image data with the arrangement position of the decoration image data.

  According to the still image data generation device according to the first aspect of the present invention, the main subject image data is specified by specifying the slight change region in the specific image data using the specific image data and the continuous image data. The still image data is generated by extracting the main subject image data by cutting out the slightly changed area and combining the extracted main subject image data with the arrangement position of the decoration image data. Therefore, main subject image data with less blur can be extracted and combined with decoration image data, and still image data capable of producing an output image with good image quality and appearance can be generated. The slight change region means a region where the degree of change is 0 or less than a predetermined value.

  In the still image data generation device according to the first aspect of the present invention, the image data is composed of a plurality of pixel data, and the specification of the slight change region is, among the pixel data constituting the specific image data, The continuous still image data may be executed by specifying an area composed of pixel data whose corresponding pixel data value change amount is a predetermined value or less as the fine change area. In such a case, it is possible to specify the slight change region based on the change amount of the pixel data, and the main subject image data can be extracted more accurately.

The still image data generation device according to the first aspect of the present invention further decorates the main subject image data and obtains decorative image data having an arrangement position of one or a plurality of the main subject image data. An acquisition means,
The main subject image data specifying means includes
Dividing means for dividing the specific image data into a plurality of blocks;
A moving amount calculating means for calculating a moving amount of each of the divided blocks in the continuous image data, wherein the main subject image is centered on a block having the moving amount smaller than a predetermined value among the plurality of blocks. Identify the data,
The generation of the still image data may be executed by extracting the main subject image data by cutting out the slight change area and combining the extracted main subject image data with the arrangement position of the decoration image data. good. In such a case, it is possible to specify the slightly changed area based on the movement amount of the block, and the main subject image data can be extracted more quickly.

  According to a second aspect of the present invention, there is provided a still image data generating device that generates still image data from a plurality of image data continuous in time series. The still image data generation device according to the second aspect of the present invention includes a specifying unit that specifies one scene as a specific scene from the plurality of image data continuous in time series, and another unit within a predetermined time from the specific scene. A main subject in the specific scene, using continuous scene acquisition means for acquiring a scene as a continuous scene from a plurality of image data continuous in time series, image information of the specific scene, and image information of the continuous scene And a still image data generating means for generating still image data centered on the specified main subject.

  According to the still image data generation device according to the second aspect of the present invention, the main subject in the specific scene is determined using the image information of the specific scene and the image information of another scene within a predetermined time from the specific scene. It is possible to generate still image data that is identified and includes the identified main subject at the center. Therefore, it is possible to generate still image data with high image quality and centered on the main subject from a plurality of time-sequential image data such as moving image data or continuous shot image data.

  A third aspect of the present invention provides a still image data generation method for generating still image data from a plurality of image data continuous in time series. In the still image data generation method according to the third aspect of the present invention, one image data is specified as specific image data from the plurality of image data continuous in time series, and the image data continuous to the specific image data is Acquired from a plurality of image data continuous in time series as continuous image data, using the specific image data and the continuous image data to identify main subject image data in the specific image data, the specified Still image data mainly including main subject image data is generated.

  According to the still image data generation method according to the third aspect of the present invention, it is possible to obtain the same functions and effects as those of the still image data generation apparatus according to the first aspect of the present invention. The still image data generation method according to the aspect can be realized in various aspects in the same manner as the still image data generation apparatus according to the first aspect of the present invention.

  According to a fourth aspect of the present invention, there is provided a still image data generation method for generating still image data from a plurality of image data continuous in time series. In the still image data generation method according to the fourth aspect of the present invention, one scene is specified as a specific scene from a plurality of image data continuous in time series, and another scene within a predetermined time from the specific scene is determined. Acquired from a plurality of image data continuous in time series as a continuous scene, using the image information of the specific scene and the image information of the continuous scene to identify a main subject in the specific scene, the specified main Still image data including a subject at the center is generated.

  According to the still image data generation method according to the fourth aspect of the present invention, it is possible to obtain the same operational effects as those of the still image data generation apparatus according to the second aspect of the present invention, and the fourth aspect of the present invention. The still image data generation method according to the aspect can be realized in various aspects similarly to the still image data generation apparatus according to the second aspect of the present invention.

  The still image data generation method according to the third and fourth aspects of the present invention can also be used as a still image data generation processing program and a computer-readable recording medium on which the still image data generation processing program is recorded. Can be realized.

  In the still image data generation device according to the first and second aspects of the present invention and the still image data generation method according to the third and fourth aspects of the present invention, the plurality of image data continuous in time series are: It may be moving image data.

  Hereinafter, an image processing apparatus and an image processing method according to the present invention will be described based on examples with reference to the drawings.

  An image processing system including a still image data generation device according to the present embodiment will be described with reference to FIG. FIG. 1 is an explanatory diagram illustrating a schematic configuration of an image processing system including a still image data generation device according to the present embodiment.

  The image processing system includes a digital video camera 11 (including a digital still camera capable of capturing moving images) as an input device for generating moving image data and a moving image data resource 10 including a server 12 on a network for storing moving image data. , A personal computer 20 as a still image data generating device that generates still image data from moving image data acquired from the moving image data resource 10, and a color printer 30 as an output device that outputs an image using the generated still image data It has. The color printer 30 may have a still image data generation function provided in the personal computer 20, and in such a case, the still image data generation processing, image processing, and image output can be executed in a stand-alone manner. . As the output device, in addition to the printer 30, a monitor 25 such as a CRT display or LCD display, a projector, or the like can be used. In the following description, it is assumed that the color printer 30 that is connected to the personal computer 20 is used as an output device.

  The personal computer 20 is a computer of the type generally used, and a central processing unit (still image data generating process for generating still image data from moving image data, and a central processing unit for executing each processing operation including image processing ( CPU) 200, input moving image data, generated still image data, random access memory (RAM) 201 for temporarily storing various data such as calculation results, and still image data are generated using moving image data. A hard disk (HDD) 202 (or read-only memory (ROM)) for storing various control programs including a program for the above. In addition, the personal computer 20 includes an input / output terminal (digital terminal, analog terminal) 203 for connecting a connection cable from the digital video camera 11 or the like, and a memory card slot for mounting a memory card. May be provided.

  In this embodiment, the personal computer 20 further stores decoration image data for generating still image data by decorating main subject image data cut out from moving image data, and layout control information in the HDD 202. The decoration image data is, for example, frame image data, album mount image data to which a plurality of main subject image data is pasted, and may be either bitmap data or vector data. The layout control information defines the arrangement position and arrangement size of the main subject image data with respect to the decoration image data and is associated with the decoration image data, and defines the arrangement position and arrangement size of the main subject image data with respect to the decoration image data. It is described by a script.

  The digital video camera 11 is a camera that acquires a moving image by imaging light information on a digital device (a photoelectric conversion element such as a CCD or a photomultiplier tube), such as a CCD for converting optical information into electrical information. A photoelectric conversion circuit, a moving image data generation circuit for controlling the photoelectric conversion circuit to generate digital moving image data, an image processing circuit for processing the generated digital moving image data, and the like. The digital video camera 11 stores the acquired digital moving image data in a recording medium such as a magnetic tape or an optical recording medium as a storage device. The data format of moving image data in the digital video camera 11 is generally a DV format composed of 30 image data (still image data) per second. In addition, an MPEG2 format that realizes high compressibility by storing reference image data and a motion vector (difference information) for the reference image data is known. In addition to this, it goes without saying that various data formats such as AVI and MPEG1 can be used. As described above, in this embodiment, the moving image data MD is moving image data formed from a plurality of frame image data arranged in time series, reference image data, and a moving image formed from difference information with respect to the reference image data. It means both image data and moving image data that can extract a specific scene based on time information. That is, the moving image data MD composed of a plurality of frame image data includes moving image data that can extract still image data of a specific scene (time) in addition to a plurality of frame image data arranged in time series. means.

  The server 12 stores the moving image data uploaded by the user and the moving image data provided by the content provider in the hard disk drive. The server 12 distributes moving image data via a network in response to a request from the personal computer 20 that is a still image data generation device.

  The moving image data generated in the digital video camera 11 is transferred to the personal computer 20 via, for example, a cable CV or a memory card. Still image data generated by the personal computer 20 is sent to the color printer 30 via the cable CV. Alternatively, if the printer 30 has a function for generating still image data, the memory card storing the moving image data in the digital video camera 11 is attached to the printer 30, so that the moving image data is transferred to the color printer 30. Transferred. In the following description, a case where image processing for image data is executed by the personal computer 20 and processed image data is output to the color printer 30 will be described.

  The color printer 30 is a printer capable of outputting a color image. For example, four color inks of cyan (C), magenta (M), yellow (Y), and black (K) are ejected onto a print medium. This is an ink jet printer that forms an image by forming a dot pattern. Alternatively, it is an electrophotographic printer that forms an image by transferring and fixing color toner onto a printing medium. In addition to the above four colors, light cyan (light cyan, LC), light magenta (light magenta, LM), red, and blue may be used as the color ink.

Still image data generation processing in the personal computer 20:
With reference to FIG. 2, an outline of a functional configuration of the personal computer 20 will be described. FIG. 2 is a functional block diagram of the personal computer 20 (CPU 200) according to the present embodiment. In the following description, moving image data is used as an example of a plurality of image data continuous in time series. In addition to this, continuous image data obtained by continuously capturing images may be included as the plurality of image data continuous in time series.

  The personal computer 20 acquires the moving image data MD composed of a plurality of frame image data in the moving image data acquisition unit 21, and frames one arbitrary scene (one frame image data) from the acquired moving image data MD. The image data specifying unit 22 specifies the image data. The personal computer 20 acquires a frame image continuous with the specified frame image data, for example, frame image data of around one frame in the continuous frame image data acquisition unit 23.

The personal computer 20 uses the specified frame image data and the acquired continuous frame image data to specify main subject image data corresponding to the central subject of the specified frame image data in the main subject image data specifying unit 24. . The personal computer 20 generates still image data GD in the still image data generation unit 26 using the identified main subject image data and the decoration image data and layout control information acquired in the decoration image data acquisition unit 25. .

  A still image data generation process executed in the personal computer 20 according to the present embodiment will be described with reference to FIGS. FIG. 3 is a flowchart showing a processing routine of still image data generation processing executed in the personal computer 20 according to the present embodiment. FIG. 4 is a flowchart showing a processing routine executed for specifying main subject image data. FIG. 5 is an explanatory diagram illustrating an example of the decoration image data at the time of image output (when the image buffer is developed). FIG. 6 is an explanatory diagram schematically showing frame image data divided into a plurality of blocks. FIG. 7 is an explanatory diagram schematically showing frame image data corresponding to the specified frame (I). FIG. 8 is an explanatory diagram showing the frame image data corresponding to the frame (I + 1) next to the specified frame (I) and the block movement. FIG. 9 is an explanatory diagram showing a specific example of frame image data corresponding to the frame (I). FIG. 10 is an explanatory diagram showing a specific example of frame image data corresponding to the frame (I + 1). FIG. 11 is an explanatory diagram schematically showing main subject image data (region) obtained from the frame (I) shown in FIG. 8 and the frame (I + 1) shown in FIG. FIG. 12 is an explanatory diagram showing another specific example of frame image data corresponding to the frame (I). FIG. 13 is an explanatory diagram showing another specific example of frame image data corresponding to the frame (I + 1). FIG. 14 is an explanatory diagram schematically showing main subject image data (region) obtained from the frame (I) shown in FIG. 11 and the frame (I + 1) shown in FIG. FIG. 15 is an explanatory diagram illustrating an example of still image data GD generated by the personal computer 20 according to the present embodiment. Note that the image example of each image data conceptually shows the state when being developed on the image buffer.

  The still image data raw processing executed in the present embodiment is started, for example, when a memory card is attached to the personal computer 20 or when the digital video camera 11 is connected to the personal computer 20 via a communication cable. Alternatively, it may be executed when a still image data generation process is instructed by the user via a keyboard or the like.

  When starting the still image data generation process, the personal computer 20 (CPU 200) acquires the decoration image data SD selected by the user and temporarily stores it in the RAM 201 (step S100). The decoration image data SD is selected, for example, by displaying the decoration image data SD stored in the HDD 202 in advance on the personal computer 20 as a selection candidate on the display 25, and selecting among the selection candidates displayed via a keyboard or the like. Or may be selected via a network. Alternatively, decoration image data may be stored in advance in the digital video camera 11 and performed on the digital video camera 11.

  The decorative image data SD has, for example, the form shown in FIG. 5 when outputting an image (when developing an image buffer), and one or a plurality of arrangement positions L1 and L2 for pasting the main subject image data OD are prepared. .

  The decoration image data SD is exchanged in the form of a decoration image file FF including the decoration image data SD and layout control information. The layout control information defines arrangement position information (for example, coordinate information) at which the main subject image data OD is to be arranged, and defines the arrangement size (resizing size) of the main subject image data OD at the arrangement position. The layout control information further describes α channel data. The α channel data is, for example, each gradation value (R, G, and R) of image data (for example, decoration image data SD) positioned on the upper side and image data (for example, main subject image data OD) positioned on the lower side during image synthesis. (B data value) is relatively adjusted to determine the transparency of the image data located on the lower side with respect to the upper image data. For example, if the coefficient α is applied to the R, G, B data of the upper image data, the coefficient (1-α) is applied to the R, G, B data of the lower image data. When the value is 255, the lower image data does not appear in the synthesized image (non-transparent), and when it is 0, the lower image data appears completely in the synthesized image (transparent). A semi-transparent decoration effect can be obtained by using an arbitrary value in the range of 0 to 255.

  Subsequently, the CPU 200 acquires the selected moving image data MD and temporarily stores it in the RAM 201 (step S110). The moving image data MD is selected, for example, on the personal computer 20 via a keyboard or the like, and one or more moving image data MD can be selected. In general, the decoration image data SD is selected (determined), and subsequently, the moving image data MD for cutting out the main subject image data OD is selected.

  CPU 200 identifies cut-out frame image data KD from the acquired moving image data MD (step S120). The frame image data to be clipped is generally designated by the user via an input device such as a keyboard or a mouse, and the CPU 200 specifies the clipped frame image data KD by the frame number and time based on the inputted designation information. . The user reproduces the moving image data MD, displays it on the monitor 25, and uses the functions such as frame advance, frame return, and pause to cut out the position (frame position, frame number, frame time) that is desired to be the still image data GD. That is, the cut-out frame image data KD is designated. Note that the frame image data in this embodiment means a plurality of still image data constituting the moving image data MD, and is dynamically generated using reference image data, difference information, and time information. It also means still image data and a plurality of image data continuous in time series obtained by continuous shooting.

  When the moving image data MD has a DV format composed of a plurality of frame image data (still image data), the designation of the frame image data by the user directly specifies the cut-out frame image data KD. On the other hand, when the moving image data MD has an MPEG2 format including a P picture and a B picture having only difference information with respect to the reference frame (I picture) and the I picture, the frame image data designated by the user is The moving image data MD does not exist as frame image data. Therefore, the CPU 200 generates cut-out frame image data KD from the reference frame (I picture) based on the difference information using time information corresponding to the frame image data designated by the user.

  When the cut-out frame image data KD is specified, the CPU 200 acquires continuous frame image data RD continuous with the cut-out frame image data KD (step S130). The continuous frame image data RD is acquired from the frame image data corresponding to the previous (I-1) or next (I + 1) frame number when the frame number of the cut-out frame image data KD is I. In this embodiment, frame image data corresponding to the next frame number is acquired as continuous frame image data RD.

  The CPU 200 specifies main subject image data OD corresponding to the subject image that is the center of shooting in the cutout frame image using the cutout frame image data KD and the continuous frame image data RD (step S140). In this specifying process, a motion vector is used to specify a region (pixel data, block pixel data) with little motion in the cut-out frame image data KD in comparison with the continuous frame image data RD, and the specified region is identified as main subject image data. Treat as.

The main subject image data OD specifying process will be described in detail with reference to FIG. The CPU 200 divides the cut-out frame image data KD (frame (I)) into a plurality of blocks BLK _k composed of m × n pixel data as shown in FIG. For example, the same number of vertical and horizontal divisions may be performed from about 8 × 8 to 16 × 16 so that the aspect ratio of the frame and the block is the same, and the vertical and horizontal divisions may be performed by different numbers. The greater the number of divided blocks, the higher the accuracy of specifying the main subject image data. In particular, in a zoom / wide scene (frame), since there is almost no movement of the main subject, it is desirable that the number of divided blocks be large.

The CPU 200 initializes the block number (k) (step S200), and the continuous frame image data RD (frame (I + 1) shown in FIG. 8 of the block BLK _{k in} the cut-out frame image data KD (frame (I)) shown in FIG. )) calculates the movement amount BV _k for (step S210).

An example of a method for calculating the movement amount BV _k will be described below.
-The pixel value of the coordinates (x, y) of the frame (I) is P0 (x, y)
The pixel value of the coordinate (x, y) of the frame (I + 1) is P1 (x, y)
The coordinate movement amount of the block BLK in the frame (I + 1) is (dx, dy)
The pixel value of the coordinate (x + dx, y + dy) after the movement of the block BLK in the frame (I + 1) is P1 (x + dx, y + dy)
BVref = Cmax / 20, where the movement threshold is BVref and the longest dimension of the vertical and horizontal dimensions of the cut-out frame image data is Cmax.
And Note that the coordinates (x, y) indicate coordinates in the entire frame image data.

  The CPU 200 calculates a pixel difference value DIF (dx, dy) between the pixel value P0 (x, y) and the pixel value P1 (x + dx, y + dy) from the following equation (1).

DIF (dx, dy) = Σabs (P0 (x, y) −P1 (x + dx, y + dy)) Equation (1)
coordinates of all pixels of x, y ∈ BLK _k

Specifically, the CPU 200 sequentially applies dx and dy to the formula (1) in the range of −BVref <dx, dy <BVref, and the minimum coordinate movement amount that minimizes DIF (dx, dy) ( dxmin, dymin). Therefore, (x + dxmin, y + dymin) is the coordinate of the movement destination in the frame (I + 1) of the coordinate (x, y) in the block BLK _k in the frame (I).

The CPU 200 obtains the movement amount BV _k of the block BLK from the following equation (2).

BV _k = (dxmin ² + dymin ² ) ^1/2 formula (2)

CPU200 movement amounts BV _k calculated block BLK _k is equal to or determined threshold value BVref more (step S220). That is, it is determined whether or not the movement amount BV _{k of} the target block BLK _k is within a range that can be regarded as not moving. That is, it is determined whether or not the movement amount of the block BLK _k is 0 or slightly fluctuates (fine change).

If the CPU 200 determines that BV _k ≧ BVref (step 220: Yes), it adds a movement mark to the block BLK _k (step S230), and proceeds to step S240. On the other hand, when it is determined that BV _k ≧ BVref is not satisfied (step 220: No), the CPU 200 proceeds to step S240 without attaching a movement mark.

  The CPU 200 determines whether or not the process of determining the movement amount BV is completed for all the blocks except the peripheral area block PBLK (step S240), and when it is determined that the process is completed (step S240: Yes), this processing routine To return to the process of the flowchart of FIG. Excluding the peripheral area block PBLK, the main subject is generally captured at the center of the image data, and the image data of the peripheral area is moved in the frame image data before and after the main object moves. This is because the possibility of disappearance is high.

If the CPU 200 determines that the process of determining the movement amount BV is not completed for all the blocks except the peripheral area block PBLK (step S240: No), it updates the number k of the block BLK _k (step S250). Then, the processes of steps S210 to S240 are executed for the next block BLK _{k + 1} .

Returning to FIG. 3 and continuing the description, the CPU 200 executes a trimming process on the cut-out frame image data KD with the identified main subject image data OD as the center (step S150). The trimming process will be described in detail. As described above, among the blocks BLK _k of the cutout frame image data KD (frame (I)), the block BLK _k which is determined to be moving in successive frame image data RD (frame (I + 1)) , Move mark is set. Therefore, an area with less motion in the cut-out frame image data KD (frame (I)) centered on the block BLK _k without a movement mark is _obtained . In addition, the center of the region with little motion in the cut-out frame image data KD (frame (I)) is _obtained as the center of the minimum rectangle including the block BLK _k without the movement mark, for example.

A description will be given based on a specific example with reference to FIGS. FIGS. 9 to 11 are examples when the main subject moving is photographed, and FIGS. 12 to 14 are examples when the main subject is zoomed. When the main subject moves, the image is generally taken so that the main subject is located at the center of the image, that is, the position of the main subject does not move. As a result, as shown in FIGS. 9 and 10, the area position of the main subject image data OD in the cut-out frame image data KD and the area position of the main subject image data OD in the continuous frame image data RD are substantially the same. As a result, the block BLK _k without the movement mark becomes a block BLK ′ indicated by hatching, and the image data of the area formed by these blocks BLK ′ is trimmed as the main subject image data OD. The centers of these blocks BLK ′ are as indicated by the solid black circles.

  When the main subject is zoomed, the main subject does not move from the center of the image, and the area occupied by the main subject in the image increases. As a result, as shown in FIGS. 12 and 13, the center position of the main subject image data OD in the cut-out frame image data KD and the center position of the main subject image data OD in the continuous frame image data RD are the same. As a result, the block BLK to which no movement mark is attached becomes a block BLK ′ indicated by diagonal lines, and the image data of the area formed by these blocks BLK ′ is trimmed as the main subject image data OD. The centers of these blocks BLK 'are as indicated by the solid black circles.

  The CPU 200 determines whether or not trimming of the desired (requested) main subject image data OD has been completed (step S160), and if it is determined that there is still main subject image data OD to be trimmed (step S160). S160: No), the main subject image data OD already obtained is stored in the RAM 201, and the processes of steps S120 to S150 are executed. When a plurality of moving image data MD is selected, it may be considered that a plurality of main subject image data OD is desired to be trimmed from the same moving image data MD.

  When the CPU 200 determines that the main subject image data OD to be trimmed does not exist (step S160: Yes), the CPU 200 uses the main subject image data OD and the decoration image data SD obtained by the trimming to display the still image shown in FIG. Image data GD is generated (step S170).

  The generation of the still image data GD is performed as follows, for example. The CPU 200 interprets the script about the arrangement position and the arrangement dimension described in the layout control information, determines the arrangement position and the arrangement dimension of the main subject image data OD with respect to the decoration image data SD according to the interpretation result, and the α channel. The gradation value of the decoration image data SD is determined based on the data, and the two image data are synthesized (superposed). The combination of the decoration image data SD and the main subject image data OD may be executed so that the center of the arrangement position of the decoration image data SD coincides with the center of the main subject image data. Further, the CPU 200 may resize (reduce or enlarge) the size of the captured image data in accordance with the arrangement size for each arrangement position described in the script.

  The CPU 200 outputs the generated still image data GD to the printer driver and the display display driver (step S180), and ends this processing routine. In the printer driver, RGB-CMYK color conversion processing using a lookup table or the like, halftone processing, and the like are executed. For example, output image data is output to the printer 30 as raster data with a print control command. As a result, an output image of still image data in which one or a plurality of main subject image data cut out from the moving image data MD is arranged is obtained.

  As described above, according to the personal computer 20 as the still image data generation apparatus according to the present embodiment, the moving image data MD is constituted by the block BLK with less motion using the two consecutive frame image data. The image data of the area can be cut out as main subject image data OD to be the center of the output image and pasted on the decoration image data SD to generate still image data GD. As a result, it is possible to cut out the subject image data OD with less blurring, and the output image of the still image data GD generated by being pasted on the decoration image data SD can also have a good appearance.

  In addition, the user can obtain a good-looking still output image only by selecting one frame image data including a main subject desired to be cut out.

Other examples:
In the above embodiment, all the coordinates (x, y) in the block BLK _k of the frame (I) are used to specify the main subject image data OD using the cut-out frame image data KD and the continuous frame image data RD. However, the vertical and horizontal directions of the block BLK _k may be divided into 8 to 16, and the above-described movement distance BV _k may be calculated for 64 to 256 lattice points. In such a case, the movement amount of the block BLK _k can be calculated with a smaller calculation amount, and as a result, the main subject image data is trimmed at a higher speed (trimming main subject image data with less blur). be able to.

  In the above-described embodiment, the case where the main subject image data OD cannot be specified, that is, the case where there are few or no moving regions (slightly changing regions) in the cut-out frame image data KD is not described in detail. In such a case, only the central area of the cut-out frame image data KD may be trimmed, or the main subject image data OD may not be trimmed. Under this condition, it is difficult to trim the main subject image data KD with less blur, but there may be a demand for trimming the main subject image data OD regardless of the blur. On the other hand, when there are few slight change area images, high quality still image data GD cannot be generated, and therefore it is preferable not to perform trimming of main subject image data OD.

The method for calculating the motion vector of the block BLK _k in the above embodiment is merely an example, and it goes without saying that the movement amount BV _k of the block BLK _k can be calculated by various other known methods. For example, the coordinates having the pixel value closest to the pixel value P0 (x, y) of the coordinates (x, y) of the block BLK _k in the frame (I) may be searched from all the pixel data of the frame (I + 1). That is, it is only necessary that the main subject image data can be specified using two pieces of continuous image information included in the moving image data MD.

  In the above embodiment, the description has been made on the assumption that two (a plurality of) main subject image data OD is arranged for one decoration image data SD. One main subject image data OD may be arranged, or one or a plurality of main subject image data OD may be arranged in a plurality of decoration image data SD. In any case, it is possible to obtain a still image including a main subject image with less blur and good appearance as an output image.

  In the above embodiment, the main subject image data OD is enlarged / reduced so that the proportion of the main subject image data OD at each arrangement position of the decoration image data SD is, for example, 70% or more in area ratio. May be. This process may be described in advance in the layout control information, or may be executed by the user's designation.

  In the above embodiment, when the main subject image data OD and the decoration image data SD are combined, the position and size of the main subject image data OD at the arrangement position of the decoration image data SD may be adjustable by the user. For example, in the cut-out frame image data KD, when the main subject image data GD is close to the end and a blank is formed when pasted on the decoration image data SD, the user keeps it as it is or keeps the center. The main subject image data OD may be enlarged.

  In the above embodiment, the digital video camera 11 is used as the image data generating device, but a digital still camera may be used. That is, in the above embodiment, moving image data is used as a plurality of image data that is continuous in time series, but in addition to this, in a digital still camera, it is continuous in time series that was shot in so-called continuous shooting mode. A plurality of continuous still image data (continuously shot image data) may be used. In such a case, for example, continuous image data can be used instead of moving image data by performing grouping such as handling a plurality of image data shot in the continuous shooting mode as one file. . Even when continuous shot image data is used, since it is continuous in time series, the main subject can be easily and appropriately cut out using the above-described method. Note that the continuous shot image data is preferably continuous within a predetermined time interval.

  In the above embodiment, the still image data generation processing is executed using the personal computer 20 as the still image data generation device. In addition, for example, a stand-alone printer having a still image data generation function, A display device may be used as a still image data generation device. In this case, the still image data generation process is executed in a printer or a display device. Further, it can be realized as a printer driver, a video driver, and a still image data generation processing application (program) without a hardware configuration such as a still image data generation device. Here, the display device includes, for example, a CRT, a liquid crystal display, a projector, and the like.

  Further, all or part of the still image data generation processing executed by the personal computer 20 may be executed by the digital video camera 11. In this case, the moving image editing application stored in the ROM or the like of the digital video camera 11 is provided with the still image data generation processing function described in the present embodiment. Printing data including a printing control command generated by the digital video camera 11 and printing still image data is provided to the printer 30 via a cable or via a memory card. The printer 30 that has received the print data forms a dot pattern on the print medium according to the print data and outputs an image. Note that the digital video camera 11 may provide still image data to the personal computer 20 or the printer 30. In such a case, print data including a print control command is generated in the personal computer 20 or the printer 30.

  In the above embodiment, the still image data generation processing is executed in the form of still image data generation processing software, that is, a computer program, but still image data writing including a logic circuit for executing each processing (step) described above. It may be performed using processing hardware circuitry. In such a case, the load on the CPU 200 can be reduced, and higher-speed still image data generation processing can be realized. The still image data generation processing hardware circuit can be implemented as an implementation circuit for the digital video camera 11 and the printer 30 and an add-on card for the personal computer 20, for example.

  As described above, the still image data generation device, the still image data generation method, and the still image data generation program according to the present invention have been described based on the embodiments. However, the embodiments of the present invention described above facilitate the understanding of the present invention. Therefore, the present invention is not limited thereto. The present invention can be changed and improved without departing from the spirit and scope of the claims, and it is needless to say that the present invention includes equivalents thereof.

FIG. 1 is an explanatory diagram illustrating a schematic configuration of an image processing system including a still image data generation device according to the present embodiment. It is a functional block diagram of the personal computer 20 (CPU200) which concerns on a present Example. It is a flowchart which shows the process routine of the still image data generation process performed in the personal computer 20 which concerns on a present Example. It is a flowchart which shows the process routine performed in order to specify main subject image data. It is explanatory drawing which illustrates the one aspect | mode of the decoration image data at the time of image output (at the time of image buffer expansion | deployment). It is explanatory drawing which shows typically the frame image data divided | segmented into the several block. It is explanatory drawing which shows typically the frame image data corresponding to the specified flame | frame (I). It is explanatory drawing which shows the mode of the movement of a block while showing the frame image data corresponding to the flame | frame (I + 1) following the identified flame | frame (I). It is explanatory drawing which shows the specific example of the frame image data corresponded to flame | frame (I). It is explanatory drawing which shows the specific example of the frame image data corresponded to a frame (I + 1). FIG. 11 is an explanatory diagram schematically showing main subject image data (region) obtained from a frame (I) shown in FIG. 9 and a frame (I + 1) shown in FIG. 10. It is explanatory drawing which shows the other specific example of the frame image data corresponded to flame | frame (I). It is explanatory drawing which shows the other specific example of the frame image data corresponding to a frame (I + 1). FIG. 14 is an explanatory diagram schematically showing main subject image data (region) obtained from the frame (I) shown in FIG. 12 and the frame (I + 1) shown in FIG. 13. It is explanatory drawing which shows an example of the still image data GD produced | generated by the personal computer 20 which concerns on a present Example.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Moving image data resource 11 ... Digital video camera 12 ... Server 20 ... Personal computer 25 ... Monitor 200 ... Central processing unit (CPU)
201: Random access memory (RAM)
202: Hard disk (HDD)
203 ... Input / output terminal 30 ... Printer

Claims (9)

A still image data generation device for generating still image data from a plurality of image data continuous in time series,
Specifying means for specifying one image data as the specified image data from the plurality of image data;
Continuous image data acquisition means for acquiring image data continuous to the specific image data from a plurality of image data continuous in time series as continuous image data;
Main subject image data specifying means for specifying main subject image data in the specific image data using the specific image data and the continuous image data;
A still image data generating device comprising: still image data generating means for generating still image data centered on the identified main subject image data. The still image data generation device according to claim 1 further includes:
Decoration image data acquisition means for acquiring decoration image data including decoration positions of the main subject image data and decorating the main subject image data;
The identification of the main subject image data is executed by identifying a slight change area in the specific image data using the specific image data and the continuous image data.
The generation of the still image data is performed by extracting the main subject image data by cutting out the fine change region, and combining the extracted main subject image data with the arrangement position of the decoration image data. Image data generation device. The still image data generation device according to claim 2,
The image data is composed of a plurality of pixel data,
The specification of the slight change area is an area constituted by pixel data in which the amount of change in the value of the corresponding pixel data in the continuous still image data is equal to or less than a predetermined value among the pixel data constituting the specific image data. A still image data generation device that is executed by specifying as a slight change region. The still image data generation device according to claim 1 further includes:
Decoration image data acquisition means for acquiring decoration image data including decoration positions of the main subject image data and decorating the main subject image data;
The main subject image data specifying means includes
Dividing means for dividing the specific image data into a plurality of blocks;
A moving amount calculating means for calculating a moving amount of each of the divided blocks in the continuous image data;
The main subject image data is identified centering on a block in which the movement amount is smaller than a predetermined value among the plurality of blocks,
The generation of the still image data is performed by extracting the main subject image data by cutting out the fine change region, and combining the extracted main subject image data with the arrangement position of the decoration image data. Image data generation device. A still image data generation device for generating still image data from a plurality of image data continuous in time series,
Specifying means for specifying one scene as a specific scene from a plurality of image data continuous in time series;
Continuous scene acquisition means for acquiring other scenes within a predetermined time from the specific scene from a plurality of image data continuous in the time series as a continuous scene;
Main subject specifying means for specifying a main subject in the specific scene using the image information of the specific scene and the image information of the continuous scene;
A still image data generating device comprising: still image data generating means for generating still image data having the identified main subject as a center. A still image data generation method for generating still image data from a plurality of image data continuous in time series,
One image data is specified as specific image data from the plurality of image data,
The image data continuous to the specific image data is acquired as a continuous image data from a plurality of image data continuous in the time series,
Using the specific image data and the continuous image data, specify main subject image data in the specific image data,
A still image data generation method for generating still image data mainly including the identified main subject image data. A still image data generation method for generating still image data from a plurality of image data continuous in time series,
One scene is identified as a specific scene from a plurality of image data continuous in time series,
Other scenes within a predetermined time from the specific scene are acquired from a plurality of image data continuous in the time series as a continuous scene,
Using the image information of the specific scene and the image information of the continuous scene, the main subject in the specific scene is specified,
A still image data generation method for generating still image data having the identified main subject as a center. In the still image data generation device according to any one of claims 1 to 5,
The still image data generation device, wherein the plurality of pieces of image data continuous in time series are moving image data. In the still image data generation method according to claim 6 or 7,
The still image data generating method, wherein the plurality of pieces of image data continuous in time series are moving image data.

Images