JP3041360B2 - Generating moving images - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION [Industrial Application Field] The present invention relates to a moving image information material (hereinafter, referred to as a cut).
When editing electronically on a computer by arranging and connecting or exchanging images, even users who do not wait for specialized knowledge and expertise can obtain high-quality movies and other moving images. The present invention relates to a method for generating moving image information capable of creating a cut.

[Conventional technology]

Conventionally, a method of creating data of a moving image cut includes:
There were the following two methods. The first is a method of creating using computer graphics.
Is a method of taking a picture with a video camera and accumulating continuous frames as image data. Here, a cut is a group of one-divided images forming one scene from the beginning to the end of a certain operation in a moving image such as a video or a movie.

In the first method, first, an object to be photographed (object) is created as three-dimensional shape data, and the object, illumination, and the like are arranged in a pseudo space in a computer to determine a viewpoint. Later, calculations of light, irradiation, and reflection are performed. Then, by reproducing the state of the pseudo space viewed from the viewpoint, this is stored as image data. Next, this calculation is repeatedly performed while gradually arranging the object and the viewpoint in the pseudo space, and accumulating each calculation result as image data to form a plurality of continuous frames.

Further, in the second method, a real scene or a person is actually photographed using a video camera or the like, and the photographed natural moving image is digitized and captured in a frame unit on a computer, and each frame is captured. It is stored as image data and is made into a plurality of continuous frames.

References relating to the operation of moving image information include, for example, “Technical Report of the Institute of Electronics, Information and Communication Engineers” IE89-6.pp.49-5
Some are listed in 6.

[Problems to be solved by the invention]

In the first method, it is extremely difficult to create three-dimensional shape data on a graphic display using a computer, except when it can be created by a simple combination of basic figures. That is, there are the following problems.

(I) It is difficult to create a composition in which an object having a complicated shape is projected. That is, in general, when creating a cut using graphics, it is easy to create a two-dimensional image, but it is very difficult to create a three-dimensional image on a screen, which requires a great deal of labor and time. .

On the other hand, the second method has the following problem.

(Ii) Vibration (shake) of the camera during shooting is likely to occur.

(Iii) The speed of the pan operation for changing the direction of the optical axis of the camera at the time of photographing is uneven.

(Iv) The speed of the zoom operation for changing the viewing angle of the camera at the time of photographing varies.

(V) The composition is inappropriately cut. In other words, there may be a case where the entire image is not shown or a composition in which a desired target object is omitted.

(Vi) The cut length is too short or too long. That is, it is conceivable that the time is too short and the last scene is not included, or the time is too long and an extra scene is included.

Among the above-mentioned problem items, (ii) to (iv) are problems of the image quality of moving images depending on the skill of the operator who operates the camera, and images handled by an operator with a low skill are jerky images. Become. Therefore, these are problems regardless of whether the edited moving image data is edited or not.

On the other hand, the above (v) and (vi) are due to a lack of prior study and planning when photographing. Specifically, it is a problem that occurred because it was not possible to accurately grasp the relationship between the entire image of the scenario and a specific cut at the time of shooting the cut, and usually the majority of the scenario is completed by connecting the cuts Until then, the problem is often not found. For this reason, in the second method, it is necessary to frequently retake images.

The purpose of the present invention is to solve these conventional problems and, as in the case of shooting using advanced camera operation technology,
It is an object of the present invention to provide a method of generating moving image information that can easily obtain a moving image that is easy to see and expressive and that can easily create a high-quality cut.

[Means for solving the problem]

In order to achieve the above object, the method for generating moving image information according to the present invention comprises the steps of: (i) when instructed to cut out a plurality of images from arbitrary different regions on the original image, the processing apparatus Generating moving image information by performing clipping, enlarging or reducing each clipped image to a predetermined size, and using the processed images as frames to continuously connect a plurality of frames. There is a feature. (Ii) In the processing device, an area to be cut out from the original image to create the first and last frames of the moving image to be created and the number of frames included in the moving image to be created are designated. Then, based on the area and the number of frames, the clipping positions of consecutive frames are sequentially determined, and clipping processing is executed at each of the determined positions to create moving image information. There is. Also, (iii) the processing device
In order to create an arbitrary number of frames included in a moving image to be created, an area to be cut out from the original image, a frame number indicating the number of the frame of the moving image to be created in each area, and There is also a feature in specifying. (Iv) When the cutout path between the first and last frames is specified, the processing device determines the position of an arbitrary point in the image cutout area on the original image based on the specified path. There is also a feature in that the position is set and the positions at which continuous frames are cut out are sequentially determined. (V) When the moving rate of each cut image between the first and last frames is specified, the processing device specifies the position of an arbitrary point in the image cut area on the original image. It is also characterized in that it is set on the basis of the moving rate and the positions at which continuous frames are cut out are sequentially determined. (Vi)
When the size change rate of each cut image between the first and last frames is specified, the processing device determines the size of the cut area of each image on the original image based on the specified size change rate. It is also characterized in that the size of a region to be cut out of a continuous frame is sequentially determined. (Vii)
When the size of the region from which the image is cut is changed, the processing device sets the position of the region from which the image is cut so that a predetermined point on the original image is always displayed at a point on the moving image created by the change. There is also a feature in setting. Also, (viii) the processing device is characterized in that, when the specified moving image information is generated, the generated moving image information is immediately reproduced and each frame is continuously reproduced. Further, (ix) the processing device is characterized in that, when continuously reproducing a plurality of pieces of generated moving image information, the order of each frame is changed and reproduced.

[Action]

In the present invention, a user first inputs image data to be used as an original image to a computer, and then instructs to generate a cut from the original image. The computer cuts out a part of the original image according to the user's instruction, enlarges or reduces the cut out image, converts it into an image of a fixed size (corresponding to a frame), and stores it. This process is called the frame in the cut.
By repeating the same number of times as the number of programs, a cut of the moving image is generated.

Thus, by moving the position of the region cut out from the original image at a constant speed or while changing the speed smoothly, a pan operation without speed unevenness can be performed. Further, by changing the size of the region cut out from the original image at a constant speed or while changing the speed smoothly, a zoom operation without speed unevenness can be performed. Furthermore, since a cut can be generated at any time and can be reproduced and confirmed immediately, a cut having a composition and a length suitable for the entire scenario can be created while editing the cut. In addition, since a natural image captured from a camera or the like can be used as an original image, a composition having a shape that is difficult to create with computer graphics can be easily created.

〔Example〕

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 4 is a schematic diagram showing a flow of a moving image information generating process according to the present invention, and FIG. 11 is an auxiliary explanatory diagram of FIG.

In FIG. 4, reference numeral 401 denotes a moving image cut editor indicating editing information on an original image designated by a user; 403, a cut generation command created by a program; and 405, an N frame created by the command. This is the file where the cut is stored.

First, the user interactively defines a cut to be created on the moving image cut editor 401. That is, an area to be cut out to create a frame of a moving image to be created is specified for the original image displayed on the display screen. For this purpose, (1) start frame designation, (2) end frame designation, (3) frame number designation, (4) zoom speed designation,
(5) Perform pan speed and route specification.

The user-defined cut input by the moving image cut editor 401 is converted into a cut generation command of a frame 403 by an arrow 402. Arrow 404 based on the cut generation command 403
Executes the cut generation processing. That is, based on the cut generation command 403, a specified area is cut out from the original image, and image size conversion processing for enlarging or reducing the area to an image of a predetermined size is executed. It is stored in the file 405 as a moving image frame. Then, when a cut is generated, the stored frame image data is immediately displayed continuously to reproduce the cut as a moving image.

In this manner, the cut is generated by the arrow 404, and the cut data stored in the file 405 is immediately reproduced on the display screen in response to the user's request. While repeating the processing flow, this can be corrected or redefined.

11 (a) to 11 (c) show the moving picture editor 40 shown in FIG.
FIG. 1 is a diagram for explaining in detail 1, wherein d is an original image, b is an image to be cut out first, b is one image in the cut out image,
C is the last image to be cut out, and E and F are all frames. For example, if the original image is an image in which a person is standing in the field, the entire scene is first projected, the focus is sequentially set on the person, and finally the cut ends with an image in which the person's face is enlarged. (Scene) is considered. To do so, first cut out the image of A,
Finally, a region only of the face portion is cut out as shown in C, and a plurality of region images are cut out in between. Then, the first image A is slightly reduced after being cut out to generate a frame E, and the last image C is greatly expanded after being cut out to generate a frame F. Also, a plurality of cut images including the part between them are appropriately reduced or enlarged to generate a frame of the same size as that of (e). From frame E to frame F are cuts designated by the user. One point of the X mark of the image C is Frame Ho and Frame
It is also shown at the position of the cross on Mu-he.

FIG. 1 is a configuration diagram of a moving image information generation system showing one embodiment of the present invention.

In FIG. 1, reference numeral 101 denotes an arithmetic processing unit for generating, correcting, and defining moving image information, and 102, a moving image cut data.
A main storage device for storing data, data being processed, etc .; 103, a mouse as a pointing input device; 104, a display device such as a bitmap display; and 110, an auxiliary storage device such as a magnetic disk. The disk device 110 includes a program storage area 111, a data file 112 of an original image used for generating moving image information of the present invention, a cut generation command storing area 113 created by generating moving image information of the present invention, and An image data file area 114 of a cut created by generating moving image information is included.

When the user uses the mouse 103 to define a cut on the original image displayed on the display 104, the cutoff by the editor 401 shown in FIG. 4 is performed. A cut generation command 403 is created and stored in the cut definition file 113. Next, after generating a cut from the original image using the cut definition command 403,
The generated cut is stored in the cut image data file 114. At the same time, the cut is read and the cut generated on the display 104 is reproduced and output.

FIG. 2 is a diagram showing types of programs stored in the disk device in FIG. 1 and their relationships.

In the program storage area 111 in the disk 110, a plurality of programs below the job control program 201 are stored. The job control program 201 has a function of controlling the execution of each processing program.
Reference numeral 2 denotes a man-machine interface (interaction environment between the user and the computer) for defining a cut created by the user according to the method of the present invention. The image display program 203 has a function of displaying an image on the display device 104 in response to a request from the editor program 202.
Has a function of creating a cut generation command in accordance with the output of the editor program 202. Further, the moving image generation control program 205 has a function of controlling a lower-order program for creating cut data by the method of the present invention,
The command analysis program 206 has a function of analyzing a cut generation command.
The image size conversion program 208 has a function of cutting out a designated area of the image data.
It has a function to reduce. Further, the kernel section 209
Has a function of providing a system call used when each of the above programs accesses the file system 210. In other words, this is an operating system (OS) for giving a read / write operation to the file system 210, and this part is an existing function.

FIG. 3 is a flowchart of the overall processing of moving image information generation according to an embodiment of the present invention.

The detailed operation of FIG. 3 will be described with reference to the hardware configuration of FIG. 1, the program configuration of FIG. 2, and the processing flow of FIG. 4, respectively.

First, in step 301, the user activates the moving image generation system according to the present invention. Thereby, the arithmetic processing unit
101 reads the job control program 201 from the program storage area 111 of the disk device 110 and writes it on the main storage device 102. The job control program 201 proceeds to step 302
In order to execute ~ 304, the editor program 202 is started.

Next, in step 302, when an image to be an original image is selected by the moving image generation method of the present invention according to an instruction from the user, the image display program 203 converts the data to the original image data.
The data is read from the data file area 112 and displayed on the screen of the display device 104.

In step 303, the user defines a cut to be created for the editor program 202 using an input device such as the mouse 103. FIG. 4 corresponds to the processing of the frame 401.

In step 304, the command creation program 204 is started, and for all the frames created based on the cut definition input by the user in step 303, the positions to be cut out from the original image are determined, and a cut generation command is created. I do. In FIG. 4, a cut generation command corresponding to an arrow 402 and in a frame 403 is created.

When the processing of steps 302 to 304 ends, the job control program 201 starts the moving image generation control program 205,
In step 304, the cut generation command 403 created by the command creation program 204 is passed to the moving image generation control program 205. The subsequent steps 305 to 309 are controlled by the moving image generation control program 205.

In step 305, the command analysis program 206 is started to analyze the cut generation command 403 and create a frame to be created.
The number of programs N is obtained.

Step 306 is a process for determining whether or not N frames have been created. Steps 307 to 309 are repeatedly executed N times.

In steps 307 to 309, N pieces of image cutout information described in the cut generation command 403 are sequentially processed. Arrows 404 in FIG. 4 correspond to steps 307 to 309.

First, in step 307, the image cutout program 207
Cuts out the area of the original image data defined by the numerical value in the cut generation command 403 corresponding to the frame to be created at present.

Next, in step 308, the image size conversion program 2
08 converts the image cut out in step 307 into a predetermined image size.

In step 309, the image data of a fixed size created in step 308 is stored in the cut image data file area 114.

Step 306 controlled by the moving image generation control program 205
When the repetition of the processing of to 309 has been completed N times, the job control program 201 notifies the editor program 202 that the cut creation processing has been completed. In step 310, the editor program 202 inquires of the user whether or not to display the created cut. If display is instructed, in step 311, the image display program 203 continuously cuts the frame data into the cut image data file 11.
4 and is displayed on the screen of the display device 104. As a result, the created cut is displayed, and the process returns to the beginning and proceeds to the next image processing. If the user does not instruct the display of the cut in step 310, the process immediately returns to step 302.

FIG. 5 is a diagram showing a display example of the moving image cut editor of the present invention.

On the screen of the display device 104, a mouse cursor 120 whose display position moves in accordance with the operation of the mouse 103 is displayed. A moving image cut editor 401 controlled by the editor program 202 is also displayed.

The moving image cut editor 401 includes three areas 501, 502, and 503.
It consists of.

The first display area 501 is an original image display area. In the original image display area 501, the original image selected by the user in step 302 is read out from the original image data file area 112 by the image display program 203 and displayed. When a high-definition image having a large number of pixels is used as the original image, the image in the original image display area 501 is reduced and displayed,
Alternatively, the original image can be scrolled in the original image display area 501, and only a part thereof is displayed.

The second display area 502 is a moving image display area. In the moving image display area 502, the display of the cut executed in step 301 is displayed by the image display program 203 by the cut image data.
The frame image data is continuously read from the data file area 114 and displayed as a moving image.

The third display area 503 is a cut icon display area. In the cut icon display area 503, icons for visualizing the cut defined by the user in step 303 are displayed.

In the original image display area 501, an original image cutout frame 504 that can move its display position within the area following the mouse cursor 120 is displayed. Original image cutout frame 504
Is determined, and the display position in the original image display area 501 is determined. By clicking the button of the mouse 103, the composition of the specified frame in the cut is specified. Then, this composition is designated as an enlarged or reduced content of the area displayed in the original image cutout frame 504.

In the cut icon display area 503 of this embodiment, a plurality of sets of a cut start composition icon 505 and a cut end composition icon 506 are displayed. The set display of these icons is such that the image display program 203 reduces the composition of the first frame and the last frame of the cut defined by the user, and displays them as icons.
Move the mouse cursor 120 over these icons,
By pressing the mouse button, the definition of the cut represented by the icon is changed, and an instruction for displaying the cut in the moving image display area 502 is performed.

Also, when the user has defined a plurality of cuts and the entire set of icons 505 and 506 cannot be displayed in the cut icon display area 503, the display contents of the display area 503 can be scrolled to allow the user to scroll. All cuts defined by the user can be operated with icons.

FIG. 6 is a flowchart showing the flow of the cut definition processing by the user.

The user executes the processing of the cut definition step 303 on the moving image cut editor 401.

First, in step 601, the composition of the start frame of the cut to be defined is specified. This is performed by deciding the size of the original image cutout frame 504 and the display position in the original image display area 501, and then clicking the button of the mouse 103. At this point, a cut start composition icon 505 is displayed in the cut icon display area 503 in the image display program 2.
Displayed by 03.

In step 602, the composition of the end frame of the cut to be defined is specified in the same manner as in step 601. At that time, a cut end composition icon 506 is displayed in the cut icon display area 503 by the image display program 203.

In step 602, the composition of the end frame of the cut to be defined is specified in the same manner as in step 601. At that time, a cut end composition icon 506 is displayed in the cut icon display area 503 by the image display program 203.

7 (a) to 7 (d) are explanatory diagrams showing support functions (change of frame size, designation of number of frames, etc.) at the time of cut definition in FIG.

When changing the size of the original image cutout frame 504, it is set by moving the center point as shown in FIG. 7 (a). In the diagram (a), the center point is the mouse cursor.
The display position is 120. The center point is not exactly located at the center position of the cut-out image, but rather the original image cut-out frame 504.
Is changed to the frame 504a in the figure, each vertex of the frame 504a comes on a straight line 700a-700d connecting the position of the mouse cursor 120 and each vertex of the frame 504.

In step 603, the number of frames in the cut to be defined is specified. This designation is performed by prompting the user to input a numerical value from a keyboard, or by displaying the slide volume 701 on the screen of the display device 104 as shown in FIG. Then, the position of the mouse cursor 120 can be moved. That is, the user moves the mouse cursor 120 on the knob 702 of the slide volume 701, and moves the mouse 103 in the horizontal direction while pressing the mouse button, thereby moving the knob 702 to a position of a desired numerical value. After moving, you can enter a numerical value by releasing the mouse button.

In step 604, items that need to be instructed to define the cut are selected.

Note that, for the items that have not been selected in step 604, default values prepared in advance on the computer side are set. The default value is
For example, the frame position path (605) is a straight line connecting the start frame designated in step 601, and the frame position moving speed coefficient (606) and the frame size change speed coefficient (607) have a constant speed. It can be. Therefore, step
The processes 605 to 607 are processes for changing the values that have already been set. Note that the frame position moving speed coefficient is a moving rate of a distance from an image position before an image frame to be sequentially cut to a corresponding image position, and the movement of a camera assuming that the camera sequentially moves the image position. It is a coefficient of speed. Further, the frame size change speed coefficient is a rate at which the ratio of the cutout size of the corresponding image to the cutout size of the previous image changes, and in this case also, the camera at the time of sequentially tracking the changed image size by the camera. Is the coefficient of change of speed.

In step 604, when the route specification of the position of the original image clipping frame 504 is selected, step 605 is executed. Step 6
As an example of 05, there is a method in which the user moves the mouse cursor 120 while pressing the button of the mount 103, and sets the movement path as the path of the position of the original image cutout frame 504.

Note that the path of the position of the original image cutout frame 504 is a path followed by the center point, and in this embodiment, the center point is the display position of the mouse cursor 120.

Next, in Step 604, when the specification of the moving speed coefficient of the display position of the original image cutout frame 504 is selected, Step 606 is executed. FIG. 7 (c) shows an example of step 606.
As shown in FIG. 7, a graph 703 in which the horizontal axis represents the frame number and the vertical axis represents the moving speed coefficient of the original image cutout frame 504 is displayed.
There is a method in which the user operates the mouse cursor 120 to change the shape of the graph to specify the graph.

As another example, as shown in FIG. 7 (d), there is a method in which the shape of the graph 704 is prepared in a pattern and applied. In the figure (d), the graph
The moving speed is slow near the start and end frames of the cut as indicated by 704, and is high near the center of the cut. Furthermore, after setting the shape of the prepared graph, it is also possible to partially change the shape.

Next, in step 604, when the designation of the change rate coefficient of the size of the original image cutout frame 504 is selected, step 607 is executed. Step 607 can be performed in the same manner as in step 605 by setting the vertical axis of the graph in FIG.

Also, the following steps 605 to 607 can be specified at one time. That is, a plurality of frames can be designated by the same method as the composition designation of the start frame executed in step 601, and a frame number in a cut can be designated for each frame. In this case,
The designated frames can be set as straight lines for the route and constant for the change coefficient. Furthermore, if the change between frames is made smooth by forming a smooth curve by processing with a spline function or the like, a smooth movement is obtained even when the created cut is reproduced.

When setting the composition of multiple frames, first
The user specifies the frame number and uses the current settings to
The original image cutout frame 504 of the size and display position at the time of the program number is displayed. The user can also determine the composition at the time of the frame number by correcting the size and display position of the displayed frame. The method for calculating the size and display position of the original image cutout frame 504 from the frame number will be described at the same time as the method for executing the step 304 by the command creation program 204.

FIG. 8 is a view showing a cut definition table according to the present invention, wherein (a) shows an original image cutout frame management table,
(B) is a route management table, (c) is a moving speed coefficient management table, (d) is a frame size change speed coefficient management table, and (e) is a data management table.

8 (a) to 8 (e), step 303 in FIG.
A description will be given of various cut definition tables generated by the user defining cuts and having values set therein. The coordinate system used in this embodiment is a coordinate system whose origin is the point at the lower left corner of the original image, and is a pixel unit of the original image.

In FIG. 8A, reference numeral 801 denotes an original image cutout frame management table, 802 denotes a frame number, 803 denotes a coordinate value of the center point of each frame, 804 denotes a frame size, and 805 denotes a center point offset value. is there. The frame number 802 is registered from 1 to the number of frames in the cut. The center point offset value is a value obtained by normalizing the offset coordinate value of the center point from the lower left corner of the original image cutout frame 504 by the size of 504. That is,
When the coordinate value of the frame 504 is (X, Y), the following is performed.

a = (xc−X) / w; b = (yc−Y) / h (1) If this is described in detail in FIG. 11 (c), the frame 504 is cut out first. If the image a and the original image are d, FIG. 8 (a)
As shown in, frame - center point coordinates of the beam number 1, i.e. the coordinate values of the position of the × mark in the case of calculating from the left corner of the original image (0,0) is xc _1, yc _1, the frame size is w ₁ , h ₁ , so the center point offset, that is, the left corner of the cut
The deviation rate from the center when Y is obtained is obtained by dividing a value obtained by subtracting X from xc ₁ by w ₁ and a value obtained by subtracting Y from yc ₁ by h ₁
Is the value divided by.

The original image cutout frame management table 801 is initialized when the number of frames is determined in step 603 in FIG.
The result of step 601 is written in the first entry, and the result of step 602 is written in the last entry. Step 604
When the processing of Steps 607 to 607 is performed by designating the composition of a specific frame, it is written in the entry corresponding to the instructed frame number.

In FIG. 8B, reference numeral 811 denotes the contents of the route management table, 812 denotes the number of vertices, 813 denotes the vertex coordinate values (xp, yp) of the route, 8
14 is the distance between the next entry vertex.
The first entry of the route management table 811 is the
Is the coordinate value of the center point when the composition of the start frame is designated. In the embodiment, the coordinate value is the same as the display position of the mouse cursor 120. Also, the last entry is a step
602 is the coordinate value of the center point when the composition of the final frame is designated.

By specifying a route in step 605, the number of vertices 812 is added to the number of vertices newly specified, and the number of entries of the vertex coordinate value 813 is increased.
Redo the calculation and update.

In FIG. 8C, reference numeral 821 denotes a moving speed coefficient management table.
822, a frame number, and 823, a corresponding moving speed coefficient v. The moving speed coefficient management table 821 is initialized when the number of frames is determined in step 603 in FIG. 6, and as a default value, in the case of moving the frame at a constant speed, the moving speed is controlled. The same value is written in all of the speed coefficients 823. The contents of the moving speed coefficient management table 821 are updated in step 606.

In FIG. 8D, reference numeral 831 denotes the contents of the frame size change speed coefficient management table, 832 denotes the frame number, and 833 denotes the corresponding frame size change speed coefficient z. The frame size change rate coefficient management table 831 is initialized when the number of frames is determined in step 603 in FIG. 6. When the frame size is changed at a constant speed as a default, the frame size change table is set. The same value is written in all of the speed coefficients 833. The contents of the frame size change rate coefficient management table 831 are updated in step 607.

In FIG. 8 (e), reference numeral 841 denotes the contents of the data management table, and reference numeral 842 denotes the total route distance D, which is a value obtained by adding the inter-vertex distance 814 of the route management table 811. . Reference numeral 843 denotes a moving speed parameter V, which is a value obtained by adding the moving speed coefficient 823 of the moving speed coefficient management table 821. Reference numeral 844 denotes a frame size change speed parameter Z, which is a value obtained by adding the frame size change speed coefficient 833.

These cut definition tables 801 to 841 are necessary when creating the cut generation command 403 in step 304 of FIG. 3, as described later. And
After the cut image data has been created, the cut image is stored in the cut definition file area 113 together with the cut generation command 403 by the editor program 202.

FIG. 9 is a diagram showing the contents of a cut generation command in the present invention.

In FIG. 9, reference numeral 902 denotes the name of the original image, that is, the file name in the original moving image data file area 112. 903
Is the number of frames in the cut, 904 is the frame image name header, and 905 is the frame image name start number. That is, when storing the frame image data of the cut to be created in the cut image data file area 114, a serial number starting with the frame image name start number 905 is added to the frame image name header 904. Is used as a file name.

Reference numeral 906 denotes designation information (frame number) of an area to be cut out from the original image by the image cutout program 206 to create each frame. For example, a numerical value in a coordinate system having the origin at the lower left corner point of the original image It is. Therefore, the frame number 906 is repeatedly designated by the number (1 to N) of the frame number 903. Reference numeral 907 denotes the coordinate value (X, Y) of the lower left corner of the region to be cut out, and 908 denotes the size (W, H) of the region to be cut out. These values 907 and 908 are calculated by the command creation program 204. In that case, command creation program 2
In step 04, the portion where the numerical values of the center point coordinate value 803 and the frame size 804 are not written in the entry of the original image cutout frame management table 801 is calculated.

Next, returning to FIG. 4, when the cut of the N frame is stored in the cut image data file 114, the cut is immediately reproduced and displayed on the display screen so that the user can confirm it. . In this case, it is possible to change the order of the frames and display them continuously. For this purpose, the original image cutting frame management table 801, the path information management table 811, the moving speed coefficient management table 821, and the frame size change speed coefficient management table 831 stored in the cut definition file 113 are provided. , And the data management table 841, the order of the frame numbers is exchanged, each piece of information is read out, and the corresponding image may be taken out from the cut image data file 114 and displayed accordingly. .

FIG. 10 is a flowchart showing the number-of-executions processing when generating a cut generation command in the present invention, and FIG. 12 is an auxiliary explanatory diagram of FIG.

In this embodiment, the coordinate values of the intermediate points of frames other than the start frame and the end frame of the cut (that is, the coordinate values of the center point)
803) is a process in a case where it is not required. And
Here, the center point coordinate value 803 is stored in the route information management table 811.
And the contents of the moving speed coefficient management table 821 are shown. When the intermediate point coordinate value 803 of the frames other than the start frame and the end frame is obtained, it is assumed that the cut is delimited by the frame and the center is determined using FIG. Point coordinate values can be calculated.

In FIG. 12, p in the broken line is the moving distance, and r in the solid line is the remaining length of the polygonal line segment.

First, in step 1001, initialization processing of variables r, m, and n is shown. Here, r is the remaining length of the polygonal line segment, m is the corresponding number on the polygonal line segment, and n is the value of the frame counter, that is, the frame number.

In the next step 1002, a repetition process for obtaining the center point coordinate value 803 of all the frames in the cut is shown, and the same process is performed until the frame number n becomes equal to the total frame number N. repeat.

In step 1003, the distance between the center point of the nth frame and the center point of the (n-1) th frame is calculated and substituted into a variable p (movement distance). That is, a process is shown in which the value obtained by multiplying the total distance D by the moving speed coefficient / moving speed parameter is set to p. Step 1004 shows a process of determining that the center point of the n-th frame is not on the (m + 1) -th polygonal line segment of the route.
That is, it is determined whether the moving distance p in FIG. 12 is larger than the remaining length r of the polygonal line segment. next,
In step 1005, if it is determined in step 1004 that it is not on the (m + 1) th polygonal line segment, (m +
1) A process of subtracting the remaining length r of the first polygonal line segment from the moving distance p is shown. Step 1006 shows a process of proceeding to the next segment on the route. Next, in step 1007, a process of determining that the center point to be obtained is not on the polygonal line segment is shown. That is, the moving distance p is equal to the route information management table 81
It is determined whether or not it is larger than the vertex distance dm of 1 and p
If is smaller than dm, calculate the center point coordinates. Also,
If p is greater than dm, the moving distance p
The length dm of the polygonal line segment is subtracted from, and the processing is repeated from step 1006. If the center point to be obtained is on the polygonal line segment in step 1007, the remaining length r of the polygonal line segment is obtained in step 1009, and the central point coordinates (X _n , Y _n ) are obtained in step 1010.

If the center point to be determined in step 1004 is on the polygonal line segment, in step 1012 the remaining length r of the polygonal line segment is calculated, and in step 1010 the central point coordinates are determined.

Xn and Yn of the center point coordinates are obtained by subtracting the remaining length r of the polygonal line segment obtained in steps 1012 and 1009 from the segment length dm and dividing by dm (ratio to the segment length), It is obtained by multiplying the difference between the vertex coordinate values and adding to the previous coordinate value.

Next, in step 1011, the value of the frame counter n is set to 1
And return to step 1002.

 Further, the frame size 804 is calculated by the following equation.

_{W n = W n-1 +} (WN-W1) · zn / ZH n = H n-1 + (HN-H1) · zn / Z ········· (2) Equation (2) Can be obtained by referring to the frame size change rate coefficient management table 831 and the data management table 841. That is, determine the rate of change from the size change rate population parameter Z and the size change rate coefficient z _n, which multiplies the width WN of the final clipped image to the first value obtained by subtracting the width W1 of the clipped image, the width of the previous image Should be added to As for the height,
Ask in the same way.

Further, in the present embodiment, since the change coefficient is not set for the center point offset 805 as in the case of the frame size 804, it is calculated by linear interpolation using the values in the start frame and the end frame. And find the value.

By the above processing, the original image cutout frame management table 801
Numerical values are written in all the entries of the cut command 403. Then, referring to these numerical values, the entries 907 and 908 of the cut generation command 403 are calculated as follows.

X = xc− (w × a); Y = yc− (h × b) W = w; H = h (3) where (xc, yc) is , The center point coordinate value 803 of the corresponding frame number, (w, h) is the frame size 804 of the corresponding frame number,
(A, b) is the center point offset value 805 of the corresponding frame number.

Various cut definition tables and cut generation commands 403 stored in the cut definition file area 113 are displayed in the icons 505 and 506 displayed in the cut icon display area 503.
By operating on the editor program 202
Is read by

〔The invention's effect〕

As described above, according to the present invention, it is possible to obtain a moving image with rich expressiveness equivalent to a case where the camera is operated and photographed with advanced technology, and the cut composition and the length during the editing work are reduced. When it turns out to be inappropriate, you can freely re-create the cut and immediately check this, so you can get a cut suitable for the whole scenario,
And it is possible to improve the quality of the work created by joining the cuts.

[Brief description of the drawings]

FIG. 1 is an overall configuration diagram of a computer system showing one embodiment of the present invention, FIG. 2 is a hierarchy diagram of a computer program in FIG. 1, and FIG. 3 is a moving image generation program showing one embodiment of the present invention. FIG. 4 is a schematic diagram showing the flow of the process of the present invention, FIG. 5 is a diagram showing a display example of a moving image cut editor, and FIG. 6 is a cut definition by a user. FIG. 7 is a flowchart showing a processing flow, FIG. 7 is a diagram showing a support function at the time of cut definition in the present invention, FIG. 8 is a diagram showing a cut definition table in the present invention, and FIG. FIG. 10 is a flowchart showing the content of the cut generation command in FIG. 10, FIG. 10 is a flowchart of the center point coordinate value calculation processing performed at the time of generating the cut generation command of the present invention, FIG. 11 is an auxiliary explanatory diagram of FIG. FIG. 12 is an auxiliary explanatory diagram of FIG. 101: arithmetic processing unit, 102: main storage device, 103: mouse, 104:
Display device, 110: disk device, 111: program storage area, 112: original image data file area, 113: cut definition file area, 114: cut image data file area, 120: mouse cursor, 201: job control program ,
202: Editor program, 103: Image display program, 20
4: Command creation program, 205: Moving image generation control program, 206: Command analysis program, 207: Image cutting program, 208: Image size conversion program, 209: Kernel section, 210: File system, 401: Moving image cut Editor, 403: Cut generation command, 501: Original image display area, 50
2: Moving image display area, 503: Cut icon display area, 504:
Original image cutout frame, 505: Cut start composition icon, 506: Cut end composition icon, 801: Original image cutout frame management table, 811: Route information management table, 821: Moving speed coefficient management table, 831 : Frame size change speed coefficient management table, 84
1: Data management table.

──────────────────────────────────────────────────続 き Continuation of the front page (56) References JP-A-2-204791 (JP, A) JP-A-60-143388 (JP, A) JP-A-63-143676 (JP, A) JP-A-50-143 34437 (JP, A) JP-A-54-142935 (JP, A) JP-A-58-81064 (JP, A) (58) Fields investigated (Int. Cl. ⁷ , DB name) H04N 5 / 262-5 / 278

Claims (1)

(57) [Claims] 1. A method for generating a moving image, comprising: specifying, from an original image, an area corresponding to a start frame and an area corresponding to an end frame of the moving image; Designate, determine a straight line connecting the center point of the area corresponding to the start frame and the center point of the area corresponding to the end frame as a cutout path, and complement between the start frame and the end frame. With respect to the intermediate frame forming the moving image, the area corresponding to the intermediate frame is positioned on the cutout path with the center point of the area corresponding to the intermediate frame, and the position of the area corresponding to the previous frame is changed to the next frame. The rate of movement of the distance to the position of the corresponding area is fixed, and the ratio of the size of the area corresponding to the next frame to the size of the area corresponding to the previous frame The rate of change is fixed, and sequentially determined from the original image, the area corresponding to the start frame, the area corresponding to the end frame, and the area corresponding to the intermediate frame are enlarged or reduced to the same value. A method for generating a moving image, comprising: generating a frame image of a size; and continuously connecting the generated frame images to generate a moving image.