JP3175971B2 - Video content display method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a moving image content display method for understanding the contents of a moving image at a glance.

[0002]

2. Description of the Related Art In a conventional moving picture, it is a usual method to understand the contents by playing back the moving picture itself or watching it at a quick glance. On the other hand, there is a method of reminding the contents by displaying a typical screen as a still image recently.

[0003]

However, it is difficult to use the conventional method as a means for searching for a specific scene, searching or changing a moving image.

[0004] It is an object of the present invention to provide a moving image content display method that allows the contents of a moving image to be read at a glance.

[0005]

Video content display method according to the present invention SUMMARY OF THE INVENTION the image captured by the camera and the electronic image information
A moving image content display method for displaying a frame constituting a moving image when electronically edited and displayed on an electronic image display device , wherein a speed parameter of a camera operation at the time of photographing the frame.
Data and convert it to the previous frame
Deformation amount and movement of current frame with respect to the previous frame
Calculate the video vector indicating the quantity, and add
Video with a fixed amount added diagonally in the order of shooting time for each frame
The frames are deformed and moved according to vectors, and are superimposed. In addition, the speed of the camera operation
Transform the frame based on the parameters
And the current frame with respect to the previous frame
Is calculated. Ma
Further, an image of a frame corresponding to a change point of the camera operation is extracted from the change point and separately displayed.

Further, a Helmart change is used in converting a change in the state of a shooting position accompanying a camera operation in a moving image into a graphic.

[0007] Further, the combination of the frames indicating the time lapse in the moving image is obtained by superimposing the actual images.

[0008]

[0009]

[0010]

According to the present invention, a figure (hereinafter simply referred to as a figure) indicating a change in the state of a photographing position associated with a representative screen and a camera operation is shown as a still image (hereinafter referred to as an icon). The contents of the moving image can be read at a glance, and the camera operation can be used as a means for editing.

[0011]

FIG. 1 is an example of an icon showing a moving image content display method according to the present invention. In FIG. 1, the representative screen 1 is at the top, and the subsequent screen is shown as FIG. 1A behind it.
If the camera operation is fixed, this figure 1A is added with a frame 2 of a frame shown as a figure obliquely upward to the right and the length of the video can be known from the ratio of this addition. Further, when a camera operation is added thereto, the frame 2 of the frame is moved in the operation direction in accordance with the operation.

Here, expressions for camera operation will be described. The basics of camera operation are the fixed position of the camera,
Fixing while fixed, shaking vertically and shaking horizontally are called tilt and pan, respectively, the change in magnification by the lens is called zoom, and rotating the camera itself with respect to the optical axis is called rotation. Operations for moving the camera in the front-back direction, the left-right direction, and the up-down direction are called dolly, truck, and boom. The camera operation information includes a method of accumulating information of a sensor attached to the camera itself at the time of photographing together with moving image information, and a method of taking image data from a photographed moving image by image processing. In the former case, a camera with a special sensor may be manufactured and stored in an audio track or the like of a video tape. The latter can be detected by the method described in Japanese Patent Application No. 3-12629.

The present invention relates to a display method for fixing, tilting, panning, zooming, and rotating among the basic operations of the camera. Operations for moving the camera itself, such as a boom, a track, and a dolly, are each tilted. ,
I will treat it with pan and zoom.

FIG. 1 shows an example of moving image display. Here, the operation names of F and P are shown in order to make the explanation of each camera operation range 5 easy to understand. Bread (P
1) The initial acceleration part 21 and the constant velocity pan part 2
2. There is a portion 23 where the speed is low. 24 is a fix (F
2) is shown. In this example, a pan (P1) operation of moving quickly to the right following the fix (F1) is performed, and the position again becomes the fix (F1) at that position, and then a pan (P2) operation of moving slowly to the left is performed. We fix (F2)
An icon 50 indicating that the process is completed after the process has been completed. Reference numeral 3 denotes a progress display line, and reference numeral 4 denotes a virtual line when camera operation in a fixed state continues.

With the icon 50 expressed in this way, the outline of the scene can be associated with the representative screen 1 and the details can be temporally classified by operating the camera. By designating the frame 2 of the frame of the icon 50 with a cursor or the like, a device that designates a specific frame to the machine can accurately designate the position of the frame. In addition, each moving amount indicates the smoothness of the camera operation, and it is often difficult to view a moving image if the change is not smooth, and it is possible to determine the quality of the video. Furthermore, if the machine is instructed to change the length of the changing part or the straight part that is too long or too short, the video can be edited by thinning out frames from the moving image or adding frames appropriately. Can be easily done.

FIG. 2 shows the icon 50 when the zoom or dolly operation is performed. In FIG. 2, the screen is once enlarged by zooming to narrow the shooting range, and then the screen is reduced to widen the shooting range. Further, the operation is shown in which the screen is further enlarged to narrow the shooting range, and the screen is returned to a screen having almost the same size as the top screen. Next, a method for displaying these icons 50 will be described.

Here, the tilt, pan, zoom, and rotation of the speed parameters of the camera operation detected by the method disclosed in Japanese Patent Application No. Hei 3-12629 are represented by tilt (t), pan
(t), zoom (t), and rot (t), and a method of creating and displaying the icon 50 using these parameters will be described. FIG. 6 shows an icon 50 for explanation. FIG. 7 shows this as viewed from the line of sight of the human eye 20 in the figure.
The arrow in FIG. 7 represents the video vector κ, in which the arrow 1
Reference numeral 4 denotes a vector representing the amount of deformation of the current frame 12 with respect to the previous frame 11 and the direction of movement change on the xy plane. The arrow 15 is a vector indicating the amount of deformation of the frame between the next frame 13 and the current frame 12 and the direction of movement change on the xy plane.

Next, a method of calculating a video vector using the camera operation parameters and displaying the icon 50 will be specifically described. The calculation of the video vector from the speed parameter of the camera operation detected by the method disclosed in Japanese Patent Application No. Hei 3-12629 uses, for example, the Helmert transform that can perform similarity conversion. The Helmert transformation is a transformation represented by equation (1), and a video vector can be calculated by substituting a camera operation parameter for each coefficient.

[0019]

(Equation 1) Here, Table 1 shows a relationship between the coefficients a, b, c, and d and the parameters tlt (t), pan (t), zoom (t), and rot (t) of the camera operation speed.

[0020]

[Table 1] Here, when the camera operation is fixed, the coefficients a, b,
c and d are each 0. Also, when zoom and rotation are combined, equation (2) is obtained,

[0021]

(Equation 2) Where κzoom and κrot are

[0022]

(Equation 3) It is. Except for the case where zoom and rotation are combined, it is represented by the sum of video vectors obtained from each camera operation. For example, in a camera operation in which pan, tilt, and zoom are combined, Expression (3) is obtained.

[0023]

(Equation 4) Where κpan and κtilt are respectively

[0024]

(Equation 5) It is.

An icon 50 as shown in FIG. 7 can be produced by deforming and moving the frame 2 of each frame using the video vector. In this icon 50, the frames overlap each other in the fix operation, so that it is impossible to see other than the top screen, and the value of the icon 50 is small. Therefore, a method of manufacturing the icons 50 as shown in FIG. 6 by arranging the icons 50 at frame intervals in the direction of the time t will be described. Here, a method of displaying the time axis so as to be at an upper 45 degrees in order to have compatibility with the conventional icon 50 will be described. The icon can be expressed on a two-dimensional plane by adding the term of the time axis to the equation (1) of the video vector, and sequentially deforming, moving, and superimposing each frame by the video vector. For this purpose, the term on the time axis is expressed by equation (1)
Is represented as equation (4).

[0026]

(Equation 6) Here, e is the coefficient of the term on the time axis.

[0027] Among the icons produced by the equation (4),
The icon of the shot shot with the fix corresponding to the absence of the camera operation parameter matches the conventional icon. FIG. 5 shows an image actually produced using this Helmert transform. The coefficient of this icon 50 is a = cos (n /
π), b = sin (n / π), c = 1, d = 2, e = 1, and n is the number of frames from 1 to 60.

If the icon 50 is fixed to the camera, the frame 2 of each frame should be shifted slightly to the upper right as shown in FIG. 6, but this icon 50 is an initial screen (in this case, a representative screen). From 1), it is shown that the camera rotates by 1 / π per frame around the optical axis and the camera is directed to the lower right direction. By understanding such rules, the contents of the camera operation can be understood at a glance.

Using the Helmert transform in this way,
Using the value of the camera operation information obtained from the video, the arrangement information of each frame on the screen for icon creation can be obtained mathematically, and the icon can be easily created on the computer. Further, even when a sensor attached to a camera is used, the arrangement information of each frame can be similarly calculated using the amount of change, and the icon 50 of the present invention can be manufactured.

Further, as shown in FIG. 3, by arranging a plurality of icons 50a, 50b, etc., it is possible to understand at a glance a moving image of a certain length,
It will help you understand the video and use it as an aid to editing.

In FIG. 4, the screen 10 of the frame corresponding to the change point of each camera operation is separately shown by a leader line 11, so that the development of the icon 50 can be more easily understood. This makes it possible to display icons that are easier to see.

In the above description, reference numeral 2 denotes a frame. However, the icon 50 is formed by stacking the actual frame images as the actual images. . In this way, a portion of each image that does not overlap with a real image that is superimposed later will be partially visible. This is hard to understand compared to the case where the actual image is completely visible, but when a person who has knowledge of the target video uses this icon 50, it is possible that partial information can be seen on other than the representative screen 1. It is very useful for remembering the flow of content,
This and the camera operation information can be obtained from the same icon 50. Therefore, it is possible to grasp the video in more detail just by glance at the icon 50. This is an effect not found in the icon 50 composed of only the frame 2 of the simple frame.

[0033]

As described above, the present invention relates to a camera
The image shot with is used as electronic image information, edited electronically, and
A moving image content display method for displaying a frame constituting a moving image when displayed on a child image display device, the method comprising : converting the frame based on a speed parameter of a camera operation at the time of shooting.
The amount of deformation of the frame from the previous frame
Video vector indicating the amount of movement of the current frame with respect to the frame
Is calculated, and the shooting time is set for each frame in the video vector.
The image vector is obtained by adding a certain amount diagonally in order.
Since the frames are deformed and moved to be superimposed, the icons can be used to associate the outline of the scene with the representative screen, and the details can be temporally classified by operating the camera. By designating the frame of the icon frame with a cursor or the like, the position of the frame can be accurately designated. Also, the respective moving amounts indicate the smoothness of the camera operation, and the quality of the video can be determined. In addition, if the changing part or the straight part is too long or too short, giving an instruction to change the length will make it easier to edit the movie by thinning out frames from the movie or adding frames appropriately. Will be able to

[0034] In addition, the speed parameter of the camera operation
Transforms the shape of the frame based on the Helmert transform based on
And the amount of movement of the current frame with respect to the previous frame.
Since the video vector is calculated, the processing on the computer becomes easy. That is, using the value of the camera operation information obtained from the video, the arrangement information of each frame on the screen for icon creation can be mathematically obtained, and the icon can be easily created on the computer. Furthermore, even when a sensor attached to a camera is used, the arrangement information of each frame can be similarly calculated using the amount of change, and the icon of the present invention can be manufactured.

In the moving image content display method, a camera
If the image of the frame corresponding to the operation change point is
Each camera operation
The screen of the frame corresponding to the change point of
This makes it easier to expand the icon.
So that you can understand. This gives you more
A pan icon can be displayed .

[Brief description of the drawings]

FIG. 1 is an elevation view of an icon with a representative screen used by the present invention.

FIG. 2 is an elevation view of another icon used by the present invention.

FIG. 3 is an elevation view in which a plurality of icons with a representative screen used by the present invention are arranged.

FIG. 4 is an elevation view of another icon used by the present invention.

FIG. 5 is a diagram showing an example of an icon using the Helmert transform used by the present invention.

FIG. 6 is a plan view of an icon using the Helmert transform of the present invention.

FIG. 7 is an elevation view of an icon using the Helmert transform used by the present invention.

[Explanation of symbols]

 1 Representative screen 2 Frame frame 3 Progress display line 4 Temporary line 5 Range of camera operation 10 Screen 11 Leader line 50 Icon

Claims (3)

(57) [Claims] An image captured by a camera is used as electronic image information.
A moving image content display method for displaying a frame constituting a moving image when electronically edited and displayed on an electronic image display device , wherein the speed parameter of a camera operation at the time of shooting the frame is The amount of deformation of the frame shape from the previous frame by converting based on
And the amount of movement of the current frame with respect to the previous frame.
Calculate the video vector and diagonally add the video vector to the video vector in the order of shooting time.
The frame is determined by a video vector to which a certain amount is added.
A moving image content display method characterized by being superimposed by being deformed and moved . Wherein based on the speed parameters of the camera operation
And the amount of deformation of the frame
And the moving amount of the current frame with respect to the previous frame.
The moving image content display method according to claim 1, wherein an image vector is calculated. 3. The moving image content display method according to claim 1, wherein an image of a frame corresponding to a change point of the camera operation is extracted from the change point and separately displayed.