JPH05232912A - Mehtod for displaying contents of moving image - Google Patents

Abstract

PURPOSE:To judge the contents of a moving image at a glance by displaying time passage in the moving image as the combination of frames and displaying the status change of a photographing position in the moving image due to camera operation as a graphic. CONSTITUTION:In an icon 50, a representative picture 1 is arranged on the leading position and succeeding pictures are arranged following the picture 1 as graphics 1A. When camera operation is fixed, a frame 2 indicated as a graphic is added in the upper-light direction and the length of the image is detected in accordance with the rate of the addition. When camera operation is applied, the frame 2 is moved in the operational direction in accordance with the operation. In the icon 50 expressed by said constitution, the outline of the scene based upon the representative picture 1 can be associated with and the time-divided sorting of detailed parts by the camera operation can be attained. A device capable of specifying a specific frame to a machine by specifying the frame 2 of the icon 50 by a cursor or the like can exactly specify the position of the frame.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a moving picture content display method for understanding the contents of a moving picture at a glance.

[0002]

2. Description of the Related Art In a conventional moving image, in order to understand its contents, it is a usual method to reproduce the moving image itself and watch it, or to look at it and understand the contents. On the other hand, there is a method of reminding the contents by displaying a typical screen as a still image recently.

[0003]

However, the conventional method is difficult to use as a means for searching for a specific scene, searching or changing a moving image.

It is an object of the present invention to provide a moving picture content display method which allows the contents of a moving picture to be read at a glance.

[0005]

According to the method of displaying moving picture contents of the present invention, a time course in a moving picture is shown as a combination of frames, and a state change of a photographing position due to a camera operation in the moving picture is shown as a figure. It is a thing.

Further, the Helmert change is used in converting the state change of the photographing position due to the camera operation in the moving image into a figure.

Furthermore, the combination of frames of frames showing the passage of time in a moving image is used as an overlay of real images.

[0008] Further, the frame screen at the time when the camera operation of the moving image included in the combination of frame frames that shows the temporal passage in the moving image is changed to the temporal position of the combination of frame frames. It is displayed corresponding to.

Further, the frame combination representing the moving picture included in the combination of the frame and the frame combination showing the passage of time in the moving picture is made to correspond to the temporal position of the combination of the frame composition. It is something to display.

[0010]

According to the present invention, since the representative screen and the figure (hereinafter, simply referred to as a figure) showing the state change of the photographing position due to the camera operation are shown as a still image (hereinafter, referred to as an icon), The contents of the moving image can be read at a glance and can be used as a means for using the camera operation for editing.

[0011]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 is an example of an icon showing a moving image content display method of the present invention. In FIG. 1, the representative screen 1 is at the top, and the screen following it is shown as a graphic 1A.
When the camera operation is fixed, the figure 1A is added with the frame 2 of the frame shown as a figure diagonally to the right, and the length of the image can be known by the ratio of this addition. Further, when a camera operation is added to this, the frame 2 of the frame is moved in the operation direction in accordance with the operation.

[0012] Here, the expressions for the camera operation will be described. For the basics of camera operation, at the position where the camera is fixed,
Fixing while fixed, swinging vertically, and swinging horizontally are called tilt and pan, respectively, the change in magnification due to the lens is called zoom, and the rotation of the camera itself about the optical axis is called rotation. Further, the operation of moving the camera in the front-back direction, the left-right direction, and the up-down direction is called a dolly, a track, and a boom. These pieces of camera operation information include a method of storing information of a sensor attached to the camera itself at the time of shooting together with moving image information, and a method of taking image processing from a shot moving image. In the former case, a camera with a special sensor may be manufactured and stored in an audio track of a video tape. The latter can be detected by the method disclosed in Japanese Patent Application No. 3-12629.

Further, the present invention is a display method for fixing, tilting, panning, zooming, and rotation among the basic operations of the camera, and tilting is performed for each operation of moving the camera itself such as a boom, a truck, or a dolly. ,
I will handle it with pan and zoom.

FIG. 1 shows an example of a moving image display. Here, in order to make the description of the range 5 of each camera operation easy to understand, the operation names are shown by F and P. Bread (P
1) is a part 21 for accelerating in the initial stage, and a part 2 for constant velocity pan
2. There is a low speed portion 23. 24 is a fix (F
2) is shown. In this example, a pan (P1) operation that moves rapidly to the right following the fix (F1) is performed, and then a fix (F1) operation is performed again at that position, and then a pan (P2) operation that moves slowly to the left is performed. We fix (F2)
It is an icon 50 indicating that it is finished after the end. Further, 3 is a progress display line, and 4 is a virtual line when the camera operation in the fixed state continues.

With the icon 50 expressed in this way, an outline of the scene can be associated with the representative screen 1, and details can be categorized in time by operating the camera. By designating the frame 2 of the frame of the icon 50 with a cursor or the like, it becomes possible to accurately designate the position of the frame in the device which instructs the machine to the specific frame. Further, each moving amount shows the smoothness of the camera operation, and if this change is not smooth, it is often a moving image that is difficult to see, and the quality of the image can be judged. Furthermore, if the changing part or straight part is too long or too short, you can instruct the machine to change its length by thinning out frames from the video or adding frames appropriately to edit the video. Can be done easily.

FIG. 2 shows an icon 50 when a zoom or dolly operation is performed. In FIG. 2, the screen is once enlarged by zooming to narrow the photographing range, and then the screen is reduced to widen the photographing range. Further, the operation is shown in which the screen is enlarged and the shooting range is narrowed, and the screen is returned to a screen having the same size as the top screen. A method of displaying these icons 50 will be described next.

Here, the tilt, pan, zoom, and rotation of the speed parameter of the camera operation detected by the method shown in Japanese Patent Application No. 3-12629, etc. are set to tilt (t), pan.
(t), zoom (t), rot (t), and a method of producing and displaying the icon 50 using these parameters will be described. An illustrative icon 50 is shown in FIG. FIG. 7 shows a view of this from the direction of the line of sight of the human eye 20 in the figure.
The arrow in FIG. 7 represents the video vector κ, in which the arrow 1
Reference numeral 4 is a vector that represents the amount of frame-shaped deformation of the current frame 12 with respect to the previous frame 11 and the direction of movement change in the xy plane. An arrow 15 is a vector representing the frame-shaped deformation amount of the next frame 13 and the current frame 12 and the movement change direction in the xy plane.

Next, a method of calculating the video vector using the camera operation parameters and displaying the icon 50 will be specifically described. For calculating the video vector from the speed parameter of the camera operation detected by the method disclosed in Japanese Patent Application No. 3-12629, for example, the Helmert conversion capable of similarity conversion is used. The Helmert transform is a transform represented by the equation (1), and the video vector can be calculated by substituting the camera operation parameter for each coefficient.

[0019]

[Equation 1] Table 1 shows the relationship between the coefficients a, b, c and d and the camera operation speed parameters tilt (t), pan (t), zoom (t) and rot (t).

[0020]

[Table 1] Here, when the camera operation is fixed, the coefficients a, b,
c and d are 0 respectively. Also, when zoom and rotation are combined, formula (2) becomes

[0021]

[Equation 2] Where κzoom and κrot are respectively

[0022]

[Equation 3] Is. Also, except when the zoom and rotation are combined, it is represented by the sum of the video vectors obtained from each camera operation. For example, in the camera operation in which pan, tilt, and zoom are combined, formula (3) is used.

[0023]

[Equation 4] Where κpan and κtilt are

[0024]

[Equation 5] Is.

By transforming and moving the frame 2 of each frame by using the video vector, the icon 50 as shown in FIG. 7 can be produced. With this icon 50, the frames are overlapped with each other in the fix operation, and only the first screen can be seen, and the utility value of the icon 50 is low. Therefore, a method of arranging the icons 50 at frame intervals in the direction of time t to manufacture the icon 50 as shown in FIG. 6 will be described. Here, in order to have compatibility with the conventional icon 50, a method of displaying the time axis at 45 degrees upward will be described. An icon can be expressed on a two-dimensional plane by adding a term on the time axis to the equation (1) of the image vector, sequentially deforming and moving each frame by the image vector and superimposing them. For this reason, the term on the time axis is expressed by equation (1)
The formula added to is expressed as Formula (4).

[0026]

[Equation 6] Here, e is a coefficient of the term on the time axis.

Among the icons created by the equation (4),
The icon of the shot taken with the fix corresponding to no camera operation parameter matches the conventional icon. An image actually created using this Helmert transform is shown in FIG. The coefficient of this icon 50 is a = cos (n /
π), b = sin (n / π), c = 1, d = 2, e = 1, and n is the number of frames from 1 to 60.

If the icon 50 is fixed to the camera, the frame 2 of each frame should be slightly shifted to the upper right, as shown in FIG. 6, but the icon 50 shows an initial screen (in this case, a representative screen). From 1), it is shown that the camera rotates in 1 / π increments per frame about the optical axis and the camera is oriented in the lower right direction. By understanding such rules, the contents of camera operation can be understood at a glance.

Using the Helmert transform in this way,
Arrangement information of each frame on the screen for icon production can be obtained mathematically by using the value of the camera operation information obtained from the image, and the icon can be easily produced on the computer. Further, even when a sensor attached to the camera is used, the arrangement information of each frame can be calculated in the same manner by using the amount of change, and the icon 50 of the present invention can be manufactured.

Further, as shown in FIG. 3, by arranging a plurality of icons 50a, 50b, etc., it becomes possible to understand a video of a certain length at a glance.
It can be used as an aid for editing while helping to understand the video.

In FIG. 4, the screen 10 of the frame corresponding to the change point of each camera operation is separately shown by a leader line 11 so that the expansion of the icon 50 can be more easily understood. This makes it possible to display icons that are easier to see.

Further, in the above description, 2 is the frame of the frame, but the image of each frame constituting the actual video is used as the real image, and the icons 50 are made by stacking them. .. By doing so, a part of each image, which has no overlap with the subsequently superimposed actual image, can be seen. This is harder to understand than when the entire real image is visible, but when a person who has knowledge of the target video uses this icon 50, partial information may be visible on other than the representative screen 1. Very helpful to remember the flow of content,
This and the camera operation information can be obtained from the same icon 50. Therefore, it is possible to grasp the image in more detail simply by glancing at the icon 50. This is an effect that the icon 50 composed of only the simple frame 2 does not have.

[0033]

As described above, the present invention shows the time course in a moving image as a combination of frame frames,
This icon is shown as a combination of a graphic and a representative screen showing the change in the shooting position associated with camera operation in this video, so the contents of the video can be read at a glance, and as a means of using camera operation for editing. Will be available.

Further, when the Helmert transformation is used, it is possible to mathematically create an icon by using the value of the operation information of the camera, and the processing on the computer becomes easy.

Further, since a plurality of real screens are added to the frame at the time when the camera operation changes, the contents of the icon can be understood in more detail in the combination of the frames of the frames showing the passage of time in the moving image. Furthermore, when it is shown as an overlap of real images, the surrounding image becomes visible, and the content in the icon is improved.

[Brief description of drawings]

FIG. 1 is an elevation view of an icon with a representative screen used in the present invention.

FIG. 2 is an elevation view of another icon used by the present invention.

FIG. 3 is an elevation view in which a plurality of icons with a representative screen used in the present invention are arranged.

FIG. 4 is an elevation view of another icon used by the present invention.

FIG. 5 is a diagram showing an example of an icon using Helmert conversion used in the present invention.

FIG. 6 is a plan view of an icon using the Helmert transform of the present invention.

FIG. 7 is an elevational view of an icon using the Helmert transform used by the present invention.

[Explanation of symbols]

 1 Representative screen 2 Frame frame 3 Progress display line 4 Temporary line 5 Camera operation range 10 Screen 11 Leader line 50 Icon

Claims (5)

[Claims] 1. A method of displaying a moving image content, characterized in that a time course in a moving image is shown as a combination of frame frames, and a change in a state of a photographing position due to a camera operation in the moving image is shown as a figure. 2. The moving image content display method according to claim 1, wherein Helmert conversion is used to convert the change in the state of the photographing position due to the camera operation in the moving image into a figure. 3. The moving image content display method according to claim 1, wherein the combination of frames of frames showing the passage of time in the moving image is a superposition of real images. 4. A screen of a frame at a time point when a camera operation of a moving image included in a combination of frame frames showing a temporal passage in a moving image changes in a time frame of the combination of the frame frames. The moving image content display method according to claim 1 or 3, wherein the moving image content is displayed in correspondence with different positions. 5. A screen of a frame representing a moving image included in a combination of frame frames showing a time course in a moving image and the frame frame combination corresponds to a temporal position of the frame frame combination. The moving image content display method according to claim 1 or 3, wherein the moving image content is displayed by being displayed.