JP3304386B2 - Image display method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display method suitable for grasping moving image information recorded on, for example, a video tape or a video disk.

[0002]

2. Description of the Related Art Conventionally, when grasping moving image information recorded on a video tape, a video disk, or the like, it is conventionally performed by sequentially presenting two-dimensional image information along a time flow.

[0003]

For this reason, at each time point, only one two-dimensional image is viewed. Therefore,
For example, when performing an operation in the time axis direction such as fast-forward or rewind in a VTR, it has been difficult to properly grasp and predict the situation.

Accordingly, an object of the present invention is to provide an image display method which makes it easy to grasp the situation in the time axis direction.

[0005]

According to the present invention, a series of moving image data displayed two-dimensionally is obtained by sampling one-dimensionally in another direction while sequentially moving each sampling position in one direction. A still image formed based on data and a moving image formed based on moving image data are simultaneously displayed, and the still image is scroll-displayed in accordance with the progress of the moving image.

The still images to be displayed are characterized in that they are past, present and future still images based on a moving image .

[0007]

The still image is obtained by connecting one-dimensional images corresponding to data obtained by one-dimensional sampling. This still image can be confirmed as a still image obtained by compressing the outline of a series of moving image data in accordance with the passage of time. Therefore, the flow of time and the past or future situation in the time axis direction can be easily grasped by the still image displayed simultaneously with the moving image.

[0008]

An embodiment of the present invention will be described below with reference to the drawings.

In conventional moving image display, two-dimensional image information is sequentially extracted from moving image information (shown in FIG. 2A) as time advances, and only a moving image is displayed on the screen 100 (shown in FIG. 2B). ). Note that t indicates a time direction.

On the other hand, in the present embodiment, two-dimensional image information is sequentially extracted from the moving image information (shown in FIG. 3A), and the moving image is displayed on the screen 100. In addition, a video image group, which is a set of moving image data, is subjected to a kind of video slice processing (see a solid line in FIG. B) to form a video index (illustrated in FIG. C). Then, the video index (still image) is displayed on the screen 100 simultaneously with the moving image (illustrated in FIG. D). The video index is set in the horizontal direction (arrow a direction) according to the progress of the moving image.
Is scrolled.

Next, the video index will be described.

FIG. 4 shows processing of moving image data for creating a video index. In the figure,
Reference numeral 1 denotes a video image group as a whole. The video image group 1 can be considered to be a sequence of moving images corresponding to a series of moving image data recorded on a video tape, a video disk, or the like, arranged in the unit of frame 2 in the time direction.

The frame frequency of the video signal is 30 Hz
(NTSC system), the video video group 1
30 frames 2 are arranged per second. 2A to 2E
2 shows a series of frames of a video image group 1.

Reference numeral 4 denotes a vertical slit (input slit) for inputting image data set on the frame 2, and the image of the frame 2 is sampled by the vertical slit 4. The vertical slit 4 scans in the horizontal direction (H direction) at a predetermined speed, and when it reaches the right end of the frame 2, it repeatedly scans from the left end in the H direction again. Therefore, the vertical slit 4 is inclined Ht in a three-dimensional space including the time axis.
Scan in the direction.

When the vertical slit 4 scans the video image group 1 from the left end to the right end in the Ht direction, the vertical slit 4 crosses f frames 2, and the vertical slit 4 causes n (normally n = 1) frames. It is assumed that one slit-shaped image is sampled for.

When f is selected to be a multiple of n, f = nX is satisfied using a predetermined integer X, and a frame group (3) composed of f frames 2
A, 3B, etc.), each of which samples X slit images.

In this example, the time required for the vertical slit 4 to scan the video image group 1 from the left end to the right end in the Ht direction is set to 12 seconds, n is set to 1, and f is set to 1 X = 12 × 30 = 360.

X slit images obtained from the frame group 3A are connected in the horizontal direction, and are further compressed in the horizontal and vertical directions to form a reduced screen 6A. Similarly, X slit images obtained from the frame group 3B are connected in the horizontal direction and compressed horizontally and vertically to form a reduced screen 6B. Even in the following frame groups, reduced screens are formed in a similar manner.

Actually, since the slit-like images sampled by the vertical slits 4 are generated one by one in time series, the images are compressed in the order of generation to form a reduced screen.

For example, the vertical slits 4A to 4E are assigned so as to sequentially scan in the H direction corresponding to the frames 2A to 2E. The images on the slits sampled by the vertical slits 4A to 4E are respectively compressed to become the images of the vertical slits (output slits) 7A to 7E.

FIG. 1 shows an image display apparatus to which the method of the present invention is applied. In the figure, reference numeral 8 denotes a host computer. The host computer 8 functions as control means for the entire apparatus, such as creating a video index and forming a reduced moving image screen.

Reference numeral 11 denotes a system bus, and 12 denotes a keyboard.
And host computer 8 via system bus 11
To give various commands.

Reference numeral 14A denotes a video disk device as a moving image data source, 14B1 to 14BN also VTRs as moving image data sources, and 15 an A / D converter. Reference numeral 10 denotes a switch circuit. The switch circuit 10 switches input / output of video signals between the video disk device 14A and the VTRs 14B1 to 14BN, switches video signals supplied to the A / D converter 15, and the like.

16a is a video R composed of a frame memory.
AM (VRAM1). A video signal (for example, Y, RY, BY, or R, G, B component signal) output from the switch circuit 10 is converted to an A / D converter 15.
After being converted to digital data by the video RAM
(VRAM1) 16a.

The storage area of the video RAM 16a corresponds to the actual display screen, as shown in FIG.
HL dot in one direction) and VL in vertical direction (VY1 direction)
Dots. The address of the video RAM 16a is represented by coordinates (VX1, VY1) (0 ≦ VX1 ≦ HL-1, 0 ≦ V
Y1 ≦ VL−1).

Reference numeral 17 denotes an image processor.
The image processor 17 creates a video index. That is, the vertical slit 4 (see FIG. 5) is obtained from one frame of image data in the video RAM 16a.
Is read out, the data is compressed and the video index video RAM (VRA) is read out.
M2) 16b vertical slit (output slit) 7 (FIG. 6)
) Are sequentially written.

The video RAM 16b has a capacity to store, for example, image data for four reduced screens. As shown in FIG. 6, the storage area of the video RAM 16b has 4X dots in the horizontal direction (VX2 direction) and Y dots in the vertical direction (VY2 direction). Video RAM 16
The address of b is represented by coordinates (VX2, VY2) (0 ≦ VX1
≤ 4X-1, 0 ≤ VY1 ≤ Y-1).

The image data of the video index written in the video RAM 16b is stored in a video RAM for display.
(VRAM3) 16c is written to the video index area (see FIG. 8). In this case, the image data in the video index area Lb is sequentially updated so as to be horizontally scrolled.

In the video RAM 16c, the time point of the image data to be written in the moving image area La is set as the present time, and a pointer is displayed in the video index area Lb in correspondence with the current position of the image data to be written. Is written (see FIG. 8).

The video signal converted into digital data by the A / D converter 15 is written into a video RAM (VRAM 4) 16d after being delayed by a predetermined time by a delay circuit 9. Then, the image data written in the video RAM 16d is sequentially compressed by a process such as thinning out by the image processor 17 to form reduced moving image screen data, which is sequentially updated and written in the moving image area La of the video RAM 16c.

When the image processor 17 is expressed as a set of means corresponding to functions, the image processor 17 includes an input slit moving means 17a, a slit data reading means 17b, an output slit moving means 17c,
It comprises a slit data writing means 17d and a moving picture reduced screen data forming means 17e.

When the video index is created, the image data of the video image group 1 output from the switch circuit 10 is transferred to the video RAM 16b (shown in FIG. 6) as a series of slit data via the video RAM 16a (shown in FIG. 5). A series of operations at the time of writing will be described step by step along the flowchart of FIG.

In this case, X pieces of slit data extracted one by one from each frame of the video RAM 16a are collectively compressed and converted into (X × X) in the video RAM 16b.
It is assumed that writing is performed as reduced screens 6A, 6B,...

[Step 101] The number of pixels in the VX1 and VY1 directions constituting the pixel block 33 according to the following equation:
Calculate X and △ Y.

ΔX = HL / X ΔY = VL / Y ΔX and ΔY need not be integers, and the video RAM 16a
The pixel data of the block 33 composed of (△ X × △ Y) pixels is compressed to the value of one pixel 34 of the video RAM 16b.

In this example, in order to easily perform the compression, the pixel data having the coordinates (VX1, VY1) of the upper left corner of the block 33 of the video RAM 16a as the addresses are directly used as the coordinates (VX2, VY2) of the video RAM 16b. Is the data of the pixel 34. If ΔX and ΔY are non-integers, the coordinates (VX1, VY1) are not a pair of integers, and the value of the pixel indicated by the coordinates (VX1, VY1) is calculated by interpolation from the values of surrounding pixels. .

Also, four reduced screens (6A, 6B,...)
・) Set the numbers FR of 0) to 0 to 3 and initialize FR = 0.

The video RAM 16a stores a moving image data source (hereinafter, VTR1) selected by the switch circuit 10.
4B1) will be written.

[Step 102] The initial values of the coordinates VX1 of the vertical slit 4 of the video RAM 16a and the coordinates VX2 of the vertical slit 7 of the video RAM 16b are set to 0 and F, respectively.
Set to R · X.

[Step 103] The initial values of the coordinates VY1 of the vertical slit 4 of the video RAM 16a and the coordinates VY2 of the vertical slit 7 of the video RAM 16b are set to 0 and 0, respectively.
Set to.

[Steps 104 and 105] The image processor 17 sets the coordinates (VX1, VX1) of the video RAM 16a.
Y1) The pixel data is read and the video RAM 16b is read out.
After writing as pixel data of coordinates (VX2, VY2), the value of coordinates VY1 is increased by ΔY, and coordinates VY2
Is incremented by one.

[Step 106] When data of the vertical slit 4 of the video RAM 16a is read in the direction D1 (see FIG. 5), data of the vertical slit 7 of the video RAM 16b is written in the direction D2 (see FIG. 6). Then, the coordinates VY1 of the vertical slit 4 of the video RAM 16a
Is smaller than or equal to VL, the routine returns to step 104, and when the coordinate VY1 exceeds VL, the routine proceeds to step 107.

[Steps 107 and 108] The value of VX1 is increased by ΔX, and the value of VX2 is increased by 1. This means
This means that the position of the vertical slit 4 of the video RAM 16a is shifted to the right by ΔX, and the position of the vertical slit 7 of the video RAM 16b is shifted to the right by 1.

The host computer 8 is connected to the VTR 1
4B1 through the switch circuit 10 to input the image data of the n-th frame from the current frame,
Write to M16a.

[Step 109] If the coordinate VX1 of the vertical slit 4 of the video RAM 16a is less than or equal to HL, the flow returns to step 103. If the coordinate VX1 exceeds HL, it means that one horizontal scan of the vertical slit 4 of the video RAM 16a has been completed, and the process proceeds to step 110.

[Steps 110, 111, 112] The number FR of the reduced screen is increased by 1, and when the number FR is 3 or less, the process returns to step 102. When the number FR exceeds 3, the process returns to step 102 with FR = 0, and the above-described operation is repeated.

As a result, the video index is formed continuously, and the data of the video index (still image) for four screens is always written in the video RAM 16b, and the data is sequentially updated.

Therefore, as the vertical slit 7 of the video RAM 16b moves, the read area of the video RAM 16b is sequentially changed in the VX2 direction, and the read image data is written in the video index area Lb of the video RAM 16c. The above-described horizontal scroll display can be performed. In this case, the video RAM 16b
Is a moving image area L of the video RAM 16c.
A predetermined area before and after the center of the slit data portion at substantially the same time as the image data written in a. Then, the center slit data is written so as to correspond to the pointer data Dp indicating the present in the video RAM 16c.

Returning to FIG. 1, the image data read from the video RAM 16c is converted into an analog signal by the D / A converter 26 and supplied to the monitor 27. Monitor 27
3D, a moving image and a video index are displayed simultaneously. The video index is horizontally scrolled and displayed in the direction of the arrow in accordance with the progress of the moving image, so that near-past and near-future image information is displayed with the passage of time.

As described above, in this example, the flow of time and the image information of the near past and near future can be viewed simultaneously with the moving image by the video index, and the situation in the time axis direction can be easily grasped. There is an effect that the operation in the time axis direction such as fast forward and rewind can be facilitated. In addition, there is an advantage that the outline can be grasped by the video index without paying attention to the image at each time point.

In the above-described embodiment, the delay circuit 9 is arranged on the display path of the moving image to delay the display time of the moving image.
Although a video index indicating near-future image information is displayed, a video index indicating near-past and present image information can be displayed on the screen 100 of the monitor 27 by removing the delay circuit 9.

In this case, pointer data Dp indicating the present is written into the display video RAM 16c in correspondence with the end of the video index area Lb as shown in FIG. The read area of the video RAM 16b is a predetermined area before the slit data portion at substantially the same time as the image data written in the moving image area La of the video RAM 16c.

FIG. 10 shows a display on the screen 100 of the monitor 27. A video index indicating the past and present image information is displayed simultaneously with the moving image.

In the above embodiment, the video index data is formed from the moving picture data and
7, the moving image and the video index are simultaneously displayed on the screen 100. However, in addition to the moving image data, the video index data is recorded in advance on a package medium such as a video tape or a video disk ( In the normal display, only the moving image may be displayed (shown in FIG. B), and in the time stream display, the moving image and the video index may be displayed simultaneously (shown in FIG. 11C). .

Further, as the delay circuit 9 in the embodiment, a semiconductor memory, a delay disk memory, or the like can be used.

The individual frames 2 of the video image group 1
Instead of using the vertical slit 4 to sample the image data, the horizontal slit may be used to sample the image data. In this case, the horizontal slit is periodically scanned at a predetermined speed from the upper end of the frame 2 to the lower end in the vertical direction (V direction). By sampling in this manner, the video index can be scroll-displayed in the vertical direction.

[0057]

According to the present invention, a still image (video index) in which one-dimensional images corresponding to data obtained by one-dimensional sampling simultaneously with a moving image are scroll-displayed. The still image makes it easy to grasp the flow of time and the past and future situations in the time axis direction. For example, there is an advantage that operations in the time axis direction such as fast forward and rewind in a VTR become easy. Further, there is an effect that the outline can be grasped without watching the image at each time point.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of an image display device to which the method of the present invention is applied.

FIG. 2 is a diagram for explaining display of a moving image.

FIG. 3 is a diagram for explaining display of a moving image and a video index.

FIG. 4 is a diagram illustrating the concept of a video index.

FIG. 5 is a diagram showing a data structure of a video RAM (VRAM1).

FIG. 6 is a diagram showing a data structure of a video RAM (VRAM2).

FIG. 7 is a flowchart showing an operation at the time of creating a video index.

FIG. 8 is a diagram illustrating an area of a video RAM for display.

FIG. 9 is a diagram for explaining an area of a video RAM for display.

FIG. 10 is a diagram showing another example of the display screen.

FIG. 11 shows moving image data on a package medium,
FIG. 4 is a diagram for describing a case where video index data is recorded.

[Explanation of symbols]

 Reference Signs List 1 video image group 2 frame 3A, 3B frame group 4 vertical slit (input slit) 6A, 6B reduced screen 7 vertical slit (output slit) 8 host computer 10 switch circuit 14A video disk device 14B1 to 14BN VTR 16a to 16d video RAM 17 Image Processor 27 Monitor

────────────────────────────────────────────────── ─── Continuation of the front page (56) References JP-A-2-93492 (JP, A) JP-A-2-260075 (JP, A) (58) Fields investigated (Int. Cl. ⁷ , DB name) G09G 5/00-5/42 G06T 13/00 H04N 5/262-5/278 H04N 5/91-5/95

Claims (2)

(57) [Claims] 1. A still image constituted by a series of moving image data displayed two-dimensionally based on data obtained by sampling one-dimensionally in another direction while sequentially moving each sampling position in one direction. And simultaneously displaying a moving image formed based on the moving image data,
An image display method, wherein the still image is scroll-displayed in accordance with the progress of the moving image. 2. The image display method according to claim 1, wherein the displayed still images are past, present, and future still images based on the moving image.