JPH02260075A - Display device - Google Patents

Abstract

PURPOSE:To quickly confirm the outline of a large amount of animation data with high reproducibility and to facilitate the check of short cuts by joining together 1-dimensional pictures corresponding to the data obtained with a 1-dimensional sampling operation for production of a still picture. CONSTITUTION:The video signals received from a VTR 14 are written into a VRAM 16 via an A/D converter 15. An image processor 17 reads the data on a part enclosed by a vertical slit (input slit) 4 out of the picture data on the VRAM 16 and writes the data into a part enclosed by a vertical slit (output slit) 7 of a VRAM 23 consisting of a frame memory after compression. Then the processor 17 supplies the picture element data read out of the VRAM 23 to a synthesizing circuit 25 together with the data on the instructed cursor/frame numbers read out of a cursor RAM 24 and produces the synthetic picture data. This picture data is supplied to a monitor 27 and an external storage 28 via a D/A converter 26. Then the video signals reproduced out of the storage 28 and the data on the frame numbers are written into the VRAM 23 and the RAM 24 via an A/D converter 29 and a system bus 11.

Description

DETAILED DESCRIPTION OF THE INVENTION [Field of Industrial Application] The present invention relates to a display device suitable for use, for example, in aggregating video tapes or searching the contents of a video database.

[Summary of the invention]

The present invention provides a display device suitable for use, for example, in editing a videotape or searching the contents of a video database.
means for one-dimensionally sampling each of a series of moving image data to be displayed dimensionally; means for moving the second sampling position horizontally or vertically; and a still image constructed based on the data obtained by the sampling. By being equipped with a means for displaying the video data, it is possible to quickly check the outline of the huge amount of video data that has been recorded in an invisible state as a still image in a compressed form corresponding to the passage of time, and also to display the video data. Television (TV) present in the image data
) This allows you to easily check short cuts of commercials, etc.

[Conventional technology]

It is possible to check the outline of a material recorded as a visible image, such as a so-called cine film, and to select a desired cut simply by visually observing the material.

On the other hand, in the case of materials such as video tapes and video discs where the moving image data is recorded in an invisible state, to get an overview of the material, display it one screen at a time on the monitor and perform a high-speed search as necessary. For example, as disclosed in Japanese Patent Publication No. 61-44437, multiple frames of moving images are reduced as they are and displayed in a scrolling manner using a so-called multi-screen display on a monitor. .

[Problem to be solved by the invention]

However, among the conventional methods for checking the overview of moving images recorded on video tapes, etc., the method of sequentially displaying one frame or multiple frames on a monitor does not allow for example a one-hour TV program. It takes more time to check the outline of the videotape, which has the disadvantage of extremely poor editing efficiency.

Furthermore, when checking the outline of a TV program using a so-called high-speed search, short cuts such as TV commercials may be overlooked, and the check is not reproducible and may vary depending on the operator. Ta.

In view of these points, the present invention enables quick and reproducible confirmation of the outline of a huge amount of moving image data that is recorded in an invisible state, and allows short cuts in the moving image data to be easily checked. The purpose is to make it easy to check.

[Means to solve the problem]

For example, as shown in FIG. 1, the display device according to the present invention displays a series of two-dimensionally displayed moving image data (2A) to (2E) one-dimensionally (for example, by vertical slits (4A) to (4E)). The means for sampling and the sampling position left and right (horizontal direction H) or up and down (vertical direction ■)
and means for displaying a still image (5) constructed based on the data obtained by the sampling.

[Effect]

According to the present invention, the still image (5) is formed by, for example, joining together one-dimensional images corresponding to data obtained by one-dimensional sampling. Therefore, the series of moving image data (2A) to (
2E) can be confirmed as a compressed still image corresponding to the passage of time.

In addition, because the one-dimensional sampling position is moved left and right (horizontal direction H) or up and down (vertical direction ■), the images of the series of video data (2^) to (2E) are slow. For example, if the images of the data obtained by sampling are connected two-dimensionally, a series of moving image data (2A) to (2
The average original image of E) is restored. Therefore, the outline of the original image can be recognized.

Furthermore, if the images of the series of moving image data (2A) to (2E) change rapidly, such as when a TV commercial is inserted, the images of the data obtained by sampling them may be converted into two-dimensional images. A disconnection occurs at a predetermined position in the image that is stitched together. Therefore, insertion of short cuts, etc. can be easily confirmed.

〔Example〕

Hereinafter, one embodiment of a display device according to the present invention will be described with reference to the drawings.

FIG. 1 is a diagram for explaining the processing of moving image data according to this example. In FIG. 1, (1) shows a video image group as a whole to be edited, and this video image group (1)
can be thought of as moving images corresponding to a series of moving image data recorded on a VTR videotape, for example, arranged in units of one frame (two fields) (2) in the time (1) axis direction. The frame frequency of the video signal is 3
Since the frequency is 0 Hz, 30 frames (2) are arranged per second in the video image group (1). Also,(
2A) to (2E) each show a series of frames of the video image group (1).

In frame (2) of the video image group (1), (
4) indicates a vertical slit (input slit) for inputting image data, and this vertical slit (4) samples the image of the frame (2), and also samples this vertical slit (4) in the horizontal direction (H direction). After scanning at a predetermined speed and reaching the right end of the frame (2), scanning is repeated from the left end in the H direction.

Therefore, the vertical slit (4) is scanned in the diagonal 1-1 direction in a three-dimensional space including the time axis.

When the vertical slit (4) scans the video image group (1) from the left end to the right end in the H1 direction, f
The vertical slits (4) across the frames
Assume that one slit-shaped image is sampled for n (usually n-1) frames. Then, if r is selected as a multiple of n, f = nX (1) is established using a predetermined integer X, and a frame group (3A
) and (3B), X slit-shaped images are sampled, respectively. In this example, the vertical slit (
4) sets the time required to scan the video image group (1) from the left end to the right end in the Ht force direction to 12 seconds, and if n = 1, then the slit-shaped image of The reduced screen (6A) is compressed to 115 in the horizontal and vertical directions, and this reduced screen (6A) is connected to the display screen (5) corresponding to one frame memory. It's like fitting it into the. Similarly, X slit-shaped images obtained from the frame group (3B) are joined horizontally and then compressed to create a reduced screen (6B).
and convert this reduced screen (6B) into its display screen (5)
Insert it next to the reduced screen (6A) inside. In reality, the images sampled by the vertical slit (4) are generated one by one in time series, so the slit-like images are compressed in the order in which they are generated and displayed on the display screen (5).
), insert them one by one.

Vertical slits (4^) to (4E) for sampling correspond to individual frames (2A) to (2E) in Fig. 1, respectively.
are allocated to scan in the H direction, and the images (4a) to (4e) sampled by these vertical slits (48) to (4B) are respectively compressed and displayed on the display screen (5).
Since the image is of the vertical slits (7A) to (7E), these vertical slits (7A) to (7E) are also referred to as output slits, respectively. Also, vertical slit (4A) ~
Methods for compressing the image sampled in (4E) include a method of simply thinning out the image data and a method of taking a weighted average of a predetermined area. When simply thinning out image data, the slits (4A) to (4E) may have a width of only one pixel in the H direction.

An embodiment of the display device for processing the moving image data shown in FIG. 1 will be described with reference to FIG. 2. In FIG. 2, (8) indicates a host computer;
This host computer (8) uses coordinate values and
Frame number conversion means (9) and control means for the entire device (
functions as lO). (11) is the system bus, (1
2) indicates the keyboard, and the operator uses the keyboard (1)
2) From the input/output circuit (13) and system bus (11)
Various commands are given to the host computer (8) via the host computer (8).

(14) is a video tape recorder (VTR) as a moving image data source, (15) is an analog/digital (A/
D) Converter, (16) indicates a first video signal RAM (VRAM, ) consisting of a frame memory, V T
The video signal supplied from R (14) is
, B-Y minute # (so-called 4:'2:2 standard), RGB separation, etc., and then converted to a digital signal via an A/D converter (15), and this digital signal is stored in the VRAM.

Write in (16). The storage area of the VRAM (16) corresponds to the actual display screen, as shown in FIG. 3A, with HL dots in the horizontal direction (VX1 direction) and VL dots in the vertical direction (VY1 direction). The address of each pixel data read from t6) is set to the coordinates (VXI, VY
I) Indicate by Co≦VX1≦HL, 0≦■Y1≦VL).

Returning to FIG. 2, (17) indicates an image processor,
This image processor (17) is a VRAM.

The data in the area surrounded by the vertical slit (input slit) (4) (see Fig. 3A) is read from the image data in (16), and the read data is compressed to generate a second video signal consisting of a frame memory. RAM for (V R
A M t> Write in the area surrounded by the vertical slit (output slit) (7) (see Figure 3 B) of (23), and write each output slit (7) on the screen corresponding to that vRAMz (23). ) has the function of moving a pointing cursor that indicates an arbitrary area surrounded by If the image processor (17) is expressed as a set of means corresponding to its functions, the image processor (17) includes an input slit moving means (18), a slit data reading means (
19), output slit moving means (20), slit data writing means (21) and instruction cursor display means (22)
). Also, as shown in Figure 3B, the storage area of VRAMz (23), like VRAMI (16), has HL dots in the horizontal direction (VX2 direction) and HL dots in the vertical direction (VY2 direction).
direction) as a VL dot, its V RAM t (
23) The address of each pixel data to be written to the coordinates (VX2
．． VY2).

Further, (24) indicates a cursor RAM for storing the position of the instruction cursor, and this cursor RAM (
24) is designed to be able to store identification data equal to the number of storage pixels of the VRAMz (23) divided by the number of pixels of the output slit (7), and each identification data is 1-bit data and compression corresponding to the presence or absence of the instruction cursor. It consists of the frame number of the frame ((2A) to (2E) etc. in FIG. 1) to which the slit data belongs. The pixel data read from the VRAM (23) and the instruction cursor/frame number data read from the cursor RAM (24) are supplied to the synthesis circuit (25) to form composite image data. is converted into a video signal via a digital-to-analog (D/A) converter (26) and then displayed on a monitor (27).
(Video printer etc. may also be used) and external storage device (
VTR, floppy disk, etc.) (28). The video signal and frame number data recirculated from this external storage device (28) are written to the VRAMz (23) and cursor RAM (24) via the A/D converter (29) and system bus (11), respectively. Make it as if you can put it into it.

The image data of the video image group stored in the VTR (14) using the display device of the example in FIG. 2 is stored in the VRAM.

(16) (FIG. 3A) to write a series of slit data to V RAMg (23) (FIG. 3B) will be explained for each step shown in FIG. 4. In this case, VRAMz (23) (7) (X X Y
) reduced images consisting of pixels (6A), (6B).
...It shall be written in a closed form.

Step (101) Calculate ΔX and ΔY according to the following formulas.

AX=HL/X, ΔY=VL/Y −・−(3) Δ
X and ΔY do not need to be integers; VRAM.

(16) A block consisting of (ΔX×ΔY) pixels (
30) (7) Pixel data to VRAMI (23) (7
) is compressed to the value of one pixel (31). In this example, in order to easily compress
) Book (30) (7) Coordinates of the upper left corner (VXl, V
The value of the pixel whose address is YI) is directly transferred to that VRA.
Let it be the value of one pixel (31) whose address is the coordinates (VX2.VY2) of MI (23). Also, ΔX, ΔY
If is a non-integer, the coordinates (VXI, VYI) are no longer a pair of integers, so the value of the pixel indicated by the coordinates (VXI, VYI) is calculated by interpolation from the values of surrounding pixels.

In addition, in the VRAM (23), a reduced screen (such as (6A)) consisting of X vertical slits (7) is
Assume that FR is arrayed in total. Then, the number of pixels in the horizontal margin is χ5, the number of pixels in the vertical margin is Ye, and the reduced screens (6A) and (6B).

If the numbers FR of ... are respectively 0, 1, etc., then h
= (XL-X,)/X ----(4) holds true. Furthermore, while setting FR=0 as the initial value,
Pixel data for one frame is written into the VRAM (16), and the corresponding frame number is written into the cursor RAM (24).

Step (102) VRAMI (23) number FR reduced screen ((6A)
.

Assuming the coordinates of the upper left corner of (6B) etc. as (BX, BY),
If the number of pixels in the left margin in the horizontal direction is X, 1, and the number of pixels in the top margin in the vertical direction is Yst, then BX = (FRa
+od h)X+X-+ ”(5)BY= (FR
/h)Y+Y□...(6), formula (6)
In, (FR/h) represents an integer not exceeding FR/h.

Step (103) Coordinates VXI of input slit (4) of VRAM, (16)
.

The initial values of the output slits (force coordinates ■χ2) of V RA M t (23) are each set to 0.BX.

Step (104) Coordinates VYI of input slit (4) of VRAM, (16)
.

Coordinates VY2 of output slit (7) of VRAM2 (23)
The initial values of are set to O and BY, respectively.

Steps (105) and (106) The image processor (17) reads the value of the pixel at the coordinates (VXI, VYI) of the VRAM (16) and converts it to VRAMz.
After writing the value of the pixel at the coordinates (VX2.VY2) in (23), the value of the coordinate VYI is increased by ΔY, and the value of the coordinate VY2 is increased by 1.

Step (107) Read data from input slit (4) of VRAM (16).

When reading in the direction, VRAM! The data of the output slit (7) of (23) is written in the D2 direction. And the coordinate VY of input slit (4) of VRAM (16)
When I is less than or equal to VL, the process returns to step (105), and when the coordinate VYI exceeds VL, the process returns to step (108).
).

Steps (108), (109) Increase the value of VXI by ΔX, and increase the value of VX2 by 1.

This means that VRAM, (16) manual slit (4)
Move the position of ΔX to the right, and V RA M z (23)
This means shifting the position of the output slit (7) by 1 to the right. Then, the host computer (8)
Image data of the n-th frame from the current frame is input from R (14) and written to the VRAM (16). At this time, the frame number of the image data is written in a predetermined area of the cursor RAM (24).

Step (110) VRAM, coordinates of input slit (4) of (16) VXI
When the coordinate VX1 is below HL, the process returns to step (104), and when the coordinate VX1 exceeds HL, it means that one horizontal scan of the input slit (4) has been completed, so the process moves to step (111). do.

Steps (111), (112) Increment the reduced screen number FR by 1 and set the number FR to V.
When RAMz (23) is less than or equal to the allowable number of reduced screens FR6, the process returns to step (102) and the number FR
When the number exceeds the number FR0, the process shifts to step (113) and post-processing is performed. For post-processing, VRAMz (23
) and the frame number data of the cursor RAM (24) are stored in the external storage device (28) via the D/A converter (26), and the VRAM t
It is conceivable to supply the image data of (23) to the monitor (27) via the D/A converter (26), but then the operation returns to step (101) again.

By doing so, the image data of the video image group (1), which is a collection of moving image data shown in FIG. 5, is stored in the external storage bag W (2g ).

When the external storage device (28) is a VTR or the like, in order to observe the compressed image data, the video signal and frame number data played back by the VTR or the like are A/
VRAM! via the D converter (29). (23) and cursor RAM (24), respectively. Then, by supplying the image data of the VRAM 2 (23) to the monitor (27) via the D/A converter (26), the display screen (5) of the monitor (27) is displayed as shown in FIG. 6, for example. Like, multiple reduced screens (6A), (6B)
An image consisting of , . . . is displayed. Each reduced screen (6
A), (6B), ... are video image groups (
1) Slit data sampled from image data of f (=nX) frames with a slight phase shift is compressed and synthesized.

Furthermore, in this example, the operator uses the keyboard (12) to drive the image processor (17) via the host computer (8), thereby changing the display screen (5).
The pointing cursor (32) can be displayed at any position in the horizontal and vertical directions. Further, in the upper right corner of the display screen (5), the frame number (33) in the video image group (1) of the image data corresponding to the output slit indicated by the instruction cursor (32) can be displayed. can. These can be performed by using the cursor RAM (24).

As described above, according to this example, the vertical slits (7) correspond to the image data obtained by sampling the vertical slits (4) at different positions every n frames of the video image group (1). By joining the images of
Reduced screen (6A), (611) which is a still image.

(6C)... is formed. Therefore, there is an advantage that the outline of the moving image of the video image group (1) can be confirmed as a still image compressed in both the horizontal and vertical directions corresponding to the passage of time.

In addition, since the position of the vertical slit (4) is changed so that it scans from the left edge to the right edge of one screen in 12 seconds,
For example, 25 reduced images (6A) are displayed on the display screen (5).
, (6B) ,..., 12
X25 = 300 (seconds) = 5 (minutes) ...From (7), it is possible to compress and display 5 minutes of video signal moving image data on one display screen (5). . Furthermore, assuming that the frame frequency of the video signal is 307, n=
If it is 1, then 30 x 12 x 25 = 9000 ・
...From (8), 9000 frames of video data are compressed and displayed on the display screen (5) for 1 frame, so according to this example, the compression is extremely large. There is an advantage that a series of video data can be compressed at a high rate.

Further, according to this example, the number of moving images in the video image group (1) is 12.
If the change is slow based on seconds, it is because the vertical slit (4) is scanning from the left end to the right end.
As shown in the reduced screens (6^) and (6G) in the figure, it is possible to restore almost the original state of the moving image. On the other hand, if the moving images of the video image group (1) suddenly change, the scene will be discontinuous in any of the reduced screens (6^), (6B), etc. as shown in Figure 6. For example, in the case of moving image data such as a TV commercial where one cut can be completed in about 10 seconds, a disconnection (34) that changes automatically is formed. 6^), (6B),...
This means that two disconnections (34) are formed within.... In this case, move the instruction cursor (32) to the disconnection (3).
4), it is possible to read the frame numbers (33) of the original image before and after the disconnection (34).

Therefore, according to this example, even though the video data is compressed and displayed at a compression rate of approximately 1/9000 as described above, it is not possible to check the outline of parts that change slowly. At the same time, disconnection occurs in the reduced screen (34)
Don't overlook the presence or absence of short cuts (there is a profit that can be confirmed).

In the above embodiment, image data was sampled from each frame (2) of the video image group (1) using the vertical slit (4), but the present invention is not limited to this, and as shown in FIG. As shown in FIG. 2, image data may be sampled from each frame (2) using a horizontal slit (35). In this case, the horizontal slit (35) is periodically scanned at a predetermined speed from the upper end of the frame (2) in the vertical direction (V direction) to the lower end.

In addition, in the above embodiment, as shown in FIG. 1, the slit data extracted from the individual frames (2A) to (2E) are compressed and synthesized, but the slit data is not compressed and is combined in the horizontal or vertical direction. They may be joined together to form a display screen (5). Furthermore, the present invention can be effectively used for searching the contents of video databases.

As described above, the present invention is not limited to the above-described embodiments, and it goes without saying that various configurations may be adopted without departing from the gist of the present invention.

〔Effect of the invention〕

According to the present invention, it is possible to quickly check the outline of a huge amount of moving image data that is recorded in an invisible state as a still image in a compressed form corresponding to the passage of time, and also to There is an advantage in that it is easy to check short cuts of existing TV commercials, etc.

[Brief explanation of drawings]

FIG. 1 is a diagram for explaining processing of moving image data according to an embodiment of the present invention, FIG. 2 is a configuration diagram showing a display device according to an embodiment,
FIG. 3 shows the VRAM (16) and VRAM of the embodiment.
z (23); FIG. 4 is a flowchart showing the operation of the display device of the example in FIG. 2;
FIG. 5 is a diagram showing an example of the video image group (1) as input data, FIG. 6 is a diagram showing the processing result of the example in FIG. 5, and FIG. 7 is a diagram showing a modification of the example in FIG. 1. It is a line diagram. (2A) to (2F) are frames, (4A) to (4E), respectively.
) are the vertical slits, (5) is the display device, (16) is the first video signal RAM (VRAM, ), (17)
is an image processor, (23) is a second video signal RAM (RAM2), and (27) is a monitor. Agent Hidemori Matsukuma

Claims (1)

[Claims] means for one-dimensionally sampling each of a series of moving image data to be displayed two-dimensionally, means for moving the sampling position left and right or up and down, and a still image constructed based on the data obtained by the sampling. A display device comprising: means for displaying.