JP2864523B2 - Display device - Google Patents

Description

Description: BACKGROUND OF THE INVENTION The present invention relates to a display device suitable for use in, for example, editing a video tape or retrieving the contents of a video database.

[Summary of the Invention]

The present invention is, for example, in a display device suitable for use in videotape editing and video database content search,
Means for one-dimensionally sampling a series of two-dimensionally displayed moving image data, means for moving the sampling position to the left or right or up and down, and a still image formed based on the data obtained by the sampling Means for displaying a large amount of moving image data recorded in an invisible state can be quickly checked as a still image in a compressed form corresponding to the passage of time, and the moving image Television (T
V) Short cuts such as commercials can be easily checked.

[Conventional technology]

Confirmation of the outline of a material recorded as a visible image such as a so-called cine film and selection of a desired cut can be performed simply by visually observing the material.

On the other hand, in the case of a material such as a video tape or a video disk on which moving image data is recorded in an invisible state, to know the outline of the material, display it on the monitor one screen at a time and perform a high-speed search as necessary. Or a method in which moving images of a plurality of frames are directly reduced and displayed in a scrolling manner by a so-called multi-screen display on a monitor as disclosed in Japanese Patent Publication No. 61-44437, for example. .

[Problems to be solved by the invention]

However, of the conventional methods for confirming the outline of a moving image recorded on a video tape or the like, a method of sequentially displaying a screen of one frame or a plurality of frames on a monitor is, for example, a one-hour TV program. It took more time to check the outline of the videotape, and the editing efficiency was extremely low.

Furthermore, when the outline of a TV program is checked by a so-called high-speed search, a short cut such as a TV commercial may be overlooked, and the confirmation may not be reproducible and may vary depending on the operator. Was.

In view of the above, the present invention enables the outline of a huge amount of moving image data recorded in an invisible state to be quickly and reproducibly confirmed, and the short cuts included in the moving image data to be confirmed. The purpose is to facilitate checking.

[Means for solving the problem]

For example, as shown in FIG.
Means for one-dimensionally sampling each of a series of moving image data (2A) to (2E) displayed in one dimension (for example, by vertical slits (4A) to (4E)); ) Or means for moving up and down (vertical direction V), and means for displaying a still image (5) formed based on data obtained by the sampling.

[Action]

According to the present invention, for example, a still image (5) is formed by connecting one-dimensional images corresponding to the data obtained by one-dimensional sampling. Therefore, the series of moving image data (2A)
The outline of (2E) can be confirmed as a still image in a compressed form corresponding to the passage of time.

Further, since the position of the one-dimensional sampling is moved left and right (horizontal direction H) or up and down (vertical direction V), the series of moving image data (2A) to (2E) is slowly In the case of a change, for example, an average original image of the series of moving image data (2A) to (2E) is restored by two-dimensionally connecting data images obtained by sampling. Therefore, the outline of the original image can be recognized.

Further, when the series of moving image data (2A) to (2E) change abruptly, for example, when a TV commercial is inserted, the image of the data obtained by sampling the two-dimensional images is converted into a two-dimensional image. A disconnection occurs at a predetermined position of an image that is connected to. Therefore, insertion of a short cut can be easily confirmed.

〔Example〕

Hereinafter, an embodiment of a display device according to the present invention will be described with reference to the drawings.

FIG. 1 is a diagram for explaining processing of moving image data according to the present embodiment. In FIG. 1, (1) shows a video image group as a whole which is symmetrical to editing, and this video image group (1) is, for example, a VTR. It can be considered that moving images corresponding to a series of moving image data recorded on a video tape are arranged in the direction of the time (t) axis in units of one frame (two fields) (2). Since the frame frequency of the video signal is 30 Hz, 30 frames (2) are arranged per second in the video image group (1). Also, (2
(A) to (2E) show a series of frames of the video image group (1), respectively.

In frame (2) of the video image group (1),
(4) indicates a vertical slit (input slit) for inputting image data. The vertical slit (4) samples the image of the frame (2) and sets the vertical slit (4) in the horizontal direction (H direction). When the frame is scanned at a predetermined speed and reaches the right end of the frame (2), scanning is repeated from the left end in the H direction again. Accordingly, the vertical slit (4) is scanned obliquely in the _Ht direction in a three-dimensional space including the time axis.

F when its vertical slits (4) is gradually scanned to the right portion H _t direction that video GOP (1) from the left end
Crosses one frame and its vertical slit (4)
It is assumed that one slit-shaped image is sampled for n (normally n = 1) frames. When f is selected to be a multiple of n, f = nX (1) is established using a predetermined integer X. From the frame groups (3A) and (3B) composed of the f frames (2), Each of the X slit images is sampled. In this example, it is assumed that the time required for the vertical slit (4) to scan the video image group (1) from the left end to the right end in the Ht direction is set to 12 seconds, and that n = 1. F = X = 12 × 30 = 360 (sheets) (2) Then, the X obtained from the frame group (3A)
After connecting the slit images in the horizontal direction, the images are compressed to 1/5 in the horizontal and vertical directions to reduce the screen size (6
A) is formed, and the reduced screen (6A) is fitted into the display screen (5) corresponding to one frame memory. Similarly, X slit images obtained from the frame group (3B) are connected in the horizontal direction and then compressed to form a reduced screen (6B), and this reduced screen (6B) is displayed. It fits next to the reduced screen (6A) in the screen (5). Actually, the images sampled by the vertical slits (4) are generated one by one in the time series, so that the slit-shaped images are compressed in the order of generation and fitted into the display screen (5) one by one. I will go into it.

Vertical slits (4A) to (4E) for sampling are respectively allocated so as to scan in the H direction corresponding to the individual frames (2A) to (2E) in FIG. Image (4a) sampled in (4E)
Since (4e) is compressed to become the images of the vertical slits (7A) to (7E) of the display screen (5), these vertical slits (7A) to (7E) are also referred to as output slits.
As a method of compressing an image sampled by the vertical slits (4A) to (4E), there are a method of simply thinning out image data and a method of taking a weighted average of a predetermined area. When simply taking out the image data, the slits (4
A) to (4E) may have a width of only one pixel in the H direction.

An embodiment of the display device for processing the moving image data shown in FIG. 1 will be described with reference to FIG. 2. In FIG. 2, (8) indicates a host computer, The computer (8) functions as a coordinate value / frame number conversion means (9) and a control means (10) of the entire apparatus as described later. (11) is the system bus, (1
2) indicates the keyboard, and the operator indicates the keyboard (1
2) Various commands are given to the host computer (8) via the input / output circuit (13) and the system bus (11).

(14) is a video tape recorder (VTR) as a moving image data source, (15) is an analog / digital (A / D) converter, and (16) is a first video signal comprising a frame memory.
A RAM (VRAM ₁ ) indicates that the video signal supplied from the VTR (14) is separated into Y, RY, BY (separate 4: 2: 2 standard), RGB, etc., and then an A / D converter ( The digital signal is converted into a digital signal via 15), and this digital signal is written to VRAM ₁ (16). VRAM ₁
(16) The storage area corresponds to the actual display screen, as shown in FIG. 3A, as HL dots in the horizontal direction (VX1 direction) and VL dots in the vertical direction (VY1 direction), from the VRAM ₁ (16). The address of each pixel data to be read is represented by coordinates (VX1, VY1) (0 ≦ V
X1 ≦ HL, 0 ≦ VY1 ≦ VL).

Returning to FIG. 2, (17) shows an image processor,
The image processor (17) reads data of a portion surrounded by a vertical slit (input slit) (4) (see FIG. 3A) from the image data of the VRAM ₁ (16), and compresses the read data. Second consisting of frame memory
The video signal RAM (VRAM ₂ ) (23) is written into a portion surrounded by a vertical slit (output slit) (7) (see FIG. 3B), and a screen corresponding to the VRAM ₂ (23) is written. Has a function of moving an instruction cursor indicating an arbitrary area surrounded by each output slit (7). When the image processor (17) is expressed as a set of means corresponding to the function, the image processor (17) includes input slit moving means (18), slit data reading means (19),
It comprises output slit moving means (20), slit data writing means (21) and indication cursor display means (22). The storage area of VRAM ₂ (23) is the same as VRAM ₁ (16)
As shown in FIG. B, the VRAM ₂ (23) has HL dots in the horizontal direction (VX2 direction) and VL dots in the vertical direction (VY2 direction).
Is designated by coordinates (VX2, VY2).

(24) indicates a cursor RAM for storing the position of the pointing cursor, and the cursor RAM (24) is a VRAM.
_{2 The} number of pieces of identification data obtained by dividing the number of storage pixels in (23) by the number of pixels in the output slit (7) can be stored, and each piece of identification data is 1-bit data corresponding to the presence or absence of the pointing cursor and the compressed slit. The frame to which the data belongs (first
(2A) to (2E) in the figure). The pixel data read from these VRAM ₂ (23) and the cursor R
The data of the instruction cursor / frame number read from the AM (24) is supplied to the synthesizing circuit (25) to form synthesized image data, and the synthesized image data is digital / analog (D / A)
The video signal is converted to a video signal via the
7) (It may be a video printer, etc.) and an external storage device (V
TR, floppy disk, etc.) (28). The video signal and frame number data reproduced from the external storage device (28) are transferred to the A / D converter (29) and the system bus (1).
The data can be written into the VRAM ₂ (23) and the cursor RAM (24) via 1), respectively.

The image data of the video image group stored in the VTR (14) using the display device of the example in FIG. 2 is converted into a series of slit data via the VRAM ₁ (16) (FIG. 3A) in the VRAM ₂ (23).
A series of operations for writing to (FIG. 3B) will be described for each step shown in FIG. In this case, a reduced image (6A) composed of (X × Y) pixels of VRAM ₂ (23) is obtained by compressing X pieces of slit data extracted one by one from each frame of VRAM ₁ (16). ), (6B)….

Step (101) Calculate ΔX and ΔY according to the following equations.

ΔX = HL / X, ΔY = VL / Y (3) ΔX and ΔY do not have to be integers, and (Δ) of VRAM ₁ (16)
The pixel data of the block (30) composed of (X × ΔY) pixels is compressed to the value of one pixel (31) of the VRAM ₂ (23).
In this example, in order to easily perform compression, the value of a pixel whose address is the coordinates (VX1, VY1) of the upper left corner of the block (30) of the VRAM ₁ (16) is used as it is in the coordinates (VRAM ₂ (23)). VX
2, VY2) as the address of one pixel (31). When ΔX and ΔY are non-integers, the coordinates (VX1, VY
Since 1) is no longer a pair of integers, the value of the pixel indicated by the coordinates (VX1, VY1) is calculated by interpolation from the values of surrounding pixels.

Further, assume that the VRAM ₂ (23) X number of vertical slits (7) from consisting condensation small screen ((6A) or the like) and the h arranged in the horizontal direction, and FR ₀ or sequence throughout. And
The number of pixels in the horizontal margin is X _s , the number of pixels in the vertical margin is Y _s , and the numbers FR of the reduced screens (6A), (6B),.
Assuming 1… h = (XL−X _s ) / X (4) Further, FR = 0 is set as an initial value, pixel data for one frame is written in VRAM ₁ (16), and the corresponding frame number is written in the cursor RAM (24).

Step (102) Reduced screen of number FR of VRAM ₂ (23) ((6A), (6B)
BX = (FRmod h) X + X, where X _{s1 is} the number of pixels in the left margin in the horizontal direction and Y _s1 is the number of pixels in the top margin in the vertical direction, where (BX, BY) is the coordinate of the upper left corner of _s1 (5) BY = [FR / h] Y + Y _s1 (6), and in the formula (6), [FR / h] indicates an integer not exceeding FR / h.

Step (103) Coordinates VX1 and VRAM of the input slit (4) of VRAM ₁ (16)
₂ Set the initial value of the coordinates VX2 of the output slit (7) of (23) respectively.
Set to 0, BX.

Step (104) Coordinates VY1, VRAM of the input slit (4) of VRAM ₁ (16)
₂ Set the initial value of the coordinates VY2 of the output slit (7) of (23) respectively.
Set to 0, BY.

Step (105), coordinates (106) the image processor (17) is VRAM ₁ (16) (VX
1, VY1) coordinates of VRAM ₂ reads the values of the pixels (23) (VX2,
After writing as the value of the pixel of VY2), the value of the coordinate VY1 is changed to Δ
The value of the coordinate VY2 is increased by 1 by increasing Y.

Step (107) the data of the input slit (4) of the VRAM ₁ (16) when read out to the D ₁ direction, the output slit of the VRAM ₂ (23) (7)
Data is written to the D ₂ direction. And VRAM ₁ (16)
When the coordinate VY1 of the input slit (4) is less than or equal to VL, the process returns to step (105), and when the coordinate VY1 exceeds VL, the process returns to step (108).

Steps (108) and (109) Increase the value of VX1 by ΔX and increase the value of VX2 by 1. This means that the position of the input slit (4) of VRAM ₁ (16) is Δ
This means that the position of the output slit (7) of the VRAM ₂ (23) is shifted by one to the right by X. Then, the host computer (8) inputs the image data of the n-th frame from the current frame from the VTR (14) VRAM ₁ (1
Write in 6). At this time, the frame number of the image data is written in a predetermined area of the cursor RAM (24).

Step (110) If the coordinate VX1 of the input slit (4) of VRAM ₁ (16) is less than HL, return to step (104). If the coordinate VX1 exceeds HL, move the input slit (4) in the horizontal direction. Since this means that one scan has been completed, the process proceeds to step (111).

Steps (111) and (112) Increment the number FR of the reduced screen by 1 and change the number FR to VRAM.
₂ (23) returns to step (102) when it is several FR ₀ following contraction small screen acceptable, performs post-processing in turn to step (113) when the number FR exceeds the number FR _0. As post-processing, VRAM ₂ (23) image data and cursor RAM
The data of the frame number of (24) is stored in the external storage device (28) via the D / A converter (26), or the VRAM ₂ (2
3) Monitor the image data (2) via the D / A converter (26).
Although it is conceivable to supply to (7), the operation returns to step (101) again.

In this way, the image data of the video image group (1), which is a set of moving image data shown in FIG. 5, is compressed in a manner that can be expressed as a kind of video slice, and is stored in the external storage device (28). Is accumulated in

When the external storage device (28) is a VTR or the like, in order to observe the compressed image data, the video signal and the frame number data reproduced by the VTR or the like are transferred to the VRAM via the A / D converter (29). ₂ (23) and cursor RAM (24)
Write to each. Then, by supplying the image data of the VRAM ₂ (23) to the monitor (27) via the D / A converter (26), the display screen (5) of the monitor (27) is displayed, for example, as shown in FIG. As shown, multiple reduced screens (6A), (6B), ...
Is displayed. Each reduced screen (6A), (6
B),... Are obtained by compressing and synthesizing slit data sampled with slightly shifted phases from the image data of f (= nX) frames of the video image group (1).

Further, in this example, the operator drives the image processor (17) via the host computer (8) using the keyboard (12), so that an arbitrary position in the horizontal and vertical directions is displayed in the display screen (5). Can display an instruction cursor (32). In the upper right corner of the display screen (5), a frame number (33) in the video image group (1) of the image data corresponding to the output slit pointed by the pointing cursor (32) can be displayed. it can. These can be performed by using the cursor RAM (24).

As described above, according to this example, n of the video image group (1)
By connecting the images of the vertical slit (7) corresponding to the image data obtained by sampling using the vertical slit (4) while changing the position for each frame, a reduced screen (6A) as a still image , (6B), (6C) ...
Are formed. Therefore, there is an advantage that the outline of the moving image of the video image group (1) can be confirmed as a still image in a form compressed in both the horizontal and vertical directions in accordance with the passage of time.

In addition, since the position of the vertical slit (4) is changed so as to scan from the left end to the right end of one screen in 12 seconds,
In the display screen (5), for example, 25 reduced images (6A),
When (6B),... Are formed, 12 × 25 = 300 (seconds) = 5 (minutes) From (7), a video signal for 5 minutes is displayed on one display screen (5). Can be displayed after being compressed. Further, assuming that the frame frequency of the video signal is 30 Hz, n =
Assuming that 1, 30 × 12 × 25 = 9000 (8) From the display screen (5) for one frame, the moving image data for 9000 frames is compressed and displayed. According to this, there is an advantage that a series of moving image data can be compressed with an extremely large compression ratio.

Further, according to this example, the moving image of the video image group (1) has 12 moving images.
When the speed changes slowly on the basis of seconds, the vertical slit (4) scans from the left end to the right end.
As shown in the reduced screens (6A) and (6Q) in the figure, the original image state of the moving image can be almost restored. On the other hand, when the moving image of the video image group (1) changes abruptly, the scene changes discontinuously to one of the reduced screens (6A), (6B),... As shown in FIG. A disconnection (34) is formed. This means that, for example, in the case of moving image data in which one cut can be accommodated in about 10 seconds, such as a TV commercial, one or two adjacent reduced screens (6A), (6B),. This means that the disconnection (34) is formed. In this case, the frame number (33) of the original image before and after the disconnection (34) can be read by moving the instruction cursor (32) over the disconnection (34).

Therefore, according to the present example, it is possible to confirm the outline of the portion that is changing slowly, despite the fact that the moving image data is compressed and displayed at a compression ratio of approximately 1/9000 as described above. In addition to this, there is an advantage that the presence or absence of a short cut can be confirmed without overlooking by the disconnection (34) occurring in the reduced screen.

In the above embodiment, the image data is sampled from the individual frames (2) of the video image group (1) using the vertical slits (4). However, the present invention is not limited to this, and FIG. As shown in (1), image data may be sampled from each frame (2) using a horizontal slit (35). In this case, the horizontal slit (35) is periodically scanned at a predetermined speed from the upper end of the frame (2) to the lower end in the vertical direction (V direction).

In the above embodiment, as shown in FIG. 1, slit data extracted from each of the frames (2A) to (2E) is compressed and synthesized. The display screen (5) may be formed by joining. Further, the present invention can be effectively used for searching contents of a video database.

As described above, the present invention is not limited to the above-described embodiment, and may adopt various configurations without departing from the spirit of the present invention.

〔The invention's effect〕

According to the present invention, an outline of a huge amount of moving image data recorded in an invisible state can be quickly confirmed as a still image in a compressed form corresponding to the passage of time, and the moving image data can be included in the moving image data. There is an advantage that it is easy to check a short cut of an existing TV commercial or the like.

[Brief description of the drawings]

FIG. 1 is a diagram for explaining processing of moving image data according to an embodiment of the present invention, FIG. 2 is a configuration diagram illustrating a display device according to the embodiment,
FIG. 3 is a diagram showing the data structure of each of VRAM ₁ (16) and VRAM ₂ (23) of the embodiment, FIG. 4 is a flow chart showing the operation of the display device of FIG. 2, and FIG. FIG. 6 is a diagram showing an example of a video image group (1) as input data, and FIG.
FIG. 7 is a diagram showing a processing result of the example of FIG. 7, and FIG. 7 is a diagram showing a modification of the example of FIG. (2A) to (2E) are frames, (4A) to (4E) are vertical slits, (5) is a display device, (16) is the first video signal RAM (VRAM ₁ ), and (17) is Image processor,
(23) is a second video signal RAM (VRAM ₂ ), and (27) is a monitor.

Claims (1)

(57) [Claims] 1. A means for one-dimensionally sampling a series of moving image data displayed two-dimensionally, a means for moving the sampling position to the left and right or up and down, and a method based on data obtained by the sampling. Means for displaying the constituted still image.