JP2002221956A - Video data display system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video data display system which expands the applicable field of a video window system, and has better operability. SOLUTION: The video data display system is provided with a monitor function which displays a video outputted from an external video reproducing device on a video window, and a reproduction function which stores the video outputted from the external video reproducing device into a memory, and reads video data from the memory when necessary to display them on the video window.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a video window system capable of displaying video video information, and more particularly to a multi-window video data display system.

[0002]

2. Description of the Related Art In recent years, computer systems such as personal computers and workstations using microprocessors have tended to use multi-windows in pursuit of higher performance and a better user interface. In such a video window system, improvement of operability of a workstation and development of a new application method is a major problem. In particular, how to handle a general video signal such as an NTSC signal in a multi-window system is a major problem. It is one of the problems.

Conventionally, in a multi-window system, only text information is mainly handled. In recent years, however, a window provided with a window for displaying an image based on a general video signal as a moving image on a display of a workstation has been provided. Systems have also been proposed (for example, Araki et al., "VP-150 High-Definition Natural Image Processor",
NEC Technique VOL. 40 No. 7/1987 pp. 2
8-33 ").

In the device described in this document, a video signal is A / D-converted, stored in a primary memory, subjected to predetermined image processing, and then stored in a secondary memory. The contents of the secondary memory are read out in synchronization with the synchronization signal of the display, D / A-converted, combined with a video signal from a personal computer, and output to the display.

[0005]

However, in the apparatus described in the above-mentioned document, part or all of the image displayed by the personal computer is replaced with a video signal from another video signal source such as a VTR or a video camera. It is not possible to perform processing such as recording and editing on the video signal itself while viewing the displayed image.

The present invention has been devised to solve the above-mentioned problem. Video signals for a plurality of screens are temporarily recorded in a memory, and a predetermined operation is performed on the contents of the memory. Accordingly, an object of the present invention is to provide a video data display system having a wider application field of the video window system and having better operability.

[0007]

In order to achieve the above object, a video data display system according to the present invention has a monitor function of displaying a video image output from an external video reproduction device in a video window, and an external video reproduction system. A reproduction function of storing video output from the device in a memory, reading video data from the memory as necessary, and displaying the video data in a video window.

[0008]

BEST MODE FOR CARRYING OUT THE INVENTION

[0009]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The features of the present invention will be specifically described below based on embodiments with reference to the drawings.

FIG. 1 is a block diagram showing the principle configuration of a first embodiment of the video window system according to the present invention.

The video window system of the first embodiment, as shown in FIG. 1, converts at least an image (hereinafter referred to as a video image) based on a video signal output from a video reproducing device 1 such as a VTR or a video camera. A video window 2 that can be displayed; video data recording means 3 for recording a video signal corresponding to the video video displayed in the video window 2 in a memory in real time; a keyboard 4 and a mouse 5
Interface means 6 for interpreting the input signal
In response to the signal interpreted by the interface unit 6, any video data intended by the user is selected from a set of a plurality of video data recorded in the video data recording unit 3 and the video window 2 or another video window 7 is selected. And video data reproducing / displaying means 8 for displaying the data.

In this video window system,
Two types of display modes, a monitor mode and a reproduction mode, can be taken. Normally, the monitor mode is set, and the video window 2 displays a video image from the video reproduction device 1. In the reproduction mode, a video image from the video data reproduction display means 8 is displayed. .

Signals input from the keyboard 4 and the mouse 5 are output by the interface means 6 as control signals for the video data reproducing and displaying means 8, and a plurality of video data recorded in the video data recording means 3 are used for one screen. Minutes of video data. The selected video data is displayed in the video window 2 or another video window 7 by the video data reproduction / display means 8.

Next, a specific configuration of the first embodiment will be described with reference to the block diagram of FIG. FIG. 3 shows an example of the display screen of this embodiment.

In the example of FIG. 2, the video image display means 9 converts the video signal input from the video input terminal 10 into a digital signal by the A / D converter 11, and performs write control according to the field rate of the video signal. Table 12
To write to the video memory 13. Video memory 13
Are read out by the readout controller 14 controlled according to the scanning rate of the display to be displayed, and are converted into digital video signals. This digital video signal passes through a switch 15 for switching between a monitor mode for monitoring video input and a playback mode for displaying recorded image data, and further according to the size of a displayed video window. It is stored in a buffer 17 through a spatial filter 16 to prevent aliasing noise.

On the other hand, a display input from a computer, a workstation, or the like for displaying text information is also input to the image synthesizer 1 via the display input terminal 18.
9 is synchronized for display and buffer 1
The digital video signal is synthesized with the digital video signal stored in the digital video signal 7, and is output from the video output terminal 20 as a video output to the display device.

FIG. 3 shows an example of a display screen. A command input from the keyboard 4 (see FIG. 1) is echoed back and displayed on the display unit 51 of the display device, or the system is displayed. Window 52 for displaying the response from the user, video data recording means 2 described later
Video display window 5 for displaying one screen of image data read from one video data memory bank 22
3. A text window 54 or the like is displayed in which a part of the image data is cut out and displayed, and displayed together with the text data. In the text window 54, for example, a partial area of the image displayed in the video display window 53 is designated by using the mouse 5 or the like, and is copied into the text window 54 in which a character string input from the keyboard 4 is displayed. By doing so, it is possible to create a multimedia document in which a part of an arbitrary scene in a video image is cut out and incorporated in a document.

Further, the video data recording means 21 records the video video data D converted into a digital signal in order to record the video signal input from the video input terminal 10.
0, D1, D2,... From the video memory 13,
The write controller 12 assigns field numbers 0, 1, 2,... Starting from 0 and increasing for each field, and stores them in the video data memory bank 22. Table 1 shows an example of the state of storage in the video data memory bank 22.

[Table 1] In the interface means 23, the position information supplied from the mouse 5 (see FIG. 1) via the mouse input terminal 24 is counted by the coordinate counter 25 and held as the coordinates of the mouse cursor 55 (see FIG. 3). Is done. The mouse button detector 26 detects on / off information of the mouse button and outputs the information to the video data reproduction / display means 28. In this embodiment, as shown in FIG.
Consider a mouse 5 having three types of buttons: R, middle button 5C, and left button 5L. Also, as shown in FIG.
It is assumed that the mouse cursor 55 indicates a part of the scroll bar 56 on the display unit 51. The scroll bar 56 is disposed adjacent to the right side of the video display window 53 and has a length substantially equal to the height of the video display window 53. The coordinate counter 25 detects that the mouse buttons 5L, 5C, 5R have been pressed, and outputs the coordinates at that time to the normalizer 27. The normalizer 27
From the coordinate values, the ratio of the distance 1 from the starting point of the designated point on the scroll bar 56 to the entire length L of the scroll bar 56 is calculated, and the value α from 0 to 1 is sent to the video data reproduction / display means 28. Output.

In the video data reproduction / display means 28,
The number M of image data recorded in the video data memory bank 22 is held in a recorded image number holder 29.
When the recorded video data is reproduced and displayed on the video display window 53, an image indicating which field of the image data recorded on the video data memory bank 22 is displayed on the video display window 53. A counter 30 and a multiplier 31 for obtaining a field number F corresponding to an image to be displayed from the output α of the normalizer 27 of the interface means 23 and the output M from the recorded image number holder 29 are provided.

When the mouse button detector 26 detects that the right button 5R of the mouse 5 has been pressed, a signal C is output.
U is generated, and this signal CU causes the image counter 30
Is counted up, and as a result, the image data of the field recorded immediately after is displayed in the video display window 5.
3 is displayed.

The image counter 30 is counted down by a signal CD for detecting that the left button 5L has been pressed. As a result, the image data of the field recorded immediately before is displayed on the video display window 53. .

The multiplier 31 multiplies the value α from 0 to 1 output from the normalizer 27 of the interface means 23 by the content M of the number-of-recorded-images holding device 29, so that the mouse 5 Is obtained, and the field number F is loaded into the image counter 30 by a signal LD for detecting that the middle button 5C is pressed. As a result of the loading, the image data of the field number recorded in the video data memory bank 22 is displayed on the video display window 53.

As a result, the recorded video data can be viewed as if the video tape recorder were stepped by the right or left button 5R, 5L of the mouse 5, for example. Also, middle button 5 of mouse 5
With C, a specific scene from the recorded video data can be directly selected and displayed. Further, by moving the mouse cursor 55 on the scroll bar 56 while holding down the middle button 5C of the mouse 5, the image counter 30 is continuously changed while the field number F of the image data designated by the mouse 5 changes. , The video data corresponding to the position indicated by the mouse 5 on the scroll bar 56 is continuously displayed in the video display window 53. Processing becomes easy.

Thus, an arbitrary scene can be extracted from a series of moving images by a simple operation as needed. For example, a new image can be obtained by combining a computer graphic image and a video image from a video tape recorder. It is possible to provide a better user interface in a multimedia document editing operation such as creating a.

Next, a second embodiment of the present invention will be described with reference to the principle block diagram of FIG. 5 and the specific block diagram of FIG. In addition, members and the like corresponding to those of the first embodiment shown in FIGS. 1 to 3 are denoted by the same reference numerals, and redundant description will be omitted.

The principle block diagram of the second embodiment shown in FIG. 5 is different from the principle block diagram of the first embodiment shown in FIG.
Is different from the first embodiment in that a preview data display means 32 is provided. The preview data display means 32 is for displaying a continuous series of plural video data from a set of plural video data recorded in the video data recording means 3. A memory for recording the video data of interest and a plurality of video data before and after the video data based on the instruction is provided.

In the second embodiment shown in FIG. 5, similarly to the first embodiment, a video image from the video reproducing device 1 is normally displayed in the video window 2, and At the time of reproduction display, a video image from the video data reproduction display means 8 can be displayed. Also,
By reading out the image data recorded in the preview data display means 32, a plurality of video data recorded before and after along with the video data of interest are displayed in the video window 2 in the order of recording time. In this embodiment,
This video window is particularly called a preview window for distinction. On the other hand, a signal input from the mouse 5 and the keyboard 4 is output by the interface means 6 as a control signal for the video data reproducing / displaying means 8, and a plurality of video data recorded in the video data recording means 3 is used for one screen of video. Select data. The selected video data is displayed in the video window 2 or the like by the video data reproduction / display means 8, and is displayed in the preview window together with a plurality of video data recorded before and after the selected video data. You. In the example of FIG. 5,
The preview window is included in the video window 2.

FIG. 6 is a specific block diagram of the second embodiment. The difference from the specific block diagram of the first embodiment shown in FIG. The output of the bank 22 is supplied to the preview data memory 35 via the spatial filter 34, and the output of the preview data memory 35 is supplied to the image synthesizer 1 via the buffer 36.
9 is provided. The preview data memory 35 has a write controller 12 and a read controller 1.
4 supplies a control signal. FIG.
5 shows an example of a display screen according to the embodiment of FIG.

In this embodiment, as shown in FIG. 7, a preview window 5 is provided separately from the video display window 53.
7 are displayed, and in the preview window 57, the video data of interest and five fields before and after the video data, that is, a total of eleven video data Dn-5, Dn-4,.
Suppose that Dn,..., Dn + 4, Dn + 5 can be displayed.

A preview data display means 33 provided with a spatial filter 34 and a preview data memory 35 receives the field number F output from the video data reproduction / display means 28, and receives the field number F from the video data memory bank 22. The video data corresponding to F and the image data of a total of 11 fields, 5 fields before and after,
Preview data memory 3 via spatial filter 34
5 is stored. The stored image data for 11 fields is output to the video image display means 9 and displayed as a preview window 57.

As a result, as shown in FIG. 7, by simultaneously viewing a plurality of video data displayed in the preview window 57, it is possible to grasp the relationship and flow of the video data before and after. Further, when the mouse 5 is operated on the preview window 57 and the right button 5R or the left button 5L is pressed, the field number designated by the image counter 30 increases or decreases by one, and the field number corresponding to the field number is increased. Image data to be read from the video data memory bank 22 and the video display window 5
3 and image data for 11 fields centered on the changed field number is displayed in the preview window 57. As a result, the user can operate the mouse 5 to view the recorded video data as if the video tape recorder were stepping forward.
By operating the middle button 5C of the mouse 5, the multiplier 31 is operated.
The field number F obtained by the
, It is possible to directly select and display one specific scene from the recorded video data.

Further, by moving the mouse cursor 58 on the scroll bar 59 while holding down the middle button 5C of the mouse 5, the video display window 53 and the preview window 57 display the mouse 5 on the scroll bar 59.
, The corresponding video data designated is displayed continuously, and processing such as fast-forward playback and rewind playback of a video tape recorder can be easily performed.

In the second embodiment, it is assumed that the interface means 23 has been changed to one corresponding to the preview window 57.

Next, a third embodiment of the present invention will be described with reference to a principle block diagram of FIG. 8 and a concrete block diagram of FIG. Members corresponding to those of the second embodiment shown in FIGS. 5 to 7 are denoted by the same reference numerals, and redundant description will be omitted. FIG. 10 is an example of a display screen according to the third embodiment.

The principle block diagram of the third embodiment shown in FIG. 8 is different from the principle block diagram of the second embodiment shown in FIG. The difference is that an image cue unit 37 is provided between. The image queue unit 37 is a memory having a queue structure for storing numbers uniquely corresponding to video data.

In the third embodiment, as in the first and second embodiments, the video window 2 includes
Normally, a video image from the video reproduction device 1 is displayed. In the case of reproduction display, a video image from the video data reproduction display means 8 can be displayed. Also,
As in the second embodiment, the preview data display means 32
Accordingly, a plurality of video data recorded before and after along with the video data of interest are displayed in the preview window in the order of recording time.

On the other hand, signals input from the mouse 5 and the keyboard 4 are output as control signals for the video data reproducing and displaying means 8 by the interface means 6, and a plurality of video data recorded in the video data Minutes of video data. The selected video data is displayed on the video window 2 by the video data reproduction / display means 8, and at the same time, the selected video data is displayed on the preview window together with a plurality of video data recorded before and after.

Here, in the third embodiment, when an operation of selecting a desired video data range on the preview window using the mouse 5 is performed, a series of numbers corresponding to the series of video data uniquely is obtained. Is stored in the image queue unit 37. By repeating this operation, it is possible to obtain moving image data in which arbitrary video data stored in the video data recording unit 3 is connected in an arbitrary order intended by the user. The moving image is displayed in the preview window and the video window 2 based on the number stored in the image queue unit 37.

FIG. 9 shows a specific block diagram of the third embodiment. The difference from the second embodiment shown in FIG. A coordinate comparator 40 for determining the position, a range indicator 41 for converting a range on the scroll bar 59 indicated by the mouse cursor 58 to a range of field numbers of a plurality of image data, and The output of the range indicator 41 is supplied and stored, and the image queue unit 39 including the queue memory 38 whose output is supplied to the preview data memory 35 is provided.

The field numbers from the range indicator 41 and the image counter 30 are supplied to the image queue section 39, and the field numbers are output from the image queue section 39 to the video data memory bank 22 and the preview memory 35. Is done. Further, a signal for changing the content of the image counter 30 to a field number corresponding to the image specified by the mouse on the preview window 57 is output from the image queue unit 39.

In the third embodiment, as in the first and second embodiments, the video data memory bank 22
Out of the plurality of image data stored in the
The image data selected by the video image window 5
3 and furthermore, the image data for the previous and next eleven fields including the target image data is displayed on the preview window 57 by the preview data display means 33.

Now, when the mouse cursor 58 is present on the preview window 57, the start of the area desired by the user in the series of video data displayed on the When the instruction is given by the button 5L and the end is given by the right button 5R, the mouse cursor 58 when each of the buttons 5L and 5R is pressed is displayed.
Are supplied to the coordinate comparator 40. The coordinate comparator 40 detects that a specific series of video data on the preview window 57 has been selected, and outputs the coordinate value of the mouse cursor 58 to the range indicator 41. The range indicator 41 knows the field numbers corresponding to the individual video data of the series of video data selected from the output of the preview data memory 35, and writes them as a series of field numbers in the queue memory 38 in chronological order. Here, it should be noted that the field number corresponding to each video data is uniquely determined in this system.

By repeating the above-described operation of selecting a series of video data displayed in the preview window 57 and writing a corresponding series of field numbers into the image queue section 39, the moving image data is joined. To create new moving image data.

On the other hand, by outputting a series of field numbers written in the queue memory 38 to the preview data memory 35, image data corresponding to the field numbers written in the queue memory 38 is displayed in the preview window 57. I do. Similarly, by outputting a specific field number from the series of field numbers to the video data memory bank 22, the image data corresponding to the field number is displayed in the video display window 53.
To be displayed.

As a result, as in the first and second embodiments, while simultaneously watching a plurality of video data displayed on the preview window 57, the relationship and flow of the video data before and after are grasped. By operating the mouse 5 on the screen 57, it is possible to view the recorded video data as if frame advance, fast forward playback, and rewind playback of a video tape recorder were performed.

In particular, in the third embodiment, by providing the image queue section 39, moving image data can be referred to,
After the examination, a series of moving images desired by the user can be cut out and connected by the mouse 5 to easily create new moving image data.

Further, by displaying the ratio of the amount of data indicating the field number actually written to the maximum capacity of the queue memory 38 as a marker 60 on the display screen 51, the images are cut out and connected. While editing, the user can know how much more editing can be done. In order to display the marker 60, for example, the queue memory 38 is provided in a signal path between the queue memory 38 and the image synthesizer 19.
It is sufficient to provide a marker generator (not shown) for changing the generation timing of the marker signal according to the amount of data in the marker.

As described above, the identification number such as the field number assigned to the image data to be displayed among the plurality of image data stored in the memory is stored in the queue memory, and this identification number is used during reproduction. By reading out the image data in the memory based on the above, the above-described frame advance operation and the like are performed, and after examining the flow of the video, a series of moving images desired by the user are cut out and connected, and new moving image data is I can create it. In addition, unlike editing by film or videotape, it is extremely easy to change the editing location, and since the processing is performed digitally, there is no deterioration in image quality due to editing work.

[0049]

As described above, according to the present invention,
Two types of display functions, a monitor function and a reproduction function, can be used.

[Brief description of the drawings]

FIG. 1 is a principle block diagram of a first embodiment of a video window system of the present invention.

FIG. 2 is a specific block diagram of the first embodiment.

FIG. 3 is an explanatory diagram showing an example of a display screen according to the first embodiment.

FIG. 4 is a schematic plan view of a mouse.

FIG. 5 is a principle block diagram of a second embodiment of the video window system of the present invention.

FIG. 6 is a specific block diagram of a second embodiment.

FIG. 7 is an explanatory diagram showing an example of a display screen according to a second embodiment.

FIG. 8 is a principle block diagram of a third embodiment of the video window system of the present invention.

FIG. 9 is a specific block diagram of a third embodiment.

FIG. 10 is an explanatory diagram showing an example of a display screen according to a third embodiment.

[Explanation of symbols]

1: Video playback device 2, 7: Video window 3: Video data recording means 4: Keyboard 5: Mouse 6, 2
3: Interface means 8, 28: Video data reproduction / display means 9: Video video display means 10: Video input terminal 11: A / D converter 12: Write controller 1
3: Video memory 14: Readout controller 15: Switching unit 16, 34 Spatial filter 17: Buffer 1
8: Display input terminal 19: Image synthesizer 20:
Video output terminal 21: Video data recording means 22: Video data memory bank 24: Mouse input terminal 25:
Coordinate counter 26: Mouse button detector 27: Normalizer 29: Recorded image number holder 30: Image counter 31:
Multipliers 32, 33: preview data display means 35:
Preview data memory 36: Buffer 37, 3
9: Image queue unit 38: Queue memory 40: Coordinate comparator 41: Range indicator 51: Display unit 52, 54:
Text window 53: Video display window 5
5, 58: Mass cursor 56, 59: Scroll bar
57: Preview window 60: Marker

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/44 H04N 5/44 Z 5C082 5/45 5/45 5/76 5/76 Z 5/91 5 / 91 NF term (reference) 5B057 BA11 BA24 CE08 CH01 CH11 CH16 DA16 5C023 AA02 AA14 AA18 BA11 BA15 CA03 CA05 DA04 DA08 5C025 BA21 BA27 BA28 BA30 CA06 CA09 CB10 DA05 DA10 5C052 AB04 AC01 DD04 EE03 5C053 KA21 KA21 KA21 HA24 LA01 LA11 5C082 AA02 AA37 BA12 BA42 CA21 CA62 MM09

Claims (1)

[Claims] 1. A monitor function for displaying a video image output from an external video playback device in a video window, and storing a video output from the external video playback device in a memory, and, if necessary, the memory. A video data display system, comprising: a playback function of reading video data from a computer and displaying the video data in a video window.