JPH03122692A - Video window system - Google Patents

Abstract

PURPOSE:To extend the field of the application of a video window system and to improve operability by providing a pointer display means for displaying the relative relationship of video data displayed on a display screen to entire video data accumulated in a video data recording means on the display screen. CONSTITUTION:The video data of a video signal where the content of an image is changed in real time is accumulated in the video data recording means 3. By giving instruction by the use of a mouse 5, etc., to an interface means 6, the video data which should be displayed out of the video data accumulated in the means 3 is disignated and read out so as to be displayed on the display screen by a video data reproducing display means 8. Based on the instruction, what relation the image displayed on the display screen has to the entire video data accumulated in the means 3 is displayed by the pointer display means. Thus, the image on an optional spot is segmented to be viewed while grasping the entire state of the image.

Description

DETAILED DESCRIPTION OF THE INVENTION [Field of Industrial Application] The present invention relates to a video window system capable of displaying video image information, and particularly to a multi-window video window system.

[Conventional technology]

In recent years, computer systems such as personal computers and workstations using microprocessors are becoming multi-windowed in order to achieve higher performance and better user interfaces. In such video window systems, improving the operability of workstations and developing new application methods are major issues, and in particular, how to handle general video signals such as NTSC signals in a multi-window system is a major issue. This is one of the problems.

In the past, multi-window systems mainly handled only text information, but in recent years, multi-window systems have been able to handle (
Window systems with windows that display images as moving images have also been proposed (for example, Araki et al.
-150 high-definition natural image processor J, NEC technique 7-bit, 4ON.

7/1987. p9. 28-33 J)
In the device described in this document, the video signal is A/D
After being converted, the image is stored in the secondary memory, and then subjected to predetermined image processing, and then stored in the secondary memory. The contents of the secondary memory are read out in synchronization with a display synchronization signal, subjected to D/A conversion, and then combined with a video signal from the personal computer and output to the display.

[Problem to be solved by the invention]

However, in the device described in the above-mentioned document, -a or the entire image displayed by the personal computer is transferred to the VT.
It is only necessary to replace the video signal with a video signal from another video signal source such as a video camera and display it, and it is not possible to perform processing such as recording or editing on the video signal itself while viewing the displayed image. could not.

The present invention was devised in order to solve the above-mentioned problems, and it is possible to record video signals for multiple sides in a memory, and to perform predetermined operations on the contents of this memory. The purpose of this invention is to expand the field of application of video window systems and provide a video window system with better operability.

[Means to solve the problem]

In order to achieve the above object, the video window system of the present invention includes a video data recording means for accumulating the video data of each screen of a video signal whose image content changes in real time, and a video data recording means for specifying the video data to be displayed. interface means for inputting instruction data; video data reproduction display means for reading video data specified by the instruction data from the video data recording means and displaying it on a display screen; and based on the instruction data from the interface means, The present invention is characterized by further comprising pointer display means for displaying on the display screen the relative relationship between the video data displayed on the display screen and the entire video data stored in the video data recording means.

Further, the video window system of the present invention includes a video data recording means for storing video data of each screen of a video signal whose image content changes in real time, and inputting instruction data for specifying video data to be displayed. an interface means, a preview data memory for accumulating a plurality of frames of video data before and after the video data specified by the instruction data read from the video data recording means; a video data reproducing and displaying means for reading out a plurality of screens of video data and displaying the same on a display screen simultaneously; and a video data reproducing and displaying means for reading a plurality of video data displayed on the display screen and displaying the video data simultaneously on the display screen based on instruction data from the interface means. The present invention is characterized by further comprising pointer display means for displaying a relative relationship with the entire video data stored in the recording means on the display screen.

[Effect]

In the video window system of the present invention, video data of each screen of a video signal such as a moving image whose image content changes in real time is stored in the video data recording means. Then, by giving an instruction using a mouse or the like to the interface means, the interface means specifies the video data to be displayed among the plurality of video data stored in the video data recording means, and displays this video (image). Data is read out from the video data recording means and displayed on the display screen by the video data reproducing and displaying means.Furthermore, based on the instruction data, the image displayed on the display screen is read out from the navigation video data recording means. The pointer display means displays the relationship with the entire stored video data using a mouse cursor, etc. Therefore, you can cut out any part of the image while grasping the overall image condition. It becomes possible to see.

Further, among the plurality of sides of video data stored in the video data recording means, a plurality of sides of video data before and after the video data designated by the instruction data are stored in the preview data memory, and the plurality of video data are stored in the preview data memory. By arranging images of multiple planes based on video data of a plane and displaying them simultaneously on the display screen in a fixed direction, you can see at a glance how the image content changes over time, all on the same screen. displayed above.

〔Example〕

DETAILED DESCRIPTION OF THE INVENTION Hereinafter, features of the present invention will be specifically described based on examples with reference to the drawings.

FIG. 1 is a block diagram showing the basic configuration of a first embodiment of the video window system of the present invention.

As shown in FIG. 1, the video window system of the first embodiment is capable of displaying at least an image (hereinafter referred to as video image) based on a video signal output from a video playback device such as a VTR or video camera. A video window 2, a video data recording means 3 for recording in memory a video signal corresponding to the video image displayed on the video window 2 in real time, and an interface for interpreting signals input from the keyboard 4 and mouse 5. The means 6 and the signal interpreted by the interface means 6 select arbitrary video data intended by the user from a set of a plurality of video data recorded in the video data recording means 3, and display the video data in the video window 2 or other video data. It is comprised of a video data reproducing display means 8 for displaying on a window 7.

This video window system can take two types of display modes: a monitor mode and a playback mode. Normally, the monitor mode is set, and the video image from the video playback device 1 is displayed in the video window 2, and the video image from the video data playback display means 8 is displayed in the playback mode. .

Further, signals inputted from the keyboard 4 and the mouse 5 are output as control signals for the video data reproducing and displaying means 8 by the interface means 6, and one screen worth of video is generated from the plurality of video data recorded in the video data recording means 3. Select data. The selected video data is displayed on the video window 2 or another video window 7 by the video data reproduction/display means 8.

Next, regarding the specific configuration of the first embodiment, the second
This will be explained with reference to the block diagram shown in the figure. Further, an example of the display screen of this embodiment is shown in FIG.

In the example shown in FIG. 2, in the video image display means 9, a video signal input from a video input terminal 10 is converted into a digital signal by an A/D converter 11, and is converted into a digital signal by a write controller 12 according to the field rate of the video signal. Write to video memory 13. The contents of the video memory 13 are
The signal is read out by a readout controller 14 controlled according to the scanning rate of the display to be displayed, and is converted into a digital video signal.

This digital video signal is passed through a switch 15 for switching between a monitor mode for monitoring video input and a playback mode for displaying recorded image data, and further, depending on the size of the video window to be displayed, Buffer 1 passes through spatial filter 16 to prevent aliasing noise.
7 is saved.

On the other hand, display input from a computer, workstation, etc. for displaying text information is also input to the image synthesizer 19 via the display input terminal 18, synchronized for display, and stored in the buffer 17. is combined with the digital video signal, and output to video output terminal 2.
0 to the display device as a video output.

FIG. 3 shows an example of a display screen, and the display unit 51 of the display device echoes and displays commands input from the keyboard 4 (see FIG. 1), and displays responses from the system. A text window 52 that displays . A video display window 531 that displays one screen worth of image data read out from the video data memory bank 22 of the video data recording means 21, which will be described later; A text window 54 that cuts out and displays a part of the image data and displays it together with text data. etc. are displayed.

Note that in the text window 54, for example,
By specifying a partial area of the image displayed in the video display window 53 using the mouse 5, etc., and copying the character string input from the keyboard 4 into the displayed text window 54, the video image can be added to the document. It becomes possible to create a multimedia document that cuts out and incorporates a part of an arbitrary part of the document.

Further, the video data recording means 21 includes the video input terminal 10
Video image data D converted into a digital signal in order to record the input video signal. .

D,, D, . ... and save it in the video data memory bank 22. An example of the storage state in the video data memory bank 22 is shown in Table 1.

Table 1 Also, in the interface hand m'23, the mouse 5 (
The positional information supplied from the mouse input terminal 24 (see FIG. 1) is counted by the coordinate counter 25 and held as the coordinates of the mouse cursor 55 (see FIG. 3). Also,
The mouse button detector 26 detects whether the mouse button is on or off.
Off information is detected and output to the video data reproduction display means 28. In this embodiment, as shown in FIG.
Consider a mouse 5 that has three types of buttons: R, middle button 5C, and left button 5L. Also, as shown in Figure 3,
It is assumed that the mouse cursor 55 points to a part of the scroll bar 56 on the display section 51. The scrollper 56 is disposed adjacent to the right side of the video display window 53 and has a length substantially equal to the height of the video display window 53. The coordinate counter 25 detects that the mouse buttons 5L, 5C, and 5R are pressed and outputs the coordinates at that time to the normalizer 27. The normalizer 27 calculates the ratio of the distance l from the starting point of the indicated point on the scroll par 56 to the entire length L of the scroll par 56 from the coordinate values, and calculates a value α between 0 and 1. The video data is outputted to the video data reproduction display means 28 as a video data reproduction display means 28.

In the video data reproduction display means 28, the number M of image data recorded in the video data memory bank 22 is
is held in the recorded image number holder 29.

Furthermore, when the recorded video data is played back and displayed on the video display window 53, an image indicating which field of the image data recorded in the video data memory bank 22 is displayed on the video display window 53 is also displayed. It is provided with a counter 30 and a multiplier 31 for determining the field number F corresponding to the image to be displayed from the output α of the normalizer 27 of the interface means 23 and the output M from the recorded image number holder 29.

When the mouse button detector 26 detects that the right button 5R of the mouse 5 has been pressed, a signal Ctl is generated, and this signal CU causes the image counter 30 to count up, so that the image counter 30 is immediately recorded. The image data of the field currently displayed is displayed in the video display window 53.

Further, the image counter 30 counts down in response to the signal CD detecting that the left button 5L has been pressed, and as a result, the image data of the field recorded immediately before is displayed on the video display window 53.

Further, by multiplying the value α from 0 to 1 outputted from the normalizer 27 of the interface means 23 by the content M of the recorded image number holder 29 in the multiplier 31,
The field number F of the image data designated by the mouse 5 is obtained, and the field number F is loaded into the image counter 30 by the signal LD that detects that the middle button 5C is pressed. As a result of loading, the image data of the field number recorded in the video data memory bank 22 is displayed on the video display window 53.

This allows for example the right or left button 5 of the mouse 5 to
With R and 5L, the recorded video data can be viewed as if moving frame by frame on a video tape recorder. Further, by using the middle button 5C of the mouse 5, it is possible to directly select and display a specific scene from the recorded video data. Furthermore, by moving the mouse cursor 55 on the scroller 56 while holding down the middle button 5C of the mouse 5, the field number F of the image data designated with the mouse 5 changes and the image counter 30 continuously changes. As a result, the video data corresponding to the position indicated by the mouse 5 on the scroller 56 is continuously displayed on the video display window 53, just like fast-forwarding or rewinding playback on a video tape recorder. Processing becomes easier.

This makes it possible to extract any scene from a series of moving images with simple operations as needed.For example, a new image can be created by combining a convenience store graphic image with a video image from a video tape recorder. It is possible to provide a better user interface in the editing work of multimedia doki comments, such as creating.

Next, a second embodiment of the present invention will be described with reference to the principle block diagram in FIG. 5 and the concrete block diagram in FIG. 6. In addition, the first [! The same reference numerals are given to the members, etc. corresponding to those in the first embodiment shown in FIGS. llI! ! Details are omitted.

The principle block diagram of the second embodiment shown in FIG. 5 is different from the principle block diagram of the first embodiment shown in FIG. The difference is that preview data display means 32 is provided. This Brevigny data display means 32 is for displaying a continuous series of a plurality of video data from a set of a plurality of video data recorded in the video data recording means 3. The camera is equipped with a memory for recording video data of interest and a plurality of video data before and after the video data based on an instruction.

In the second embodiment shown in FIG. 5, as in the first embodiment, the video window 2 normally displays the video image from the video playback device 1, and the playback display Sometimes, four video images from the video data reproducing and displaying means 8 can be displayed. Furthermore, by reading the image data recorded in the Brevigny data display means 32, a plurality of pieces of video data recorded before and after the video data of interest are displayed on the video window 2 in the chronological order of recording. . In this embodiment, this video window is specifically referred to as a preview window to distinguish it. On the other hand, the signals input from the mouse 5 and keyboard 4 are
The interface means 6 outputs it as a control signal for the video data reproduction display means 8, and the video data recording means 3
Select one screen's worth of video data from a plurality of video data recorded on. The selected video data is displayed on the video window 2 etc. by the video data reproduction/display means 8, and at the same time is displayed on the pre-picture window together with a plurality of video data recorded before and after the selected video data. be done. In the example shown in FIG. 5, the Brevigny window is included in the video window 2.

FIG. 6 shows a concrete block diagram of the second embodiment. What is different from the concrete block diagram of the first embodiment shown in FIG. The output is supplied via a spatial filter 34 to a Brevigny data memory 35, and the output of this preview data memory 35 is supplied via a buffer 36 to an image synthesizer 19.

Note that the preview data memory 35 includes the write controller 12. A control signal is supplied from a read controller 14. Incidentally, FIG. 7 shows an example of a display screen according to the second embodiment.

In this embodiment, as shown in FIG. 7, a Brevigny window 57 is displayed separately from the video display window 53, and this Brevigny window 57 contains video data of interest and five fields before and after it, that is, , a total of 11 video data DI, -,,D, 4°D7.・・・＋D
Consider something that can display n + 4 r D n + 5.

Spatial filter 34. The preview data display means 33 equipped with the Brevigny data memory 35 inputs the field number F outputted from the video data reproduction display means 28 and displays the video data corresponding to the field number F from the video data memory bank 22. The image data of 5 fields before and after, 11 fields in total, are processed by spatial filter 3.
4 and stored in the Brevigny data memory 35.

The stored image data for 11 fields is output to the video image display means 9 and displayed as a preview window 57.

As a result, as shown in FIG. 7, by viewing a plurality of pieces of video data displayed on the Brevigny window 57 at the same time, it becomes possible to understand the relationship and flow of the video data. Furthermore, if you operate the mouse 5 on the preview window 57 and press the right button 5R or left button 5L, the field number indicated by the image counter 30 will increase or decrease by 1, so that the field number corresponding to the field number will be increased or decreased by 1. The image data to be stored is stored in the video data memory bank 22.
11 centered around the changed field number and displayed on the video display window 53.
The image data for one field is displayed in the Blur Pico window 57.
will be displayed. As a result, recorded video data can be viewed by operating the mouse 5 as if moving frame by frame on a video tape recorder. Also, by operating the middle button 5C of the mouse 5 and directly loading the field number F obtained by the multiplier 31 into the image counter 30, a specific scene of the recorded video data can be directly selected. It can be selected and displayed.

Furthermore, by moving the mouse cursor 58 on the scroller 59 while holding down the middle button 5C of the mouse 5,
Video display window 53 and preview window 5
7, the corresponding video data designated by the mouse 5 is continuously displayed on the scroller 59, making it possible to easily perform processing similar to fast forward playback or rewind playback on a video tape recorder.

Note that in the second embodiment, the interface means 2
3 has been changed to correspond to the Brevigny window 57.

Next, a third embodiment of the present invention will be described with reference to the principle block diagram of FIG. 8 and the concrete block diagram of FIG. 9. Incidentally, members and the like corresponding to those of the second embodiment shown in FIGS. 5 to 7 are denoted by the same reference numerals, and redundant explanation will be omitted. Further, FIG. 10 is an example of a display screen according to the third embodiment.

The principle block diagram of the third embodiment shown in FIG. 8 is different from the principle block diagram of the second embodiment shown in FIG.
The difference is that an image cover portion 37 is provided between the two. The image Kinney section 37 is a memory having a Kinney structure for storing numbers uniquely corresponding to video data.

In this third embodiment, as in the first and second embodiments described above, the video window 2 normally displays a video image from the video playback device lf■, and the playback display At this time, the video image from the video data reproducing and displaying means 8 can also be displayed. Further, similarly to the second embodiment, the preview data display means 32 allows
A plurality of pieces of video data recorded before and after the video data of interest are displayed in the preview window in the chronological order of recording.

On the other hand, signals inputted from the mouse 5 and the keyboard 4 are output as control signals for the video data reproducing and displaying means 8 by the interface means 6, and one screen worth of video is generated from a plurality of video data recorded in the video data recording means 3. Select data. The selected video data is displayed on the video window 2 by the video data reproduction/display means 8, and at the same time, the selected video data is displayed on the preview window together with a plurality of video data recorded before and after.

In this third embodiment, when a desired range of video data is selected on the preview window using the mouse 5, a series of numbers uniquely corresponding to the series of video data is displayed in the image queue. Part of it is stored in 37.

By repeating this operation, it is possible to obtain moving image data in which arbitrary video data stored in the video data recording means 3 are joined in an arbitrary order intended by the user. Further, this moving image is displayed in the Brevigny window and the video window 2 based on the number stored in the image cue section 37.

FIG. 9 shows a concrete block diagram of the third embodiment, which is different from the second embodiment shown in FIG. A range indicator 41 is provided to convert the range on the scroller 59 indicated by the mouse cursor 58 to a range of field numbers of a plurality of image data, and Vessel 41
An image storage part 39 is provided which is provided with a cue memory 38 to which the output of the Brevigny data memory 35 is supplied and stored.

The field number from the range indicator 41 and the image counter 30 is supplied to the image cue section 39, and the field number is output from the image cue section 39 to the video data memory bank 22 and the preview memory 35. Ru. Further, a signal for changing the contents of the image counter 30 to the field number corresponding to the image designated by the mouse on the Brevigny window 57 is outputted from the image key part 39.

In this third embodiment as well, similarly to the first and second embodiments, the image data selected by the mouse 5 from among the plurality of image data stored in the video data memory bank 22 is displayed on the image window 53,
Furthermore, the Brevigny data display means 33 displays image data for 11 fields before and after the image data including the image data for this purpose in the preview window 57.

The mouse cursor 58 is now in the preview window 57.
The preview window 57
Among the series of video data displayed on the screen, the user uses the left button 5 of the mouse 5 to specify the start of a desired range of video data, and the right button 5R to specify the end.
The coordinate values of the mouse cursor 58 when 5R is pressed are respectively supplied to the coordinate comparator 40. The coordinate comparator 40 detects that a specific series of video data on the Brevigny window 57 has been selected, and outputs the coordinate value of the mouse cursor 58 to the range indicator 41. The range indicator 41 learns the field numbers corresponding to individual video data of the series of video data selected from the output of the preview data memory 35, and writes them into the queue memory 38 in time order as a series of field numbers. It should be noted here that in this system, the field number corresponding to each video data is determined arbitrarily.

By repeating the above-mentioned operation of selecting a series of video data displayed in the preview window 57 and writing a corresponding series of field numbers in the image key part 39, the video data is connected. Create new video data.

On the other hand, by outputting a series of field numbers written in the cue memory 3B to the Brevigny data memo IJ35, image data corresponding to the field numbers written in the cue memory 38 is displayed in the preview window 57. Similarly, by outputting a specific field number out of a series of field numbers to the video data memory bank 22, image data corresponding to the field number is displayed on the video display window 53.

As a result, as in the first and second embodiments, while viewing a plurality of pieces of video data displayed on the preview window 57 at the same time, you can grasp the relationship and flow of the video data before and after the video data.
Furthermore, by operating the mouse 5 on the Brevigny window 57, frame-by-frame forwarding and fast-forward playback can be performed as if on a video tape recorder.

You can view the recorded video data as if you were playing it back.

In particular, in the third embodiment, by providing an image key part 39, the user can refer to the moving image data, cut out a series of moving images desired by the user with the mouse 5 after consideration, and join them together. This makes it easy to create moving image data.

In addition, by displaying the ratio of the amount of data indicating the actually written field number to the maximum capacity of the cue memory 38 on the display screen 51 as a marker 60, editing work in which images are cut out and stitched together can be performed. While editing, the user can see how much more editing can be done. To display this marker 60, for example, the cue memory 38 and the image synthesizer 1
A marker generator (not shown) may be provided in the signal path between the queue memory 38 and the queue memory 38, in which the generation timing of the marker signal is changed according to the amount of data in the queue memory 38.

As mentioned above, an identification number such as a field number assigned to the image data to be displayed out of the multiple image data stored in the memory is stored in the cue memory, and the memory is stored based on this identification number during playback. By reading out the image data within the system, the user performs operations such as frame-by-frame forwarding as described above, considers the flow of the video, cuts out a series of video images desired by the user, and connects them together to create new video data. I can do it. Moreover, unlike editing using film or videotape, it is extremely easy to change the edited parts.
Furthermore, since the processing is performed digitally, there is no deterioration in image quality due to editing work.

[Effects of the Invention] As described above, according to the present invention, video data is stored in a memory, and while viewing a video window, among the recorded video data, an input means such as a mouse is input.
It becomes possible for the user to quickly extract any video data desired by the user, or to perform operations such as frame-by-frame forwarding to examine the flow of the video. This not only improves the operability when displaying images, but also provides a better user interface as a means of information processing for video image information.

Furthermore, by simultaneously displaying a plurality of images in a specific window on the display screen, it becomes possible to easily understand the relationship and flow of video data.

Furthermore, by operating the mouse on this window for displaying multiple images, it is possible to change the central image and quickly select any image.

[Brief explanation of drawings]

FIG. 1 is a principle block diagram of a first embodiment of the video window system of the present invention, FIG. 2 is a concrete block diagram of the first embodiment, and FIG. 3 is an example of a display screen according to the first embodiment. The explanatory diagram shown in FIG. 4 is a schematic plan view of the mouse,
FIG. 5 is a principle block diagram of a second embodiment of the video window system of the present invention, FIG. 6 is a concrete block diagram of the second embodiment, and FIG. 7 is an example of a display screen according to the second embodiment. 8 is a principle block diagram of the third embodiment of the video window system of the present invention, and FIG. 9 is a block diagram of the third embodiment of the video window system of the present invention.
FIG. 10 is an explanatory diagram showing an example of a display screen according to the third embodiment. 1: Video playback device 2.7: Video window 3:
Video data recording means 4: Keyboard 5: Mouse 6.23: Interface means 8.28: Video data reproduction and display means 9: Video image display means 10: Video input terminal 11: A/D converter 12:
Write controller 13: Video memory 14: Read controller 15: Switch 16.34: Spatial filter 17: Buffer 18: Display input terminal 19 Knee*image synthesizer 20: Video output terminal 21: Video data recording means 22: Video Data memory bank 24: Mouse input terminal 25: Coordinate counter 26: Mouse button detector 27: Normalizer 29: Recorded image number holder 30: Image counter 31: Multiplier 32.33 Nibreview data display Means 35: Brevigny data memory 36: Buffer 37. 39 Two-image cue section 38: Cue memory 40: Coordinate comparator 41: Range indicator 51; Display portion 52. 54: Text window 53: Video display window 55. 58: Mouse cursor 56. 59 Niss scroll bar 57 Double key window 60: Marker

Claims (1)

[Claims] 1. Video data recording means for accumulating video data of each screen of a video signal whose image content changes in real time, and interface means for inputting instruction data for specifying video data to be displayed. and a video data reproduction/display means for reading the video data specified by the instruction data from the video data recording means and displaying it on the display screen; A video window system comprising: pointer display means for displaying, on the display screen, a relative relationship between the video data stored in the video data and the entire video data stored in the video data recording means. 2. A video data recording means for accumulating the video data of each screen of a video signal whose image content changes in real time; an interface means for inputting instruction data for specifying the video data to be displayed; and the video data recording means. a preview data memory for storing a plurality of frames of video data before and after the video data specified by the instruction data read from the means; and a preview data memory for storing a plurality of frames of video data stored in the preview data memory. video data reproducing and displaying means for simultaneously displaying the video data on the display screen; and a plurality of video data displayed on the display screen and the video data stored in the video data recording means based on instruction data from the interface means. A video window system comprising: pointer display means for displaying a relative relationship with the whole on the display screen.