KR19980048945A - Video and graphic window control device and its control method - Google Patents

Abstract

1. TECHNICAL FIELD OF THE INVENTION

Video and Graphic Window System

2. Technical problem to be solved by the invention

When displaying a video screen on a computer, it is difficult to freely change the size of the graphic screen and free window control such as overlapping multiple windows and including a graphic screen in the video window.

3. Summary of the Solution of the Invention

Simultaneously create multiple video windows and graphic windows on a television monitor, and control their size, position, and picture in picture, that is, multiple video and graphic windows. It can be displayed all at once on the screen or monitor window of a computer, giving you full control over its position and size, as well as its overlapping and embedding effects.

4. Important uses of the invention

Windows system

Description

Video and graphic window control device and its control method

The present invention allows the simultaneous creation of multiple video windows and graphic windows on a television monitor, control of their size and position, and picture in picture, that is, video and graphics. A window control device and a control method thereof.

The present invention is a technology for simultaneously outputting video and graphic windows on a TV or computer monitor, and belongs to the category of various technologies expressed in terms such as video overlay, graphic overlay. However, the present invention is to handle the display method of the video window and the graphics window in the same way, while the conventional methods take the form that the other window is additionally displayed depending on one of the video window and the graphics window. This allows simultaneous output to the screen with equivalent qualifications. In the existing video overlay method for representing a video screen on a computer, a video is represented where a pixel of a corresponding color is located on a graphic screen using a color key. However, this method has a problem that a video screen is dependent on a graphic screen, free size conversion of the graphic screen is difficult, and free window control such as overlapping multiple windows and including a graphic screen in a video window is impossible.

The present invention has a structure in which a plurality of video windows and a plurality of graphic windows can coexist while freely overlapping, including, and resizing.

The present invention provides a method of configuring a hardware and a method of controlling a device in which a plurality of video windows and a plurality of graphic windows, which are impossible in the existing video overlay schemes, can coexist freely by overlapping, including, and resizing. The purpose is to. Here, the overlap means that when a plurality of video and graphic screens appear on one TV screen or one computer monitor window, a part of another screen is overlapped on a part of one screen, and the inclusion means one TV screen or one When multiple video and graphics screens appear on a computer monitor window, this indicates that the entirety of the other screen is included and superimposed on a portion of one screen.

FIG. 1 is a screen showing an example of overlapping and inclusion of a plurality of video and graphic screens for explaining the present invention. The present invention includes a graphic screen and a size adjustment of a video screen, and a video screen on a graphic screen (FIG. 1 a). A variety of screen processes, including graphic screens on video screens (Figure 1b), overlapping video screens and graphic screens (Figure 1c), and positioning of multiple video and graphic screens (Figure 1d). Make it possible.

The present invention utilizes a video window control apparatus and a video window control method of the method, which is the patent application No. 95-55901, for a graphic input device and a graphic that can be processed by applying a graphic screen having a different characteristic from the video screen. It is an object of the present invention to provide a video and graphics window control apparatus capable of simultaneously outputting graphics and video as well as video, by adding a storage device and extending a video flow control apparatus.

In order to achieve the above object, the present invention is responsible for adjusting the size of the video / graphics input control and the video / graphics position, overlap, including the control effect of the video / graphics output control, the video / graphics input control signal Video flow control means for outputting a video / graphics output control signal and a video / graphics selection signal; The video signals input from the external video input and processing means are limited to the video for controlling the size of the input video under the control of the video flow control means, and the output videos have the effect of position, overlap, inclusion, etc. A plurality of video storage means for outputting limitedly; A plurality of graphics storage means connected to said video flow control means for temporarily storing non-video signal graphic data for merging with the video signal; A graphic input control means for extracting graphic data by giving an address and an input clock of graphic data to the graphic processor storage means under the control of the video flow control means and transferring the graphic data to the graphic storage means; And a video merging means for merging the video / graphic signals outputted from the video / graphic storage means 32 and 34 into one signal by the video / graphic selection signal and transferring them to an external screen output means. It is done.

The present invention provides a video flow control means for outputting a video input control signal, a video output control signal and a video selection signal, and an input video signal under control of the video flow control means. Video storage means for receiving and outputting an output video signal, and a plurality of graphics storage means connected to the video flow control means for temporarily storing graphic data other than the video signal for merging with the video signal; A graphic input control means for extracting graphic data by giving an address and an input clock of graphic data to the graphic processor storage means under the control of the video flow control means and transferring the graphic data to the graphic storage means; A video window control method applied to a video window control apparatus having video merging means for merging the output video signal by the control of the video flow control means, the method comprising: checking an input video size magnification Wn of a predetermined video; First step; A second step of subsampling the video signal input to the video storage means according to the window size adjustment control signal according to the input video size magnification Wn; A third step of confirming whether a plurality of video window controls are currently performed; And a fourth step of checking the input video size magnification or generating a control signal for adjusting the window size according to whether the predetermined video size magnification is changed if a plurality of video window controls are currently performed.

In another method, video flow control means for outputting a video input control signal, a video output control signal and a video selection signal, and a video for receiving an input video signal under the control of the video flow control means and outputting an output video signal. A plurality of graphics storage means connected to said video flow control means for temporarily storing graphic data which are not video signals for merging with the video signal; A graphic input control means for extracting graphic data by giving an address and an input clock of graphic data to the graphic processor storage means under the control of the video flow control means and transferring the graphic data to the graphic storage means; A video window control method applied to a video window control apparatus having video merging means for merging the output video signal by the control of the video flow control means, the output position and priority of a predetermined video and the magnification of an input video size. A first step of checking a window size according to (Wn); A second step of counting pixel output positions (X, Y) of the corresponding video window to determine whether the corresponding video should be output at a pixel position to be currently output; A third step of checking the overlap and priority with other output video according to whether the corresponding video is output or not and outputting the corresponding video pixel value at a predetermined position or controlling a plurality of video windows; And a fourth step of checking the position and overlap of the corresponding video and whether the last pixel is applied according to the control of the plurality of video windows, and transitioning to the first or second step.

1 illustrates an example of overlapping a video screen and a graphic screen and including a video;

2 is a configuration diagram of a video graphics input / output system to which the present invention is applied;

3 is an internal configuration diagram of a video and graphic window control apparatus according to the present invention;

4 is a flowchart for controlling video and graphic screen size adjustment according to the present invention;

5 is a video and graphics position / overlap control control flow diagram in accordance with the present invention.

* Explanation of symbols for the main parts of the drawings

21: video flow control device 22: video storage device

23: video merge device 24: graphics storage device

25: Graphic input control device 31: Graphic output range control device

32: graphic size control device 33: graphic data input control device

Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

2 is a configuration diagram of a video graphics window control system according to the present invention, wherein the video input and processing apparatus 21 receives a camera input and converts an analog image into a digital image, or a codec device for video compression / restore. , A processing unit that handles video.

The video output device 24 refers to the final output device of video for displaying digital images on a TV or computer monitor. The graphic processor storage 22 is a storage place for graphic data managed by the graphic processor. Here, the apparatus according to the control method of the present invention receives a plurality of video signals from the video input and processing apparatuses and the graphic signals extracted from the graphics processor storage device 22 and receives them according to the control method of the present invention. Various types of control are made into a single video signal and then sent to the video output device 24.

3 is an internal configuration diagram of a video graphics window control apparatus according to the present invention, wherein 31 is a video flow control device, 32 is video storage devices # 1 to #N, 33 is video merging device, and 34 is graphics storage. Device # 1-#N are shown respectively.

As shown in the figure, the video flow control device 31 is the main control device of the present invention, and is a device for controlling the size of the video by the input control, the position of the video by the video output control, the overlap, the effect of the inclusion, etc. to be. That is, the video input control signals are transmitted to the video storage device 32 to control the input video signals input to the video storage device 32 which have not been described, and are described from the video storage device 32. The video output control signals are transmitted to the video storage devices 32 to control the output videos output to the video merging device 33.

In addition, the video flow control device 31 is a video selection signal (video selection signal according to video position, overlap, and magnitude) necessary for merging output video signals transmitted to the video merging device 3 into one video signal. To the video merging device 33.

The video merging device 33 merges the output video signals transmitted from each video storage device 32 into one video signal under the control of the video flow control device 31 to the external video output device 22. This may be a signal multiplexer, or may be implemented by connecting signal lines without a separate device when the output signals of the video storage device 32 are each tri-state. have.

The video storage device 32 accepts videos for the control of the size of the input video under the control of the video flow control device 31, and the output video is limited for the effect of position, overlap, inclusion, etc. It is preferable to perform sequential input and sequential output (FIFO: First In First Out), and the input / output clock signal should be as many as the number of bits of video to be handled.

In addition, the input and output should be possible at the same time (Dual Port), the input and output control must be able to be arbitrarily independent of the input and output clock, and there must be a passage for resetting at regular intervals.

In addition, the video memory device 32 may be configured in such a manner that an additional circuit is added to a general RAM and a buffer, a FIFO memory device may be used, and a field memory may be more effectively implemented. This is possible.

The video window control method according to the present invention includes video screen size control, video position control, video overlapping and embedding control, wherein the size of the video screen can be performed upon input or output of the video storage device 32.

The synchronous video clock of the input video signal may be masked by an enable signal and stored in the video storage device. The effective control signal used at this time may be used by dividing the synchronous video clock and the video horizontal synchronizing signal by a desired video size.

In the case of controlling the output, the same method may be used for output, but other control signals are included in the output.

The graphics memory 34 is a device that temporarily stores graphic data that is not a video signal for merging with the video signal. In practice, the graphics memory 34 may be implemented in the same way as the video memory, but the data input clock and the data output clock frequencies may be different from each other, and the synchronization signal may also be different. Devices (FIFO, Field Memory, etc.) are preferred. The graphic input controller 35 extracts the graphic data by giving an address and an input clock of the graphic data to the graphic processor storage device under the control of the video flow control device 31, and then extracts the graphic data to the graphic memory device 34. It is responsible for communicating. At this time, the output range control and the graphic size control are performed in accordance with the resolution of the graphic data.

4 is a configuration diagram of the graphics storage device 34.

The graphic output range control device 41 receives the screen input control signal from the video flow control device and designates the output range of the graphic, and outputs the graphic output range control signal to the graphic data input control device 43 so as to extract only the graphic data of the range. Send to The graphic size control device 42 receives the screen input control signal from the video flow control device to determine the size of the graphic and selectively extracts the graphic data according to the size of the graphic data input control device 43. Send to The graphic data input control device 43 receives the graphic output range control signal and the graphic size control signal, generates an input clock and a data address for extracting data from the graphic processor memory, and transmits the data to the graphic processor memory. The extracted graphic data is transferred to the graphics memory in synchronization with the input clock.

The video and graphic window control schemes of the present invention include video size control schemes, window position control schemes, window overlapping and embedding control schemes. First, the video screen size control method is as follows. The size of the video screen can be done at the time of input or output of the video storage. The synchronous video clock of the input video signal may be masked by an enable signal and stored in the video storage device. The effective control signal used at this time may be used by dividing the synchronous video clock and the video horizontal synchronizing signal by a desired video size. The same method can be used to control the output. However, other control signals are included in the output.

FIG. 5 is a flowchart illustrating an operation of resizing a screen, which illustrates only one window control operation among a plurality of video windows, and the same operation may be controlled for the remaining video windows. These multiple video window control operations all start simultaneously and are processed in parallel.

5, when the window control is started, the input video size magnification Wn of the nth video is checked (51). The input video size magnification Wn is generally input from the outside, and the size magnification is 1/2. , Magnification of the original video size, such as 1/4, 1/8, etc.

A window size control signal SWn is generated according to the input video size magnification Wn (52), and the window size control signal SWn is enabled to accept an input video signal in a limited manner. The signal is a limiting method may be a method of simply subsampling or a method of interpolating it.

Subsampling the video signal inputted to the video storage device 32 according to the generated window size control signal SWn (53), and then checking whether or not a plurality of video window controls are currently performed. (54) If yes, it is determined whether the magnification of the N-th video has been changed in the main system (55).

As a result of the determination, if the size magnification of the n-th video is changed, the process shifts to step 51 of checking the input video size magnification of the n-th video, otherwise the window is determined according to the input video size magnification Wn of the n-th video. In step 52 of generating the control signal SWn for scaling control, the control continues at the same magnification.

On the other hand, if the size magnification of the n-th video has not been changed as a result of the determination, the control ends.

In the video position control method, a video storage device is set in accordance with a video clock for video output after determining a range of position values where video is placed in a window by giving a start coordinate, an end coordinate, or a size for each video. A video signal inputted at 32 is captured when the desired position is reached. That is, the counter is operated in accordance with the video clock for video output in the apparatus of the present invention, and the counter serves as a reference for each video to be located.

Each video storage device 32 controls to output video data if the counter value is within the range of the position value at which the video is to be placed. The counter value causes a reset once each time the video vertical sync signal appears.

In addition, video overlapping and inclusion effect control schemes can be easily implemented by prioritizing each video. This case can be regarded as a special case of video position control, that is, when two or more videos fall within a range of position values.

In this case, when multiple videos are exported at the same time, the screens cannot be recognized because they overlap each other, so that only the video corresponding to the video having the highest priority is output according to the predetermined priority. Or video storage devices 32.

FIG. 5 is a video position / overlap control flow chart according to the present invention, which shows only control for one video as in FIG. 4, and control for multiple videos is simultaneously controlled in the same flow as in FIG. Also, the flow of FIG. 5 is executed simultaneously with the flow of FIG.

First, the output positions Xn and Yn of the video and the priority Pn of the video are checked in the computer monitor or TV screen of the nth output video (61). The output position (Xn, Yn) indicates the Y coordinate of the X coordinate in the video of the video, and the priority (Pn) indicates whether or not the video appears at the top and is visible on the actual monitor when multiple videos overlap. This parameter represents.

In addition, the size SXn and SYn of the video window is determined according to Wn determined in FIG. 5 (62), and the size SXn and SYn of the video window corresponds to the actual horizontal and vertical window sizes of the video window. Say.

The actual screen output positions X and Y of the video window are initialized, that is, X = 0 and Y = 0 (63), and the pixel output positions X and Y in the screen are checked (64). This means that the X and Y positions are counted. This counting operation is performed until Y is counted up to the X resolution of the actual screen. Continues up to the Y resolution of the screen.

Now, it is determined whether the video should be output at the pixel position to be output or not as XnXSXn, YnYSYn (65), and if the video should be output, it is checked whether the video overlaps with other videos (66).

If the video is not overlapped with other videos, the pixel value of the video is output at the X and Y positions (68), and if the video is overlapped, it is checked whether the priority of the video is higher than other overlapping videos. (67), if the priority is high, the pixel of the video is output (68), otherwise it cannot be output.

By such an operation, overlapping control of multiple videos can be performed.

If the video is not output at the current pixel position or overlaps with other output video, the priority is not high or the n-th video pixel value is output at the X and Y positions, and the current multiple video window control is continued. Check (69).

As a result of the check, if the current multiple video window control is not continued, the video window control is finished. If the control continues, it is checked whether the position, overlap, priority of the corresponding video has been changed (70).

At this time, if a change is made, the process proceeds to step 63 of checking the position (Xn, Yn) and priority (Pn) of the nth output video, and if not, checks whether X and Y are the last pixels of the screen ( 71). Here, the last pixel means the last position, that is, the bottommost rightmost pixel, in the full video resolution displayed on the computer monitor or TV screen.

As a result of the checking, if it is the last pixel, the screen output positions X and Y are initialized (63). Otherwise, the control proceeds to the step 64 of checking the intra-screen pixel output positions X and Y, and control continues.

The apparatus of the present invention and a control method thereof as described above can display a plurality of video and graphic windows all at once on a TV screen or a monitor window of a computer, and can freely control the position and size, the overlapping effect and the embedding effect. do. Simultaneous display of the graphic screen with the video window proposed in the present invention is to allow the simultaneous display of the graphic screen in the video window control apparatus and the video window control method of the method No. 95-55901. It may be widely used in multimedia devices where video must be mixed, for example, Set-Top Box for Video On Demand, Internet TV, video telephony / conference terminal.

Claims (13)

It is responsible for size control by video / graphics input control and video / graphics position, overlap, and effect control by video / graphics output control, and video / graphics input control signal and video / graphics output control signal and video / graphics control. Video flow control means for outputting a graphic selection signal; The video signals input from the external video input and processing means are limited to the video for controlling the size of the input video under the control of the video flow control means, and the output videos have the effect of position, overlap, inclusion, etc. A plurality of video storage means for outputting limitedly; A plurality of graphics storage means connected to said video flow control means for temporarily storing non-video signal graphic data for merging with the video signal; A graphic input control means for extracting graphic data by giving an address and an input clock of graphic data to the graphic processor storage means under the control of the video flow control means and transferring the graphic data to the graphic storage means; And a video merging means for merging the video / graphic signals outputted from the video / graphic storage means 32 and 34 into one signal by the video / graphic selection signal and transferring them to an external screen output means. Video and graphics window controls. The method of claim 1, The video storage means, A video and graphic window control device, wherein the input and output clock signals are as many as the number of bits of video to be handled, allowing input and output to occur simultaneously. The method according to claim 1 or 2, The video storage means, An additional circuit is added to a general RAM and a buffer, or a video and graphic window control device using first in first out (FIFO) memory or field memory. The method according to claim 1 or 2, The video storage means, Video and graphic window control device, characterized in that the control of the input and output can be arbitrarily independent of the input and output clock, there is a passage for resetting at regular intervals. The method of claim 1, The graphic storage means, A video and graphic window control apparatus, which is the same as the video memory device, but is configured of first-in first-out means or field memory according to a data input clock, a data output clock frequency, and a synchronization signal. The method of claim 1, The video merging means, A video and graphics window control device using a signal multiplexer. The method of claim 1, The video merging means, And the output video signals from the video memory means are tri-state, and are implemented by connecting signal lines without a separate device. Video flow control means for outputting a video input control signal, a video output control signal and a video selection signal, video storage means for receiving an input video signal under the control of the video flow control means and outputting an output video signal; A plurality of graphics storage means connected to the video flow control means for temporarily storing graphic data other than the video signal for merging with the video signal; A graphic input control means for extracting graphic data by giving an address and an input clock of graphic data to the graphic processor storage means under the control of the video flow control means and transferring the graphic data to the graphic storage means; A video window control method applied to a video window control apparatus including video merging means for merging the output video signal by the control of the video flow control means. A first step of checking an input video size magnification Wn of the predetermined video; A second step of subsampling the video signal input to the video storage means according to the window size adjustment control signal according to the input video size magnification Wn; A third step of confirming whether a plurality of video window controls are currently performed; And And a fourth step of checking the input video size magnification or generating a control signal for adjusting the window size according to whether the predetermined video size magnification is changed if a plurality of video window controls are currently performed. Way. Video flow control means for outputting a video input control signal, a video output control signal and a video selection signal, video storage means for receiving an input video signal under the control of the video flow control means and outputting an output video signal; A plurality of graphics storage means connected to the video flow control means for temporarily storing graphic data other than the video signal for merging with the video signal; A graphic input control means for extracting graphic data by giving an address and an input clock of graphic data to the graphic processor storage means under the control of the video flow control means and transferring the graphic data to the graphic storage means; A video window control method applied to a video window control apparatus including video merging means for merging the output video signal by the control of the video flow control means. A first step of checking the window size according to the output position and priority of the predetermined video and the input video size magnification Wn; A second step of counting pixel output positions (X, Y) of the corresponding video window to determine whether the corresponding video should be output at a pixel position to be currently output; A third step of checking the overlap and priority with other output video according to whether the corresponding video is output or not and outputting the corresponding video pixel value at a predetermined position or controlling a plurality of video windows; And And a fourth step of checking the position and overlap of the corresponding video and whether the last pixel is applied according to whether the plurality of video windows are controlled, and transitioning to the first or second step. The method of claim 9, The second step, A fifth step of initializing an actual screen output position of the video window; A sixth step of identifying a pixel output position in the screen; And And a seventh step of determining whether a corresponding video should be output at a pixel position to be currently output. The method of claim 10, The sixth step, When the output position is represented by the X and Y coordinates of the video, when the X side counting reaches the X resolution of the actual screen, Y is incremented and the Y side counting continues to the Y resolution. Way. The method of claim 9, The third step, A fifth step of checking whether the corresponding video overlaps with other output videos if the corresponding video is to be output at the pixel position to be output after the second step; A sixth step of checking the priority of the corresponding video if there is overlap with other output videos after performing the fifth step; A seventh step of outputting a predetermined video pixel value at a corresponding position after the fifth step or the sixth step, if the corresponding video does not overlap other output videos or the priority is higher than the other output video; And And an eighth step of determining whether the video is currently being controlled at a plurality of video windows if the corresponding video is not output at the pixel position to be currently output or if the priority is not higher than other output video or if a predetermined video pixel value is output at the corresponding position. Video and graphics window control method. The method of claim 10, The fourth step, An eighth step of checking whether there is a change in the position and overlap of the predetermined video if a plurality of video window controls are currently performed; If there is a change in the position and overlap of the predetermined video, the process shifts to the first step of checking the window size according to the output position and priority of the predetermined video and the input video size magnification (Wn). A ninth step of determining whether the on-screen output position (X, Y) is the last pixel; And And a tenth step of transitioning to a fifth step of initializing an actual screen output position of the corresponding video window if it is the last pixel and a sixth step of checking the pixel output position of the screen if it is not the last pixel. Video and graphics window control method.