JPH01289389A - Moving picture signal decoding system - Google Patents

Abstract

PURPOSE:To enlarge only a part to which attention is directed with an observer on a receiving side and to finely display it by recognizing the position of the sight line of the observer on the receiving side, determining the position and range of a partial picture as the notable part for the observer in a moving picture, and displaying only the part. CONSTITUTION:An decoding means 1 on the receiving side decodes a code 100 transmitted from a transmitting side, displays an moving picture 101 on a picture 2, recognizes a position 102 of the sight line of the observer on the picture 2, and based on the position 102 of the sight line, a determining means 4 to have received the position 102 of the sight line determines a position 103 and a range 104 of the center of the partial animation to be displayed. Based on the position 103 and range 104 of the partial moving picture, the decoding means 1 decodes the code 100, segments the partial moving picture from the animation to be generated, and displays it on the picture 2 as the picture 101. Thus, only the notable part can be enlarged and finely displayed at every observer.

Description

DETAILED DESCRIPTION OF THE INVENTION (Industrial Application Field) The present invention relates to a method for decoding a moving image signal for displaying a moving image signal manually input from a television camera or the like.

(Prior Art) In the encoding/decoding method for video signals used in video conferences, etc., video signals input from a television camera, etc. are encoded and transmitted via an analog or digital communication path. , which is decoded and displayed on the receiving side.

At this time, in order to use a narrowband communication channel, the moving image signal is encoded using a highly efficient encoding method.

For example, if a normal NTSC signal is expressed as digital data, the amount of information will be 60 to 100 Mbits per second. In an actual video conference, this moving image signal is encoded and transmitted at a code amount of about 64K to 1.5M bits/second. Therefore, the encoding compression rate is from 1/40 to 10
It reaches 1/00th.

(Problems to be Solved by the Invention) In conventional encoding/decoding systems for moving image signals, moving image signals input from a television camera or the like are encoded and transmitted as they are. Therefore, the receiving side only displays the decoded moving image. However, when a moving image with many people as subjects is transmitted, for example in a video conference, and many observers are observing the image on the receiving side, the objects of interest may differ depending on the observers. In such a case, it is desirable for each observer to enlarge and display the portion that each observer is paying attention to. However, in the conventional video signal decoding method, since everyone observes the same decoded image, there is a problem in that such an enlarged display of a portion of interest cannot be realized.

The present invention recognizes the position of the viewer's line of sight on the receiving side, determines the position and range of a partial image that is the viewer's attention area in a moving image, and enlarges only this part to display it in detail. The purpose of the present invention is to provide a method for decoding moving image signals.

(Means for Solving the Problems) The encoding/decoding method for moving image signals of the present invention decodes the code transmitted from the transmitting side, displays the decoded moving image on a screen, and displays the code on the screen. Recognize the position of the observer's line of sight, determine the position and range of the partial moving image to be displayed based on the position of the line of sight, and select the partial moving image from the moving image based on the position and range. It consists of means for cutting out and displaying it on the screen.

(effect) The decoding method for moving image signals according to the present invention will be explained.

The receiving side decodes the codes transmitted from the transmitting side and displays the moving image on the screen. Then, the position of the observer's line of sight on the decoded display screen is recognized. Based on the position of this line of sight, the position and range of the partial moving image to be displayed is determined.

The position and range of the moving image indicate which part of the entire moving image is to be enlarged and displayed, and correspond to, for example, the camera angle and zoom of a television camera as an input device.

Based on the position and range thus determined, a partial image is cut out from the moving image, enlarged, and displayed on the screen.

Note that various encoding methods for video signals such as predictive encoding and transform encoding can be used as a method for encoding video signals on the transmitting side.

(Example) Hereinafter, an example of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing an embodiment of the moving image signal decoding method of the present invention. As shown in FIG. 1, a decoding means 1 on the receiving side decodes a code 100 transmitted from the transmitting side and displays a moving image 101 on a screen 2.

FIG. 2 is an explanatory diagram showing a displayed screen.

As shown in FIG. 2, the position 102 of the observer's line of sight on the screen 2 is recognized by the recognition means 3. This recognition means 3 can be easily realized using a device called an eye mark recorder. Furthermore, the position of the observer's line of sight on the screen 2 can be recognized by inputting and processing an image in which the observer is the subject and detecting the movement of the observer's eyeballs.

The determining means 4 that receives the line-of-sight position 102 determines the center position 103 and range 104 of the partial moving image to be displayed based on the line-of-sight position 102. FIG. 3 is an explanatory diagram showing a method for determining the position and range of a partial moving image to be displayed. As shown in FIG. 3, the position 102 of the line of sight on the screen 2 changes over time. Therefore, for example, the center of the line-of-sight position 102 within a certain time is set as the center position 103 of the partial moving image to be displayed.

Then, depending on the range of temporal variation, if the variation is large, the range 104 of the partial video to be displayed is enlarged so that the whole can be displayed, and if the variation is small, the range 104 is made smaller. The portion indicated by position 103 can be displayed in close-up. At this time, it may also be beneficial to enlarge the image using well-known image interpolation methods.

Next, the position 103 of the partial moving image determined by the determining means 5
and range 104 are input to the decoding means 1. Based on the position 103 and range 104 of this partial moving image, the decoding means 1 cuts out a partial moving image from the moving image generated by decoding the code 100 and displays it on the screen 2 as a moving image 101. .

Note that various encoding methods for video signals such as predictive encoding and transform encoding can be used as a method for encoding video signals on the transmitting side.

Furthermore, by implementing such a decoding method for each observer, only the portion of interest for each observer can be enlarged and displayed in detail.

Furthermore, there is no need for the viewer on the receiving side to perform any complicated operations.

(Effect of the invention) By recognizing the position of the line of sight of the viewer on the receiving side, determining the position and range of a partial image as the viewer's attention part in the moving image, and displaying only this part. , it is possible to enlarge only the part that the observer on the receiving side is paying attention to and display it on the detailed HJ.

[Brief explanation of the drawing]

FIG. 1 is a block diagram showing an embodiment of the moving image signal decoding method of the present invention, FIG. 2 is an explanatory diagram showing the displayed screen, and FIG. 3 shows the position of the partial motion @Yu to be displayed. FIG. 3 is an explanatory diagram showing a method for determining a range. In the figure, 1...Decoding means, 2...Screen, 3...Recognition means, 4...Determination means. Figure 1 Figure 2 Figure 3

Claims (1)

[Claims] The code transmitted from the transmitting side is decoded, the decoded moving image is displayed on the screen, the position of the observer's line of sight on the screen is recognized, and the partial moving image to be displayed is determined based on the position of the line of sight. A decoding method for a moving image signal that determines a position and a range, cuts out the partial moving image from the moving image based on the position and range, and displays the partial moving image on the screen.