JPH06303605A - Picture communication terminal equipment - Google Patents

Abstract

PURPOSE:To solve the problem of having a disturbed picture due to inability of a motion picture compression algorithm to follow the motion of a camera in the operation such as rotation of the camera, zoom-in and zoom-out in the picture communication terminal equipment for a video conference or the like. CONSTITUTION:A camera control section 6 receiving a control signal from an operation section 7 such as a remote commander gives a camera motion notice signal to a motion picture CODEC section 5, confirms it that the motion picture CODEC section transits to the freeze state or the like and provides a camera control signal to the camera section to control the operation of the camera. Or the camera control section 6 receiving a control signal from the operation section 7 such as a remote commander gives a camera motion notice signal to a camera section to control the operation of the camera, The terminal equipment is provided with a camera motion detection section receiving the digital picture transmission signal from a pre-processing section 4 to detect a motion of the camera and a camera motion detection notice signal from the camera motion detection section is outputted to a 2nd motion picture CODEC section 8, in which processing such as freezing is executed.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a CCITT H.264 video image from a camera whose operation such as rotation can be controlled by an operation unit such as a remote controller. 261 recommendation The present invention relates to an image communication terminal such as a video conference / telephone terminal which is encoded according to the low-speed moving image compression algorithm and is transmitted to the other party.

[0002]

2. Description of the Related Art In recent years, the market expansion of image communication terminals such as video conferences / telephone terminals is expected due to the spread of ISDN and the recommendation of image encoding algorithms in CCITT. Such an image communication terminal requires a camera for inputting a moving image of its own side, and the functions of the camera are rotation, zoom-in and zoom under the control of an operation unit such as a remote control or an operation panel.・ Functions such as out are required.

FIG. 8 shows functional blocks of a conventional image communication terminal. In FIG. 8, a pre-processing unit 4 for inputting a local analog video input signal B from the local camera 2 and outputting a digital image transmission signal C converted into a common intermediate format (CIF), The digital image transmission signal C is converted to CCITT H.264. The image compression data G encoded according to the low-speed moving image compression algorithm in accordance with the H.261 recommendation is output to the ISDN network, and the image compression data G input from the ISDN network is converted into CCITTH. 261
A moving image codec unit 5 that encodes according to a low-speed moving image compression algorithm that complies with the recommendation and outputs a digital image reception signal D in a common intermediate format (CIF), and an analog video input to the monitor 1 by inputting the digital image reception signal D. An operation signal from the post-processing unit 3 that outputs and displays the output signal A, and the operation unit 7 (remote control device, operation panel, etc.) for controlling the rotation and zoom-in and zoom-out of the own camera 2 Input F, camera control signal E for rotation, zoom in and zoom out, etc.
And the camera control section 6 for controlling the camera to realize communication of image data.

[0004]

However, in the above-mentioned conventional technique, the moving image codec unit 5 cannot cope with the movement of the camera such as rotation, zoom-in and zoom-out, and the image transmitted to the other party cannot be displayed. There was a problem of being disturbed. This is CCITT H. Since the H.261 recommendation itself is a low-speed moving image compression algorithm and is intended for images that originally have little movement, moving the camera means moving the entire screen, which takes time algorithmically, and This is because it becomes impossible to deal with. The present invention solves the above-mentioned conventional problems, and an object thereof is to provide an image communication terminal in which a moving image compression algorithm can follow the movement of a camera during operation.

[0005]

In order to achieve the above object, the present invention has any one of the following means.

(1) It has a function of inputting an operation signal from an operation unit such as a remote controller or an operation panel and transmitting a camera motion notification signal to a moving image codec unit in a camera control unit for controlling the movement of the own camera. The second camera control unit and the camera movement notification signal from the second camera control unit are input to freeze the camera before moving it when movements such as rotation and zoom in / zoom out occur. After that, a second moving image codec section for controlling the camera to move is provided.

(2) In the above structure, when the camera is rotated, the camera control unit transmits a motion vector amount of the camera to the moving image codec unit in advance by including it in the camera motion notification signal, and the camera. The second moving image codec section is provided, which greatly reduces the motion vector detection algorithm by using the motion vector amount.

(3) In the above configuration, the camera zoom
A second camera control unit that transmits a motion vector amount for camera zoom-in in advance to the moving image codec unit by including the motion vector amount in the camera motion notification signal during the IN operation, and a normal CCITT H.264. 261 Recommendation A second moving image codec section that temporarily suspends processing according to the low-speed moving image compression algorithm and performs zoom-in processing operation corresponding to the amount of motion vector of the camera before the camera starts zoom-in operation. It is provided.

(4) In the system having the above-mentioned configuration, the camera control unit and the moving image codec unit are independent, that is, there is no function for transmitting and controlling the camera motion notification signal from the camera control unit to the moving image codec unit. A camera motion detection unit that inputs a digital image transmission signal converted into a common intermediate format (CIF), detects a camera motion, and outputs and controls a camera motion detection notification signal to a second moving image codec unit; In a configuration in which a camera motion detection notification signal from the camera motion detection unit is input and a second moving image codec unit that operates using the information is provided, the camera motion detection unit has four corners of the entire screen. The motion vector of the macroblock (MB) is always detected, and when the vectors match within a certain range, it is determined that the camera is rotating, and the second moving image is detected. It is provided with a function of notifying the information to the codec.

(5) The camera motion detection section constantly detects the motion vectors of macroblocks (MB) at the four corners of the entire screen, and when each vector radially spreads or gathers from the center of the screen, the camera zooms. A function is provided to notify the second moving image codec section of the information when it is determined that the in and zoom out operations have been performed.

(6) The moving image codec section is provided with a memory for accumulating the digital image transmission signal of the previous frame in order to transmit the digital image transmission signal before the movement of the camera to the other terminal. The above-described processing is performed on the digital image transmission signal of the previous frame.

[0012]

Therefore, according to the present invention, due to the above-mentioned configuration, the disturbance of the image can be greatly reduced even if the camera is rotated, or zoomed in and zoomed out.

[0013]

EXAMPLE A first example of the present invention will be described below with reference to FIG. In FIG. 1, 1 is a monitor, 2 is a camera, 3 is a post-processing unit, 4 is a pre-processing unit, and 7 is an operation unit such as a remote controller or an operation panel, which are similar to the conventional example. The same numbers are assigned and the description is omitted. 8
The digital image transmission signal C input from the pre-processing unit 4 to the CCITT H.264. The image compression data G is encoded according to the low-speed moving image compression algorithm compliant with the H.261 recommendation.
Is output to the ISDN network, and the compressed image data G on the other side input from the ISDN network is converted into CCITT H.264. Second, encoding is performed in accordance with the low-speed moving image compression algorithm compliant with the H.261 recommendation, the digital image reception signal D of the common intermediate format (CIF) is output, and the process corresponding to the camera motion is performed using the camera motion notification signal. Is a moving image codec unit of. 9 inputs an operation signal F from the operation unit 7 to rotate the camera 2 and perform zoom-in and zoom-in.
The second camera control unit outputs a camera control signal E such as OUT and outputs a camera motion notification signal to the second moving image codec unit 8. Further, the camera movement notification signal is information on the operation mode of the camera, that is, the rotation mode, the zoom-in mode, the zoom-out mode, and the like, and detailed information in each mode, that is, the rotation direction and rotation in the rotation mode. It is a signal that has information such as quantity and rotation speed.

The contents of the first embodiment will be described below with reference to FIG. In this description, the time when the rotation operation command is issued from the operation unit 7 is described. A camera operation command is generated by the operation unit 7, and the second camera control unit 9 is notified. The second camera control unit 9 first sends a camera motion notification to the second moving image codec unit 8. In the second moving image codec section 8, the normal state, that is, C
CITT H. The processing state according to the low speed moving image compression algorithm recommended by H.261 is shifted to the freeze state, and when the shift is completed, a freeze state shift completion notification is transmitted to the camera control section 9. Upon receipt of this completion notice, the second camera control unit 9 transmits a camera control command to the camera 2 to start rotation of the camera 2.

The second embodiment will be described below with reference to FIG. In this description, the time when the rotation operation command is issued from the operation unit 7 is described. A camera operation command is generated by the operation unit 7, and the second camera control unit 9 is notified. The second camera control unit 9 first sends a camera motion notification to the second moving image codec unit 8 and also sends a camera control command to the camera 2. In the second moving image codec section 8, the normal state, that is, CCIT
TH. Although the processing is performed in accordance with the low-speed moving image compression algorithm recommended by H.261, the rotation vector (rotation direction, rotation amount, rotation speed, etc.) included in the camera motion notification from the second camera control unit 9 is analyzed. , CCITT H.S. It is used for the processing of the low-speed moving image compression algorithm recommended by H.261, and in this processing, the algorithm of the motion vector detection processing that requires time is shifted to a simplified algorithm that greatly reduces the operation.

The third embodiment will be described below with reference to FIG. In this description, the case where a zoom-in operation command is issued from the operation unit 7 is described. The operation unit 7
A zoom-in operation command is generated from the above, and the second camera control unit 9 is notified. The second camera control unit 9 sends a camera motion notification to the second moving image codec unit 8 and also sends a camera control command to the camera 2. In the second moving image codec section 8, the normal state, that is, CCITT H.264. However, the zoom-in information (zoom-in amount, zoom-in speed, etc.) included in the camera motion notification from the second camera control unit 9 is analyzed. Then, the amount of zoom-in and the operation time of the camera are calculated, and the process proceeds to zoom-in processing. After the operating time of the camera has passed, it returns to the normal state.

Next, a second embodiment of the present invention will be described with reference to FIG.
Will be explained. In FIG. 2, 1 is a monitor, 2 is a camera, 3 is a post-processing unit, 4 is a pre-processing unit, 6 is a camera control unit, 7 is an operation unit such as a remote controller or operation panel, and 8 is a second moving image. The codec section is the same as that of the conventional example and the first embodiment, and therefore, the same reference numerals are given and the description thereof is omitted. 10 receives the digital image transmission signal C output from the pre-processing unit 4, detects the movement of the camera from the digital image transmission signal C, and informs the second moving image codec unit 8 of the camera movement detection notification signal I. Is a camera motion detection unit that outputs

The fourth embodiment will be described with reference to FIG. As shown in FIG. 6, the digital image reception signal D of FIG. 2 has a common intermediate format (CI) of 352 pixels × 288 lines.
It is formatted as F). This screen is 396 (22 × 18)
It is divided into macro blocks (MB). Here, one macroblock (MB) is composed of 16 pixels × 16 lines. CCITT H. According to the H.261 recommendation, a motion vector is detected and coded in macroblock units, and the horizontal and vertical components of the motion vector are integers within +/− 15 pixels. The camera motion detection unit 10 in FIG. 2 selects a macro block having four corners in the entire screen and detects a motion vector for the macro block. In FIG. 6, the macro blocks at the four corners are selected like a, b, c, and d. The motion vectors of these four macroblocks are detected, and when the motion vectors match within a certain range, it is determined that the camera has rotated, and the second moving image codec unit 8 in FIG. A camera motion detection notification signal I for notifying that the state has been transmitted is transmitted, and the second moving image codec section 8 performs processing such as shifting from the normal state to the freeze state.
After that, when the motion vectors of the four macroblocks do not match within a certain range in the camera motion detection unit 10, it is determined that the motion of the camera has stopped, and the second moving image codec unit 8 returns to the normal state. To process.

The fifth embodiment will be described with reference to FIG. The camera motion detection unit 10 in FIG. 2 selects a macro block having four corners in the entire screen and detects a motion vector for the macro block. In FIG. 7, a, b,
The macro blocks at the four corners are selected like c and d. The motion vectors of these four macroblocks are detected, and when the four motion vectors are spread in a radial range from the center of the screen, it is determined that there has been a zoom-in operation of the camera, and the second in FIG. A camera motion detection notification signal I is sent to the moving image codec unit 8 to inform that there has been a zoom-in operation of the camera, and the second moving image codec unit 8 performs processing such as shifting from the normal state to the freeze state. After that, when the motion vectors of the four macro blocks do not match in a certain range, the camera motion detection unit 10 determines that the camera motion has stopped, and the second moving image codec unit 8 returns to the normal state. To do so. The same can be explained for the zoom-out operation of the camera.

The sixth embodiment will be described. In the second embodiment, the camera movement is detected by the camera movement detection unit.
After performing detection in 10, when performing processing such as shifting the second video codec unit 8 to a freeze state, image distortion is prevented unless processing is performed on the digital image transmission signal before the camera operates. Therefore, a memory for holding the image transmission signal before detecting the camera movement is provided, and the image transmission signal stored in the memory is used instead of the image transmission signal detecting the camera movement. The above processing is performed.

[0021]

As is apparent from the above-described embodiments, the present invention realizes an image communication terminal with high image quality by significantly reducing image distortion due to camera rotation, zoom-in and zoom-out operations. It has the effect of being able to.

[Brief description of drawings]

FIG. 1 is a functional block diagram of an image communication terminal according to a first embodiment of the present invention.

FIG. 2 is a functional block diagram of an image communication terminal according to a second embodiment of the present invention.

FIG. 3 is an explanatory diagram of a first embodiment content of the present invention.

FIG. 4 is an explanatory diagram of a second embodiment content of the present invention.

FIG. 5 is an explanatory diagram of the third embodiment of the present invention.

FIG. 6 is an explanatory diagram of the contents of the fourth embodiment of the present invention.

FIG. 7 is an explanatory diagram of the fifth embodiment of the present invention.

FIG. 8 is a functional block diagram of an image communication terminal in a conventional example.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Monitor, 2 ... Camera, 3 ... Post-processing part, 4 ... Pre-processing part, 5 ... Moving image codec part, 6 ... Camera control part, 7 ... Operation part, 8 ... 2nd moving image codec part,
9 ... second camera control unit, 10 ... camera movement detection unit,
A ... video output signal, B ... video input signal, C ...
Digital image transmission signal, D ... Digital image reception signal,
E ... Camera control signal, F ... Operation signal, G ... Image compression data, H ... Camera motion notification signal, I ... Camera motion detection notification signal.

Claims (6)

[Claims] 1. A pre-processing unit that inputs a local analog video input signal from a local camera or the like and outputs a digital image transmission signal converted into a common intermediate format (CIF),
CCITT the digital image transmission signal that is input
H. The image compression data encoded according to the low-speed moving image compression algorithm based on the H.261 recommendation is output to the ISDN network, and the image compression data input from the ISDN network is CCITT H.264. Common intermediate format that is decoded according to the low-speed moving image compression algorithm compliant with the H.261 recommendation
A moving image codec unit that outputs a (CIF) digital image reception signal, a post-processing unit that inputs the digital image reception signal and outputs / displays an analog video output signal on a monitor, rotation and zoom of the own camera, Controls the camera by inputting operation signals from the operation unit (remote control device, operation panel, etc.) for controlling in and zoom out, etc. and outputting control signals such as rotation, zoom in and zoom out. In an image communication terminal configured to communicate with image data including a camera control unit, the camera control unit transmits a camera motion notification signal to the moving image codec unit to rotate the camera, zoom in and zoom out, and the like. When motion occurs, the moving image codec section is controlled to freeze before moving the camera and then to move the camera. An image communication terminal characterized by eliminating the image distortion. 2. The camera control unit transmits the motion vector amount of the camera to the moving image codec unit in advance by including the motion vector amount of the camera in the camera motion notification signal, and the moving image codec unit uses the motion vector amount of the camera. The image communication terminal according to claim 1, wherein the motion vector detection algorithm is significantly reduced to reduce the image disturbance with respect to the camera movement. 3. When the camera zooms in, the camera control unit transmits to the moving image codec unit a motion vector amount for the zooming in of the camera in advance in a camera motion notification signal, and the moving image codec unit normally sends the motion vector amount. CC
ITT H. 261 Recommendation The processing according to the low-speed moving image compression algorithm is interrupted, and the zoom-in processing corresponding to the motion vector amount of the camera is performed on the image data before starting the zoom-in operation of the camera. The image communication terminal according to claim 1, wherein the normal processing is restarted after the operation is completed to reduce the image disturbance with respect to the movement of the camera. 4. A preprocessing unit for inputting a local analog video input signal from a local camera or the like and outputting a digital image transmission signal converted into a common intermediate format, and a CCITT for inputting the digital image transmission signal. H. 261
The image compression data encoded by the low-speed moving image compression algorithm according to the recommendation is output to the ISDN network, and the image compression data input from the ISDN network is CCITT.
H. A moving image codec unit that decodes in accordance with a low-speed moving image compression algorithm compliant with the H.261 recommendation and outputs a digital image reception signal in a common intermediate format, and the digital image reception signal is input and an analog video output signal is output / displayed on a monitor. A communication terminal device having a post-processing unit and a camera control unit for controlling a camera by inputting operation signals from an operation unit for controlling rotation and zoom-in / zoom-out of the own camera. In the system in which the camera control unit and the moving image codec unit are independent (there is no function to control the moving image codec unit by the camera motion notification signal from the camera control unit), the preprocessing unit A digital image transmission signal is input to detect the camera movement and a camera movement detection notification signal is sent to the moving image codec. The camera motion detection unit that outputs and controls the camera is always provided, and the camera motion detection unit constantly detects the motion vectors of the macroblocks at the four corners of the entire screen, and when the vectors match within a certain range, the camera rotation operation is performed. An image communication terminal, characterized in that it is determined to be present and the information is notified to the moving image codec section. 5. The camera motion detection unit constantly detects motion vectors of macroblocks having four corners of the entire screen, and when each vector radially spreads or gathers from the center of the screen, the camera zooms in or out. The image communication terminal according to claim 4, wherein the moving image codec unit is notified of the information when it is determined to have operated. 6. The moving image codec unit after detecting the camera movement by the camera motion detecting unit and transmitting a camera motion detection notification signal to the moving image codec unit, the influence of the image distortion due to the camera movement The image communication according to claim 4 or 5, further comprising a memory for accumulating image data of a previous frame that is not present, which is image data for performing processing such as freezing the digital image transmission signal of the previous frame. Terminal.