JPH06189301A - Video transmission processing device - Google Patents

Abstract

PURPOSE:To freely revise and set the resolution and the frame rate of com pressed data sent from a connected terminal equipment by providing a connec tion destination control signal generating section to the terminal equipment so as to allow the receiver side to control the compressed data. CONSTITUTION:The size of a display pattern of a video image or the lightness or the like or a sound level inputted to a speaker 109B and a frequency characteristic or the like is controlled through a command via a control input device 108. In this case, a video/sound indication reproduction control section 103B outputs a display state of a video image and a reproduction state of a sound signal to a connection destination control signal generating section 104B. The connection destination control signal generating section 104B outputs a control signal to a transmission data compression control section 105A of a terminal equipment 101A of a connection destination in response to the state of a status signal. Thus, a compression parameter of transmission data or the like is controlled at the receiver side in a form corresponding to the display content on the display monitor 110B at the terminal equipment 101B or the sound reproduction state of a speaker 109B.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video transmission processing apparatus for bidirectionally communicating moving images and sounds as compressed data for display and reproduction.

[0002]

2. Description of the Related Art Conventionally, as a technique for simultaneously transmitting moving image information and audio information, for example, "Video Information (I) (198)
There is a videophone described in "September 8th, page 49 to page 54". The configuration of this videophone will be described with reference to FIG.

The constituent elements of the videophone are a video section 403 which processes moving image information and an audio section 416 which processes audio information.
And operation keys 420 for controlling telephone calls, video / audio, etc.
It has a basic configuration with. The video unit 403 is connected with a camera 401 for photographing the face of the caller, a display 409 for displaying a video sent from the other party, and the like via a video signal line 402 and a display signal line 426, respectively. There is. A receiver 410, which is means for inputting / outputting voice information, is connected to the voice unit 416 via a voice signal line 413. A speaker 411 and a microphone 412 are connected to a voice unit 416 via a voice signal line 414 and a voice signal line 415, respectively, in order to talk with the receiver on.

Since the videophone communicates via the communication line 408 in which the data transmission rate has an upper limit, the moving picture information and the voice information cannot be simultaneously transmitted unless the amount of data to be transmitted is reduced. Therefore, the video encoding / decoding unit 405 is connected to the video unit 403 via the decoded video signal line 404, while the audio unit 41 is connected.
6, a voice encoding / decoding unit 418 is connected via a decoded voice signal line 417. The video encoding / decoding unit 405 encodes the video signal data, outputs the encoded video signal on the encoded video signal, and inputs the encoded video signal to the communication line interface 407. The voice encoding / decoding unit 418 encodes the voice signal, outputs the encoded voice signal onto the encoded voice signal line 419, and inputs it to the communication line interface 407. The operation key 420 is
It is a means for designating each operation such as making a call, displaying a video, inputting / outputting a voice, and the like. A signal is input to the control unit 422 via the key output signal line 421, and the control unit 422 controls the video, the voice, In order to control the line and the like, the video encoding / decoding unit 40 transmits the video control signal via the video control signal line 425.
5, the voice control signal is input to the voice encoding / decoding unit 418 via the voice control signal line 424, and the line control signal is input to the communication line interface 407 via the line control signal 423. . The communication line interface 407 multiplexes the coded video signal, the coded voice signal, and the line control signal 423 and outputs them to the communication line 408. On the other hand, when receiving, communication line 40
The multiplexed signal input from 8 is separated into an encoded video signal and an encoded audio signal by the communication line interface 407, and the video encoding / decoding unit 405 decodes the encoded video signal. , Decoding video signal line 404
The video signal is output to the above, and the display unit 403 outputs the display signal to the display 409 to display the moving image on the display 409.

On the other hand, in the voice encoding / decoding section 418,
The encoded voice signal is decoded and output on the decoded voice signal line 417. In the voice unit 416, the input decoded voice signal is input to the receiver 410 and the speaker 411, respectively, the voice signal line 413 and the voice signal line 414. Output via.

[0006]

Conventionally, in an apparatus for transmitting moving picture / sound information such as a videophone, the compression parameter at the time of compressing the moving picture information is set to a value depending on the maximum transmission rate of the communication path used. Is determined by the sender.

Usually, such parameters are automatically set according to the movement of the image input from a camera or the like. The video captured from the camera or the like on the transmission side is subjected to data compression processing according to the above parameters and sent to the reception side.
The receiving side decompresses the data according to the parameters and displays it. The display screen on the receiving side can be adjusted in brightness, contrast, hue, vividness and the like when the display signal (video signal) subjected to the expansion processing is displayed on the display.

However, depending on the content of the transmitted moving image information, smoothness of movement (frame rate) may be important as a moving image on the receiving side, and resolution may be required up to a detailed portion. In, they could not be controlled and changed on the receiving side. The present invention provides a video transmission processing device that can freely change the resolution, frame rate, etc. of displayed data in real time with respect to a moving image displayed on the receiving side.

[0009]

[Means for Solving the Problems] In order to solve the above problems, the following means can be considered.

Input moving image information and voice information,
Video with the function of converting the information into digital data
A voice input unit, a data compression control unit that performs data compression processing on the digital data, a control input device having a function of inputting an instruction to perform control, and a connection to a communication line according to an instruction from the control input device, A communication control unit for transmitting and receiving compressed data, a data decoding unit for decompressing the received compressed data, an image output unit and an audio output unit for outputting the decompressed received data, and the decompressed unit. Video / audio display reproduction control for outputting received data to the image output means and the audio output means, and further controlling the size of the display screen in the image output means by an instruction given via the control input device. In a video transmission processing device configured to have a unit, a video transmission processing device of the same configuration is connected to a connection destination connected via a communication line. The video / audio display / reproduction control unit has a function of outputting a status signal relating to a display / reproduction state including the size of the screen. A connection destination terminal control signal generation unit that generates a signal for controlling image information is provided, and the signal generated by the connection destination terminal control signal generation unit is output to the communication line via the communication control unit to connect the connection destination terminal control signal generation unit. The video transmission processing device is input to a data compression control unit of the video transmission processing device, and the data compression processing parameter of the connection destination video transmission processing device is controlled by the connection source video transmission processing device.

In this case, the connection destination terminal control signal generation unit detects the size of the display screen based on the status signal, and the size of the frame rate and the resolution, which is the moving image information transmitted by the video transmission processing device of the connection destination. When determining the height, it is preferable that the control signal is generated so that the value obtained by multiplying the data amount of one frame by the frame rate is within a predetermined value. Further, the connection destination terminal control signal generation unit generates a control signal so that the transmission rate of the moving image information and the audio information transmitted by the connection destination video transmission processing device does not exceed the maximum transmission rate of the communication line. The configuration is also preferable.

Further, in the above video transmission processing device, an overlay control section and a control signal generation section are further provided,
The display control unit, which is configured by connecting the control signal generation unit and the system bus of the information processing apparatus, has a function of inputting a display status signal related to the state of the display screen to the control signal generation unit. Then, the control signal generation unit generates and outputs the connection destination terminal control signal using the instruction and the display status signal given via an input device included in the information processing apparatus, and further, the video / audio reproduction control. The control signal is output to the
The display information output from the video / audio display reproduction control unit and the display information output from the display control unit are combined and sent to the display unit included in the information processing apparatus, and the combined screen is displayed on the screen of the display unit. A video transmission processing device that outputs the above may be considered. Further, the following means can be considered as a configuration in which a plurality of video transmission processing devices are connected by a communication line.

A video transmission processing device for connecting at least two image processing devices and the image processing devices using a communication line, wherein each image processing device inputs moving image information and audio information, and the information is transmitted. A video / audio input unit having a function of converting data into digital data, a data compression control unit for performing data compression processing on the digital data, a control input device having a function of inputting an instruction for performing control, and the control input A communication control unit for connecting to a communication line, transmitting and receiving compressed data according to an instruction from the device, a data decoding unit for decompressing the received compressed data, and an image output unit for outputting the decompressed received data And an audio output means, and outputs the expanded received data to the image output means and the audio output means, and further via the control input device. In a video transmission processing device configured to have a video / audio display reproduction control unit for controlling the size of the display screen in the image output means in accordance with a given instruction, to a connection destination connected via a communication line. Are connected to a video transmission processing device having the same configuration, and the video / audio display reproduction control unit outputs a status signal indicating a display / reproduction state, and the video transmission processing device at the connection destination outputs the status signal according to the status signal. A connection destination terminal control signal generation unit for generating a signal for controlling information regarding audio and images to be output, and outputs the signal generated by the connection destination terminal control signal generation unit to the communication line via the communication control unit. , Input to the data compression control unit of the video transmission processing device at the connection destination,
The video transmission processing device controls the data compression parameter of the connection destination video transmission processing device by the connection source video transmission processing device.

The image output means has a function of displaying an instruction item for performing predetermined control on a display screen and inputting an instruction through the display screen. Alternatively, the display means included in the information processing device has a function of displaying an instruction item for performing predetermined control on a display screen and inputting an instruction through the display screen. A processing device is conceivable.

[0015]

[Operation] The operation will be described below.

The video transmission processing device on the receiving side is provided with a connection destination terminal control signal generation unit, generates a signal for controlling the video transmission processing device on the connection destination, that is, the transmission side, and inputs it to the data compression control unit on the transmission side. . The data handled here is moving image information, audio information, and the like. Now, by controlling the compression parameter used for processing in the data compression control unit built in the device on the transmission side by the device on the reception side, the frame rate, resolution, etc. can be adjusted. Furthermore, by inputting a status signal from the video / audio display reproduction control unit to the connection destination terminal control signal generation unit, according to the display state (screen size, position, etc.) of the moving image displayed on the receiving side, It is possible to control the compression parameter of the transmission data on the transmission side.

Therefore, the operator on the receiving side can set desired compression parameters in order to make a trade-off of frame rate, resolution, etc. according to his / her purpose.

[0018]

EXAMPLES Examples of the present invention will be described.

FIG. 1 shows a configuration example of a video transmission processing device of the present invention. In FIG. 1, the video transmission processing devices are connected via a communication line network 150. However, in the present embodiment, two video transmission processing devices are referred to as video transmission processing devices (hereinafter, simply “terminal A”). 101A and a video transmission processing device (hereinafter, also simply referred to as “terminal B”) 10
1B is in a connected state. The terminal A 101A and the terminal B 101B have the same configuration, and the same constituent elements are denoted by the same reference numerals, and the numbers are denoted by “A” and “B”.

In the following description of this embodiment, first, the terminal A
The configuration of 101A will be described. Terminal A101A is
A video / audio input unit 102A, a video / audio display reproduction control unit 103A, a connection destination terminal control signal generation unit 104A,
The transmission data compression control unit 105A, the reception data decoding unit 106A, and the communication control unit 107A are configured,
Furthermore, outside, TV camera 112A, microphone 111A,
The display monitor 110A, the speaker 109A, and the control input device 108A are provided. Video
Audio input unit 102A, video / audio display reproduction control unit 103
A, the connected terminal control signal generation unit 104A, the transmission data compression control unit 105A, the reception data decoding unit 106A, and the communication control unit 107A are, for example, a CPU, a ROM, and a R.
It can be realized by electronic devices such as AM and various C-MOS.

TV camera 112A and microphone 111A
Is connected to the video / audio input unit 102A, and the control signals output from the control input device 108A via the control signal lines 113A and 114A are input to the video / audio display reproduction control unit 103A and the communication control unit 107A, respectively. To be done. The output signal of the video / audio input unit 102A is input to the transmission data compression control unit 105A, and the transmission data compression control unit 10
The compressed data output from the 5A via the compressed data line 119A is input to the communication control unit 107A, the transmission data compression control unit 105A and the communication control unit 107A are connected by a control signal on the control signal line 118A, and A control signal is input from the communication control unit 107A to the transmission data compression control unit 105A via the control signal line 116B. The reception data decoding unit 106A and the communication control unit 107A are connected by a control signal line 117A, and the compression data output from the communication control unit 107A via the compression data line 119B is input to the reception data decoding unit 106A. The output signal of the reception data decoding unit 106A is input to the video / audio display reproduction control unit 103A.

The connection destination terminal control signal generation unit 104A and the video / audio display reproduction control unit 103A are connected via a status signal line 115A, and the connection destination terminal control signal generation unit 104A connects the connection destination terminal control signal line 116A. The connection destination terminal control signal output via the communication control unit 107A
Entered in. Next, the configuration of the terminal B101B will be described.

The terminal B101B includes a video / audio input unit 10
2B, a video / audio display reproduction control unit 103B, a connection destination terminal control signal generation unit 104B, a transmission data compression control unit 105B, a reception data decoding unit 106B, and a communication control unit 107B. , TV camera 112B, microphone 111B, display monitor 1 externally
10B, a speaker 109B, and a control input device 108B. The video / audio input unit 102B, the video / audio display reproduction control unit 103B, the connection destination terminal control signal generation unit 1
04B, the transmission data compression control unit 105B, the reception data decoding unit 106B, the communication control unit 107B, and the like can be realized by electronic devices such as a CPU, a ROM, a RAM, and various C-MOSs. The TV camera 112B and the microphone 111B are connected to the video / audio input unit 102B, and the control signal line 113B from the control input device 108B,
The control signal output via 114B is input to the video / audio display reproduction control unit 103B and the communication control unit 107B, respectively.

The output signal of the video / audio input section 102B is
The compressed data input to the transmission data compression control unit 105B and output from the transmission data compression control unit 105B is input to the communication control unit 107B via the compressed data line 119B, and is transmitted to the transmission data compression control unit 105B and the communication control unit. 10
7B are connected by a control signal line 118B, and further, a control signal is input from the communication control unit 107B to the transmission data compression control unit 105B via the control signal line 116A.
Received data decoding unit 106B and communication control unit 107B
Are connected by a control signal line 117B, and the communication control unit 107
The compressed data output from B is the compressed data line 119A.
It is input to the received data decoding unit 106B via.

The output signal of the received data decoding unit 106B is input to the video / audio display reproduction control unit 103B.
The connection destination terminal control signal generation unit 104B and the video / audio display reproduction control unit 103B are connected by a status signal line 115B, and the connection destination terminal control signal output from the connection destination terminal control signal generation unit 104B is (connection destination terminal ) Control signal 11
It is input to the communication control unit 107B via 6B. Next, in the configuration of the present embodiment shown in FIG.
The operation will be described by taking as an example the case of transmitting video information and audio information from 1A) to the terminal B (101B).

Terminal A (101) A and terminal B (101B)
Control input device 108A to connect terminal B
When a connection with (101B) is instructed, the communication control unit 107A is controlled by a control signal (a signal on the control signal line 114A), and the communication control unit 107A receives the terminal B (101B) via the communication line network 150. Make a connection with. From the TV camera 112A and the microphone 111A to the terminal B (101
Video information and audio information to be transmitted are input to B), and the video / audio input unit 102A converts the input video information and audio information into digital data and sends the digital data to the transmission data compression control unit 105A.

The transmission data compression control unit 105A compresses the input video and audio data, and the communication control unit 10
7A, compressed data (data on the compressed data line 119A) is output, and the compression parameters (for example, quantization parameter, sampling rate, screen data amount, color data spread rate, etc.) used during the data compression process are controlled. The signal is output to the communication control unit 107A as a signal (a signal on the control signal line 118A). In the communication control unit 107A, the compressed video / audio signals and the compression parameters are converted into a data format suitable for the transmission method of the communication network 150 to be used (for example, a method matched to the line such as ISDN), and communication is performed. It is transmitted to the terminal B (101B) via the line network 150. On the other hand, in the terminal B (101B), the terminal A (1
01A) data transmitted from the communication line control unit 10
At 7B, the compressed data (signal on the signal line 119A),
Separated into compression parameters, the received data decoding unit 106
The compressed data (the signal on the signal line 119A) is input to B, and the compression parameter is set to the control signal (control signal line 1).
17B signal).

The reception data decoding unit 106B uses the compression parameter of the received compressed data (signal on the signal line 119A) by the control signal on the control signal line 117B to compress the transmission data compression control unit 105A of the terminal A (101A). Then, the data is decompressed by the decoding method suitable for the compression method and sent to the video / audio display reproduction control unit 103B. Video / audio display playback controller 1
In 03B, the decompressed data is converted into a video signal and an audio signal, which are sent to the display monitor 110B and the speaker 109B, respectively, and the video information and the audio information are output.

Control relating to the size, brightness, contrast, color tone, vividness, etc. of the display screen of the image displayed on the display monitor 110B, or the audio level input to the speaker 109B, frequency characteristics (tone control), etc. , Instructing via the control input device 108B,
The control signal (signal on the control signal line 113B) may be used to control the video / audio display reproduction control unit 103B.

At this time, the video / audio display reproduction control section 10
3B instructs the connected terminal control signal generation unit 104B to display the video display state and the audio playback state of the video / audio display / playback control unit 103B controlled by the control signal (the signal on the control signal line 113B) as “status signal”. "(Signal on the status signal line 115B)" to the connection destination terminal control signal generation unit 104B.

In the connection destination terminal control signal generation unit 104B, in order to control the transmission data compression control unit 105A of the connection destination terminal A (101A) according to the state of the status signal (signal on the status signal line 115B). A control signal (a signal on the control signal line 116B) is output as the signal of the communication control unit 107B, the communication network 1
50, and is input to the transmission data compression control unit 105A via the communication control unit 107A.

As a result, the compression parameter of the transmission data on the transmission side of the data is received in a form corresponding to the display content on the display monitor 110B on the terminal B (101B) or the audio reproduction state on the speaker 109B. It becomes possible to operate from the side.

For example, the receiving side is required to increase the frame rate (the number of screens per second), the size of the displayed video screen, the resolution of the transmitted display data, etc. It is impossible to meet all of these requirements due to the limitation of the maximum data transmission rate of the transmission path to be used, and one of the parameters is sacrificed by making a trade-off. For example,
When the display screen is enlarged and the data resolution is increased at the expense of the frame rate (that is, the frame rate is reduced), or when the display screen is reduced but the frame rate and the data resolution are increased, It is conceivable to make various trade-offs such as increasing the frame rate and the size of the display screen while reducing the data resolution. An example of such control will be described with reference to FIGS.

FIG. 4 is a diagram showing the user interface on the display monitor of this embodiment, and FIG. 5 is a diagram showing the relationship between the frame rate and the resolution with respect to the size of the display screen displayed on the display. . In FIG. 4, the image sent from the other terminal is displayed on the display screen 502 on the display monitor 501.
The size of the display screen 502l can be changed by instructing the size of the display screen 502 from the control input device 108B. In addition, the display monitor 501 has a frame rate 503A of the display screen 502 and a frame rate / resolution display area 503 for indicating the resolution 503B. Here, "fps" is frame / second, "Res"
Represents the resolution.

In FIG. 4, the frame rate 503A
"20" as the value of, and the value "25" for the resolution 503B.
6 ”is displayed. If the displayed value is large, it means that the frame rate and the resolution are respectively large, and if the value is small, it means that the frame rate is small and the resolution is low. . The video data is
Since it is sent via the communication line network 150 having a restriction on the maximum value of the transmission rate, the compressed data (compressed data line 1
(The data on 19A) exceeds the maximum transmission rate, the data cannot be transmitted normally, so that the compressed data (data on the compressed data line 119A) does not exceed the maximum transmission rate, the frame rate 503A, It is necessary to control the resolution 503B.

In FIG. 5, the size of the display screen is 502l.
When the value (shown in FIG. 4) is the value 50212, a curve (curve 50212) showing a possible value of the compressed data (data on the compressed data line 119A) is shown. The vertical axis of this figure is the frame rate, and the horizontal axis is the resolution. With the user interface of FIG. 4, the frame rate 503A and the resolution 503B are the point on the curve shown in FIG. 5 (the point on the curve determined by 503A and 503B), the point on the vertical axis (503A), and the horizontal. A value in the range surrounded by the point (503B) on the axis and the origin can be taken. In the connection destination terminal control signal generation unit 104B,
Display screen size 502l and frame rate 503A,
The resolution 503B controls the video / audio display reproduction control unit 103 so that the resolution does not exceed this range.
15B).

Further, at this time, a control signal (a signal on the control signal line 116B) for controlling the transmission data compression unit 105A of the connection destination terminal is generated, and the video data to be compressed by the terminal on the transmission side is generated in real time. Control. In this way, the frame rate and resolution of the video sent from the transmission side can be controlled within the range of the maximum transmission rate of the communication line in use according to the size of the display screen on the reception side terminal. it can. Above, from terminal 101A to terminal 1
The case of sending video to 01B was explained, but terminal B
The same applies when sending from (101B) to terminal A (101A).

The same applies when there are three or more terminals. Further, in FIG. 5, the curve 50211 and the curve 5
The size of the display screen is 50.
2l shows the case of taking the values of 502l1 and 502l3, respectively. In this case, 502l1 <502l2
<502l3. As described above, in the present embodiment, an example of connecting one-to-one terminals has been described, but a plurality of terminals may be connected and used at the same time.
In this case, there are as many display screens 502 as shown in FIG. 4 as the number of connected counterpart terminals, and the frame rate,
Similarly, there may be a plurality of resolution display areas 503, or only one resolution display area 503 may be displayed and a screen for a desired connection destination terminal may be displayed by operation. Such a display method includes, for example, CPU, ROM, R
It can be realized by electronic devices such as AM and software built in these devices.

Of course, when a plurality of terminals are connected to the terminal B (101B) of FIG. 1, the connection destination terminal control signal (signal on the control signal line 116B) output from the connection destination terminal control signal generation unit 104B. Respectively controls the transmission data compression control unit of the connection destination terminal. Next, a second embodiment of the present invention will be described with reference to FIG. In FIG. 2, a terminal 260 uses a display monitor of an information processing terminal device such as a personal computer or a workstation as the display monitor of the terminal shown in FIG. 1, and transmits the transmitted image on the display monitor of the information terminal device such as a personal computer. In addition, the communication control is performed by an instruction given via a keyboard, a mouse or the like which is an input / output interface of the information processing terminal device. .

Next, the configuration of the terminal 260 will be described. The video / audio input unit 202 is externally connected to the TV camera 212 and the microphone 211, and the output signal of the video / audio input unit 202 is input to the transmission data compression control unit 205. The transmission data compression control unit 205 outputs the compressed data to the communication control unit 207 via the compressed data line 219, and receives the compressed data from the connection destination terminal control signal generation unit of the connection destination terminal connected to the communication control unit 207. A control signal (a signal on the control signal line 316) is input and further connected by a control signal line 218. The compressed data (the signal on the compressed data line 319) output from the communication control unit 207 is input to the received data decoding unit 206 and further connected by the control signal line 217. The output of the reception data decoding unit 206 is
The video / audio reproduction control unit 203 inputs the audio output of the video / audio display reproduction unit 203 to the external speaker 209, and the video output is input to the superposition control unit 257. The video / audio display reproduction control unit 203 and the connection destination terminal control signal generation unit 204 are connected by the status signal line 215, and the control signal output from the connection destination terminal control signal generation unit 204 via the control signal line 216 is: It is input to the communication control unit 207 and input to the transmission data compression control unit of the terminal connected via the communication line 150. The video / audio display reproduction control unit 203 includes a control signal generation unit 20.
A control signal from 8 (a signal on the control signal line 213) is input.

The control signal (signal on the control signal line 214) output from the control signal generator 208 is the communication controller 20.
Input to 7. Further, the control signal generation unit 208 is connected to the system bus 250. A CPU 252, a main memory 251, an auxiliary memory 253, a personal computer / WS (workstation) display control unit 254, and an input interface 256 are connected to the system bus 250. The display output signal output from the personal computer / WS display control unit 254 is input to the overlay control unit 257,
The display output signal output from the overlay control unit is output to the display monitor 210. The input interface 256 includes a keyboard 259 and a mouse 258.
Etc. are connected. Next, the operation of this embodiment will be described.

A video / audio input unit 202, a video / audio display reproduction control unit 203, a connection destination terminal control signal generation unit 204,
Reception data decoding unit 206, transmission data compression control unit 2
05, the communication control unit 207, the video / audio input unit 102A, 102B, the video / audio display reproduction control unit 1 shown in FIG.
03A, 103B, connection destination terminal control signal generation unit 104
A, 104B, received data decoding units 106A, 106
B, the transmission data compression control units 105A and 105B, and the communication control units 107A and 107B have the same configuration and perform the same operation. In the present embodiment, instead of the control input devices 108A and 108B shown in FIG.
8 is provided and an image is output from the control signal generation unit 208.
The control signal (signal on the control signal line 213) input to the audio display reproduction control unit 203 is the control signal line 113 in FIG.
A and 113B are the same as the signals on the control signal generator 2
The control signal (signal on the control signal line 214) output from 08 and input to the communication control unit 207 is the same as the signal on the control signal lines 114A and 114B in FIG. The display output signal output from the personal computer / WS display control unit 254 and the video output signal output from the video / audio display reproduction control unit 203 are subjected to overlay control by the overlay control unit 257, and the video / audio display is performed. The video output output from the reproduction control unit 203 is converted into the scan timing of the display monitor 210 of a personal computer, a workstation, etc., and is combined with the display of the personal computer / WS for display.

The superposition control is performed by the personal computer / WS.
The display output signal received from the display control unit 254 and the video output signal from the video / audio display reproduction control unit 203 are switched to be output to the display monitor 210, and the video / audio display reproduction control unit is displayed on the display screen 502 in FIG. 20
3 is a control for displaying the moving image information output from 3 of FIG. This control is realized as follows, for example.
First, a portion corresponding to the display area of the display screen 502 is filled with a predetermined specific color by the personal computer / WS display control unit 254, and the overlay control unit 257.
Detects the specific color, outputs the display information from the video / audio display reproduction control unit 203 when the color is the specific color, and outputs the display information of the personal computer / WS display control unit 254 when the color is other than the specific color. Switching control may be performed. Further, the superposition control unit 257 outputs the signal output from the video / audio display reproduction control unit 203 to the display monitor 210.
The scanning timing may be converted to a scanning timing that conforms to, and control may be performed so as to synchronize. In this way, the display monitor 210 can display the moving image information sent from the video / audio display reproduction control unit 203 in the area of the display screen 502 as shown in FIG.

The superposition control unit 257 is
For example, it can be realized by an electronic device such as a CPU, a ROM, and a RAM. The control signal generation unit 208 generates the control signal via the input interface 256 by an input operation via the input means such as the keyboard 259 and the mouse 258. Further, at this time, in order to perform control in association with the display control by the personal computer / WS display control unit 254, a display status signal (signal on the signal line 255)
Is input from the personal computer / WS display control unit 254. The control of the personal computer / WS display control unit 254, the control of the control signal generation unit 208, and the like can be realized by the configuration performed by the CPU 252 by a program stored in advance in the auxiliary storage device 253, the main storage memory 251, and the like. next,
A display example on the display monitor 210 is shown in FIG. On the display monitor 510, the display screen 502 based on the display information from the video / audio display reproduction control unit 203, and the display output 506 from the personal computer / WS display control unit 254.
And frame rate, resolution display, change area 504
Are displayed on the same screen.

For example, the size of the display screen 502, 502l, can be changed by moving the mouse cursor 505 using a mouse which is a locator, and a button 504a provided on the frame rate resolution display / change area 504.
(Increase in value of "fps"), 504b (increase in value of "Res"), 504c (decrease in value of "fps"), 504
The values of the frame rate 503A and the resolution 503B can be changed by moving the mouse cursor over d (decrease in the value of “Res”) and operating the mouse button.
As described above, the range in which the value can be changed is within the range surrounded by the curve shown in FIG. 5, the vertical axis, and the horizontal axis. Such a change is made by, for example, the mouse 258, the input interface 256, the system bus 250, the personal computer / WS shown in FIG.
Display control unit 254, CPU 252, superposition control unit 2
57 and man-machine interface software stored in the main memory 251. Here, “fps” means the number of frames per second, and “Res” means the resolution. According to the present embodiment, in addition to the video to be transmitted and displayed, it is possible to operate and display it simultaneously with other software operating on the information processing terminal. It is also possible to operate.

For example, the transmitted moving image data is classified according to its contents and stored in the database software operating on the personal computer / WS, the image information is classified and stored, and the transmitted moving image is stopped. As a still image, attach the still image to a sheet of desktop publishing (DTP software) that runs on a personal computer / WS, and further store it in advance on a magnetic disk of the personal computer / WS according to the items in the spreadsheet table. It is conceivable that the moving picture information is retrieved, displayed, and transmitted.
As described above, this embodiment can be used when exchanging moving image data with an application operating on a personal computer / WS while watching a moving image display.

[0047]

According to the present invention, the receiving side control signal generating section controls the compressed data sent from the connecting side terminal on the receiving side so that it is within the maximum transmission rate of the transmission path to be used. , Resolution, frame rate, etc. can be freely changed and set.

[0048]

[Brief description of drawings]

FIG. 1 is a diagram showing a configuration of a first exemplary embodiment of the present invention.

FIG. 2 is a diagram showing a configuration of a second exemplary embodiment of the present invention.

FIG. 3 is a diagram showing a configuration of a conventional TV phone.

FIG. 4 is a diagram showing a display example on the display according to the first embodiment of the present invention.

FIG. 5 is a diagram showing a relationship among a size of a display screen, a frame rate, and a resolution.

FIG. 6 is a diagram showing a display example on a display according to a second embodiment of the present invention.

[Explanation of symbols]

101A ... Terminal A, 101B ... Terminal B, 102A ... Video / audio input section, 102B ... Video / audio input section, 103A
... video / audio display / reproduction control unit, 103B ... video / audio display / reproduction control unit, 104A ... connection destination terminal control signal generation unit,
104B ... Connected terminal control signal generator, 115A ... Status signal line, 115B ... Status signal line, 116A
... control signal line, 116B ... control signal line, 108A ... control input device, 108B ... control input device, 113A ... control signal line, 113B ... control signal line, 114A ... control signal line,
114B ... Control signal line, 106A ... Received data decoding section, 106B ... Received data decoding section, 105A ... Transmission data compression control section, 105B ... Transmission data compression control section,
117A ... Control signal line, 117B ... Control signal line, 118
A ... Control signal line, 118B ... Control signal line, 119A ... Compressed data line, 119B ... Compressed data line, 107A ... Communication control unit, 107B ... Communication control unit, 109A ... Speaker,
110A ... display monitor, 111A ... microphone, 1
12A ... TV camera, 109B ... speaker, 110B ...
Display monitor, 111B ... Microphone, 112B ... T
V camera, 150 ... communication line network, 260 ... terminal, 202
... video / audio input unit, 203 ... video / audio display reproduction control unit, 204 ... connection destination terminal control signal generation unit, 215 ... status signal, 216 ... control signal, 205 ... transmission data compression control unit, 206 ... received data decoding Control unit 208, control signal generator 209, speaker 210, display monitor 211, microphone 212, TV camera 21
3 ... Control signal line, 214 ... Control signal line, 215 ... Status signal line, 216 ... Control signal line, 217 ... Control signal line, 218 ... Control signal line, 219 ... Compressed data line, 21
9 ... Signal line, 207 ... Communication control part, 250 ... System bus, 251 ... Main memory, 252 ... CPU, 253 ...
Auxiliary storage device, 254 ... PC / WS display control unit, 2
55 ... Signal line, 256 ... Input interface, 257
... overlay control unit, 258 ... mouse, 259 ... keyboard, 316 ... control signal line, 319 ... signal line, 401 ...
Camera 402 ... Video signal line 403 ... Image section 40
4 ... Decoded video signal line, 405 ... Video encoding / decoding unit, 406 ... Encoded video signal line, 407 ... Communication line interface, 408 ... Communication line, 409 ... Display, 410 ... Receiver, 411 ... Speaker, 412 ... microphone, 413 ... audio signal line, 414 ... audio signal line, 41
5 ... Voice signal line, 416 ... Voice section, 417 ... Decoded voice signal line, 418 ... Voice coding / decoding section, 419 ... Coded voice signal line, 420 ... Operation key, 421 ... Key output signal line, 422 ... Control unit, 423 ... Line control signal line, 42
4 ... Audio control signal line, 425 ... Video control signal line, 426
Display signal line 501 Display monitor 502
Display screen, 503 ... Resolution display area, 503A ... Frame rate, 503B ... Resolution, 504 ... Change area,
504a ... button, 504b ... button, 504c ... button, 504d ... button, 505 ... mouse cursor, 50
6 ... Display output 510 ... Display monitor

 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Tetsuya Kawahara, 292 Yoshida-cho, Totsuka-ku, Yokohama-shi, Kanagawa Inside the Hitachi, Ltd. Microelectronics Device Development Laboratory (72) Inventor Junji Nakata Totsuka, Yokohama-shi, Kanagawa 292, Yoshida-cho, Tokyo, Hitachi, Ltd. Microelectronics equipment development laboratory (72) Inventor Takehiro Yamada 292, Yoshida-cho, Totsuka-ku, Yokohama, Kanagawa Hitachi, Ltd. Microelectronics equipment development laboratory (72) ) Inventor Tomohisa Kohiyama 292 Yoshida-cho, Totsuka-ku, Yokohama-shi, Kanagawa, Ltd.Hitachi, Ltd. Microelectronics Device Development Laboratory (72) Inventor Masakazu Hamaguchi 292 Yoshida-cho, Totsuka-ku, Yokohama-shi, Kanagawa Micro Electronics Scan equipment development within the Institute (72) inventor Nakano TakashiHiroshi Kawasaki-shi, Kanagawa-ku, Saiwai Kashimada 12 Hitachi, Ltd. Information System Development Division within the address 890

Claims (7)

[Claims] 1. Inputting moving image information and audio information,
Video with the function of converting the information into digital data
A voice input unit, a data compression control unit that performs data compression processing on the digital data, a control input device having a function of inputting an instruction to perform control, and a connection to a communication line according to an instruction from the control input device, A communication control unit for transmitting and receiving compressed data, a data decoding unit for decompressing the received compressed data, an image output unit and an audio output unit for outputting the decompressed received data, and the decompressed unit. Video / audio display reproduction control for outputting received data to the image output means and the audio output means, and further controlling the size of the display screen in the image output means by an instruction given via the control input device. In a video transmission processing device configured to have a unit, a video transmission processing device of the same configuration is connected to a connection destination connected via a communication line. The video / audio display / reproduction control unit has a function of outputting a status signal relating to a display / reproduction state including the size of the screen. A connection destination terminal control signal generation unit that generates a signal for controlling image information is provided, and the signal generated by the connection destination terminal control signal generation unit is output to the communication line via the communication control unit to connect the connection destination terminal control signal generation unit. A video transmission processing device characterized by being input to a data compression control unit of the video transmission processing device, wherein the data compression processing parameter of the connection destination video transmission processing device is controlled by the connection source video transmission processing device. 2. The frame according to claim 1, wherein the connection destination terminal control signal generation unit detects the size of the display screen based on the status signal, and is moving image information transmitted by the video transmission processing device of the connection destination. A video transmission processing device, wherein a control signal is generated such that a value obtained by multiplying a data amount of one frame by a frame rate is within a predetermined value when determining the rate and the size of the resolution. 3. The connection destination terminal control signal generation unit according to claim 1, wherein the transmission rate of the moving image information and the audio information transmitted by the connection destination video transmission processing device exceeds the maximum transmission rate of the communication line. A video transmission processing device characterized by generating a control signal so as not to exist. 4. The method according to claim 1, 2 or 3,
Furthermore, an overlay control unit and a control signal generation unit are provided, and the control signal generation unit and the system bus of the information processing device are connected to each other. The control signal generation unit has a function of inputting a status signal to the control signal generation unit, and the control signal generation unit uses the instruction given through an input device included in the information processing device and the display status signal to control the connection destination terminal. Generates and outputs a signal, and further
A control signal is output to the audio reproduction control unit, and the superposition control unit synthesizes the display information output from the video / audio display reproduction control unit and the display information output from the display control unit to perform the information processing. A video transmission processing device, characterized in that it is sent to a display means included in the device and a composite screen is output on the screen of the display means. 5. A video transmission processing apparatus for connecting at least two image processing apparatuses and the image processing apparatuses using a communication line, wherein each image processing apparatus inputs moving image information and audio information, A video / audio input unit having a function of converting the information into digital data, a data compression control unit for performing data compression processing on the digital data, a control input device having a function of inputting an instruction for performing control, A communication control unit for connecting to a communication line, transmitting and receiving compressed data according to an instruction from a control input device, a data decoding unit for decompressing received compressed data, and an image for outputting the decompressed received data Output means and audio output means, and outputs the expanded received data to the image output means and the audio output means, and further via the control input device. In a video transmission processing device configured to have a video / audio display reproduction control unit for controlling the size of the display screen in the image output means in accordance with a given instruction, to a connection destination connected via a communication line. Are connected to a video transmission processing device having the same configuration, and the video / audio display reproduction control unit outputs a status signal indicating a display / reproduction state, and the video transmission processing device at the connection destination outputs the status signal according to the status signal. A connection destination terminal control signal generation unit for generating a signal for controlling information regarding audio and images to be output, and outputs the signal generated by the connection destination terminal control signal generation unit to the communication line via the communication control unit. , Input to the data compression control unit of the video transmission processing device at the connection destination,
A video transmission processing device, wherein a data compression parameter in the connection destination video transmission processing device is controlled by the connection source video transmission processing device. 6. The image output means according to any one of claims 1, 2, 3 and 5, wherein an instruction item for performing predetermined control is displayed on a display screen, and an instruction is given via the display screen. A video transmission processing device characterized by having a function of inputting. 7. The display means provided in the information processing apparatus according to claim 4, wherein an instruction item for performing predetermined control is displayed on a display screen, and an instruction can be input through the display screen. A video transmission processing device having a function.