JP2001251593A - Video telephone conference system and its control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To send still image data of a desired data type with reduction in the sending time to the opposite station of a video telephone conference via a transmission line of a limited transmission band. SOLUTION: This control method controls a video telephone conference system, including a moving image pickup device, a static image pickup device and an output device, which outputs the images picked up by both moving and static image pickup devices. The control method includes a switching step S3 for performing switching between the output of a moving image and that of a static image and, for the case static image output is selected in the switching step, a separating step S8 for separating the static image data into the luminance and color difference data and the output steps S8 and S11 to output in sequence the luminance data and color difference data of the static image data, which are separated in the step S8.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a videophone / conference system and a control method thereof, and more particularly to a videophone / conference system which is connected to a general public telephone line network and can be used for moving images, voices, still images and other multimedia information between remote points. TECHNICAL FIELD The present invention relates to a videophone / conference system for transmitting data and a control method thereof.

[0002]

2. Description of the Related Art At present, in a videophone / conference system,
Many use ISDN lines, and N-ISD
The configuration of an AV (Audio Visual) system and its terminal device are described in ITU-T H.264. 320 is recommended. Further, its network has been extended to general public telephone lines, and a low bit rate multimedia terminal for videophone has been described in H.264. H.324 and multimedia communication over a LAN. H.323 is currently recommended.

As a multimedia terminal or a component of the videophone / conference system, a high-definition still image input device such as a document camera or a scanner can be used. By using such a device, it is possible to send a still image data to the other party separately from the moving image and the audio, and hold a videophone / conference while sharing the data.

In addition to a document camera, cameras used in videophone / conference systems include an image sensor such as a CCD, a camera head including a timing generator (TG) and an automatic gain controller (AGC), There is a camera system that can be separated into a signal processing board unit including an / D converter, a signal processing unit, and a video / audio codec unit. By using such a camera system, without converting the image signal to a video signal, it is possible to perform codec processing as a digital signal and send it as a moving image, or to transfer it as still image data via a data port, A camera system capable of processing image data with high definition can be realized.

[0005] Further, by making the head section separable, the camera system is rich in various variations, for example, the type of CCD, the difference in single focus and zoom of the lens, and the presence or absence of the head section. Can be configured. Camera head 10 with zoom lens
FIG. 10 shows a configuration diagram of a system in which a zoom camera in which the camera head 0 and the pan head unit 200 are integrated, a document camera unit 600, and a host terminal device 500. FIG. 10 shows a scanner instead of the document camera 600 in FIG. FIG. 11 shows a configuration diagram of a system to which the unit 700 is connected.

[0006]

However, when a videophone call or conference is to be conducted over a path having a limited transmission capacity such as ISDN, a data port is used to transmit a destination from a still image input device such as a document camera or a scanner. If you try to transfer color still image data to
It takes a lot of time to transfer.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems, and it has been proposed to reduce the transmission time to a partner station during a videophone / conference by using a transmission path with a limited transmission band, and to provide a desired data type. It is an object of the present invention to provide a videophone / conference system capable of transmitting still image data and a control method thereof.

[0008]

In order to achieve the above object, a moving image pickup device, a still image pickup device, and an output device for outputting the moving image and the image captured by the still image pickup device to the outside are provided. The method for controlling a videophone / conference system according to the present invention includes: a switching step of switching between output of a moving image and output of a still image; and when the still image is output by the switching step, the still image data is converted into luminance data and color difference. The method includes a separation step of separating the data into data, and an output step of outputting the still image data separated by the separation step in the order of luminance data and color difference data.

The videophone / conference system of the present invention includes a moving image capturing apparatus, a still image capturing apparatus, and an output device for outputting the moving image and the image captured by the still image capturing apparatus to the outside. Switching means for switching between output of an image and output of a still image, separating means for separating still image data into luminance data and color difference data when outputting a still image, and separating means for outputting a still image The still image data separated by
Control means for controlling and outputting the color difference data in order.

According to the above arrangement, since the luminance data of the still image data is transmitted first, the image can be confirmed quickly.

Preferably, the control method further includes a binarization compression step of binarizing and compressing the luminance data,
In the output step, the binarized and compressed luminance data is output prior to the chrominance data, and the videophone / conference system further includes a binarization compression unit that binarizes and compresses the luminance data, The control means controls to output the binarized and compressed luminance data prior to the color difference data.

Further, the color difference data includes gray scale data and color data, and in the output step,
The control means outputs grayscale data and color data in the order of grayscale data and color data.

According to still another preferred embodiment of the present invention, the control method further includes a step of displaying a still image data output state during still image output. Means for displaying the output status of the still image data during the output of the still image is further provided.

According to a preferred aspect of the present invention, the control method further comprises the step of determining whether or not to output the color difference data before the output of the color difference data after the output of the luminance data is completed. In the output step, when it is determined in the determination step that the color difference data is not to be output, the output of the color difference data is stopped. In addition, the videophone / conference system further includes, after completion of the output of the luminance data, prior to the output of the color difference data, a determination unit that determines whether to output the color difference data, and the control unit includes: When the determination means determines that the color difference data is not output, the output of the color difference data is stopped.

According to a preferred aspect of the present invention, the control method further comprises a step of instructing the interruption of the output of the still image data, and when the interruption of the output of the still image data is instructed, In the output step, the output of the still image data is interrupted. Further, the videophone / conference system further includes means for instructing the suspension of the output of the still image data, and when the interruption of the output of the still image data is instructed, the control means suspends the output of the still image data. I do.

According to the above configuration, during transmission, the transmission status of each data can be displayed and the data can be interrupted.

According to a preferred aspect of the present invention, the moving image capturing device and the still image capturing device are a single image capturing device that can switch between moving image capturing and still image capturing.

Preferably, the still image capturing device includes a video camera, a document camera, and a scanner, and the moving image capturing device includes a video camera and a document camera.

[0019]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

<First Embodiment> FIGS. 1 and 2 are block diagrams showing a configuration of each device of a videophone / conference system according to an embodiment of the present invention. More specifically, FIG. 1 shows an imaging unit in a videophone / conference system, and includes a camera head unit 100, a pan head unit 200, and a document camera head unit 6.
00. FIG. 2 shows a signal processing unit in the videophone / conference system, and includes a signal processing board unit 300, a communication board unit 400 for performing communication control and the like, and a host terminal device 500.

The camera head unit 100 and the camera platform unit 200 are connected by a bidirectional control signal line 110, and a control signal is multiplexed on a video signal from the camera head unit 100 or the document camera head unit 600 to the signal processing board unit 300. A signal line for transmitting the synchronized signal, and a video synchronization signal (Syn)
c) and a signal line for transmitting a control signal.

FIG. 4A is a diagram showing a method of transmitting various signals on the signal line. In the first embodiment, switching of the image output to the signal processing board unit 300 between the output image from the camera head unit 100 and the output image from the document camera head unit 600 is performed by the host terminal device 500. Is controlled by the system control unit 606 of the document camera head unit 600 based on the control signal.
When an image switching unit 609 described later is located on the camera head unit 100 side, the system control unit 106 of the camera head unit 100 performs the same control.

The signal processing board 300 and the communication board 400 are connected by signal lines for transmitting data signals and control signals to each other.
6, 402 to connect to the host terminal device 500.
The host terminal device 500 controls the signal processing board unit 300, the pan head unit 200, and the camera head unit 100 via the bus I / F 306 (control of the document camera 600), and the communication board unit 400 also via the bus I / F 402. Control.

The configuration of the camera head unit 100 will be described. Reference numeral 106 denotes a system control unit, which includes a CPU, a ROM,
It consists of a one-chip microcomputer having functions such as an AM, a control port, and a communication port, controls each device of the camera head unit 100, and controls the camera platform unit 200 and the signal processing board unit 3
00 and two-way communication. 101 is a lens unit having functions such as zoom and focus, and 102 is a lens unit 10
An iris unit 103 for adjusting the amount of incident light passing through 1 is an imaging device such as a CCD that photoelectrically converts an optical image passing through the lens unit 101 and the iris unit 102 and converts the optical image into an electric signal. Reference numeral 104 denotes an S / H / AGC unit that samples an image signal from the image sensor 103, performs a hold for noise reduction, and adjusts a gain. 105 denotes an accumulation operation and a read operation according to the number of pixels of the image sensor 103. Dashi behavior,
Timing generator (T
G) and the like. 107 separates Sync from the signal processing board unit 300 into a horizontal synchronizing signal (HD) and a vertical synchronizing signal (VD).
To determine the drive timing of the image pickup device, and put the control signal from the system control unit 106 in the vertical blanking period of the CCD signal, or conversely, the vertical direction of the CCD signal from the signal processing board unit 300. This is a sync separation / control signal code decoder that extracts a control signal placed in the blanking interval and sends it to the system controller 106. S / H ・
The control signal from the control signal codec 107 is multiplexed with the CCD signal from the AGC unit 104 by the multiplexing unit 108 and then transmitted to the signal processing board unit 300. FIG. 4 (b)
FIG. 3 is a diagram illustrating a multiplexing process.

Next, the configuration of the document camera head unit 600 will be described. A lens unit 601, an iris unit 602,
The image pickup device 603, the S / H / AGC unit 604, the image pickup device driving unit 605, the system control unit 606, the control signal code decoding unit 607, and the multiplexing unit 608 are provided in the camera head unit 1 described above.
Since 00 is the same as the configuration shown in 101 to 108, the description is omitted. However, the lens unit 601 and the iris unit 602 may use a single focus lens or a manual iris. In that case, the system control unit 6
No control from 06 is required.

Reference numeral 609 denotes a video signal switching unit for switching between a video signal sent to the board unit 300 and a signal from the camera head unit 100 and a signal from the document camera unit 600. The control signal from the signal processing board unit 300 is received by the control signal code decoding unit 607, and the system control unit 606 switches the video signal switching unit 609 according to the received control signal. When switching to the document camera unit 600, the pan head unit 200 cannot be controlled.

Next, the structure of the camera platform 200 will be described. Reference numeral 203 denotes a system control unit which includes a CPU, ROM, RA
A one-chip microcomputer having functions such as an M, a control port, and a communication port controls each device of the camera platform 200 and performs bidirectional communication with the camera head 100. 2
Reference numeral 01 denotes a remote control light receiving unit that receives infrared light from the wireless remote control and notifies the system control unit 203 of the infrared light.
A pan head motor control unit 02 drives a motor for pan / tilt operation of the pan head under the control of the system control unit 203. To drive this motor, an external power supply is required.

Next, the configuration of the signal processing board unit 300 will be described. Reference numeral 304 denotes a system control unit, which includes a CPU, R
A one-chip microcomputer having functions such as an OM, a RAM, a control port, and a communication port. The video signal processing board unit 300 controls each device, auto white balance control, the camera head unit 100, and the camera platform 20 via the same.
0 and communication with the host terminal device 500 via the bus I / F 306. Also, the host terminal device 50
By interpreting the command from 0, the operation requested by the host terminal device 500 is also performed. Reference numeral 301 denotes the camera head unit 1
An A / D converter 302 for converting a CCD signal transmitted from 00 into a digital signal, a video 302 for performing a process of converting an imaging signal converted to a digital signal into a standardized digital video signal through color signal processing It is a signal processing unit. The video signal processing unit 302 uses the cycle of the vertical synchronization signal (VD)
Brightness data of a subject, data for white balance control, and data for focus control used for exposure control are received from the system control unit 304, and control corresponding to each is performed. The standardized digital signal is processed by the codec unit 305 and the communication control unit 401 together with the voice signal and other data signals from the host terminal device 500, such as encoding and decoding necessary for a videophone / conference system. Is made.

FIG. 3 is a block diagram showing the functions of the codec unit 305 and the communication control unit 401. 1 inputs a video signal from the video signal processing unit 302 or a bus I /
A video I / F unit for outputting an image signal from the host terminal device 500 via F306, and has image processing functions such as screen division, image composition, and character composition. Reference numeral 2 denotes a video coding / decoding unit (codec) that codes the video signal from the video I / F unit 1 and decodes the received coded video information. Reference numeral 3 denotes an audio I / F for connecting a speaker, a microphone, and the like, and has an audio processing function such as an echo canceling function. Reference numeral 4 denotes an audio encoding / decoding unit (codec) which encodes an audio signal from the audio I / F unit 3 and decodes the received encoded audio information. Reference numeral 5 denotes a delay processing section for delaying the encoded audio information by the audio encoding / decoding section 4 and the received encoded audio information for a predetermined period, and is provided to synchronize (lip sync) with the video information. . Reference numeral 6 denotes a computer unit for realizing an application such as a computer conference function in addition to a basic video conference function; 7, a still image / drawing control unit for controlling still image transmission and drawing functions; An auxiliary device control unit that controls another image processing apparatus. The computer unit 6, the still image / drawing control unit 7, and the auxiliary device control unit 8 can communicate via the data port 9.

Reference numeral 10 denotes a communication control unit, which is an end for establishing a common operation mode of a signal and operation for proper network access by the network signal control unit 12 and proper operation of the terminal by the interconnection procedure control unit 11. -Implement functions such as end control. The multiplex transmission unit 13 multiplexes video information, audio information, and control information into one bit string and transmits the multiplexed signal, and separates the received bit string into multimedia information, and the network I / F unit 14 Measure the adaptation needed between terminals. 15 is a network such as a telecommunication line,
Reference numeral 16 denotes a control unit for connecting the videophone / conference system between multiple points.

Next, the operation of the videophone / conference system having the above configuration will be described with reference to the flowchart of FIG.

First, when starting a videophone / conference, a communication line is set or secured with a remote partner terminal in step S1 according to a normal procedure. When the line is normally connected, the camera head unit 100 or the document camera head unit 6 in step S2.
00, the moving image to be photographed is transmitted, and the moving image and / or the image received from the partner station are displayed.

Next, in step S3, it is determined whether or not a still image is to be transmitted. When transmitting a moving image continuously, the process returns to step S2. When transmitting a still image, the process returns to step S2.
Proceed to step 4 to select whether or not to newly take in a still image.
When a new still image is to be captured, either the camera head unit 100 or the document camera unit 600 is selected by a command from the host terminal device 500 as a camera for capturing a still image in step S5.

In step S6, the host terminal device 500
A high-resolution still image of a subject is captured into the host terminal device 500 by using the camera selected in step S5 based on the still image capture command from. The determination in step S3 may be configured to be performed based on a still image capture command from the host terminal device 500. The image data thus captured is Y
(Luminance), digital data of a color image of u, v (color difference). The process proceeds to step S7 in order to send the Y, u, v data of the color still image fetched in this way to the partner terminal during the videophone / conference.

In step S7, from the still images newly captured in the host terminal device 500 in step S6 or the still images previously captured, the still image to be transferred to the partner station during the video conference communication is selected. First, among the selected still image data, the Y (luminance) data is first binarized by a certain threshold value, and the binarized data is compressed by a run length or another method (step S8).
This data is multiplexed with the transmission data via the data port 9 of FIG. 3 and sent to the partner station (step S9). At this time, the transmission status is displayed on the monitor so that the transmission status can be canceled. FIG. 6 shows a display example of the transmission status of the binary data.

When the transfer of the binarized data is completed, it is determined whether or not to transmit the Y (luminance) data (step S10). When the transfer of the binarized data is completed, an operation such as displaying a flash screen or generating a sound may be performed. If the binarized data is sufficient, for example, if the still image to be transferred is a two-color document, it is canceled here (YE in step S10).
S). As a result, the subsequent transfer stops. Subsequently, when it is desired to transmit the grayscale data and the color data (NO in step S10), the transmission state is maintained (step S11). FIG. 7 shows a display example of a state in which gray scale data has been transferred and u, v (color difference) data is being transferred. When all the images have been transferred, a display indicating the end of color image transfer is displayed as shown in FIG.

It should be noted that an image based on the transmitted data may be sequentially displayed upon completion of the transfer of each of the data. Further, a still image can be displayed on the transmitting side with a full-color image, and a receiving side can display a grayscale or binary image with each other so that they can collaborate.

As described above, according to the first embodiment, when transmitting the color still image information captured from the imaging unit to the partner station during a videophone / conference, the color data is converted into luminance data, Separated into color difference data, first sent from binary data of luminance data, then gray scale data,
By transmitting the color difference data in order, the still image data of the desired data type can be transmitted to the partner station during the videophone / conference on the transmission path of the limited transmission band. Thus, the transmission time can be reduced. Further, the partner station reproduces a color still image by synthesizing the received data of each type.

<Second Embodiment> Next, a second embodiment of the present invention will be described.

FIG. 9 is a block diagram showing a configuration of a videophone / conference system according to the second embodiment of the present invention. Camera head unit 100, pan head unit 200, signal processing board unit 300, codec unit 305, and communication control unit 40
The functions and operations of the first embodiment are the same as those described in the first embodiment, and thus description thereof is omitted.

In the second embodiment, as a still image input device, the scanner unit 700 is connected to the host terminal device 500 via a bus I / F 701 such as SCSI or Centronics.

In the above configuration, since the scanner unit 700 cannot capture a moving image, a series of operations other than the camera switching operation may be performed in the same manner as in the first embodiment.

The device that can be used as a device for capturing a still image in the present invention is not limited to the above device, and any device that can input a still image may be used.

[0044]

[Other Embodiments] The present invention relates to a plurality of devices (for example, a host computer, an interface device, a scanner,
Imaging system).
You may apply to the apparatus which consists of one apparatus.

An object of the present invention is to supply a storage medium (or a recording medium) on which a program code of software for realizing the functions of the above-described embodiments is recorded to a system or an apparatus, and to provide a computer (or a computer) of the system or the apparatus. Or a CPU or MPU) reads out and executes the program code stored in the storage medium,
Needless to say, this is achieved. In this case, the program code itself read from the storage medium implements the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.
In addition, by the computer executing the readout program code, not only the functions of the above-described embodiments are realized, but also based on the instructions of the program code,
The operating system (OS) running on the computer performs part or all of the actual processing,
It goes without saying that a case where the function of the above-described embodiment is realized by the processing is also included.

Further, after the program code read from the storage medium is written into the memory provided in the function expansion card inserted into the computer or the function expansion unit connected to the computer, the program code is read based on the instruction of the program code. , The CPU provided in the function expansion card or the function expansion unit performs part or all of the actual processing,
It goes without saying that a case where the function of the above-described embodiment is realized by the processing is also included.

When the present invention is applied to the storage medium, the storage medium stores program codes corresponding to the above-described flowchart shown in FIG.

[0048]

As described above, according to the present invention, the transmission time can be shortened for the still image of the desired data type to the partner station during the videophone / conference by using the transmission path of the limited transmission band. Can send data.

Further, since the binary data of the still image is transmitted first, the image can be confirmed quickly.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of an imaging unit in a videophone / conference system according to a first embodiment of the present invention.

FIG. 2 is a block diagram illustrating a configuration of a signal processing unit in the videophone / conference system according to the first embodiment of the present invention.

FIG. 3 is a block diagram illustrating functions of a codec unit and a communication control unit in FIG. 2;

FIG. 4 is a diagram illustrating a method of transmitting a control signal between an imaging unit and a signal processing unit according to the embodiment of the present invention.

FIG. 5 is a diagram showing a video phone according to the first embodiment of the present invention.
5 is a flowchart illustrating the operation of the conference system.

FIG. 6 is a diagram illustrating a display example of a transfer status of still image binary data.

FIG. 7 is a diagram illustrating a display example of a still image data transfer status.

FIG. 8 is a diagram illustrating a display example of a still image data transfer status.

FIG. 9 shows a video telephone according to the second embodiment of the present invention.
FIG. 2 is a block diagram illustrating a configuration of a conference system.

FIG. 10 is an external view of a camera system to which a document camera is connected.

FIG. 11 is an external view of a camera system to which a scanner is connected.

[Explanation of symbols]

 Reference Signs List 100 camera head unit 101 lens 102 iris 103 CCD 104 S / H & AGC 105 TG 106 system control unit 107 control signal code decoding unit 108 multiplexing unit 200 pan head unit 201 remote control light receiving unit 202 pan head motor control unit 203 system control unit 300 signal Processing board unit 301 A / D converter 302 Video signal processing unit 303 Control signal code decoding unit 304 System control unit 305 Codec unit 306 Bus I / F 400 Communication board unit 401 Communication control unit 402 Bus I / F 500 Host terminal device 600 Document camera head unit 601 Lens 602 Iris 603 CCD 604 S / H & AGC 605 TG 606 System control unit 607 Control signal code decoding unit 608 Multiplexing unit 609 Video signal switching unit 700 Scanner unit

 ──────────────────────────────────────────────────続 き Continued on the front page F-term (reference) JT10 LB15 LD08 LE11 9A001 CC02 HH27 HH31 JJ21 JJ23 JJ24

Claims (19)

[Claims] 1. A control method for a videophone / conference system, comprising: a moving image capturing device; a still image capturing device; and an output device for outputting an image captured by the moving image and the still image capturing device to the outside. A switching step of switching between output of a moving image and output of a still image; a separation step of separating still image data into luminance data and color difference data when performing a still image output by the switching step; An output step of outputting the obtained still image data in order of luminance data and color difference data. 2. The method of binarizing and compressing the luminance data.
The control method according to claim 1, further comprising a value compression step, wherein in the output step, the luminance data subjected to the binarization compression is output prior to the color difference data. 3. The control according to claim 1, wherein the color difference data includes gray scale data and color data, and the output step outputs gray scale data and color data in this order. Method. 4. The control method according to claim 1, further comprising the step of displaying the output status of the still image data during the output of the still image. 5. After the output of the luminance data is completed, prior to the output of the chrominance data, a determination step of determining whether or not to output the chrominance data is further provided. 5. The control method according to claim 1, wherein the output of the color difference data is stopped when it is determined that the color difference data is not output. 6. The method according to claim 1, further comprising the step of instructing the interruption of the output of the still image data, wherein, when the interruption of the output of the still image data is instructed, the output of the still image data is interrupted in the output step. The control method according to claim 1. 7. The moving image capturing apparatus and the still image capturing apparatus are independent image capturing apparatuses that can switch between moving image capturing and still image capturing. Or the control method described in 8. The control method according to claim 1, wherein the still image capturing device includes a video camera, a document camera, and a scanner. 9. The video camera according to claim 9, wherein:
9. The control method according to claim 1, further comprising a document camera. 10. A videophone / conference system including a moving image pickup device, a still image pickup device, and an output device for outputting the moving image and an image captured by the still image pickup device to the outside, wherein: Switching means for switching the output of a still image and output of a still image; separating means for separating still image data into luminance data and color difference data when outputting a still image; and outputting the still image by the separating means. Control means for controlling and outputting the separated still image data in the order of luminance data and chrominance data, and a videophone / conference system. 11. A binary compression means for binarizing and compressing the luminance data, wherein the control means controls the binarized and compressed luminance data to be output prior to the color difference data. The videophone / conference system according to claim 10, wherein: 12. The apparatus according to claim 10, wherein said color difference data includes gray scale data and color data, and said control means controls and outputs gray scale data and color data in this order. The videophone / conference system described. 13. The videophone / conference system according to claim 10, further comprising means for displaying the output status of the still image data during the output of the still image. 14. When the output of the luminance data is completed, prior to the output of the chrominance data, the apparatus further comprises a judgment unit for judging whether or not to output the chrominance data. 14. The videophone / conference system according to claim 10, wherein the output of the color difference data is stopped when it is determined not to output the color difference data. 15. An image processing apparatus, further comprising: means for instructing interruption of output of still image data, wherein when the interruption of output of still image data is instructed, the control means interrupts output of still image data. The videophone / conference system according to any one of claims 10 to 14. 16. The image capturing apparatus according to claim 10, wherein the moving image capturing apparatus and the still image capturing apparatus are a single image capturing apparatus that can switch between moving image capturing and still image capturing. Videophone / conference system described in Crab. 17. The videophone / conference system according to claim 10, wherein the still image capturing device includes a video camera, a document camera, and a scanner. 18. The videophone / conference system according to claim 10, wherein said moving image pickup device includes a video camera and a document camera. 19. A storage medium storing a program code for implementing the control method for a videophone / conference system according to claim 1.