JP3328370B2 - Control method of video conference communication device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a control method of a video conference communication device having an image pickup function, a video display function, a voice input / output function, a video conference communication function, and an automatic call receiving function.

[0002]

2. Description of the Related Art For example, CCITT recommendation H.264. There has been proposed a video conference communication device having a video conference communication function specified by H.320 and exchanging video and audio between remote locations to realize conference communication. In particular, in recent years, a video conference communication device has been regarded as important as a communication application using ISDN as a line, and is gradually spreading.

[0003] In the incoming call form of this video conference communication device, there are a manual incoming call that a user intervenes like a telephone,
There are two types of automatic incoming calls without user intervention, such as facsimile machines.

[0004] In the case of a manual incoming call, it is necessary for the user to be waiting at the video conference communication device. However, it is usually the case that two users on the ground are simultaneously waiting at the scheduled time at the video conference communication device. If it is not possible to expect, for example, if the called user is delayed, a delay of about several minutes occurs before the video conference communication is started, and the calling user is kept waiting.

On the other hand, in the case of an automatic incoming call, even when the user is absent, the video conference communication device on the receiving side answers, so that the communication operation between the video conference communication devices is started. However, even in this case, when the called user is delayed, the start of the video conference communication is delayed.

[0006]

As described above, when the called user is delayed, the start of the video conference communication is delayed regardless of the incoming call form of the video conference communication device. Conventionally, when such a situation occurs, it is necessary for the calling user to call the called user with another telephone and to request a new video conference communication.

The present invention has been made in view of the above circumstances, and has as its object to provide a control method of a video conference communication device that can start video conference communication smoothly.

[0008]

SUMMARY OF THE INVENTION The present invention relates to a method for controlling a video conference communication apparatus having an image pickup function, a video display function, a voice input / output function, and a video conference communication function, and also having an automatic call reception function. When an incoming call is detected, a predetermined pre-transmission procedure is performed to complete preparation for video conference communication with the other terminal, and the presence / absence of the user of the own terminal is determined, and the user is absent. Is detected, an operation for calling the user is performed. Also,
The method of determining the presence / absence of the user of the own terminal includes determining the presence of the user when the level of the voice input signal is input and the level is equal to or higher than a predetermined value, and determining the user's presence when the level is lower than the predetermined value. Determining absence can be used. Further, the method of determining the presence / absence of the user of the own terminal includes determining the presence of the user when a motion vector obtained at the time of encoding a video signal input by shooting is equal to or more than a predetermined value per frame. When the motion vector is smaller than a predetermined value per frame, the absence of the user can be determined.

[0009]

[0010]

Therefore, when it is detected that the user of the own terminal is absent when the incoming call is detected, an operation for calling the user is performed, so that the calling user uses the other telephone or the like to call the called user. It is not necessary to perform useless communication such as calling, and the video conference communication can be started smoothly.

[0011]

Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

FIG. 1 shows a model of a video conference communication system according to an embodiment of the present invention. In this case, the video conference communication is executed in a point-to-point connection mode using ISDN as the transmission path. Also,
Each terminal also has a still image communication function.

In FIG. 1, a video conference communication device TTV
1 and TTV2 are connected via ISDN and have the same functions.

The video conference communication devices TTV1, TTV
2 is a still image communication function (group 4 facsimile function) for transmitting and receiving conference materials; 320, a scanner device 3 for reading a document image at a predetermined resolution, and a page printer 4 for recording and outputting various documents at a predetermined resolution. It is configured. Note that the scanner device 3 can read and input a book document and can continuously read and input a sheet document.

The main unit 1 includes a video monitor device 5 for displaying a moving image, a video camera device 6 provided on the video monitor device 5 for inputting a moving image, and a left and right side of the video monitor device 5. A speaker 7 for outputting sound, a microphone 8 for inputting sound, and an operation display device 9 for operating the main unit 1 are provided. In addition, the video camera device 6 is provided with a rotation mechanism for moving (shaking) the photographing range right and left.

FIG. 2 shows a configuration example of the video conference communication device TTV1 (, TTV2) shown in FIG.

In FIG. 1, a CPU (central processing unit) 1
Reference numeral 1 denotes a ROM for performing control processing of each unit of the video conference communication device TTV1, a facsimile communication function, and a video conference communication function.
The (read only memory) 12 stores a control program executed by the CPU 11 and data such as various parameters necessary for executing the control program, and a RAM (random access memory) 13.
Constitutes a work area of the CPU 11.

DMA (Direct Memory Access)
The control device 14 controls the CPU 1 without using the CPU 11.
The real-time clock device 15 outputs current time information, and the interrupt control device 16 sends the interrupt signal to the CPU 11 of a large number of generated interrupt signals. This is for controlling the output of.

The printer interface 17 is for connecting the page printer 4 to record and output an image (document), and the scanner interface 18 is for connecting the scanner device 3 to read and input a document image. The magnetic disk device 19 is for storing a large amount of various kinds of document information and the like, and the magnetic disk interface 20 is connected to the magnetic disk device 19 to store / read / read data in / from the magnetic disk device 19. It is for erasing. Also, the serial interface 21
Is for connecting the operation display device 9.

The voice CODEC 22 is an ISDN B
This is for performing a signal conversion process of an analog signal / digital data for transmitting an analog audio signal using a channel. The analog signal side is connected to the speaker 7 and the microphone 8 via the analog interface 23. ing.

The document encoding / decoding device 24 encodes and compresses the image signal and decodes the encoded image information into the original image signal. The encoding / decoding in the group 4 facsimile mode is performed. It has a processing function.

The video CODEC device 25 is for mutually converting a video signal into a video encoded signal of a predetermined format, and the video signal side is connected to the video monitor device 5 and the video camera via a video interface 26. It is connected to the device 6.

The communication control device 27 is connected to the ISDN, and performs a call control function on the D channel (signal channel), a facsimile communication function on the B channel (information channel), and a communication control function of a lower layer of the video conference communication function. It is for performing a function.

These CPU 11, ROM 12, RAM
13, DMA controller 14, real-time clock device 15, interrupt controller 16, printer interface 1
7, scanner interface 18, magnetic disk interface 20, serial interface 21, audio CO
DEC device 22, Document encoding / decoding device 24, Video C
The ODEC device 25 and the communication control device 27 are connected to a system bus 28, respectively, and data transmission between these components is mainly performed via the system bus 28. Further, a control signal of the video monitor device 5 and a control signal of the video camera device 6 are also output from the CPU 11 via the system bus 40.

FIG. 3 shows an example of the communication control device 27.

In FIG. 1, the ISDN interface circuit 30 is connected to the ISDN and has a function of processing the signal of the ISDN layer 1 and a function of integrating / separating the D channel signal and the two B channel signals. , D-channel signals are exchanged with the D-channel transmission control device 31, and the two B-channel signals are multiplexed /
It communicates with the separation device 32.

The LAPD channel transmission control device 31
This is for realizing the signal processing function of layer 2 of the channel. The multiplexing / demultiplexing device 32 multiplexes data of a plurality of media such as audio, video (moving image) and general-purpose data exchanged using the B channel, and performs CCI.
TT Recommendation H. In addition to forming frame data specified in H.221 and sending it to the line side, it separates data of a plurality of media multiplexed with the received frame data. The multiplexer / demultiplexer 43 exchanges audio data with the audio CODEC 22 via the system bus 28, exchanges video data via the video CODEC 25 via the system bus 28, and outputs a group 4 facsimile signal or the like. General-purpose data of L
It communicates with the APB controllers 33 and 34. LAP
The B control devices 33 and 34 are for realizing the function of the lower layer of the group 4 facsimile communication function.

The processing functions executed by the CPU 11 of the video conference communication device TTV 1 include an operation display control process for controlling input and output of data to and from the operation display device 9, and data from the serial interface 21. UIF (user interface) manager for inputting and distributing to each processing process, AV (audio / video) manager for controlling video conference communication, FAX manager for controlling group 4 facsimile communication function, and transmission / reception task ( A transmission operation and a reception operation are independently controlled), a G4 protocol stack, a printer manager for controlling the page printer 4, a scanner manager for controlling the scanner 3, and a voice COD.
A voice CODEC manager for controlling the EC device 22 and a DCR for controlling the document encoding / decoding device 24
Manager, Q931 manager to control layer 3 of D channel call control, LMNG entity to control multiplexing using two B channels, LA
LAPD manager for controlling PD control device 31, H24 for controlling multimedia multiplex communication
2 manager, H221 manager for controlling the operation of the multiplexing / demultiplexing device 32, and the video CODEC device 25
H261 manager for controlling the operation of LAPB
There is a LAPB manager for controlling the operation of the control devices 33 and 34, and the like.

Here, Q931, H242, H221,
H261 is based on JT-Q. 931,
JT-H. 242, JT-H. 221, JT-H. 26
Represents the function of 1. Note that the TTC standard JT-Q. 93
1, JT-H. 242, JT-H. 221, JT-H.
261 are respectively CCITT Recommendation Q.261. 931, H.C. 2
42, H .; 221, H.R. This is a domestic standard corresponding to H.261.

Further, according to TTC standard JT-H. Next, the moving image information specified by H.261 will be described.

First, the basic format of the moving picture information is C
IF (Common Inter-mediate F)
format), where the CIF is 2 per second.
A screen of 9.97 frames is displayed, one frame (image frame) is composed of 288 lines, and one line is 36 lines.
It consists of 0 pixels. Then, the frame is shown in FIG.
As shown in (a), 12 GOBs (Group Of
Block), and each GOB is divided into 33 11 × 3 macroblocks as shown in FIG. Furthermore, one macroblock is 2 × 2
Is divided into four blocks. Therefore, one block is composed of 8 pixels × 8 lines, and one macro block is composed of 16 pixels × 16 lines.

In this embodiment, the video monitor device 5 and the video camera device 6 are NTSC (Na
Tional TV System Committee
e) The video codec 2
5 is configured as shown in FIG.

In the figure, the NTSC / CIF converter 3
Numeral 5 is for converting a video shooting signal VV from the video camera device 6 input via the video interface 26 from the above-described NTSC format signal to a CIF format signal, and the output is encoded as a signal VC. Processing unit 3
6 has been added.

The encoding processing unit 36 converts the input signal VC into the ITU-T Rec. The coding process of the image coding method specified in H.261 is applied, and a code portion of the output is output to the error correction coding unit 37 as a signal SV, and is calculated for each macroblock. A signal Smc representing the value of the motion vector is output to the system bus. This signal Smc is applied to the CPU 11 via the system bus 28.

The error correction coding unit 37 buffers the signal SV and, for example, (511, 493)
The signal SV is converted into a format to which a predetermined error correction code such as BCH is added, and its output is output to the system bus 28 as a transmission video signal SVa.

The error correction decoding unit 38 buffers the received video signal RVa input via the system bus 28 and applies a predetermined error correction decoding process. , As the decoded received video signal RV.

The decoding processing section 39 applies the decoding processing of the above-described image coding method to the input decoded received video signal RV, and outputs the signal VR as a CIF / NTSC conversion section 40. Has been added to

The CIF / NTSC converter 40 converts the input CIF format signal VR into an NTSC format signal. The converted output is supplied to the video monitor device 5 via the video interface 26 as a signal VM. Have been.

Now, the video conference communication devices TTV1, TT
In V2, in the B channel, the TTC standard JT-
H. 221 is exchanged in a multi-frame format.

As shown in FIG. 6, one multi-frame MFL is composed of eight sub-multi-frames SMF1 to SMF.
8 in each sub-multiframe SMF1 to SMF1.
The SMF 8 is composed of two frames each. That is, one multi-frame MFL is composed of 16 frames FLM0 to FLM15.

Each of the frames FLM0 to FLM15
Is composed of 80 octets of data, as shown in FIG. 7, and the bit positions where these octets are arranged in bit order constitute subchannels SCH1 to SCH8.

The eighth bit of the first to eighth octets is a frame synchronization signal (Frame Ali).
The 8th bit of the 9th to 16th octets constitutes a bit rate allocation signal (Bit rate Allocation).
(Signal) BAS. That is, the sub-channel SCH8 is allocated to the eighth bit of the 17th octet to the 80th octet, and this portion is allocated to the application channel AC (Application Channel).
el). Also, the sub-channel SC
In the part corresponding to the 17th to 24th octets of H8,
Data of an encryption channel for exchanging key information or the like for encrypting data may be set (optional).

As described above, the frame synchronization signal FAS
Are arranged in one frame FLM0 to FLM15, and the bit allocation is configured in units of a multi-frame MFL as shown in FIG.

That is, even frames FLM0, FLM
2,..., FLM14, second to eighth octets, followed by odd frames FLM1, FLM3,.
A horizontal synchronizing signal composed of an 8-bit data pattern “00110111” is arranged in the FLM 15, and a first octet of the odd-numbered frames FLM 1, FLM 3,. A synchronization signal is provided.

By detecting the horizontal synchronization signal and the vertical synchronization signal, the synchronization of one multi-frame MFL can be detected.

The 0th frame, the 2nd frame, the 4th frame
Bits N1, N2, N3, N4, and N5 of the first octet of the frame, the sixth frame, and the eighth frame are used to indicate a multiframe number. Of these, bit N5 is used to indicate whether a multi-frame number is used. As described above, since the data used for the multi-frame number is 4 bits, the multi-frame number changes in a descending order with values from 0 to 15, and the same multi-frame number appears every 16 multi-frames.

The tenth frame, the twelfth frame,
And the bit L of the first octet of the thirteenth frame
1, L2 and L3 are used to display connection numbers indicating the order of connection of the B channels carrying the frame among the B channels currently used. Also, bit R of the first octet of the fifteenth frame is reserved (reserved) for future recommendations,
Its value is set to 0.

The bit TEA of the first octet of the fourteenth frame is used to indicate that data cannot be transmitted due to an internal failure of the data terminal device.

The odd frames FLM1, FLM3,
.., Bit A of the third octet of FLM 15 is used to indicate whether frame synchronization or multi-frame synchronization has been established, or whether synchronization has been lost.

The odd frames FLM1, FLM3,
,..., The fifth octet, the sixth octet, the seventh octet, and the eighth octet of the FLM 15
C2, C3 and C4 are used to indicate a CRC (Cyclic Redundancy Check) code which is referred to for data error detection (ie, channel quality detection) of two consecutive frames (ie, sub-multiframes). The bit E of the fourth octet of the odd frames FLM1, FLM3,..., FM15 is used to indicate that a transmission error has been detected on the receiving side.

Further, as shown in FIG. 9, the bit rate assignment signal BAS includes even-numbered frames FLM0, FLM2,
, FLM14, 8-bit data representing a capability BAS or a BAS command is arranged, and subsequent odd-numbered frames FLM1, FLM3,.
A double error correction code for error correcting the value of the capability BAS or BAS command transmitted in the immediately preceding frame is arranged.

The transmission of the data of the multi-frame MFL is performed in the order of the frame numbers, and each of the frames FLM0 to FLM15 is transmitted in the octet sequence from the first octet to the 80th octet as shown in FIG. Octets are transmitted with the first bit first.

That is, each frame FLM0
In the FLM 15, the first bit of the first octet is transmitted first, and the eighth bit of the 80th octet is transmitted last.

FIG. 11 shows a video conference communication device TTV1,
TTC standard J.H.H.2 is applied as a transmission control procedure executed when TTV2 exchanges audio data and video data using the B channel. 242 (CCITT Recommendation H.264).
242) is shown.

First, the calling terminal calls the destination terminal, performs a call setting procedure on the D channel, secures one B channel (hereinafter referred to as the first channel) (phase A), and Frame synchronization is performed while exchanging frame data in which PCM voice data (A-law or μ-law, 64 Kbps) is set on one channel (frame mode). When frame synchronization is established, mutual capability BAS is performed.
Data and command BAS data are exchanged (phase B1-1), the transmission mode to be used at that time is determined, and an additional call setting request for securing the second B channel is started (phase B1-2). ).

Then, from the contents exchanged between the transmission modes at that time, a mode having the highest function in common with each other is selected in principle (phase B1-3), and the calling terminal arrives at the selected operation mode. Sending a BAS command specifying the terminal function to operate the function to the calling terminal,
Parameters common to the device functions of the calling terminal and the called terminal are set (phase B2). Thus, in the first channel, for example, data transmission of audio data (16 Kbps) and data transmission of moving image data (46.4 Kbps) corresponding to the transmission mode selected at that time are performed (phase C). .

When the first channel starts data transmission in the frame mode, a call setup procedure is performed on the D channel for the second B channel (hereinafter referred to as the second channel) (phase CA), and the second channel is established. Then, frame data including only the frame synchronization signal FAS and the bit allocation signal BAS are exchanged using the second channel to establish frame synchronization and multi-frame synchronization (phase CB1-11). Establish synchronization between channels (phase CB1-12).

When the synchronization of the two B channels is completed, the transmission mode is set by transmitting a BAS command from the calling terminal side (phase CB1-2), and the transmission mode is switched to the set contents (phase CB1-3). ), And set common parameters (phase CB3).

After the initialization of the second channel is completed in this way, after that, the frame data exchanged on the first channel and the frame data exchanged on the second channel are synchronized with each other. Using the B channel, audio data and moving image data are transmitted in a state where transmission rates of, for example, 56 Kbps and 64 Kbps are allocated, respectively (FIG. 12A,
(B)).

When ending such data transmission, the terminal first disconnects from the second channel established later. At this time, a procedure for setting a common mode is performed for the audio data transmission performed only on the first channel (phase CD1), and the mode switching of the second channel to the frame mode 0F is performed (phase CD1). Phase CD2).

At this time, the first channel and the second channel are asynchronous, and the second channel is in a state where a call is held in a transmission state of only the frame synchronization signal FAS and the bit allocation signal BAS. Is in a state where the call of the second channel can be released by the call disconnection and release procedure.

In the first channel, the phase CD1
During the phase CD2, audio data and moving image data are transmitted in the frame mode at a total transmission rate of 62.4 Kbps. In this state, when the communication of the operator of one terminal ends, the transmission of the moving image data ends,
The transmission capacity of all the first channels, including the transmission capacity of the moving image data, is switched to mode 0F in order to use the transmission capacity for voice transmission (phase D2). The call can be released.

As a result, the call disconnection release procedure is executed on the D channel for the first channel and the second channel (phase E), and the video conference communication between the two terminals ends.

As described above, the video conference communication device TTV
1, the TTV 2 secures one B channel (first channel) first and establishes a frame mode, and then allocates the transmission speed of audio data and moving image data in the first channel to perform transition mode. If the second B channel (second channel) can be set at the same time while performing data transmission, the second channel is secured by the D channel call setting procedure.

Then, the first channel transmitting in the transient mode and the newly secured second channel are synchronized, and when the channel synchronization is established, the transmission speeds of the audio data and the moving image data are allocated. Is changed, and in order to utilize the increased transmission capacity of the B channel, the encoding rule (encoding method) of the audio data and the moving image data is changed to exchange higher-quality audio data and moving image data. Like that.

On the other hand, when ending data transmission, it is necessary to temporarily change from the mode in which the transmission path in which both the first channel and the second channel are synchronized to the mode in which only the first channel is used. is there.

Therefore, first, each of the coding rules of the audio data and the moving image data is set to a method of optimizing the transmission capacity of the first channel to 62.4 Kbps, and the transmission mode is changed to the transmission mode of only the first channel. The two channels are the first
While the synchronization state with the channel is stopped, the mode shifts to mode 0F in which user data is in an idle transmission state, and D
The call is disconnected / released according to the channel call release procedure.
Further, the first channel is switched from two types of media transmission of audio data and moving image data to mode 0F, which is a transmission mode of only audio data, and then disconnects / releases the call by a D channel call release procedure. . The first channel can be disconnected / released after directly changing the mode to the mode 0F without switching the mode to the two types of media transmission of the audio data and the moving image data. In addition, accounting information and the like obtained in the call disconnection release procedure are managed for each channel.

In the present embodiment, when an incoming call is detected, the video conference communication device TTV1 (TTV2) executes the processing shown in FIG.

First, a predetermined video conference call setting procedure process (process 101) is executed to establish two B channels, and video conference communication can be performed using the two B channels established at that time. State.

Next, the TV camera scanning process (process 10)
2) is executed to transmit the video of the shooting range of the own terminal to the calling terminal side, and execute a voice input determination process (process 103) for confirming by voice that the user of the own terminal is waiting. .

In this voice input determination processing, it is checked whether or not it has been determined that a user's voice has been input (determination 104). If the result of determination 104 is YES,
Since the user of the own terminal is on standby, the video conference communication process at that time is continuously executed (process 10).
5).

If the result of determination 104 is NO, a moving image input determination process (process 106) for confirming with a video that the user of the terminal is waiting is executed. It is checked whether or not motion has been detected in the moving image input determination processing (determination 107), and the result of determination 107 is YES.
Is reached, it means that the user of the own terminal is on standby, and the process proceeds to processing 105.

When the result of the determination 107 is NO, it means that the user of the own terminal is not waiting, so that a calling process (process 108) for calling the user of the own terminal is executed, and after the user is made to wait, , To the processing 105.

FIG. 14 shows an example of the television camera scanning process.

First, the image transmission operation is started (Step 20).
1) The imaging position of the video camera device 6 is moved at a predetermined speed from the center of the initial value to the left limit position (processing 20).
2) Next, the robot moves at a predetermined speed from the left limit position to the right limit position (process 203), and moves at a predetermined speed from the right limit position to the center (process 204).

Thus, the video monitor device 5 of the calling terminal
, The seating state of the user, the state of the room on the side of the receiving terminal, and the like are displayed and output. Therefore, the user of the calling terminal can wait without boredom until the video conference starts.

FIG. 15 shows an example of the voice input determination process.

First, the level of an audio signal input from the microphone 8 is detected (process 301), and it is checked whether or not the level of the audio signal is higher than a predetermined value N (unit is decibel) (decision 302). . When the result of the determination 302 is YES, the main routine (the processing in FIG. 13) is notified of the presence of the voice input (processing 303), and the determination 302
If the result is NO, the main routine is notified that there is no voice input (process 304).

FIG. 16 shows an example of the moving image input determination processing.

First, the value of the variable n is initialized to 0 (process 401). Next, the signal Smc is input, and the value of the motion vector of one macroblock is detected (processing 40).
2) The absolute value of the motion vector is substituted for a variable KV (process 403). Then, it is checked whether the value of the variable KV is smaller than a predetermined value K (for example, 1) (decision 40).
4) If the result of the determination 404 is YES, the value of the variable n is increased by one (process 405).

Then, it is checked whether or not the processing has been completed for all 396 macroblocks (decision 40).
6) If the result of determination 406 is NO, process 40
2, the process for the next macroblock is executed.

When the result of determination 406 is YES, the processing for one screen image has been completed.
It is checked whether the value of the variable n is larger than a predetermined value L (for example, 300) (decision 407).

If the result of the judgment 407 is YES, it means that there is no moving object in the image for one screen at that time, so that the main routine is notified that there is no motion (processing 408), and the result of the judgment 407 is When the answer is NO, it means that there is a moving target in the image of one screen at that time, and the main routine is notified of that (step 408).

As described above, it is determined whether or not there is a moving object in one screen by using the motion vector detecting function of the video CODEC 25.

FIG. 17 shows an example of the calling process.

First, a timer TM1 for a predetermined time is started (process 501), a process for generating a predetermined ringing tone is started (process 502), and the user responds to the operation display device 9 or the timer TM1 is operated. It waits until a timeout occurs (NO loop of determinations 503 and 504).

When the timer TM1 times out, the judgment 5
04 is YES, the timer TM2 for a predetermined time
Is started (process 505), the ringing tone is stopped (process 506), and the user operates the operation display device 9 for a response, or
Wait until the timer TM2 times out (decision 5
07, 508 NO loop). If timer TM2 times out and the result of decision 508 is YES, process 5
Returning to 01, a ringing tone is generated again.

Further, the user who has noticed the ringing tone calls and responds to the operation display device 9 and the result of the judgment 503 is Y
When it becomes ES, the generation of the ringing tone is stopped (process 508), and this operation ends. When the result of determination 507 is YES, this operation is immediately terminated.

In this way, the ringing tone is generated during the timer TM1 and the operation of stopping the timer TM2 is repeatedly executed to perform the calling operation of the user.

As described above, in the present embodiment, the destination terminal automatically executes the preparation for the video conference communication by responding to the incoming call, and when the preparation for the video conference communication is completed,
First, transmitting the video of the own terminal side to the calling terminal, then checking the state of voice input and moving image input to determine whether the user of the own terminal is waiting, and calling the user when not waiting Is to run.

Therefore, it is possible to avoid a situation in which the user of the calling terminal waits frustratingly until the start of the video conference communication, and can smoothly operate the video conference communication.

In the above-described embodiment, when the user cannot be confirmed by voice input, an operation of confirming the user by moving image input is executed, and when the user cannot be confirmed, the calling operation is executed. However, the conditions and operations leading up to the calling operation are not limited to this.

That is, the video conference input operation may be checked first, or the video conference communication operation may be continued when the user can be confirmed by voice input and the user can be confirmed by video input. Can also.

Further, for example, the calling operation may be executed for a predetermined time (for example, three minutes), and if the user of the own terminal cannot be detected, the video conference communication may be forcibly terminated.

In the above-described embodiment, whether or not there is a moving object in the input image is checked by using the detected value of the motion vector, and the result of the check is used for detecting the user. When a silhouette of a person can be detected by a matching process or the like, it may be detected that the user is on standby.

Further, as the calling operation, as in the above-described embodiment, not only a ringing tone is generated, but also a specific calling message may be output by voice. Also,
The frequency of the ringing tone may be appropriately set according to the preference of the user or the ease of listening. Further, a call display may be performed on the video monitor device 5.

[0097]

As described above, according to the present invention,
When the absence of the user of the own terminal is detected at the time of the incoming call detection, an operation of calling the user is performed, so that there is no useless call of the calling user using the other telephone or the like. There is no need to perform communication, and an effect is obtained that video conference communication can be started smoothly.

[Brief description of the drawings]

FIG. 1 is a schematic diagram showing a video conference communication system according to one embodiment of the present invention.

FIG. 2 is an exemplary block diagram showing a configuration example of a video conference communication device according to an embodiment of the present invention;

FIG. 3 is a block diagram showing an example of a communication control device.

FIG. 4 is a schematic diagram for explaining a format of image information.

FIG. 5 is a block diagram showing an example of a video CODEC.

FIG. 6 is a schematic diagram showing an example of a frame configuration of a multi-frame.

FIG. 7 is a schematic diagram showing an example of a signal configuration of one frame.

FIG. 8 is a schematic diagram illustrating an example of a frame adjustment signal.

FIG. 9 is a schematic diagram showing an example of a bit allocation signal.

FIG. 10 is a schematic diagram for explaining a signal transmission order.

FIG. 11 shows TTC recommendation JT-H. 242 is a time chart showing a general procedure example of H.242.

FIG. 12 is a schematic diagram showing an example of a signal format at the time of video conference communication.

FIG. 13 is a flowchart illustrating an example of processing of a destination terminal.

FIG. 14 is a flowchart illustrating an example of a video camera scanning process.

FIG. 15 is a flowchart illustrating an example of a voice input determination process.

FIG. 16 is a flowchart illustrating an example of a moving image input determination process.

FIG. 17 is a flowchart illustrating an example of a calling process.

──────────────────────────────────────────────────続 き Continuation of front page (56) References JP-A-4-61488 (JP, A) JP-A-62-24788 (JP, A) JP-A-1-132261 (JP, A) JP-A-4- 207253 (JP, A) JP-A-2-81589 (JP, A) JP-A-5-41863 (JP, A) JP-A-2-1666985 (JP, A) JP-A-5-327707 (JP, A) (58) Field surveyed (Int.Cl. ⁷ , DB name) H04N 7/10 H04N ^7/ 14-7/173 H04N ^7/ 20-7/22

Claims (3)

(57) [Claims] 1. A camera having a photographing function, a video display function, a voice input / output function, and a video conference communication function.
In a control method of a video conference communication device having an automatic call reception function, when a call is detected, a predetermined pre-transmission procedure is executed to complete preparation for video conference communication with a partner terminal. A method for controlling a video conference communication device, comprising: determining whether a user is present / absent and, when detecting that the user is absent, performing an operation of calling the user. 2. The presence / absence determination of the user of the own terminal is performed by inputting a level of a voice input signal and, when the level is equal to or more than a predetermined value, determining the presence of the user and determining that the level is smaller than a predetermined value. 2. The method according to claim 1, wherein the absence of the user is determined at times. 3. The determination of the presence / absence of the user of the own terminal includes determining the presence / absence of the user when a motion vector obtained at the time of encoding of a video signal input by shooting is equal to or more than a predetermined value per frame. The method according to claim 1, wherein the determination is made, and when the motion vector is smaller than a predetermined value per frame, the absence of the user is determined.