JP3406919B2 - Videophone apparatus and control method thereof - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a videophone device and a control method thereof, and more particularly to a videophone device having an answering machine answering function and a control method thereof.

[0002]

2. Description of the Related Art In recent years, an ISDN (Integrated Service Digital Network) interface has been standardized by the CCITT (International Telegraph and Telephone Consultative Committee) as a digital line consisting of an information channel and a signal channel, and its practical use is being promoted. . There is a videophone device as a terminal that handles voice and video using this type of ISDN service. Since the videophone device can handle not only voice but also video (still image, moving image), by providing a function for recording a voice message or a video message, a videophone device with an answering machine answering function should be provided. You can

In contrast to a conventional answering machine that only responds to voice, a video telephone equipped with an answering machine can transmit both video and voice, so commercial video can also be used for a response message. Thus, it is possible to visually send a message to the other party, and even when not present, the message can be accurately and comfortably transmitted to the other party.

By the way, in a conventional videophone apparatus having an answering machine answering function, the received image data to be transmitted is recorded as it is as an answering machine recording reception data at the time of answering machine answering. In this case, when the time allowed for the recorded message elapses during answering machine answering, a warning sound is transmitted to the communication partner to notify the end of the recorded message. In addition, in the conventional videophone device of this type, the answering machine response message image is stored as a moving image composed of a plurality of frames, and the moving image is transmitted to the communication partner during the answering machine response.

[0005]

[Problems to be Solved by the Invention] H.
According to H.261, in this type of videophone device, the encoding method is Inter (Inter
r Frames), MC (Motion Compe
Nation), INTRA (Intra Frame)
Unlike e), the received image quality is deteriorated to some extent in the Inter and MC modes. Therefore, when the received images in the Inter and MC modes are accumulated as the recorded message reception data, there is a problem that the image quality is not good.

The present invention has been made in view of the current state of the above-described video telephone apparatus of the type described above, and an object thereof is a video telephone capable of storing a received image of good image quality when answering an answering machine. An object is to provide an apparatus and a control method thereof.

[0007]

In order to achieve the above object, the video telephone apparatus according to claim 1 automatically starts response communication to an incoming communication and sends a response message to a communication partner. A video telephone device having a function of storing an image message and a voice message transmitted from the communication partner, and transmitting a request signal for transmitting a screen update request signal for updating a coding mode to the communication partner. Means for determining the coding mode of the received image, and after the screen update request signal is transmitted, when the coding mode of the received image becomes a predetermined mode, it is transmitted from the communication partner. Memory to store image messages
Means for storing the communication partner,
Images that are captured and transmitted at arbitrary timing by operation
Image message, timing of receiving the image message
Is stored together with information indicating

According to a second aspect of the present invention, in the video telephone device according to the first aspect, the managing means for managing the storage time of the voice message and the storage time of the voice message become a predetermined time. Accordingly, it is characterized by having a transmitting means for transmitting a predetermined image message to a communication partner.

According to a third aspect of the present invention, in the video telephone device according to the first aspect, the screen update request signal is a signal requesting the Intra mode.

According to a fourth aspect of the present invention, in the video telephone device according to the first or third aspect, the coding mode is at least Inter mode and Int.
It is characterized by including a ra mode.

According to a fifth aspect of the present invention, in the videophone device according to the first, third, or fourth aspect, the storage means stores the image message and a voice transmitted from the communication partner. Is stored.

The videophone device according to a sixth aspect of the present invention is, in the configuration of the fifth aspect, a determination means for determining whether or not the storage time of the voice transmitted from the communication partner has exceeded a predetermined time. It is characterized by having.

Further, in the videophone device according to a seventh aspect, in the structure according to the sixth aspect, a predetermined image is displayed when the determination unit determines that the storage time of the voice exceeds the predetermined time. It is characterized by comprising a transmission control means for transmitting.

Further, the video telephone apparatus according to claim 8
Is in the configuration according to any one of claims 1 to 7 above.
The response message indicates that the communication partner
Includes content that informs the operation method for capturing sage
It is characterized by

The videophone device according to claim 9
Automatically starts response communication for incoming communication,
The response message is sent to the communication partner and the communication is performed.
Image and voice messages sent from the other party
A videophone device having a function of storing
When the image coding mode becomes a predetermined mode
The image message sent from the communication partner is stored in
Means for storing in the means,
The stage can be taken at any time by the operation of the communication partner.
The image message sent in
In the storage means together with information indicating the reception timing of the message
It is characterized by storing.

Further , the videophone device according to claim 10
It is Te configuration smell of the claim 9, wherein the voice message
Management means for managing the storage time of the message, and the voice message
Depending on when the storage time of the
With a transmission means for transmitting the determined image message to the communication partner
It is characterized by having.

The videophone device according to claim 11
Is the storage control device in the configuration according to claim 9.
Dan has the storage means store the image message.
And the voice transmitted from the other party is stored.
It is characterized by making it.

The videophone device according to the twelfth aspect.
Is the communication partner in the configuration according to claim 11.
Whether the storage time of the voice transmitted from
It is characterized by having a determining means for determining whether or not.

The videophone device according to claim 13
In the structure according to claim 12, is the determination means.
It is determined that the voice storage time exceeds the predetermined time.
In the case of being separated, a transmission control means for transmitting a predetermined image is provided.
It is characterized by being provided.

The videophone device according to claim 14
In the configuration according to any one of claims 9 to 13 above.
In the response message, the communication partner
Includes contents that inform you of the operation method for capturing messages.
It is characterized by

The videophone device according to the fifteenth aspect.
The control method is to automatically respond to the incoming call.
Start and send a response message to the communication partner.
The image message and sound transmitted from the communication partner.
Of the videophone device that stores the voice message in the storage means
It is a control method and requires a screen update to update the encoding mode.
A request signal is transmitted to the communication partner to encode the received image.
The screen reception request signal after sending the screen update request signal
When the image coding mode becomes a predetermined mode
The image message sent from the communication partner
It is stored in the storage means and further operated by the communication partner.
Image message that is captured and sent at any time
Information indicating the reception timing of the image message.
And characterized in that stored in the Symbol 憶means together.

A videophone device according to claim 16
16. The control method according to claim 15, wherein the storage time of the voice message is managed according to the configuration of claim 15 , and a predetermined image message is sent to a communication partner when the storage time of the voice message reaches a predetermined time. It is characterized by transmitting.

The videophone device according to claim 17
In the configuration of the fifteenth aspect of the present invention, the screen update request signal is a signal requesting the Intra mode.

A videophone device according to claim 18.
The control method of the above is the configuration according to claim 15 or 17 above.
The encoding mode includes at least an Inter mode and an Intra mode.

A videophone device according to claim 19
The control method is described in claim 15, 17 or 18 above.
In the configuration, the image message is stored in the storage unit, and the voice transmitted from the communication partner is stored.

The videophone device according to claim 20.
The control method according to claim 19 is characterized in that, in the configuration according to claim 19, it is determined whether or not the storage time of the voice transmitted from the communication partner exceeds a predetermined time.

The videophone device according to claim 21.
The control method according to the present invention is characterized in that, in the configuration according to claim 20 , a predetermined image is transmitted when it is determined that the storage time of the voice exceeds the predetermined time.

The videophone device according to claim 22.
The control method according to any one of claims 15 to 21 above.
In the described configuration, the response message is the communication.
Informs the operation method for the other party to capture the image message
It is characterized by including the contents to be.

The videophone device according to claim 23.
The control method is to automatically respond to the incoming call.
Start and send a response message to the communication partner.
The image message and sound transmitted from the communication partner.
Of the videophone device that stores the voice message in the storage means
The control method is such that the encoding mode of the received image is predetermined.
Sent from the other party when the communication mode is changed
The image message is stored in the storage means, and
It is imported at any timing by the operation of the communication partner.
Make sure that the image message sent is
Stored in the storage means together with information indicating the signal timing.
It is characterized by

The videophone device according to claim 24.
The control method of the
It manages the storage time of voice messages and
Depending on when the storage time of the
Characterized by sending the specified image message to the communication partner
And

Further , the video telephone device according to claim 25.
The control method of the
The storage means stores the image message.
To store the voice transmitted from the communication partner
Is characterized by.

A videophone device according to claim 26.
The control method of the
The storage time of the voice transmitted from the communication partner
The feature is that it is determined whether or not it has exceeded.

The videophone device according to claim 27.
27. The control method of the
It was determined that the recording time of the voice recording exceeded the predetermined time.
In this case, a predetermined image is transmitted.

The videophone device according to claim 28.
The control method according to any one of claims 23 to 27 above.
In the described configuration, the response message is the communication.
Informs the operation method for the other party to capture the image message
It is characterized by including the contents to be.

[0035]

According to the action television telephone apparatus of claim 1, is started automatically response communication to the communication which has been called, the screen update request signal for updating the sign-reduction mode is transmitted to the communication partner,
After transmitting the screen update request signal, the received image is encoded in the coding mode.
When the communication mode changes to a predetermined mode,
The image message transmitted from the device is stored. Furthermore, before
It is imported at any timing by the operation of the communication partner.
The image message that is sent is the receipt of the image message.
It is stored together with the information indicating the signal timing.

According to the video telephone apparatus of claim 9,
And the response communication is automatically started for the incoming communication.
The received image coding mode is set to the predetermined mode.
Image message sent from the other party when
Is stored in the storage means, and is arbitrarily operated by the communication partner.
Image message that is captured and sent at the timing of
Is the information indicating the reception timing of the image message
Both are stored in the storage means.

The control of the videophone device according to claim 15
According to the method, it automatically responds to incoming calls
Screen update request signal to start encoding and update the encoding mode
Is sent to the communication partner and the screen is updated to update the encoding mode.
A new request signal is sent to the communication partner, and the screen update request
After the signal is transmitted, the encoding mode of the received image is
When a message is displayed, the image message sent from the
The message is stored in the storage means. Furthermore, the communication phase
It is captured and transmitted at any time by hand.
Image message is the reception timing of the image message.
Stored in the storage means together with the information indicating the message.

The control of the videophone device according to claim 23.
According to the method, it automatically responds to incoming calls
Is started and the coding mode of the received image is
When a message is displayed, the image message sent from the
The message is stored in the storage means and can be operated by the communication partner.
Image messages that are captured and transmitted at more arbitrary timing
Sage indicates the timing of receiving the image message
It is stored in the storage means together with the information.

[0039]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to FIGS.

[Structure] FIG. 2 is a perspective view showing the structure of the videophone apparatus according to this embodiment. In FIG. 2, reference numeral 601 denotes a videophone main body, and a received image is displayed on the front surface of the videophone main body 601. A display 219 is provided above the display 219 with a camera 205 for capturing a received image. Further, the lower part of the front surface of the videophone main body 601 is extended forward to form an operation panel D, and a ten-key 604 is provided at the center of the operation panel D.
Answering machine mode setting button 605 for setting the answering machine mode on one side, play button 606 for reproducing the content received on behalf of the answering machine, accumulation button 607 for accumulating a response message in the answering machine mode, and image freeze button 6
08 is provided. Furthermore, a handset 60 including a speaker 220 and a microphone 204 on the other side of the operation panel D
9 is connected and the handset 609 is idle
Is provided with a hook switch 610. When the handset 609 is placed on the hook switch 610,
The hook switch 610 goes into the on-hook state, and when the operator lifts the handset 609, the hook switch 610 goes into the off-hook state.

FIG. 1 is a block diagram showing the configuration of the video telephone apparatus according to the present embodiment. The output terminal of the microphone 204 for outputting a voice signal of the operator is, via the AD converter 206, CC. It is connected to a voice encoding unit 209 which encodes transmission voice data by the encoding method of 722. Further, the output terminal of the camera 205 is connected to a transmission image frame memory 208 that temporarily stores the transmission image to be encoded in frame units via the AD converter 207, and the output terminal of the transmission image frame memory 208 is , CCITT Recommendation H.264. It is connected to an image encoding unit 210 that encodes transmission image data according to the encoding method of H.261. Then, the audio encoding unit 209 and the image encoding unit 2
10 and the output terminal of CCITT recommended H.264. 221 is connected to a multiplexing unit 211 that multiplexes audio data and image data by the data multiplexing method.
The output terminal of is connected to a communication control unit 212 which sends out the multiplexed transmission data to the external communication line and inputs the multiplexed reception data received from the external communication circuit to the separating unit 213 described later.

On the other hand, the output terminal on the receiving side of the communication control unit 212 is the H.264 signal of CCITT recommendation. 221 is connected to a separation unit 213 that separates the audio data and the image data that are multiplexed by the data multiplexing method of 221. An image decoding unit 214 that decodes image data encoded by the encoding method of H.261.
Connected to. The output terminal of the image decoding unit 214 is connected to the received image frame memory 216 that temporarily stores the decoded image data in frame units,
The output terminal of the received image frame memory 216 is the display 2 that displays the received image via the DA converter 217.
It is connected to 19.

The output terminal on the receiving side of the separating unit 213 is CCITT G.G. 711 and G.I. The audio decoding unit 215 is connected to the audio decoding unit 215 which decodes the audio data by the decoding method of 722, and the output terminal of the audio decoding unit 215 is DA
It is connected to the speaker 220 via the converter 218.

By the way, in this embodiment, a timer 203 for measuring the communication time is provided, and this timer 203 is connected to the overall control unit 201 for controlling the overall operation. It is connected to the memory 208 and the memory 202 in which voice data and image data at the time of answering machine is stored. The memory 202 is connected to a received image frame memory 216, and the output terminal of the memory 202 is connected to an audio decoding unit 223 which decodes audio data compressed to 32 kbps by the ADPCM method. The output terminal of the audio decoding unit 223 is connected to the speaker 220 and the microphone 204 via the DA converter 224. Further, the output terminals of the microphone 204 and the DA converter 218 are input via the AD converter 221 to the audio encoding unit 222 that compresses audio data into data of 32 kbps by the ADPCM method, and the output terminal of the audio encoding unit 222. Memory 20
It is connected to 2.

[Operation Mode] FIG. 7 is an operation mode state transition diagram of the video telephone according to the present embodiment. In FIG. 7, reference numeral 701 indicates an idle state, and from this idle state, the operator off-hooks the handset 609, When the telephone number of the communication partner is dialed, the calling state 702 is set, and when the call partner is connected through the line, the calling state 703 is set. In this case, if the operator goes on-hook before connecting to the calling party, the state returns to the idle state, and even when the operator goes on-hook from the call state 703, the state returns to the idle state 701.

When there is an incoming call in the idle state 701, the ring tone sounds and the ring tone sounds state 704.
When the operator lifts the handset 609 and goes off-hook, the call state 703 is entered, and when the communication partner disconnects the communication before going off-hook, the state returns to the idle state 701.

On the other hand, when the operator turns on the answering machine mode setting button 605 in the idle state 701,
Answering mode state 705, answering mode state 70
From 5, the operator turns off the answering mode setting button 605.
If F operation is performed, it will return to the idle state 701. In the idle state 701, when the operator turns on the answering machine playback button 606, the answering machine record / playback state 706 is played in which the answering machine message recorded in the answering machine mode state 705 is played.
Return to.

Further, when the operator turns on the accumulation button 607 in the idle state 701, accumulation of the response message in the recorded message mode is started. To store the response message, first, the response voice storage 707 is performed. When the freeze button 608 is turned on while the voice is being stored, the response image storage 708 that stores the image captured by the camera 205 as the response message image is displayed. Done. When this accumulation ends, the process returns to the response voice accumulation 707, and when the accumulation button 607 is turned off, the idle state 701
Return to.

[Operation in Answering Machine] FIG. 3 is a flow chart showing the operation in the answering machine of the present embodiment. Four parameters of n, m, T1 and Tsm are used for the operation, and the communication numbers are used respectively. , Received image number,
A communication time timer and a time stamp are shown. The communication number n is an incoming call order management number at the time of answering machine operation, and is numbered as 1, 2, 3 ... In the incoming call order, and the received image number m is
At the time of answering machine answering operation, it is a storage order management number of the still images stored in the memory. The first image at the start of communication is 0, and the numbers are numbered 1, 2, 3 ... Every time the memory is stored thereafter.
The communication time timer T1 indicates the call time from the start of communication for each communication, and the time stamp Tsm indicates the time when the image stored in the memory is received, as a relative time from the start of the communication. Ts1, Ts2 is recorded in the second accumulated image data, and Tsm is recorded in the mth accumulated image data.

The operation of the answering machine mode of this embodiment will be described below with reference to FIG.

In the answering machine mode, step S103
Initialization of the parameters is performed with the initial values n = 1, m =
When 0 and T1 = 0 are set, the answering machine mode is determined in step S104, and if the answer is NO and the answering machine mode is released, the operation ends. Step S1
If the determination result in 04 is YES, the process proceeds to step S105 to enter the waiting state for the incoming call, and the determinations in steps S104 and S105 are repeated until the incoming call occurs.

When there is an incoming call, the line is connected in step S106, and the response image shown in FIG. 5 which is stored in the memory 202 in advance in order to notify the communication partner that the videophone device is in the answering machine mode. Is written in the transmission image frame memory 208, encoded by the image encoding unit 210, and transmitted to the communication partner via the multiplexing unit 211 and the communication control unit 212 (step S107). In this case, the image written in the transmission image frame memory 208 looks like a still image to the communication partner because the same data is read and encoded many times. In this way, the operator's self-portrait P shown in Fig. 5 and "I'm absent now. Message is 30
Seconds are recorded. Press the freeze button and your image will be recorded. Message ”is transmitted to the communication partner as a response image message.

At the same time as the transmission of this response image message,
The voice data of the response message (different from the message of the response image) stored in the memory 202 in advance is read and decoded by the decoding unit 223, and the DA converter 224,
It is transmitted to the communication partner via the AD converter 206, the voice encoding unit 209, the multiplexing unit 211, and the communication control unit 212.

Further, when all the received image data of the first sheet are received at the same time as the transmission of the response image message and the response voice message and all of them are stored in the received image frame memory 216, the data of the one frame is set as still image data.
The data is stored in the memory 202. At this time, as shown in FIG. 4B, the communication number n and the time stamp Ts0 are recorded at the head of the image data storage area.

Returning to FIG. 3, when the transmission of the response message ends in step S107, the end of communication is confirmed once in step S108, and when the communication partner ends the communication without sending the message, It is possible to stop the answering machine response operation and return to the waiting state for waiting for an incoming call. If the decision result in the step S108 is NO, the step S
In step 109, the communication time timer 203 starts counting, and at the same time, the voice of the communication partner is data-compressed by the voice encoding unit 222 and accumulated in the memory 202 in real time. At this time, the overall control unit 201 records the communication number n at the beginning of the audio data storage area, as shown in FIG. Then, H.264 of the CCITT recommendation is sent to the communication partner. BAB (bit rate allocation signal) 221
A screen update request is made to the communication partner by transmitting the "image update request command" defined in.

In this way, when the screen update request in step S109 is completed and the first received INTRA mode image (INTRA mode will be described later) is stored in the received image frame memory 216, step S1
In 10, the data of the frame is stored in the memory 202 as still image data. In this case, image data 3
As the storage area of 17, the image area of Ts0 is overwritten and the image data of the time stamp Ts0 is updated, and the value of Ts0 at this time remains 0 seconds.

Next, in step S112, it is determined whether or not the communication partner has terminated communication and the line has been disconnected. If the result of this determination is YES, step S119
Then, the communication is cut off, and in step S120, the accumulation of the voice of the communication partner in the memory is stopped, and in step S121.
Then, the communication number n is updated by adding 1 to the next incoming call waiting state.

If the determination result in step S112 is NO and communication has not ended, the communication time timer 203 is monitored in step S113. If 30 seconds has elapsed, the process proceeds to step S118, and the image of the message recording end message is displayed. The data and the voice data of the warning sound are read out from the memory 202, and are transmitted to the communication partner in the same manner as the above-mentioned response message transmission. Here, the reason why the communication time is limited to 30 seconds is to limit the upper limit of the free memory capacity necessary for the absence recording of one communication and prevent the overflow of the writing to the memory. By the way, in the present embodiment, the voice data is converted into the data of 32 kbps by the voice encoding unit 222.
The free capacity of the memory 202 for accumulating voice data for 30 seconds at maximum without overflow becomes 120 Kbytes at maximum.

If the decision result in the step S113 is NO, 3
If it does not exceed 0 seconds, the process proceeds to step S114 to determine whether or not there is a freeze request from the communication partner. It is determined that there is a freeze request when the “screen freeze command” defined by the BAS 221 is received from the communication partner. This freeze request is that the communication partner has instructed to record the image, as shown in the response message of FIG. 5. If this request is made, first, in step S115, the received image number m is received. Is updated by adding 1 to the relative communication time T for which the freeze request is made to the time stamp Tsm in step S116.
Write 1. Then, in step S117, the memory 20
The data of the received image of the received image frame memory 216 is written in 2. For example, if there is a first freeze request 10 seconds after the start of communication, as shown in FIG.
10 is recorded in (315) and the subsequent memory area 316
The received image data is recorded in. And. Step S1
When the accumulation of the received image data is completed in step 17 and when the freeze request is not issued in step S114, step S
Return to 112.

[Answering / Recording / Reproducing Operation] Next, an answering / recording / reproducing operation of accumulated image data and accumulated voice data will be described.

When the operator presses the play button 606 in the idle state 701, the answering machine recording / reproducing mode 706 is started in which the image data and the audio data stored in the memory 202 in the answering machine mode are reproduced. In this reproduction, n = 1, 2, 3, ... Are reproduced in order of the communication number n. In the present embodiment, the number of recordings is 1 (n = 1), the communication time (voice recording time) is 20 seconds, and two images (Ts0 = 0 seconds, Ts1 =
15 seconds) The case where the data is accumulated will be described below.

FIG. 8 is a flow chart showing an operation at the time of recorded message reproduction of the embodiment, and FIG. 9 is an explanatory diagram showing an accumulated state of recorded message data on the memory at the time of recorded message reproduction of the embodiment. In FIG. 9, 901, 903, and 906 are communication management numbers, and in this embodiment, the number of cases is one, so all are set to 1.
Reference numeral 902 denotes audio data, and audio data converted into ADPCM is accumulated for 20 seconds (80 Kbytes).
Reference numeral 904 indicates a relative time Ts0 from the start of communication when the first image is stored, which is 0 second in this embodiment. 905
Indicates the first image data accumulated when the relative time is 0 seconds. 907 is the relative time Ts when the second image is accumulated
1 and that is 15 seconds in this embodiment, and 908 shows the second image data accumulated when the relative time is 15 seconds.

In the flowchart of FIG. 8, when the answering machine recording / reproducing mode is entered, the parameter n is initialized in step S803, and the parameter n is the communication management number of the recorded message data processed in the recorded message reproducing routine.
The initial value is 1. Next, in step S804, the presence / absence of audio data is determined by searching the memory 202 for the audio data indicating the communication management number n = 1. If the determination result is NO, there is no image data. The recorded message reproduction routine ends.

If the decision result in the step S804 is YES, the timer 203 is started in a step S805, and the process advances to the step S806 to reproduce and start the voice data 902 having the communication management number of n = 1. To reproduce the audio data, the audio data 902 on the memory 202 is read out, decoded by the audio decoding unit 223, converted into an analog audio signal by the DA converter 224, and reproduced from the speaker 220 via the bus 255.

Next, in step S807, the parameter m is initialized. The parameter m is the accumulated image number of the image data in the communication management number n, and the initial value is 0. In the next step S808, the time stamp Ts
The presence or absence of image data of 0 is determined, and if the determination result of step S808 is YES, the image data of time stamp Ts0 is transferred from the memory 202 to the received image frame memory 216 in step S809. The image data transferred to the received image frame memory 216 is the DA converter 2
It is converted into an analog video signal at 17, and the display 21
9 is displayed. Since the image data in the received image frame memory 216 is read many times until the next image data is transferred and the data is updated, the reproduced image is a still image.

If the transfer of the image data is completed in step S809, or if the image data of the time stamp Ts0 does not exist in step S808, the value of the parameter m is updated by adding 1 in step S810. In this embodiment,
As shown in FIG. 9B, there is no image data of Ts0 in the accumulated data on the memory 202, and the image data is not transferred and updated to m = 1. Next, in step S811, it is determined whether or not there is image data with the time stamp Ts1, and if there is an image with the time stamp Ts1, step S81.
In step 2, the process waits until the value of the timer 203 exceeds the value of the time stamp Ts1, that is, the relative time when the image is accumulated. When the relative time is exceeded, in step S813, the image data of the time stamp Ts1 on the memory 202 is received. Transfer to the frame memory 216. The transferred image data is
Converted to analog video signal by DA converter 217,
The time stamp Ts0 is displayed on the display 219.
Image is updated when the image data of the time stamp Ts1 is transferred to the received image frame memory 216.

When all the data of the time stamp Ts1 have been transferred to the received image frame memory 216, step S
Returning to 810, the parameter m is updated again, and m = 2
To update. Then, similarly to the case of Ts0 described above, the image data of the time stamp Ts2 is transferred to the received image frame memory 216 in step S813 after the determinations in steps S811 and S812. The image data transferred in this way is converted into an analog video signal by the DA converter 217, displayed on the display 219, and the parameter m is updated again.

Then, the updated parameter becomes m = 3, but in this embodiment, as shown in FIG. 9B, it is determined in step S811 that there is no image data of Ts3, and the process proceeds to step S814. It is determined whether or not the reproduction of the audio data has been completed, and if the result of this determination is YES, then the operation proceeds to step S815. In step S815,
The image data and audio data of the communication management number n = 1 reproduced in the above process are erased in step S815, and the memory 2
The free space of 02 is secured, the communication management number n is updated in step S816, and the process proceeds to the next process.

When a plurality of recorded messages are received, the value of n continues to be 2, 3, 4, ... Therefore, similar to the above case,
Step S80 for each value of n = 2, 3, 4, ...
The processing of 4 to S816 is repeatedly executed. In this embodiment, as shown in FIG. 9A, the audio data is only n = 1. Therefore, in the case of n = 2, the determination result of step S804 is NO, and the recorded message reproducing routine is ended.

[Operation of Accumulating Response Message in Memory] As shown in FIG.
The operation starts from the response voice accumulation 707, and when the response message accumulation button 607 is turned on, the response voice accumulation starts. Then, the analog audio signal from the microphone 204 is AD-converted by the AD converter 221, converted into audio data of 32 kbps by the audio encoding unit 222, and stored in the memory 202. When the accumulation button 607 is turned off, this accumulation process ends. Also, if the freeze button 603 is turned on while sound is being accumulated, the camera 2
The image captured in 05 is converted by the AD converter 207, and only one frame is stored in the transmission image frame memory 208. Then, the image data of the one frame is accumulated in the memory 202 by the overall control unit 201.

[Image Coding Mode] In this embodiment, image data is transmitted and received in an image format called CIF format. CIF format signals are Y, Cb, and Cr, Y signal frames are 352 horizontal × 288 vertical pixels, Cb signal and Cr signal frames are 176 horizontal × 144 vertical pixels, and each data has an 8-bit data width. I am doing it. In a CIF format image, one frame is composed of 12 blocks called GOB, one GOB is composed of 33 macro blocks, and one macro block is composed of 6 blocks. There is. Processing is GOB
No. 1 to No. 12, in each GOB from macroblocks 1 to 33, and in each macroblock, Y blocks 1 to 4, Cb blocks, and Cr blocks.

FIG. 10 is an explanatory diagram showing the pixel structure of the CIF format of the present embodiment. In the case of Cb frame and Cr frame, the frame size and GOB size are 1 when Y.
/ 2. In Y, 4 blocks form a macroblock, but in Cb and Cr, there are no independent macroblocks, and 4 blocks in Y and 1 block each in Cb and Cr make up a total of 6 blocks. Make up.

In this embodiment, the image coding unit 210 has three modes I depending on the nature of the macroblock to be processed.
inter (Inter Frames), MC (Mot
Ion Compensation), INTRA (I
The encoding operation is performed in conformity with the intra frame).
These modes will be sequentially described below.

Inter is as shown in FIG.
It is an inter-frame differential encoding, and the difference between the block Bp on the previous frame Fp and the processing block B at the same position is calculated,
This is a method of encoding the difference. In this Inter,
In an object that does not move between frames, the difference is 0, so that a very high coding efficiency can be obtained.

MC is an inter-frame differential encoding with motion compensation. As shown in FIG. 11 (b), when there is a motion of an object between frames, a block to be encoded at a position separated by the motion. Since the block Bn similar to Bp exists, the motion vector of the object is estimated from the previous image, the block Bn is obtained, and the difference between the block Bn and the processing block B is encoded. This method makes it possible to compensate for the drawbacks of simple interframe differential encoding.

In INTRA, as shown in FIG. 11C, encoding is performed only with the data in the block without referring to the previous frame. This method is applied to the first image in the first communication in which there is little correlation with the previous image due to a scene change, because of a scene change, or when there is no previous frame to refer to.

The image transmitted in this manner is the Inte
r, MC, and INTRA modes are
CCITT Recommendation H.264. It is transmitted to the communication partner by the MTYPE information indicated by 261. In the present embodiment, the MTYPE information of the transmission image is created by the image encoding unit 210 and transmitted to the communication partner, and the MTYPE information of the reception image is determined by the image decoding unit 214 to perform the decoding process in each mode. It is carried out.

[Modification] In the above-described embodiment, the screen update request is made only in step S109 of FIG. 3. However, after it is determined in step S114 that there is a freeze request, a screen update request signal is sent to the communication partner. It is possible to transmit the received image, wait for the received image to be in the INTRA mode, and then execute the processing in and after step S115 for the image data received in the INTRA mode. Further, in the above-described embodiment, the image message notifying the end of the accumulation is transmitted at the end of the accumulation. However, for example, 20 seconds after 1/3 of the accumulable time has elapsed, “the accumulation is completed in 10 seconds later” You may send a notice message saying "It will end."

Further, in the above-described embodiment, the transmission image frame memory 208 stores the digital video signal for each frame, but the analog video signal is stored as it is for each frame and AD conversion is performed thereafter. Of course, the reception image frame memory 216 may be a memory that stores an analog video signal. Further, although the image data and the audio data are stored in the memory 202 in the above-described embodiment, the image data and the audio data are separately stored. It may be a memory.

[0080]

According to the present invention, the coding mode of the received image is
Sent from the other party when the
It stores the image message that is received,
The image can be stored only in the encoding mode.
Received in NTRA mode for high quality picture recording
Memorize received images in all modes
The storage capacity of the storage means can be saved because there is no
Wear. In addition, by the operation of the communication partner at any timing
The image message that is captured and sent is
It should be stored with the information indicating the timing of receiving the sage.
, Regardless of whether the image is received in the above predetermined mode.
By enabling the reception of images based on the operation of the other party,
Prevents the situation where the communication partner cannot receive the desired image
You can For example, the communication partner is
Send the image at any time according to the audio description.
I can believe. Furthermore, you can receive image messages.
Since it is stored together with the information indicating the signal timing,
For example, you can play back in sync with the audio description,
Playback can be done in sync with minging, and it is easy to use.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a videophone device according to an embodiment of the present invention.

FIG. 2 is a perspective view showing an appearance of the videophone device of FIG.

FIG. 3 is a flowchart der showing the operation of the message recording mode
It

FIG. 4 is an explanatory diagram showing a data storage state in a memory during an answering machine operation.

FIG. 5 is an explanatory diagram of an answering machine response image message.

FIG. 6 is an explanatory diagram of a message recording end message.

FIG. 7 is an explanatory diagram showing a transition state of operation.

FIG. 8 is a flowchart showing an operation of reproducing an answering machine message.

FIG. 9 is an explanatory diagram showing a data storage state of a memory at the time of recorded message reproduction.

FIG. 10 is an explanatory diagram of a pixel configuration of CIF format.

FIG. 11 is an explanatory diagram of encoding modes of Inter, MC, and INTRA.

[Explanation of symbols]

201 Overall control unit 202 memory 203 timer 204 microphone 205 camera 208 Transmission image frame memory 209 Speech coding unit 210 image coding unit 211 Multiplexer 212 Communication control unit 213 Separator 214 image decoding unit 215 Speech decoding unit 216 Received image frame memory 219 display 220 speakers 222 speech coding unit 223 speech decoding unit

Continued front page       (56) References Japanese Patent Laid-Open No. 1-302984 (JP, A)                 JP-A-1-151890 (JP, A)                 Japanese Patent Laid-Open No. 2-119491 (JP, A)                 JP-A-3-178247 (JP, A)                 JP-A-3-41888 (JP, A)                 JP-A-3-250889 (JP, A)                 Actual Kaihei 4-76783 (JP, U)

Claims (28)

(57) [Claims] 1. A function for automatically starting a response communication to an incoming communication, transmitting a response message to a communication partner, and storing an image message and a voice message transmitted from the communication partner. A videophone device, request signal transmitting means for transmitting a screen update request signal for updating a coding mode to the communication partner, determining means for judging a coding mode of a received image, and transmitting the screen update request signal. And a storage unit for storing an image message transmitted from the communication partner when the received image coding mode is changed to a predetermined mode, and the storage unit further operates the communication partner. By any
Image message that is captured and sent at the timing of
With information indicating the reception timing of the image message
A videophone device that is stored together . 2. A managing means for managing the accumulation time of the voice message, and a transmitting means for transmitting a predetermined image message to a communication partner when the accumulation time of the voice message reaches a predetermined time. The videophone device according to claim 1, wherein the videophone device comprises. 3. The videophone device according to claim 1, wherein the screen update request signal is a signal requesting an Intra mode. 4. The encoding mode is at least Int.
4. The videophone device according to claim 1, wherein the videophone device includes an er mode and an Intra mode. 5. The videophone device according to claim 1, wherein the storage unit stores the image message and also stores a voice transmitted from the communication partner. 6. The videophone device according to claim 5, further comprising a determination unit that determines whether or not the storage time of the voice transmitted from the communication partner has exceeded a predetermined time. 7. The videophone according to claim 6, further comprising transmission control means for transmitting a predetermined image when the determination means determines that the storage time of the voice exceeds the predetermined time. apparatus. 8. The response message is sent by the communication partner.
Informing the operation method to capture the image message
The content of any one of claims 1 to 7 is included.
The videophone device according to. 9. An automatic response communication to an incoming communication
Start and send a response message to the communication partner.
The image message and sound transmitted from the communication partner.
With a videophone device equipped with a function to store voice messages
Therefore, the encoding mode of the received image will be the predetermined mode.
Image message sent from the other party
Storage means for storing the memory in the storage means, The storage control means is operated by an operation of the communication partner.
The image message that is captured and sent at the timing
Along with information indicating the timing of receiving the image message
Videophone characterized by storing in the storage means
apparatus. 10. Managing the accumulation time of the voice message
Management means and a predetermined accumulation time of the voice message
A predetermined image message according to the time
And transmitting means for transmitting the
The videophone device according to claim 9. 11. The storage control means is the storage means.
And store the image message in the
Characterized by storing the voice transmitted from the other party
The video telephone device according to claim 9. 12. A record of voice transmitted from the communication partner.
A determination means to determine whether the storage time has exceeded a predetermined time
The videophone device according to claim 11, characterized in that
Place 13. When the voice is stored by the discriminating means
If it is determined that the time period has exceeded the predetermined time,
A transmission control means for transmitting an image is provided.
The videophone device according to claim 12. 14. The response message is the communication partner.
Informs you how to get the image message
The content according to any one of claims 9 to 13, characterized in that the content is included.
The videophone device according to item 1. 15. A television for automatically starting response communication to an incoming communication, transmitting a response message to a communication partner, and storing in a storage means an image message and a voice message transmitted from the communication partner. A method of controlling a telephone device, comprising transmitting a screen update request signal for updating a coding mode to the communication partner, determining a coding mode of a received image, transmitting the screen update request signal, and then transmitting the received image of the received image. when the coding mode becomes a predetermined mode, the image message transmitted from the communicating party
It is stored in the storage means and further operated by the communication partner.
Image message that is captured and sent at any time
Information indicating the reception timing of the image message.
And a telemeter characterized in that it is stored in the storage means together with
Control method for B-phone device . 16. manages storage time of the voice message, the claims storage time of the voice message in response to reaches a predetermined time, and transmits a predetermined image message to the communication partner Videophone described in 15
Device control method. 17. The screen update request signal is Intra.
Claim, characterized in that a signal for requesting the mode 1
5. The method of controlling the videophone device according to item 5 . 18. The encoding mode is at least In.
18. The method according to claim 15, wherein the control method includes a ter mode and an Intra mode. Together make storing the image message to 19. wherein the storage means, according to claim 15, 17 or 1, characterized in that storing a sound to be transmitted from the communication partner
8. A method of controlling a videophone device according to item 8 . 20. The method according to claim 19, wherein it is determined whether or not the storage time of the voice transmitted from the communication partner has exceeded a predetermined time. 21. The method of controlling a videophone apparatus according to claim 20 , wherein a predetermined image is transmitted when it is determined that the storage time of the voice exceeds the predetermined time. 22. The response message is the communication partner.
Informs you how to get the image message
The contents are included. Any of 1
2. A method of controlling a videophone device according to item 1. 23. Automatically responding to an incoming call
Communication is started and a response message is sent to the communication partner.
The image message and sound transmitted from the communication partner.
Of the videophone device that stores the voice message in the storage means
The control method is such that the encoding mode of the received image is predetermined.
Sent from the other party when the communication mode is changed
The image message is stored in the storage means, and
It is imported at any timing by the operation of the communication partner.
Make sure that the image message sent is
Stored in the storage means together with information indicating the signal timing.
A method for controlling a videophone device, comprising: 24. Managing the accumulation time of the voice message
However, the accumulation time of the voice message has reached the specified time
Depending on the situation, you can send a predetermined image message to the communication partner.
The videophone according to claim 23, wherein the videophone is transmitted.
Device control method. 25. The image message is stored in the storage means.
And the sound transmitted from the communication partner.
24. The tele according to claim 23, which stores a voice.
Control method for B-phone device. 26. A record of voice transmitted from the communication partner
Characterized by determining whether the storage time has exceeded a predetermined time
The method of controlling a videophone device according to claim 25. 27. The storage time of the voice is equal to the predetermined time.
Sending the specified image when it is determined that it has exceeded
27. A method of controlling a videophone device according to claim 26,
Law. 28. The response message is the communication partner.
Informs you how to get the image message
28. Any of claims 23-27 including content.
2. A method of controlling a videophone device according to item 1.