JP2001103436A - Portable video telephone - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable video telephone that can surely display holding of communication, even if an application such as a telephone directory is started, while video telephone communication is in a holding state. SOLUTION: The portable video telephone is provided with a frame memory that stores image data having been displayed on a display means, when an application program start means starts an application and with a control means that applies display control to the display means, in such a way that the display means displays the image data having been started in the frame memory in the case that a communication channel is in a holding state, when the application program is terminated.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to a portable videophone device, and more particularly to the display of a hold image during communication in the portable videophone device.

[0002]

2. Description of the Related Art A portable videophone apparatus can have a conversation while transmitting / receiving a voice or an image while viewing an image from a partner, and can store the received image as it is. Yes, and it is also possible to store an image taken by a camera built in the portable videophone device as it is. In the portable videophone device, the stored image data can be handled as additional information of the registration data of the telephone directory. As a result, when searching for an individual from the telephone directory, it is possible to look at the image and perform the search, and when an incoming call is received, the image related to the called number is displayed together with the name information, so that the calling party can be more intuitively identified. It becomes possible to understand.

[0003]

In the portable videophone device, in order to reduce the size and weight of the device, the encoding / decoding of the transmitted / received image and the image stored in the internal memory are performed by the same processing unit. Use That is, normally, when encoding and decoding image data in the internal memory using an application that handles an image stored in the internal memory such as a telephone directory, when encoding and decoding an image obtained by a camera, The same processing unit is used for encoding / decoding an image transmitted / received during a telephone call.

However, when an application for decoding image data in an internal memory, such as a telephone directory function, is activated during communication by a videophone, when a hold request is received from a communication partner and the videophone device shifts to a hold state,
There is a problem that an image indicating the hold cannot be displayed when the application is exited during the hold state and the display screen of the videophone device is returned from the image display of the telephone directory to the display for communication.

[0005] Regarding this phenomenon, FIGS.
This will be described with reference to FIG. FIG. 9 shows a basic configuration diagram relating to image display processing in a conventional portable videophone device, and FIG. 10 shows a configuration diagram representing a flow of received image display processing in a conventional portable videophone device. 11
1 is a configuration diagram showing a flow of image display processing at the time of starting an application in a conventional portable videophone device.

In the figure, reference numeral 1 denotes a control processing unit, 2 denotes an operation input unit, 3 denotes an image memory for storing image information corresponding to a telephone number or the like, and 4 denotes a reception for receiving data via a communication line. Reference numeral 5 denotes a received image data buffer for temporarily storing data received in order to adjust data input / output timing, 6 denotes a selector, 7 denotes a decoding processor, and 8 denotes a display. In addition, the same code | symbol is used for the location which shows the same structure.

Next, conventional operation processing will be described. In the configuration shown in FIG. 9, the processing procedure for displaying the received image received by the receiving unit 4 on the display unit 8 in real time is as follows. First, the selector 6 is moved to FIG. Connect as shown. The image data received by the receiving unit 4 is stored in a received image data buffer unit 5.
Is temporarily stored in the decoding unit 7, decoded by the decoding processing unit 7, and displayed on the display unit 8. When an image is being displayed at the time of starting the application, the selector 6 is connected as shown in FIG. 11 under the control of the control processing unit 1 in order to display the image stored in the image memory 3. Then, the image data to be displayed is read from the image memory 3, decoded by the decoding processing unit 7, and displayed and output by the display unit 8. These processes are performed by the control processing unit 1 switching the selector 6 as needed in response to a signal from the operation input unit 2 or a signal received by the receiving unit 4, and the received image data received by the receiving unit 4 The decoding processing of the image data stored in the image memory 3 can be performed by using the same decoding processing unit 7.

Further, even during communication by videophone as shown in FIG. 10, when an application for displaying image data stored in the image memory 6 such as a telephone directory is activated, the selector is switched as shown in FIG. At this time, since the communication itself is not stopped, the image data received one after another is accumulated in the received image data buffer unit 5,
The next received data is overwritten and updated as needed without being decoded. When the application is terminated and the communication is returned to the videophone communication, decoding is started from the image data stored in the received image data buffer unit 5.

Normally, when a hold request is generated during a videophone communication, the decoding process is stopped, the updating of the image displayed on the display unit 8 is stopped, and a hold sound is transmitted from a speaker (not shown). (See FIG. 12).

In the suspended process, the updating of the display image is stopped by stopping the decoding process. However, when the application is activated during the suspension processing and the display is switched to the image display in the image memory 3, or when the application is activated during communication and the image in the image memory 3 is displayed, the communication is suspended. In this case, there is a problem that an image at the time of stopping due to suspension cannot be displayed again when the application is terminated. (Reference Figure 1
3) Explaining this state, first, the inter-frame coding method is useful for compressing data of images transmitted continuously in time like a videophone. This method uses a strong correlation between one frame and the next frame before the screen is suddenly changed, and performs data compression. In this method, the values of all pixels in one frame are calculated. Requires a frame memory to store. Usually, there are two frame memories, one of which is used for display and the other is used for generating the next display image. Then, these two frame memories are switched and used. Therefore, in the above-mentioned suspended state, the switching of the two frame memories is stopped. However, when displaying an image in the image memory 3 by activating the application, the images in the image memory 3 are sent one after another for display in the two frame memories. Will be overwritten and erased by the image display accompanying this.

In the case of image data having no inter-frame encoding such as motion JPEG, image data before decoding is stored, and when it is necessary to display as a reserved image, re-decoding and display are performed. Thus, even if the image display is overwritten and erased with the start of the application as described above, it is possible to display the image again after the application is terminated.In this case, when the image is displayed by starting the application If a hold request is issued, there is a problem that the hold image may not be displayed when the application is terminated.

[0012] Since the decoding process itself is a process of decoding the image data stored in the internal memory along with the activation of the application, the decoding process itself is accumulated in the received image data buffer unit 5 at the time of receiving the hold request. It is not known whether the displayed image data can be displayed and output. This is because, in the case of a portable videophone device, data is exchanged between terminals via a wireless transmission path, and in places where radio wave conditions are poor, there is a possibility that received data may contain noise. Therefore, when the received image data at the time of receiving the hold request is decoded as it is, an image different from the image transmitted due to noise is displayed, or an image that is not related to the communication image such as a black screen without switching display is displayed. May be displayed.

[0013]

According to a first aspect of the present invention, there is provided a portable videophone apparatus comprising: an imaging unit; and a communication unit for transmitting / receiving image data to / from a communication partner through a communication line. A video phone apparatus comprising: a display unit for displaying image data; an application program start unit for starting an application program; and a hold start unit for temporarily holding a line in communication. A storage means for storing the image data displayed on the display means when the application program is terminated, and when the hold activation means switches the line being communicated to a hold state when terminating the application program, the storage means Control means for controlling the display of the stored image data on the display means, And it said that there were pictures.

According to a second aspect of the present invention, there is provided a portable videophone device, comprising: an image pickup means; a communication means for transmitting / receiving image data to / from a communication partner through a communication line; a display means for displaying image data; In a videophone device comprising: an application program activating unit for activating a program; and a hold activating unit for temporarily switching a line in communication to a temporary hold, a display is displayed on the display unit when the hold activating unit switches the line in communication to a hold state. Storage means for storing image data being stored, and control means for controlling display of the image data stored in the storage means on the display means when the communication line is on hold when terminating the application program, It is characterized by having.

According to a third aspect of the present invention, in the portable videophone device, the storage means includes a holding frame memory different from a frame memory provided for display or an area of the display frame memory. Part.

According to a fourth aspect of the present invention, there is provided a portable videophone device, comprising: an image pickup means; a communication means for transmitting / receiving image data to / from a communication partner through a communication line; Determining means for determining whether or not the image data decoded by the decoding means can be displayed on the display means in a videophone device comprising: decoding means for performing decoding; and display means for displaying image data decoded by the decoding means. And storage means for storing image data before decoding by the decoding means corresponding to the image data judged to be displayable by the judgment means.

Further, a portable videophone device according to a fifth aspect of the present invention includes an application program activating means for activating an application program, and a hold activating means for temporarily switching a line in communication to a temporary hold. The image data before decoding by the decoding means corresponding to the image data judged by the judgment means to be displayable based on the activation of the application program starting means or the holding starting means is stored.

The portable video-phone apparatus according to claim 6, wherein said storage means is a buffer for holding or a buffer different from a receiving buffer for temporarily storing said received image data. It is characterized by being a part of a region.

[0019]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings. In addition, the same code | symbol is used for the location which shows the same structure. FIG. 1 is a basic configuration diagram relating to image display processing in a portable videophone device according to one embodiment of the present invention. 1 is a control processing unit, 2 is an operation input unit, 3 is an image memory that stores image information corresponding to a telephone number or the like, 4 is a receiving unit that receives data via a communication line, 5 Denotes a received image data buffer unit for storing temporarily received data for adjusting data input / output timing, 6 denotes a selector, 7 denotes a decoding processing unit, 8 denotes a display unit, and 9 denotes a reserved display image frame memory. . In addition, the same code | symbol is used for the location which shows the same structure.

First, the basic operation of displaying image information on the display unit 8 will be described. Image data received by the receiving unit 4 is stored in the received image data buffer unit 5, and stored in the received image data buffer unit 5. Image data or image data stored in the image memory 3 in advance
The display unit 8 is decoded by the decoding processing unit 7 via the selector 6.
Is displayed and output. The control processing unit 1 controls the connection destination of the selector 6 based on a signal from the operation input unit 2 or a control signal received by the receiving unit 4.

Next, one embodiment of the present invention will be described with reference to FIGS. 2, 3 and 4. FIG. FIG. 2 is a flowchart showing a processing operation when the portable videophone device according to one embodiment of the present invention holds a communication, and FIG. 3 is a flowchart of the portable videophone device according to one embodiment of the present invention. FIG. 4 is a flowchart showing a processing operation at the time of activating application image display, and FIG. 4 is a flowchart showing a processing operation at the time of ending the application image display of the portable videophone device according to one embodiment of the present invention.

FIG. 2 shows processing when a user or a communication partner issues a hold request for this communication during a videophone communication. Check that the process is performed (S10
1) Further, it is checked whether the displayed image is a communication image received by the receiving unit 4 (S102), and the control processing unit 1
Saves temporarily the display image by videophone communication displayed on the display unit 8 to the hold display image frame memory 9 and stops the decoding processing of the next frame.

FIG. 3 shows a process for displaying an image memory 3 by activating an application in response to a signal from the operation input unit 2 during communication by a videophone. Not) (S201),
Check whether the displayed image is an image by communication (S20).
2), the control processing unit 1 temporarily saves the display image in the videophone communication displayed on the display unit 8 to the hold display image frame memory 9 (S203), and moves the selector 6 from the reception image data buffer unit 5 to the image memory 3 (S
204). Thus, the image stored in the image memory 3 is displayed and output on the display unit 8. When a signal of a hold request from a communication partner is input to the reception unit 4 during the activation of the application, the control processing unit 1 shifts the internal operation processing state from the communication state to the hold state.

FIG. 4 shows when the application is terminated.
That is, the process for ending the image display associated with the application is shown, and the decoding process of the image memory 3 is stopped with the end of the application (S301), and the control processing unit 1 performs the process corresponding to the current communication state (S302). )I do. For example, if the current state is communication, the selector 6
Is switched to the received image data buffer unit 5 to start decoding and displaying the received image data (S303). On the other hand, in the case of the suspension state, the image once saved in the suspension display image frame memory 9 is displayed as an image (S304).

FIG. 5 is a diagram showing a display state of the display unit when the telephone directory is opened during videophone communication, a hold request is received from a communication partner, and the telephone directory is closed during the hold. When the telephone directory is opened during communication, the displayed communication image is saved in the hold display image frame memory 12. Then, the image in the image memory 3 is displayed on the display unit 8. When a hold request is received from a communication partner in this state, the internal state shifts from a communication state to a hold state and a hold sound is transmitted. Then, when the application is ended while the application is suspended, the display unit 8 displays and outputs the image saved in the suspension display image frame memory 9 first.

In the above description, the reserved display image frame memory 9 is described separately from the display unit 8. However, actually, the frame memory in the display unit 8 is replaced by adding one frame memory for the reserved display image. And may be realized.

Next, another embodiment of the present invention will be described with reference to the drawings. FIG. 6 is a basic configuration diagram relating to image display processing in a portable videophone device according to an embodiment of the present invention. In the figure, reference numeral 10 denotes an encoding processing unit,
Reference numeral 1 denotes a suspended display image buffer unit. In addition, the same code | symbol is used for the location which shows the same structure.

In FIG. 6, when the reserved display image is saved, the image data once decoded by the decoding processing unit 7 is encoded by the encoding processing unit 10 and saved in the reserved display image buffer unit 11 so that the reserved display image is saved. It is possible to reduce the memory capacity occupied in. In general, when a hold occurs, the other party stops updating the image in the hold state. During this time, the encoding of the image input from the camera and the transmission of the data are temporarily stopped.
0 can be assigned to the encoding of the reserved display image displayed on the display unit 8. When the reserved image is to be displayed again, the reserved image is decoded by the decoding processing unit 7 via the selector 6 and displayed on the display unit 8. This makes it possible to reduce the memory capacity for saving the hold display image.

Another embodiment of the present invention will be described with reference to FIGS. FIG. 7 is a diagram showing a basic configuration of an image display process in a portable videophone device according to an embodiment of the present invention. FIG. 8 is a diagram illustrating updating of a hold display image in the portable videophone device according to an embodiment of the present invention. It is a flowchart which shows a process. In addition, the same code | symbol is used for the location which shows the same structure.

7 and 8, in the case where the image data stored in the received image data buffer unit 5 is decoded by the decoding processing unit 7 and can be displayed on the display unit 8 (S40).
1, the decoding processing unit 7 notifies the suspended display image buffer unit 11 that decoding display is possible (S40).
3), the image data is copied from the received image data buffer unit 5 to the hold display image buffer unit 11 (S40).
4).

When the application is in the hold state at the end of the application, the control processing unit 1 switches the selector 6 from the image memory 3 to the hold display image buffer unit 11 and decodes the image data stored in the hold display image buffer unit 11. The data is decrypted by the unit 7 and displayed on the display unit 8.

It should be noted that the reserved display image buffer unit 11 makes it possible to update only when the decoded image can be displayed by the decoding processing unit 7. For this reason, the reception data received by the receiving unit 4 is not decoded while the application is being activated and the image is being displayed, and the suspended display image buffer unit 11 is not updated. In other words, the image displayed as the hold image when the application is terminated is the image that the user has seen last before the application is activated, and the user can continue the operation without feeling uncomfortable.

Here, the suspended display image buffer unit 11 is described separately from the received image data buffer unit 5. However, actually, one image for the suspended display image is added to the received image data buffer unit 5, and finally, It may be realized by treating the buffer that has decoded and displayed and output as a pending display image buffer.

Saving of the received image data to the hold display image buffer unit 11 is performed when the communication image is not displayed.
That is, the processing amount can be reduced by performing only the image data of the communication image displayed when there is a hold request or when an application other than the videophone communication is activated.

In the present invention, an application is a menu screen for selecting various functions, a telephone directory function for displaying a list of telephone numbers and corresponding information, a document preparation function for creating characters and figures, and an image pickup by a camera. This refers to a function of switching and displaying communication images displayed in real time, such as an imaging mode for displaying a displayed image.

In the above embodiment, the hold state is set by a request signal from a communication partner or a user's operation. However, traffic congestion and radio wave often occur when using a wireless line. It can also be used for sudden communication suspensions, such as when data is not fully or not received due to degradation effects.

[0037]

As described above, when the portable videophone device of the present invention is used, an application such as a telephone directory function is activated during communication using an image, that is, so-called videophone communication. When information is displayed on the display unit, communication images being displayed are saved in the frame memory for holding images at the same time as switching the screen, so that, for example, communication is held while displaying the phonebook image. Even in the state, when the telephone directory is ended, the saved image can be displayed in the frame memory to indicate the hold state of the communication.

Further, by always saving received image data capable of generating a decoded image in the hold display image buffer, even if the application is put on hold during the activation,
At the end of the application, the hold state of the communication can be indicated by displaying the image stored in the hold display image buffer. Therefore, since the decoded image is not stored, the memory to be used can be reduced, and as a result, the terminal is downsized.

Thus, even if the application is put on hold during communication during a videophone call, an image indicating the hold state can be displayed, so that the user can continue the operation without feeling uncomfortable.

[Brief description of the drawings]

FIG. 1 is a basic configuration diagram relating to image display processing in a portable videophone device according to an embodiment of the present invention.

FIG. 2 is a flowchart illustrating a processing operation when the portable videophone device according to the embodiment of the present invention suspends communication.

FIG. 3 is a flowchart showing a processing operation at the time of starting application image display of the portable videophone device according to one embodiment of the present invention.

FIG. 4 is a flowchart showing a processing operation of the portable videophone device according to the embodiment of the present invention when an application image display ends.

FIG. 5 is a diagram showing a display state of a display unit in the portable videophone device according to one embodiment of the present invention.

FIG. 6 is a basic configuration diagram regarding image display processing in a portable videophone device according to an embodiment of the present invention.

FIG. 7 is a basic configuration diagram relating to image display processing in a portable videophone device according to an embodiment of the present invention.

FIG. 8 is a flowchart showing an update process of a hold display image in the portable videophone device according to one embodiment of the present invention.

FIG. 9 is a basic configuration diagram relating to image display processing in a conventional portable videophone device.

FIG. 10 is a configuration diagram showing a flow of display processing of a received image in a conventional portable videophone device.

FIG. 11 is a configuration diagram showing a flow of image display processing at the time of starting an application in a conventional portable videophone device.

FIG. 12 is a diagram showing a display state of a display unit in a conventional portable videophone device.

FIG. 13 is a diagram showing a display state of a display unit in a conventional portable videophone device.

[Explanation of symbols]

 1: Control processing unit 2: Operation input unit 3: Image memory 4: Receiving unit 5: Received image data buffer unit 6: Selector 7: Decoding processing unit 8: Display unit 9: Suspended display image frame memory 10: Encoding processing unit 11: Hold display image buffer unit

Claims (6)

[Claims] A communication means for transmitting / receiving image data to / from a communication partner through a communication line; a display means for displaying image data; an application program starting means for starting an application program; A videophone device comprising: a holding start unit that temporarily switches a line to a hold; a storage unit that stores image data displayed on the display unit when the application program starting unit starts an application; Control means for controlling the display of the image data stored in the storage means on the display means, when the hold activation means has switched the line being communicated to the hold state at the time of termination. Portable videophone device. 2. An image pickup means, a communication means for transmitting / receiving image data to / from a communication partner through a communication line, a display means for displaying image data, an application program starting means for starting an application program, A videophone device comprising: a hold activation unit that temporarily switches a line to a hold; a storage unit that stores image data displayed on the display unit when the hold activation unit switches a line in communication to a hold state; A control unit for controlling the display of the image data stored in the storage unit on the display unit when the communication line is on hold at the time of ending the application program. apparatus. 3. The display device according to claim 1, wherein said storage means is a frame memory for suspension different from a frame memory provided for display, or a part of an area of said frame memory for display. 3. The portable videophone device according to 2. 4. An image pickup means, a communication means for transmitting / receiving image data to / from a communication partner through a communication line, a decoding means for decoding image data received by the communication means, and a decoding means for decoding the image data received by the communication means. Display means for displaying image data, a determining means for determining whether the image data decoded by the decoding means can be displayed on the display means, and an image determined to be displayable by the determining means. Storage means for storing image data corresponding to data before being decoded by the decoding means. 5. An application program activating means for activating an application program, and a hold activating means for temporarily switching a line under communication to a temporary hold, wherein said storage means is based on activation of said application program activating means or said activating means. A portable video-phone apparatus for storing image data before decoding by the decoding means corresponding to the image data judged to be displayable by the judgment means. 6. The storage means according to claim 1, wherein said storage means is a buffer for holding, different from a reception buffer for temporarily storing said received image data, or a part of said reception buffer area. Item 6. A portable videophone device according to item 4 or 5.