JP4271449B2 - Communication device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a communication apparatus suitable for use in image instruction and selection during image data communication.
[0002]
[Prior art]
2. Description of the Related Art In recent years, portable videophone devices have been realized that can communicate while viewing images from a communication partner by transmitting and receiving images together with sound. The camera of this portable videophone device has a structure that not only images the direction of the speaker but also images the area around the speaker. Thereby, it is possible not only to talk to each other while watching the other party's face, but also to send, for example, the scenery of a travel destination.
[0003]
A conventional portable videophone device encodes an image captured by a camera and audio input by a microphone, and transmits the encoded image to a terminal of a communication partner using a wireless line. Also, the encoded image and audio data received from the communication partner terminal is decoded and output by the display unit and the speaker, respectively. It takes a certain amount of time for an image captured by the portable videophone device to be displayed and output on the communication partner terminal based on the image and audio encoding / decoding processing and the transmission bandwidth of the transmission path. Also, an image has a larger amount of data than audio, and the processing time required for encoding and decoding the image is longer than the time required for encoding and decoding the audio.
[0004]
Usually, in a video conference system or the like, a voice is synchronized with an image and output, thereby eliminating a gap between the movement of the mouth and the voice. However, since the audio delay hinders rhythmic conversation, when importance is attached to the conversation, output is performed without synchronizing the sound and the image. Further, there is a video conference system that gives a mark when a speaker is projected in a video conference (for example, see Patent Document 1).
[0005]
[Patent Document 1]
JP-A-8-37655 Gazette
[Problems to be solved by the invention]
However, with a conventional portable videophone device, when a plurality of articles are imaged and this image is transmitted and the recipient selects an item, for example, when the customer chooses what to buy at the destination of shopping. A time lag occurs between the image captured on the transmission side and the image displayed on the reception side depending on the processing time and transmission time of the image encoding and decoding described above. For this reason, there is a delay in the time from when the sender images with the camera until the receiver views the image. In addition, the reply from the receiver to the sender is further delayed. However, the sender recognizes the object that the sender intends to show when the sender points toward the camera as if the receiver is on the spot without worrying about the delay time. There is a problem in that the images being noticed do not match between the sender and the receiver.
[0007]
Further, in the portable videophone device, there is a possibility that the user's hand may be shaken when the object is imaged, and there is a problem that the display image on the receiving side is disturbed by the shake.
[0008]
The present invention has been made in view of such circumstances, and an object of the present invention is to provide a communication apparatus that can easily match images of interest between a sender and a receiver.
[0009]
[Means for Solving the Problems]
In order to solve the above problems, a communication device according to claim 1 is provided with an image input unit and an image display unit, and transmits and receives image data to and from the other communication device via a wireless line. of the input image by the input means, associating instruction input means for designating an image to be stored to the other communication device, when the image is specified by the instruction input means, the number to the specified image a number setting unit, when the image number is associated with said number setting means, and transmission control means for controlling to transmit towards the image data to which the number is associated to said other communication device And a display control means for displaying the image corresponding to the number by the image display means when the number selected in the other communication device is received. It is characterized by a door.
[0010]
The communication apparatus according to claim 2, wherein the number setting unit associates the same number with an input image in a period during which the designation by the input unit is continued.
[0011]
According to a third aspect of the present invention, the display control means continuously displays the image data associated with the number for a certain period.
[0012]
The communication device according to claim 4, the image data and the selection input means for selecting the image data of the received data number is associated with, a number associated with the selected image data as a selected number Selection number transmission control means for transmitting to the transmission source.
[0013]
The communication apparatus according to claim 5, further comprising a selection image storage unit that holds the designated image together with a number associated with the image data , wherein the display control unit is held in the selection image storage unit. The image corresponding to the received selection number is displayed together with the number by the image display means.
[0014]
The communication apparatus according to claim 6, wherein a deletion schedule flag corresponding to a retention order is added to the number and the image information held in the selected image storage unit during the communication period at the end of communication. And
[0015]
In the communication device according to claim 7, when there is no free space in the selected image storage unit, the oldest information held in the selected image storage unit is deleted based on the deletion schedule flag. Features.
[0016]
9. The communication device according to claim 8, wherein when there is no free space in the selected image storage means, information relating to a number other than the corresponding selection number and deleting the oldest information based on the deletion schedule flag. It is characterized by that.
[0017]
A communication apparatus according to claim 9, or at the time of incoming response transmission operation, to erase the number and the image information held in the selected image storage unit, and wherein the initializing the numbers.
[0018]
The communication apparatus according to claim 10, wherein the sharpness of the edge in the input image input by the image input unit is measured, and during the period in which the designation by the instruction input unit continues, the previous time in the period Only an input image having a sharpness higher than the sharpness of the transmitted image is transmitted.
[0019]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be sequentially described with reference to the drawings.
FIG. 1 is a block diagram showing a basic configuration of a portable videophone device 200 according to the first embodiment of the present invention. In FIG. 1, an image encoding unit 1 encodes image information input by an image input unit 6 and outputs image encoded data. The voice encoding unit 2 encodes the voice information input by the voice input unit 5 and outputs voice encoded data. The encoded image data and the encoded audio data are multiplexed by the multiplexing / demultiplexing unit 12 and wirelessly transmitted via the wireless processing unit 13 and the antenna unit 4.
[0020]
Also, the encoded data received by the antenna unit 4 and the wireless processing unit 13 is separated into image encoded data and audio encoded data by the multiplexing / separating unit 12. The image decoding unit 9 decodes the separated encoded image data. The image output unit 7 displays and outputs the decoded image data. Also, the speech decoding unit 10 decodes the separated speech encoded data. The audio output unit 8 reproduces and outputs the decoded audio data.
The image output unit 7 can display and output the input image of the image input unit 6 together with the received image by the picture-in-picture function.
[0021]
The control unit 21 manages the instruction number corresponding to the input image of the image input unit 6. When the instruction signal is input by pressing the instruction key of the operation unit 3, the control unit 21 updates the instruction number, associates the updated instruction number with the current input image of the image input unit 6, and selects the image storage unit 20. To remember. Further, while the instruction signal is continuously input, the same instruction signal is associated with the input image. Then, the control unit 21 outputs the instruction number to the multiplexing / demultiplexing unit 12. The multiplexing / separating unit 12 adds the instruction number received from the control unit 21 to the transmission data when multiplexing the encoded image data of the input image.
[0022]
When the encoded image data to which the instruction number is added is received, the control unit 21 receives the encoded image data and the instruction number from the multiplexing / separating unit 12 and stores them in the selected image storage unit 20. The control unit 21 causes the image output unit 7 to display each received image stored in the selected image storage unit 20 based on the key operation of the operation unit 3. Accordingly, the user can display each received image to which the instruction number has been added and select a target image by operating the key of the operation unit 3. Upon receiving an image selection determination instruction from the operation unit 3, the control unit 21 transmits the instruction number added to the selected received image as a selection number.
Further, the control unit 21 displays and outputs the received image to which the instruction number is added together with the instruction number for a certain period. Thereby, it becomes possible to improve a user's visibility.
[0023]
On the other hand, when the selection number is received, the control unit 21 reads out the image to which the instruction number matching the selection number is added from the selection image storage unit 20 and displays it as the selected image in the image output unit 7. Let
[0024]
The control unit 21 may store the moving image in the selected image storage unit 20 in association with the instruction number. For example, the control unit 21 on the image transmission side transmits an instruction number when the instruction key is pressed, and then transmits a release code of the transmitted instruction number when the instruction key is released. The input moving image is stored in the selected image storage unit 20 in association with the instruction number. Similarly, the control unit 21 on the image receiving side stores the received moving image in the selected image storage unit 20 in association with the instruction number from when the instruction number is received until the release code is received. Alternatively, the selected image storage unit 20 may store a moving image for a certain period from the time when the instruction key is pressed on the image transmitting side, and similarly, a moving image for a certain period from the time when the instruction number is received on the image receiving side. Good.
[0025]
Next, with reference to FIG. 2, the operation of the above-described portable videophone device 200 will be described. FIG. 2 is a diagram for explaining the flow of processing for transmitting and receiving images by the portable videophone device 200 shown in FIG.
In FIG. 2, the operator 102 on the instruction image transmission side presses the instruction key while imaging the instruction target 105 using the portable videophone device 200-1. Thereby, portable videophone apparatus 200-1 adds instruction number 1 to the encoded data of the image captured when the instruction key is pressed and transmits the encoded data (step S1). Next, when the operator 102 presses the instruction key while the instruction target 103 is being imaged, the portable videophone apparatus 200-1 adds an instruction number 2 to the encoded data of the image captured when the operator 102 is pressed. Are added and transmitted (step S2). Next, when the operator 102 presses the instruction key while the instruction target 104 is being imaged, the portable videophone apparatus 200-1 adds the instruction number 3 to the encoded data of the image captured when the operator 102 is pressed. Is added and transmitted (step S3).
[0026]
Next, when the instruction image receiving side receives the encoded image data to which the instruction numbers 1, 2, and 3 are added, the portable videophone device 200-2 displays each instruction object 105, The decoded images 103 and 104 are sequentially displayed together with the corresponding instruction numbers 1, 2, and 3 (step S4). Next, the operator 107 on the instruction image receiving side selects a target image from the instruction objects displayed on the display unit of the portable videophone device 200-2. For example, when the instruction target 103 is selected (example in FIG. 2), the instruction number 2 added to the image encoded data is transmitted to the instruction image transmission side as a selection number (step S5).
[0027]
Next, when receiving the selection number 2, the portable videophone device 200-1 on the instruction image transmission side reads the image stored in association with the corresponding instruction number 2 from the selection image storage unit 20 and together with the instruction number 2. The information is displayed on the display unit (step S6). As a result, the operator 102 on the instruction image transmission side can clearly grasp that the operator 107 as the communication partner desires the instruction target 103 corresponding to the instruction number 2.
As described above, according to the present embodiment, it is possible to easily match images of interest between the sender and the receiver.
[0028]
The operator 107 on the instruction image receiving side, when selecting a desired image from the images received together with the instruction number, scrolls the received image with the up and down keys or the scroll key as a selection key, Can be selected by pressing the enter key when displaying the image to be displayed.
Alternatively, a desired image may be selected by inputting an instruction number of a desired image using a numeric keypad and pressing the enter key.
Further, the number of selectable images is limited to 10 or less, and a selection number is assigned from 0 to 9, and an image is selected by pressing a numeric keypad that matches the target selection number. May be.
[0029]
Note that the operator 107 on the instruction image receiving side may notify the operator 102 on the instruction image transmitting side by voice of the selection number.
Further, portable videophone apparatus 200-1 on the instruction image transmission side may display only the received selection number. However, it is more preferable to display the instruction number together with the image of the selected image storage unit 20 corresponding to the received selection number as in the above embodiment.
[0030]
Next, a second embodiment of the present invention will be described. FIG. 3 is a block diagram showing a schematic configuration of a portable videophone apparatus according to the second embodiment of the present invention. The portable videophone device according to the second embodiment has substantially the same configuration as that of the portable videophone device according to the first embodiment shown in FIG. 1, and FIG. 3 shows only the parts related to the different configurations. ing. 3, parts corresponding to those in FIG. 1 are given the same reference numerals, and descriptions thereof are omitted.
[0031]
As shown in FIG. 3, the portable videophone device according to the second embodiment includes a switching unit 30, a sharpness determination unit 31, and a freeze image storage unit 32.
When the instruction key of the operation unit 3 is pressed, the sharpness determination unit 31 measures the sharpness of the edge in the image input by the image input unit 6. Then, when the sharpness of the latest input image is higher than the sharpness of any input image during which the instruction key is being pressed, the latest input image is written into the freeze image storage unit 32, whereby the freeze image storage unit The image held at 32 is updated as needed.
[0032]
The switching unit 30 inputs the input image from the image input unit 6 and the image held in the freeze image storage unit 32, and outputs one of the images to the image encoding unit 1 according to the switching control of the control unit 22. The control unit 22 causes the image held in the freeze image storage unit 32 to be output as an input image of the image encoding unit 1 during the period in which the instruction key is pressed. On the other hand, the input image from the image input unit 6 is output to the image encoding unit 1 during a period when the instruction key is not pressed. Further, the image held in the freeze image storage unit 32 is stored in the selected image storage unit 20 together with the instruction number. As a result, the clearest image among the input images disturbed by camera shake or the like is transmitted as the instruction image.
[0033]
Further, by using the image of the freeze image storage unit 32 as an input image to the image encoding unit 1, the image to be encoded becomes a pseudo still image, and the input image for the encoding process is fixed. Therefore, the image encoding unit 1 outputs encoded data obtained by sequentially correcting the encoding error, and on the receiving side that receives and decodes these encoded data, the definition of the decoded display image gradually increases. It will follow. Then, a transmission code indicating that the instruction key has been released is transmitted from the transmission side, and on the reception side, decoding of the target image is stopped based on the received transmission code, whereby a decoded image associated with the instruction number is transmitted. Is obtained as the clearest still image. Thereby, it is possible to suppress the deterioration of the image quality due to the hand shake of the operator. Further, when the target key is dark when the instruction key is pressed, it is possible to further improve the sharpness of the image by emitting the flash and turning on the light.
[0034]
At the end of communication, a deletion schedule flag corresponding to the holding order is added to the instruction number and image information held in the selected image storage unit 20 during the communication period, and the selected image storage unit 20 has no free space. In this case, the oldest information held in the selected image storage unit may be deleted based on the deletion schedule flag. Alternatively, the oldest information based on the deletion schedule flag that is information related to the instruction number that has not received the corresponding selection number may be deleted.
[0035]
In addition, the instruction number and the image information stored in the selected image storage unit 20 may be erased and the instruction number may be initialized at the time of a calling operation or an incoming call response.
[0036]
The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes design changes and the like within a scope not departing from the gist of the present invention.
[0037]
【The invention's effect】
As described above, according to the present invention, images of interest can be easily matched between the sender and the receiver. Further, since the transmission data increased by the present invention is a small amount of information such as an instruction number or a selection number added to the encoded data, a decrease in transmission efficiency due to the instruction and selection of the image of interest is slight. .
[0038]
In addition, since only the input image having a higher sharpness than the previously transmitted image is transmitted, the display image on the receiving side gradually improves. As a result, for example, in a portable videophone device, camera shake tends to occur when an object is imaged. However, image disturbance due to camera shake or the like is prevented from being transmitted to the reception side as it is, and the reception side The effect that the display image is stabilized is obtained.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a basic configuration of a portable videophone device 200 according to a first embodiment of the present invention.
FIG. 2 is a diagram for explaining the flow of processing for transmitting and receiving an image by the portable videophone device 200 shown in FIG. 1;
FIG. 3 is a block diagram showing a schematic configuration of a portable videophone device according to a second embodiment of the present invention.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... Image encoding part, 2 ... Audio | voice encoding part, 3 ... Operation part, 4 ... Antenna part, 5 ... Audio | voice input part, 6 ... Image input part, 7 ... Image output part, 8 ... Audio | voice output part, 9 ... Image decoding unit, 10 ... audio decoding unit, 12 ... multiplexing / separation unit, 13 ... wireless processing unit, 20 ... selected image storage unit, 21, 22 ... control unit, 30 ... switching unit, 31 ... sharpness determination unit, 32 ... Freeze image storage unit, 200, 200-1, 200-2 ... Portable videophone device, 103-105 ... Target of indication

Claims (10)

In a communication apparatus that includes an image input means and an image display means, and transmits and receives image data to the other communication apparatus via a wireless line.
Instruction input means for designating an image to be stored in the other communication device among the images input by the image input means;
Number setting means for associating a number with the designated image when an image is designated by the instruction input means ;
When the image number is associated with said number setting means, and transmission control means for controlling to transmit towards the image data to which the number is associated to said other communication device,
Display control means for displaying the image corresponding to the number by the image display means when receiving the number selected in the other communication device;
A communication apparatus comprising:   The communication apparatus according to claim 1, wherein the number setting unit associates the same number with an input image in a period during which the designation by the input unit is continued.   The communication apparatus according to claim 1, wherein the display control unit continuously displays the image data associated with the number for a certain period. Selection input means for selecting image data of received data associated with a number;
Selection number transmission control means for transmitting a number associated with the selected image data as a selection number to the transmission source of the image data;
The communication device according to any one of claims 1 to 3, further comprising: A selection image storage means for holding the designated image together with a number associated with the image data;
The said display control means displays the image corresponding to the received selection number among the images hold | maintained at the said selection image memory | storage means by the said image display means with the said number. Communication device.   6. The communication apparatus according to claim 5, wherein at the end of communication, a deletion schedule flag corresponding to the holding order is added to the number and image information held in the selected image storage means during the communication period.   7. The communication apparatus according to claim 6, wherein when there is no free space in the selected image storage unit, the oldest information held in the selected image storage unit is deleted based on the deletion schedule flag. .   The oldest information based on the deletion schedule flag, which is information related to a number other than the corresponding selection number, is deleted when the selected image storage means has no free space. Communication device.   6. The communication apparatus according to claim 5, wherein a number and image information held in the selected image storage means are erased and the number is initialized at the time of a call operation or an incoming call response.   The sharpness of the edge in the input image input by the image input means is measured, and the sharpness higher than the sharpness of the previously transmitted image within the period is measured during the period when the designation by the instruction input means is continued. The communication apparatus according to claim 1, wherein only the input image having a degree is transmitted.

Images