JP2002016895A - Video telephone apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video telephone apparatus which is improved in user- friendliness and can communicate simply the will of a speaker by using image information except the image information sensed with a camera or the like. SOLUTION: This video telephone apparatus is equipped with a camera part for taking in an image signal, a microphone part for taking in an audio signal, a transmitting part which transmits a transmission signal containing at least one kind of additive signal out of image information and/or audio information which is added independently of the image signal and the audio signal, a receiving part which receives an image signal containing picture image information which is transmitted from a communication partner, and the additive signal containing the video information and/or audio information which contain additive information selected by the communication partner, and an output part which superposes the image signal transmitted from the communication partner with the additive signal transmitted from the communication partner, and outputs the superposed signal.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video telephone.

[0002]

2. Description of the Related Art In recent years, a communication terminal having a videophone function utilizing an ISDN line, line switching, or the like (referred to as a videophone device) has appeared on the market.

[0003] With remarkable progress in image compression technology and communication infrastructure, it is expected to spread in the future.
There is another problem apart from improving the infrastructure.

[0004] It is a natural usage to listen and talk while watching a videophone. In view of this, it is a natural communication method to use a so-called handset not at the ear but at a position separated from the eyes.

[0005] In this case, the voice is louder, but it is thought that the contents of the call do not want to be heard by others, and this is one factor that hinders the spread of videophones. Wearing an earphone or the like is also conceivable, but wearing an earphone is one of the forms that should be avoided in consideration of user convenience.

[0006] In addition, the videophone device enables a hearing-impaired person to communicate using gestures such as sign language.
When one or both hands are occupied, the gesture cannot be used sufficiently, and there is a problem that communication cannot be performed satisfactorily.

For example, Japanese Patent Application Laid-Open No. Hei 8-23528 discloses a video telephone which superimposes character information on a video signal and transmits the video signal. Information can be transmitted by means other than audio by adding textual information to video, but inputting textual information in a videophone device is no different from electronic mail, and it can be said that it utilizes the characteristics of videophones. Absent.

[0008]

Video telephone apparatuses are expected to be widely used because they can transmit and receive video signals in this way. However, since the video information uses the camera image as it is, the intention of the sender is described here. At present, it cannot be inserted.

The present invention has been made in view of the above points, and is a videophone device capable of easily transmitting a caller's intention using image information other than image information captured by a camera or the like. The purpose is to provide.

[0010]

According to the present invention, there is provided a receiving section for receiving an image signal containing video information and an additional signal containing image information and / or audio information containing additional information selected by the other party; An output unit for superimposing the additional signal on a signal and outputting the superposed signal (claim 1).

That is, at the time of a videophone call, the sender selects, for example, a desired image (additional image as an additional signal) from options prepared in advance and superimposes it on main video information. It is possible to incorporate image information reflecting the intention of the sender into camera imaging information.

On the other hand, on the receiving side receiving this superimposed signal,
If an output unit (a display unit such as an LCD or an audio output unit such as a speaker) is provided which superimposes an additional signal transmitted from the other party on an image signal transmitted from the other party and outputs the signal, Image display reflecting the intention of the user.

If both have similar functions, they can transmit and receive each other by reflecting their own intentions with images in addition to imaging information. That is, a camera unit for capturing an image signal; a microphone unit for capturing an audio signal; and a transmission signal including at least one additional signal of image information and / or audio information added separately from the image signal and the audio signal. A transmitting unit; an image signal containing video information transmitted from the other party and a receiving unit receiving an additional signal containing image information and / or audio information containing additional information selected by the other party; An output unit that superimposes an additional signal transmitted from the other party on the transmitted image signal and outputs the superimposed signal (claim 2).

The additional signals include image signals (moving images, still images, etc.) and voices (voice, music, sound effects, etc.) different from the speaker-captured image / speaker voice in the ordinary videophone function. No.

At the time of transmission, the additional signal can be transmitted while being superimposed with a video signal or the like, or can be transmitted by another system.

[0016]

Embodiments of the present invention will be described below.

FIG. 1 is a schematic functional diagram of the videophone device. The videophone device includes a wireless unit (1) for transmitting and receiving wireless signals to and from the outside; an input / output unit (3) for inputting / outputting voice / image / operation signals and controlling an interface function with an operator; Radio unit (1) and input / output unit (3)
And a power supply section (4) for supplying power thereto.

The radio unit 1 includes an antenna (ANT: 11) for transmitting and receiving signals to and from an external device, and a duplexer (DP).
X: 12), transmitting unit (TX: 13), receiving unit (RX: 1)
4), a synthesizer (SYN: 15). Transmission of a signal to the antenna is transmitted from the transmission unit via the duplexer, and a signal received from the antenna is transmitted to the reception unit via the duplexer.

The control unit 2 has a ROM (21) and a RAM (2)
2) connected to the main control unit (23), the control unit sends a data signal / control signal for transmitting / receiving a radio signal to the radio unit 1, and receives a necessary signal from the radio unit 1. Will be. The main controller (23) controls the entire wireless communication terminal.

The control section 2 is provided with a demultiplexing section (24) which is controlled by the main control section (23) and multiplexes and separates superimposed signals such as voice / image.

The demultiplexing section (24) separates the multimedia data received from the main control section (23) into a control section / data section / audio section / video section and the like, and separates them into the main control section (23) / Data conversion / display control unit (2
6) / Sound codec (28) / Multimedia processing unit (25).

The multimedia processing section (25) decodes the supplied video data, and supplies the reproduced image signal to the LCD control section (27).

The audio codec (28) decodes the supplied audio data, and the reproduced audio signal is supplied to a speaker and output as a loudspeaker.

The LCD control unit (27) receives the image signal supplied from the multimedia processing unit (25) and the main control unit (2).
The display data supplied from 3) is superimposed and supplied to the LCD.

The data conversion / display control unit (26) is connected to a database (DB1: 261) for storing correspondence between animations and corresponding IDs as described later, reads an animation ID from the received data, and The information of the animation to be performed
7). If the received data is character information, the display timing is determined, the information is sent to the LCD control unit (27) at the determined display timing, and the character information is displayed on the LCD.

At the time of an incoming call, a signal notifying that there is an incoming call is supplied from the main control unit (23) to the sounder driving unit (29), and the sounder is driven.

The input / output unit 3 includes a camera (CAM: 31),
Microphone (MIC: 33), key input section (KEY: 35)
Input unit, a liquid crystal display (LCD: 32), a speaker (SPEAKER: 34), and a sounder (SOUNDE).
R: 36) for transmitting and receiving signals to and from the control unit 2.

The signal from the camera (31) is supplied to a multimedia processing unit (25), and the LCD (32) outputs an LC
A display signal is supplied from the D control unit (27). Further, a signal from the microphone (33) is supplied to an audio codec (28), and a speaker (34) is supplied to the audio codec (28).
Supplies a signal. An input signal from the key input unit (35) is supplied to the main control unit (23) to instruct terminal operation,
The character information and the like supplied to the data conversion / display control unit (26) are transmitted to the LCD (3) via the LCD control unit (27).
It will be displayed in 2). In addition, a ring tone or the like receives a signal from the sounder driving unit (29) and receives a sounder (S
OUNDER: 36).

The camera (31) / microphone (33) /
The signal from the key input unit (35) is transmitted to the multiplex separation unit (2) via the multimedia processing unit (25) / speech codec (28) / data conversion / display control unit (26), respectively.
4) and multiplexed in a predetermined format.
The multiplexed transmission data is supplied from the main control unit (23) to the transmission unit (13).

The power supply section 4 includes a power supply (PS: 41) for supplying power to each functional section and a charging circuit (CH) connected thereto.
G: 42) and a battery (BAT: 43). Various functions of the videophone device are driven by the power supplied from the power supply unit 4.

Next, a specific operation using the videophone device will be described. The operation described below shows a case where the additional image selected by the sender is superimposed as an additional signal in addition to the normal imaging information.

The sender selects a desired image from options of the additional image prepared in advance. This selection may be displayed on the display screen of the videophone device, and the selection may be made by key input or the like, or the selection may be made directly by key input without displaying each time.

The input is a voice input using a microphone,
Other means than key input, such as handwriting input, screen touch input, and eye-gaze input by image processing, may be used.

As shown in the flowchart of FIG. 3, when the selection of the additional information is completed based on the information input from the key input section (KEY), the encoded video signal from the camera (CAM) is And the animation ID information obtained from DB1 by the data conversion / processing unit (26) according to the selection result of the additional information.
The data is multiplexed in 4) and transmitted from the transmission unit as transmission data.

Prior to transmission, it is preferable that a multiplexed image to be displayed on the sender side is once displayed on the user's own videophone in order to confirm the sender side. In this case, the screen of the videophone may be displayed separately on the monitor screen of the sender and the reception screen, or each may be switched and used by key input or the like.

On the other hand, on the receiving side, as shown in the flowchart of FIG. 4, the received videophone data is demultiplexed by the demultiplexing processing section (24) to separate it into a video signal and animation data. The data is decrypted by the media processing unit (25). If the received signal contains animation data, the data conversion / display control unit (26) reads predetermined animation data from the received ID from the DB1, and the video signal of this animation is sent to the LCD control unit (27). Together with the video signal decoded by the multimedia processing unit (24).
D display is performed.

By performing the above-described operation by each of the transmitting and receiving parties, a chat with an animation can be performed in addition to a normal camera image.

At this time, by displaying the received video data and the animation on separate layers, even if the video transitions to the next frame, the animation displayed on the upper layer can be controlled independently. . That is, the animation can be continuously displayed while the video changes every moment. Further, it is also possible to process by combining the same layer without using separate layers.

This animation is cleared when a command for erasing the animation is input by a key or when a new animation is received, by transmitting a clear command for the animation display layer from the main control unit to the LCD control unit. In addition, it is possible to set so as to be automatically deleted after a predetermined time has elapsed, or to set to clear the display on the receiver side. Further, a plurality of animations can be displayed simultaneously.

The animation includes a still image,
Includes various forms such as video. In the above example, ID
Although it has been described as having a database (261) for storing a conversion table of an animation,
It is also possible to directly transmit and receive image data such as a moving image and display it in a superimposed manner. Even if the database (261) is not prepared in advance, for example, ID / ID
It is also possible to insert an animation control table and convert it from an ID included in a subsequent signal by importing the table.

Further, if the information for designating the display position is sent together with the animation, the animation can be displayed at the position desired by the sender on the partner terminal. For example, it can be displayed at the center of the display screen, or can be displayed at the bottom, top, or the like of the screen.

This position information can be sent separately from the animation selection information, and the position information on the previously transmitted animation can be transmitted later.
In this case, the already transmitted animation can be moved by the other party.

When the reception of the animation information is detected on the receiver side, the animation information may be displayed immediately. However, it is also possible to inform the user of the reception detection first and wait for a display instruction from the user before displaying the information. .

The display position and size of the received data may be fixed, but the density distribution of the background imaging information,
It can also be changed automatically or according to a user's instruction according to the situation such as color distribution. When set by the user, the control on the receiver side is also possible, and when the sender also checks the transmission information on his own screen, it is possible to set it on the sender side and send it is there.

As described above, during a communication conversation using the videophone mode, the intention of the sender can be transmitted in a mode other than voice. Therefore, for example, it is possible to transmit and receive information that the user does not want to transmit or cannot transmit as voice, and the convenience of the videophone is remarkably improved.

For example, when the receiver uses a videophone while on the go, even if the third party can hear the voice, the appropriate animation is selected so that the third party cannot hear the voice. Can communicate the intention of.

Further, even in the case where the sender cannot make a voice or in the situation where the voice cannot be made, the intention of the sender and the like can be conveyed by the animation selection in addition to the imaging information of the videophone.

Further, even if the receiver has a hearing impairment, the intention of the sender can be known in addition to the video by looking at the animation information sent in addition to the image information of the videophone.

In this embodiment, an example has been described in which the additional information / additional signal is image information, but the additional information may be audio. In this case, for example, various forms such as music such as flowing as BGM of the imaging screen, sound effects such as conveying the emotion of the speaker, and the like can be taken. The sound as the additional information is output to the receiver through output means such as a sounder and a speaker. As with the image, it is also possible for the speaker to monitor before transmission. <Start / Stop of Use Mode of Superimposition Information> The above operation mode (superimposition mode) may be always ON,
It is also possible to start / interrupt / stop by some input such as key input.

For example, the control unit in the above embodiment may be provided with an activation determination unit (added as a function inside the main control unit (32)). When an instruction to activate this mode is input by a key, the operation is set to the ON state, and when an instruction to end the operation is input, the operation is set to the OFF state.

ON / OFF without special key input
It is possible to switch. For example, from the telephone directory information stored electronically, it is possible to turn on the superimposition mode when starting a videophone mode with a specific partner. Further, it is also possible to provide an option as to whether or not to turn on the superimposition mode in the use setting menu of the videophone mode, and to turn on the superimposition mode at the time of starting the use of the videophone by setting of the user. It can also be turned on when a signal to use this superimposition mode is received from the other party.

The superimposition mode is terminated by a predetermined input such as a key input for instructing termination, when the videophone mode is terminated,
This can be performed, for example, when a signal to end use of the same mode is transmitted from the other party.

Further, even when there is an input for instructing the use of the superimposition mode, the start can be prohibited. For example, if activation is instructed at the time of communication with a party not registered in the phonebook registered by the user, if the battery level is low, activation prohibition is set based on conditions such as preset use prohibited hours. It is also possible to do it. <Superimposition of Other Information> In the above embodiment, an example was described in which information such as a still image and a moving image was superimposed. However, text information and audio information can be superimposed.

At the time of transmitting the character information, after the character information is input by the user's key input, when a transmission command is input by a key input or another input method, the character information is captured by the camera by the demultiplexing unit. And multiplexed with the transmitted video. Note that the transmission command may be automatically issued after a predetermined time has elapsed after the input.

The received signal transmitted with the superimposed character information is separated by the demultiplexer, and the included character information is converted into a signal suitable for LCD display by the data converter / controller. And displayed on the LCD.

Also in this case, by displaying the character information on a layer different from the video data, it is possible to display the character information independently of the video. The display method of the text information can be set in any manner.For example, it is possible to always display the text information of the other party at the top of the screen. It is also possible for a person to display in a form surrounded by a so-called balloon.

Also, the sender can display the character information sent by the other party together with the character information created by the sender, thereby displaying the exchange state of the character information on the terminal screen of the sender.

FIG. 6 shows an example of a display screen when animation selection and character information are superimposed.

On the display screen of the sender, an animation selection screen (a) is displayed, and information on the animation selected from the animation selection screen is superimposed and transmitted. In addition, character information input separately is also superimposed and transmitted. On the receiver side, the imaging information, animation information, and character information of the sender are superimposed and displayed (b).

FIG. 6B shows the display screen of the receiver. The small screen at the lower right of FIG.
It plays the role of a monitor screen for checking the imaging state transmitted from the receiver side. For example, when the receiver enters the transmission state, it is possible to confirm the transmission data before transmission by enlarging the monitor screen.

As shown in FIG. 6C, it is also possible to insert a background image surrounding the sender's face and display it on the receiver side. In addition to being able to set the background appropriately, it can also be used as masking of an area not to be displayed.

The character information thus superimposed may be transmitted and received on the same transmission path as the video data, or may be transmitted and received on separate transmission paths.

As information to be superimposed, for example, telephone directory information (name, phonetic, phone number, mail address,
Face information). By transmitting and receiving telephone directory information in a unified format between the transmitting and receiving parties, it is also possible for the receiving party to write the information in its own telephone directory as it is or appropriately processed. <Storage of superimposed information>
Character information and the like can be stored together with the distinction of transmission / reception. Time-series information can also be stored together. This stored information can be displayed separately by a later operation.

Note that all saving may be performed automatically,
The saving may be selectively performed according to a user's instruction.

The image information according to the present invention can be encoded / decoded in accordance with standards such as MPEG4. Multiplexing may be performed according to a standard such as H.223, but is not limited thereto.

[0066]

As described above, according to the present invention, it is possible to obtain a videophone device capable of having a more visually appealing conversation by superimposing an animation or the like in addition to ordinary imaging information. .

[Brief description of the drawings]

FIG. 1 is a schematic functional diagram illustrating an embodiment of the present invention.

FIG. 2 is a diagram corresponding to an animation ID for explaining an embodiment of the present invention.

FIG. 3 is a flowchart illustrating an embodiment of the present invention.

FIG. 4 is a flowchart illustrating an embodiment of the present invention.

FIG. 5 is a display screen diagram illustrating an embodiment of the present invention.

FIG. 6 is a display screen diagram illustrating an embodiment of the present invention.

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 7/025 7/03 7/035 F term (Reference) 5C063 AA01 AB03 AC01 AC05 CA36 DA01 DA03 DA05 DA13 5C064 AA01 AC02 AC05 AC06 AC12 AC16 AD08 AD13 5K027 AA10 BB01 CC01 HH01 HH26 HH29 KK02 5K101 KK04 NN06 NN07 NN15 NN18 NN21

Claims (2)

[Claims] A receiving unit that receives an image signal containing video information and an additional signal containing image information and / or audio information containing additional information selected by a communication partner; and superimposing the additional signal on the image signal. A video phone device comprising: an output unit that outputs the video signal. 2. A camera section for capturing an image signal; a microphone section for capturing an audio signal; and a transmission signal including at least one additional signal of image information and / or audio information added separately from the image signal and the audio signal. A transmitting unit for transmitting an image signal including video information transmitted from the other party, image information including additional information selected by the other party, and / or
Or, a receiving unit for receiving an additional signal including audio information; and an output unit for superimposing and outputting an additional signal transmitted from the other party to an image signal transmitted from the other party. Video phone equipment.