KR20090084489A - Apparatus and method for video calling with portable terminal - Google Patents
Apparatus and method for video calling with portable terminal Download PDFInfo
- Publication number
- KR20090084489A KR20090084489A KR1020080010705A KR20080010705A KR20090084489A KR 20090084489 A KR20090084489 A KR 20090084489A KR 1020080010705 A KR1020080010705 A KR 1020080010705A KR 20080010705 A KR20080010705 A KR 20080010705A KR 20090084489 A KR20090084489 A KR 20090084489A
- Authority
- KR
- South Korea
- Prior art keywords
- data
- video call
- text
- mode
- voice
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 94
- 230000005540 biological transmission Effects 0.000 claims abstract description 3
- 230000006870 function Effects 0.000 claims description 47
- 238000012545 processing Methods 0.000 claims description 24
- 238000004891 communication Methods 0.000 claims description 11
- 230000004044 response Effects 0.000 claims description 10
- 230000003139 buffering effect Effects 0.000 claims description 3
- 230000004913 activation Effects 0.000 claims 1
- 238000012790 confirmation Methods 0.000 claims 1
- 230000008569 process Effects 0.000 abstract description 12
- 230000005236 sound signal Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 5
- 239000000872 buffer Substances 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000003213 activating effect Effects 0.000 description 2
- 238000012508 change request Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 1
- 238000007429 general method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2203/00—Aspects of automatic or semi-automatic exchanges
- H04M2203/25—Aspects of automatic or semi-automatic exchanges related to user interface aspects of the telephonic communication service
- H04M2203/251—Aspects of automatic or semi-automatic exchanges related to user interface aspects of the telephonic communication service where a voice mode or a visual mode can be used interchangeably
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
- H04N2007/145—Handheld terminals
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Telephone Function (AREA)
Abstract
Description
The present invention relates to a mobile terminal having a video call function. In particular, the present invention relates to a mobile terminal capable of providing a video call using text data by converting voice data received during a video call into text data. A video call method and apparatus are provided.
With the continuous development of research and technology, terminals, especially mobile terminals, go beyond the functions of telephones for voice calls, such as digital cameras, alarm functions, short text messages, multimedia messages, and e-mails. It also provides various user convenience functions such as mail and infrared communication. In addition, the user-convenience functions provided in this way are being added more and more according to the needs of users and the development of technology.
Recently, among the functions provided for user convenience, there is a video call function that makes a call while looking at each other's appearances rather than a simple voice call only. Such a video call is made by simultaneously transmitting video data input through a camera or the like together with voice data input through a microphone. Such a video call can transmit a video data to a counterpart by using real-time video streaming technology, so that the call can be seen while watching each other. In addition, with the spread of 3G services, the number of users using video calls is gradually increasing.
In the case of such a video call, a voice call is possible while looking at each other's appearance, and the output of the voice data according to the voice call is provided at a higher output than during the voice data output during a normal voice call. For example, during a video call, the mobile terminal switches to speakerphone mode to provide the voice data.
Therefore, as the voice data of the other party is provided with high power through the speaker, it causes inconvenience to the user in a place where the voice call is inconvenient. For example, as voice data output by the speakerphone mode is transmitted not only to the user but also to other people around him, there is a disadvantage in that the confidentiality of the contents of the call is difficult to be guaranteed. That is, privacy protection is difficult as the contents of the call with the other party are disclosed in the video call.
Disclosure of Invention An object of the present invention is to provide a video communication method and apparatus for a mobile terminal, which can provide various types of video call methods, rather than a general video call method.
Another object of the present invention is to provide a video communication method and apparatus for a mobile terminal which can convert and provide received voice data into text data during a video call in the mobile terminal.
It is still another object of the present invention to provide a video communication method and apparatus for a mobile terminal that can independently provide or simultaneously provide a video call in a text mode and a voice mode during a video call in the mobile terminal.
The method according to an embodiment of the present invention for achieving the above object, in the mobile terminal having a video call function, the process of checking whether the text mode is activated when the video call event occurs, and by the text mode Converting the voice data received during the video call into text data; and outputting the text data together with the video data received in response to the video call.
A method according to an embodiment of the present invention for achieving the above object, in a mobile terminal having a video call function, the process of confirming the video call method is set when the video call event occurs, and the video call method is a character Converting the received voice data into text data when the mode is set, and processing a video call by the text data and video data; and video call by the received voice data and video data when the video call method is set to the voice mode. And converting the received voice data into the text data when the video call method is set to the voice mode and the text mode, and processing the video call by the text data, the voice data, and the image data. .
An apparatus according to an embodiment of the present invention for achieving the above object, in the portable terminal, and the radio frequency unit for transmitting and receiving video data and voice data corresponding to the video call by forming a communication channel with a wireless network and; The audio processing unit outputs the received voice data through the speaker during the video call in the voice mode, and removes the output of the received voice data during the video call in the text mode, and at least one application and user data necessary for the operation of the video call function. And a memory unit for buffering and providing voice data transmitted according to a video call, a camera unit for receiving and processing image data of a user during a video call, and at least one video call. Display image data and display text data together with the at least one image data. And a display unit to convert the received voice data into text data when performing a video call in the text mode, and output the text data together with the image data through any one of a pop-up frame and a text input frame. And a control unit for controlling the video call in the mode.
As described above, according to the video call method and apparatus of the mobile terminal proposed by the present invention, it is possible to improve the user's satisfaction by providing various types of video call methods other than the general video call method in the mobile terminal. In addition, the mobile terminal has an effect of maximizing the use and satisfaction of the user's mobile terminal by independently providing or simultaneously providing the video call in the text mode and the voice mode during the video call.
In addition, according to the present invention, by converting the received voice data into text data when providing a video call in the mobile terminal, there is an effect that can keep the contents of the call confidential.
Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, only the parts necessary for understanding the operation according to the embodiment of the present invention will be described, it should be noted that the description of other parts will be omitted so as not to distract from the gist of the present invention.
The terms or words used in the specification and claims described below should not be construed as being limited to ordinary or dictionary meanings, but should be construed as meanings and concepts corresponding to the technical spirit of the present invention. And the embodiments described in the specification and the configuration shown in the drawings are only one of the most preferred embodiment of the present invention, not representing all of the technical idea of the present invention. Therefore, it should be understood that there may be various equivalents and modifications that can substitute for them at the time of the present application.
The present invention relates to a video call method and apparatus for a mobile terminal, and more particularly, to a video call method of a mobile terminal for converting and providing voice data transmitted from a counterpart mobile terminal into text data when performing a video call in the mobile terminal. And to an apparatus.
According to an embodiment of the present invention, when the video call in the text mode, the received voice data along with at least one video data (transmitted video data, received video data) is converted into text data and output to the display unit, and the video call in the voice mode is performed. Outputting at least one video data to a display unit and outputting received voice data to a speaker, and converting at least one video data, received voice data, and text data converted from the received voice data during a video call in text mode and voice mode. All can be provided.
Provided are a video call in a text mode and a video call in a voice mode, and a portable terminal implementing the same.
1 is a schematic block diagram of a portable terminal according to an exemplary embodiment of the present invention.
As shown in FIG. 1, the
Referring to FIG. 1, the
The
The
The
The application is an application for activating / deactivating a function for converting voice data transmitted from a counterpart mobile terminal into text data in response to a video call event, i.e., processing a mode switch between the voice mode and the text mode of the present invention, and performing a video call. The application may be an application for converting the voice data transmitted according to the text data into text data, an application for processing the text data to be converted to the
The
In addition, the
Particularly, when there is a character input / output request during a video call, the image processor of the present invention distinguishes and provides a video data frame for outputting image data and a text data frame (popup frame, character input frame) for outputting the character data. Can be. The image processor may include a frame buffer for storing image data input through the
The
The
In particular, the
The
The
The
In addition, the
Meanwhile, FIG. 1 illustrates a schematic configuration example of a
In the above, the configuration and operation of the control means and the portable terminal including the same according to an embodiment of the present invention have been described. Next, the video call method of the present invention performed by the mobile terminal will be described. However, the present invention is not limited to the contents described below, it should be noted that it can be applied to various embodiments based on the following embodiments.
2 is a flowchart illustrating a video call method in a portable terminal according to an embodiment of the present invention.
1 and 2, when a video call event occurs (step 201), the controller checks whether the function of the present invention is activated (
Next, when the controller recognizes that the text mode function is activated, the controller may notify the user of information on the set mode (text mode) (step 207). That is, the controller may notify that the text mode is set through an audio signal, a screen signal, or a combination thereof. The audio signal may include a voice signal, a beep sound, and the screen signal may include a message provided in a popup form.
Next, the controller notifies whether the text mode function is activated and then checks whether there is a mode switch request (step 209). If there is a mode switch request, the controller switches the text mode to the voice mode and processes a general video call in the voice mode (step 219). On the other hand, if there is no mode change request, the controller processes the video call in the text mode (step 211).
First, the control unit converts the received voice data from the counterpart mobile terminal into text data during the video call in the text mode (step 213), and then outputs the converted text data according to the set output method (step 215). ). In this case, the text data conversion may be performed using a text data conversion function after buffering the received voice data. Alternatively, the received voice data may be directly converted by the text data conversion function.
The text data conversion function may utilize a text to speech (TTS) function that converts voice data into text data. In addition, the output of the character data may be provided in various ways according to a setting method, which will be described with reference to FIGS. 3 to 4b to be described later.
Next, when the controller detects the mode switch request during the video call in the above-described text mode (step 217), the controller may switch the text mode to the voice mode and process the video call in the voice mode ( Step 219). When the video call is terminated by the user or the mobile terminal (step 221), the controller terminates the above-described operation. In addition, when the termination is not completed, the controller may perform a corresponding operation corresponding to the text mode or the voice mode (step 223). In this case, it is also possible to maintain the mode used at the end time and to apply the initial mode when the next video call event occurs.
On the other hand, if it is recognized in
Next, the controller notifies the voice mode and checks whether there is a mode switch request (step 233). If there is a mode change request, the controller switches the voice mode to the text mode (step 237) and proceeds to step 211 to process the video call in the text mode. On the other hand, if there is no mode switch request, the controller processes the video call in the voice mode (step 235).
Meanwhile, although omitted in FIG. 2, the present invention provides the output of the received voice data along with the text data or removes the output of the received voice data according to a setting method when controlling a video call in the text mode. Only character data can be provided.
3 is a flowchart illustrating a text data output method when performing a video call according to an exemplary embodiment of the present invention, and FIGS. 4A and 4B illustrate screen examples according to the text data output method of the present invention.
3 to 4B, the controller may first check an output method set before outputting the text data (step 301).
First, if it is recognized in
As shown in FIG. 4A,
Next, if it is recognized in
As illustrated in FIG. 4B,
On the other hand, as described above, in the embodiment of the present invention has been described with the video call method according to the text mode and voice mode, the present invention is not necessarily limited thereto. Therefore, according to the present invention, it is a matter of course that the video call can be provided by simultaneously supporting the text mode and the voice mode and providing the voice data and the text data according to the setting method. In this case, the controller may provide the image data and the audio data transmitted from the counterpart portable terminal through the display unit and the speaker, and convert the voice data into text data and provide the image data to the display unit together with the image data.
In addition, the embodiment of the present invention has been described with respect to the video call method through the text mode according to whether the function of the present invention is activated. In addition, according to an embodiment of the present invention, the controller may adaptively control the switching between the text mode and the voice mode in response to the surrounding environment to provide a video call. For example, the controller may automatically control the video call mode to the text mode when it determines that the surrounding environment is external, and automatically control the video call mode to the voice mode when it determines that it is internal. This determination may be made through measurement of ambient noise, ambient brightness, and the like. To this end, the mobile terminal of the present invention may further include a sensor for measuring noise or measuring brightness.
In addition, the embodiment of the present invention may further include a function of notifying the counterpart portable terminal of the mode information set in the portable terminal or the mode information changed by the mode switching when the video call is performed. The notification may be delivered using a designated message when a video call event occurs and when all transitions are made.
As described above, in the detailed description of the present invention has been described with respect to specific embodiments, various modifications are possible without departing from the scope of the invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the claims below, but also by the equivalents of the claims.
1 is a schematic block diagram of a portable terminal according to an embodiment of the present invention;
2 is a flowchart illustrating a video call method in a mobile terminal according to an embodiment of the present invention;
3 is a flowchart illustrating a method of outputting character data when performing a video call according to an embodiment of the present invention;
4A and 4B are diagrams showing screen examples according to the character data output method of the present invention.
Claims (24)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020080010705A KR20090084489A (en) | 2008-02-01 | 2008-02-01 | Apparatus and method for video calling with portable terminal |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020080010705A KR20090084489A (en) | 2008-02-01 | 2008-02-01 | Apparatus and method for video calling with portable terminal |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20090084489A true KR20090084489A (en) | 2009-08-05 |
Family
ID=41205038
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020080010705A KR20090084489A (en) | 2008-02-01 | 2008-02-01 | Apparatus and method for video calling with portable terminal |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20090084489A (en) |
-
2008
- 2008-02-01 KR KR1020080010705A patent/KR20090084489A/en not_active Application Discontinuation
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR100678206B1 (en) | Method for displaying emotion in video telephone mode of wireless terminal | |
EP2364000B1 (en) | Method for controlling a camera mode in a portable terminal | |
KR100701519B1 (en) | Mobile Communication Terminal and Method capable of outputting selectively converting Short Message Service Message to voice sound according to a movement speed | |
KR20080002343A (en) | Method and apparatus for screen partition as receiving broadcast signal with a mobile terminal | |
KR100735290B1 (en) | Method for controlling image?in video telephone mode of wireless terminal | |
US20060293070A1 (en) | Mobile terminal and method for processing messages apparatus | |
KR20060127304A (en) | Method for performing call in wireless terminal | |
KR100547741B1 (en) | Speaker device of mobile terminal | |
KR100584390B1 (en) | Method for performing camera function in mobile communication terminal | |
KR20070012062A (en) | Method for performing presentation in video telephone mode of wireless terminal | |
KR100703462B1 (en) | Method for changing image attach mode in wireless terminal | |
KR100996251B1 (en) | Method for informing a state of portable terminal | |
JP2006157650A (en) | Television intercom system | |
KR20090084489A (en) | Apparatus and method for video calling with portable terminal | |
KR100557096B1 (en) | Method for displaying data in wireless terminal with both camera | |
KR100606092B1 (en) | Method for preventing howling in wireless terminal | |
KR20060136235A (en) | Method for performing call in wireless terminal | |
KR20070000265A (en) | Method for performing call in wireless terminal | |
KR20070044426A (en) | Method for controlling image in video telephone mode of wireless terminal | |
KR20090080774A (en) | Method and Apparatus for sending a text message during video calling with a terminal | |
KR100689409B1 (en) | Method for displaying data in external display unit of wireless terminal | |
KR100713438B1 (en) | Method for calling between wireless terminal and headset | |
JP2005348006A (en) | Video telephone system having character display function and voice character conversion display method in video telephone system | |
KR100678030B1 (en) | Method for performing automatic response function in mobile communication system | |
KR100547807B1 (en) | How to send a message from your mobile device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WITN | Withdrawal due to no request for examination |