KR20090080774A - Method and Apparatus for sending a text message during video calling with a terminal - Google Patents

Abstract

A method for transmitting a short message during a video call in a terminal and an apparatus thereof are provided to send the short message without the additional traffic required for the message transmission by making an image of character information which is desired to be inputted to a portion of image data to be transmitted, and then transmitting it. A method for transmitting a short message during a video call in a terminal comprises the following steps of: receiving a short message; converting the message into an image data frame(character frame) in case transmission of the message is requested; synthesizing the character frame with an image frame(401); and then transmitting the synthesized frame to the other party.

Description

Method and Apparatus for sending a text message during video calling with a terminal}

The present invention relates to a video call in a terminal, and more particularly, to a method and apparatus for transmitting a text message during a video call.

With the continuous development of research and technology, terminals, especially portable terminals, go beyond the functions of a telephone for voice calls, such as digital cameras, alarm functions, short text messages, multimedia messages, and e-mails. It also provides various user convenience functions such as mail and infrared communication. In addition, these provided user convenience functions are being added more and more according to the needs of the user and the development of technology.

Recently, among the functions provided for user convenience, there is a video call function that makes a call while looking at each other's appearances rather than a simple voice call only. Such a video call is made by simultaneously transmitting video data input through a camera or the like together with audio data input through a microphone or the like. Video calls that transmit video data to the other party using real-time video streaming technology must transmit video data that is more constrained than voice data, such as the size of the transmitted data. You can get a lot.

Meanwhile, another user convenience function is a text message service for transmitting and receiving text messages instead of a voice call, in particular, a short message service (SMS) for transmitting and receiving short text messages. The text message service is a function that is widely used by users because it is possible to communicate the user's intentions in a situation where a voice call is impossible or without directly attempting a call with the other party, and a low rate.

A user who is accustomed to using the text message service may wish to transmit a text message during a video call with the other party, or to communicate by text instead of voice when a voice call is not possible. However, in this case, according to the conventional method, after ending the video call in communication with the other party, the text message application must be driven and transmitted, which causes inconvenience to the user when transmitting the text message during the video call. Accordingly, there is a need for a method of using a text message service without inconvenience during a video call.

Accordingly, the present invention provides a method and apparatus for transmitting a text during a video call in a terminal.

According to one aspect of the preferred embodiment of the present invention, the method of transmitting a text during a video call in the terminal of the present invention comprises the steps of checking whether there is a request to activate the text input window during the video call, and if there is a request to activate the text input window A process of activating an input window, receiving a text from a user in the activated text input window, and converting the input text into an image data frame (text frame) when there is a request for transmission of the input text. And synthesizing the text frame with a video frame for a video call, and transmitting the synthesized frame to the counterpart in the video call. The synthesized frame includes a first area and a second area, the first area includes a corresponding portion of the video frame for the video call, and the second area includes the text frame.

According to another aspect of the preferred embodiment of the present invention, a text transmission device during a video call in the terminal of the present invention, the camera unit for photographing the image for the video call, the input unit for receiving a text input from the user, the text input during the video call When there is a window activation request, after receiving a text input in the activated text input window, if there is a request for transmission of the received text, the input text is converted into a video data frame (text frame), and the video call with the text frame. And a display unit for displaying an image for the video call and the text input window.

The foregoing has outlined rather broadly the features and technical advantages of the present invention in order that those skilled in the art may better understand it from the following detailed description of the invention. In addition to these features and advantages, further features and advantages of the present invention which form the subject of the claims of the present invention will be better understood from the following detailed description of the invention.

According to the present invention, when a voice call is difficult or a text message is to be transmitted during a video call, a smooth message can be expressed by transmitting a text message together with image data. By texting and combining the text information to be input to a part of the image data to be transmitted, the text message can be transmitted without adding additional traffic due to the text transmission.

DETAILED DESCRIPTION A detailed description of preferred embodiments of the present invention will now be described with reference to the accompanying drawings. Those skilled in the art will recognize that the disclosed concept and specific embodiments of the invention described below may be changed or modified to achieve the technical problem to be achieved by the present invention. Those skilled in the art will also recognize that concepts and structures equivalent to the concepts and structures disclosed herein do not depart from the spirit and scope of the broadest form of the invention. It should be noted that reference numerals and like elements among the drawings are denoted by the same reference numerals and symbols as much as possible even though they are shown in different drawings. In the following description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

1 is a view showing a schematic configuration of a portable terminal according to a preferred embodiment of the present invention. 1 illustrates a configuration of a general portable terminal for convenience of description, it should be noted that the terminal of the present invention may be any terminal that can provide a text message service while providing a video call with a camera or the like.

Referring to FIG. 1, the portable terminal includes a wireless unit 110, a controller 120, a camera unit 130, an image processor 140, a display unit 150, an input unit 160, a memory 170, and an audio processor ( 180). The wireless unit 110 performs a wireless communication function of the portable terminal. The wireless unit 110 may include a frequency transmitter for upconverting and amplifying a frequency of a transmitted signal, and a frequency receiver for low noise amplifying and downconverting a received signal. The controller 120 controls overall operations of the mobile terminal. In addition, the controller 120 may include functions of a transmitter for encoding and modulating a transmitted signal and a receiver for demodulating and decoding a received signal. That is, the controller 120 may include a modem (MOdulator / DEModulator: MODEM) and a codec (COder / DECorder: CODEC). In particular, according to an embodiment of the present invention, the control unit 120 controls a video call, converts a text message input during the video call into video data, synthesizes the video message for the video call, and transmits it to the counterpart.

The camera unit 130 converts light (light) input through a camera lens (eg, a charge coupled device (CCD), a complementary metal-oxide semiconductor (CMOS)) into digital data. In other words, the camera unit 130 may include a camera sensor for converting an input optical signal into an electrical signal, and a signal processing unit for converting an analog image signal photographed from the camera sensor into digital data. In addition, the signal processor may be implemented as a digital signal processor (DSP). The camera sensor and the signal processor may be integrally implemented or may be implemented separately. The image processor 140 processes screen data for displaying an image signal output from the camera unit 130. The image processor 140 processes the image signal output from the camera unit 130 in units of frames, and outputs frame image data processed in units of frames according to the characteristics and sizes of the display unit 150. In addition, the image processor 140 includes an image codec and performs a function of compressing the frame image data displayed on the display unit 150 in a set manner or restoring the compressed frame image data to the original frame image data. When there is a text input request during a video call, the image processing unit 140 scans a predetermined portion of the frame image data and an image of the text input window itself in which the text is input, and the same format as that of the frame image data. The new frame image data is generated by synthesizing the character image data converted to (Format) (hereinafter, used interchangeably with 'character frame') into the remaining portions of the predetermined portion of the frame image data. In addition, the image processor 140 may include a frame buffer 145 for storing frame image data input through the camera unit 130 and processed in units of frames. When the character frame is generated, it is synthesized with the frame image data stored in the frame buffer 145. A detailed description will be described with reference to FIG. 2. The display unit 150 displays the image data output from the image processing unit 140 on the screen, and displays the user data output from the control unit 120. The display unit 150 may use a liquid crystal display (LCD). In this case, the display unit 150 may include an LCD controller, a memory capable of storing image data, an LCD display device, and the like. . In this case, the LCD may be operated as an input unit when the LCD is implemented in a touch screen manner.

The input unit 160 may include keys for inputting numeric and text information and function keys for setting various functions. The memory 170 may include program memory and data memories. The program memory may store programs for controlling general operations of the portable terminal. The data memory temporarily stores data generated while executing programs. In addition, the memory 170 stores in advance replacement image data that may replace an image input through the camera when the image cannot be displayed during a video call or by a user's request. The audio processor 180 includes an audio codec for converting audio data into an analog audio signal, outputting the same through a speaker (SPK), and converting an analog audio signal input through a microphone (MIC) into audio data. .

2 is a flowchart illustrating a process of generating image data synthesized with a text message according to a preferred embodiment of the present invention.

Referring to FIG. 2, the controller 120 of FIG. 1 checks whether there is a request for a text message service from the user, that is, an input window for inputting a character, in step 210 during a video call with the counterpart in step 205. do. In this case, the request for activating the text input window may be performed by a key input preset at the time of manufacture of the portable terminal or by a key input set by the user according to user convenience. The user may set a shortcut key for executing the text input window for convenience, and instead of going through a plurality of steps by inputting the set shortcut key, the user may immediately execute the text input window. Since the shortcut key setting is not the gist of the present invention, a detailed description thereof will be omitted. In addition, when a video cannot be displayed during a video call or a user request, the controller 120 performs a video call by using replacement image data that can replace an image input through a camera. If there is a request for activating the text input window, the control unit 120 proceeds to step 215. Otherwise, the control unit 120 returns to step 205 to continue the video call. In step 215, the controller 120 activates the text input window. In step 220, the controller 120 receives text from the user in the activated text input window. Here, the character is a concept including all symbols that can be input through the input unit 160 to convey a doctor, such as English alphabet (Alphabet), Korean consonants and vowels, numbers. In step 225, the controller 120 checks whether there is a request for transmission of the text input from the user. In other words, the controller 120 checks whether there is an input indicating that the character input to be transmitted to the counterpart is completed. In this case, an input for notifying completion of character input may be input of a specific key, for example, an 'OK' key. The specific key may be set at the time of manufacture as a preset key or may be set by a user. If there is an input of a key indicating completion of the character input, the controller 120 proceeds to step 230; otherwise, the control unit 120 returns to step 220 and continuously receives a character input from the user.

In step 230, the controller 120 scans the characters input in the character input window and converts the characters into an image data frame. In step 235, the controller 120 combines the converted frame with a frame of image data stored in the frame buffer 145 after being input and processed through the camera unit 130. The synthesis of these frames will be described in detail with reference to FIG. 3.

3A and 3B are diagrams illustrating a process of synthesizing a text message to image data according to an embodiment of the present invention.

Referring to FIG. 3A, the controller 120 scans an image of a text input window itself into which text is input and converts the image into a frame having the same format as the image data input from the camera unit 130. Create In this way, the character input window is converted into a frame having the same format as the image data to generate a frame such as Frame A 301. The frame B 302 is an image data frame input through the camera unit 130 and stored in the frame buffer 145. Frame A and Frame B are combined together with Frame C (303). In other words, frame C 303 is generated by combining frame A 301 with the remaining portion excluded from frame B 302 by the size of frame A 301. In this case, when there is no image data input through the camera, the controller 120 generates the frame B 302 using the substitute image data stored in the memory 170 and then synthesizes the frame A 301 as described above. Generate C 303.

FIG. 3B is a diagram illustrating an example of synthesis in the method of FIG. 3A. A frame A 301 converted from a text input window in which a character “Hello!” Is inputted and frame B 302 which is photographed image data are synthesized. Frame C 303 is generated.

2, in step 240, the controller 120 transmits the image data obtained by combining the character frame and the captured image frame to the counterpart. In step 245, the controller 120 checks whether there is an input for notifying the end of the character input. In this case, the input for notifying the end of the character input may be performed by a specific key, for example, an end key input. In addition, when there is an input for notifying the termination, the controller 120 may display a message such as a popup for confirming termination on the display unit 150 and then confirm the termination by receiving a user's selection. If there is an input for notifying the end of the character input, the controller 120 terminates, otherwise, the control unit 120 returns to step 220 to continue receiving the character input from the user. As described above, the present invention has been described as synthesizing with a video frame for a video call by scanning a text input window when there is a key input requesting text transmission, but after scanning a text input window for a text message every set time, Of course, it can be changed according to the setting such as synthesis.

4A, 4B, 4C, and 4D are diagrams illustrating screens of a process of transmitting a text message during a video call according to an embodiment of the present invention.

4A illustrates an example of a screen in which a user of a mobile terminal capable of converting a text input window into an image data frame and having a video call with the other party. As shown by reference numeral 401 of FIG. 4A, the other side of the user is displayed on the display unit 150 of FIG. As shown by reference numeral 402 of FIG. 4A, the user's appearance may be displayed on the display unit 150. When a voice call is difficult or a text message is transmitted during a video call, a text input window may be activated by inputting a text input window activation request from the user. FIG. 4B confirms a text input request. Figure 4c is an exemplary view of the screen, Figure 4c is an example of receiving a letter 'Hello!' From the user is activated by the text input window by the request. If there is an input to inform the text transmission after inputting the text 'Hello!' As shown in FIG. 4C, the user scans the input window 403 in which the text 'Hello! It transmits by composing with frame of captured image data. When the transmitted frame is displayed on the display unit, it is as shown in FIG. 4D. 4D is an exemplary view of a screen displayed on a mobile terminal of the other party. As shown in FIG. 4D, the other party may receive the intention of the user using only the information displayed on the screen. Herein, for convenience of description, the text frame is converted to a text frame in which the text input window is converted at the bottom of the synthesized frame. However, the text frame may be variously modified. Of course. In this way, the present invention enables smooth communication using text even when a voice call is difficult during a video call.

Meanwhile, in the detailed description of the present invention, specific embodiments have been described, but various modifications are possible without departing from the scope of the present invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the scope of the following claims, but also by those equivalent to the scope of the claims.

1 is a diagram showing a schematic configuration of a portable terminal according to a preferred embodiment of the present invention.

2 is a flowchart illustrating a process of generating image data synthesized with a text message according to a preferred embodiment of the present invention.

3A and 3B illustrate a process of synthesizing a text message with image data according to an embodiment of the present invention.

4A, 4B, 4C, and 4D illustrate screens of a process of transmitting a text message during a video call according to an embodiment of the present invention.

Claims (15)

In the text transmission method during the video call in the terminal, Receiving text from the user, Converting the input text into an image data frame (text frame) when there is a transmission request for the input text; Synthesizing the text frame with a video frame for a video call; And transmitting the synthesized frame to the counterpart in the video call. The method of claim 1, wherein the converting to the character frame comprises: And scanning the input text. The method of claim 1, wherein the converted text frame is a frame having the same format as the video frame for the video call. The method of claim 1, further comprising: checking whether there is a request for activating a text input window during the video call before receiving text from a user; And if the text input window is activated, further comprising activating the text input window. The method of claim 1, wherein the synthesized frame, A first area and a second area, wherein the first area comprises a corresponding part of the video frame for the video call, and the second area consists of the text frame. Way. The method of claim 5, wherein the size and location of the first area and the second area are preset. The method of claim 1, wherein the video frame for the video call is a video data frame input through a camera or a pre-stored video data frame. In the text transmission device during a video call in the terminal, A camera unit for photographing a video call; An input unit for receiving character input from a user, And a control unit for converting a text input through the input unit into a video data frame (text frame) and synthesizing the text frame with a video frame for a video call. The method of claim 8, And a display unit which displays a video and text input window for a video call. The method of claim 8, wherein the control unit, And, when there is a transmission request for the received text, scanning the text input window. The apparatus of claim 8, wherein the converted text frame has a frame having the same format as the video frame for the video call. The method of claim 8, wherein the synthesized frame, A first area and a second area, wherein the first area comprises a corresponding part of the video frame for the video call, and the second area consists of the text frame. Device. The apparatus of claim 12, wherein sizes and positions of the first region and the second region are preset. The method of claim 8, wherein the control unit, And transmit the synthesized frame to the counterpart in the video call. The apparatus of claim 8, wherein the video frame for the video call is a video data frame input through the camera unit or a pre-stored video data frame.

Images