KR100797120B1 - Method for transmitting and receiving data in portable terminal capable of video telephony - Google Patents

Abstract

A data transceiving method of a portable terminal for a video call is provided to be capable of transmitting a video stream by attaching a user's video stream data when a video call is conducted, thus limited resources of wireless communication can be efficiently used, consequently utility of the terminal is increased. User data is selected(S401,S403). A video stream for a video call is obtained through a camera unit of a portable terminal. A surplus space of preset data size is generated in the video stream(S405). The user data is attached to the surplus space(S407). Control data including an indicator having the attached user data information is generated(S409). The video stream and the control data are multiplexed and transmitted(S411-S415).

Description

Method for transmitting and receiving data in portable terminal capable of video telephony}

1 is a diagram illustrating an example of a screen displayed on a display unit of a mobile terminal for a video call during a general video call;

2 is a view schematically showing each configuration of a mobile terminal for a video call according to an embodiment of the present invention.

3 is a diagram illustrating the internal configuration of a mobile terminal controller for a video call according to an embodiment of the present invention for each functional block;

4 is a diagram illustrating a data transmission method of a mobile terminal for performing a video call according to an embodiment of the present invention.

5A to 5D are screen examples for explaining a method of attaching user data of a mobile terminal performing a video call according to an embodiment of the present invention.

6A to 6B are screen examples illustrating a data transmission method of a mobile terminal for performing a video call according to an embodiment of the present invention.

7 is a view for explaining a data receiving method of a mobile terminal according to an embodiment of the present invention.

8 is a screen example for explaining a data receiving method according to an embodiment of the present invention.

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data transmission / reception method of a mobile terminal, and more particularly, to a data transmission / reception method of a video call mobile terminal capable of sending data to a video stream transmitted and received for a video call.

The video call service is a service of looking at the other party through a mobile terminal equipped with a camera and may be classified into a circuit switching method using a switch and a packet switching method using an all-IP network. Such video call service should implement H.323 or H.324M protocol, an international standard defined by the International Telecommunication Union (ITU), in a mobile communication system. H.323 is a system protocol that provides video telephony service in IP (Internet Protocol) network, which is a packet data network, H.324 is a system protocol developed based on public network, and H.324M (Mobile) is H.324. Has been improved for mobile communication.

1 illustrates an example of a screen displayed on a display unit of a mobile terminal during a general video call.

As shown, an image displayed on a display unit of a mobile terminal during a video call is divided into two image display regions 110 and 120, and each image display region is a camera of a mobile terminal of one's or the other's mobile terminal according to a user's setting. The additional acquired image is displayed. In general, an image acquired by the counterpart camera unit is displayed on the large image display area 110. In such a video conversation, a video call can be performed without any difficulty even if the image of the edge portion 115 is not transmitted. In order to efficiently use the limited resources of wireless communication, the use of this area is required.

Accordingly, an object of the present invention is to provide a method for transmitting and receiving user data to more efficiently use the limited resources of wireless communication in transmitting data during a video call.

According to a preferred embodiment of the present invention, there is provided a data transmission method of a video call mobile terminal, the method including selecting user data, acquiring a video stream for the video call, Generating a surplus space having a preset data size, attaching the user data to the surplus space, generating control data including an indicator having the attached user data information, the video stream and control And multiplexing the data.

The generating of the predetermined surplus space in the video stream may include deleting data corresponding to a predetermined edge region of each frame of the video stream.

The indicator preferably includes information about the size of the redundant area of the video stream, the type of user data, and the attachment location of the user data in the video stream.

According to an aspect of the present invention, there is provided a method of receiving data in a video call mobile terminal, the method including receiving a bit stream for the video call, demultiplexing the bit stream, and controlling a video stream and controlling the video stream. Extracting data, determining whether user data is attached to the redundant area of the video stream with reference to the indicator of the control data, and if the user data is attached as a result of the determination, decoding the video and audio stream And extracting the user data.

The method may further include displaying the video stream on a display unit of the portable terminal, and displaying an arbitrary region of an edge of the video stream using a pre-stored image.

And outputting audio data in synchronization with the video data to perform a video call.

As a result of the determination, if the user data is not attached, decoding the video and audio data, displaying the video data on a display unit of the portable terminal, and outputting audio data in synchronization with the video data, perform a video call. The process further includes.

The indicator includes information on the size of a predetermined surplus space of the video stream, the type of user data, and the attachment position of the user data in the video stream.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, only the parts necessary for understanding the operation according to the embodiment of the present invention will be described, it should be noted that the description of other parts will be omitted so as not to distract from the gist of the present invention.

The terms or words used in the specification and claims described below should not be construed as being limited to the ordinary or dictionary meanings, and the inventors are appropriate to the concept of terms in order to explain their invention in the best way. It should be interpreted as meanings and concepts in accordance with the technical spirit of the present invention based on the principle that it can be defined. Therefore, the embodiments described in the specification and the drawings shown in the drawings are only one of the most preferred embodiments of the present invention, and do not represent all of the technical idea of the present invention, various modifications that can be replaced at the time of the present application It should be understood that there may be equivalent water and variations.

In addition, in the embodiment of the present invention, the mobile terminal will be described using a mobile communication terminal as an example, but the present invention is not limited thereto. That is, the portable terminal according to an embodiment of the present invention is a terminal capable of a video call, preferably a mobile communication terminal, a digital broadcasting terminal, a personal digital assistant (PDA), a smart phone, an IMT. Applicable to all information communication devices and multimedia devices such as International Mobile Telecommunication 2000 (WTDMA) terminals, Wideband Code Division Multiple Access (WCDMA) terminals and Universal Mobile Telecommunication Service (UMTS) terminals, and applications thereof. will be.

First, a portable terminal for carrying out the present invention by the above-described portable terminal will be described. 2 is a view schematically showing each configuration of a mobile terminal for video call according to an embodiment of the present invention, Figure 3 is a view showing the internal configuration of the mobile terminal control unit for video call according to an embodiment of the present invention for each functional block to be.

Referring to FIG. 2, the portable terminal according to an exemplary embodiment of the present invention includes a wireless communication unit 210, an audio processor 220, an input unit 230, a display unit 240, a camera unit 250, a storage unit 260, And a controller 270.

The wireless communication unit 210 is in charge of a wireless transmission and reception function for a video call. For this function, the wireless communication unit 210 performs a low frequency amplification of a radio frequency (RF) transmitter for up-converting and amplifying a frequency of a transmitted video call bit stream, and a low noise amplification of the received video call bit stream. And it may include a radio frequency receiver for converting the frequency down.

The audio processor 220 plays a function of playing an audio stream output from the controller 270 or transmitting an analog signal such as a voice input from a microphone MIC to the controller 270. This is done using a converter. In detail, the audio processor 220 converts the audio stream into an audible sound through the speaker SPK under the control of the controller 270 and outputs the audio stream. That is, the digital audio stream is converted into an analog audio stream and output. In addition, the voice / sound received from the microphone MIC is converted into a digital audio stream and transmitted to the controller 270.

The input unit 230 includes a plurality of input keys and function keys for receiving numeric or character information and setting various functions. The function key may include a direction key, a side key and a shortcut key set to perform a specific function. In addition, the input unit 230 transmits a key signal input in relation to user setting and function control of the portable terminal to the controller 270.

The display unit 240 displays a video stream output from the image processing apparatus on a screen, or displays a video stream received from the controller 270 on a screen. The display unit 240 visually provides a menu of the portable terminal, user data input by the user, function setting information, and various information to the user. In addition, the display unit 240 displays a video stream according to an embodiment of the present invention. The display unit 240 may be formed of a liquid crystal display (LCD). In this case, the display unit 240 may include a control device for controlling the liquid crystal display, a memory capable of temporarily storing a moving image file, and a liquid crystal display device. If the LCD is formed in the form of a touch screen, the display unit 240 may perform some or all of the functions of the input unit 230.

The display unit 240 displays a video stream output from the image processing apparatus on a screen, or displays a video stream received from the controller 270 on a screen. The display unit 240 visually provides a menu of the portable terminal, user data input by the user, function setting information, and various information to the user. In addition, the display unit 240 displays a video stream according to an embodiment of the present invention. The display unit 240 may be formed of a liquid crystal display (LCD). In this case, the display unit 240 may include a control device for controlling the liquid crystal display, a memory capable of temporarily storing a moving image file, and a liquid crystal display device. If the LCD is formed in the form of a touch screen, the display unit 240 may perform some or all of the functions of the input unit 230.

The camera unit 250 is for providing a camera function which is an additional function of the portable terminal. The camera unit 150 includes a camera (not shown), a signal processing device (not shown), and an image processing device (not shown). The camera captures a video stream and has a camera sensor that converts the photographed optical signal into an electrical signal. In this case, the camera sensor is preferably a CCD sensor. The signal processing apparatus converts the analog video stream output from the camera into a digital video stream. In this case, the signal processing device is preferably implemented by a digital signal processor (DSP). The image processing apparatus performs a function of generating screen data for displaying a video stream output from the signal processing apparatus. The image processing apparatus transmits the received video data according to the standard of the display unit 240 under the control of the controller 270, and also compresses and decompresses the video data. In particular, the signal processing apparatus may include the video codec used in the embodiment of the present invention to encode the digital video data converted therein and transmit the encoded digital video data to the controller 270. Here, the video codec preferably encodes video data according to the H.261 or H.263 method.

The storage unit 260 stores an application program and data according to the function operation according to an embodiment of the present invention. The storage unit 260 may include one or more buffers that temporarily store data generated while an application program is executed. The storage unit 260 may include a program area and a data area. The program area stores an operating system (OS) for booting the portable terminal, other option functions of the portable terminal, such as an application program required for a camera function, a sound playback function, an image or video playback function, and the like. When activating each function according to a user request, each function is provided through corresponding application programs under the control of the controller 270. The data area is an area in which data generated according to the use of the mobile terminal is stored, and can store various contents such as audio data such as still images, moving images, music, and sound sources. In particular, it stores a substitute image according to an embodiment of the present invention.

The controller 270 controls the overall operation of the portable terminal and the signal flow between the internal blocks of the portable terminal. That is, the controller 270 controls the signal flow between the components of the audio processor 220, the input unit 230, the storage unit 260, the camera unit 250, and the display unit 240.

Referring to FIG. 3, the controller 270 includes a user data processor 271, a video codec 272, an audio codec 273, a control signal processor 274, a mux / demux, and a multiplexer. / demultiplexer) 275 and a modem (MODEM) 276.

The user data processor 271 attaches the user data to the video stream at the time of transmission, and extracts the user data from the video stream at the time of reception. In detail, the user data processor 271 receives the video stream and the user data to provide a surplus area in a portion of the video stream. The user data is attached to the surplus area and output to the video codec 272. The excess area can be obtained by deleting data of the border area of each frame constituting the video stream. In addition, the surplus region may be obtained by resizing and down-scaling each frame. At this time, the user data processor 271 attaches the user data to the video stream according to the data size of the surplus region of the video stream set by the control signal processor 274, the type of the user data, and the attachment position of the user data in the video stream. do. In addition, when user data is attached to the received video stream, the user data processor 271 receives an indicator from the control signal processor 274, and accordingly extracts user data from the video stream and outputs the user data separately.

Video codec 272 performs encoding and decoding of the video stream. Specifically, the video codec 272 encodes the received video stream. The user data processor 271 also encodes the video stream to which the user data is attached in the same manner. The received encoded video data is decoded and output. The method of encoding and decoding video data is preferably made using H.261, H.263 and MPEG-4.

Here, H.261 is a standard for video encoding / decoding for video telephony and video conferencing, and H.263 and MPEG-4 are improved video encoding / decoding standards in H.261. In the embodiment of the present invention, the video codec has been described as being located only in the controller 270, but the camera unit 250 may include a video codec in addition to the controller 270, which may transmit video data through the camera unit 250. To receive and encode via video codec 272.

The audio codec 273 encodes the input audio stream or decodes the encoded audio data and outputs the encoded audio data. The audio codec may correct the delay of the video stream by giving an arbitrary delay to the receiving path of the audio stream for synchronization of the audio and the video stream. The function module may be configured separately for the delay for the synchronization. The audio codec 273 uses adaptive multi-rate (AMR), G.723.1, as an encoding / decoding method.

The control data processor 274 generates and outputs control data according to a protocol for control signals for video communication, and outputs a control signal for interpreting the received control data to control other functional blocks accordingly. Specifically, the control signal processor 274 generates an indicator containing information on the data size of the redundant area of the video stream, the type of user data, and the attachment position of the user data in the video stream, and accordingly the user data processor 271. To attach user data to the video stream. Then, the control data including the indicator is generated and transmitted to the mux / demux 275. In addition, the indicator of the control data received from the mux / demux 275 is interpreted and transmitted to the user data processor 271. The control signal processor 274 uses H.245 as a protocol for control.

The multiplexer / demultiplexer (MUX / DEMUX) 275 multiplexes the video stream, the audio stream, and the control data into one bit stream, and transmits the received bit stream to each multimedia stream. Demultiplexing It also provides error recovery through logical frame generation, serial numbering, error detection, and retransmission for each media type. H.223 is used as the multiplexing protocol for this function.

The modem 276 modulates the bit stream multiplexed by the mux / demux 275 into an analog signal that can be transmitted to the GSTN, and transmits the modulated signal to the wireless communication unit 210. The analog signal received from 210 is demodulated into a bit stream and transmitted to the mux / demux 275. The protocol for this function uses V.34. In addition, the modem 276 is described as belonging to the control unit 270, but is not limited thereto, and may belong to the wireless communication unit 210, and may be an independent module between the wireless communication unit 210 and the control unit 270. Can be located.

Hereinafter, a method of attaching and transmitting user data to a video stream while a mobile terminal having the above-described configuration is performed will be described.

4 is a view illustrating a data transmission method of a mobile terminal for performing a video call according to an embodiment of the present invention, Figures 5a to 5d is a user of a mobile terminal for performing a video call according to an embodiment of the present invention 6A to 6B are screen examples for explaining a data transmission method of a mobile terminal for performing a video call according to an embodiment of the present invention.

Referring to FIG. 4, the portable terminal is in a video call mode in step S401. In a video call, the calling mobile terminal attempts to set up a call to the called mobile terminal, and the called mobile terminal connects the call in response to the call setting attempt of the calling mobile terminal. That is, a call path for a video call is set up between the calling mobile terminal and the called mobile terminal. Then, the video stream collected through the camera unit 250 and the audio stream collected through the audio processor 220 are transmitted to the called mobile terminal. The transmission is accomplished by encoding and multiplexing the video and audio streams to form one bit stream, converting it into an analog signal, and then radiating the converted analog signal at high frequencies through an antenna.

In the video call mode as described above, a user may attach user data to be transmitted. 5A through 5D, when a user selects 'content library', 'text data', and 'emoticon 01' in order, the controller 270 sequentially displays the screens as shown in FIGS. 5A through 5C. 240). When the user selects a menu on the screen as shown in FIG. 5C, the controller 270 displays a menu on the screen as shown in FIG. 5D and selects the menu. As shown in FIG. 5D, the user selects' 2. If the 'attach to video stream' is selected, the 'Emoticon 01' file can be transmitted to the destination portable terminal according to the data transmission method according to the embodiment of the present invention. In the foregoing description, text data has been described as an example, but the present invention is not limited thereto. In addition to text, image, and video files, all files that can be coded according to encoding / decoding standards supported by the mobile terminal may be transmitted. In addition, the process of attaching the user data through the above screen example is only one of the embodiments of the present invention, and it is possible to automatically attach or to attach the user data using a menu other than the above example. It is a matter of course.

When the user selects the user data in the above manner, the control unit 270 detects this in step S403 and generates a surplus area 620 in a part of the video data received in step S405. That is, as illustrated in FIGS. 6A and 6B, the image data of each frame edge portion 610 of the video stream may be provided as the redundant area 620. The video data of the edge portion 610 is an area where there is no great difficulty in performing a video call even if the video data is not transmitted during the video call.

Next, in step S407, the controller 270 attaches the user data selected by the user to the surplus area 620 of the video stream. Then, the controller 270 includes the indicator in the control data in step S409. The indicator is information for extracting user data, and has information about the size of the redundant area, the type of user data, and the location of user data in the video stream. Next, the control unit 270 encodes in accordance with the standard of the protocol supporting the video stream, audio stream and control data in step S411. Subsequently, the controller 270 multiplexes the video stream, the audio stream, and the control data in step S413 to generate a video call bit stream, converts the bit stream generated in step S415 into an analog signal, and then converts the bit stream into an analog signal. Is transmitted to the called party's mobile terminal.

Next, a description will be given of a method in which the called-party portable terminal receives the user data transmitted through the above method. 7 is a view for explaining a data receiving method of a mobile terminal according to an embodiment of the present invention, Figure 8 is a screen example for explaining a data receiving method according to an embodiment of the present invention.

Referring to FIG. 7, in the video call mode, the controller 270 receives a bit stream for a video call in step S701, and demultiplexes the bit stream received in step S703 into a video stream, an audio stream, and control data. Subsequently, the controller 270 decodes the video stream, the audio stream, and the control data in operation S705, and interprets the data according to a protocol supporting the control data in operation S707.

As the control data is interpreted, the controller 270 determines whether the user data is included in the video stream in step S709. This can be confirmed by the presence of an indicator.

As a result of the determination in step S709, if an indicator is included in the control data, the control unit 270 proceeds to step S711 to extract the user data in the video stream. In detail, when the control data processor 274 interprets the control data and checks the indicator, the control data processor 274 determines the size of the preset redundant area of the indicator, the type of the user data, and the position of the user data in the video stream. Information about the data is transmitted to the user data processing unit 271. The user data processor 271 extracts user data from the video stream with reference to the same, and outputs the video stream and the user data separately. Subsequently, the control unit 270 loads an image previously stored in the storage unit 260 in operation S713. As shown in FIG. 6B, the video stream has a surplus region 520 of the size of the attached user data, and the image of the edge portion 510 of the screen is reproduced by being broken as much as the surplus region. need. Next, the controller 270 plays the video stream at step S715 and simultaneously displays the replacement image on the display unit 240, and synchronizes the audio stream to the speaker SPK through the audio processor 220 in synchronization with the video stream. Perform a video call by outputting. That is, as shown in FIG. 8, the video stream and the replacement image 800 are displayed at the same time, and the size of the replacement image is displayed so as to cover the edge area of the video stream screen to be reproduced as the replacement image. Here, the size of the video stream and the replacement image may be adjusted by referring to the size of the surplus region of the indicator, and the replacement image may be received and used by the transmitting mobile terminal.

On the other hand, if the indicator is not included in the control data as a result of the determination in step S709, the control unit 270 proceeds to step S717 to display the video stream through the display unit 240 of the portable terminal, and to display the audio stream as audio. The processor 220 outputs the speaker to the speaker SPK.

As described above, in the detailed description of the present invention has been described with respect to specific embodiments, various modifications are possible without departing from the scope of the invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the claims below, but also by the equivalents of the claims.

As described above, according to the present invention, by attaching and transmitting user data of a video stream when performing a video call, it is possible to efficiently utilize limited radio communication resources. Therefore, there is an advantage of increasing the utilization of the mobile terminal.

Claims (8)

In the data transmission method of a mobile terminal for performing a video call, Selecting user data, Obtaining a video stream for the video call through a camera unit of a mobile terminal; Generating a surplus space having a preset data size in the video stream; Attaching the user data to the surplus space; Generating control data including an indicator having the attached user data information; And multiplexing the video stream and the control data and transmitting the multiplexed data stream. The method according to claim 1, The process of generating a predetermined excess space in the video stream, And deleting data of each frame region of the video stream corresponding to an edge region of a size corresponding to the surplus space. The method according to claim 1, The indicator is And information on the size of the redundant area of the video stream, the type of user data, and the attachment position of the user data in the video stream. In the data receiving method of a mobile terminal for making a video call, Receiving a bit stream for the video call; Demultiplexing the bit stream to extract a video stream and control data; Determining whether user data is attached to a surplus region of the video stream by referring to an indicator of the control data; And if the user data is attached as a result of the determination, extracting the user data by decoding the video and audio streams. The method according to claim 4, And displaying the video stream on a display unit of the portable terminal, and displaying an arbitrary region of an edge of the video stream using a pre-stored image. The method according to claim 4, And performing a video call by outputting audio data in synchronization with the video data. The method according to claim 4, As a result of the determination, if the user data is not attached, And decoding the video and audio data, displaying the video data on a display unit of the portable terminal, and outputting audio data in synchronization with the video data to perform a video call. How to receive data. The method according to claim 4, The indicator is The information receiving method of the video call mobile terminal, characterized in that it includes information on the size of the predetermined surplus space of the video stream, the type of user data and the attachment position of the user data in the video stream.

Images