KR20090013392A - A mobile telecommunication device and a method of visual communication using the same - Google Patents

Abstract

A mobile telecommunication device and a method of visual communication using the same are provided to enable a receiver and an originator to communicate with each other, watching a paused image. A user selects a pause function during image communication (S410), a menu for selecting a pause target image is displayed(S420). When the pause function is requested in interrupt format, an image is paused at an Iframe firstly appearing after the user selects the pause function. The time stamp values of an image frame of a transmitting or receiving image(S430). It is notified to a terminal of the other party by an application packet of an RTCP that an image is paused and by transferring a time stamp value at which frame the image is paused(S440). A mutually synchronized pause image is outputted to each terminal(S450).

Description

A mobile telecommunication device and a method of visual communication using the same

The present invention relates to a mobile communication terminal capable of implementing a temporary function during a video call and a video call method using the same.

Thanks to the development of communication technology, mobile communication technology has emerged to implement a video call that allows a user to talk while looking at the other's face. There is no function to stop the video during video communication currently in service, for example, Video Telephony (VT) or Video Sharing Call (VSC). That is, there is no technology for satisfying the user's request to talk while viewing a still image during a video call.

It is an object of the present invention to provide a mobile communication terminal and a call method using the same, in which a receiver and a caller can talk while viewing a still image.

Another object of the present invention is to provide a mobile communication terminal and a call method using the same, which can reduce unnecessary traffic.

It is still another object of the present invention to provide a mobile communication terminal and a call method using the same capable of realizing still image synchronization of a transmitting and receiving side.

The mobile communication terminal according to the present invention for achieving these objects is characterized in that it is possible to make a call by stopping only the video while maintaining the voice call.

A feature of the configuration of a mobile communication terminal according to the present invention is to implement a pause function of an image using a button formed in a predetermined portion of the terminal or through a menu function.

Features of a detailed configuration of a mobile communication terminal according to the present invention are at least one camera; A wireless communication unit for performing wireless communication with at least one other terminal; An operation unit for implementing an image pause function during video communication through a camera and a wireless communication unit; The controller is configured to output an image control signal according to a signal provided through an operation unit.

The detailed configuration of the mobile communication terminal according to the present invention is characterized in that the video pause function pauses the video transmitted to the counterpart terminal, pauses the video received from the counterpart terminal, or pauses all the videos transmitted and received. That's the point.

A feature of the detailed configuration of the mobile communication terminal according to the present invention is that the video pause function stops the video in the first I-frame that appears after the input of the input means.

Call method using a mobile communication terminal according to the present invention comprises the steps of performing a video call with at least one counterpart terminal; Receiving a video pause interrupt signal during a video call; This is a process including stopping and outputting an image in an I-frame first appearing after receiving an image pause interrupt signal.

The mobile communication terminal and the call method using the same according to the present invention can expect an effect of eliminating unnecessary traffic and realizing still image synchronization on the transmitting and receiving side by stopping the temporarily transmitted or received image during a video call.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The illustrated mobile terminal 100 includes a wireless communication unit 110, an A / V (Audio / Video) input unit 120, an operation unit 130, a sensing unit 140, and an A / V (Audio / Video) output unit 150. ), A storage unit 160, an interface unit 170, a controller 180, a power supply unit 190, and the like. It should be noted that the components may be combined into one or more components, or one component may be subdivided into two or more components as needed when implemented in actual application.

The following describes the components in order.

The wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a GPS module 115, and the like.

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a pre-generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

  The broadcast receiving module 111 receives broadcast signals using various broadcast systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link only (MediaFLO). ), Digital broadcast signals may be received using digital broadcasting systems such as DVB-H (Digital Video Broadcast-Handheld) and ISDB-T (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 is configured to be suitable for all broadcast systems providing broadcast signals as well as the digital broadcast system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the storage 160.

In addition, the mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be internal or external.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

In addition, the GPS (Global Position System) module 115 receives position information from a plurality of satellites.

Meanwhile, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera module 121 and a microphone module 122. The camera module 121 processes image frames such as still images or moving images obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display module 151.

The image frame processed by the camera module 121 may be stored in the storage 160 or transmitted to the outside through the wireless communication unit 110. Two or more camera modules 121 may be provided according to the configuration of the terminal.

The microphone module 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output in the call mode. The microphone module 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The operation unit 130 generates key input data input by the user for controlling the operation of the terminal. The operation unit 130 may be configured of a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like. The image pause function according to the present invention may be implemented by using a menu function key among key pads or by forming a function key on the side of the main body. In particular, when the touch pad forms a mutual layer structure with the display module 151 described later, this may be referred to as a touch screen.

The sensing unit 140 detects a current state of the mobile terminal 100 such as an open / closed state of the mobile terminal 100, a position of the mobile terminal 100, presence or absence of a user contact, and controls the operation of the mobile terminal 100. Generate a sensing signal. For example, when the portable terminal 100 is in the form of a slide phone, whether the slide phone is opened or closed may be sensed. In addition, it is responsible for sensing functions related to whether the power supply unit 190 is supplied with power or whether the interface unit 170 is coupled to an external device.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, wired / wireless headsets, external chargers, wired / wireless data ports, card sockets (e.g. memory cards, SIM / UIM cards), audio input / output (I / O) terminals, video I / O (Input / Output) terminal, earphone, etc. The interface unit 170 receives data from an external device or receives power and transmits the data to each component inside the mobile terminal 100 or transmits the data inside the mobile terminal 100 to an external device.

The A / V output unit 150 is for outputting an audio signal or a video signal, and may include a display module 151 and a sound output module 152.

The display module 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, a user interface (UI) or a graphic user interface (GUI) related to a call is displayed. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays a photographed and / or received image, a UI, or a GUI.

Meanwhile, as described above, when the display module 13 and the touch pad form a mutual layer structure to form a touch screen, the display module 151 may be used as an input device in addition to the output device. The display module 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, or a three-dimensional display. 3D display). In addition, two or more display modules 151 may exist according to the implementation form of the mobile terminal 100. For example, the external display module (not shown) and the internal display module (not shown) may be simultaneously provided in the portable terminal 100.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the storage unit 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

On the other hand, although not shown, the portable terminal 100 according to an embodiment of the present invention may be provided with a vibration output unit for outputting a signal in the form of vibration using a motor.

The storage unit 160 may store a program for processing and control of the controller 180, and a function for temporarily storing input / output data (for example, a phone book, a message, a still image, a video, etc.). You can also do

The storage unit 160 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory), It may include a storage medium of at least one type of RAM and ROM. In addition, the mobile terminal 100 may operate a web storage that performs a storage function of the storage unit 150 on the Internet.

The controller 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia playback module 181 for multimedia playback. The multimedia player module 181 may be configured as hardware, or may be configured as software separately from the controller 180.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

In the above, the portable terminal related to the present invention has been described in terms of components according to functions. Hereinafter, referring to FIG. 2 and FIG. 3, the portable terminal related to the present invention will be further described in terms of components according to appearance. In the following description, a slider type portable terminal is described as an example among various types of portable terminals such as a folder type, a bar type, a swing type, a slider type, and the like for clarity. Therefore, the present invention is not limited to the slider type portable terminal, but can be applied to all types of portable terminals including the aforementioned type.

2 is a front perspective view of an example of a mobile terminal according to the present invention; A state in which the first body 100A is disposed to overlap the second body 100B may be referred to as a closed status, and at least a portion of the second body 100B may be exposed as shown in this drawing. One state may be referred to as an open state.

The portable terminal operates mainly in the standby mode in the closed state, but the standby mode may be released by the user's operation. In addition, the portable terminal operates mainly in a call mode or the like in an open state, but may be switched to a standby mode by a user's operation or a lapse of a predetermined time.

The case (casing, housing, cover, etc.) forming the exterior of the first body 100A is formed by the first front case 100A-1 and the first rear case 100A-2. Various electronic components are embedded in the space formed by the first front case 100A-1 and the first rear case 100A-2. At least one intermediate case may be further disposed between the first front case 100A-1 and the first rear case 100A-2.

The cases may be formed by injecting synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The first body 100A, specifically, the first front case 100A-1 may include a display module 151, a first sound output module 152-1, a first camera module 121-1, or a first manipulation unit. 130-1 may be disposed.

The display module 151 includes a liquid crystal display (LCD), organic light emitting diodes (OLED), and the like, which visually express information.

Since the touch pad is superimposed on the display module 151 in a layer structure, the display module 151 may operate as a touch screen to enable input of information by a user's touch.

The first sound output module 152-1 may be implemented in the form of a speaker.

The first camera module 121-1 may be implemented to be suitable for capturing an image or a video of a user.

The first manipulation unit 130-1 receives an operation signal according to a user's intention to control the operation of the portable terminal.

Like the first body 100A, the case forming the exterior of the second body 100B is formed by the second front case 100B-1 and the second rear case 100B-2.

The second manipulator 130-2 may be disposed on the front body of the second body 100B, specifically, the second front case 100B-1.

The third manipulation unit 130-3, the microphone module 122, and the interface unit 170 may be disposed on at least one of the second front case 100B-1 or the second rear case 100B-2).

The first to third manipulation units 130-1, 130-2, and 130-3 may be collectively referred to as manipulating portions 130, and may be manipulated by the user while having a tactile feeling. Can be employed in any manner.

For example, the operation unit may be implemented as a dome switch or a touch pad that may receive a command or information by a user's push or touch operation, or may be implemented by a wheel or jog method that rotates a key, or a method such as a joystick. Can be.

In the functional aspect, the first operation unit 130-1 is for inputting a command such as start, end, scroll, etc., and the second operation unit 130-2 is for inputting numbers, letters, symbols, and the like. will be.

In addition, the third operation unit 130-3 may operate as a hot-key for activating a special function in the mobile terminal.

The microphone module 122 may be implemented in a form suitable for receiving a user's voice, other sounds, and the like.

The interface unit 170 serves as a passage for allowing a portable terminal related to the present invention to exchange data with an external device. For example, the interface unit 170 is wired or wirelessly, a connection terminal for connecting to the earphone, a port for short-range communication, for example, an infrared port (IrDA port), Bluetooth port (Bluetooth port), wireless LAN port It may be at least one of power supply terminals for supplying power to a wireless LAN port. Since the interface unit 170 has already been described above, a detailed description thereof will be omitted.

The power supply unit 190 for supplying power to the portable terminal is mounted on the second rear case 100B-2.

The power supply unit 190 may be detachably coupled for charging, for example, as a rechargeable battery.

3 is a rear perspective view of the portable terminal of FIG. 2.

Referring to FIG. 3, a second camera module 121-2 may be additionally mounted on the rear surface of the second rear case 100B-2 of the second body 100B. The second camera module 121-2 may have a photographing direction substantially opposite to that of the first camera module 121-1 (see FIG. 2), and may have different pixels from the first camera module.

For example, the first camera module 121-1 has a low pixel so that the user's face is photographed and transmitted to the counterpart in case of a video call, and the second camera module 121-2 is a general subject. It is preferable to have a high pixel because it is not often photographed and transmitted immediately.

The flash 121-3 and the mirror 121-4 may be further disposed adjacent to the second camera module 121-2. The flash 121-3 illuminates the light toward the subject when the subject is photographed by the second camera module 121-2. The mirror 121-4 allows the user to see his / her own face or the like when the user wants to photograph (self-photograph) the second camera module 121-2.

The second sound output module 152-2 may be further disposed on the second rear case 100B-2.

The second sound output module 152-2 may implement a stereo function together with the first sound output unit 152-1 (see FIG. 3), and may be used for a call in the speakerphone mode.

In addition, an antenna 111-1 for receiving a broadcast signal may be disposed on one side of the second rear case 100B-2 in addition to an antenna for a call. The antenna 111-1 may be installed to be pulled out of the second body 100B and 2.

A portion of the slide module 100C for slidably coupling the first body 100A and the second body 100B is disposed on the first rear case 100A-2 side of the first body 100A.

The other part of the slide module 100C may be disposed on the side of the second front case 100B-1 of the second body 100B and may not be exposed to the outside as shown in the drawing.

In the above description, the second camera module 121-2 is disposed on the second body 100B, but is not necessarily limited thereto.

For example, at least one of the elements 111-1, 121-2 to 121-3, and 152-2 described as disposed on the second rear case 100B-2, such as the second camera module 121-2. At least one may be mounted to the first body 100A, mainly the first rear case 100A-2. In such a case, there is an advantage that the arrangements disposed in the first rear case 100A-2 in the closed state are protected by the second body 100B. Furthermore, even if the second camera module 121-2 is not separately provided, the first camera module 121-1 may be rotatably configured to be photographed up to the shooting direction of the second camera module 121-2. It may be.

4 is a flowchart illustrating a process of a call method using a mobile communication terminal according to the present invention. 5 and 6 are exemplary views of a screen displayed on the terminal according to an embodiment of the present invention.

As shown in FIG. 5, a video call is performed with at least one other terminal user. It will not be mentioned that a plurality of relative images may be displayed when performing group communication or the like, and the following description will take one-to-one communication as an example. In the video communication, an image read through a camera provided in each terminal is transmitted in real time to the counterpart terminal. Therefore, the image displayed through the terminal may be referred to as a video. However, since the moving image cannot be displayed through the drawing, the moving image is displayed in a stationary form (S410).

The user performs the video pause function as needed. The video pause function may be both an image transmitted from its own terminal, an image received from an external terminal, or a transmission / reception image. The video pause function is implemented using a menu key or a button formed separately on one side of the terminal.

For example, if a menu key is pressed during a video call, taking the user A's terminal as an example, a function that can be implemented during a video call is displayed as shown in FIG. 6A. That is, various menus for recording a received image, selecting and transmitting a picture stored in a terminal thereof, and implementing a pause function according to the present invention are displayed. When the user selects the pause, a menu for selecting an image to be paused is displayed as shown in FIG. 6B. That is, both the transmission image, the reception image, and the transmission / reception image may be selected. If the group communication, the target terminal may be selected, and a detailed description thereof will be omitted since it may deviate from the gist of the present invention (S420).

If the realization of the video pause function is required in the form of an interrupt, the user freezes the video in the first I-frame that appears after selecting the pause. A time stamp value of a currently transmitted image or a received image frame is extracted (S430).

The application packet of the RTCP is used to inform the counterpart terminal that the video is stopped, and at the same time, transmit a time stamp value to indicate in which frame it is stopped.

The synchronized still images are output to each terminal (S450).

If the user wants to cancel the video pause function, a menu key or a button formed on one side of the terminal is used. Since the current image pause function is being implemented, as shown in FIG. 6C, a screen asking the user whether to cancel the image pause function is displayed (S460).

If the user selects the "transmitted video pause" function, the video transmitted through the camera formed on the user's terminal is paused. At this time, the opposite terminal makes a call while watching the same still image.

If the user selects the "pause received image" function, the received screen is paused. At this time, the same still image is displayed on the calling side. On the other hand, the sender may continue to transmit the video regardless of whether the receiver stops the video.

Meanwhile, although the present embodiment has been described using a mobile communication terminal, the implementation of the pause function during video communication, which is a basic concept of the present invention, may be applied to any device capable of performing video communication. In addition, the present invention is also applicable to a VT or VSC operating in an IMS (IP Multimedia Subsystem) network other than the VT or VSC operating in a terminal. In addition to VT and VSC, it is widely applicable to video transmission applications such as PTV.

By pausing the video during video communication, voice calls can be exchanged with each other while still maintaining the voice call. In the case of the VT which emphasizes real-time, when receiving the RTCP packet indicating that the video is stopped, unnecessary RTP packet no longer needs to be transmitted, thereby preventing unnecessary waste of bandwidth. Since the time stamp information of the still picture frame is transmitted in the RTCP packet, the user can view the same still picture.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

2 is a front perspective view of an example of a mobile terminal according to the present invention;

3 is a rear perspective view of the portable terminal of FIG. 2.

4 is a flowchart illustrating a process of a call method using a mobile communication terminal according to the present invention.

5 illustrates an example of a screen displayed on a terminal according to an example of video communication.

6 is an exemplary view of a screen displayed on the terminal according to an embodiment of the present invention.

Claims (8)

At least one camera; A wireless communication unit for performing wireless communication with at least one other terminal; An operation unit for implementing an image pause function during video communication through a camera and a wireless communication unit; And a control unit for outputting an image control signal according to a signal provided through an operation unit. The mobile terminal of claim 1, wherein the image pause function pauses an image transmitted to the counterpart terminal and transmits a time stamp value of the stopped image frame together with the pause information of the transmitted image. The mobile communication terminal of claim 1, wherein the image pause function pauses an image received from a counterpart terminal. The mobile communication terminal of claim 3, wherein the image pause function transmits a time stamp value of the stopped image frame together with the image reception pause information to the counterpart terminal. The mobile communication terminal according to any one of claims 1 to 4, wherein the image pause function stops the image in the first I-frame that appears after the input of the input means. Performing a video call with at least one counterpart terminal; Receiving a video pause interrupt signal during a video call; A video call method using a mobile communication terminal, comprising: stopping and outputting an image in an I-frame first appearing after receiving an image pause interrupt signal. The mobile communication terminal of claim 6, further comprising: pausing the image transmitted to the counterpart terminal and transmitting a time stamp value of the still image frame together with the pause information of the transmitted image. Video call method. The mobile communication terminal of claim 6, further comprising: pausing an image received from the opposite terminal and transmitting a time stamp value of the still image frame together with the pause information of the received image. Video call method.

Images