KR20070070848A - Method and system for providing rotation compensation of video data transmitted to mobile communication terminal - Google Patents

Abstract

A system and a method for providing rotation correction of video data transmitted to a mobile communication terminal are provided to allow a user of a receiving mobile communication terminal to maintain a specific angle of video data transmitted from a transmitting mobile communication terminal. When a transmitting mobile terminal initializes a camera attached thereto and receives video data, a relative correction value measurement unit generates relative correction angle data and an absolute correction angle measurement unit generates absolute correction angle data(S200). The relative correction angle data and the absolute correction angle data are included in the video data and encoded. The encoded data is transmitted to a receiving mobile terminal(S202). The receiving mobile terminal decodes the encoded data and acquires the relative correction angle data and the absolute correction angle data from the decoded data(S204). It is confirmed whether the receiving mobile terminal uses rotation correction(S206). When the receiving mobile terminal uses rotation correction, rotation correction is executed on the decoded data by using an image correction application based on the relative correction angle data and the absolute correction angle data(S214). When the receiving mobile terminal does not use the rotation correction, a null signal which represents that the rotation correction is not used is generated(S208) and the decoded data is displayed on a screen of the receiving mobile terminal(S212). The rotation-corrected video data is displayed on the screen of the receiving mobile terminal(S218).

Description

System and method for providing rotation correction of image data transmitted to mobile communication terminal {Method and System for Providing Rotation Compensation of Video Data Transmitted to Mobile Communication Terminal}

1 is a view schematically showing the internal structure of a mobile communication terminal providing rotation correction of image data according to an embodiment of the present invention;

2 is a flowchart illustrating a process of providing rotation correction of image data transmitted to a mobile communication terminal according to a preferred embodiment of the present invention.

<Description of Symbols for Main Parts of Drawings>

110: microprocessor 120: memory

130: program storage unit 132: mode state storage unit

134: relative correction angle measurement unit 136: image correction unit

140: absolute correction angle sensor 150: key input unit

160: display unit 170: digital signal processing unit

180: baseband converter 182: speaker

184: microphone 190: RF signal processing unit

192: antenna

The present invention relates to a system and method for providing rotation correction of image data transmitted to a mobile communication terminal. More specifically, the mobile terminal is equipped with a horizontal angle sensor to calculate the absolute correction angle, calculate the relative correction angle based on the initial image data input through the camera of the outgoing mobile terminal, and the relative correction angle data and relative The correction angle data is included in the image data transmitted by the calling mobile communication terminal and transmitted, so that the receiving mobile communication terminal uses the absolute correction angle data and the relative correction angle data to provide rotation correction of the image data transmitted from the calling mobile communication terminal. A system and method for providing rotation correction of image data transmitted to a mobile communication terminal.

The mobile communication system has been developed through the first generation analog AMPS (Advanced Mobile Phone System) method and the second generation cellular (Cellular) / Personal Communication Service (PCS) method. The third generation mobile communication system IMT-2000 (International Mobile Telecommunication 2000), which is enacted as a standard in ITU-R, is commercially available. IMT-2000 is CDMA 2000 1X, 3X, EV-DO, Wideband CDMA (WCDMA), etc., and is used in IS-95A and IS-95B networks by using the IS-95C network that has evolved from the existing IS-95A and IS-95B networks. It is a service that can provide wireless Internet at a transmission speed of up to 144 Kbps, much faster than the supportable data transfer rate of 14.4 Kbps or 56 Kbps. In particular, by using IMT-2000 service, it is possible to provide various multimedia services (AOD, VOD, etc.) at a faster speed as well as improving existing voice and wireless broadcasting service (WBS) service quality.

In addition, recently, as a part of overcoming the limitations in providing the wireless Internet service of the above-described mobile communication system, a portable Internet system (HPi: High Speed) capable of using high-speed wireless Internet service at a low cost while moving Development of the Portable Internet System or WiBro: Wireless Broadband Internet System. The portable internet system uses various types of portable terminals such as laptops, PDAs, and handheld PCs to access various types of information and contents by accessing the Internet in indoor and outdoor stationary environments and mobile environments at walking speeds and low to medium speeds. It is a service. In addition, it enables mobile subscribers to use the wireless Internet while moving at a speed of 60 km / h, provides a downlink transmission speed of 24 Mbps, and a downlink transmission of 50 Mbps using a multiple input multiple output (MIMO) system. It is an IP (Internet Protocol) based wireless data system that can provide speed.

In addition, the hardware of the mobile communication terminal continues to evolve in accordance with the service provided. Early models only supported voice calls and short message services, but the camera was installed on the mobile terminal so that users could take pictures, and the mobile communication terminal was equipped with a module capable of playing sound. In recent years, hardware development has been continued up to the mobile communication terminal equipped with a module capable of reproducing and receiving satellite broadcasting.

The mobile subscriber can use the mobile communication system to carry voice communication while carrying the mobile communication terminal, and wirelessly access the Internet through the mobile communication system using the wireless Internet technology to transmit text, images, Multimedia data services such as voice or video are provided. The wireless Internet allows a mobile subscriber to search and download a variety of information by accessing the Internet using a mobile communication terminal without time or space constraints.

Recently, with the development of the Internet and multimedia data technology, a content provider (CP) that provides various contents such as multimedia communication, network game, and video game has emerged, and various services provided by the content provider are provided as mobile communication terminals. The number of mobile subscribers to use has increased.

On the other hand, a mobile communication terminal equipped with a camera has only a picture taking function, but recently, not only a function of taking a still picture but also a video recording, and provides correction or editing functions. In addition, as a mobile communication company starts a video call service, image processing technology for a camera mounted on a mobile communication terminal has been continuously developed.

However, since the camera mounted on the mobile communication terminal is a built-in fixed position type camera, the mobile communication terminal user often grips only one hand and makes a video call. There was a problem that the displayed image is rotated accordingly.

In order to solve this problem, the present invention is equipped with a horizontal angle sensor in the mobile communication terminal to calculate the absolute correction angle, and calculate the relative correction angle based on the initial image data input through the camera of the outgoing mobile communication terminal, The correction angle data and the relative correction angle data are included in the image data transmitted by the calling mobile terminal, and the receiving mobile terminal uses the absolute correction angle data and the relative correction angle data to transmit the video data transmitted from the calling mobile terminal. It is an object of the present invention to provide a system and method for providing rotation correction of image data transmitted to a mobile communication terminal providing rotation correction.

In order to achieve the above object, according to the first object of the present invention, in the method for providing a rotation correction of the image data transmitted to the mobile communication terminal in a mobile communication terminal comprising an outgoing mobile terminal and a receiving mobile communication terminal, (a) When the outgoing mobile communication terminal initializes the camera mounted on the mobile communication terminal and receives the image data, the relative correction angle measuring unit generates the relative correction angle data, and the absolute correction angle sensor generates the absolute correction angle data. Generating a; (b) encoding and including the relative correction angle sensor and the absolute correction angle sensor in the image data input through the camera, and transmitting the encoded image data to a receiving mobile communication terminal; (c) decoding the encoded image data by the receiving mobile communication terminal and searching for the decoded image data to obtain relative correction angle data and absolute correction angle data; (d) checking whether the receiving mobile communication terminal uses rotation correction; (e) rotating correction of the image data decoded using the image correction application based on the relative correction angle data and the absolute correction angle data when it is determined that the reception mobile communication terminal uses the rotation correction; (f) generating a null signal indicating that the rotation compensation is not used and displaying the decoded image data on the screen of the reception mobile communication terminal when it is determined that the reception mobile communication terminal does not use the rotation correction; And (g) displaying the rotationally corrected image data on the screen of the receiving mobile communication terminal.

In addition, according to a second object of the present invention, in a mobile communication terminal providing rotation correction of image data transmitted to a mobile communication terminal using a video call service, the overall communication associated with the voice call and data communication transmitted to the mobile communication terminal A microprocessor that controls an operation process and controls to acquire image data of absolute correction angle and relative correction angle by retrieving image data received by the mobile communication terminal; Configured to include EEPROM (Electrically Erasable Programmable Read Only Memory), Flash Memory, and Random Access Memory (RAM), the software required to drive a mobile terminal and the various types of applications downloaded by the mobile terminal user. A memory storing the; Application Loader located in the memory to load the application, download manager to manage the download of the application required in the mobile terminal, mobile terminal call processing software, mobile financial services, content providing services and electronics A program storage unit including application software for supporting a wireless Internet service including a government service, a relative correction angle measuring unit for generating relative correction angle data, and an image correction unit for rotating correction of image data; An absolute correction angle sensor for measuring an horizontal angle of the mobile communication terminal and generating absolute correction angle data of image data received through a camera mounted on the mobile communication terminal; And an operating state of the mobile communication terminal, including a power supply state, a radio wave reception intensity, a date and time, displaying a menu item for executing an application, and receiving the mobile communication terminal to perform a video call service. It provides a mobile communication terminal for providing a rotation correction of the image data transmitted to the mobile communication terminal comprising a display unit for displaying the image data.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. First of all, in adding reference numerals to the components of each drawing, it should be noted that the same reference numerals are used as much as possible even if displayed on different drawings. In addition, in describing the present invention, when it is determined that the detailed description of the related well-known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted.

In addition, hereinafter, the present invention will be described under the assumption that a code division multiple access (CDMA) 2000 system is used as the mobile communication system. However, the CDMA 2000 system is a system designated for convenience of description and the mobile communication system used in the present invention is not limited thereto.

1 is a diagram schematically illustrating an internal structure of a mobile communication terminal that provides rotation correction of image data according to an exemplary embodiment of the present invention.

The mobile communication terminal 100 providing rotation correction of image data according to an exemplary embodiment of the present invention includes a microprocessor 110, a memory 120, a program storage unit 130, a mode state storage unit 132, and a counterpart. Correction angle measuring unit 134, image correction unit 136, absolute correction angle sensor 140, key input unit 150, display unit 160, digital signal processing unit 170, baseband conversion unit 180, It includes a speaker 182, a microphone 184, an RF signal processing unit 190 and an antenna 192, and uses a wireless application protocol (WAP), which is an Internet access protocol, and an MIE based on HTML using an HTTP protocol. Via a mobile communication network using a browser for wireless Internet access such as Microsoft Internet Explorer (HDPT), Handheld Device Transport Protocol (HDPT), NTT DOCOMO's 'i-Mode' or SK Telecom's 'NATE' Contacting the internet Can. Among the Internet access protocols used in the mobile communication terminal 100, MIE uses m-HTML, which is a shortened version of HTML, and in the case of i-Mode, a language called compact HTML (c-HTML), which is a subset of HTML. Use

The microprocessor 110 controls the overall operation process related to the transmission and reception of voice call signals and data communication signals in the mobile communication terminal 100, and the image received by the receiving mobile communication terminal when the receiving mobile communication terminal starts a video call The controller searches for data to obtain absolute correction angle data and relative correction angle data, and transmits the obtained absolute correction angle data and the relative correction angle data to the image correction unit.

In addition, when the originating mobile communication terminal starts a video call, the microprocessor 110 may store the absolute correction angle data and the absolute correction angle data generated by the relative correction angle measuring unit 134 on image data input through a camera mounted on the originating mobile communication terminal. Absolute correction angle data generated by the correction angle sensor 140 is included and transmitted.

The memory 120 includes an electrically erasable programmable read only memory (EEPROM), a flash memory, a random access memory (RAM), and the like, and stores basic programs necessary for driving the mobile communication terminal 100. It is. Flash memory stores basic programs such as real time operating system, mobile terminal call processing software, multimedia coloring software, and short message application for short message creation and confirmation. 130, the software of the program storage unit 130 is loaded into the RAM and driven.

The mode state storage unit 132 stores the current operation mode of the mobile communication terminal 100 selected by the key input unit 150 as a state flag (eg, 0, 1, 2, ...). That is, the microprocessor 110 has a unique state flag for each mode to distinguish the standby mode, the origination mode, the search mode, the call mode, the general incoming mode, the multimedia coloring service incoming mode, and the like of the mobile communication terminal 100. To update the mode state storage unit 132.

The relative correction angle measuring unit 134 according to the preferred embodiment of the present invention continuously inputs the image data based on the initial image data received when the calling mobile terminal initializes the camera for the video call and receives the image data. The function of generating relative correction angle data for the rotation angle of the.

The image correcting unit 136 according to the preferred embodiment of the present invention receives the absolute correction angle data and the relative correction angle data for retrieving and transmitting the image data from the microprocessor 110, and the outgoing mobile communication displayed by the receiving mobile communication terminal. Rotation correction of image data of the terminal is performed.

Rotation correction of the image data received by the receiving mobile communication terminal is performed by the image correcting unit 136 using the image correction application. The image correction application is performed by the user of the mobile terminal. Rotation correction of image data is performed using.

When the image correction application performs rotation correction of the image data using the absolute correction angle data, the rotation of the image data is corrected based on the absolute correction angle data included in the image data transmitted from the originating mobile communication terminal.

Absolute correction angle data in the present invention is a data generated by measuring the horizontal angle of the mobile communication terminal 100, the absolute correction by measuring the rotation of the mobile communication terminal 100 based on the case that the mobile communication terminal 100 is horizontal Generate each piece of data.

When the image correction application performs rotation correction of the image data using the relative correction angle data, the rotation of the image data is corrected based on the relative correction angle data included in the image data transmitted from the originating mobile communication terminal.

In the present invention, the relative correction angle data is data generated based on the first image data received through the camera of the mobile communication terminal 100, and after analyzing the first image data received by the mobile communication terminal 100 after the first image data. Relative correction angle data is generated by measuring the rotation of the image data received in the input.

Absolute correction angle sensor 140 according to a preferred embodiment of the present invention is a sensor that is mounted inside the mobile communication terminal 100 to measure the horizontal angle of the mobile communication terminal, senses the inclination of the mobile communication terminal, sensed size Generates an electrical signal proportional to, and generates absolute correction angle data based on the generated electrical signal.

The key input unit 150 includes a number key for inputting a number such as a phone number, a button for inputting a character, and a function key button for calling a specific function. The mobile communication terminal 100 includes a key input unit 150. To write a short message.

The display unit 160 displays an operation state of the mobile communication terminal 100 including a power supply state, a radio wave reception intensity, a date and time, and a menu item for executing an application and the mobile communication terminal 100 wirelessly. A screen for downloading various content applications from a data service is displayed, and image data received by the mobile communication terminal 100 is displayed.

The digital signal processor (DSP) 170 functions as an equalizer for coding or decoding a voice signal and for removing multipath noise, and for performing sound data processing, decoding of a caller specified multimedia content, and the like. Means a digital signal processing processor to perform. In addition, the digital signal processor 170 exchanges speech data with the baseband converter 180 and digital data including caller-specific multimedia content received from the baseband converter 180. ).

The baseband converter 180 converts a signal transmitted and received between the RF signal processor 190 and the digital signal processor 170, the speaker 182, and the microphone 184 into a signal of a baseband band, and converts a digital analog signal (DAC). : Performs functions such as Digital to Analog Conversion (ADC) and Analog to Digital Conversion (ADC). The baseband converter 180 transmits the transmission data TXIQ to the RF signal processor 190, and controls the power of the RF signal processor 190 or automatically controls its gain. The RF signal processor 190 receives the received signal RFIQ.

The RF signal processor 190 demodulates and amplifies the RF signal received from the antenna 192, modulates a transmission signal applied from the baseband converter 180, and transmits the modulated signal to the propagation space. The speaker 182 outputs acoustic data transmitted from the baseband converter 180 as an audible sound, and the microphone 184 converts a user's voice input into an electrical signal.

2 is a flowchart illustrating a process of providing rotation correction of image data transmitted to a mobile communication terminal according to a preferred embodiment of the present invention.

When the user of the mobile communication terminal initializes the camera mounted on the outgoing mobile communication terminal for video call and inputs the image data, the relative correction angle measuring unit 134 generates the relative correction angle data, and the absolute correction angle sensor 140. Generates absolute correction angle data, and transmits the generated relative correction angle data and the absolute correction angle data to the microprocessor 110 (S200).

Absolute correction angle data in the present invention is a data generated by measuring the horizontal angle of the mobile communication terminal 100, the absolute correction by measuring the rotation of the mobile communication terminal 100 based on the case that the mobile communication terminal 100 is horizontal Generate each piece of data.

In the present invention, the relative correction angle data is data generated based on the first image data received through the camera of the mobile communication terminal 100, and after analyzing the first image data received by the mobile communication terminal 100 after the first image data. Relative correction angle data is generated by measuring the rotation of the image data received in the input.

The microprocessor 110 receiving the relative correction angle data and the absolute correction angle data is encoded by including the relative correction angle data and the absolute correction angle data in the image data, and transmits the encoded image data to the receiving mobile communication terminal (S202). ).

When the encoded image data is transmitted to the receiving mobile communication terminal, the microprocessor 110 decodes the encoded image data, retrieves the decoded image data to obtain relative correction angle data and absolute correction angle data, and obtains the obtained relative correction. Each data and the absolute correction angle data are transmitted to the image corrector 136 (S204).

The image corrector 136 receiving the relative correction angle data and the absolute correction angle data checks whether the receiving mobile communication terminal uses rotation correction (S206).

If it is determined in step S206 that the receiving mobile communication terminal does not use the rotation correction, the image correction unit 136 generates a null signal indicating that the receiving mobile communication terminal does not use the rotation correction to the microprocessor 110. It transmits (S208).

If it is determined in step S206 that the reception mobile communication terminal uses rotation correction, the image correction unit 136 checks whether the reception mobile communication terminal uses absolute correction angle data (S210).

The microprocessor receiving the null signal transmits the decoded image data to the display unit 160 (S212).

If it is determined in step S210 that the receiving mobile communication terminal uses the absolute correction angle data, the image correction unit 136 executes an image correction application to decode the image data based on the absolute correction angle data transmitted from the microprocessor 110. Rotation correction is performed (S214).

If it is determined in step S210 that the receiving mobile communication terminal does not use absolute correction angle data, the image correction unit 136 executes an image correction application to decode the image data based on the relative correction angle data transmitted from the microprocessor 110. Rotation correction is performed (S216).

The image data corrected for rotation in step S214 or step S216 is transmitted to the display unit 160 under the control of the microprocessor 110 (S218).

The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains may make various modifications and changes without departing from the essential characteristics of the present invention. Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical spirit of the present invention but to describe the present invention, and the scope of the technical spirit of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

As described above, according to the present invention, an absolute correction angle is calculated by mounting a horizontal angle sensor in the mobile communication terminal, and the relative correction angle is calculated based on the initial image data input through the camera of the originating mobile communication terminal. The correction angle data and the relative correction angle data are included in the image data transmitted by the calling mobile terminal, and the receiving mobile terminal uses the absolute correction angle data and the relative correction angle data to transmit the video data transmitted from the calling mobile terminal. By providing the rotation correction, there is an effect that the user of the receiving mobile communication terminal receiving the video data transmitted from the calling mobile communication terminal provides the convenience of viewing the video data at a constant angle.

Claims (10)

A method for providing rotation correction of image data transmitted to a mobile communication terminal in a mobile communication terminal including an outgoing mobile communication terminal and a receiving mobile communication terminal, (a) When the originating mobile communication terminal initializes the camera mounted on the mobile communication terminal and receives the image data, the relative correction angle measuring unit generates the relative correction angle data, and the absolute correction angle sensor generates the absolute correction angle data. Generating; (b) including and encoding the relative correction angle sensor and the absolute correction angle sensor in the image data input through the camera, and transmitting the encoded image data to the receiving mobile communication terminal; (c) decoding, by the receiving mobile communication terminal, the encoded image data, retrieving the decoded image data to obtain the relative correction angle data and the absolute correction angle data; (d) checking whether the receiving mobile communication terminal uses the rotation correction; (e) performing rotation correction on the decoded image data using the image correction application based on the relative correction angle data and the absolute correction angle data when the receiving mobile communication terminal determines that the rotation correction is used; (f) when the receiving mobile communication terminal determines that the rotation correction is not used, generates a null signal informing that the rotation correction is not used and displays the decoded image data on the screen of the receiving mobile communication terminal. Displaying; And (g) displaying the image of the rotation correction on the screen of the receiving mobile communication terminal; Method for providing a rotation correction of the image data transmitted to the mobile communication terminal comprising a. The method of claim 1, wherein the relative correction angle data, Data generated based on the first image data input through the camera, and the relative correction by measuring the rotation angle of the image data received after the first image data by analyzing the first image data received by the mobile communication terminal And generating rotation data of the image data transmitted to the mobile communication terminal. The method of claim 1, wherein the absolute correction angle data, Data generated by measuring a horizontal angle of the mobile communication terminal, and generating absolute correction angle data by measuring rotation of the mobile communication terminal based on the horizontal case of the mobile communication terminal. A method for providing rotation correction of image data to be generated. The method of claim 1, Step (e), (e1) confirming whether the receiving mobile communication terminal uses the absolute correction angle data when the receiving mobile communication terminal determines that the rotation correction is used; (e2) if it is determined in step (e1) that the receiving mobile communication terminal uses the absolute correction angle data, the image correction application is executed to perform rotation correction of the decoded image data based on the absolute correction angle data; Making; And (e3) if it is determined in step (e1) that the receiving mobile communication terminal does not use the absolute correction angle data, the image correction application is executed to perform rotation correction of the decoded image data based on the relative correction angle data. Steps to perform Method for providing a rotation correction of the image data transmitted to the mobile communication terminal comprising a. The method of claim 1, wherein the image correction application, The absolute correction angle data and the relative correction angle data, which are produced by a virtual machine application and included in the image data received by the mobile communication terminal, are contents for performing the rotation correction of the image data received by the mobile communication terminal. The rotation correction of the image data transmitted to the mobile communication terminal, characterized in that for performing the rotation correction of the image data based on. A mobile communication terminal providing rotation correction of video data transmitted to a mobile communication terminal using a video call service, Controlling overall operations related to voice calls and data communications transmitted to the mobile communication terminal, and searching for the image data received by the mobile communication terminal to obtain absolute correction angle data and relative correction angle data. A microprocessor for controlling; It is composed of EEPROM (Electrically Erasable Programmable Read Only Memory), Flash Memory (RAM) and Random Access Memory (RAM), and various kinds of software downloaded by the mobile terminal user and the software required to drive the mobile terminal. A memory storing an application; An application loader which is located in the memory and loads the application, a download manager which manages the download of the application required by the mobile communication terminal, application software supporting a wireless Internet service, and the relative correction angle data. A program storage unit equipped with a relative correction angle measurement unit to generate and an image correction unit to perform the rotation correction of the image data; An absolute correction angle sensor which measures the horizontal angle of the mobile communication terminal and generates the absolute correction angle data of the image data received through a camera mounted on the mobile communication terminal; And Display the operating state of the mobile communication terminal, including a power supply state, a radio wave reception intensity, a date and time, display a menu item for executing the application, and display the image data received by the mobile communication terminal. Display unit to display A mobile communication terminal providing a rotation correction of the image data transmitted to the mobile communication terminal comprising a. The method of claim 6, wherein the microprocessor, The image data received through the camera is encoded including the relative correction angle data and the absolute correction angle data, the encoded image data received by the mobile communication terminal is decoded, and the decoded image data is searched for. And obtaining relative correction angle data and the absolute correction angle data and transmitting the relative correction angle data to the image correction unit. The method of claim 6, wherein the relative correction angle measuring unit, Analyzing the first image data received through the camera of the mobile communication terminal to measure the rotation angle of the image data received after the initial image data to generate relative correction angle data to the mobile communication terminal A mobile communication terminal for providing rotation correction of the image data. The method of claim 6, wherein the absolute correction angle sensor, And a rotation correction of the image data transmitted to the mobile communication terminal, characterized in that for generating an absolute correction angle data by measuring the rotation of the mobile communication terminal on the basis that the mobile communication terminal is horizontal. The method of claim 6, wherein the image corrector, Rotate the image data transmitted to the mobile communication terminal by executing the image correction application to correct the rotation of the decoded image data based on the relative correction angle data and the absolute correction angle data transmitted from the microprocessor. A mobile terminal providing calibration.

Images