KR20120138567A - Method, system and mobile terminal for converting contents - Google Patents

Abstract

PURPOSE: A content converting method, a system thereof, and a mobile terminal therefor are provided to detect reproduction information through a photographed image for a reproduction device and convert contents by using the reproduction information. CONSTITUTION: A mobile terminal(1200) photographs a reproduction unit(1100). If a code related to the reproduction unit is included in the photographed image, the mobile terminal detects reproduction information of the reproduction unit by decoding a code. The mobile terminal transmits the reproduction information to a cloud server(1300). The cloud server converts contents by using the reproduction information according to a request of the mobile terminal. [Reference numerals] (1100) Reproduction unit; (1200) Mobile terminal; (1300) Cloud server; (S110) Obtaining a photographed image; (S120) Detecting reproduction information; (S130) Transmitting reproduction information; (S140) Converting contents; (S150) Transmitting converted contents; (S160) Reproducing the converted contents

Description

METHOD, SYSTEM AND MOBILE TERMINAL FOR CONVERTING CONTENTS}

The present invention relates to a content conversion technology, and more particularly to a content conversion method and system, and a mobile terminal used for content conversion.

A terminal can be divided into a mobile or portable terminal and a stationary terminal depending on whether the terminal is movable or not. The mobile terminal may be further classified into a handheld terminal and a vehicle mount terminal according to whether a user can directly carry it.

As the functions of such terminals are diversified, they are implemented in the form of a multimedia player having complex functions such as photographing and photographing of movies, reproduction of music and video files, games, and broadcasting reception . Further, in order to support and enhance the function of the terminal, it may be considered to improve the structural and software parts of the terminal.

On the other hand, the terminal may be configured to play the multimedia content in different playback formats. Therefore, unless the playback format of the multimedia content is compatible with all terminals, a process of converting the multimedia content is required.

An object of the present invention is to enhance the user's convenience in converting multimedia content.

According to an embodiment of the present disclosure, a method of converting a content may include: acquiring an image by photographing a playback device; and when the code associated with the playback device is included in the acquired image, the mobile terminal receives the code. Reading and detecting playback information of the playback device; transmitting, by the mobile terminal, the playback information to a cloud server; and requesting the mobile terminal to convert content using the playback information to the cloud server; It includes.

The detecting of the play information may include detecting, by the mobile terminal, applying the object recognition function to the obtained image, when the read code fails to read the code, and detecting the play information. If is registered in the memory of the mobile terminal, the mobile terminal may include detecting the playback information in the memory using the recognition information. Here, the recognition information may include at least one of the aspect ratio, shape, color, model name, manufacturer and logo of the playback device.

The content converting method may further include receiving, by the mobile terminal, the playback information from a user when it fails to detect the playback information. The method for converting content may include transmitting, by the mobile terminal, the acquired image and the recognition information to a device information providing server when it fails to detect the reproduction information, and the obtained image and the recognition. The mobile terminal may further include receiving the play information from the device information providing server in response to the information. The content converting method may further include the server transmitting the converted content to the playback device. The content converting method may further include transmitting, by the mobile terminal, the content to the cloud server when the content is not stored in the cloud server and stored in the mobile terminal.

In example embodiments, the playback information may include a resolution, a video format, and an audio format supported by the playback device.

According to an embodiment of the present invention, a content conversion system may acquire a video by photographing a playback device and the playback device, and when a code related to the playback device is included in the obtained image, the playback device is read by reading the code. A mobile terminal for detecting reproduction information of the mobile terminal; and receiving the reproduction information from the mobile terminal, and reproducing the content using the reproduction information so that the content corresponding to the conversion request of the mobile terminal can be reproduced in the reproduction device. Includes a cloud server to convert.

In example embodiments, when the mobile terminal fails to read the code, the mobile terminal detects recognition information by applying an object recognition function to the obtained image, and when the reproduction information is registered in a memory, the recognition The reproduction information may be detected in the memory using the information.

In an embodiment, the cloud server may transmit the converted content to the playback device.

The content conversion system may be configured to: when the content conversion system receives the acquired image and the recognition information from the mobile terminal and detects the reproduction information in a database using the obtained image and the recognition information, the reproduction. The apparatus may further include a device information providing server for transmitting information to the mobile terminal.

According to an embodiment of the present invention, a mobile terminal may include: a photographing unit configured to photograph an image of a playback device and to acquire an image; And a communication unit for transmitting the reproduction information to the cloud server so that an operation of converting content using the reproduction information can be performed by the cloud server.

In an embodiment, the mobile terminal may further include a memory for registering and storing the play information.

In example embodiments, if the control unit fails to read the code, the controller detects recognition information by applying an object recognition function to the obtained image, and when the reproduction information is registered in the memory, the recognition unit detects the recognition information. The reproduction information may be detected in the memory using the information.

The communication unit may transmit the acquired image and the recognition information to a device information providing server if the communication unit fails to detect the reproduction information, and in response to the obtained image and the recognition information. Playback information may be received from the device information providing server. The communication unit may receive the reproduction information from a communication tag associated with the reproduction apparatus through short range wireless communication.

In an embodiment, the mobile terminal may further include a display unit which displays list information of playback devices registered in the memory.

According to the present invention, the mobile terminal detects the playback information using the captured image of the playback device, and the cloud server converts the content using the playback information, so that the user captures the playback device to play the content using the mobile terminal. By doing so, playback information necessary for content conversion can be obtained easily.

In addition, in converting the content, the resource of the cloud server is used instead of the resource of the mobile terminal, thereby reducing the constraints on storage space, power consumption, etc., and also improve the performance (time required) of the conversion operation.

1 is a block diagram illustrating a mobile terminal according to the present invention.
2A and 2B are perspective views showing an appearance of a mobile terminal according to the present invention.
3 is a block diagram illustrating a content conversion system according to an exemplary embodiment.
4 is a flowchart illustrating a content conversion method according to an embodiment of the present invention.
5 is a block diagram schematically illustrating the mobile terminal illustrated in FIG. 3.
6 is a flowchart illustrating an embodiment of a method of detecting playback information according to the present invention.
7 and 8 are conceptual views illustrating an embodiment of a user interface related to the operation of the mobile terminal illustrated in FIG. 3.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings so that those skilled in the art may easily implement the technical idea of the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigator, have. However, it should be understood that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless it is applicable only to a mobile terminal. It will be easy to see.

1 is a block diagram illustrating a mobile terminal 100 according to the present invention. 1, a mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A controller 160, an interface unit 170, a controller 180, and a power supply unit 190. The components shown in Fig. 1 are not essential, so that a mobile terminal having more or fewer components can be implemented.

Hereinafter, the components 110 to 190 of the mobile terminal 100 will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115.

The broadcast receiving module 111 receives broadcast signals and broadcast related information from an external broadcast management server through a broadcast channel. Here, the broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network. In this case, the broadcast-related information may be received by the mobile communication module 112. The broadcast signal and the broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Such wireless signals may include various types of data depending on a voice call signal, a video call signal, a text message, or a multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be embedded in the mobile terminal 100 or externally. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used.

The location information module 115 is a module for acquiring a location of the mobile terminal 100, and a representative example thereof is a GPS (Global Position System) module.

1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal and a video signal, and may include a camera 121, a microphone 122, and the like. The camera 121 processes image frames such as still images and moving images obtained by the image sensor in the video communication mode or the photographing mode. The image frame processed by the camera 121 can be displayed on the display unit 151. [ The image frame may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ More than two cameras 121 may be provided depending on the use environment.

The microphone 122 processes the sound signal input from the outside in the communication mode, the recording mode, the voice selection mode, and the like as electrical voice data. The voice data processed by the microphone 122 in the communication mode can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated when an external sound signal is input.

The user input unit 130 generates input data for controlling the operation of the mobile terminal 100 by a user. The user input unit 130 may be composed of a key pad, a dome switch, a touch pad (static and electrostatic), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as presence or absence of a user, the open / close state of the mobile terminal 100, position, orientation, acceleration, deceleration, And generates a sensing signal. For example, when the mobile terminal 100 is in the form of a slide phone, the sensing unit 140 may detect whether the slide phone is opened or closed. The sensing unit 140 may sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like.

The sensing unit 140 may include a proximity sensor 141. The sensing unit 140 may include a touch sensor (not shown) for sensing a touch operation with respect to the display unit 151.

The touch sensor may have the form of a touch film, a touch sheet, a touch pad, or the like. The touch sensor may be configured to convert a pressure applied to a specific portion of the display portion 151 or a change in capacitance generated at a specific portion of the display portion 151 into an electrical input signal. The touch sensor may be configured to detect a touch pressure as well as a touched position and area.

When the touch sensor and the display unit 151 have a mutual layer structure, the display unit 151 can be used as an input device in addition to the output device. The display unit 151 may be referred to as a 'touch screen'.

If there is a touch input via the touch screen, signals corresponding thereto are sent to a touch controller (not shown). The touch controller processes the signals transmitted from the touch sensor, and then transmits data corresponding to the processed signals to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched.

When the touch screen is capacitive, the touch screen may be configured to detect the proximity of the sensing object by the change of the electric field according to the proximity of the sensing object. Such a touch screen may be classified as proximity sensor 141. [

The proximity sensor 141 refers to a sensor that detects the presence or absence of an object to be sensed without mechanical contact using an electromagnetic force or infrared rays. The proximity sensor 141 has a longer life than the contact type sensor and its utilization is also high. Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

Hereinafter, for convenience of explanation, a proximity action is referred to as " proximity touch " while an object to be sensed does not touch the touch screen, and an action of touching the sensing object on the touch screen is called & touch ".

The proximity sensor 141 detects the presence or absence of a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, The information corresponding to the presence / absence of proximity touch and the proximity touch pattern can be output to the touch screen.

The output unit 150 generates an output related to visual, auditory, tactile, and the like. The output unit 150 may include a display unit 151, an audio output module 153, an alarm unit 154, and a haptic module 155.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal 100 operates in the call mode, the display unit 151 displays a UI (User Interface) or a GUI (Graphic User Interface) related to the call. When the mobile terminal 100 operates in the video communication mode or the photographing mode, the display unit 151 displays the photographed image, the received image, the UI, the GUI, and the like.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT-LCD), an organic light emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

At least one display (or display element) included in the display unit 151 may be configured to be transparent or light transmissive so that the display can see the outside through it. This may be referred to as a transparent display. A representative example of such a transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 in the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. [ For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from each other or positioned integrally with one another, and may be located on different surfaces.

The sound output module 153 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice selection mode, a broadcast reception mode, The sound output module 153 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The sound output module 153 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 154 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events generated in the mobile terminal 100 include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 154 may output a signal for informing occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The display unit 151 and the audio output module 153 may be classified as a part of the alarm unit 154 because the video signal or the audio signal can be output through the display unit 151 or the audio output module 153. [

The haptic module 155 generates various tactile effects that a user can feel. A typical example of the haptic effect generated by the haptic module 155 is vibration. The intensity, pattern, and the like of the vibration generated by the tactile module 155 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 155 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, Various effects can be generated such as the effect of heat generation and the effect of reproducing the cold sensation using the heat absorbing or heatable element.

The haptic module 155 can be configured to not only transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sense of the finger or arm. At least two haptic modules 155 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input and output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data related to vibrations and sounds of various patterns that are output upon touch input on the touch screen.

The memory 160 may be a flash memory, a hard disk, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM) And may include at least one storage medium. The mobile terminal 100 may operate in association with a web storage that performs storage functions of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device, receives power, transfers the power to each component inside the mobile terminal 100, or transmits data inside the mobile terminal 100 to an external device. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, Input / output ports, video I / O ports, earphone ports, and the like.

The identification module is a chip for storing various information for authenticating the usage right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module Universal Subscriber Identity Module (USIM)). A device equipped with an identification module (hereinafter referred to as "identification device") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface unit 170 may be a path through which the power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle or various command signals input from the cradle by the user, (Not shown). The various command signals or power supplied from the cradle may also act as a signal for recognizing that the mobile terminal 100 is correctly mounted in the cradle.

The controller 180 controls the overall operation of the mobile terminal 100. For example, control and processing related to voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [ The control unit 180 may perform pattern selection processing for selecting handwriting input and drawing input on the touch screen as characters and images, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be applied to various types of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays Microprocessors, microprocessors, and other electronic units for performing other functions, as will be appreciated by those skilled in the art. In some cases, the embodiments described herein may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code may be implemented in a software application written in a suitable programming language. Such software code may be stored in the memory 160 and executed by the controller 180.

Hereinafter, a method of processing user input to the mobile terminal 100 will be described.

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100, and may include a plurality of operation units. The operating units may also be referred to as manipulating portions and may be employed in any manner as long as they are operated in a tactile manner by the user's tactile sense.

Various kinds of time information can be displayed on the display unit 151. [ Such visual information can be displayed in the form of letters, numbers, symbols, graphics, icons, and the like, and can be formed as a three-dimensional stereoscopic image. At least one of a character, a number, a symbol, a graphic, and an icon may be displayed in a predetermined arrangement for inputting time information, thereby being implemented as a keypad. Such a keypad may be referred to as a so-called " soft key ".

The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with one another. For example, an output window and an input window may be displayed on the upper and lower portions of the display unit 151, respectively. The output window and the input window are areas allocated for outputting or inputting information, respectively. In the input window, a soft key with a number for inputting a telephone number may be output. When the soft key is touched, the number corresponding to the touched soft key is displayed in the output window. When the operating unit is operated, a call connection to the telephone number displayed in the output window may be attempted, or the text displayed in the output window may be entered into the application.

The display unit 151 or the touch pad may be configured to detect touch scrolling. The user can move the cursor or the pointer positioned on the displayed object, for example, the icon, on the display unit 151 by scrolling the display unit 151 or the touch pad. Further, when the finger is moved on the display unit 151 or the touch pad, the path along which the finger moves may be visually displayed on the display unit 151. [ This will be useful for editing the image displayed on the display unit 151. [

One function of the mobile terminal 100 may be executed in response to a case where the display unit 151 and the touch pad are touched together within a predetermined time range. In the case of being touched together, there may be a case where the user clamps the main body of the mobile terminal 100 using the thumb and index finger. At this time, one function of the mobile terminal 100 to be executed may be activation or deactivation for the display unit 151 or the touch pad, for example.

2A and 2B are perspective views showing an appearance of a mobile terminal 100 according to the present invention. FIG. 2A shows a front side and one side of the mobile terminal 100, and FIG. 2B shows a rear side and the other side of the mobile terminal 100. FIG.

Referring to FIG. 2A, the mobile terminal 100 includes a bar-shaped terminal body. However, the mobile terminal 100 is not limited thereto, and may be realized in various forms such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are movably coupled to each other.

The terminal body includes a case (a casing, a housing, a cover, and the like) that forms an appearance. In the embodiment, the case may be divided into a front case 101 and a rear case 102. A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding of a synthetic resin or may be formed to have a metal material such as stainless steel (STS), titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input unit 130 (see FIG. 1), the microphone 122, the interface 170, can do.

The display unit 151 occupies a main portion of the front case 101. [ The audio output unit 152 and the camera 121 are located in a region adjacent to one end of the display unit 151 and the first user input unit 131 and the microphone 122 are located in a region adjacent to the other end. The second user input unit 132 and the interface 170 may be located on the sides of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100. [ The user input unit 130 may include a plurality of operation units 131 and 132.

The first or second operating units 131 and 132 can receive various commands. For example, the first operation unit 131 can receive commands such as start, end, scroll, and the like. The second operation unit 132 can receive commands such as adjusting the size of the sound output from the sound output unit 152, switching to the touch selection mode of the display unit 151, and the like.

Referring to FIG. 2B, a rear camera 121 'may be additionally mounted on the rear surface of the terminal body, that is, the rear case 102. The rear camera 121 'has a photographing direction opposite to that of the front camera 121 (see FIG. 2A), and may be configured to have pixels different from those of the front camera 121.

For example, the front camera 121 may be configured to have a low pixel, and the rear camera 121 'may be configured to have a high pixel. Accordingly, when the front camera 121 is used during a video call, the size of the transmission data may be reduced when the user's face is photographed and transmitted to the counterpart in real time. On the other hand, the rear camera 121 'can be used for the purpose of storing a high-quality image.

Meanwhile, the cameras 121 and 121 'may be installed in the terminal body so as to be rotated or popped up.

The flash 123 and the mirror 124 may be further positioned adjacent to the rear camera 121 '. The flash 123 emits light toward the subject when the user photographs the subject with the rear camera 121 '. The mirror 124 illuminates the user's face when the user photographs himself (self-photographing) using the rear camera 121 '.

A rear sound output unit 152 'may be additionally disposed on the rear surface of the terminal body. The rear sound output unit 152 ′ may perform a stereo function together with the front sound output unit 152 (see FIG. 2A), and may perform a speakerphone function during a call.

In addition to the antenna for communication, an antenna 116 for receiving broadcast signals may be additionally provided on the side surface of the terminal body. The antenna 116 constituting a part of the broadcast receiving module 111 (see FIG. 1) can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the main body of the terminal or may be detachable from the outside of the main body of the terminal.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may be of a light transmission type like the display unit 151 (see FIG. 2A). In addition, a rear display unit for outputting visual information may be additionally mounted on the touch pad 135. In this case, information output from both the front display unit 151 and the rear display unit may be controlled by the touch pad 135.

The touch pad 135 operates in correlation with the display unit 151. [ The touch pad 135 may be located parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Hereinafter, a mechanism for converting multimedia content by applying cloud computing to a mobile terminal according to the present invention will be described in detail. Here, cloud computing refers to a service that provides a user with a computing resource that is built by integrating a plurality of physical servers into one virtual server (cloud or cloud server).

3 is a block diagram illustrating a content conversion system 1000 according to an exemplary embodiment. Referring to FIG. 3, the content conversion system 1000 includes a playback device 1100, a mobile terminal 1200, and a cloud server 1300 that provides a cloud computing service.

The playback device 1100 is configured to play multimedia content such as music and video (hereinafter, referred to as "content") in a predetermined playback format. The playback device 1100 records information on a format for playing content (hereinafter referred to as "playback information"), address information of a server that provides playback information, detailed information about the playback device 1100, and the like. The cord 1110 may be provided. For example, the code 1110 may be attached to a part of the main body of the playback device 1100 in the form of a bar code or a Quick Response (QR) code.

The playback information of the playback device 1100 may include a resolution, a video format, an audio format, and the like supported by the playback device 1100. The reproduction information may be variously determined for each reproduction device that reproduces the content. Therefore, when the content is configured in a playback format that is not supported by the playback device 1100, it is necessary to convert the content to match the playback format supported by the playback device 1100. This means that the playback information can be used to convert the content. Table 1 below shows examples of playback information supported by various playback devices.

Playback device resolution Video format Audio format Digital TV Full HD 1920x1080 H.264 / AVC AAC + tablet HD 1280x720 H.264 / AVC AAC + Smartphone WVGA 800x480 H.264 BP AAC PMP 480 x 272 MPEG-4 SP / ASP MP3 Projector XGA 1024x768 MPEG-4 SP / ASP MP3 Notebook computer HD + 1600x900 H.264 / AVC AAC Digital photo frame SVGA 800x600 MPEG-4 MP3

The playback device 1100 may include a communication tag 1120 in which playback information is stored. For example, the communication tag 1120 may be mounted outside or inside the playback device 1100.

The communication tag 1120 is a medium that stores tag information corresponding thereto. Tag information according to an embodiment of the present invention may include playback information of the playback device 1100. The communication tag 1120 may provide tag information using RFID, Near Field Communication (NFC), or the like. In this case, the communication tag 1120 may be called an RFID tag, an NFC tag, or the like.

Adjacent magnetic field communication refers to short-range wireless communication technology that transmits data between mobile terminals at low power at a distance, for example, 10 cm to hundreds of meters. Adjacent magnetic field communication is a variant of RFID that uses frequencies in the 13.56 MHz band and transmits data at 424 Kbits (424 Kbps) per second. Near field communication is specified in accordance with ISO / IEC, ECMA, and ETSI international standards and is compatible with Bluetooth, Wi-Fi / 802.11, and UWB.

The adjacent magnetic field communication may be divided into a passive communication mode and an active communication mode. In the passive communication mode, an initiator forms an RF field and a target responds by applying a load modulation scheme to the command of the transmitter. On the other hand, in the active communication mode, both the transmitter and the target communicate by forming an RF field.

The mobile terminal 1200 may include a photographing unit (not shown) such as a camera to capture an image by capturing the playback device 1100. The mobile terminal 1200 may include a code 1110 when the acquired image includes a code 1110 related to the playback device 1100, for example, a code 1110 on which playback information of the playback device 1100 is recorded. ), The playback information can be detected.

If the mobile terminal 1200 cannot detect the playback information by reading the code 1110, the mobile terminal 1200 may obtain the playback information through other means. For example, the mobile terminal 1200 reads the code 1110 and provides address information of a server (hereinafter, referred to as a device information provision server, which is not shown) that provides information related to the playback device 1100 (eg, not shown). : URL) can be detected. Thereafter, the mobile terminal 1200 may access the device information providing server using the address information and receive the reproduction information from the device information providing server. In addition, the mobile terminal 1200 may receive the reproduction information from the communication tag 1120 mounted on the reproduction device 1100 through adjacent magnetic field communication. In addition, the mobile terminal 1200 may apply the object recognition function to the obtained image, and detect the playback information from the internal or external database DB using the recognition information obtained as the object recognition result.

The mobile terminal 1200 may transmit the acquired image and the recognition information to the device information providing server, and receive playback information from the device information providing server in response thereto. This means that the device information providing server may receive the obtained image and recognition information from the mobile terminal 1200 and detect the corresponding reproduction information in the database using the obtained image and recognition information.

The mobile terminal 1200 may request the cloud server 1300 to convert content selected by the user. The content to be converted in response to the conversion request of the mobile terminal 1200 may be stored in the mobile terminal 1200 or the cloud server 1300. When the content to be converted is stored in the mobile terminal 1200, the mobile terminal 1200 may transmit the content to be converted to the cloud server 1300. On the other hand, when the content to be converted is stored in the cloud server, the mobile terminal 1200 may transmit identification information about the content to the cloud server 1300, and the content to be converted may be designated by the identification information.

The cloud server 1300 may convert the content using the reproduction information transmitted from the mobile terminal 1200 so that the content can be reproduced in the reproduction device 1100. The cloud server 1300 may transmit the converted content to the playback device 1100.

As described above, according to the content conversion system according to the present invention, the mobile terminal 1200 detects the reproduction information by using the captured image of the reproduction device 1100, and the cloud server 1300 uses the reproduction information to reproduce the content. Can be converted.

As a result, the user can easily obtain the playback information necessary for the content conversion by photographing the playback device 1100 to reproduce the content using the mobile terminal 1200. In addition, in converting the content, the resources of the cloud server 1300 is utilized instead of the resources of the mobile terminal 1200, thereby reducing constraints on storage space, power consumption, etc., and also improving the performance (time required) of the conversion operation. have.

4 is a flowchart illustrating a content conversion method according to an embodiment of the present invention. Referring to FIG. 4, the content conversion method includes a step in which the mobile terminal 1200 acquires an image by capturing the playback device 1100 (S110). The obtained image may include a code related to the playback device 1100. In this code, playback information of the playback device 1100, address information of the device information providing server, and the like may be recorded.

Next, the mobile terminal 1200 detects the playback information using the obtained image (S120). A detailed method of detecting the reproduction information will be described in more detail with reference to FIG. 6 below.

Thereafter, the mobile terminal 1200 transmits the detected playback information to the cloud server 1300 (S130), and the cloud server 1300 uses the playback information transmitted from the mobile terminal 1200 to transmit content. The conversion step S140 is performed. That is, the content may be converted into a format that can be reproduced by the playback device 1100. For example, if the playback device 1100 photographed by the mobile terminal 1200 is a digital TV, the content is a playback format in which the resolution is Full HD 1920x1080, the video format is H.264 / AVC, and the audio format is AAC +. Can be converted to have.

Next, the cloud server 1300 transmits the converted content to the playback device 1100 (S150), and the playback device 1100 plays the converted content (S160).

Also, although not shown in the drawing, when the playback format of the converted content is supported by the mobile terminal 1200 as well as the playback device 1100, the cloud server 1300 transfers the converted content to the mobile terminal 1200. Can transmit As a result, the converted content may also be played in the mobile terminal 1200.

Hereinafter, the mobile terminal 1200 applied to the above-described content conversion system will be described in more detail.

FIG. 5 is a block diagram schematically illustrating the mobile terminal 1200 illustrated in FIG. 3. Referring to FIG. 5, the mobile terminal 1200 includes a communication unit 1210, a photographing unit 1220, a controller 1230, a display unit 1240, and a memory 1250.

The communication unit 1210 may be configured to perform data communication through a wireless Internet network such as Wi-Fi, a 3G data communication network, or the like. For example, the communication unit 1210 may include a wireless internet module (not shown) for wireless internet connection with a cloud server and a device information providing server. The communication unit 1210 may transmit the reproduction information and the content to be converted to the cloud server, and receive the converted content from the cloud server.

The communication unit 1210 may receive the reproduction information from the device information providing server. For example, when detecting the reproduction information by the control unit 1230, the communication unit 1210 may apply the recognition information detected by applying the object recognition function to the captured image and the captured image for the playback device device information providing server And the playback information from the device information providing server in response thereto.

The communication unit 1210 may be configured to perform adjacent magnetic field communication with a playback device or a communication device related thereto. For example, the communication unit 1210 may include a short range communication module (not shown) for receiving the reproduction information from a communication tag mounted inside or outside the reproduction device through adjacent magnetic field communication.

The photographing unit 1220 may be implemented as a camera mounted on the terminal body. The photographing unit 1220 photographs a playback device to obtain an image of the playback device. In this case, a code (for example, a barcode, a QR code, etc.) attached to a part of the playback device may be photographed together. Therefore, the obtained image may include not only a playback device but also a code related to the playback device.

The controller 1230 controls the overall operation of the mobile terminal 1200. The controller 1230 may detect playback information by reading a code included in the obtained image. In addition, the controller 1230 may apply the object recognition function to the acquired image to detect the playback information. In addition, the controller 1230 may receive the playback information from the user when it fails to detect the playback information in the obtained image. A detailed method of detecting the reproduction information will be described in more detail with reference to FIG. 6 below.

The display 1240 may display various information regarding the operation and state of the mobile terminal 1200 through a graphical user interface (GUI). The image acquired by the photographing unit 1220 may be displayed. Accordingly, the user can check whether the playback device and the code have been correctly captured. In addition, the display 1240 may display the reproduction information detected by the controller 1230. In addition, the display 1240 may display list information of playback devices registered in the memory 1250. Such list information may include playback information for a plurality of playback devices.

The memory 1250 registers and stores reproduction information detected by the controller 1230. That is, the memory 1250 may register and store list information of playback devices. In addition, the memory 1250 may store a plurality of applications running in the mobile terminal 1200. For example, the memory 1250 may store an application that performs a thing recognition function.

6 is a flowchart illustrating an embodiment of a method of detecting playback information according to the present invention. Here, the process of detecting the reproduction information by the controller of the mobile terminal will be described in detail.

Referring to FIG. 6, when the captured image of the reproduction apparatus is obtained, the method of detecting the reproduction information includes reading a code included in the obtained image to detect the reproduction information (S121).

In detecting the reproduction information through code reading, step S122 of determining whether or not the code reading has failed may proceed. Success of code reading means normal detection of reproduction information. On the other hand, failure of code reading means that reproduction information cannot be detected through code reading. For example, if the code is not included in the acquired image, or if the code is not correctly recognized due to the deformation, distortion, or the like of the code, the controller may make a failure decision on the code reading. Therefore, when the code reading fails, step S123 of detecting playback information by applying an object recognition function to the obtained image may be performed.

First, when failing to read a code, the controller may detect recognition information by applying an object recognition function to the obtained image. Here, the recognition information may include at least one of the aspect ratio, shape, color, and logo of the playback device.

If the reproduction information matching the recognition information is registered in the memory, the controller may detect the reproduction information from the memory using the recognition information. This means that the reproduction information can be detected through the internal database. In addition, when the reproduction information matching the recognition information is registered in the external storage space such as the device information providing server, the controller may detect the reproduction information in the external storage space using the recognition information. This means that the reproduction information can be detected through an external database.

In detecting playback information through the object recognition function, determining whether the object recognition has failed may be performed (S124). Success of object recognition means normal detection of reproduction information. On the other hand, failure of object recognition means that playback information cannot be detected through object recognition. For example, if recognition information cannot be detected from the acquired image or playback information matching the recognition information is not found, the controller may make a failure determination on object recognition. Therefore, when the object recognition fails, step S123 of receiving playback information from the user may proceed.

7 and 8 are conceptual views illustrating an embodiment of a user interface related to an operation of the mobile terminal 1200 illustrated in FIG. 3.

Referring to FIG. 7, the display 1240 may display list information of playback apparatuses registered in a memory. More specifically, the display 1240 may display playback information to be used for content conversion, that is, icons 1241a and 1242b for selecting a playback device to play the converted content. For example, the first icon 1241a may correspond to the playback information of the first playback device (eg, digital TV), and the second icon 1241b may correspond to the playback information of the second playback device (eg, a smartphone). Can be. Also, the display 1240 may briefly display the first and second reproduction information 1242a and 1242b corresponding to the first and second reproduction apparatuses, respectively.

When the selection of the displayed icons 1241a and 1242b is detected, the controller recognizes the reproduction information corresponding to the selected icon as the reproduction information to be used for content conversion.

The display unit 1240 may display a menu button 1243 for adding a non-registered playback device (or playback information). When the selection of the menu button 1243 is detected, the controller may execute a photographing mode for photographing the playback device.

Referring to FIG. 8, when the photographing mode is executed, the display unit 1240 may display a preview window 1244 for the current photographed image. Accordingly, the user may check the playback apparatus currently photographed and the code attached thereto through the preview window 1244. When a captured image of the playback apparatus is obtained in the photographing mode, the obtained image may be used to detect playback information of the playback apparatus.

The display 1240 may display a category list 1245 of the playback device along with the preview window 1244. If a selection of an item on the category list 1245 is detected, the controller may access a database related to a category of the selected item (hereinafter, referred to as a “selection category”). Accordingly, when photographing a playback device corresponding to a selection category, the search range of a database required for object recognition, that is, the playback device recognition, can be narrowed. As a result, in applying the object recognition function to the acquired image, it is possible to quickly obtain information stored in the database corresponding to the selected category.

According to the embodiment disclosed herein, the above-described method can be implemented by a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

In the mobile terminal disclosed in this specification, the configuration and method of the above-described embodiments are not limitedly applied, but all or some of the embodiments may be selectively combined so that various modifications can be made.

Claims (17)

Photographing, by the mobile terminal, a playback device to obtain an image;
If the code associated with the playback device is included in the obtained image, detecting the playback information of the playback device by reading the code by the mobile terminal;
Transmitting, by the mobile terminal, the playback information to a cloud server; And
And requesting, by the mobile terminal, the cloud server to convert content by using the playback information. The method of claim 1,
Detecting the reproduction information,
If the mobile terminal fails to read the code, detecting, by the mobile terminal, recognition information by applying an object recognition function to the obtained image; And
And when the play information is registered in the memory of the mobile terminal, detecting, by the mobile terminal, the play information in the memory using the recognition information. The method of claim 2,
If the mobile device fails to detect the play information, receiving the play information from a user by the mobile terminal. The method of claim 2,
If the mobile terminal fails to detect the play information, transmitting the obtained image and the recognition information to a device information providing server; And
And receiving, by the mobile terminal, the playback information from the device information providing server in response to the obtained image and the recognition information. The method of claim 2,
And the recognition information includes at least one of aspect ratio, shape, color, model name, manufacturer, and logo of the playback device. The method of claim 1,
And transmitting, by the cloud server, the converted content to the playback device at the request of the mobile terminal. The method of claim 1,
And if the content is not stored in the cloud server but stored in the mobile terminal, transmitting the content to the cloud server by the mobile terminal. The method of claim 1,
And the playback information includes a resolution, a video format, and an audio format supported by the playback device. Playback device;
A mobile terminal for photographing the playback device to acquire an image, and when the code associated with the playback device is included in the obtained image, reading the code to detect playback information of the playback device; And
And a cloud server that receives the playback information from the mobile terminal and converts the content using the playback information so that the content corresponding to the conversion request of the mobile terminal can be played in the playback device. . The method of claim 8,
The mobile terminal includes:
In case of failing to read the code, the recognition information is detected by applying an object recognition function to the obtained image,
And when the reproduction information is registered in the memory, detecting the reproduction information in the memory using the recognition information. The method of claim 8,
The cloud server includes:
And transmit the converted content to the playback device. The method of claim 8,
Providing the device information for receiving the obtained image and the recognition information from the mobile terminal, and transmitting the reproduction information to the mobile terminal when detecting the reproduction information in a database using the obtained image and the recognition information. A content conversion system further comprising a server. A photographing unit which photographs a playback device to obtain an image;
A control unit which reads the code and detects playback information of the playback device when a code related to the playback device is included in the obtained image; And
And a communication unit configured to transmit the reproduction information to the cloud server so that an operation of converting content using the reproduction information may be performed by a cloud server. 13. The method of claim 12,
The control unit,
In case of failing to read the code, the recognition information is detected by applying an object recognition function to the obtained image,
And when the reproduction information is registered in the memory, detecting the reproduction information in the memory using the recognition information. 15. The method of claim 14,
Wherein,
If it fails to detect the reproduction information, the acquired image and the recognition information is transmitted to the device information providing server, and the reproduction information from the device information providing server in response to the obtained image and the recognition information. Mobile terminal, characterized in that for receiving. The method of claim 11,
Wherein,
And the playback information is received from a communication tag associated with the playback device through short-range wireless communication. 13. The method of claim 12,
And a display unit for displaying list information of playback devices registered in the memory.

Images