KR20120122754A - Mobile terminal and code decoding method thereof - Google Patents

Abstract

PURPOSE: A mobile terminal and a code reading method thereof are provided to read patterns included in a photographed image even if a sphere code is photographed in various directions and angles, thereby accurately detecting code information. CONSTITUTION: A photographing unit(121) photographs a sphere code and obtains an image including a part of the sphere code. A controlling unit(180) detects and reads information storing patterns located in a radial shape with a reference pattern as a center and detects code information. The controlling unit reads the detected storing patterns in a clockwise direction or an counter-clockwise direction with the reference pattern as the center. The controlling unit selects the reference pattern among the detected reference patterns based on a relative location of the center of the image and of the reference patterns. [Reference numerals] (110) Wireless communication unit; (111) Broadcasting receiving module; (112) Mobile communication module; (113) Wireless internet module; (114) Local area network module; (115) Location information module; (120) A/V input unit; (121) Camera; (122) Microphone; (130) User input unit; (140) Sensing unit; (141) Proximity sensor; (150) Output unit; (151) Display unit; (152) Sound output module; (153) Alarming unit; (154) Haptic module; (160) Memory; (170) Interface unit; (180) Control unit; (181) Multimedia module; (190) Power supply unit

Description

MOBILE TERMINAL AND CODE DECODING METHOD THEREOF

The present invention relates to a mobile terminal, and more particularly, to a mobile terminal capable of reading a code and a method of reading a code thereof.

A terminal can be divided into a mobile or portable terminal and a stationary terminal depending on whether the terminal is movable or not. The mobile terminal may be further classified into a handheld terminal and a vehicle mount terminal according to whether a user can directly carry it.

As the functions of such terminals are diversified, they are implemented in the form of a multimedia player having complex functions such as photographing and photographing of movies, reproduction of music and video files, games, and broadcasting reception . Further, in order to support and enhance the function of the terminal, it may be considered to improve the structural and software parts of the terminal.

Meanwhile, the terminal may photograph a 1D code such as a barcode and a 2D code such as a QR (Quick Response) code using a camera. In addition, the terminal may be equipped with a program, an application, etc. that can detect the information by reading the photographed code.

An object of the present invention is to provide a mobile terminal capable of reading a code embodied in a three-dimensional solid object and a method of reading a code thereof.

The mobile terminal according to an embodiment of the present invention includes a photographing unit which acquires an image including a portion of the spherical code by photographing a sphere code, and radially around a reference pattern in the obtained image. And a controller configured to detect a plurality of information storage patterns positioned and to detect code information by reading the detected information storage patterns.

The controller may read the detected storage patterns in a clockwise or counterclockwise direction based on the one reference pattern. The control unit may detect a plurality of reference patterns in the acquired image and select the one reference pattern among the detected reference patterns based on a relative position of the center of the acquired image and the detected reference patterns. Can be. Here, the one reference pattern may be located at the center of the acquired image or relatively closer to the center of the acquired image than other reference patterns. The plurality of information storage patterns may be located between the one reference pattern and the other reference patterns, respectively.

In some embodiments, each of the plurality of information storage patterns may include a plurality of information storage areas. In this case, the controller may select one of the plurality of information storage areas according to a direction of reading the plurality of information storage patterns, and detect a part of the code information in the selected information storage area.

The plurality of information storage patterns may include a bar code. The code information may include at least one of web page connection information, content request information, and application execution information.

According to another exemplary embodiment of the present invention, a mobile terminal photographs a part of a spherical code having a plurality of reference patterns and a plurality of information storage patterns to capture some of the plurality of reference patterns and some of the plurality of information storage patterns. A capturing unit for acquiring an image, and detecting first to third reference patterns from the acquired image, and using the first to third reference patterns, first and second information storage patterns in the acquired image. And a control unit for detecting code information by reading the first and second information storage patterns. Here, the first information storage pattern may be located between the first and second reference patterns, and the second information storage pattern may be located between the first and third reference patterns.

The first information storage pattern may include first and second information storage areas, and the second information storage pattern may include third and fourth information corresponding to the first and second information storage areas, respectively. It can include a storage area. In this case, when the control unit reads the first information storage pattern before the second information storage pattern, the controller detects the code information in the first and third information storage areas, and selects the second information storage pattern. When reading before the first information storage pattern, the code information may be detected in the second and fourth information storage areas.

The control unit reads the first information storage pattern in a direction crossing the first reference pattern and the second reference pattern, and controls the first information pattern in a direction crossing the first reference pattern and the third reference pattern. 2 The information storage pattern can be read.

The first reference pattern may be located at the center of the acquired image or relatively closer to the center of the acquired image than the second and third reference patterns. The plurality of reference patterns and the plurality of information storage patterns may be displayed on the surface of the spherical code. Here, the plurality of reference patterns may be located at a predetermined interval on a plurality of circumferences (circumferences).

According to an embodiment of the present disclosure, a method of reading a code of a mobile terminal may include: obtaining an image including a portion of the rectangular code by photographing a rectangular code; and a plurality of radially positioned centers on a reference pattern in the acquired image Detecting the information storage patterns of C; and detecting code information by reading the detected information storage patterns.

In the detecting of the code information, the detected information storage patterns may be read in a clockwise or counterclockwise direction about the one reference pattern.

When each of the plurality of information storage patterns includes two information storage areas, in the detecting of the code information, any one of the two information storage areas according to a direction in which the plurality of information storage patterns are read. And a part of the code information can be detected in the selected information storage area.

The detecting of the plurality of information storage patterns may include detecting a plurality of reference patterns in the acquired image, based on the relative position of the center of the acquired image and the detected reference patterns. The method may include selecting one of the reference patterns, and detecting the plurality of information storage patterns based on a position of the selected reference pattern.

The code reading method may include extracting web page connection information from the code information, accessing a server providing a web page corresponding to the web page connection information, and reading the web page from the server. The method may further include receiving and displaying the received web page.

The method may further include extracting application execution information from the code information, and executing an application corresponding to the application execution information.

According to the present invention, even if the spherical code is photographed in various directions and angles using the geometric characteristics of the spherical code, the code information may be detected by reading the patterns included in the captured image. Therefore, the detection of code information in the old code is not dependent on the relative position between the old code and the mobile terminal reading the old code.

In addition, when the patterns of the old codes are displayed on the surface of the old code so that different code information is detected according to the direction and angle of shooting the old code, the relative positions between the old code and the mobile terminal for reading the old code may be changed. Code information can be detected.

1 is a block diagram illustrating a mobile terminal according to the present invention.
2A and 2B are perspective views showing an appearance of a mobile terminal according to the present invention.
3 is a block diagram schematically illustrating a code reading system according to an exemplary embodiment of the present invention.
4 is a block diagram schematically illustrating the mobile terminal illustrated in FIG. 3.
5 is a flowchart illustrating a code reading method of a mobile terminal according to an embodiment of the present invention.
FIG. 6 is a flowchart illustrating a method of detecting the information storage patterns illustrated in FIG. 5 in more detail.
7 to 9 are flowcharts for describing embodiments of an additional control operation of the code reading method illustrated in FIG. 5.
10A and 10B are diagrams illustrating examples of the spherical cord 1100 illustrated in FIG. 3 in more detail in different directions.
11A and 11B are diagrams illustrating a mobile terminal 1200 displaying an image including a part of an old code shown in FIG. 3.
12 is a diagram illustrating an example of detected reference patterns and information storage patterns according to an embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings so that those skilled in the art may easily implement the technical idea of the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigator, have. However, it should be understood that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless it is applicable only to a mobile terminal. It will be easy to see.

1 is a block diagram illustrating a mobile terminal 100 according to the present invention. 1, a mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A controller 160, an interface unit 170, a controller 180, and a power supply unit 190. The components shown in Fig. 1 are not essential, so that a mobile terminal having more or fewer components can be implemented.

Hereinafter, the components 110 to 190 of the mobile terminal 100 will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115.

The broadcast receiving module 111 receives broadcast signals and broadcast related information from an external broadcast management server through a broadcast channel. Here, the broadcast related information means information related to a broadcast channel, a broadcast program or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network. In this case, the broadcast-related information may be received by the mobile communication module 112. The broadcast signal and the broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Such wireless signals may include various types of data depending on a voice call signal, a video call signal, a text message, or a multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be embedded in the mobile terminal 100 or externally. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used.

The location information module 115 is a module for acquiring a location of the mobile terminal 100, and a representative example thereof is a GPS (Global Position System) module.

1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal and a video signal, and may include a camera 121, a microphone 122, and the like. The camera 121 processes image frames such as still images and moving images obtained by the image sensor in the video communication mode or the photographing mode. The image frame processed by the camera 121 can be displayed on the display unit 151. [ The image frame may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ More than two cameras 121 may be provided depending on the use environment.

The microphone 122 processes the sound signal input from the outside in the communication mode, the recording mode, the voice selection mode, and the like as electrical voice data. The voice data processed by the microphone 122 in the communication mode can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated when an external sound signal is input.

The user input unit 130 generates input data for controlling the operation of the mobile terminal 100 by a user. The user input unit 130 may be composed of a key pad, a dome switch, a touch pad (static and electrostatic), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as presence or absence of a user, the open / close state of the mobile terminal 100, position, orientation, acceleration, deceleration, And generates a sensing signal. For example, when the mobile terminal 100 is in the form of a slide phone, the sensing unit 140 may detect whether the slide phone is opened or closed. The sensing unit 140 may sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like.

The sensing unit 140 may include a proximity sensor 141. The sensing unit 140 may include a touch sensor (not shown) for sensing a touch operation with respect to the display unit 151.

The touch sensor may have the form of a touch film, a touch sheet, a touch pad, or the like. The touch sensor may be configured to convert a pressure applied to a specific portion of the display portion 151 or a change in capacitance generated at a specific portion of the display portion 151 into an electrical input signal. The touch sensor may be configured to detect a touch pressure as well as a touched position and area.

When the touch sensor and the display unit 151 have a mutual layer structure, the display unit 151 can be used as an input device in addition to the output device. The display unit 151 may be referred to as a 'touch screen'.

If there is a touch input via the touch screen, signals corresponding thereto are sent to a touch controller (not shown). The touch controller processes the signals transmitted from the touch sensor, and then transmits data corresponding to the processed signals to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched.

When the touch screen is capacitive, the touch screen may be configured to detect the proximity of the sensing object by the change of the electric field according to the proximity of the sensing object. Such a touch screen may be classified as proximity sensor 141. [

The proximity sensor 141 refers to a sensor that detects the presence or absence of an object to be sensed without mechanical contact using an electromagnetic force or infrared rays. The proximity sensor 141 has a longer life than the contact type sensor and its utilization is also high. Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

Hereinafter, for convenience of explanation, a proximity action is referred to as " proximity touch " while an object to be sensed does not touch the touch screen, and an action of touching the sensing object on the touch screen is called & touch ".

The proximity sensor 141 detects the presence or absence of a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, The information corresponding to the presence / absence of proximity touch and the proximity touch pattern can be output to the touch screen.

The output unit 150 generates an output related to visual, auditory, tactile, and the like. The output unit 150 may include a display unit 151, an audio output module 153, an alarm unit 154, and a haptic module 155.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal 100 operates in the call mode, the display unit 151 displays a UI (User Interface) or a GUI (Graphic User Interface) related to the call. When the mobile terminal 100 operates in the video communication mode or the photographing mode, the display unit 151 displays the photographed image, the received image, the UI, the GUI, and the like.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT-LCD), an organic light emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

At least one display (or display element) included in the display unit 151 may be configured to be transparent or light transmissive so that the display can see the outside through it. This may be referred to as a transparent display. A representative example of such a transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 in the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. [ For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from each other or positioned integrally with one another, and may be located on different surfaces.

The sound output module 153 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice selection mode, a broadcast reception mode, The sound output module 153 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The sound output module 153 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 154 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events generated in the mobile terminal 100 include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 154 may output a signal for informing occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The display unit 151 and the audio output module 153 may be classified as a part of the alarm unit 154 because the video signal or the audio signal can be output through the display unit 151 or the audio output module 153. [

The haptic module 155 generates various tactile effects that a user can feel. A typical example of the haptic effect generated by the haptic module 155 is vibration. The intensity, pattern, and the like of the vibration generated by the tactile module 155 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 155 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, Various effects can be generated such as the effect of heat generation and the effect of reproducing the cold sensation using the heat absorbing or heatable element.

The haptic module 155 can be configured to not only transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sense of the finger or arm. At least two haptic modules 155 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input and output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data related to vibrations and sounds of various patterns that are output upon touch input on the touch screen.

The memory 160 may be a flash memory, a hard disk, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM) And may include at least one storage medium. The mobile terminal 100 may operate in association with a web storage that performs storage functions of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device, receives power, transfers the power to each component inside the mobile terminal 100, or transmits data inside the mobile terminal 100 to an external device. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, Input / output ports, video I / O ports, earphone ports, and the like.

The identification module is a chip for storing various information for authenticating the usage right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module Universal Subscriber Identity Module (USIM)). A device equipped with an identification module (hereinafter referred to as "identification device") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface unit 170 may be a path through which the power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle or various command signals input from the cradle by the user, (Not shown). The various command signals or power supplied from the cradle may also act as a signal for recognizing that the mobile terminal 100 is correctly mounted in the cradle.

The controller 180 controls the overall operation of the mobile terminal 100. For example, control and processing related to voice calls, data communications, video calls, and the like are performed. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [ The control unit 180 may perform pattern selection processing for selecting handwriting input and drawing input on the touch screen as characters and images, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be applied to various types of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays Microprocessors, microprocessors, and other electronic units for performing other functions, as will be appreciated by those skilled in the art. In some cases, the embodiments described herein may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code may be implemented in a software application written in a suitable programming language. Such software code may be stored in the memory 160 and executed by the controller 180.

Hereinafter, a method of processing user input to the mobile terminal 100 will be described.

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100, and may include a plurality of operation units. The operating units may also be referred to as manipulating portions and may be employed in any manner as long as they are operated in a tactile manner by the user's tactile sense.

Various kinds of time information can be displayed on the display unit 151. [ Such visual information can be displayed in the form of letters, numbers, symbols, graphics, icons, and the like, and can be formed as a three-dimensional stereoscopic image. At least one of a character, a number, a symbol, a graphic, and an icon may be displayed in a predetermined arrangement for inputting time information, thereby being implemented as a keypad. Such a keypad may be referred to as a so-called " soft key ".

The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with one another. For example, an output window and an input window may be displayed on the upper and lower portions of the display unit 151, respectively. The output window and the input window are areas allocated for outputting or inputting information, respectively. In the input window, a soft key with a number for inputting a telephone number may be output. When the soft key is touched, the number corresponding to the touched soft key is displayed in the output window. When the operating unit is operated, a call connection to the telephone number displayed in the output window may be attempted, or the text displayed in the output window may be entered into the application.

The display unit 151 or the touch pad may be configured to detect touch scrolling. The user can move the cursor or the pointer positioned on the displayed object, for example, the icon, on the display unit 151 by scrolling the display unit 151 or the touch pad. Further, when the finger is moved on the display unit 151 or the touch pad, the path along which the finger moves may be visually displayed on the display unit 151. [ This will be useful for editing the image displayed on the display unit 151. [

One function of the mobile terminal 100 may be executed in response to a case where the display unit 151 and the touch pad are touched together within a predetermined time range. In the case of being touched together, there may be a case where the user clamps the main body of the mobile terminal 100 using the thumb and index finger. At this time, one function of the mobile terminal 100 to be executed may be activation or deactivation for the display unit 151 or the touch pad, for example.

2A and 2B are perspective views showing an appearance of a mobile terminal 100 according to the present invention. FIG. 2A shows a front side and one side of the mobile terminal 100, and FIG. 2B shows a rear side and the other side of the mobile terminal 100. FIG.

Referring to FIG. 2A, the mobile terminal 100 includes a bar-shaped terminal body. However, the mobile terminal 100 is not limited thereto, and may be realized in various forms such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are movably coupled to each other.

The terminal body includes a case (a casing, a housing, a cover, and the like) that forms an appearance. In the embodiment, the case may be divided into a front case 101 and a rear case 102. A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding of a synthetic resin or may be formed to have a metal material such as stainless steel (STS), titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input unit 130 (see FIG. 1), the microphone 122, the interface 170, can do.

The display unit 151 occupies a main portion of the front case 101. [ The audio output unit 152 and the camera 121 are located in a region adjacent to one end of the display unit 151 and the first user input unit 131 and the microphone 122 are located in a region adjacent to the other end. The second user input unit 132 and the interface 170 may be located on the sides of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100. [ The user input unit 130 may include a plurality of operation units 131 and 132.

The first or second operating units 131 and 132 can receive various commands. For example, the first operation unit 131 can receive commands such as start, end, scroll, and the like. The second operation unit 132 can receive commands such as adjusting the size of the sound output from the sound output unit 152, switching to the touch selection mode of the display unit 151, and the like.

Referring to FIG. 2B, a rear camera 121 'may be additionally mounted on the rear surface of the terminal body, that is, the rear case 102. The rear camera 121 'has a photographing direction opposite to that of the front camera 121 (see FIG. 2A), and may be configured to have pixels different from those of the front camera 121.

For example, the front camera 121 may be configured to have a low pixel, and the rear camera 121 'may be configured to have a high pixel. Accordingly, when the front camera 121 is used during a video call, the size of the transmission data may be reduced when the user's face is photographed and transmitted to the counterpart in real time. On the other hand, the rear camera 121 'can be used for the purpose of storing a high-quality image.

Meanwhile, the cameras 121 and 121 'may be installed in the terminal body so as to be rotated or popped up.

The flash 123 and the mirror 124 may be further positioned adjacent to the rear camera 121 '. The flash 123 emits light toward the subject when the user photographs the subject with the rear camera 121 '. The mirror 124 illuminates the user's face when the user photographs himself (self-photographing) using the rear camera 121 '.

A rear sound output unit 152 'may be additionally disposed on the rear surface of the terminal body. The rear sound output unit 152 ′ may perform a stereo function together with the front sound output unit 152 (see FIG. 2A), and may perform a speakerphone function during a call.

In addition to the antenna for communication, an antenna 116 for receiving broadcast signals may be additionally provided on the side surface of the terminal body. The antenna 116 constituting a part of the broadcast receiving module 111 (see FIG. 1) can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the main body of the terminal or may be detachable from the outside of the main body of the terminal.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may be of a light transmission type like the display unit 151 (see FIG. 2A). In addition, a rear display unit for outputting visual information may be additionally mounted on the touch pad 135. In this case, information output from both the front display unit 151 and the rear display unit may be controlled by the touch pad 135.

The touch pad 135 operates in correlation with the display unit 151. [ The touch pad 135 may be located parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

3 is a block diagram schematically illustrating a code reading system 1000 according to an exemplary embodiment of the present invention. Referring to FIG. 3, the code reading system 1000 includes a sphere code 1100, a mobile terminal 1200, and a server 1300.

The spherical code 1100 is a code in which a plurality of reference patterns and a plurality of information storage patterns are displayed on a surface of a spherical object. Here, the reference patterns provide reference positions for detecting the information storage patterns, and the information storage patterns store code information in a form readable by the mobile terminal 1200. The spherical cord 1100 will be described in more detail with reference to FIGS. 10A-10B below.

The mobile terminal 1200 acquires an image including a part of the old code 1100 by photographing the old code 1100. In this case, the mobile terminal 1200 may acquire an image including different reference patterns and positive storage patterns according to the direction in which the old code 1100 is photographed. The mobile terminal 1200 detects reference patterns in the obtained image, and detects information storage patterns using the detected reference patterns. The mobile terminal 1200 detects and outputs code information by reading the detected information storage patterns.

When the detected code information includes web page connection information such as a URL, the mobile terminal 1200 may access a server 1300 that provides a web page corresponding to the web page connection information. Therefore, the mobile terminal 1200 may receive a web page provided by the server 1300 using the detected code information and display it.

In addition, when the detected code information includes content request information, the mobile terminal 1200 may access a server 1300 that provides content corresponding to the content request information. Therefore, the mobile terminal 1200 may receive the content provided by the server 1300 using the detected code information and display it.

In addition, when the detected code information includes application execution information, the mobile terminal 1200 may execute an application corresponding to the application execution information.

When the server 1300 receives the code information from the mobile terminal 1200, the server 1300 provides the web terminal, content, and the like corresponding to the received code information to the mobile terminal 1200. Here, the content may include a specific place, guide information on a work, production, distribution, price information, etc. on a specific product.

4 is a block diagram schematically illustrating the mobile terminal 1200 illustrated in FIG. 3. Referring to FIG. 4, the mobile terminal 1200 includes a communication unit 1210, a photographing unit 1220, a display 1251, a memory 1260, and a controller 1280.

The communication unit 1210 transmits code information obtained by reading an old code to a server, and receives a web page, content, and the like corresponding to the code information from the server. The communication unit 1210 may access a server through a wireless Internet network such as Wi-Fi, a 3G data communication network, or the like.

The photographing unit 1220 acquires a 2D planar image by photographing a part of a spherical code having a plurality of reference patterns and a plurality of information storage patterns. In this case, the acquired image may include other reference patterns and information storage patterns according to the photographing direction, angle, and the like. For example, the images obtained by photographing the spherical code from up, down, left, and right may include different reference patterns and information storage patterns. In an embodiment, the photographing unit 1220 may be implemented as a camera mounted on the terminal body.

The display 1125 may display an image acquired by the photographing unit 1220. Accordingly, the user can check which part of the old code is photographed. The display 1125 may display code information detected by the controller 1280.

Meanwhile, when the code information includes web page connection information and content request information, the display unit 1251 may display a web page corresponding to the web page connection information, content corresponding to the content request information, and the like.

The memory 1260 may store a program or an application associated with the same to capture an old code, acquire an image, detect patterns in the acquired image, read the detected patterns, and the like. In addition, the memory 1260 may store an image acquired by the photographing unit 1220, a web page corresponding to code information, content, and the like.

The controller 1280 controls the overall operation of the mobile terminal 1000. The controller 1280 detects reference patterns in the image acquired by the photographing unit 1220, detects information storage patterns using the detected reference patterns, and detects code information by reading the detected information storage patterns.

More specifically, the controller 1280 selects one reference pattern among the detected reference patterns based on the relative position of the center of the acquired image and the reference patterns. For example, the controller 1280 selects one reference pattern positioned at the center of the acquired image or located relatively closer to the center of the acquired image than other reference patterns. The controller 1280 detects information storage patterns radially positioned based on the selected reference pattern based on the position of the selected reference pattern. For example, the controller 1280 detects information storage patterns positioned between the selected reference pattern and other reference patterns, respectively. The controller 1280 may read the detected information storage patterns in a clockwise or counterclockwise direction based on the selected reference pattern.

In an embodiment of the present disclosure, each of the information storage patterns of the old code may include a plurality of information storage areas. For example, each information storage pattern for storing 16 bits of data may include two information storage areas for storing 8 bits of data.

In this case, the controller 1280 may select any one of the information storage areas of each information storage pattern according to the direction of reading the information storage patterns, and detect a part of the code information in each selected information storage area. . This will be described in more detail with reference to FIG. 12 below.

The controller 1280 may control the display 1125 to display the detected code information, and control the memory 1260 to store the detected code information. In addition, the controller 1280 may extract web page connection information, content request information, application execution information, and the like from the detected code information. The controller 1280 may control the communicator 1210 to transmit webpage connection information and content request information to a server. The controller 1280 may control the display unit 1251 to display a web page corresponding to the web page connection information and content corresponding to the content request information. The controller 1280 may read an application corresponding to the application execution information from the memory 1260 and execute it.

As described above, according to the present invention, even if the spherical code is photographed in various directions and angles using the geometric characteristics of the spherical code, the code information may be detected by reading the patterns included in the captured image. Therefore, the detection of code information in the old code is not dependent on the relative position between the old code and the mobile terminal reading the old code.

In addition, when the patterns of the old codes are displayed on the surface of the old code so that different code information is detected according to the direction and angle of shooting the old code, the relative positions between the old code and the mobile terminal for reading the old code may be changed. Code information can be detected.

According to the present invention, according to the direction and angle of viewing the exhibits, performances, monuments, works of art (hereinafter referred to as 'viewing object'), the old codes are mapped to information corresponding to the exhibition halls, performance halls, historic sites, museums, etc. Available in place. In this case, the spherical code may be photographed in various directions and angles, and the pattern detected in the photographed image may be read to obtain information about a viewing object viewed at an angle and a direction corresponding to the photographing angle and the photographing direction.

5 is a flowchart illustrating a code reading method of a mobile terminal according to an embodiment of the present invention. Referring to FIG. 5, the code reading method includes photographing a rectangular code having a plurality of reference patterns and a plurality of information storage patterns to obtain an image including a portion of the rectangular code (S110). The obtained image may include other reference patterns and information storage patterns according to the direction and angle of photographing the spherical code.

Next, a step (S120) of detecting a plurality of information storage patterns radially positioned with respect to one reference pattern in the acquired image is performed. Here, the information storage patterns may be implemented by a barcode. Each of the information storage patterns may include two information storage areas. The method of detecting the information storage patterns will be described in more detail with reference to FIG. 6 below.

After detecting the information storage patterns, step S130 of detecting the code information by reading the detected information storage patterns is performed. More specifically, any one of the information storage areas corresponding to each information storage pattern is selected according to the direction in which the information storage patterns are read (for example, clockwise or counterclockwise about one reference pattern). A portion of the code information is detected in each selected information storage area. This will be described in more detail with reference to FIG. 12 below.

Thereafter, the step of displaying the detected code information is performed (S140). For example, the display unit may convert the code information into text, an image, or the like and display it.

FIG. 6 is a flowchart illustrating a method of detecting the information storage patterns illustrated in FIG. 5 in more detail. Referring to FIG. 6, in order to detect the information storage patterns, a step (S121) of detecting a plurality of reference patterns in the obtained image is performed.

Next, a step (S122) of selecting one reference pattern among the detected reference patterns is performed based on the relative position of the center of the acquired image and the detected reference patterns. For example, a reference pattern positioned at the center of the acquired image or relatively closer to the center of the acquired image than other reference patterns may be selected.

Thereafter, a step (S123) of detecting a plurality of storage patterns based on a position in the selected reference pattern is performed. More specifically, storage patterns radially located about the selected reference pattern may be detected. This means that the storage patterns respectively located between the selected reference pattern and the other reference patterns are detected.

7 to 9 are flowcharts for describing embodiments of an additional control operation of the code reading method illustrated in FIG. 5.

Referring to FIG. 7, an additional control operation for a case where code information includes web page connection information is illustrated. First, a step (S210) of extracting web page connection information from code information is performed. Here, the webpage connection information may include address information of a server providing a webpage, for example, a URL.

After the webpage connection information is extracted, a step (S220) of accessing a server providing a webpage corresponding thereto is performed. In this case, the mobile terminal may access the server through the wireless Internet by using the webpage connection information.

Next, a step (S230) of receiving a web page corresponding to the web page connection information from the server and displaying the received web page (S240) are performed. For example, the communication unit may receive a web page from the server, deliver the received web page to the display unit, and the display unit may display the received web page.

Referring to FIG. 8, an additional control operation for the case where code information includes content request information is illustrated. First, a step (S310) of extracting content request information from code information is performed. Here, the content request information may include address information of a server providing content such as an MP3, an image, a video, and identification information about content.

After the content request information is extracted, a step (S320) of accessing a server providing content corresponding thereto is performed. In this case, the mobile terminal may access the server through the wireless Internet by using the content request information.

Next, a step of receiving content corresponding to the content request information from the server (S330) and outputting the received content (S340) are performed. For example, the communication unit may receive the content from the server, transfer the received content to the display unit or the sound output module, and the display unit or the sound output module may output the received content.

Referring to FIG. 9, an additional control operation for the case where the code information includes application execution information is shown. First, an operation (S410) of extracting application execution information from code information is performed. Next, an operation (S420) of executing an application corresponding to the application execution information is performed.

Here, the application may include a web browser for displaying a web page, and a multimedia player for playing contents such as an MP3, an image, a video, and the like.

10A and 10B are diagrams illustrating examples of the spherical cord 1100 illustrated in FIG. 3 in more detail in different directions. FIG. 10A is a front view of spherical cord 1100 and FIG. 10B is a top view of spherical cord 1100.

The spherical code 1100 is composed of a spherical object on which a plurality of reference patterns and a plurality of information storage patterns are displayed. Although reference patterns are illustrated in a circle in the drawing, the present disclosure is not limited thereto, and the reference patterns may be variously modified.

10A and 10B, two reference patterns 1110 and 1112 are positioned at the anodes of the spherical object, respectively. A plurality of circumferences intersect at regular intervals at the anode of the spherical object. For example, if four circumferences intersect at the anode of a spherical object, the surface of the spherical object may be divided into eight equal parts by the circumferences. That is, the surface of a spherical object can be divided into eight by eight semi-circles.

The remaining reference patterns other than the reference patterns 1110 and 1112 positioned at the anodes of the spherical object may be located at equal intervals on these (semi) circles. For example, the three reference patterns 1114, 1116, 1118 may be located at equal intervals on the semicircle. Likewise, reference patterns may be located on other semicircles. In this case, eight reference patterns are positioned on the outline of each of the three cross sections which are divided into quadrants between the anodes of the spherical object.

Each information storage pattern is located between two reference patterns. For example, eight information storage patterns may be located between the reference pattern 1110 located at the pole and the eight reference patterns adjacent thereto. In addition, the other eight information storage patterns may be located between eight reference patterns neighboring the reference pattern 1110 located at the pole.

The information storage patterns may be implemented with a barcode, as shown. However, the information storage patterns are not limited thereto and may be modified in various forms. For example, the information storage patterns may be implemented by two-dimensional code including a plurality of data cells.

11A and 11B are diagrams illustrating a mobile terminal 1200 displaying an image including a part of an old code shown in FIG. 3.

When an image including a part of a spherical code is obtained by a photographing unit (not shown), the display unit 1251 may display the obtained image. The controller (not shown) detects a plurality of reference patterns in the obtained image. The controller may select one reference pattern among the detected reference patterns based on the relative position of the center of the acquired image and the detected reference patterns.

For example, as illustrated in FIG. 11A, the controller may select the reference pattern 1261 positioned at the center of the acquired image. The controller detects eight information storage patterns radially positioned around the selected reference pattern 1261. That is, the controller may detect information storage patterns positioned between the selected reference pattern 1261 and eight reference patterns adjacent thereto.

For another example, as illustrated in FIG. 11B, the controller may select a reference pattern 1262 located relatively closer to the center of the acquired image than other reference patterns. The controller may detect four information storage patterns radially positioned around the selected reference pattern 1262. That is, the controller may detect information storage patterns positioned between the selected reference pattern 1262 and four reference patterns neighboring the selected reference pattern 1262.

11A and 11B, the controller may detect code information by reading the detected information storage patterns clockwise (or counterclockwise). The method of detecting code information will be described in more detail with reference to FIG. 12 below.

12 is a diagram illustrating an example of detected reference patterns and information storage patterns according to an embodiment of the present invention. As shown in the figure, five reference patterns 211 to 225 and four information storage patterns 220 to 250 may be detected. The detected information storage patterns 220 to 250 may be located between the first reference pattern 211 and the second to fifth reference patterns 212 to 215, respectively.

In an embodiment, each of the information storage patterns 220 to 250 may include two information storage areas 221, 222, 231, 232, 241, 242, 251, and 252. That is, the first information storage pattern 220 refers to the first and second information storage regions 221 and 222, and the second information storage pattern 230 refers to the third and fourth information storage regions 231 and 232. The third information storage pattern 240 may include fifth and sixth information storage regions 241 and 242, and the fourth information storage pattern 250 may include seventh and eighth information storage regions 251 and 252, respectively. Can be. Each of the first to fourth information storage patterns 220 to 250 may be implemented as a barcode that stores 16 bits of data. In this case, the first to eighth information storage areas 221, 222, 231, 232, 241, 242, 251, and 252 may each store 8 bits of data.

The first to fourth information storage patterns 220 to 250 may be read in a clockwise or counterclockwise direction. That is, the first information storage pattern 220 crosses the first reference pattern 211 and the second reference pattern 212, and the second information storage pattern 230 is connected to the first reference pattern 211. In a direction intersecting between the third reference pattern 213, the third information storage pattern 240 is in a direction intersecting between the first reference pattern 211 and the fourth reference pattern 214. 250 may be read in a direction crossing the first reference pattern 211 and the fifth reference pattern 215, respectively.

Any one of the information storage areas of each information storage pattern may be selected according to the direction in which the information storage patterns 220 to 250 are read. For example, an information storage area that is first read out of two information storage areas of each information storage pattern may be selected. A part of the code information can be detected in each selected information storage area, and the reading process can be skipped for the other information storage area. If all of the selected information storage areas are repeatedly read, the entire code information can be detected.

More specifically, when the first to fourth information storage patterns 220 to 250 are read in the clockwise direction, the first, third, fifth, and seventh information storage areas 221, 231, 241, and 251 are selected. Code information can be detected from these. On the other hand, when the first to fourth information storage patterns 220 to 250 are read in the counterclockwise direction, the second, fourth, sixth, and eighth information storage areas 222, 232, 242, and 252 are selected. From this, code information can be detected.

According to the embodiment disclosed herein, the above-described method can be implemented by a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

In the mobile terminal disclosed in this specification, the configuration and method of the above-described embodiments are not limitedly applied, but all or some of the embodiments may be selectively combined so that various modifications can be made.

Claims (20)

A photographing unit which photographs a sphere code to obtain an image including a portion of the sphere code; And
And a controller configured to detect a plurality of information storage patterns radially positioned around the one reference pattern in the obtained image, and detect code information by reading the detected information storage patterns. The method of claim 1,
The control unit,
And the detected storage patterns are read in a clockwise or counterclockwise direction about the one reference pattern. The method of claim 1,
The control unit,
And detecting a plurality of reference patterns from the acquired image, and selecting the one reference pattern among the detected reference patterns based on a relative position of the center of the acquired image and the detected reference patterns. terminal. The method of claim 3, wherein
The one reference pattern is located in the center of the acquired image or a mobile terminal, characterized in that located relatively closer to the center of the acquired image than other reference patterns. The method of claim 3, wherein
And the plurality of information storage patterns are located between the one reference pattern and the other reference patterns, respectively. The method of claim 1,
Each of the plurality of information storage patterns includes a plurality of information storage areas,
The control unit,
And selecting one of the plurality of information storage areas according to a direction in which the plurality of information storage patterns are read, and detecting a part of the code information in the selected information storage area. The method of claim 1,
And the plurality of information storage patterns include a bar code. The method of claim 1,
The code information includes at least one of web page connection information, content request information, and application execution information. A photographing unit which photographs a part of a spherical code having a plurality of reference patterns and a plurality of information storage patterns to obtain an image including some of the plurality of reference patterns and some of the plurality of information storage patterns; And
Detecting first to third reference patterns from the acquired image, Detecting first and second information storage patterns from the acquired image using the first to third reference patterns, The first and second A control unit for detecting code information by reading an information storage pattern;
And the first information storage pattern is located between the first and second reference patterns, and the second information storage pattern is located between the first and third reference patterns. The method of claim 9,
The first information storage pattern includes first and second information storage regions, and the second information storage pattern includes third and fourth information storage regions respectively corresponding to the first and second information storage regions. ,
The control unit,
When the first information storage pattern is read before the second information storage pattern, the code information is detected in the first and third information storage regions,
And when the second information storage pattern is read before the first information storage pattern, the code information is detected in the second and fourth information storage areas. The method of claim 9,
The control unit,
Reading the first information storage pattern in a direction intersecting between the first reference pattern and the second reference pattern,
And the second information storage pattern is read in a direction crossing between the first reference pattern and the third reference pattern. The method of claim 9,
And the first reference pattern is located at the center of the acquired image or relatively closer to the center of the acquired image than the second and third reference patterns. The method of claim 9,
The plurality of reference patterns and the plurality of information storage patterns are displayed on the surface of the spherical code. The method of claim 13,
And the plurality of reference patterns are located at a predetermined interval on a plurality of circumferences. Photographing a spherical code to obtain an image including a portion of the spherical code;
Detecting a plurality of information storage patterns radially positioned around a reference pattern in the obtained image; And
And detecting code information by reading the detected information storage patterns. The method of claim 15,
In the detecting of the code information,
And the detected information storage patterns are read in a clockwise or counterclockwise direction about the one reference pattern. 17. The method of claim 16,
Each of the plurality of information storage patterns includes two information storage areas;
In the detecting of the code information,
Selecting one of the two information storage areas according to the direction of reading the plurality of information storage patterns, and a part of the code information is detected in the selected information storage area. . The method of claim 15,
Detecting the plurality of information storage patterns,
Detecting a plurality of reference patterns in the obtained image;
Selecting the one reference pattern among the detected reference patterns based on the relative position of the center of the acquired image and the detected reference patterns; And
Detecting the plurality of information storage patterns based on the position of the selected reference pattern. The method of claim 15,
Extracting web page connection information from the code information;
Accessing a server providing a web page corresponding to the web page connection information;
Receiving the web page from the server; And
And displaying the received web page. The method of claim 15,
Extracting application execution information from the code information; And
And executing an application corresponding to the application execution information.

Images