KR20120014751A - Mobile terminal and control method therof - Google Patents

Abstract

PURPOSE: A mobile terminal and a control method thereof are provided to acquire the information of a wireless AP close to a fixed point to overlap on an acquired image. CONSTITUTION: A display(151) displays an acquired image through a camera(121). A control unit(180) acquires at least one wireless AP information, which is close to at least one point set by a wireless communication unit(110). The control unit overlaps at least a part of the wireless AP information based on the wireless AP information.

Description

MOBILE TERMINAL AND CONTROL METHOD THEROF}

The present invention relates to a mobile terminal and a control method thereof, and more particularly, to obtain information of a wireless AP adjacent to a specific point and display the information superimposed on the obtained image so that the user can intuitively recognize the information related to the wireless AP. The present invention relates to a mobile terminal and a control method thereof.

A terminal such as a personal computer, a notebook computer, or a mobile phone has various functions, for example, a multimedia device having a complex function such as photographing or photographing of a moving picture, reproduction of music or a moving picture file, (Multimedia player).

The terminal can move It may be divided into a mobile terminal and a stationary terminal, depending on whether it is present. The mobile terminal may be further classified into a handheld terminal and a vehicle mount terminal according to whether a user can directly carry it.

In order to support and enhance the functionality of the terminal, it is contemplated to improve the structural and / or software portion of the terminal.

Recently, a variety of terminals including mobile terminals provide a complex and various functions, and the menu structure is also becoming complicated. In addition, a function of displaying various digital documents including a web page is added to a mobile terminal.

The present invention relates to a mobile terminal capable of intuitively recognizing information related to a wireless AP by acquiring information of a wireless AP adjacent to a specific point and superimposing the information on the acquired AP, and a control method thereof.

Mobile terminal according to an embodiment of the present invention for realizing the above object, a wireless communication unit; A camera for acquiring an image; A display for displaying an image acquired through the camera; And obtaining information of at least one wireless access point (AP) adjacent to at least one preset point through the wireless communication unit, and obtaining at least some of the obtained information of the wireless AP based on the obtained wireless AP information. It may include a control unit for superimposing the image.

In addition, a mobile terminal according to an embodiment of the present invention for realizing the above object, a display; A wireless communication unit; And obtaining information of at least one wireless access point (AP) adjacent to at least one preset point through the wireless communication unit, and displaying an available range of the wireless AP included in the obtained wireless AP information on the display. It may include a control unit.

In addition, the control method of the mobile terminal according to an embodiment of the present invention for realizing the above object, the step of obtaining an image from the activated camera; Obtaining at least one wireless AP information from a server; Obtaining information of at least one wireless AP adjacent to at least one preset point; And displaying at least a portion of the obtained information of the wireless AP by overlapping the obtained image.

The mobile terminal and its control method according to the present invention have the effect of allowing the user to intuitively recognize the information related to the wireless AP by acquiring the information of the wireless AP adjacent to a specific point and displaying the information superimposed on the obtained image. .

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2A is a front perspective view of a mobile terminal according to an embodiment of the present invention.
2B is a rear perspective view of a mobile terminal according to an embodiment of the present invention.
2C and 2D are diagrams illustrating implementation forms and display screens of a mobile terminal according to various embodiments of the present disclosure.
3 is a conceptual diagram illustrating a proximity depth of a proximity sensor.
4 is a block diagram of a CDMA wireless communication system for communicating with the mobile terminal shown in FIG.
5 is a flowchart of a mobile terminal according to an embodiment of the present invention.
FIG. 6 is a diagram illustrating an operation of the mobile terminal of FIG. 5.
7 is a signal flow diagram between the mobile terminal and the server of FIG. 5.
FIG. 8 is a diagram illustrating access information of the wireless AP of FIG. 5.
FIG. 9 is a distribution diagram of a wireless AP based on the mobile terminal of FIG. 5.
FIG. 10 is a diagram illustrating an operation screen of the mobile terminal of FIG. 5.
FIG. 11 is a diagram illustrating a screen on which an indicator is displayed in the mobile terminal of FIG. 5.
FIG. 12 is a diagram illustrating a screen on which direction information is displayed in the mobile terminal of FIG. 5.
13 to 15 are diagrams illustrating a screen for converting a wireless AP to be accessed by the mobile terminal of FIG. 5.
FIG. 16 is a diagram illustrating a screen displaying signal strength of a wireless AP in FIG. 5.
FIG. 17 is a diagram illustrating a screen displaying a signal strength of a wireless AP in text on a mobile terminal of FIG. 5.
FIG. 18 is a diagram illustrating a screen displaying an operation range of a wireless AP in FIG. 5.
19 and 20 illustrate screens for acquiring user information connected to a wireless AP in the mobile terminal of FIG. 5.
FIG. 21 is a diagram illustrating an operation range of each wireless AP in the mobile terminal of FIG. 5.
FIG. 22 is a diagram illustrating a state of each wireless AP on a map in the mobile terminal of FIG. 5.
FIG. 23 is a diagram illustrating user information connected to a wireless AP in the mobile terminal of FIG. 5.

The above objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. It is to be understood, however, that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and similarities. Like reference numerals designate like elements throughout the specification. In addition, when it is determined that the detailed description of the known function or configuration related to the present invention may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, the numbers (eg, first, second, etc.) used in the description process of the present specification are merely identification symbols for distinguishing one component from another component.

Hereinafter, a mobile terminal according to the present invention will be described in more detail with reference to the accompanying drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, and the like. However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs, desktop computers, etc., except when applicable only to mobile terminals.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory unit 160, An interface unit 170, a control unit 180, a power supply unit 190, and the like. The components shown in Fig. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video BroadcastHandheld (DVBH).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems. In particular, the broadcast receiving module 111 may be a digital multimedia broadcasting broadcasting (DMBT), a digital multimedia broadcasting satellite (DMBS), a media forward link only (MediaFLO), a digital video broadcasting ), And ISDBT (Integrated Services Digital Broadcast Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems that provide broadcast signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory unit 160.

The mobile communication module 112 transmits and receives a wireless signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and the wireless Internet module 113 can be embedded in the mobile terminal 100 or externally. WLAN (WiFi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data AssCCIation (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. A representative example of the location information module is a GPS (Global Position System) module. According to the current technology, the GPS module 115 calculates information on a distance (distance) from three or more satellites to one point (entity), information on the time when the distance information is measured, , Three-dimensional position information according to latitude, longitude, and altitude of one point (individual) in one hour can be calculated. Furthermore, a method of calculating position and time information using three satellites and correcting the error of the calculated position and time information using another satellite is also used. The GPS module 115 may continuously calculate the current position in real time and use the same to calculate speed information.

Referring to FIG. 1, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory unit 160 or transmitted to the outside through the wireless communication unit 110. The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 140 detects a current state of the mobile terminal 100 such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, presence or absence of a user contact, orientation of the mobile terminal, acceleration / deceleration of the mobile terminal, and the like. To generate a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it may be responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor.

The output unit 150 is used to generate an output related to sight, hearing, or tactile sense, and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154. Can be.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, the mobile terminal displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays photographed and / or received images, a UI, and a GUI.

The display unit 151 may be a liquid crystal display, a thin film transistor liquid crystal display, an organic light emitting diode, a flexible display, a 3D display And may include at least one.

Some of these displays can be configured to be transparent or light transmissive so that they can be seen from the outside. This may be referred to as a transparent display. A representative example of the transparent display is a transparent LCD. The rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see the object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the implementation form of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another, or may be disposed integrally with one another, and may be disposed on different surfaces, respectively.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter, abbreviated as “touch screen”), the display unit 151 is an output device. It can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.

Referring to FIG. 1, a proximity sensor may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by the change of the electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching the pointer on the screen is called "contact touch." The position where the proximity touch is performed by the pointer on the touch screen refers to a position where the pointer is perpendicular to the touch screen when the pointer is in proximity proximity.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory unit 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 outputs an acoustic signal related to a function (e.g., a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The video signal or the audio signal can also be output through the display unit 151 or the audio output module 152.

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

In addition to the vibration, the haptic module 154 may be used for the effects of stimulation by the arrangement of pins vertically moving with respect to the contact skin surface, the effect of the injection force of the air through the injection or inlet or the stimulation through the suction force, and the stimulation that rubs the skin surface. Various tactile effects may be generated, such as effects by stimulation through contact of electrodes, effects by stimulation using electrostatic force, and effects of reproducing a sense of warmth and heat using an endothermic or heat generating element.

The haptic module 154 may not only deliver the haptic effect through direct contact, but also implement the haptic effect through the muscle sense of the user's finger or arm. Two or more haptic modules 154 may be provided according to a configuration aspect of the mobile terminal 100.

The memory unit 160 may store a program for the operation of the controller 180 and may temporarily store input / output data (for example, a phone book, a message, a still image, a video, etc.). The memory unit 160 may store data regarding vibration and sound of various patterns output when a touch input on the touch screen is performed.

The memory unit 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) At least one of a random access memory (RAM), a static random access memory (SRAM), a read only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read- Lt; / RTI > type of storage medium. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory unit 160 on the Internet.

The interface unit 170 serves as a path with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip that stores various types of information for authenticating the usage rights of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identify module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface unit may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various command signals input from the cradle by a user may be moved. It may be a passage that is delivered to the terminal. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. The controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, microcontrollers, microprocessors, and electrical units for performing functions. In some cases such embodiments may be implemented using a controller 180 < / RTI >

In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. Also, the software codes may be stored in the memory unit 160 and executed by the control unit 180. [

2A is a front perspective view of an example of a mobile terminal or a portable terminal according to the present invention.

The disclosed portable terminal 100 has a terminal body in the form of a bar. However, the present invention is not limited thereto and may be applied to various structures such as a slide type, a folder type, a swing type, a swivel type, and two or more bodies are coupled to be relatively movable.

The body includes a casing (casing, housing, cover, etc.) that forms an exterior. In this embodiment, the case may be divided into a front case 101 and a rear case 102. Various electronic components are built in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injecting synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the audio output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, and the interface 170 may be disposed in the terminal body, mainly the front case 101. have.

The display unit 151 occupies most of the main surface of the front case 101. The sound output unit 152 and the camera 121 are disposed in regions adjacent to one end of both ends of the display unit 151, and the user input unit 131 and the microphone 122 are disposed in regions adjacent to the other end. The user input unit 132, the interface 170, and the like are disposed on the side surfaces of the front case 101 and the rear case 102.

The user input unit 130 is manipulated to receive a command for controlling the operation of the portable terminal 100 and may include a plurality of operation units 131 and 132.

The manipulation units 131 and 132 may also be collectively referred to as manipulating portions, and may be employed in any manner as long as the user operates the tactile manner with a tactile feeling.

The contents input by the manipulation units 131 and 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 To the touch recognition mode of the touch screen.

FIG. 2B is a rear perspective view of the portable terminal shown in FIG. 2A.

Referring to FIG. 2B, a camera 121 ′ may be additionally mounted on the rear of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to the camera 121 (see FIG. 2A), and may be a camera having different pixels from the camera 121.

For example, the camera 121 has a low pixel so that the user's face is photographed and transmitted to the counterpart in case of a video call, and the camera 121 'photographs a general subject and does not transmit it immediately. It is desirable to have a high pixel because there are many. The cameras 121 and 121 'may be installed in the terminal body such that they can be rotated or popped up.

A flash 123 and a mirror 124 are further disposed adjacent to the camera 121 '. The flash 123 shines light toward the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to see his / her own face or the like when photographing (self-photographing) the user using the camera 121 '.

The sound output unit 152 'may be further disposed on the rear surface of the terminal body. The sound output unit 152 ′ may implement a stereo function together with the sound output unit 152 (see FIG. 2A), and may be used to implement a speakerphone mode during a call.

In addition to the antenna for a call or the like, a broadcast signal reception antenna 124 may be additionally disposed on the side of the terminal body. The antenna 124 constituting a part of the broadcast receiving module 111 (see FIG. 1) may be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the portable terminal 100 is mounted on the terminal body. The power supply unit 190 may be embedded in the terminal body or may be directly detachable from the outside of the terminal body.

The rear case 102 may be further equipped with a touch pad 135 for sensing a touch. Like the display unit 151, the touch pad 135 may also be configured to have a light transmission type. In this case, if the display unit 151 is configured to output visual information from both sides, the visual information may be recognized through the touch pad 135. The information output on both surfaces may be controlled by the touch pad 135. Alternatively, a display may be additionally mounted on the touch pad 135, and a touch screen may be disposed on the rear case 102.

The touch pad 135 operates in association with the display unit 151 of the front case 101. The touch pad 135 may be disposed in parallel to the rear of the display unit 151. The touch pad 135 may have the same or smaller size as the display unit 151.

2C and 2D illustrate various embodiments of the mobile terminal 100 and the display unit 151.

The display unit 151 may include a first display unit in which display panels are physically divided and a second display unit. In a folding or slide type mobile terminal in which two bodies are hinged or slide, the first display unit (or the main display unit) may be formed on the inner surface or the outer surface of one body, and the second display unit ( Alternatively, the auxiliary display unit and the external display unit may be formed on an inner surface or an outer surface of another body. The secondary display unit is a display unit separate from the mobile terminal, and is detachably connected to the mobile terminal body through an interface means to display data from the mobile terminal 100.

In addition, the display unit 151 may include a first display unit and a second display unit that are logically divided in the display panel as shown in FIG. 2C.

3 is a conceptual diagram illustrating a proximity depth of a proximity sensor.

As shown in FIG. 3, when a pointer such as a user's finger is close to the touch screen, the proximity sensor disposed in or near the touch screen detects this and outputs a proximity signal.

The proximity sensor may be configured to output different proximity signals according to a distance between the proximity-touched pointer and the touch screen (hereinafter referred to as "proximity depth").

A distance at which the proximity signal is output when the pointer approaches the touch screen is referred to as a detection distance. In short, by using a plurality of proximity sensors having different detection distances, the proximity signals output from the proximity sensors are compared, .

In FIG. 3, for example, a cross section of a touch screen on which three proximity sensors capable of sensing three proximity depths is disposed is illustrated. Of course, proximity sensors that detect less than three or more than four proximity depths are also possible.

Specifically, when the pointer is completely in contact with the touch screen (d0), it is recognized as a contact touch. If the pointer is located on the touch screen at a distance less than the distance d1, it is recognized as a proximity touch of the first proximity depth.

If the pointer is located on the touch screen at a distance d1 or less and less than the distance d2, the pointer is recognized as a proximity touch of the second proximity depth. When the pointer is spaced apart from the d2 distance by more than d3 distance on the touch screen, it is recognized as a proximity touch of a third proximity depth. If the pointer is located at a distance d3 or more on the touch screen, it is recognized that the proximity touch is released.

Accordingly, the controller 180 can recognize the proximity touch as various input signals according to the proximity and proximity positions of the pointer to the touch screen, and perform various operation controls according to the various input signals.

Referring to FIG. 4, a CDMA wireless communication system includes a plurality of mobile terminals 100, a plurality of base stations 270, base station controllers BSCs 275, and a mobile switching center. Centers; MSCs, 280). The mobile switching center 280 is configured to be connected to a Public Switch Telephone Network (PSTN) 290. The mobile switching center 280 is also configured to be coupled to the base station controllers 275. The base station controllers 275 are connected to the base stations 270 via backhaul lines. The backhaul lines may be configured according to E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL known to those skilled in the art. It will be apparent to those skilled in the art that the system may include more than one base station controller 275.

Each of the base stations 270 may include one or more sectors and each sector may include an omnidirectional antenna or a specific radially tuned antenna from the base station 270 . Alternatively, each sector may include two antennas for diversity reception. Each base station 270 is configured to accommodate a plurality of frequency assignments, and the frequency assignments may have a specific spectrum (e.g., 1.25 MHz, 5 MHz).

The intersection of sectors and frequency assignments may be referred to as a CDMA channel.

The base stations 27 may also be referred to as base station transceiver subsystems (BTSs). In some instances, the term "base station" may be used to refer collectively to a base station controller 275 and one or more base stations 270. The base stations may also be denoted "cell sites ". Alternatively, individual sectors of a given base station 270 may be referred to as cell sites.

The terrestrial DMB transmitter 295 can broadcast to the mobile terminals 100 operating in the system. The broadcast receiving module 111 of the mobile terminal 100 is generally configured to receive broadcast signals transmitted by the DMB transmitter 295. This may be similarly applied to other types of broadcast and multicast signaling as described above.

4 illustrates various Global Positioning System (GPS) satellites 300. These satellites 300 may track the location of some or all of the mobile terminals 100. Although two satellites are shown, it is apparent to those skilled in the art that the location information can be obtained from more or fewer satellites. Other types of location tracking techniques (e.g., location tracking techniques that may be used in place of or in addition to GPS technology) may be used. If desired, some or all of the GPS satellites 300 may be configured to separately or additionally support satellite DMB transmission.

During operation of the wireless communication system, the base stations 270 receive reverse link signals from a plurality of mobile terminals 100. The mobile terminals 100 may be busy, are sending messages, and are performing other communications. Each reverse link signal received by the base station is processed at the base station. The processed data is transmitted to the connected base station controller 275. The base station controller 275 provides call resource allocation and provides mobility management functionality including orchestration of soft handoffs between the base stations 270. [ ). The base station controllers 275 also transmit the received data to the mobile switching centers (MSCs) 280. The mobile switching center 280 provides additional routing services for interfacing with the public switched telephone network (PSTN) 290. Similarly, the public switched telephone network 290 interfaces with the mobile switching center 280 and the mobile switching center interfaces with the base station controllers 275. The base station controllers 275 in turn control the base stations 270 to transmit forward link signals to the mobile terminals 100.

5 is a flowchart of a mobile terminal according to an embodiment of the present invention, and FIG. 6 is a diagram illustrating an operation of the mobile terminal of FIG. 5.

As shown in these figures, the controller (180 of FIG. 1) of the mobile terminal 100 according to an embodiment of the present invention may enable the step (S10) for activating the camera 121.

The camera 121 may be activated or deactivated by a user's manipulation or a control operation of the controller 180 of FIG. 1. For example, the controller (180 of FIG. 1) is provided in the sensing unit (140 of FIG. 1) is activated or deactivated by the camera 121 according to the sensing value of the posture detection sensor that can detect the posture of the mobile terminal 100. You can do that. The posture detection sensor may be configured of any one or two or more of an acceleration sensor, a gravity sensor, and a geomagnetic sensor. Through the posture detection sensor composed of any one or two or more of an acceleration sensor, a gravity sensor, and a geomagnetic sensor, the controller (180 of FIG. 1) may determine a direction in which the camera 121 is located on the mobile terminal 100. Can be. For example, it means that the controller (180 of FIG. 1) may determine whether the surface where the camera 121 is located in the mobile terminal 100 faces the ground or faces the front / rear parallel to the ground. . When it is determined that the camera 121 faces the ground, the controller (180 of FIG. 1) may deactivate the camera 121 to stop the shooting. In addition, when it is determined that the camera 121 faces the front / rear side parallel to the ground, the controller (180 of FIG. 1) may activate the camera 121 to start shooting. Since the controller (180 of FIG. 1) may adjust the activation / deactivation of the camera 121 according to the posture sensed by the posture detection sensor, the optimized photography may be performed without a user's additional manipulation. Furthermore, the battery 121 may be minimized by operating the camera 121 at the optimized moment.

When the camera 121 is activated, an operation S20 of obtaining an image from the activated camera 121 may be performed.

When the camera 121 is activated, an image may be acquired from the camera 121. That is, the photographing using the camera 121 may be performed. An image captured by the camera 121 may be displayed on the display 61. For example, when the user activates the camera 121 toward the front, it means that an image acquired through the camera 121 may be displayed on the display 61 in real time. Therefore, when the user changes the orientation of the mobile terminal 100, the image captured by the camera 121 may be changed, and thus the image displayed on the display 61 may also be different.

Acquiring the current location information of the mobile terminal 100 may be performed (S20).

Location information, which means information on which the mobile terminal 100 is currently located, may be acquired through the location information module 115 of FIG. 1. That is, the absolute coordinate on the ground of the mobile terminal 100 can be known based on the signal obtained from the satellite. In addition, the location information of the mobile terminal 100 may be known based on the mobile communication signal strength between the base stations. For example, when the mobile terminal 100 is located in an area covered by base stations A, B, and C, a triangulation technique based on the strength of radio waves between the mobile terminal 100 and base stations A, B, and C is used. The position of the mobile terminal 100 can be known.

Acquiring information of the wireless AP (AP) from the server (S of FIG. 7) may be performed (S40).

The server (S of FIG. 7) may have information about a wireless AP (AP). That is, the server (S of FIG. 7) provides location information of the wireless AP (AP) for effective operation of the wireless AP (AP), information about signal strength, utilization rate, number of users, and output range of each wireless AP (AP). You can have The server (S in FIG. 7) may adjust the load between the wireless APs (APs) based on such information. For example, when the connection to a specific wireless AP (P) increases, a user who can access another wireless AP (AP) among the users of the specific wireless AP (AP) is handed over to the other wireless AP (AP). can be handed over.

All or part of the information possessed by the server (S in FIG. 7) can be obtained through the wireless communication unit (110 in FIG. 1). That is, when the mobile terminal 100 requests the necessary information, it means that the server (S of FIG. 7) can transmit a portion of the information it has to the mobile terminal 100.

The information of the wireless AP may be obtained based on the acquired location information of the mobile terminal 100. The wireless AP (AP) of interest to the user may be those around the user. Accordingly, the controller 180 of FIG. 1 may transmit a current position of the mobile terminal 100 and a desired radius to the server (S of FIG. 7).

In operation S50, the acquired information of the obtained wireless AP may be superimposed on the captured image.

The information of the wireless AP may be displayed to overlap the captured image. That is, it means that the information obtained by applying the Augmented Reality (AR) technique can be displayed. For example, when the user photographs the scenery LS with the camera 121, the image may be displayed on the display 151. In addition, the information displayed at this time may be displayed with a perspective as if photographed together with the camera 121. In addition, when the photographing direction is changed, information on the wireless AP included in the changed photographing direction may be displayed instead of the previous information.

The displayed information of the wireless AP may be represented by an icon indicating the location of the wireless AP and its signal strength. That is, the signal strength can be visually displayed by displaying an icon at the position where the wireless AP is located and changing the shape of the icon. In addition, as will be described in detail in the corresponding part, the displayed information may vary.

7 is a signal flow diagram between the mobile terminal and the server of FIG. 5.

As shown in the drawing, the mobile terminal 100 according to an embodiment of the present invention may set the search range of the wireless AP (AP) (S42).

The controller (180 of FIG. 1) of the mobile terminal 100 may set a range of a wireless AP (AP) to search. The range of the wireless AP (AP) to search may be set based on the current location of the mobile terminal 100. For example, it may be set in a manner such as a radius from the current position of the mobile terminal 100. Alternatively, the user may set a specific point and / or search radius.

On the basis of the set search range, step S44 of requesting information of the wireless AP (AP) to the server S may proceed. The request for information to the server S may be made through the wireless communication unit (110 of FIG. 1).

The server S, which has received the information of the wireless AP, may perform the step S46 of searching the information DB of the wireless AP.

In the server S, there may be an information DB for managing information on the wireless AP (AP) managed by the server (S). The information DB may record the location, signal strength, utilization, number of accessors, output range, etc. of each wireless AP (AP). The server S may search for information on the wireless AP corresponding to the search range received from the mobile terminal 100.

In operation S49, the mobile terminal 100 transmits the retrieved information about the wireless AP.

The mobile terminal 100 may proceed to step S49 of scanning a wireless AP (AP) around the mobile terminal 100.

The mobile terminal 100 may actually scan a wireless AP (AP) around the mobile terminal 100 using the wireless Internet module (113 of FIG. 1). That is, it means that the actual wireless Internet propagation environment around the mobile terminal 100 can be scanned.

In operation S50, the wireless AP may be displayed.

The controller (180 of FIG. 1) may collect the information transmitted from the server S and the information scanned in reality and display it on the display (151 of FIG. 6). Wireless AP (AP) may be displayed in augmented reality.

FIG. 8 is a diagram illustrating access information of the wireless AP of FIG. 5.

As shown in the drawing, the mobile terminal 100 according to an embodiment of the present invention can obtain information related to MAC address, signal strength, usage rate, number of users, output range, etc. from the server S.

The MAC address is a unique address assigned to each wireless AP (AP1 to AP5). Access to the Internet can be made based on the MAC address. Since the MAC address is a unique address assigned to each device, it may serve as an identifier for each wireless AP (AP1 to AP5). That is, when the information acquired from the server (S of FIG. 7) matches the information scanned by the mobile terminal 100 itself, if the MAC address is the same, it may be determined as the same wireless AP.

The signal strength may be the strength of a wireless signal output by each wireless AP (AP1 to AP5). For example, it may be an output that can be output in the design of each wireless AP (AP1 to AP5). Further, the signal strength may actually be the strength of the radio signal output from the radio APs AP1 to AP5.

The usage rate may be a value indicating how much of the available performance of each wireless AP (AP1 to AP5) is currently in use. If there is a wireless AP with 100% utilization, the wireless AP may not be able to access any more. The controller (180 of FIG. 1) of the mobile terminal 100 may access a specific wireless AP in consideration of the usage rate. For example, when there is a wireless AP having a high signal strength but high utilization rate and a wireless AP having a low signal strength but low utilization rate, the controller (180 of FIG. 1) accesses the latter wireless AP to perform wireless communication. Can be lost.

The number of users may represent the number of persons connected to each of the wireless APs AP1 to AP5. Each wireless AP (AP1 to AP5) may be limited in the number of people that can be connected at the same time, depending on the hardware and / or software characteristics. This number can affect utilization.

The output range may be a radius that each wireless AP (AP1 to AP5) can affect. The output range may be an ideal radius of each wireless AP (AP1 to AP5) or may be an output radius in an installed environment.

FIG. 9 is a distribution diagram of a wireless AP based on the mobile terminal of FIG. 5.

As shown in the drawing, first to fifth wireless APs AP1 to AP5 may be arranged around the mobile terminal 100. Such arrangement information can be obtained from a server (S in FIG. 7) or scanned and obtained. In the mobile terminal 100 according to an embodiment of the present invention, the first and second wireless APs AP1 and AP2 may be included in the angle of view VR of the camera (121 of FIG. 6) of the mobile terminal 100. Can be. Accordingly, in the state of FIG. 9, the first and second wireless APs AP1 and AP2 may be displayed on the display 151 of FIG. 6. Hereinafter, the screen configuration and the like will be described in more detail on the premise that the first to fifth wireless APs AP1 to AP5 are arranged as shown in FIG. 9.

FIG. 10 is a diagram illustrating an operation screen of the mobile terminal of FIG. 5.

As shown in the drawing, the first and second wireless APs AP1 and AP2 within the angle of view of the camera (121 of FIG. 6) are displayed on the display 151 of the mobile terminal 100 according to an exemplary embodiment of the present invention. Can be. That is, the controller 180 of FIG. 1 may display the positions of the first and second wireless APs AP1 and AP2 using a preset icon.

The controller 180 of FIG. 1 may indicate that there is a wireless AP in addition to the current angle of view range by using the indicator IN. For example, the first and second indicators IN1 and IN2 may be displayed in the form of arrows indicating a direction in which the wireless AP outside the angle of view ranges. That is, the first indicator IN1 may indicate that another wireless AP is located on the right side of the display 151, and the second indicator IN2 may indicate that another wireless AP is located on the left side of the display 151.

FIG. 11 is a diagram illustrating a screen on which an indicator is displayed in the mobile terminal of FIG. 5.

As shown in the drawing, the mobile terminal 100 according to an embodiment of the present invention may display an indicator (IN) so as to know the number of wireless APs in a specific direction. For example, the second indicator IN2 is displayed on the left side of the display 151 to indicate that there is one wireless AP in the direction thereof, and the first and third indicators IN1, IN1 on the right side of the display 151. IN3) may indicate that there are two wireless APs in that direction. Through the number indicated by the indicator IN, the user can intuitively know the direction and the number of the wireless APs.

FIG. 12 is a diagram illustrating a screen on which direction information is displayed in the mobile terminal of FIG. 5.

As shown in FIG. 1, the controller (180 of FIG. 1) of the mobile terminal 100 according to an embodiment of the present invention displays information about the wireless AP outside the display 151 area in the form of a first pop-up window P1. ) Can be displayed. For example, it means that the position of the third, fourth, fifth wireless AP can be expressed in words.

13 to 15 are diagrams illustrating a screen for converting a wireless AP to be accessed by the mobile terminal of FIG. 5.

As shown in FIG. 1, the controller (180 of FIG. 1) of the mobile terminal 100 according to an embodiment of the present invention not only displays the wireless AP to which the mobile terminal 100 is currently connected, but also responds to user input. Therefore, the connected wireless AP can be switched.

As illustrated in FIG. 13, the controller 180 of FIG. 1 may display a connection display CCI on the first wireless AP AP1. The connection indication (CCI) indicates that the mobile terminal 100 is connected to the wireless AP. In FIG. 13, although the connection display CCI is shown in a circular form around the wireless AP, the connection display CCI is not limited thereto.

As illustrated in FIG. 14, the user may perform a drag touch operation from the first wireless AP AP1 currently connected to the second wireless AP AP2 using the finger F or the like. Such a touch operation may reflect an intuition to change the wireless AP connected to the mobile terminal 100 from the first wireless AP AP1 to the second wireless AP2.

As shown in FIG. 15, when the connection of the wireless AP is changed, the controller (180 of FIG. 1) may cause the connection indication CCI to appear on the second wireless AP AP2 instead of the first wireless AP AP1. have. That is, the wireless AP to which the mobile terminal 100 is connected may indicate that the second wireless AP (AP2).

FIG. 16 is a diagram illustrating a screen displaying signal strength of a wireless AP in FIG. 5.

As shown, the mobile terminal 100 according to an embodiment of the present invention may change the display of the icon based on the signal strength of the wireless AP (AP).

The icon representing the first wireless AP (AP1) and the icon representing the second wireless AP (AP2) may have a different form. For example, compared to the second wireless AP AP2, the icon of the first wireless AP AP1 may be represented more clearly and larger. Since the first wireless AP AP1 is displayed relatively large and clear, the user can intuitively recognize that the signal strength of the first wireless AP AP1 will be stronger.

FIG. 17 is a diagram illustrating a screen displaying a signal strength of a wireless AP in text on a mobile terminal of FIG. 5.

As shown in FIG. 1, the controller (180 of FIG. 1) of the mobile terminal 100 according to an embodiment of the present invention may indicate the state of the wireless AP using the pop-up windows P2 and P3. For example, the signal strength and usage rate of the first wireless AP AP1 are displayed using the second pop-up window P2, and the signal strength and usage rate of the second wireless AP AP2 are used using the third pop-up window P3. Means that it can be displayed. By displaying the current state of each wireless AP (AP) in more detail using a pop-up window, more information can be delivered to the user.

FIG. 18 is a diagram illustrating a screen displaying an operation range of a wireless AP in FIG. 5.

As illustrated in FIG. 1, the controller (180 of FIG. 1) of the mobile terminal 100 according to an embodiment of the present invention may display the output range of each wireless AP (AP) so as to be superimposed on the screen. The output range may be a coverage area of a wireless AP (AP). That is, the display 151 may display the first area AR1 of the output of the first wireless AP AP1 and the second area AR2 of the output of the second wireless AP AP2.

By displaying the output ranges of the first and second wireless APs AP1 and AP2 so as to overlap the photographed screen, the user can easily determine which wireless AP (AP) is more effective to access.

19 and 20 illustrate screens for acquiring user information connected to a wireless AP in the mobile terminal of FIG. 5.

As shown in these figures, when the mobile terminal 100 selects a specific wireless AP, the mobile terminal 100 can know information of another terminal user connected to the wireless AP. .

As shown in FIG. 19, the first and second wireless APs may be displayed on the display 151. The user may select the first wireless AP AP1 through a touch or the like.

As shown in FIG. 20, when the user selects the first wireless AP AP1, information about a user connected to the first wireless AP AP1 may be displayed. This process may be as follows. When the controller (180 of FIG. 1) acquires the fact that the user selects the first wireless AP (AP1), the user information of the first wireless AP (AP1) may be requested to the server (S of FIG. 7). When requesting the visitor information, the server (S of FIG. 7) may transmit necessary information to the mobile terminal 100.

The visitor information may be displayed based on the MAC address MC, which is a unique address assigned to each device. Next to each MAC address (MC) may be a detailed information output window for displaying more detailed information and a dialog request window for chatting with the user of the terminal.

In addition to the MAC address MC, user information of another terminal may be displayed on the display 151. For example, in the case of a MAC address that is already stored as a MAC address associated with a specific person in the memory of the mobile terminal 100 (160 of FIG. 1), the name (OP) of the specific person may be displayed for easy identification.

FIG. 21 is a diagram illustrating an operation range of each wireless AP in the mobile terminal of FIG. 5.

As shown in the drawing, the mobile terminal 100 according to an embodiment of the present invention may display an output range WA of the map screen and the wireless AP on the display 151.

Information about the first to fifth wireless APs (AP1 to AP5) and other wireless APs may be obtained from the server (S of FIG. 7). The controller (180 of FIG. 1) may display the acquired information of the wireless AP on the map screen. That is, it means that the position of each wireless AP and the output range WA of each wireless AP can be displayed on the map screen.

FIG. 22 is a diagram illustrating a state of each wireless AP on a map in the mobile terminal of FIG. 5.

As shown in the drawing, the mobile terminal 100 according to an embodiment of the present invention may visually express additional data for each wireless AP on the display 151.

The controller (180 of FIG. 1) may display information obtained from a server (S of FIG. 7) or through a scan on a map screen. For example, the utilization rate of each wireless AP may be further displayed in addition to the location and output range WA of the wireless AP. The usage rate may be expressed in the direction of hatching, etc., as shown. For example, the third wireless AP AP3 having 80% usage and the fifth wireless AP AP5 having 0% usage may be expressed differently. Furthermore, the controller 180 of FIG. 1 may further display additional information such as signal strength and the number of users on the map.

FIG. 23 is a diagram illustrating user information connected to a wireless AP in the mobile terminal of FIG. 5.

As shown in the drawing, when a specific wireless AP is selected among the displayed wireless APs, information on the wireless AP may be displayed on the display 151. For example, information about the accessor of the wireless AP selected by the user may be displayed. Information on the accessor of the wireless AP may be displayed based on the MAC address, and in some cases, the name of the accessor may be displayed, as described above.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit and scope of the invention. Accordingly, such modifications or variations are intended to fall within the scope of the appended claims.

100: mobile terminal 110: wireless communication unit
140: sensing unit 151: display unit
180:

Claims (20)

A wireless communication unit;
A camera for acquiring an image;
A display for displaying an image acquired through the camera; And
Acquire information of at least one wireless access point (AP) adjacent to at least one preset point through the wireless communication unit, and at least some of the acquired information of the wireless AP based on the obtained wireless AP information A mobile terminal comprising a control unit for superimposing the image. The method of claim 1,
The wireless communication unit includes a mobile communication module and a short range communication module,
The information of the wireless AP,
First information obtained from an external server connected through at least one of the mobile communication module and the local area communication module, and second information obtained by scanning a wireless AP adjacent to the mobile terminal through the local area communication module; Mobile terminal, characterized in that. The method of claim 2,
The first and second information,
At least one of a Media Access Control (MAC) address of the wireless AP, traffic of the wireless AP, signal strength of the wireless AP, capability of the wireless AP, and a location of the wireless AP. Mobile terminal. The method of claim 3,
The control unit,
And displaying a wireless AP in which the MAC address based on the first information and the MAC address based on the second information correspond to each other by overlapping the image. The method of claim 1,
The control unit,
And displaying on the display an indicator indicating at least one wireless AP located outside the display area among the at least one wireless AP. The method of claim 1,
The control unit,
And acquiring a user's selection signal for any one of the at least one wireless AP, and accessing the at least one wireless AP. The method of claim 6,
The control unit,
And displaying a connection indication for identifying the wireless AP to which the mobile terminal is currently connected among the at least one wireless AP. The method of claim 1,
The control unit,
And displaying a coverage area of the at least one wireless AP on the acquired image. The method of claim 1,
The control unit,
Mobile terminal, characterized in that for displaying the accessor of any one of the at least one wireless AP based on the MAC address. The method of claim 1,
The at least one preset point is
And a point at which the mobile terminal is currently located. display;
A wireless communication unit; And
Acquiring information of at least one wireless access point (AP) adjacent to at least one preset point through the wireless communication unit, and displaying an available range of the wireless AP included in the obtained wireless AP information on the display. A mobile terminal comprising a control unit. 12. The method of claim 11,
The wireless communication unit includes a mobile communication module and a short range communication module,
The information of the wireless AP,
First information obtained from an external server connected through at least one of the mobile communication module and the local area communication module, and second information obtained by scanning a wireless AP adjacent to the mobile terminal through the local area communication module; Mobile terminal, characterized in that. 12. The method of claim 11,
The control unit,
And displaying a map on the display and displaying an available range of the wireless AP on the displayed map. The method of claim 13,
The information of the wireless AP further includes at least one of a utilization rate of the wireless AP, a signal strength of the wireless AP, and the number of users of the wireless AP.
The control unit,
And at least one of the usage rate, the signal strength, and the number of accessors is further displayed on the display. Acquiring an image from an activated camera;
Obtaining at least one wireless AP information from a server;
Obtaining information of at least one wireless AP adjacent to at least one preset point; And
And displaying at least a portion of the acquired information of the wireless AP by overlapping the obtained image. 16. The method of claim 15,
And obtaining current location information of the mobile terminal. 17. The method of claim 16,
Obtaining information of the at least one wireless AP,
And setting the at least one point based on the obtained current position information of the mobile terminal. 16. The method of claim 15,
Displaying the overlapping,
And identifying a wireless AP to which the mobile terminal is connected among the at least one wireless AP. 16. The method of claim 15,
Displaying the overlapping,
And displaying the communicable area of the at least one wireless AP on the acquired image. 16. The method of claim 15,
And displaying accessor information of any one of the at least one wireless AP.

Images