KR101867853B1 - Mobile phone and network system comprising thereof - Google Patents

Abstract

A method for operating a mobile terminal according to an embodiment of the present invention includes: inputting a search distance between a current location and a managed object to be searched; A receiving step of receiving object information of a managed object within a search distance in a camera direction; A video display step of displaying a preview image of a current position input through a camera; And displaying an object icon corresponding to the managed object together with the preview image.
A portable terminal according to an embodiment of the present invention includes a camera; A GPS module for determining the current position; A motion sensor for sensing camera orientation; A wireless communication unit for receiving object information of a managed object located within a search distance from a current location to a camera direction; And a display unit displaying a preview image input through the camera and displaying an object icon corresponding to the managed object on the preview image when the object information is received.
A network system according to an embodiment of the present invention includes a plurality of management objects for controlling an external environment, a network server for receiving a plurality of object information including the positions of a plurality of managed objects from a plurality of managed objects, And a portable terminal for receiving a plurality of object information from the network server and displaying a plurality of object icons indicating positions of the plurality of managed objects on the preview image.

Description

[0001] MOBILE PHONE AND NETWORK SYSTEM COMPRISING THEREOF [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a portable terminal and a network system, and more particularly, to a portable terminal for browsing a management object using an augmented reality and a remote control method using the portable terminal.

A portable terminal is a portable device having at least one function that can carry out voice and video communication, a function to input / output information, and a function to store data while being portable.

In addition, since the portable terminal must consider mobility and portability, there is also a restriction in space allocation for a device for a user interface such as a display or a keypad. Accordingly, even if a front touch screen is applied to a mobile terminal, its size is limited.

As the functions of mobile terminals are diversified, they have complicated functions such as photographing and photographing of movies, playback of music files and video files, reception of games, broadcasting, wireless Internet, etc., and a comprehensive multimedia player .

Various attempts have been made in the hardware and software aspects to implement complex functions to enable the mobile terminal to be used as a multimedia device. For example, there is a user interface environment in which a user can easily and conveniently search for or select a function.

An object of the present invention is to conveniently provide location information of various management objects or failure information of various management objects using a portable terminal.

The problems of the present invention are not limited to the above-mentioned problems, and other problems not mentioned can be clearly understood by those skilled in the art from the following description.

A method for operating a mobile terminal according to an embodiment of the present invention includes: inputting a search distance between a current location and a managed object to be searched; A receiving step of receiving object information of a managed object within a search distance in a camera direction; A video display step of displaying a preview image of a current position input through a camera; And displaying an object icon corresponding to the managed object together with the preview image.

A portable terminal according to an embodiment of the present invention includes a camera; A GPS module for determining the current position; A motion sensor for sensing camera orientation; A wireless communication unit for receiving object information of a managed object located within a search distance from a current location to a camera direction; And a display unit displaying a preview image input through the camera and displaying an object icon corresponding to the managed object on the preview image when the object information is received.

A network system according to an embodiment of the present invention includes a plurality of management objects for controlling an external environment, a network server for receiving a plurality of object information including the positions of a plurality of managed objects from a plurality of managed objects, And a portable terminal for receiving a plurality of object information from the network server and displaying a plurality of object icons indicating positions of the plurality of managed objects on the preview image.

The details of other embodiments are included in the detailed description and drawings.

According to the portable terminal and the network system of the present invention, one or more of the following effects can be obtained.

The network system according to the embodiment can provide a convenience of searching for a management object easily at any place using the portable terminal.

The portable terminal according to the embodiment may display the position of the management object on the preview image so that an engineer close to the management object can respond immediately.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description of the claims.

1 is a schematic diagram of a network system including a mobile terminal according to an embodiment,
FIG. 2 is a call processing diagram of a network system including a mobile terminal according to an exemplary embodiment.
3 is a block diagram of a portable terminal according to an exemplary embodiment.
4 is a front perspective view of a portable terminal according to an embodiment,
5 is a rear perspective view of a portable terminal according to an embodiment,
6 is a flowchart illustrating a control method of a method of operating a mobile terminal according to an embodiment.
7 is a diagram illustrating a screen displayed on a display unit according to an exemplary embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

The portable terminal described in this specification includes a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation. In addition, suffixes "module" and " part "for the components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

1 is a schematic diagram of a network system including a mobile terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 1, a network system according to an embodiment includes a plurality of objects 130 for controlling an external environment, a plurality of object information including a plurality of objects 130 from a plurality of objects 130 And receives a plurality of objects 130 information from the network server 120 and the network server 120 storing a plurality of object information and displays a plurality of object icons indicating the positions of the plurality of objects 130 on the preview image The mobile terminal 110 may be a mobile terminal. The portable terminal 110 and the network server 120 can communicate wirelessly.

The portable terminal 110 can perform wireless communication with the network server 120.

The wireless communication may be a communication of information such as a signal, code, video, and sound through a radio wave without passing through an electric wire. Wireless communication technology may include a wireless network, a wireless Internet, a wireless LAN, a mobile communication, a local area communication, and the like. For example, the portable terminal 110 and the network server 120 can communicate with each other by connecting to an IP (Internet Protocol) network using a wireless communication method.

The network server 120 may communicate with a plurality of managed objects 130. The plurality of managed objects 130 may include facilities requiring management. For example, the management object 130 may be a control device connected to an air conditioner or a lighting device, or an apparatus for controlling an external environment such as an air conditioner or a lighting device, but is not limited thereto.

The network server 120 may collect information on a plurality of managed objects 130 by communicating with a plurality of managed objects 130 by wire / wireless.

The object information may include information of a wide range necessary for managing the managed object 130. For example, the object information includes at least one of a name of the managed object 130, a distance from the current position to the managed object 130, a position of the managed object 130, and failure information of the managed object 130 .

The managed object 130 may adjust the external environment. For example, the managed object 130 may adjust the temperature or illumination within the building. The management object 130 may be, but not limited to, an indoor unit of an air conditioner, an outdoor unit of an air conditioner, a lighting unit, a plurality of sensors, or the like.

The managed object 130 may have an address and GPS coordinates. When the management object 130 receives an information request from the network server 120, the managed object 130 may transmit the address and the GPS coordinates to the network server 120.

2 is a call processing diagram of a network system including a portable terminal according to an embodiment.

Referring to FIG. 2, the network server 120 may perform wire / wireless communication with a plurality of managed objects 130.

The network server 120 may request object information from the plurality of managed objects 130 (s141). The network server 120 may request object information to a plurality of managed objects 130 according to a predetermined period, but the present invention is not limited thereto, and the method may vary.

When a plurality of the managed objects 130 are requested from the network server 120 (S141), the managed objects 130 may transmit the object information to the network server 120 (S142).

When the network server 120 receives the object information from the plurality of managed objects 130 (s142), the network server 120 may store the received object information (s143).

The portable terminal 110 can grasp the current position (s144). For example, the portable terminal 110 may include a GPS module, and the GPS module may determine the current position of the portable terminal 110.

The portable terminal 110 may sense the direction of the reference direction (s145). For example, the portable terminal 110 may include a gyro sensor, and the gyro sensor may sense a direction toward the portable terminal 110. The current position of the portable terminal 110 and the detection of the direction are not limited to the order, and the posterior relationship may be changed according to the embodiment. The portable terminal 110 can determine the direction of the camera according to the direction of the portable terminal 110 sensed and the position of the camera on the portable terminal 110

According to the embodiment, the portable terminal 110 can receive the search distance. For example, the portable terminal 110 may receive a search distance designating a range to search for the management object 130 by displaying a search distance adjustment icon that can recognize a touch input on the display unit.

The portable terminal 110 may include a camera. The portable terminal 110 may request the object information of the management object 130 to the network server 120 (s146). The portable terminal 110 can transmit the direction of the camera and the current position of the portable terminal 110 to the network server 120. More specifically, the portable terminal 110 may request the network server 120 for object information of the managed object 130 located within a certain angle range in the direction toward the camera.

The portable terminal 110 can transmit the search distance to the network server 120. [ The portable terminal 110 can transmit the search distance to the network server 120. [

If the network server 120 receives the object information request from the portable terminal 110 in operation s146, the network server 120 may transmit the object information received from the managed object 130 to the portable terminal 110 in operation s147. The network server 120 can recognize the managed object 130 located within a certain angle range in the direction of the camera of the portable terminal 110 and transmit object information on the managed object 130 to the portable terminal 110.

When receiving the search distance from the portable terminal 110, the network server 120 transmits object information of the managed object 130 located within the search distance from the current location of the portable terminal 110 among the managed objects 130 to the portable terminal 110).

The portable terminal 110 may receive the object information of the managed object 130 from the network server 120 (s147). The portable terminal 110 may receive the object information of the managed object 130 and display the preview image on the display unit. However, the relationship between the object information reception and the preview image display is not limited, .

The portable terminal 110 may display an object icon corresponding to the management object 130 on the preview image. The portable terminal 110 may display the object icon on the preview image so that the direction of the managed object 130 appears.

The portable terminal 110 may display a preview image and an object icon on the display unit so that the user can visually confirm the direction of the managed object 130. [

3 is a block diagram of a portable terminal according to an exemplary embodiment of the present invention. Referring to FIG. 3, a mobile terminal according to an exemplary embodiment of the present invention will be described in terms of components according to functions.

3, the portable terminal 110 includes a wireless communication unit 210, an A / V input unit 220, a user input unit 230, a sensing unit 240, an output unit 250, A memory 260, an interface unit 270, a control unit 280, and a power supply unit 290. When such components are implemented in practical applications, two or more components may be combined into one component, or one component may be divided into two or more components as necessary.

The wireless communication unit 210 may include a broadcast receiving module 211, a mobile communication module 213, a wireless Internet module 215, a short distance communication module 217, and a GPS module 219.

The broadcast receiving module 211 receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. At this time, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast related information and a server for receiving at least one of the generated broadcast signal and broadcast related information and transmitting the broadcast signal to the terminal.

The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal. The broadcast-related information may also be provided through a mobile communication network, in which case it may be received by the mobile communication module 213. Broadcast-related information can exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 211 receives a broadcast signal using various broadcasting systems. In particular, the broadcast receiving module 211 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) ), Digital Video Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Also, the broadcast receiving module 211 may be configured to be suitable for all broadcasting systems that provide broadcast signals, as well as the digital broadcasting system. The broadcast signal and / or broadcast related information received through the broadcast receiving module 211 may be stored in the memory 260.

The mobile communication module 213 transmits and receives a radio signal to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 215 refers to a module for wireless Internet access, and the wireless Internet module 215 can be embedded in the mobile terminal 110 or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The portable terminal 110 may communicate with the network server 120 through the wireless communication unit 210. The mobile terminal 110 may communicate with the network server 120 using the mobile communication module 213 or the wireless Internet module 215. [

The mobile terminal 110 requests object information of the object 130 to the network server 120 using the mobile communication module 213 or the wireless Internet module 215 and transmits the object information transmitted by the network server 120 .

The short-range communication module 217 is a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

A GPS (Global Position System) module 219 receives position information from a plurality of GPS satellites. The GPS module 219 can determine the current position of the portable terminal 110.

The A / V (Audio / Video) input unit 220 is for inputting an audio signal or a video signal, and may include a camera 221 and a microphone 223. The camera 221 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display unit 251. [

The image frame processed by the camera 221 may be stored in the memory 260 or may be transmitted to the outside via the wireless communication unit 210. [ The camera 221 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 223 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data may be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 213 and output when the voice data is in the call mode. The microphone 223 may use various noise elimination algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 230 generates key input data that the user inputs for controlling the operation of the terminal. The user input unit 230 may include a key pad, a dome switch, and a touch pad (static / static) capable of receiving a command or information by a push or touch operation of a user. The user input unit 230 may be a jog wheel for rotating a key, a jog type or a joystick, or a finger mouse. Particularly, when the touch pad has a mutual layer structure with the display unit 251 described later, it can be called a touch screen.

The sensing unit 240 senses the current state of the portable terminal 110 such as the open / closed state of the portable terminal 110, the position of the portable terminal 110, Thereby generating a sensing signal. For example, when the portable terminal 110 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, it may be responsible for a sensing function related to the power supply of the power supply unit 290, whether or not the interface unit 270 is connected to an external device, and the like.

The sensing unit 240 may include a sensing sensor 241, a pressure sensor 243, a motion sensor 245, and the like. The detection sensor 241 can detect the presence of an object approaching the portable terminal 110 or an object existing in the vicinity of the portable terminal 110 without mechanical contact. The detection sensor 241 can detect a nearby object by using a change in the alternating magnetic field or a change in the static magnetic field or by using a change rate of the capacitance. More than two detection sensors 241 may be provided according to the configuration.

The pressure sensor 243 can detect whether pressure is applied to the portable terminal 110, the magnitude of the pressure, and the like. The pressure sensor 243 may be installed at a portion where the pressure of the portable terminal 110 is required according to the use environment. If the pressure sensor 243 is installed on the display unit 251, the touch input through the display unit 251 and the pressure input by the touch input The pressure touch input can be identified. In addition, the magnitude of the pressure applied to the display unit 251 in the pressure-touch input can be determined according to the signal output from the pressure sensor 243.

The motion sensor 245 senses the position or movement of the portable terminal 110 using an acceleration sensor, a gyro sensor, or the like. The acceleration sensor, which can be used in the motion sensor 245, is a device that converts an acceleration change in one direction into an electric signal and is widely used along with the development of MEMS (micro-electromechanical systems) technology. The acceleration sensor measures the acceleration of a small value built in the airbag system of an automobile and recognizes the minute motion of the human hand and measures the acceleration of a large value used as an input means such as a game There are various types. Acceleration sensors are usually constructed by mounting two or three axes in one package. Depending on the usage environment, only one axis of Z axis is required. Therefore, when the acceleration sensor in the X-axis direction or the Y-axis direction is used instead of the Z-axis direction for some reason, the acceleration sensor may be mounted on the main substrate by using a separate piece substrate.

The gyro sensor is a sensor for measuring the angular velocity, and it can sense the direction of rotation with respect to the reference direction.

The output unit 250 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 250 may include a display unit 251, an acoustic output module 253, an alarm unit 255, and a haptic module 257.

The display unit 251 displays and outputs information processed by the portable terminal 110. For example, when the portable terminal 110 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the portable terminal 110 is in the video communication mode or the photographing mode, the captured or received images can be displayed individually or simultaneously, and the UI or the GUI can be displayed.

Meanwhile, as described above, when the display unit 251 and the touch pad have a mutual layer structure to constitute a touch screen, the display unit 251 may be an input device capable of inputting information by a user's touch in addition to the output device Can also be used.

If the display unit 251 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like. In this case, the touch screen panel is a transparent panel attached to the outside, and may be connected to the internal bus of the portable terminal 110. The touch screen panel keeps a watch on the contact result, and if there is a touch input, sends the corresponding signals to the touch screen panel controller. The touch screen panel controller processes the signals and transmits corresponding data to the control unit 280 so that the control unit 280 can determine whether the touch input has been made and which area of the touch screen has been touched.

The display unit 251 may be formed of e-paper. Electronic paper (e-Paper) is a kind of reflective display, and has excellent visual characteristics such as high resolution, wide viewing angle and bright white background as conventional paper and ink. The electronic paper (e-paper) can be implemented on any substrate such as plastic, metal, paper, and the image is retained even after the power supply is shut off, and the battery life of the portable terminal 110 is long Can be maintained. As the electronic paper, a hemispherical twist ball filled with a telephone can be used, or an electrophoresis method and a microcapsule can be used.

In addition, the display unit 251 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display (3D display). Also, there may be two or more display units 251 according to the implementation mode of the portable terminal 110. For example, the portable terminal 110 may include an external display unit (not shown) and an internal display unit (not shown) at the same time.

The audio output module 253 outputs audio data received from the wireless communication unit 210 or stored in the memory 260 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 253 outputs sound signals related to functions performed in the portable terminal 110, for example, a call signal reception tone, a message reception tone, and the like. The sound output module 253 may include a speaker, a buzzer, and the like.

The alarm unit 255 outputs a signal for notifying the occurrence of an event of the portable terminal 110. Examples of events occurring in the portable terminal 110 include receiving a call signal, receiving a message, and inputting a key signal. The alarm unit 255 outputs a signal for informing occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. The alarm unit 255 can output a signal to notify when a call signal is received or a message is received. Also. When the key signal is input, the alarm unit 255 can output a signal as a feedback signal to the key signal input. The user can recognize the occurrence of the event through the signal output by the alarm unit 255. A signal for notifying the occurrence of an event in the portable terminal 110 may also be output through the display unit 251 or the sound output module 253. [

The haptic module 257 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 257 is a vibration effect. When the haptic module 257 generates vibration with a haptic effect, the strength and pattern of the vibration generated by the haptic module 257 can be transformed, and they can synthesize and output different vibrations or sequentially output the vibration.

In addition to the vibration, the haptic module 257 may be configured to have a function of stimulating by a pin arrangement vertically moving with respect to the contact skin surface, an effect of stimulating air through the injection or suction force of the air through the injection port or the suction port, A variety of tactile effects such as an effect of stimulation through contact of an electrode, an effect of stimulation by an electrostatic force, and an effect of reproducing a cold sensation using a heat absorbing or heatable element can be generated. The haptic module 257 can be implemented not only to transmit the tactile effect through the direct contact but also to feel the tactile effect through the muscles of the user's finger or arm. More than two haptic modules 257 may be provided according to the configuration of the portable terminal 110.

The memory 260 may store a program for processing and controlling the control unit 280 and may store a function for temporarily storing input or output data (e.g., a phone book, a message, a still image, .

The memory 260 may store the input setting radius or received object information.

The memory 260 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a RAM , And a ROM. ≪ / RTI > In addition, the portable terminal 110 may operate a web storage for storing the memory 260 on the Internet.

The interface unit 270 serves as an interface with all the external devices connected to the portable terminal 110. Examples of the external device connected to the portable terminal 110 include a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a SIM (Subscriber Identification Module) card, a UIM An audio input / output (I / O) terminal, a video I / O (input / output) terminal, and an earphone. The interface unit 270 receives data from the external device or receives power from the external device and transmits the data to each component in the portable terminal 110 and allows data in the portable terminal 110 to be transmitted to the external device .

The interface unit 270 may be a path through which power from the cradle connected to the cradle is supplied to the portable terminal 110 when the portable terminal 110 is connected to an external cradle or various command signals input from the cradle by the user And may be a passage to be transmitted to the terminal 110.

The control unit 280 controls the overall operation of the mobile terminal 110 by controlling the operations of the respective units. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 280 may include a multimedia playback module 281 for multimedia playback. The multimedia playback module 281 may be configured in hardware in the controller 280 or separately from software in the controller 280. [

The power supply unit 290 receives external power and internal power under the control of the controller 280 and supplies power required for operation of the respective components.

The mobile terminal 110 having such a configuration may be configured to be operable in a communication system capable of transmitting data through a frame or a packet, including a wired / wireless communication system and a satellite-based communication system. have.

FIG. 4 is a front perspective view of a portable terminal according to an embodiment, and FIG. 5 is a rear perspective view of a portable terminal according to an embodiment. Hereinafter, a portable terminal according to the present invention will be described with reference to FIGS. 4 and 5 in terms of components according to the external form. Hereinafter, for convenience of description, a bar-type portable terminal having a front touch screen among various types of portable terminals such as a folder type, a bar type, a swing type, a slider type, etc. will be described as an example. However, the present invention is not limited to a bar-type portable terminal, but can be applied to all types of portable terminals including the above-mentioned type.

Referring to FIG. 4, the case constituting the outer appearance of the portable terminal 110 is formed by the front case 200-1 and the rear case 200-2. Various electronic components are incorporated in the space formed by the front case 200-1 and the rear case 200-2. The front case 200-1 and the rear case 200-2 may be formed by injection molding synthetic resin or may be formed of a metal material such as stainless steel (STS) or titanium (Ti).

Specifically, the front case 200-1 includes a display unit 251, a first sound output module 253a, a first camera 221a, and first to third user input units 230a, 230b, and 230c . A fourth user input unit 230d, a fifth user input unit 230e, and a microphone 223 may be disposed on a side surface of the rear case 200-2.

The display unit 251 may be constructed so that the display unit 251 operates as a touch screen by inputting information by a user's touch by overlapping the touch pad in a layer structure.

The first acoustic output module 253a may be implemented in the form of a receiver or a speaker. The first camera 221a may be implemented in a form suitable for taking an image or a moving image of a user. The microphone 223 may be implemented in a form suitable for receiving a user's voice, other sounds, and the like.

The first to fifth user input units 230a to 230e and the sixth and seventh user input units 230f and 230g to be described later may collectively be referred to as a user input unit 230, Any manner can be employed in a tactile manner.

For example, the user input unit 230 may be embodied as a dome switch or a touch pad capable of receiving a command or information by a push or touch operation of a user, or may be a wheel, a jog type, a joystick, Or the like. In a functional aspect, the first to third user input units 230a, 230b, and 230c are for inputting commands such as call, mouse point movement, screen scroll, start, end, and the like. The fourth user input unit 230b is for inputting a selection of an operation mode or the like. In addition, the fifth user input unit 230c may operate as a hot-key for activating a special function in the portable terminal 110. [

5, a second camera 221b may be further mounted on a rear surface of the rear case 200-2, and sixth and seventh user inputs 230f and 230g may be further provided on a side surface of the second body 200B. And an interface unit 270 may be disposed.

The second camera 221b has a photographing direction that is substantially opposite to that of the first camera 221a and may have different pixels from the first camera 221a, but the present invention is not limited thereto. A flash (not shown) and a mirror (not shown) may be additionally disposed adjacent to the second camera 221b. The flash illuminates the subject when the subject is photographed by the second camera 221b. The mirror allows the user to illuminate the user's own face or the like when the user intends to take a picture of himself / herself (self-photographing) using the second camera 221b.

A second sound output module (not shown) may be additionally disposed in the rear case 200-2. The second sound output module may implement a stereo function together with the first sound output module 253a, and may be used for talking in a speakerphone mode.

The interface unit 270 can be used as a path for exchanging data with an external device. An antenna for receiving broadcast signals (not shown) may be disposed in one area of the proton case 200-1 and the rear case 200-2, in addition to the antenna for communication. The antenna may be installed to be drawable from the rear case 200-2.

A power supply unit 290 for supplying power to the portable terminal 110 may be mounted on the rear case 200-2. The power supply unit 290 may be a rechargeable battery, for example, and may be detachably coupled to the rear case 200-2 for charging or the like.

In the above description, the second camera 221b and the like are disposed in the rear case 200-2, but the present invention is not limited thereto. The first camera 221a may be rotatably formed so that the second camera 221b can be photographed up to the photographing direction, even if the second camera 221b is not separately provided.

6 is a flowchart illustrating a control method of a method of operating a portable terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 6, an operation method of a portable terminal according to an exemplary embodiment includes an input step of inputting a search distance between a current location and a management object to be searched (S410), object information of a management object within a search distance of a camera direction An image display step S460 of displaying a preview image of the current position input through the camera, and an object information display step S470 of displaying an object icon corresponding to the management object together with the preview image do.

In the input step S410 of inputting the search distance between the current position and the managed object to be searched, the mobile terminal 110 may display a search distance adjustment icon for inputting the search distance to the display unit 251. [ When there is a touch input on the search distance adjustment icon, the portable terminal 110 can recognize the search distance corresponding to the touch input.

The portable terminal operating method may further include a position determining step (S420) of determining the current position of the portable terminal 110 with the GPS module 219. [ The manner of driving the GPS module 219 has been described above and will not be described in further detail.

The portable terminal operating method may further include a direction sensing step of determining the direction of the camera 221 by the motion sensor 245 (S430). The motion sensor 245 may include an acceleration sensor and a gyro sensor to sense the position or movement of the portable terminal 110. The portable terminal 110 can determine the direction of the camera 221 according to the direction of the portable terminal 110 detected by the motion sensor 245 and the position of the camera 221 on the portable terminal 110. The manner of driving the motion sensor 245 has been described above and will not be described in further detail.

6, the position determination step S420 is shown as preceding the direction sensing step S430, but the present invention is not limited thereto, and the pre / post relationship may be different according to the embodiment.

The portable terminal operating method may further include a step S440 of requesting the network server 120 for object information of the management object 130. [

The mobile terminal 110 may transmit the current location of the mobile terminal 110, the direction of the camera 221 of the mobile terminal 110, and the search distance to the network server 120 in the object information request step S440. The portable terminal 110 may request the network server 120 for the object information of the managed object 130 located in the direction of the camera 221. [

When the portable terminal 110 requests the object information of the management object 130 from the network server 120 in operation S440, the network server 120 may transmit the object information to the portable terminal 110. [

The network server 120 may select the object information received from the management object 130 and transmit the selected object information to the mobile terminal 110. [ For example, the network server 120 may select object information to be transmitted to the portable terminal 110 based on the camera direction, the current position, and the search distance of the portable terminal 110 received from the portable terminal 110 . The object information to be transmitted to the portable terminal 110 by the network server 120 may correspond to the administered object 130 located within the search distance at the current position of the portable terminal 110 and located within a certain angle of the camera direction .

The network server 120 may store the object information by communicating with the management object 130 before the object information request of the portable terminal 110 is received. However, the present invention is not limited thereto, The object information may be received from the managed object 130 after the object information request of the terminal 110 is received.

The portable terminal 110 may receive the object information from the network server 120 (S450). The object information received from the network server 120 by the portable terminal 110 may correspond to the managed object 130 located within a certain angle range of the camera direction. The object information received from the network server 120 by the portable terminal 110 may correspond to the managed object 130 located within the search distance from the current position of the portable terminal 110. [

When the portable terminal 110 requests object information from the network server 120 but does not receive the signal from the network server 120, the portable terminal 110 can request object information again.

The portable terminal 110 can display a preview image on the display unit 251 (S460). The preview image may be an image taken by the camera 221 included in the portable terminal 110. 6, the image display step S460 is performed after the mobile terminal 110 receives the object information from the network server 120 (S450). However, the present invention is not limited thereto, The method may include various embodiments including a search distance input step S410, a position determination step S420, a direction determination step S430, an object information request step S440, or an object information reception step S450. have.

The preview image may be changed as the camera 221 of the portable terminal 110 moves or the current position of the portable terminal 110 is moved.

When the direction of the camera 221 of the portable terminal 110 is changed, the portable terminal 110 can grasp the current position and the direction of the camera 221 again. The portable terminal 110 may request the object information of the managed object 130 located within a certain angle of the direction of the camera 221 that has changed to the network server 120 again.

When the mobile terminal 110 receives object information from the network server 120 (S450), the portable terminal 110 may display an object icon corresponding to the managed object 130 on the preview image.

The object icon may be a user interface (UI) or a graphical user interface (GUI). The object icon can be displayed on the preview image. The object icon may be placed on the preview image so that the orientation or position of the corresponding administered object 130 may be displayed.

7 is a diagram illustrating a screen displayed on a display unit according to an exemplary embodiment of the present invention.

7, the portable terminal 110 includes a camera 221, a GPS module 219 for determining a current position, a motion sensor 245 for sensing a direction of the camera 221, The wireless communication unit 210 receives the object information of the managed object 130 positioned within the search distance in the direction of the camera 221 and the preview image 410 input through the camera 221, And a display unit for displaying an object icon 420 corresponding to the managed object 130 on the preview image 410. [

The camera 221 can take a preview image 410. The preview image 410 captured by the camera 221 can be displayed on the display unit 251. [

The GPS module 219 can determine the current position of the portable terminal 110. The motion sensor 245 can sense the direction of the portable terminal 110. The portable terminal 110 may also determine the orientation of the camera 221 according to the direction of the motion sensor 245.

The camera 221 and the motion sensor 245 have been described above and will not be described in further detail.

The wireless communication unit 210 can request and receive object information. The wireless communication unit 210 can communicate with the network server 120. The wireless communication unit 210 may use the mobile communication module 113 or the wireless Internet module 215 according to a communication method with the network server 120.

For example, when the mobile terminal 110 and the network server 120 communicate using the mobile communication network, the mobile terminal 110 may request the object information from the mobile communication module 213 to the network server 120 The mobile terminal 110 may request the object information from the wireless Internet module 215 to the network server 120 when the mobile terminal 110 and the network server 120 communicate using an IP have.

The wireless communication unit 210 may transmit the current location and the camera direction of the portable terminal 110 to the network server 120 and request the object information. The wireless communication unit 210 may receive object information of the managed object 130 located within a certain angle range from the network server 120 in the camera direction. The predetermined angle range for selecting the managed object 130 corresponding to the object information to be received may be arbitrarily designated by the user or may be a value designated as an initial value, but the present invention is not limited thereto.

The wireless communication unit 210 can request object information to the network server 120 again when the current position and direction of the portable terminal 110 are changed and the preview image 410 changes.

The wireless communication unit 210 may receive the object information from the network server 120 and the display unit 251 may reconfigure the screen according to the received object information.

The display unit 251 may display the preview image 410. [ The display unit 251 may change the preview image 410 as the image captured by the camera 221 is changed. The display unit 251 can recognize the touch input.

The display unit 251 may display the search distance adjustment icon 430. [ The search distance may be the maximum range from the current position of the portable terminal 110 of the managed object 130 to be searched.

In FIG. 7, the search distance adjustment icon 430 is displayed on the preview image, but the present invention is not limited thereto. As shown in FIG. 7, the search distance adjustment icon may be displayed as a button for controlling the search distance and a display window for displaying the search distance, but the present invention is not limited to this, and various embodiments may exist. When the touch input is received on the search distance adjustment icon 430, the portable terminal 110 may transmit the search distance corresponding to the touch input to the network server 120 and receive the corresponding object information.

The display unit 251 may display the object icon 420. [ The display unit 251 can display a preview image photographed by the camera 221. The display unit 251 may display the object icon 420 on the preview image 410. [

The control unit 280 may arrange the location of the managed object 130 corresponding to the object icon 420 on the preview image 410.

The display unit 251 may display the object icon 420 of the managed object 130 located within a certain angle range in the direction of the camera 221 when the direction of the camera 221 is changed.

The object icon 420 may be plural. Each of the plurality of object icons 420 may correspond to the managed object 130. The object icon 420 may be placed on the preview image 410 so that the position of the corresponding managed object 130 appears.

The object icon 420 may be a UI (User Interface) or a GUI (Graphic User Interface), but is not limited thereto. The object icon 420 may display the minimum object information. For example, the object icon 420 may indicate at least one of the name of the managed object 130 and the distance to the managed object 130 from the current location.

The management object 130 is a facility for controlling the external environment, and management may be required. For example, the management object 130 may be an air conditioner that adjusts the temperature or humidity of the installed site, or an illuminator that controls the illuminance of the installed site.

The object information may include a wide range of information necessary for managing the facility. For example, the object information may include at least one of the name of the managed object 130, the distance from the current location to the managed object 130, the failure information of the managed object 130, and the location of the managed object 130 have.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It should be understood that various modifications may be made by those skilled in the art without departing from the spirit and scope of the present invention.

110: portable terminal 120: network server
130: Managed object 200: Mobile terminal block diagram
210: wireless communication unit 220: A / V input unit
230: user input unit 240: sensing unit
250: output unit 260: memory
270: interface unit 410: preview image
420: object icon 430: search distance adjustment icon

Claims (18)

An input step of inputting a search distance to search for a managed object that is a facility requiring management based on the current location;
Receiving object information of the managed object within the search distance with respect to a camera direction;
An image display step of displaying a preview image of the current position input through the camera;
And displaying an object icon corresponding to the managed object together with the preview image;
Wherein the object icon displays the location of the managed object on the preview image,
Wherein the management object includes at least one of an air conditioner for adjusting a temperature or a humidity of a scene, an illuminating device for adjusting the illuminance of the installed scene, and a plurality of sensors. The method according to claim 1,
In the receiving step,
Wherein the received object information corresponds to a managed object located within a certain angle range in the camera direction. The method according to claim 1,
And determining the current position by the GPS module. The method according to claim 1,
And a direction sensing step of determining the camera direction with a motion sensor. The method according to claim 1,
In the input step,
A search distance adjustment icon for inputting the search distance,
And touching the search distance adjustment icon to input the search distance. The method according to claim 1,
Wherein the object icon indicates at least one of a name of the managed object and a distance from the current position to the managed object. The method according to claim 1,
Wherein the object information is information necessary for managing the managed object and includes at least one of a name of the managed object, a distance from the current position to the managed object, a position of the managed object, A method of operating a terminal. delete The method according to claim 1,
And displaying an information window including the object information when the object icon is touched. camera;
A GPS module for determining the current position;
A motion sensor for sensing camera orientation;
A wireless communication unit for receiving object information of a managed object located within a search distance from the current position to the camera; And
And a display unit displaying a preview image input through the camera and displaying an object icon corresponding to the managed object on the preview image when the object information is received,
Wherein the object icon is arranged to display the position of the managed object on the preview image,
Wherein the management object includes at least one of an air conditioner for adjusting the temperature or humidity of the site, a lighting device for controlling the illuminance of the installed site, and a plurality of sensors. 11. The method of claim 10,
Wherein the search distance is a maximum range from the current position of the managed object to be searched,
Wherein the display unit displays a search distance adjustment icon for inputting the search distance. delete 11. The method of claim 10,
Wherein the object icon indicates at least one of an object name of the managed object and a distance to the object. 11. The method of claim 10,
Wherein the object information is information necessary for managing the managed object and includes at least one of a name of the managed object, a distance from the current position to the managed object, a position of the managed object, . 11. The method of claim 10,
And requests object information of a managed object located within a certain angle range in the camera direction when the direction of the camera changes. A plurality of management objects for adjusting an external environment;
A network server receiving a plurality of object information including a position of the plurality of managed objects from the plurality of managed objects and storing the plurality of object information; And
And a portable terminal for receiving the plurality of object information from the network server and displaying a plurality of object icons indicating the positions of the plurality of managed objects on the preview image,
Wherein the plurality of management objects include at least one of an air conditioner for adjusting temperature or humidity of a site, a lighting device for adjusting the illuminance of the installed site, and a plurality of sensors,
Wherein the network server recognizes a management object located within a predetermined angle range in a direction of a camera of the portable terminal based on a position of the portable terminal and transmits the object information to the portable terminal. delete 17. The method of claim 16,
Wherein the plurality of management objects comprise address and GPS coordinate information.

Images