KR101632220B1 - A mobile device, a method for controlling the mobile device, and a control system having the mobile device - Google Patents

Abstract

The present invention relates to a mobile terminal and a control system capable of measuring a position of an electronic device or a specific area in a room and controlling a system including the same, wherein the mobile terminal includes: a communication unit for communication with a plurality of reference devices; A sensor unit for sensing a direction of the mobile terminal; The distance between the reference terminal and the communication unit, the distance between the mobile terminal and the specific region measured by the communication between the reference apparatus and the communication unit, the direction of the mobile terminal toward a specific region of the room, And a control unit for measuring the position.

Description

TECHNICAL FIELD [0001] The present invention relates to a mobile terminal, a control method of the mobile terminal, a control system, and a control method thereof,

Field of the Invention [0002] The present invention relates to a mobile terminal and a control system capable of measuring a position of an electronic device or a specific area in a room and controlling a system including the same.

A terminal can be divided into a mobile terminal (mobile / portable terminal) and a stationary terminal according to whether the terminal can be moved. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

Various new attempts have been made in terms of hardware or software to implement the complex functions of such multimedia devices. For example, a user interface environment is provided for a user to easily and conveniently search for or select a function.

In addition, mobile terminals are regarded as personal items for expressing their individuality, and various design forms are required. The design form also includes structural changes and improvements for the user to use the mobile terminal more conveniently. One such structural change and improvement can be considered for the operating unit.

Further, there is a demand for a mobile terminal capable of locating and controlling the position of an electronic device in a room.

It is an object of the present invention to provide a mobile terminal and a control system capable of measuring a position of an electronic device or a specific area in a room and controlling a system including the same.

According to an aspect of the present invention, there is provided a communication system including: a communication unit for communication with a plurality of reference devices; A sensor unit for sensing a direction of the mobile terminal; The distance between the reference terminal and the communication unit, the distance between the mobile terminal and the specific region measured by the communication between the reference apparatus and the communication unit, the direction of the mobile terminal toward a specific region of the room, And a control unit for measuring the position of the mobile terminal.

Here, the controller may provide a user interface for setting a maximum allowable value of the distance between the mobile terminal and the specific area used for measuring the position of the specific area, and a user interface for setting / changing the range of the specific area .

In addition, the controller may control the mobile terminal when the mobile terminal moves to the specific area, and may transmit the stored data to the mobile terminal.

According to another aspect of the present invention, there is provided a method of measuring a position of a mobile terminal, the method comprising: measuring a position of the mobile terminal using communication between a plurality of reference devices and the mobile terminal; Sensing a direction of the mobile terminal toward a specific area of the room using the sensor unit of the mobile terminal; Measuring a distance between the mobile terminal and the specific region; And measuring the position of the specific region using the measured position, the sensed direction, and the measured distance of the mobile terminal.

According to another aspect of the present invention, there is provided a control system including a plurality of reference devices, a mobile terminal, and a server, wherein the mobile terminal communicates with the mobile terminal through communication with the reference devices, The server transmits location information indicating the measured location to the server, and the server determines whether the mobile terminal has moved to a specific area of the room based on the location information, And controls the mobile terminal accordingly.

The server may transmit to the mobile terminal at least one of information indicating a distance between the mobile terminal and the specific area and information for guiding directions or paths to the specific area in the mobile terminal.

In addition, the server may transmit the stored data to the mobile terminal when the mobile terminal moves to the specific area, and may control the mobile terminal to display the transmitted data.

According to another aspect of the present invention, there is provided a method of controlling a mobile terminal using a plurality of reference devices and a server, the method comprising: Measuring a position of the terminal; Transmitting position information indicating the measured position to the server; Determining whether the mobile terminal has moved to a specific area of the room based on the transmitted location information; And controlling the mobile terminal using the server according to the determination result.

According to another aspect of the present invention, there is provided a communication apparatus including: a communication unit for communicating with a plurality of reference devices; A sensor unit for sensing a direction of the mobile terminal; A controller for executing at least one of functions and applications of the mobile terminal according to the position of the mobile terminal measured through communication between the reference devices and the communication unit and the direction of the mobile terminal sensed by the sensor unit, And a mobile terminal.

Here, the controller may determine whether the mobile terminal is directed to a predetermined position using the position and the direction of the mobile terminal, and when the mobile terminal faces the predetermined position, The display unit of the mobile terminal can be controlled to display the functions or applications of the mobile terminal.

The effects of the mobile terminal and the control system according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, it is possible to accurately measure the position of an electronic device or a specific area in a room.

In addition, according to at least one embodiment of the present invention, an indoor electronic device can be remotely controlled and a mobile terminal accessing a specific area can be remotely controlled.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a diagram showing an example of a control system according to the present invention.
2 is a diagram showing another example of the control system according to the present invention.
3 is a diagram illustrating an example of a mobile terminal according to the present invention.
4 is a view showing another example of a mobile terminal according to the present invention.
5 is a view showing an example of a reference device according to the present invention.
6 is a diagram showing an example of an electronic apparatus according to the present invention.
7 to 9 are views showing an example of a system control method according to the present invention.
10 and 11 are views showing another example of a system control method according to the present invention.
12 to 14 are diagrams showing another example of a system control method according to the present invention.
15 to 17 are views showing another example of a system control method according to the present invention.
18 is a diagram showing another example of a system control method according to the present invention.
19 and 20 are views showing another example of the system control method according to the present invention.
21 to 24 are diagrams showing other examples of the system control method according to the present invention.
25 and 26 are diagrams showing other examples of the system control method according to the present invention.
27 and 28 are diagrams showing other examples of the system control method according to the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

1 is a diagram showing an example of a control system according to the present invention.

As shown in FIG. 1, the control system of the present invention may include a mobile terminal 10, a plurality of reference devices 30, and one or more electronic devices 50. Here, the mobile terminal 10 measures its position through wireless communication with the reference devices 30, detects the direction of the mobile terminal 10 toward the electronic device 50, And the electronic device 50 are measured. The mobile terminal 10 can measure the position of the electronic device 50 using its position and direction and the distance between the electronic device 50 and the electronic device 50. The mobile terminal 10 can also generate and store a map indicating the location of the electronic devices 50 based on the measured location and use it to select and control the desired electronic device 50 .

The mobile terminal 10 described in the present specification can be used as a portable terminal such as a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP) slate PCs, tablet PCs, ultrabooks, wearable devices such as smartwatches, smart glass, HMDs (head mounted displays)), And may be configured in any one of a remote control mode and a remote control mode.

The reference devices 30 are devices used to measure the position of the mobile terminal 10 or the electronic device 50. At least three or more of the reference devices 30 are disposed at different positions in order to measure positions in a triangulation manner . For example, at least three reference devices 30 are required to measure the plane (2D) position of the mobile terminal 10 or the electronic device 50, and the mobile terminal 10 or the electronic device 50, At least four reference devices 30 are required to measure the spatial position (3D) When the reference devices 30 are used to measure the position of the mobile terminal 10 in the room, the reference devices 30 are preferably located indoors, but the position of the reference devices 30 is not limited to this, It is also possible.

The electronic device 50 may be a home electronic device such as a TV, a computer, a refrigerator, a washing machine, an air conditioner, a lighting device, or the like, as well as other mobile terminals capable of moving and communicating. In particular, when the electronic device 50 has an Indoor Positioning System (IPS) function, it may measure its position through communication with the reference devices 30. [

2 is a diagram showing another example of the control system according to the present invention.

2, the control system of the present invention may include a mobile terminal 10, a plurality of reference devices 30, one or more electronic devices 50, and a server 70. Here, the mobile terminal 10 measures its position through wireless communication with the reference devices 30, detects the direction of the mobile terminal 10 toward the electronic device 50, Is measured. The mobile terminal 10 can measure the position of the electronic device 50 using its position and direction and the distance between the electronic device 50 and the electronic device 50. The mobile terminal 10 may also generate a map indicating the location of the electronic devices 50 based on the measured location and may use it to select and control the desired electronic device 50.

The reference devices 30 are devices used to measure the position of the mobile terminal 10 or the electronic device 50. At least three or more of the reference devices 30 are disposed at different positions in order to measure positions in a triangulation manner . When the reference devices 30 are used to measure the position of the mobile terminal 10 in the room, the reference devices 30 are preferably located indoors, but the position of the reference devices 30 is not limited to this, It is also possible.

The electronic device 50 may be a home electronic device such as a TV, a computer, a refrigerator, a washing machine, an air conditioner, a lighting device, or the like, as well as other mobile terminals capable of moving and communicating. In particular, when the electronic device 50 has an Indoor Positioning System (IPS) function, it may measure its position through communication with the reference devices 30. [

The server 70 can measure the position of the electronic device 50 using the position and direction of the mobile terminal 10 and the distance between the mobile terminal 10 and the electronic device 50. [ In addition, the server 70 may generate and store a map indicating the location of the electronic devices 50 based on the measured location, and may use the map to map the desired electronic device 50 can be selected and controlled. Here, the server 70 may constitute a home gateway or a cloud (CLOUD), but it is not limited thereto and may mean a communicating arithmetic / storage device.

3 is a diagram illustrating an example of a mobile terminal according to the present invention.

3, the mobile terminal 10 includes a communication unit 11, an input unit 12, a sensing unit 14, a display unit 15, a memory 17, and a control unit 18 do. The components shown in FIG. 3 are not essential for implementing the mobile terminal 10, so that the mobile terminal described herein may have more or fewer components than those listed above.

The communication unit 11 may include at least one of a wireless Internet module, a local area communication module, and a location information module.

Here, the wireless Internet module refers to a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 10. The wireless Internet module is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies. Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), and Long Term Evolution-Advanced (LTE-A) And transmits and receives data according to at least one wireless Internet technology in a range including internet technologies not listed above.

The short-range communication module is for short range communication, and includes Bluetooth (registered trademark), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Communication, Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short distance communication module may be provided between the mobile terminal 10 and the reference devices 30 or between the mobile terminal 10 and the electromagnetic device 50 or between the mobile terminal 10 and the mobile terminal 10 through a wireless local area network And the network where the server 70 is located. The short-range wireless communication network may be a short-range wireless personal area network. In particular, the mobile terminal 10 can determine its own position through communication with the reference devices 30 using the local communication module.

The location information module is a module for obtaining the location (or current location) of the mobile terminal 10, and representative examples thereof include a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, the mobile terminal 10 can acquire the position of the mobile terminal 10 by using a signal sent from the GPS satellite by using the GPS module. As another example, when the mobile terminal 10 utilizes a Wi-Fi module, the mobile terminal 10 can acquire the position of the mobile terminal 10 based on information of a wireless access point (AP) Can be obtained. If necessary, the location information module may replace or additionally perform the function of any one of the other modules of the communication unit 11 to obtain data relating to the location of the mobile terminal.

The input unit 12 may include a user input unit for receiving information from a user, for example, a touch key, a mechanical key, and the like.

The sensing unit 14 may include one or more sensors for sensing at least one of information in the mobile terminal 10, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 14 may be an acceleration sensor, a magnetic sensor, a G-sensor, a gyroscope sensor, a motion sensor, an infrared sensor An infrared sensor, an ultrasonic sensor, and an optical sensor. At least one of the acceleration sensor, the magnetic sensor, the gravity sensor, the gyroscope sensor and the motion sensor may be oriented in the direction (azimuth, inclination, elevation) of the mobile terminal 10, And at least one of the infrared sensor, the ultrasonic sensor and the optical sensor may be used for measuring the distance between the mobile terminal 10 and the electronic device 50. [ For example, the ultrasonic sensor senses ultrasonic waves reflected from the electronic device 50 and returns to the controller 18, and the controller 18 can calculate the distance to the wave generating source (electronic device) through the sensed ultrasonic waves. The distance of the wave generating source can be calculated using the time difference between the output ultrasonic wave and the reflected ultrasonic wave.

The display unit 15 may implement a touch screen. Such a touch screen may function as a user input 12 that provides an input interface between the mobile terminal 10 and a user and may provide an output interface between the mobile terminal 10 and the user. In addition, the display unit 15 displays (outputs) the information processed by the mobile terminal 10. For example, the display unit 15 may display execution screen information of an application program driven by the mobile terminal 10, or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

The memory 17 stores a plurality of application programs (application programs or applications) driven by the mobile terminal 10, data and instructions for the operation of the mobile terminal 10, (ID) of the electronic device, and a map including the location information and the identification information of the one or more electronic devices 50. [ The memory 17 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card type micro type, card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (PROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk.

The control unit 18 typically controls the overall operation of the mobile terminal 10. The control unit 18 may process or process signals, data, information, and the like input or output through the above-mentioned components, or may drive an application program stored in the memory 17 to provide or process appropriate information or functions to the user. In addition, the control unit 18 may control at least some of the components in order to drive an application program stored in the memory 17. [ Furthermore, the control unit 18 may operate at least two or more of the components included in the mobile terminal 10 in combination with each other for driving the application program.

The control unit 18 determines the position of the mobile terminal 10 measured through communication between the communication unit 11 and the reference devices 30 and the position of the mobile terminal 10 measured by the sensing unit 14 The distance between the mobile terminal 10 and the electronic device 50 is used to measure the actual position of the electronic device 50. [ The control unit 18 may provide a user interface for setting a maximum allowable value of the distance between the mobile terminal 10 and the electronic device 50 used for measuring the position of the electronic device 50. [

The control unit 18 can transmit the positional information of the measured electronic device 50 to the memory 17 or the server 70 together with the identification information of the electronic device 50, The map can be generated using the identification information and stored in the memory 17. [

As described above, when the user executes the position tracking application and adjusts the direction of the mobile terminal 10 after the map is generated, the control unit 18 determines whether the direction of the mobile terminal 10 to be controlled is the measurement of the electronic device 50 It is determined whether or not it is facing the position. For this, the controller 18 determines whether the mobile terminal 10 is pointing to the position of the electronic device 50 registered in the map in consideration of the current position and the current direction of the mobile terminal 10. If the direction of the mobile terminal 10 faces the position of the electronic device 50, the control unit 18 can select and control the electronic device 50.

When the user inputs a touch input (e.g., a drag) to the display unit 15 so that the user faces the measured position of the electronic device 50, The user can select and control the electronic device 50 in consideration of the current position and the direction of the touch input.

The control unit 18 may display on the display unit 15 the identification information of one or more electronic devices 50 located on a virtual straight line that coincides with the direction of the mobile terminal 10 or the direction of the touch input . At this time, the control unit 18 may arrange the identification information on the display unit 15 in order according to the distance between the mobile terminal 10 and the corresponding electronic device 50. [ The user can easily select the desired electronic device 50 by using the identification information thus displayed. The control unit 18 may also provide a display unit 15 with a user interface for setting a virtual straight line length.

4 is a block diagram illustrating another example of a mobile terminal according to the present invention. The components of the mobile terminal 10 of FIG. 3 described above are also included in the mobile terminal 100 of FIG. 4, and the functions of the components are the same.

The mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, ), And the like. The components shown in FIG. 4 are not essential for implementing the mobile terminal 100, so that the mobile terminal 100 described herein can have more or fewer components than the components listed above have.

The wireless communication unit 110 may be connected between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and another mobile terminal 100 or between the mobile terminal 100 and the external server 100. [ Lt; RTI ID = 0.0 > wireless < / RTI > In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115 .

The input unit 120 includes a camera 121 or an image input unit for inputting a video signal, a microphone 122 for inputting an audio signal, an audio input unit, a user input unit 123 for receiving information from a user A touch key, a mechanical key, and the like). The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

The sensing unit 140 may include at least one sensor for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, A G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, An optical sensor (e.g., a camera 121, a microphone 122, a battery gage, an environmental sensor (e.g., a barometer, a hygrometer, a thermometer, (E.g., a sensor, a gas sensor, etc.), a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.) Lt; RTI ID = 0.0 > Combined can be used.

The output unit 150 includes at least one of a display unit 151, an acoustic output unit 152, a haptic tip module 153, and a light output unit 154 to generate an output related to visual, auditory, can do. The display unit 151 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user and may provide an output interface between the mobile terminal 100 and a user.

The interface unit 160 serves as a path to various types of external devices connected to the mobile terminal 100. The interface unit 160 is connected to a device having a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, And may include at least one of a port, an audio I / O port, a video I / O port, and an earphone port. In the mobile terminal 100, corresponding to the connection of the external device to the interface unit 160, it is possible to perform appropriate control related to the connected external device.

The memory 170 may store a plurality of application programs or applications running on the mobile terminal 100, data for operation of the mobile terminal 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. At least some of these application programs may exist on the mobile terminal 100 from the time of shipment for the basic functions of the mobile terminal 100 (e.g., call incoming, outgoing, message reception, and origination functions) . Meanwhile, the application program may be stored in the memory 170, installed on the mobile terminal 100, and may be operated by the control unit 180 to perform the operation (or function) of the mobile terminal.

In addition to the operations related to the application program, the control unit 180 typically controls the overall operation of the mobile terminal 100. The control unit 180 may process or process signals, data, information, and the like input or output through the above-mentioned components, or may drive an application program stored in the memory 170 to provide or process appropriate information or functions to the user.

In addition, the controller 180 may control at least some of the components illustrated in FIG. 4 in order to drive the application programs stored in the memory 170. FIG. In addition, the controller 180 may operate at least two of the components included in the mobile terminal 100 in combination with each other for driving the application program.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power to the components included in the mobile terminal 100. The power supply unit 190 includes a battery, which may be an internal battery or a replaceable battery.

At least some of the components may operate in cooperation with one another to implement a method of operation, control, or control of a mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170. [

Hereinafter, the components listed above will be described in more detail with reference to FIG. 4 before explaining various embodiments implemented through the mobile terminal 100 as described above.

First, referring to the wireless communication unit 110, the broadcast receiving module 111 of the wireless communication unit 110 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The mobile communication module 112 may be a mobile communication module or a mobile communication module such as a mobile communication module or a mobile communication module that uses technology standards or a communication method (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) And an external terminal, or a server on a mobile communication network established according to a long term evolution (e. G., Long Term Evolution-Advanced).

The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive a wireless signal in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) 113 transmit and receive data according to at least one wireless Internet technology, including Internet technologies not listed above.

The wireless Internet module 113 for performing a wireless Internet connection through the mobile communication network can be used for wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE or LTE- May be understood as a kind of the mobile communication module 112.

The short-range communication module 114 is for short-range communication, and includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB) (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short-range communication module 114 is connected to the mobile terminal 100 and the wireless communication system through the wireless area networks, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 ) And the other mobile terminal 100 (or the external server). The short-range wireless communication network may be a short-range wireless personal area network. In particular, the mobile terminal 100 may determine its location through communication with the reference devices 30 using the short-range communication module 114. [

Here, the other mobile terminal 100 may be a wearable device (e.g., a smartwatch, a smart glass, etc.) capable of interchanging data with the mobile terminal 100 according to the present invention (smart glass), HMD (head mounted display)). The short range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 around the mobile terminal 100. [ If the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the control unit 180 may transmit at least a part of the data processed by the mobile terminal 100 to the short- 114 to the wearable device. Therefore, the user of the wearable device can use the data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a telephone is received in the mobile terminal 100, the user performs a telephone conversation via the wearable device, or when a message is received in the mobile terminal 100, It is possible to check the message.

The position information module 115 is a module for obtaining the position (or current position) of the mobile terminal, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, it can acquire the position of the mobile terminal by using a signal transmitted from the GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, it can acquire the position of the mobile terminal based on information of a wireless access point (AP) that transmits or receives the wireless signal with the Wi-Fi module. Optionally, the location information module 115 may perform any of the other functions of the wireless communication unit 110 to obtain data relating to the location of the mobile terminal, in addition or alternatively. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

The input unit 120 is for inputting image information (or a signal), audio information (or a signal), or information input from a user. The input unit 120 may input image information The mobile terminal 100 may include one or a plurality of cameras 121. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [ A plurality of cameras 121 provided in the mobile terminal 100 may be arranged to have a matrix structure and various angles or foci may be provided to the mobile terminal 100 through the camera 121 having the matrix structure A plurality of pieces of image information can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or a running application program) being executed in the mobile terminal 100. Meanwhile, the microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The user input unit 123 is for receiving information from a user and when the information is inputted through the user input unit 123, the control unit 180 can control the operation of the mobile terminal 100 to correspond to the input information . The user input unit 123 may include a mechanical input means (or a mechanical key such as a button located on the front, rear or side of the mobile terminal 100, a dome switch, a jog wheel, Jog switches, etc.) and touch-type input means. For example, the touch-type input means may comprise a virtual key, a soft key or a visual key displayed on the touch screen through software processing, And a touch key disposed on the touch panel. Meanwhile, the virtual key or the visual key can be displayed on a touch screen having various forms, for example, a graphic, a text, an icon, a video, As shown in FIG.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a corresponding sensing signal. The control unit 180 may control the driving or operation of the mobile terminal 100 or may perform data processing, function or operation related to the application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface, or the presence of an object in the vicinity of the detection surface, without mechanical contact by using electromagnetic force or infrared rays. The proximity sensor 141 may be disposed in the inner area of the mobile terminal or in proximity to the touch screen, which is covered by the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is electrostatic, the proximity sensor 141 can be configured to detect the proximity of the object with a change of the electric field along the proximity of the object having conductivity. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the act of recognizing that the object is located on the touch screen in proximity with no object touching the touch screen is referred to as "proximity touch & The act of actually touching an object on the screen is called a "contact touch. &Quot; The position at which the object is closely touched on the touch screen means a position where the object corresponds to the touch screen vertically when the object is touched. The proximity sensor 141 can detect a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, have. Meanwhile, the control unit 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further provides visual information corresponding to the processed data It can be output on the touch screen. Furthermore, the control unit 180 can control the mobile terminal 100 such that different operations or data (or information) are processed according to whether the touch to the same point on the touch screen is a proximity touch or a touch touch .

The touch sensor senses a touch (or touch input) applied to the touch screen (or the display unit 151) by using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, do.

For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the touch screen or a capacitance generated in a specific portion to an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, a capacitance at the time of touch, and the like where a touch object touching the touch screen is touched on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like. Here, the touch controller may be a separate component from the control unit 180, and may be the control unit 180 itself.

On the other hand, the control unit 180 may perform different controls or perform the same control according to the type of the touch object, which touches the touch screen (or a touch key provided on the touch screen). Depending on the kind of the touch target object, whether to perform different controls or to perform the same control may be determined according to the current operating state of the mobile terminal 100 or an application program being executed.

On the other hand, the touch sensors and the proximity sensors discussed above can be used independently or in combination to provide a short touch (touch), a long touch, a multi touch, a drag touch ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, and the like. Touch can be sensed.

The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. Meanwhile, the controller 180 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera 121 includes at least one of a camera sensor (for example, a CCD, a CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to sense a touch of the sensing object with respect to the three-dimensional stereoscopic image. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

Also, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image. In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system) can be applied.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 153 may be vibration. The intensity and pattern of the vibration generated in the haptic module 153 can be controlled by the user's selection or setting of the control unit. For example, the haptic module 153 may synthesize and output different vibrations or sequentially output the vibrations.

In addition to the vibration, the haptic module 153 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 153 can transmit the tactile effect through the direct contact, and the tactile effect can be felt by the user through the muscles of the finger or arm. The haptic module 153 may include two or more haptic modules 153 according to the configuration of the mobile terminal 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the mobile terminal 100. Examples of events that occur in the mobile terminal 100 may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output from the light output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors to the front or rear surface. The signal output may be terminated by the mobile terminal detecting the event confirmation of the user.

The interface unit 160 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 160 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data in the mobile terminal 100 to an external device. For example, a port for connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, an audio I / O port, a video I / O port, an earphone port, and the like may be included in the interface unit 160.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM) A universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the interface unit 160. [

The interface unit 160 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, And various command signals may be transmitted to the mobile terminal 100. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 170 may store data related to vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 170 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read memory, a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs the storage function of the memory 170 on the Internet.

Meanwhile, as described above, the control unit 180 controls the operations related to the application program and the general operation of the mobile terminal 100. [ For example, when the state of the mobile terminal meets a set condition, the control unit 180 can execute or release a lock state for restricting input of a user's control command to applications.

In addition, the control unit 180 performs control and processing related to voice communication, data communication, video call, or the like, or performs pattern recognition processing to recognize handwriting input or drawing input performed on the touch screen as characters and images, respectively . Further, the controller 180 may control any one or a plurality of the above-described components in order to implement various embodiments described below on the mobile terminal 100 according to the present invention.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 includes a battery, the battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of an interface 160 through which an external charger for supplying power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 may use at least one of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission apparatus and a magnetic resonance coupling method based on an electromagnetic resonance phenomenon Power can be delivered.

5 is a diagram showing an example of a reference device 30 related to the present invention.

As shown in FIG. 5, the reference device 30 of the present invention includes a communication unit 31 and a control unit 38. It should be appreciated that the components shown in FIG. 5 are essential for implementing the present invention, and that the reference device 30 described herein may have more components than those listed above. In addition, the reference device 30 of the present invention may be configured to be coupled to a device such as a lighting device, a fire detector device, a household appliance device, or the like.

The communication unit 31 includes a short-range communication module. The short-range communication module is for short-range communication. The short-range communication module includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA) Can utilize at least one of UWB (Ultra Wideband), ZigBee, Near Field Communication (NFC), Wireless-Fidelity (WiFi), Wi-Fi Direct and Wireless USB have. The short-range communication module is provided between the reference device 30 and the mobile terminal 10 through the wireless area networks, between the reference device 30 and the electronic device 50, between the reference devices 30, Or a wireless communication between the reference device 30 and the network where the server 70 is located.

The control unit 38 controls communication between the communication unit 31 and the mobile terminal 10 and between the communication unit 31 and the electronic device 50 and between the communication unit 31 and the server 70. [

6 is a diagram showing an example of an electronic device 50 related to the present invention.

As shown in Fig. 6, the electronic device 50 of the present invention includes a communication unit 51 and a control unit 58. Fig. It is apparent that the components shown in FIG. 6 are essential for implementing the present invention, and that the electronic device 50 described in this specification can have more components than those listed above.

The communication unit 51 may include at least one of a local area communication module, a wired communication module, and a location information module.

The short-range communication module is for short range communication, and includes Bluetooth (registered trademark), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Communication, Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short-range communication module is a module for connecting between the electronic device 50 and the reference devices 30, between the electronic device 50 and the mobile terminal 10, or between the electronic device 50 and the mobile terminal 10 via the wireless area networks. And the network where the server 70 is located. The short-range wireless communication network may be a short-range wireless personal area network. In particular, the electronic device 50 can determine its position through communication with the reference devices 30 using the short-range communication module.

The position information module is a module for obtaining the position (or current position) of the electronic device 50, and representative examples thereof include a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the electronic device 50 utilizes a GPS module, it can acquire the position of the electronic device 50 using a signal transmitted from the GPS satellite. As another example, when the electronic device 50 utilizes the Wi-Fi module, based on the information of the wireless AP (wireless access point) transmitting or receiving the wireless signal with the Wi-Fi module, Can be obtained. Optionally, the location information module may replace or additionally perform any one of the other modules of the communication unit 51 to obtain data regarding the location of the electronic device.

The control unit 58 typically controls the overall operation of the electronic device 50. The control unit 58 may control the communication unit 51 to process input or output signals, data, information, or the like, or to communicate with the mobile terminal 10 or the reference devices 30. [

The control unit 58 compares the position information of the electronic device 50 provided by the mobile terminal 10 or the server 70 with the position of the electronic device 50 measured by the mobile device 10 or the server 70, And may respond to the terminal 10 or the server 70.

Hereinafter, embodiments related to a control method that can be implemented in a control system configured as above will be described with reference to the accompanying drawings. It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

Figs. 7 to 9 are diagrams for explaining a method of registering one or more electronic devices 50 and generating a map of the electronic device 50. Fig.

7, in a state where the mobile terminal 10 executes a remote control application used to register the position of the electronic device 50 and to control the electronic device 50, The mobile terminal 10 is moved to the vicinity of the electronic device 50 located in the room by a distance smaller than a predetermined maximum allowable distance between the mobile terminal 10 and the electronic device 50 It is desirable to approach. 8, the control unit 18 controls the maximum allowable distance between the mobile terminal 10 and the electronic device 50. The predetermined maximum allowable distance between the mobile terminal 10 and the electronic device 50 may be set / changed by the user. A user interface for setting / changing the distance can be provided.

It is preferable that at least one of the azimuth, tilt, and elevation of the mobile terminal 10 is controlled so that the mobile terminal 10 faces the electronic device 50 to be registered. As shown in FIG. 8, It is also possible that the upper end of the mobile terminal 10 faces the electronic device 50 or another part of the mobile terminal 10 faces the electronic device 50. [

When the mobile terminal 10 approaches the electronic device 50, the control unit 18 displays on the display unit 15 a list indicating previously registered electronic devices and other electronic devices capable of communication / control . At this time, the electronic devices can be recognized by the mobile terminal 10 and displayed on the list through PIN number, NFC, QR code, Received Signal Indication Proximity, or the like.

When the user selects any one of the electronic devices included in the list, the control unit 18 determines the position of the mobile terminal 10 through the short-range wireless communication between the reference devices 30 and the communication unit 11 And the sensing unit 14 senses the direction of the mobile terminal 10 toward the electronic device 50 and measures the distance between the mobile terminal 10 and the electronic device 50. [ Here, in order to measure the position of the mobile terminal 10 by the triangulation method, the controller 18 calculates the distance between the at least three reference devices 30, the speed and the frequency value of the radio wave for short- The distance between the devices 30 and the mobile terminal 10 can be measured and the position of the mobile terminal 10 can be measured using these values. It is also possible to measure the position of the mobile terminal 10 using another triangulation method. There are various methods for measuring the distance between the mobile terminal 10 and the electronic device 50. For example, the distance between the mobile terminal 10 and the electronic device 50 may be measured by using an ultrasonic sensor included in the sensing unit 14, (50) can be measured.

The control unit 18 measures the actual position of the electronic device 50 using the position and direction of the mobile terminal 10 and the distance between the mobile terminal 10 and the electronic device 50. [ Since the direction of the mobile terminal 10 toward the electronic device 50 at the current position of the mobile terminal 10 and the distance between the mobile terminal 10 and the electronic device 50 are measured as described above, It is possible to measure the position of the device 50 in a three-dimensional position. In other words, the position of the electronic device 50 can be expressed by coordinates (coordinates on a two-dimensional plane) and height (high and low) in the room. Instead of the mobile terminal 10, the server 70 may measure the actual position of the electronic device 50 using the position and orientation of the mobile terminal 10 and the distance between the mobile terminal 10 and the electronic device 50 It is also possible to do.

The control unit 18 generates position information of the electronic device 50 and transmits identification information (ID and the like) of the electronic device 50 to the memory 17 or the server 70 together with the generated position information . The location information and the identification information of the electronic device 50 transmitted in this manner are transmitted to the memory 17 or the server 70.

9, the above process is repeatedly performed to transmit and store the location information and the identification information for each electronic device in the room to the memory 17 or the server 70, and the control unit 18 or the server 70, Can generate the electronic device control map using the stored location information and the identification information.

7 to 9 illustrate the indoor electronic device 50 registration method, but outdoor electronic devices can also be registered in the same manner.

10 and 11 are views for explaining an example of a control method of a control system according to the present invention.

11, in a state where the mobile terminal 10, the plurality of reference devices 30, and the electronic device 50 are indoors and the remote control application included in the mobile terminal 10 is executed, If the direction of the mobile terminal 10 is adjusted so as to face the electronic device 50 desired by the user or a touch input (drag or flicking) is inputted to the display unit 15, the control unit 18 controls the mobile terminal 10 It is determined whether or not the direction indicated by the touch input coincides with the position of the electronic device 50 registered in the map. The control unit 18 determines the current position of the mobile terminal 10 through wireless communication with the reference devices 30 and determines the direction of the mobile terminal 10 or the touch input at the current position of the mobile terminal 10 It is determined whether or not the direction indicated by the mobile terminal 10 or the touch input coincides with the position of the registered electronic device 50. On the other hand, when the map is stored in the server 70, the server 70 determines whether or not the direction indicated by the mobile terminal 10 or the touch input matches the position of the registered electronic device 50 in place of the mobile terminal 10 It can be judged.

If the direction indicated by the mobile terminal 10 or the touch input coincides with the registered position of the electronic device 50, the control unit 18 selects the electronic device 50 and controls the electronic device 50 And displays the user interface for the user on the display unit 15. For example, if the electronic device 50 selected as shown in FIG. 11 is a creative, the control unit 18 may display a user interface for controlling a channel or a volume of the television on the display unit 15. [ The control unit 18 outputs a command for controlling the electronic device 50 according to a user's request and directly controls the electronic device 50 or controls the server 70 in accordance with a command of the mobile terminal 10. [ The electronic device 50 may be controlled by the control unit 50. [

10 and 11 illustrate the control method of the electronic device 50 in the room, however, if the reference devices 30 and the electronic device 50 are located outdoors, the outdoor electronic device can be controlled in the same manner.

12 to 14 are diagrams for explaining another example of the control method of the control system according to the present invention.

12, when the mobile terminal 10, the plurality of reference devices 30, the one or more electronic devices 50 are in the room and the remote control application included in the mobile terminal 10 is executed, The control unit 18 adjusts the direction of the mobile terminal 10 so that the user faces the desired electronic device 50 or inputs a touch input (drag or flicking) to the display unit 15 as shown in FIG. 14, It is determined whether the electronic device 50 that matches the direction indicated by the terminal 10 or the touch input is registered in the map. The control unit 18 determines the current position of the mobile terminal 10 through wireless communication with the reference devices 30 and determines the direction of the mobile terminal 10 or the touch input at the current position of the mobile terminal 10 It is confirmed whether the electronic device 50 located on the virtual straight line coinciding with the direction indicated by the mobile terminal 10 or the touch input is registered. Here, when the map is stored in the server 70, the server 70 can determine whether or not the electronic device 50 located on a virtual straight line is registered instead of the mobile terminal 10. In this case, the server 70 can transmit the identification information of the electronic device located on the imaginary straight line to the mobile terminal 10. [

In addition, the length of the virtual straight line can be changed / set by the user. For this, the controller 18 can provide a user interface for setting the length of the virtual straight line.

If at least one registered electronic device 50 is located on a virtual straight line, the control unit 18 displays a list of the electronic devices 50 on the display unit 15 as shown in FIG. In this case, the list may include identification information (ID) of the electronic device 50. The control unit 18 sequentially displays the identification information according to the distance between the mobile terminal 10 and the electronic device 50, (15).

Then, when the user selects any one of the electronic devices using the identification information included in the list, the control unit 18 displays a user interface for controlling the selected electronic device 50 on the display unit 15 can do. For example, if the electronic device 50 selected as shown in FIG. 13 is active, the control unit 18 may display a user interface for controlling the channel or volume of the television on the display unit 15. The control unit 18 outputs a command for controlling the electronic device 50 according to a user's request and directly controls the electronic device 50 or controls the server 70 in accordance with a command of the mobile terminal 10. [ The electronic device 50 may be controlled by the control unit 50. [

12 to 14 illustrate a method of controlling the electronic device 50 in the room. However, if the reference devices 30 and the electronic device 50 are located outdoors, the outdoor electronic device can be controlled in the same manner.

15 to 17 are diagrams for explaining another example of the control method of the control system according to the present invention.

15, in a state where the mobile terminal 10, the plurality of reference devices 30, the one or more electronic devices 50 are in the room and the remote control application included in the mobile terminal 10 is executed, And it is possible to scan the controllable electronic device 50 while changing the direction of the mobile terminal 10 as shown in Fig. Here, the width of the scan beam in FIG. 15 may be changed / set for the user. For this purpose, the controller 18 may provide a user interface for changing / setting the width of the scan beam. The scan beam may be set not only in a radial form but also in a cylindrical form, or may be set in other forms.

Next, the control unit 18 determines whether the electronic device 50 that matches the direction of the scan beam is registered in the map. The control unit 18 determines the current position of the mobile terminal 10 through wireless communication with the reference devices 30 and determines the direction and the range of the scan beam at the current position of the mobile terminal 10, It is confirmed whether the electronic device 50 located within the range of the beam is registered. If at least one registered electronic device 50 is located within the range of the scan beam, the control unit 18 displays a list of the electronic devices 50 on the display unit 15. [ In this case, the list may include identification information (ID) of the electronic device 50. The control unit 18 sequentially displays the identification information according to the distance between the mobile terminal 10 and the electronic device 50, (15).

Then, when the user selects any one of the electronic devices using the identification information included in the list, the control unit 18 displays a user interface for controlling the selected electronic device 50 on the display unit 15 can do. For example, if the selected electronic device 50 is a creative, the control unit 18 can display a user interface for controlling the channel or volume of the television on the display unit 15. [ The control unit 18 outputs a command for controlling the electronic device 50 according to a user's request and directly controls the electronic device 50 or controls the server 70 in accordance with a command of the mobile terminal 10. [ The electronic device 50 may be controlled by the control unit 50. [

15 to 17 illustrate a method of controlling the indoor electronic device 50. However, if the reference devices 30 and the electronic device 50 are located outdoors, the outdoor electronic device can be controlled in the same manner.

18 is a view for explaining another example of the control method of the control system according to the present invention.

As shown in FIG. 18, the control system includes a mobile terminal 10, a plurality of reference devices 30, one or more electronic devices 50, and a DLNA source (Digital Living Network Alliance Source) in a room. Here, the mobile terminal 10 may be used as a DLNA control device, and the electronic device 50 may be used as a DMR (Digital Media Renderer). The DLNA source is a network technology standard for media transmission and control between terminals in the home. It uses Internet protocols such as HTTP, RTP / RSTP, etc. to share contents such as images, music and videos under WiFi, Ethernet and Bluetooth network environment. It provides a protocol that can be used. The DLNA source may comprise a data storage device that connects to the network, such as a NAS (Network Attached Storage) or a DMS (Digital Media Server).

7 to 9, the control unit 18 may register the electronic devices 50 as a DMR or a DMS, and may control the DMR and the DMS using any one of the control methods of FIGS. have.

19 and 20 are diagrams for explaining another example of the control method of the control system according to the present invention.

20, in the state where the mobile terminal 10, the plurality of reference devices 30, and the electronic device 50 are indoors and the remote control application included in the mobile terminal 10 is executed, The controller 18 adjusts the direction of the mobile terminal 10 or inputs the touch input (drag or flicking) to the display unit 15 so that the user faces the desired electronic device 50, From the memory (170) or the server (70) or measures the current position of the electronic device (50). The controller 18 uses the position and the direction of the mobile terminal 10 and the distance between the mobile terminal 10 and the electronic device 50 to measure the current position of the corresponding electronic device 50. [

The control unit 18 generates position information using the registered position or the measured current position of the electronic device 50 and transmits the generated position information to the corresponding electronic device 50. At this time, the control unit 18 can transmit the identification information of the electronic device 50 together with the position information.

Then, the electronic device 50 compares the position information transmitted from the control unit 18 with the measured position of the user through the wireless communication between the reference devices 30, and transmits the comparison result to the mobile terminal 10 Reply. Here, since the electronic device 50 has the IPS function, it is possible to measure its position through communication with the reference devices 30.

If the transmitted location information and the measured location are the same, the electronic device 50 responds to the mobile terminal 10 and executes a pairing procedure so that it can be controlled by the mobile terminal 10. On the other hand, if the transmitted location information differs from the measured location, the electronic device 50 does not respond to the mobile terminal 10.

21 is a view for explaining another example of the control method of the control system according to the present invention.

The control unit 18 can register a specific position in the indoor space and designate at least one of functions and applications of the electronic device 50 or the mobile terminal 10 in this specific position in the same manner as in Figs. have. The functions of the electronic device 50 or the mobile terminal 10 designated by the position of the indoor space can be registered in the map stored in the memory 17 or the server 70. [ For example, as shown in FIG. 21, a specific position around the TV may be designated as a movie mode execution position, or a sleep mode may be designated at a specific position around the illumination. In addition, a specific application (e.g., a calendar application) of the mobile terminal 10 may be designated to a calendar in the room. Here, the size of the specific location registered in the map can be changed / set by the user. For this, the controller 18 can provide a user interface for changing / setting the size of the designated specific location.

When the user directs the direction of the mobile terminal 10 toward the specific position of the indoor space or inputs a touch input (drag or flicking) to the display unit 15, the control unit 18 controls the mobile terminal 10 or And executes at least one of functions and applications of the electronic device 50 or the mobile terminal 10 specified at a specific location indicated by the touch input. Here, the controller 18 measures the current position of the mobile terminal 10 in the above-described manner to determine the specific position indicated by the mobile terminal 10 or the touch input, Determines the direction of the terminal 10 or the touch input, and then determines the specific position indicated by the mobile terminal 10 or the touch input.

If the mobile terminal 10 or the touch input is directed to a specific position around the TV, the control unit 18 can control the television to execute the movie mode. In addition, if the mobile terminal 10 or the touch input is pointing to a calendar in the room, the control unit 18 may execute the calendar application of the mobile terminal 10. [

22 is a view for explaining another example of the control method of the control system according to the present invention.

As shown in FIG. 22, the control system includes a mobile terminal 10, a plurality of reference devices 30, and one or more electronic devices 50 in the room. Here, the mobile terminal 10 may have a function of miracast that is connected to an electronic device based on Wifi-Direct. In addition, the electronic device 50 may have an IPS function. In this case, the mobile terminal 10 and the electronic device 50 can perform P2P pairing.

23 is a view for explaining another example of the control method of the control system according to the present invention.

The control unit 18 can register a specific position in a room in the same manner as in FIGS. 7 to 9 and designate an item frequently lost by the user at the specific position. For example, as shown in FIG. 23, after the position of the frequently lost object 53 is measured, it can be registered in the map stored in the memory 17 or the server 70.

Thereafter, when the frequently-lost object 53 is input to the mobile terminal 10, the control unit 18 informs the user of the specific position designated by the object 53. [

24 is a view for explaining another example of the control method of the control system according to the present invention.

The control unit 18 can register the position of each article in the shop in the same manner as in FIGS. The positions of the articles and the information about the articles can be registered in the map stored in the memory 17 or the server 70. [ Here, the information on the article includes information such as an article name, a price, a manufacturer, a manufacturing date, a sale / inventory quantity, and the like.

Thereafter, when the user adjusts the direction of the mobile terminal 10 so as to face the position of the article, the controller 18 displays information on the article on the display unit 15. In addition, it is also possible to display information on a plurality of articles at the same time by setting the scan beam of the mobile terminal 10 to be wide.

25 and 26 are diagrams for explaining a method of registering a position of a specific area in a room and generating a map relating to the specific area.

First, in a state where the application used to register the position of a specific area (e.g., the first and second areas) and to control the mobile terminal 10 is executed on the mobile terminal 10, (For example, a host or a manager) moves the mobile terminal 10 to a specific area located in the room (for example, a conference room). Here, the user may designate a desired area in the space as a specific area and approach the mobile terminal 10 to a distance smaller than a predetermined maximum allowable distance between the mobile terminal 10 and the specific area. 26, the control unit 18 sets the maximum allowable distance between the mobile terminal 10 and the specific area by the user. For this purpose, the controller 18 sets the maximum allowable distance on the display unit 15 / Offset < / RTI > In addition, the control unit 18 can set a virtual NFC tag in a specific area, designate a desired data or message in an NFC tag, and can change / set the size of a specific area according to a user's request. For this, the controller 18 may provide a user interface for setting a Tag and a user interface for changing / setting a size of a specific area.

At least one of the azimuth, inclination and height of the mobile terminal 10 is preferably adjusted so that the mobile terminal 10 faces a specific area to be registered. When the top of the mobile terminal 10 faces a specific area Or another part of the mobile terminal 10 may be directed to a specific area.

The control unit 18 measures the position of the mobile terminal 10 through the short distance wireless communication between the reference devices 30 and the communication unit 11 and measures the position of the mobile terminal 10 toward the specific area using the sensing unit 14. [ (10) and measures the distance between the mobile terminal (10) and a specific area. Here, in order to measure the position of the mobile terminal 10 by the triangulation method, the controller 18 calculates the distance between the at least three reference devices 30, the speed and the frequency value of the radio wave for short- The distance between the devices 30 and the mobile terminal 10 can be measured and the position of the mobile terminal 10 can be measured using these values. It is also possible to measure the position of the mobile terminal 10 using another triangulation method. For example, the distance between the mobile terminal 10 and a specific region may be measured using an ultrasonic sensor included in the sensing unit 14, Can be measured.

Next, the controller 18 measures the position and direction of the mobile terminal 10 and the actual position of the specific region using the distance between the mobile terminal 10 and the specific region. Since the distance between the mobile terminal 10 and the specific area is measured in the direction of the mobile terminal 10 toward the specific area at the current position of the mobile terminal 10, the controller 18 determines the position of the specific area in three dimensions It is possible to measure by position. That is, the position of a specific region can be expressed by coordinates (coordinates on a two-dimensional plane) and a height (high and low) in a room. It is also possible for the server 70 to measure the actual position of the specific region by using the position and direction of the mobile terminal 10 and the distance between the mobile terminal 10 and the specific region instead of the mobile terminal 10.

Then, the control unit 18 generates positional information of the specific area, and transmits identification information (ID, etc.) of the specific area to the memory 17 or the server 70 together with the generated positional information. The location information and the identification information of the specific area thus transmitted are transmitted to the memory 17 or the server 70.

This process is repeated to transmit and store the location information and the identification information for each specific area (the first and second areas) in the room to the memory 17 or the server 70, and the control unit 18 or the server 70 May generate a map for a specific area using the stored location information and the identification information.

FIGS. 27 and 28 are diagrams for explaining an example of a system control method using the registered specific areas of FIGS. 25 and 26. FIG.

27, when the mobile terminal 10 of another user (for example, a guest) moves to the first area or passes through the first area, the mobile terminal 10 of the guest moves to the reference devices 30, And transmits position information indicating the measured position to the mobile terminal 10 or the server 70 of the host.

Then, the mobile terminal 10 or the server 70 of the host determines whether the mobile terminal 10 of the guest has moved to the second area based on the transmitted location information. If the mobile terminal 10 of the guest has not moved to the second area, the mobile terminal 10 or the server 70 of the host can determine the distance or proximity between the mobile terminal 10 and the second area of the guest ) Of the guest, and information for guiding the direction or route of the guest from the mobile terminal 10 to the second area.

When the mobile terminal 10 of the guest moves to the second area, the mobile terminal 10 or the server 70 of the host transmits data or a message specified in the virtual NFC tag of the second area, for example, The guest terminal 10 can control the guest's mobile terminal 10 to transmit data or a message asking the user to the mobile terminal 10 of the guest and display the transmitted data or message on the mobile terminal 10 of the guest. Here, the mobile terminal 10 or the server 70 of the host can store data or messages designated in each specific area.

Then, if the guest indicates the presence or absence by pressing the "Enter" button of his / her mobile terminal 10, the mobile terminal 10 or the server 70 of the host can determine whether or not the guest is present. As described above, by using the system shown in FIG. 27 to FIG. 28, it is possible to automatically confirm whether or not a guest is present and to perform an unattended guidance.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). Also, the computer may include a control unit 180 of the terminal. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

10, 100: mobile terminal 11:
12: input unit 14: sensing unit
15: display unit 17: memory
18: control unit 30: reference device
50: electronic device 70: server

Claims (11)

A communication unit for communicating with at least one reference device;
A sensor unit for sensing a direction of the mobile terminal;
A position of the mobile terminal measured by communication between the reference device and the communication unit, a direction of the mobile terminal toward a specific area, and a distance between the mobile terminal and the specific area, And a controller,
Wherein,
When there are a plurality of electronic devices located on a virtual straight line coinciding with a direction in which the mobile terminal is pointing, identification information corresponding to each of the electronic devices according to the distance between the mobile terminal and each of the electronic devices To be arranged in a primary order on the display unit, and
Wherein when the identification information corresponding to a specific electronic device among the plurality of electronic devices is selected, an interface for controlling only the specific electronic device is arranged to be secondarily arranged on the display unit. The method according to claim 1,
Wherein,
Wherein the location information indicating the location of the specific area is stored in a memory of the server or the mobile terminal. The method according to claim 1,
Wherein,
Wherein the mobile terminal provides a user interface for setting a maximum allowable value of the distance between the mobile terminal and the specific area used for measuring the position of the specific area. The method according to claim 1,
Wherein,
And provides a user interface for setting / changing the range of the specific area. The method according to claim 1,
Wherein,
And controls the other mobile terminal when the other mobile terminal moves to the specific area. The method according to claim 1,
Wherein,
And when the other mobile terminal moves to the specific area, transmits the stored data to the moved mobile terminal. Measuring a position of the mobile terminal using communication between the at least one reference device and the mobile terminal;
Sensing a direction of the mobile terminal toward a specific area of the room using the sensor unit of the mobile terminal;
Measuring a distance between the mobile terminal and the specific region;
Measuring a position of the specific region using the measured position and the sensed direction of the mobile terminal and the measured distance;
When there are a plurality of electronic devices located on a virtual straight line coinciding with a direction in which the mobile terminal is pointing, identification information corresponding to each electronic device in order according to the distance between the mobile terminal and each of the electronic devices Controlling to be arranged in a primary order on the display unit; And
Controlling an interface for controlling only the specific electronic device to be arranged on the display unit when the identification information corresponding to the specific electronic device among the plurality of electronic devices is selected
Wherein the mobile terminal is a mobile terminal. delete delete delete delete

Images