WO2014207792A1

WO2014207792A1 - Terminal device and remote control method

Info

Publication number: WO2014207792A1
Application number: PCT/JP2013/067172
Authority: WO
Inventors: 正幸平林; 西島　英男; 益岡　信夫; 吉澤　和彦; 次雄板垣; 鈴木　基之; 清水　宏
Original assignee: 日立マクセル株式会社
Priority date: 2013-06-24
Filing date: 2013-06-24
Publication date: 2014-12-31

Abstract

An easy-to-use terminal device and remote control method are provided. In a terminal device for remotely controlling a plurality of electrical devices, a position information detection means for acquiring the current position of the terminal device, a short-range wireless communication means, and an information storage means are provided; when identification information for the electrical devices is acquired by the short-range wireless communication means, the position information detection means detects position information and the position information is associated with the identification information for the electrical devices and stored in the storage means; and when the electrical devices are controlled remotely, the position information detection means detects position information, the direction from the position information to the position information stored in the storage means is calculated, and the electrical device in the direction closest to the calculated direction is selected.

Description

Terminal apparatus and remote control method

The present invention relates to a terminal device and a remote control method.

As a background art in this technical field, there is JP-A-2006-6279424 (Patent Document 1). This publication describes the following as a problem. “Provides a remote control system for electrical equipment that can operate electrical equipment with a remote control regardless of the presence of obstacles and that has a simple configuration.”
The means for solving this problem is described as follows. “This system is composed of a plurality of electrical devices, a management server that collectively manages command information of the electrical devices, and a single remote controller. A device selection table that associates an arbitrary direction with each electric device is registered in the management server.When the user points the remote control in a predetermined direction, the direction detection device detects the direction of the remote control and operates The device is selected according to the device selection table. "

JP 2006-6279424 A

The patent document 1 describes the following effects. “According to the present invention, a predetermined part of the remote control, for example, the direction in which the front end is facing is detected, and the electric device to be operated is selected based on the information, so that it is in a place obstructed by an obstacle. Even in the case of electric devices arranged, it is possible to download command information from the management server and operate from the remote controller. "
However, since a predetermined direction is defined such as “azimuth 45 degrees” for a TV, “azimuth 135 degrees” for a DVD recorder, and “azimuth 225 degrees” for an air conditioner, the direction of the remote control at a specific position is set to each electric Although it can be matched with the position of the device, the orientation of the remote control cannot be matched at another position.

Therefore, an object of the present invention is to provide a user-friendly terminal device and a remote control method.

In order to solve the above problems, for example, the configuration described in the claims is adopted.

The present application includes a plurality of means for solving the above-described problem. To give an example, in a terminal device having a remote control function for electrical equipment, position information detection means for acquiring the current position of the terminal device; Direction detecting means for acquiring the direction to which the terminal device is directed, storage means for storing position information of the electric device, position information of the terminal device, direction to which the terminal device is directed, and storage means Selection means for selecting the electric device within a predetermined range of the orientation to which the terminal device is directed from the stored position information of the electronic device, and remote control for remotely controlling the electric device selected by the selection means And a control means.

As another example, in a terminal device having a remote control function for electrical equipment, a position information detection unit that acquires the current position of the terminal device, and a direction that acquires the direction in which the terminal device is facing Detecting means; arrangement information detecting means for detecting arrangement information of the electric equipment; storage means for storing the identification information of the electronic equipment and arrangement information of the electric equipment; and the position information detecting means. The electrical device within a predetermined range is selected from the orientation to which the terminal device faces from the position information from the orientation, the orientation from the orientation detection means, and the arrangement information of the electronic equipment stored in the storage means Of the electrical equipment selected by the display electrical equipment selection means and the electrical display equipment selection means, the electrical equipment in an orientation that is substantially coincident with the orientation that the terminal device is facing is substantially in the center. To display different information, is the electric device in the direction that does not substantially match, a terminal device, characterized in that it comprises display means for displaying the identification information from the substantially central portion in a predetermined amount shifted location, a.

According to the present invention, it is possible to control an electric device with a simple operation.

Issues, configurations, and effects other than those described above will be clarified by the following description of the embodiments.

The figure which shows the structure of the remote control system of a 1st Example. The hardware block diagram of the terminal device of a 1st Example. The flowchart explaining the registration process of the electric equipment of a 1st Example. The flowchart explaining the registration process of the electric equipment of a 1st Example. The flowchart explaining the registration process of the electric equipment of a 1st Example. The flowchart explaining the selection process of the electric equipment of a 1st Example. The example of a liquid crystal panel display of the terminal device of a 1st Example. The figure which shows the azimuth | direction and azimuth | direction angle of the housing of the terminal device of a 1st Example. The example of a liquid crystal panel display of the terminal device of a 1st Example. The floor plan of the 1st Example and the layout of an electric equipment. The example of a liquid crystal panel display of the terminal device of a 1st Example. The flowchart explaining the selection process of the electric equipment of a 2nd Example. The floor plan of the 2nd Example and the layout of an electric equipment. The flowchart explaining the selection process of the electric equipment of a 3rd Example. The figure which shows the attitude | position of the housing of the terminal device of a 3rd Example. The example of a liquid crystal panel display of the terminal device of a 3rd Example. The floor plan of the 3rd Example and the layout of an electric equipment. The flowchart explaining the registration process of the electric equipment of a 4th Example. The flowchart explaining the registration process of the electric equipment of a 4th Example. The example of a liquid crystal panel display of the terminal device of a 5th Example. The functional block diagram of the terminal device of a 1st Example. The functional block diagram of the terminal device of a 2nd Example. The functional block diagram of the terminal device of a 3rd Example.

Hereinafter, examples will be described with reference to the drawings.

FIG. 1 is a diagram showing a configuration of a remote control system according to a first embodiment of the present invention. The remote control system of the present embodiment includes at least one terminal device and a plurality of electric devices.

The terminal device 1 has a wireless communication function, and can transmit and receive various information from the Internet network. Furthermore, it has the function to perform remote control of the electric equipment 3, and the user uses the terminal device 1 to remotely control electric equipment such as the lighting equipment 3a, the air conditioner 3b, the video display device 3c, and the bathroom water heater 3d. can do. In addition, although lighting equipment, an air conditioner, etc. were taken as an example of electrical equipment to be remotely controlled, any equipment that uses electricity for at least a part of control may be used. Gas equipment such as a gas stove or gas stove, electric lock, automobile Etc.

The remote controller (hereinafter referred to as “remote controller”) 2 is a dedicated control device for each electric device, and can perform remote control of the corresponding electric device by infrared rays or the like. The remote controller 2a is a remote controller dedicated to the lighting device 3a, the remote controller 2b is a remote controller dedicated to the air conditioner 3b, the remote controller 2c is a remote controller dedicated to the video display device 3c, and the remote controller 2d is a remote controller dedicated to the bathroom water heater 3d.

The lighting device 3a can be turned on / off and brightness can be set from the terminal device 1 or the remote controller 2a. The air conditioner 3b can be turned on / off, set in mode, and set in temperature from the terminal device 1 or the remote controller 2b. The video display device 3c can be turned on / off, channel setting and volume setting from the terminal device 1 or the remote control 2c. The video display device 3c is a device that receives and displays video content. For example, the video display device 3c can receive a television signal from a broadcasting station wirelessly or by wire and display the video content based on the television signal. . Also, video content received from the network 5 via the wireless router 4 such as Internet content of URL (Uniform Resource Locator) designated by the user or the like can be displayed. The bathroom water heater 3d can set the hot water supply mode and the temperature from the terminal device 1 or the remote controller 2d.

The wireless router 4 has a wireless LAN (Local Area Network) function such as Wi-Fi (Wireless Fidelity) and can be connected to the network 5 via a communication line. By connecting to the wireless router 4, the terminal device 1 and the video display device 3 c can acquire and display video content and various information from the Internet network.

FIG. 2 is a hardware configuration diagram of the terminal device 1 of FIG.

The terminal device 1 may be a mobile phone, a smart phone, a tablet terminal, or the like, or may be a PDA (Personal Digital Assistants) or a notebook PC (Personal Computer). A music player, a digital camera, a portable game machine, or other portable digital device having a communication function may be used.

A CPU (Central Processing Unit) 201 controls each part of the terminal device 1. The CPU 201 may be an arbitrary control circuit or a dedicated circuit such as an ASIC (Application Specific IC), and controls the entire terminal device 1 according to a predetermined program.

The memory 202 includes a ROM (Read Only Memory), a RAM (Random Access Memory), a flash ROM, and the like, and stores a program for controlling the terminal device 1, various setting values, and the like.

A GPS (Global Positioning System) receiving device 203 is a receiving device of a global positioning system that includes an antenna, a decoding circuit, and the like and can detect the position of the terminal device 1 on the earth by receiving radio waves from a satellite.

It should be noted that the positional accuracy can be improved by DGPS (Differential GPS) that receives a GPS satellite correction signal from a base station and corrects GPS information. Further, the position accuracy can be further improved by a quasi-zenith satellite system QZSS (Quasi-Zenith Satellite System) that receives a correction signal from a geosynchronous orbit satellite and supplements and reinforces GPS information.

Also, seamless positioning is possible indoors and outdoors by IMES (Indoor Messing System) that receives GPS satellite compatible signals from the indoor GPS transmitter and acquires position information.

The geomagnetic sensor 204, the acceleration sensor 205, and the gyro sensor 206 are a group of sensors for detecting the posture and movement of the housing of the terminal device 1, and the position, direction, orientation, inclination, and movement of the terminal device 1 are determined by these sensor groups. Etc. can be detected. Other sensors may be further provided.

The operation device 207 is, for example, a touch pad, receives an operation by a user, and transmits an instruction based on the operation to the CPU 201.

The display device 208 is a liquid crystal panel, for example, and displays various information. A combination of a liquid crystal panel and a touch pad is generally called a touch panel, and this embodiment also describes an example using a touch panel.

The video input device 209 is a camera, for example, and inputs image data of surroundings and objects by converting light input from a lens into an electrical signal.

The audio output device 210 is an amplifier and a speaker, for example, and outputs various sounds.

The voice input device 211 is a microphone, for example, and converts a user's voice or the like into voice data and inputs the voice data.

The near field communication device 212 can perform near field communication such as NFC (Near Field Communication), and can input and output various data.

The LAN communication device 213 can obtain various information from the Internet network via the wireless router 4 or the like using, for example, Wi-Fi. In addition, the electric device 3 can be remotely controlled by transmitting / receiving control commands, statuses, and the like to / from the electric device 3 via the wireless router 4 or the like. Further, for example, using Wi-Fi Direct, Bluetooth (registered trademark) or the like, control commands, statuses, and the like may be directly transmitted / received to / from the electric device 3 without using the wireless router 4 or the like.

The short-range communication device 212 and the LAN communication device 213 are each provided with an antenna, a coding circuit, a decoding circuit, and the like.

FIG. 21 is a functional block diagram of the terminal device 1 of FIG. Each functional block of the terminal device 1 operates on the CPU 201 included in the terminal device 1 illustrated in FIG. 2, for example.

The control unit 2101 includes an azimuth calculation unit 2120, an azimuth comparison unit 2121, an icon extraction unit 2122, an application activation unit 2124, and the like. Based on instructions from the user interface unit 2108, the storage unit 2102, the position information acquisition unit 2103, a housing The azimuth detection unit 2105, the short-range wireless communication unit 2112, the LAN communication unit 2113, and the like are controlled to perform registration of the electrical device 3 before using the remote control, selection of the electrical device 3 when using the remote control, and remote control. The user interface unit 2108 is, for example, the operation device 207, the display device 208, the video input device 209, the audio output device 210, the audio input device 211, and the like illustrated in FIG.

Before using the remote control, the control unit 2101 acquires information necessary for remote control of the electrical device 3 and registers it in the storage unit 2102. First, the identification signal and icon of the electric device 3 and the URL of the remote control application are acquired via the short-range wireless communication unit 2112 and stored in the identification signal list 2134 and the icon list 2132 of the storage unit 2102. At the same time, the position information acquisition unit 2103 acquires the position information of the electrical device 3 and stores it in the position information list 2131 of the storage unit 2102. Further, a remote control application is acquired from the network 5 via the LAN communication unit 2113 according to the URL, and stored in the application list 2133 of the storage unit 2102.

The remote control application is application software for remotely controlling the electrical device 3. A plurality of electrical devices 3 can be registered in the list of the storage unit 2102, and position information, icons, a remote control application, and the like are registered in association with each identification information.

When using the remote control, the control unit 2101 selects the electric device 3 to be remotely controlled from the electric devices 3 registered in the storage unit 2102. First, the position information is acquired by the position information acquisition unit 2103, and the direction to the position information of all the electric devices 3 in the position information list 2131 by the direction calculation unit 2120 (the direction from the terminal device to all the electric devices 3). Is calculated. Next, the housing orientation detection unit 2105 detects the orientation of the housing of the terminal device 1, and the orientation comparison unit 2121 compares the orientation with all the electrical devices 3 from the terminal device. Next, based on the comparison result, the icon extraction unit 2122 extracts the icon of the electrical device 3 that has the closest orientation to the chassis orientation from the icon list 2132 and displays it on the user interface unit 2108.

If the icon displayed on the user interface unit 2108 is an icon of the desired electrical device 3, the user selects the icon, and the application activation unit 2124 selects the remote control corresponding to the icon from the application list 2133. Launch the app. If the icon displayed on the user interface unit 2108 is not the icon of the desired electrical device 3, the user changes the orientation of the casing of the terminal device 1 so that the icon of the desired electrical device 3 is displayed.

In this way, the user can remotely control the desired electrical device 3.

FIG. 3 is a flowchart showing a registration process of the electric device 3 by the terminal device 1 according to the first embodiment of the present invention. In order to perform remote control of the electric device 3, it is necessary to register the electric device 3. In the present invention, application software for calling a remote control application is called a launcher application to distinguish it from the remote control application. In the present invention, it is assumed that the remote app is registered and called through the launcher app.

In this embodiment, the user can perform the registration process only by bringing the terminal device 1 close to the electric device 3.

In step S301, the terminal device 1 confirms whether or not the electrical device 3 exists within the communication range of the short-range wireless communication by the short-range communication unit 2112. When the electric device 3 exists in the communication area, the launcher application is activated and the electric device is registered.

First, in step S302, identification information is confirmed.

Next, in step S304, the current position information is acquired by the position information acquisition unit 2103 or the like. Since the electric device 3 is currently in the same position as the terminal device 1, the acquired position information becomes the position information of the electric device 3.

Next, in step S <b> 305, the terminal device 1 acquires a remote control application for the electrical device 3. The remote control application may be acquired directly from the electric device 3 in addition to being acquired from the Internet network according to the URL indicated by the electric device 3. Furthermore, product information may be acquired from the Internet network or the electrical device 3.

Next, in step S306, the identification information, remote control application, position information, product information, etc. of the electric device 3 are registered in the list, and the process is terminated.

In addition, when the electric device 3 exists in the communication area of the short-distance wireless communication of the terminal device 1, the activation of the remote control application may be performed.

FIG. 4 is a flowchart showing another example of the registration process of the electric device 3 by the terminal device 1 according to the first embodiment of the present invention, which is obtained by adding the activation process of the remote control application to the registration process of FIG. .

Since steps S401 to S402 are the same as steps S301 to S302, the description thereof is omitted.

In step S <b> 403, the terminal device 1 confirms whether or not the electric device 3 has been registered in the list stored in the memory 202. If the identification information of the electric device 3 exists in the list, it is registered, and if it does not exist, it is unregistered. If the electrical device 3 has been registered in the list, the process proceeds to step S408, and if not, the process proceeds to step S404.

Steps S404 to S406 are the same as steps S304 to S306. The current position information and remote control application are acquired, and the identification information, remote control application, position information, product information, and the like of the electric device 3 are listed. Register with.

Next, proceeding to step S408, the terminal device 1 activates the remote control application, and performs a remote control operation of the electrical device 3 at step S409. When the remote control operation ends, the process ends.

In addition, when the electric device 3 has been registered in the list, it may be confirmed whether the position information is the latest (whether the position has not been moved), and if the position has been moved, the position information may be re-registered.

FIG. 5 is a flowchart showing another example of the registration process of the electric device 3 by the terminal device 1 according to the first embodiment of the present invention, and a confirmation process for checking whether the position information is the latest is added to the registration process of FIG. It is a thing.

Since steps S501 to S502 are the same as steps S301 to S302, description thereof will be omitted.

Step S504 is the same process as step S304, and the current position information is acquired.

Next, in step S <b> 503, the terminal device 1 confirms whether or not the electric device 3 has been registered in the list stored in the memory 202. If the electrical device 3 has been registered in the list, the process proceeds to step S507, and if not, the process proceeds to step S505.

Steps S505 to S506 are the same as steps S305 to S306. The remote control app for the electrical device 3 is acquired, and the identification information, remote control app, location information, product information, etc. of the electrical device 3 are listed. Register with.

In step S507, the terminal device 1 checks whether the registered position information of the electrical device 3 matches the position information acquired in step S504. If not, the process proceeds to step S506, and in step S504. Register the latest acquired location information in the list again.

FIG. 6 is a flowchart showing a selection process of the electrical equipment 3 by the terminal device 1 according to the first embodiment of the present invention. This flowchart shows a process of selecting a desired remote control application by the launcher application.

In step S601, the terminal device 1 waits for the remote control launcher activation button to be pressed by the user. For example, a physical switch such as a home button of the terminal device 1 may be assigned to the remote control launcher activation button, or an icon on the touch panel may be assigned.

FIG. 7 is a display example of the touch panel of the terminal device 1. FIG. 7A shows an example of the home screen of the terminal device 1, and a “remote control” launcher icon is displayed among the icons of various applications displayed on the touch panel. Touching this icon is equivalent to pressing the remote control launcher activation button. Note that the “remote control” launcher icon is displayed only when the terminal device 1 is at home as shown in FIG. 7A, and the “remote control” launcher icon is not displayed at home as shown in FIG. 7B. Also good. This prevents the user from accidentally touching the “remote control” launcher icon outside the home and activating the remote control launcher application. Whether the terminal device 1 is inside or outside the home can be confirmed, for example, by checking whether the terminal device 1 is within the communication range of the wireless router 4. Alternatively, it can be confirmed by GPS or the like.

When the remote launcher launch button is pressed, launch the launcher app, select the remote app and launch it.

First, the process proceeds to step S602, where the position information acquisition unit 2103 or the like acquires the position information of the terminal device 1. The acquired position information indicates the current location of the terminal device 1 at the timing when the remote control launcher activation button is pressed.

Next, in step S604, the azimuth | direction to all the electric equipments 3 registered from the terminal device 1 is calculated. The orientation of the terminal device 1 and the electric device 3 is obtained from the registered position information of the electric device 3 and the current position information of the terminal device 1.

For example, it is assumed that the video display device 3c1 is installed at latitude 35.65858080 and longitude 139.745433, and the air conditioner 3b1 is installed at latitude 35.65858080 and longitude 139.745423. When the terminal device 1 is at latitude 35.65857070 and longitude 139.7454433, the latitudes of the video display device 3c1 and the air conditioner 3b1 are equal, and the longitudes of the terminal device 1 and the video display device 3c1 are equal. The direction to 3c1 is north (azimuth angle 0 °), and the direction from the terminal device 1 to the air conditioner 3b1 is northwest (azimuth angle 315 °). The distance between the terminal device 1 and the video display device 3c1 is about 1 m, the distance between the video display device 3c1 and the air conditioner 3b1 is about 1 m, and the distance between the terminal device 1 and the air conditioner 3b1 is about 1.4 m.

Next, in step S605, geomagnetism is detected by the geomagnetic sensor 204 and the azimuth of the casing of the terminal device 1 is calculated. At this time, the terminal device 1 is directed to the electric device 3 that is desired to be operated by remote control. The direction may be calculated by using other sensors or using them in combination.

FIG. 8 is a conceptual diagram showing the azimuth and azimuth of the casing of the terminal device 1. The relationship between azimuth and azimuth is 45 ° northeast, 90 ° east, 135 ° southeast, 180 ° south, 225 ° southwest, 270 ° southwest, 270 ° west, and 315 ° northwest when north is 0 °. It becomes. This is an example in which the posture (orientation) of the casing of the terminal device 1 is in the vertical orientation.

In step S607, the icon of the electric device 3 whose orientation calculated in step S604 is closest to the orientation of the housing of the terminal device 1 is displayed on the user interface unit 2108. Alternatively, the icon may be displayed not only when it is closest but also when the difference in orientation is within a predetermined range (for example, the orientation angle ± 10 °). Or you may display some electric equipment 3 of a near azimuth | direction.

For example, as described above, when the orientation from the terminal device 1 to the video display device 3c1 is north (azimuth angle 0 °) and the orientation from the terminal device 1 to the air conditioner 3b1 is northwest (azimuth angle 315 °), the terminal device 1 is When facing the video display device 3c1, the azimuth of the housing is close to the north (azimuth angle 0 °), and the icon of the video display device 3c1 is displayed. When the terminal device 1 is pointed toward the air conditioner 3b1, the orientation of the housing is near the northwest (azimuth angle 315 °), and the icon of the air conditioner 3b1 is displayed.

FIG. 9 shows a display example of the liquid crystal panel of the terminal device 1.

FIG. 9A shows a display example of the liquid crystal panel when the terminal device 1 is directed to the lighting device 3a1. An icon of the lighting device is displayed on the liquid crystal panel, indicating that the lighting device 3a1 exists in the direction in which the terminal device 1 is facing.

FIG. 9B shows a display example of the liquid crystal panel when the terminal device 1 is directed to the air conditioner 3b1. An air conditioner icon is displayed on the liquid crystal panel, indicating that the air conditioner 3b1 is present in the direction in which the terminal device 1 is facing.

FIG. 9C shows a display example of the liquid crystal panel when the terminal device 1 is directed to the video display device 3c1. An icon of the video display device is displayed on the liquid crystal panel, indicating that the video display device 3c1 exists in the direction in which the terminal device 1 is facing.

FIG. 9D shows another display example of the liquid crystal panel when the terminal device 1 is directed to the air conditioner 3b1. An air conditioner icon is displayed on the liquid crystal panel, indicating that the air conditioner 3b1 is present in the direction in which the terminal device 1 is facing. Further, an icon of the lighting device is displayed on the left side, indicating that the lighting device 3a1 is present in the left direction of the direction in which the terminal device 1 is facing. Further, an icon of the video display device is displayed on the right side, which indicates that the video display device 3c1 exists in the right direction in the direction in which the terminal device 1 is facing. Thus, you may display the icon of the electric equipment 3 with the azimuth | direction nearest to the left and right. This makes it easier to find the icon of the desired electrical device 3.

Further, not only the direction is closest to the second direction, but also only the icon of the electric device 3 whose direction difference is within a predetermined range (for example, an azimuth angle of 45 ° or 90 °) may be displayed on the left and right. In this case, the icon of the lighting device is not displayed on the left side, and the icon of the video display device is displayed on the right side. By doing so, it is easy to find the icon of the desired electrical device 3 by eliminating the icon of the electrical device 3 in a completely different direction.

By touching these icons, it is possible to start a remote control app for the desired electrical device 3 and remotely control the desired electrical device 3.

FIG. 10 shows an example of the floor plan of the room and the arrangement of the electrical equipment 3. An electric device 3 is arranged in the room, and the terminal device 1 selects the electric device 3 and performs a remote control operation.

In the room, a lighting device 3a1, an air conditioner 3b1, and a video display device 3c1 are installed. FIG. 10A shows an example in which the terminal device 1 is located in front of the video display device 3c1. In this example, the direction from the terminal device 1 to the electrical device 3 is that the lighting device 3a1 is south (azimuth angle 180 °), the air conditioner 3b1 is northwest (azimuth angle 315 °), and the video display device 3c1 is north (azimuth angle 0 °). ).

When operating the terminal device 1 at this position, the video display device 3c1 can be operated, for example, when the orientation of the housing of the terminal device 1 is set to the north (azimuth angle 0 °). Further, the lighting device 3a1 can be operated when the orientation of the housing of the terminal device 1 is near south (azimuth angle 180 °), and the air conditioner 3b1 when the orientation of the housing of the terminal device 1 is near northwest (azimuth angle 315 °). Can be operated.

FIG. 10B shows an example in which the terminal device 1 is located in front of the air conditioner 3b1. In this example, the orientation from the terminal device 1 to the electrical device 3 is that the lighting device 3a1 is east-southeast (azimuth angle 120 °), the air conditioner 3b1 is north (azimuth angle 0 °), and the video display device 3c1 is northeast (azimuth angle 45 °). ).

When operating the terminal device 1 at this position, for example, if the azimuth of the casing of the terminal device 1 is set to the north (azimuth angle 0 °), the air conditioner 3b1 can be operated. Further, the video display device 3c1 can be operated when the orientation of the housing of the terminal device 1 is close to northeast (azimuth angle 45 °), and illumination when the orientation of the housing of the terminal device 1 is near east-southeast (azimuth angle 120 °). The device 3a1 can be operated.

Next, in step S608, if the user selects the electric device 3 to be operated by the remote controller, the process proceeds to step S609, and if not selected, the process returns to step S602 to continue the process.

In step S609, the remote control application corresponding to the selected electrical device 3 is activated. At this time, information on the electrical device 3 is given to the activated remote control application as necessary. For example, some remote control applications that support a plurality of electrical devices 3 require specification of the model of the electrical device 3 at startup.

Next, in step S610, the user performs a remote control operation of the electrical device 3. When the remote control operation is finished, the process is finished.

In addition, although the example which uses the attitude | position (orientation) of the housing of the terminal device 1 in the portrait orientation is shown in the present embodiment, it can be used similarly in the landscape orientation.

FIG. 11 is a display example of the liquid crystal panel when the remote control application of the selected electrical device 3 is activated. 11A shows a remote control application for the lighting device 3a, FIG. 11B shows a remote control application for the air conditioner 3b, FIG. 11C shows a video display device 3c, and FIG. 11D shows a remote control application for the bathroom water heater 3d. It is an example of a display of the liquid crystal panel at the time of starting.

With the above configuration, in the first embodiment of the present invention, the terminal device acquires information necessary for remote control of the electrical device from the electrical device in advance. The information is acquired by, for example, proximity wireless communication. At this time, the position information of the electric device is acquired by using the function of the terminal device. The terminal device registers these pieces of information in the storage unit.

Then, the terminal device acquires position information when the remote control button is pressed, and calculates the direction to each electric device based on the registered position information of the electric device.

Furthermore, the icon of the electrical device having the orientation closest to the orientation of the terminal device housing is displayed on the user interface section of the terminal device. The user can quickly select an icon of a desired electrical device from a plurality of electrical devices by pointing the terminal device to the electrical device that the remote controller is desired to operate.

When an icon is selected, the corresponding remote control app is activated and the desired electrical device can be remotely controlled.

FIG. 22 is a functional block diagram of the terminal device 1 according to the second embodiment of the present invention.

The control unit 2201 includes a distance calculation unit 2221, an icon extraction unit 2222, an application activation unit 2224, an azimuth calculation unit 2225, an azimuth comparison unit 2226, and the like. Based on an instruction from the user interface unit 2208, a storage unit 2202, position information Control of the acquisition unit 2203, the body orientation detection unit 2205, the short-range wireless communication unit 2212, the LAN communication unit 2213, etc., registration of the electrical device 3 before using the remote control, selection of the electrical device 3 when using the remote control, remote control control I do.

Before using the remote control, the control unit 2201 acquires information necessary for remote control of the electrical device 3 and registers it in the storage unit 2202. The registration procedure is the same as that shown in FIG.

When using the remote control, the control unit 2201 selects the electrical device 3 to be remotely controlled from the electrical devices 3 registered in the storage unit 2202. First, the position information is acquired by the position information acquisition unit 2203, and the direction to the position information of all the electric devices 3 in the position information list 2231 by the direction calculation unit 2225 (the direction from the terminal device to all the electric devices 3). Is calculated. In addition, the distance calculation unit 2221 calculates the distance (the distance from the terminal device to all the electric devices 3) with the position information of all the electric devices 3 in the position information list 2231. Next, the housing orientation detection unit 2205 detects the orientation of the housing of the terminal device 1, and the orientation comparison unit 2226 compares the orientation with all the electrical devices 3 from the terminal device. Next, based on the comparison result, the icon extraction unit 2222 extracts the icon of the electrical device 3 within the predetermined distance A and closest to the chassis direction from the icon list 2232 and displays it on the user interface unit 2208. To do.

If the icon displayed on the user interface unit 2208 is an icon of the desired electrical device 3, the user selects the icon, and the application activation unit 2224 selects the remote control corresponding to the icon from the application list 2233. Launch the app. If the icon displayed on the user interface unit 2208 is not the icon of the desired electrical device 3, the user changes the orientation of the casing of the terminal device 1 so that the icon of the desired electrical device 3 is displayed. Alternatively, the terminal device 1 is moved closer to the desired electrical device 3 so as to be within the predetermined distance A.

In this way, the user can remotely control the desired electrical device 3.

FIG. 12 is a flowchart showing a selection process of the electrical device 3 by the terminal device 1 according to the second embodiment of the present invention. This flowchart shows a process of selecting a target electrical device 3 when the terminal device 1 performs remote control of the electrical device 3.

Steps S1201 to S1202 are the same as steps S601 to S602 in FIG.

Next, in step S1203, the distance between the terminal device 1 and the electrical device 3 is calculated. The distance between the terminal device 1 and the electric device 3 is obtained from the registered position information of the electric device 3 and the current position information of the terminal device 1.

Steps S1204 to S1205 are the same as steps S604 to S605 in FIG.

In step S 1207, the icon of the electric device 3 that is within the predetermined distance A that is determined in advance and whose direction calculated in step S 1204 is closest to the direction of the housing of the terminal device 1 is displayed on the user interface unit 2208. Or you may display some electric equipment 3 of a near azimuth | direction.

The display example of the liquid crystal panel of the terminal device 1 is the same as (a), (b), and (c) in FIG. By touching these icons, a remote control application for the desired electrical device 3 can be activated and the desired electrical device 3 can be remotely controlled.

FIG. 13 shows an example of the floor plan of the room and the arrangement of the electrical equipment 3. The electric device 3 is arranged in a plurality of rooms, and the terminal device 1 selects the electric device 3 and performs a remote control operation.

A lighting device 3a1, an air conditioner 3b1, and a video display device 3c1 are installed in a room where the terminal device 1 is located, and these are located within a predetermined distance A. The lighting device 3a2 and the air conditioner 3b2 are installed in another room, and the lighting device 3a3 and the bathroom water heater 3d1 are installed in another room, which are located outside a predetermined distance A.

Steps S1208 to S1210 are the same as steps S608 to S610 in FIG.

Note that if the predetermined distance A in step S1207 is determined in consideration of the size of the room in which the electric device 3 is installed, for example, only the electric device 3 in the room can be displayed on the user interface unit 2208. Further, the predetermined distance may be changed according to the position information. For example, even when there are a plurality of rooms and the sizes of the rooms are different, when the terminal device 1 is in the vertical orientation, Only the device 3 can be displayed. Further, when the remote control activation button is pressed, for example, the room size may be estimated from the registered distance to the nearest air conditioner 3b1, and the predetermined distance A may be automatically determined. Moreover, the room information installed at the time of registration of the electric equipment 3 may also be registered, and only the electric equipment 3 arranged in the room where the terminal device 1 exists may be displayed. Further, the predetermined distance A may be determined in accordance with the reach distance of infrared rays or the like of the dedicated remote controller 2 for the electric device 3.

With the above configuration, the second embodiment of the present invention can achieve the same effects as the first embodiment.

Further, the terminal device displays only icons of electric devices within a predetermined distance on the user interface unit. Quickly select a desired electrical device icon from multiple electrical device icons because there is no display of an electrical device icon in a remote location such as another room while selecting an electrical device in a room. Can do.

FIG. 23 is a functional block diagram of the terminal device 1 according to the third embodiment of the present invention.

The control unit 2301 includes a distance calculation unit 2321, an icon extraction unit 2322, a display switching unit 2323, an application activation unit 2324, an azimuth calculation unit 2325, an azimuth comparison unit 2326, and the like, and stores based on instructions from the user interface unit 2308. Control unit 2302, position information acquisition unit 2303, housing direction calculation unit 2305, short-range wireless communication unit 2312, LAN communication unit 2313, etc., registration of electric device 3 before using the remote control, electric device 3 when using the remote control Selection and remote control.

Before using the remote controller, the control unit 2301 acquires information necessary for remote control of the electrical device 3 and registers it in the storage unit 2302. The registration procedure is the same as that shown in FIG.

When using the remote control, the control unit 2301 selects the electrical device 3 to be remotely controlled from the electrical devices 3 registered in the storage unit 2302. First, the position information is acquired by the position information acquisition unit 2303, and the direction to the position information of all the electric devices 3 in the position information list 2331 (the direction from the terminal device to all the electric devices 3) is acquired by the direction calculation unit 2325. Is calculated. Further, the distance calculation unit 2321 calculates the distances (the distances from the terminal device to all the electric devices 3) with the position information of all the electric devices 3 in the position information list 2331. Next, the azimuth | direction of the housing of the terminal device 1 is calculated by the housing | casing azimuth | direction calculation part 2305, and it compares with the azimuth | direction from the said terminal device to all the electric equipments 3 by the azimuth | direction comparison part 2326. Next, based on the comparison result, the icon extraction unit 2322 causes the icon of the electrical device 3 that is within the predetermined distance A and closest to the chassis orientation, and the orientation that is outside the predetermined distance A and closest to the chassis orientation. The icon of the electrical device 3 is extracted from the icon list 2332 and output to the display switching unit 2323. Next, the body posture detection unit 2304 detects the posture (orientation) of the housing of the terminal device 1, and the display switching unit 2323 switches the output to be displayed on the user interface unit 2308 according to the body posture (orientation). For example, when the casing is in the vertical direction, the icon of the electric device 3 that is within the predetermined distance A and closest to the casing direction is displayed. When the casing is in the horizontal direction, the icon is outside the predetermined distance A and the most in the casing direction. The icon of the electrical device 3 that is in the near direction is displayed.

If the icon displayed on the user interface unit 2308 is an icon of a desired electrical device 3, the user selects the icon, and the application activation unit 2324 controls the remote controller corresponding to the icon from the application list 2333. Launch the app. If the icon displayed on the user interface unit 2308 is not the icon of the desired electrical device 3, the user changes the orientation of the casing of the terminal device 1 so that the icon of the desired electrical device 3 is displayed. Or the attitude | position (direction) of the housing of the terminal device 1 is changed so that the icon of the desired electric equipment 3 may be displayed.

In this way, the user can remotely control the desired electrical device 3.

FIG. 14 is a flowchart showing a selection process of the electrical device 3 by the terminal device 1 according to the third embodiment of the present invention. This flowchart shows a process of selecting a target electrical device 3 when the terminal device 1 performs remote control of the electrical device 3.

Steps S1401 to S1405 are the same as steps S1201 to S1205 in FIG.

Next, in step S1406, gravitational acceleration is detected by the acceleration sensor 205 or the like, and the posture (orientation) of the casing of the terminal device 1 is calculated. Tilt detection using the gyro sensor 206 may be used in combination, or other sensors may be used.

FIG. 15 is a conceptual diagram showing the posture of the casing of the terminal device 1. The posture of the casing of the terminal device 1 is in the vertical direction (the short side end of the casing is closer to the ground surface than the long side end) as shown in FIG. 15A, or FIG. As shown in the example, the calculation is performed in the horizontal direction (the long side end of the frame is closer to the ground surface than the short side end). Note that when calculating the posture of the chassis, it is not always necessary to keep the chassis vertical.

In step S1411, the processing is switched depending on whether the casing of the terminal device 1 is vertically or horizontally. In the case of the portrait orientation, the process proceeds to step S1407, and the user interface unit 2308 displays the icon of the electric device 3 that is within the predetermined distance A set in advance and whose orientation calculated in step S1404 is closest to the orientation of the terminal device 1 housing. To display. In the case of the landscape orientation, the process proceeds to step S1412, and the icon of the electrical device 3 that is outside the predetermined distance A and whose orientation calculated in step S1404 is closest to the orientation of the housing of the terminal device 1 is displayed. The display may be further switched by a predetermined distance B.

FIG. 16 shows a display example of the liquid crystal panel when the casing of the terminal device 1 is turned sideways. FIG. 16A shows a display example of a liquid crystal panel when the casing of the terminal device 1 is turned sideways and directed toward the lighting device 3a2. An icon of the lighting device is displayed on the liquid crystal panel, which indicates that the lighting device 3a2 exists in the direction in which the terminal device 1 is facing. FIG. 16B shows a display example of a liquid crystal panel when the casing of the terminal device 1 is turned sideways and directed toward the air conditioner 3b2. An air conditioner icon is displayed on the liquid crystal panel, indicating that the air conditioner 3b2 exists in the direction in which the terminal device 1 is facing. FIG. 16C is a display example of a liquid crystal panel when the casing of the terminal device 1 is turned sideways and directed toward the bathroom water heater 3d1. An icon of a bathroom water heater is displayed on the liquid crystal panel, indicating that the bathroom water heater 3d1 exists in the direction in which the terminal device 1 is facing.

A display example of the liquid crystal panel when the casing of the terminal device 1 is vertically oriented is the same as (a), (b), and (c) of FIG.

FIG. 17 shows an example of the floor plan of the room and the arrangement of the electrical equipment 3. The electric device 3 is arranged in a plurality of rooms, and the terminal device 1 selects the electric device 3 and performs a remote control operation.

A lighting device 3a1, an air conditioner 3b1, and a video display device 3c1 are installed in a room where the terminal device 1 is located, and these are located within a predetermined distance A. The lighting device 3a2 and the air conditioner 3b2 are installed in another room, and the lighting device 3a3 and the bathroom water heater 3d1 are installed in another room, which are located outside a predetermined distance A. In this example, the direction from the terminal device 1 to the electrical device 3 is that the lighting device 3a1 is south (azimuth angle 180 °), the air conditioner 3b1 is northwest (azimuth angle 315 °), and the video display device 3c1 is north (azimuth angle 0 °). ), The lighting equipment 3a2 is east-southeast (azimuth angle 105 °), the air conditioner 3b2 is east-northeast (azimuth angle 75 °), the lighting equipment 3a3 is east (azimuth angle 85 °), and the bathroom water heater 3d1 is east (azimuth angle 95 °). is there.

When operating the terminal device 1 at this position, the video display device 3c1 can be operated, for example, when the casing of the terminal device 1 is oriented vertically and the azimuth is near north (azimuth angle 0 °). Further, the lighting device 3a1 can be operated when the casing of the terminal device 1 is oriented vertically and the azimuth is near south (azimuth angle 180 °), and the air conditioner 3b1 is turned on when the azimuth is near northwest (azimuth angle 315 °). Can be operated. Further, the air conditioner 3b2 can be operated when the casing of the terminal device 1 is turned sideways and the azimuth is in the vicinity of east-northeast (azimuth angle 75 °). Further, the lighting device 3a3 can be operated when the housing of the terminal device 1 is turned sideways and the azimuth direction is near east (azimuth angle 85 °), and the bathroom water heater 3d1 when the azimuth direction is near east (azimuth angle 95 °). When the azimuth is in the vicinity of east-southeast (azimuth angle 105 °), the illumination device 3a2 can be operated.

Steps S1408 to S1410 are the same as steps S1208 to S1210 in FIG.

Note that the predetermined distance A in step S1412 is determined in consideration of the size of the room in which the electric device 3 is installed, for example, and the electric device 3 in the room when the posture of the terminal device 1 is vertically oriented. Can be displayed on the user interface unit 2308. Further, the predetermined distance may be changed according to the position information. For example, even when there are a plurality of rooms and the sizes of the rooms are different, when the terminal device 1 is in the vertical orientation, Only the device 3 can be displayed. Further, when the remote control activation button is pressed, for example, the room size may be estimated from the registered distance to the nearest air conditioner 3b1, and the predetermined distance A may be automatically determined. Moreover, the room information installed at the time of registration of the electric equipment 3 may also be registered, and only the electric equipment 3 arranged in the room where the terminal device 1 exists may be displayed.

With the above configuration, the third embodiment of the present invention can achieve the same effects as the first embodiment.

Furthermore, the terminal device calculates the posture of the chassis and switches the display depending on whether it is vertical or horizontal. In the case of the portrait orientation, the icon of the electrical device having the orientation closest to the orientation of the terminal device within a predetermined distance is displayed. In the case of the landscape orientation, the icon of the electrical device with the orientation closest to the orientation of the terminal device outside the predetermined distance is displayed.

Quickly select the desired electrical device icon from multiple electrical device icons by placing the terminal device vertically when the electrical device you want to remotely control is nearby, or horizontally when it is far away Can do.

Alternatively, in the case of portrait orientation, the icon of the electrical device closest to the orientation of the terminal device within a predetermined distance is displayed, and in the case of landscape orientation, the icon of the terminal device is consistent with the orientation of the terminal device. You may display the icon of the electric equipment of the nearest direction.

Alternatively, in the case of landscape orientation, the icon of the electrical device closest to the orientation of the terminal device within a predetermined distance is displayed, and in the case of portrait orientation, the electrical of the orientation closest to the orientation of the terminal device outside the predetermined distance is displayed. A device icon may be displayed.

Alternatively, the terminal device may calculate the posture of the chassis, and instead of switching the display depending on whether the orientation is vertical or horizontal, it may calculate the tilt of the chassis and switch the display depending on the angle of the tilt of the chassis.

FIG. 18 is a flowchart showing a registration process of the electric device 3 by the terminal device 1 according to the fourth embodiment of the present invention.

In the present embodiment, the registration process can be performed simply by the user photographing the electrical device 3 with the terminal device 1.

In step S1801, the terminal device 1 captures the electric device 3 from the front by the video input unit 209, acquires current position information by the GPS receiving unit 203, the LAN communication unit 213, and the like in step S1802, and in step S1803, geomagnetism. Geomagnetism is detected by the sensor 204 or the like, and the orientation of the video input unit 209 of the terminal device 1 is calculated. For example, when the video input unit 209 exists on the back surface of the terminal device 1, the azimuth in the direction in which the back surface of the terminal device 1 faces is calculated.

Next, in step S1804, the photographed image is searched for on the Internet network to identify the electrical device 3 (specify the model).

Next, in step S1805, if the electrical device 3 can be identified, the process proceeds to step S1807. If the electrical apparatus 3 cannot be identified, the process returns to step S1801 to continue the process.

Next, in step S1807, the terminal device 1 acquires the product information of the electrical device 3 from the Internet network, and acquires the size such as the height and width of the product from the product information.

Next, in step S1808, the distance from the size such as the height and width of the electrical device 3 on the image taken in step S1801 and the height and width of the product information of the electrical device 3 to the electrical device 3 is determined. Is calculated. For example, if the information indicating the relationship between the product size, the shooting distance, and the size on the image is registered in advance, such as when the electric device 3 having a width of 1 m is shot from a distance of 1 m, the image is fully captured. The distance can be calculated from the ratio for the other electrical devices 3 as well.

Next, in step S1809, the position information of the electric device 3 is obtained from the position information of the terminal device 1 acquired in step S1802, the azimuth acquired in step S1803, and the distance to the electric device 3 acquired in step S1808. Next, in step S <b> 1810, the terminal device 1 acquires a remote control app of the electric device 3. The remote control app is obtained from the Internet network.

Next, in step S1811, the identification information, remote control application, position information, product information, and the like of the electric device 3 are registered in the list, and the process ends.

FIG. 19 is a flowchart showing another example of the registration process of the electric device 3 by the terminal device 1 according to the fourth embodiment of the present invention.

Step S1901 is the same as step S1801 in FIG.

Next, in step S1912, the distance is measured with an infrared distance meter or the like. Alternatively, the focus of the lens of the video input unit 209 may be moved, and the distance may be measured depending on where the focus is achieved.

Steps S1902 to S1905 are the same as steps S1802 to S1805 in FIG.

Next, in step S1909, the position information of the electric device 3 is obtained from the position information of the terminal device 1 acquired in step S1902, the azimuth acquired in step S1903, and the distance to the electric device 3 acquired in step S1912. Steps S1910 to S1911 are the same as steps S1810 to S1811 in FIG.

With the above configuration, the fourth embodiment of the present invention can obtain the same effects as those of the first embodiment.

The terminal device acquires information necessary for remote control of electrical equipment from the Internet network in advance. For example, an electric device is photographed by a video input unit of the terminal device, the electric device is identified using image recognition, and various information is acquired from the Internet network. The position information of the electric device is acquired from the position information of the terminal device at the time of photographing the electric device, the direction, the distance to the electric device, and the like. The terminal device registers these pieces of information in the storage unit. The user can acquire various kinds of information from a place away from the electric device only by photographing the electric device with the terminal device.

FIG. 20 is a display example of the liquid crystal panel of the terminal device 1 according to the fifth embodiment of the present invention. The terminal device 1 is registered in advance with the position information of the wall of the room, and is calculated from the position information of the terminal device 1 and the orientation of the housing, and the virtual room wall is displayed on the liquid crystal panel. Further, the position information of the electric device 3 is registered, and the icon in the shape of the electric device 3 calculated from the position information of the terminal device 1 and the orientation of the housing is displayed on the liquid crystal panel. Thus, the wall of the previous room and the electrical equipment 3 facing the housing of the terminal device 1 are virtually displayed on the liquid crystal panel of the terminal device 1.

FIG. 20A shows a display example of the liquid crystal panel when the casing of the terminal device 1 is directed to the video display device 3c1. An icon in the form of a video display device is displayed in the center of the liquid crystal panel, indicating that the video display device 3c1 exists in the direction in which the casing of the terminal device 1 is facing. Further, an icon in the shape of an air conditioner is displayed on the upper left, indicating that the air conditioner 3b1 exists on the left side.

FIG. 20B shows a display example of the liquid crystal panel when the casing of the terminal device 1 is directed to the air conditioner 3b1. An icon in the shape of an air conditioner is displayed at the center of the liquid crystal panel, indicating that the air conditioner 3b1 exists in the direction in which the casing of the terminal device 1 is facing. Further, an icon in the form of a video display device is displayed on the lower right, indicating that the video display device 3c1 exists on the right side.

FIG. 20C shows a display example of the liquid crystal panel when the casing of the terminal device 1 is directed to the lighting equipment 3a1. An icon in the form of a lighting device is displayed at the center of the liquid crystal panel, indicating that the lighting device 3a1 exists in the direction in which the casing of the terminal device 1 is facing.

Alternatively, the remote controller application for the desired electrical device 3 may be activated by pressing the home button while the desired electrical device 3 is displayed at the center of the liquid crystal panel.

With the above configuration, the fifth embodiment of the present invention can achieve the same effects as the first embodiment.

Furthermore, the wall of the room and the icon of the electric device are displayed on the user interface unit of the terminal device according to the position of the terminal device and the orientation of the housing. The user can intuitively select an icon of a desired electrical device from a plurality of electrical devices by pointing the terminal device to the electrical device that the remote controller is desired to operate.

It should be noted that the above-described embodiments have been described in detail for easy understanding of the present invention, and are not necessarily limited to those having all the configurations described. Further, a part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of one embodiment. Further, it is possible to add, delete, and replace other configurations for a part of the configuration of each embodiment.

In addition, each of the above-described configurations, functions, processing units, processing means, and the like may be realized by hardware by designing a part or all of them with, for example, an integrated circuit. Each of the above-described configurations, functions, and the like may be realized by software by interpreting and executing a program that realizes each function by the processor. Information such as programs, tables, and files for realizing each function can be stored in a memory, a hard disk, a recording device such as an SSD (Solid State Drive), or a recording medium such as an IC card or an SD card.

Also, the control lines and information lines indicate what is considered necessary for the explanation, and not all the control lines and information lines on the product are necessarily shown. Actually, it may be considered that almost all the components are connected to each other.

DESCRIPTION OF SYMBOLS 1 ... Terminal device 2 ... Remote control 3 ... Electric equipment 4 ... Wireless router 5 ... Network

Claims

In a terminal device having a remote control function of electrical equipment,
Position information detecting means for acquiring a current position of the terminal device;
Orientation detection means for acquiring the orientation in which the terminal device is facing;
Storage means for storing position information of the electrical equipment;
The position information of the terminal device, the azimuth direction of the terminal device, and the position information of the electronic device stored in the storage means are within a predetermined range of the azimuth direction of the terminal device. A selection means for selecting an electrical device;
Remote control means for operating the electrical equipment selected by the selection means;
A terminal device comprising:
The terminal device according to claim 1,
The selection unit calculates a distance using the current position information of the terminal device and the position information of the electrical device stored in the storage unit, and the selection unit selects the distance according to the calculated distance. A terminal device characterized by switching the electric device to be selected.
The terminal device according to claim 1,
The said selection means selects the said electric equipment in the nearest position among the said electric equipment which exists in the predetermined range of the direction which the said terminal device has faced, The terminal device characterized by the above-mentioned.
The terminal device according to claim 2,
The terminal device characterized by selecting the electric device whose distance calculated by the selection means is within a predetermined value.
The terminal device according to claim 2,
A housing posture calculating means for calculating the posture of the housing of the terminal device,
The terminal device, wherein the predetermined value is switched according to a posture of the housing of the terminal device calculated by the housing posture calculation means.
In a remote control method of electrical equipment by a terminal device,
Obtaining the current position information of the terminal device; obtaining the direction in which the terminal device is facing;
Storing position information of the electrical equipment;
Selecting the electrical device at a position closest to the orientation to which the terminal device is directed, using the orientation information and the orientation information of the terminal device, and the position information of the electronic device;
A step of operating a selected electrical device;
A terminal device remote control method comprising:
The remote control method according to claim 6, wherein
Obtaining identification information of the electrical equipment;
Obtaining the position information of the terminal device;
Storing the position information of the terminal device in association with the identification information of the electric device.
In a terminal device having a remote control function of electrical equipment,
Position information detecting means for acquiring a current position of the terminal device;
Orientation detection means for obtaining the orientation of the terminal device;
Arrangement information detecting means for detecting arrangement information of the electrical equipment;
Storage means for storing the identification information of the electronic device and the arrangement information of the electric device in correspondence with each other,
The position information from the position information detection means, the direction from the direction detection means, and the arrangement information of the electronic device stored in the storage means are within a predetermined range from the direction in which the terminal device faces. Display electrical device selection means for selecting the electrical device;
Of the electrical devices selected by the display electrical device selection means, the electrical devices in the direction substantially coincident with the orientation to which the terminal device is directed display the identification information in a substantially central portion, and the orientation is not substantially coincident. The electric device includes a display unit that displays identification information at a location shifted by a predetermined amount from a substantially central portion;
A terminal device comprising: