JP2012172910A - System for operating indoor environmental control device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To properly control each device, even when there are a plurality of devices for indoor environmental control.SOLUTION: Operation means of the devices 11 to 15 for indoor environmental control has: a portable device 1 which is provided with a communication means communicating with the device, a camera for photographing an inside of a room, and a display 10 for displaying a screen image photographed by the camera; and an identification means for associating the images of the device projected in the screen image displayed on the display with the device. The portable device 1 superimposes an operation picture related to the device identified by the identification means on an image of the device projected in the screen image displayed on the display as an annotation and displays it, and transmits, to the identified device, information about operation added to the annotation.

Description

  The present invention relates to an operation system for an indoor environment adjusting device such as an air conditioner, a heater, a humidifier, and a lighting fixture.

  The indoor environment is adjusted by multiple devices such as air conditioners, heating devices, humidifiers, and lighting fixtures. When remote control of these devices is performed individually, a remote controller is required for each device. Will be very annoying.

  For this reason, in Japanese Patent Application Laid-Open No. 2007-192472 (Patent Document 1), a plurality of devices are placed under the control of a single control means, and a plurality of devices can be controlled only by an operation on the single control means. Things have been proposed. However, when the number of devices to be controlled increases or there are a plurality of devices of the same type, it is difficult to specify the device to be operated.

  Japanese Patent Laid-Open No. 2000-253123 discloses a plan to use a multi-function mobile phone as a remote controller for a plurality of devices. However, even in this case, the number of devices to be controlled increases or there are a plurality of similar devices. Then, it becomes difficult to specify a device to be operated.

JP 2007-192472 A

  This invention is made in view of such a point, Comprising: Even if there exist multiple equipment for indoor environment adjustment, it is a subject to provide the operation system of the equipment for indoor environment adjustment which can control each apparatus exactly It is what.

  The present invention is an operation means for a device for adjusting the indoor environment, and includes communication means for communicating with the device, a camera for indoor shooting, and a display for displaying an image projected by the camera. It has a portable device and a specific means for associating the device image shown in the image displayed on the display with the device, and the portable device appears in the image displayed on the display. An operation screen related to the device specified by the specifying means is superimposed on the image of the device and displayed as an annotation, and operation information added to the annotation is displayed for the specified device. It is characterized by being transmitted.

  An indoor environment sensor for detecting indoor environment information may be provided, and the portable device may display the indoor environment information obtained from the indoor environment sensor as an annotation on the display together with the operation screen annotation. A control unit that centrally controls the devices for adjustment may be provided, and the portable device may operate each indoor environment adjustment device through the control unit.

  In the present invention, even when there are a plurality of devices of the same means in the room, the correspondence between the devices and their operations is clarified on the display screen, so that the user's operability can be improved by the intuition. .

It is operation | movement explanatory drawing in an example of embodiment of this invention. It is operation | movement explanatory drawing same as the above. It is a block diagram same as the above. It is explanatory drawing which shows an example of the screen display of a portable apparatus same as the above. It is explanatory drawing which shows the other example of a screen display of a portable apparatus same as the above. It is explanatory drawing which shows the further another example of the screen display of a portable apparatus same as the above. It is explanatory drawing which shows another example of the screen display of a portable apparatus same as the above. It is explanatory drawing which shows another example of the screen display of a portable apparatus same as the above.

  Hereinafter, an example of an embodiment of the present invention will be described. FIG. 3 shows the entire operation system according to the present invention, and 11 to 15 in the figure are all indoor environment adjusting devices. A circulation fan 11, a floor heating device 12, an air conditioner (air conditioner) 13, and lighting fixtures 14 and 15 are shown as examples. In addition, an outdoor (outdoor) temperature sensor 21, a ceiling vicinity temperature sensor 22, a floor surface temperature sensor 23, a wall surface temperature sensor 24, and a humidity sensor 25 are connected to the circulation fan 11 as indoor environment sensors. A floor temperature sensor 26 is connected to the floor heating device 12 as an indoor environment sensor.

  And in this example, said indoor environment adjustment apparatus 11-15 is connected to the connection control unit 3, and controls operation | movement of each indoor environment adjustment apparatus 11-15 by control from the connection control unit 3 side. It has become something that can be. In addition, the linkage control unit 3 provides annotations (air tags) regarding the operating state and operation of each connected indoor environment adjusting device 11 to 15 in order to provide AR (Augmented Reality) to the portable device 1 described later. 4), which includes communication data 33 for communication with the portable device 1.

  In the figure, reference numeral 31 denotes an operation controller provided in the linkage control unit 3. By operating the operation controller 31, the indoor environment adjusting devices 11 to 15 can be individually operated. Note that the link control unit 3 here has, for example, a function for controlling the air conditioner 13 and the floor heating device 12 in a linked state according to the indoor environment during indoor heating, and a human body sensor 35 for detecting the presence or absence of a person. Accordingly, a function for controlling the operation of the devices 11 to 15 is also provided, but a description of this point is omitted. The operation controller 31 may be provided with an indoor environment sensor 32 such as a room temperature / humidity sensor.

  And in this operation system, the portable apparatus 1 connected with the said connection control unit 3 via a communication means is provided. The portable device 1 includes at least a camera and a touch panel display 10 and also includes communication means for performing communication with the connection control unit 3, and controls the camera, display, and communication means. The calculation means in the portable device 1 displays the image taken by the camera on the display 10 and uses the annotation 4 created based on the annotation generation data sent from the linkage control unit 3 as the image. It can be displayed superimposed.

  As the communication means, known bidirectional wireless communication means such as Bluetooth (registered trademark) can be suitably used, but wired communication means may be used. In addition, as the mobile device 1, a multi-function mobile phone can be suitably used.

  Next, an operation in the operation system of the present invention will be described based on the operation. FIGS. 1 and 2 are flows for communication between the mobile device 1 and the link control unit 3, FIG. 1 shows a flow at the time of initial setting, and FIG. 2 shows a flow at the time of normal use.

  First, the initial setting will be described. In a state in which communication between the mobile device 1 and the linked control unit 3 is secured, an indoor state is projected by the camera of the mobile device 1 and the image displayed on the display 10 is displayed. The point where the devices 11 to 15 to be controlled, for example, the air conditioner 13 are shown is pointed.

  By this point operation, the calculation means in the portable device 1 requests the device list of the indoor environment adjusting devices 11 to 15 recognized by the connection control unit 3 from the connection control unit 3. In response to this request, the linked control unit 3 transmits a device list to the mobile device 1. In the mobile device 1 that has received the device list, if the operator selects a device selection screen on which the device list is displayed and further specifies that the one pointed to is the air conditioner 13, the device at the point that was pointed to earlier is displayed. While recognizing that the air conditioner 13 is selected, a request to transmit the operation screen generation data for the air conditioner 13 is sent to the linked control unit 3 side. In response to this, the linked control unit 3 sends operation screen generation data for the air conditioner 13 to the portable device 1, and the computing means in the portable unit 1 that has received this data is the air conditioner 13 that is the selected device. The operation screen (annotation 4) is generated and displayed in association with the position pointed to earlier on the display 10. This state is shown in FIG.

  Note that the operation screen generation data is data necessary to generate the annotation 4 as shown in FIG. 4, for example, the type of operation mode (cooling, heating), and the level range operated in each mode. (Heating is from 18 ° C. to 30 ° C., etc.) If necessary, graphic data.

  By repeating the above operation for the devices in the room, each device shown on the display 10 is specified. Once this series of operations is performed once, in combination with the image recognition process, the devices 11 to 15 are associated with what is displayed on the screen so that the initial settings for the next time and later can be omitted. It is desirable to keep it.

  When the images showing the devices 11 to 15 are stored in the mobile device 1, the association information with the devices 11 to 15 is also stored in the mobile device 1, and the stored image is called when the device is operated. The association information with the devices 11 to 15 is also read so that the device annotation 4 corresponding to the corresponding portion in the image displayed on the display 10 can be displayed by receiving the device information through communication with the linkage control unit 3. May be. The initial setting operation itself may be performed by an operation on the stored image.

  Next, the normal operation flow will be described with reference to FIG. 2. When each of the above-described devices is specified, and when the devices 11 to 15 are operated, the linkage control unit 3 is connected to the device being operated. Data for generating the operation status summary display screen is transmitted to the mobile device 1. In response to this, the portable device 1 displays the annotations 4 and 4 created based on the generation data on the image on the display 10 in association with each device as shown in FIG. At this time, it is preferable that annotation 44 about environmental information such as average room temperature is also displayed on the screen based on the data obtained from the indoor environment sensor. By simultaneously displaying the annotation 4 on the operation and driving state and the annotation 44 on the environmental information on the actual visual screen, the operation corresponding to the situation can be performed more easily and intuitively. Also from this point, when there are a plurality of devices in the room, it is preferable to use an image in which all of these devices are shown.

  For example, when it is desired to change the operation setting of the floor heating device 12 while the annotations 4 and 44 are displayed, the floor heating device 12 is selected by pointing to the annotation 4 for the floor heating device 12 on the screen. Then, the computing means of the mobile device 1 displays the annotation 4 that is the operation screen of the floor heating device 12 on the screen as shown in FIG. Then, if a temperature setting change instruction is given by a touch operation such as a point on the operation screen displayed as the annotation 4, the calculation means of the portable device 1 transmits a corresponding floor heating operation command to the linkage control unit 3, and the linkage control is performed. The unit 3 sends a control signal corresponding to the received command to the floor heating device 12.

  By operating the annotation 4 associated with the device shown in the image on the screen, the corresponding device can be operated. For this purpose, as shown in FIG. Even when there are multiple devices of the same type (two lighting fixtures in the example shown), the operation for the lighting fixture specified in the image is performed on the corresponding lighting fixture, so the operation can be performed without any mistakes. It can be carried out.

  Furthermore, in the state where the screen shown in FIG. 5 is displayed on the display 10, the annotation 44 about the environment information is linked in response to an indoor environment transmission request transmitted from the mobile device 1 at a constant interval (for example, 5 minutes). The indoor environment state transmission sent from the control unit 3 to the portable device 1 is gradually updated. The annotation 44 not only displays temperature and humidity, but also displays a total indoor comfort index obtained from various factors such as temperature and humidity and wind speed, such as PMV, ET, SET, and the like. preferable. The lighting information may also be touched to contribute to a sensuous thermal feeling.

  If the annotation 44 about the environment information displayed on the display 10 is pointed, the details of the environment information are displayed on the screen as an annotation 45 or as a separate screen as shown in FIG. It is preferable that the environmental information details are displayed in a form that allows the past situation to be understood.

  In the above embodiment, the device is manually selected at the time of initial setting in order to identify the device where the device is on the image. However, the shape data for each device 11 to 15 is registered in the mobile device 1. The devices 11 to 15 may be identified from the image by image recognition processing using the shape data. Moreover, you may make it perform the image recognition process for the specification of the target indoor environment adjustment apparatuses 11-15 by the connection control unit 3 side. In this case, the image captured by the camera is also sent to the linked control unit 3 side via the communication means for processing.

  Instead of specifying a device by image recognition based on the device shape, a different optical marker may be attached to each device, and the device may be specified by image recognition of the marker, and further, a portable device. 1 may be used to specify a device using the compass, the tilt sensor, and the like included in 1 and the position information of each device stored in advance on the connection control unit 3 side. These may be combined to specify the device, and for this purpose, there is no limitation on how the device is specified.

  In addition, although the portable apparatus 1 showed what controls each apparatus 11-15 through the connection control unit 3, each apparatus 11 is communicated by the portable apparatus 1 communicating directly with each apparatus 11-15. ˜15 may be recognized, or the operations of the devices 11 to 15 may be controlled. However, when acquiring the state of each device, the indoor temperature environment, and the like with the portable device 1, if each device 11-15 or sensor is acquired individually, the number of devices 11-15 and sensors to be communicated increases and communication traffic increases. Therefore, it is more efficient to acquire each sensing data at one time by communicating with a device that centrally manages sensing information (link control unit 3 in this example).

  Moreover, although the thing provided with the touchscreen display 10 which can perform point operation etc. with a fingertip as the portable apparatus 1 was shown, point operation etc. are performed using the mouse cursor displayed on a screen. May be.

DESCRIPTION OF SYMBOLS 1 Portable apparatus 3 Connection control unit 4 Annotation 10 Display 11-15 Indoor environment adjustment apparatus 21-26 Indoor environment sensor

Claims (3)

A portable device comprising a communication means for communicating with the device for indoor environment adjustment, a communication means for communicating with the device, a camera for indoor shooting, and a display for displaying an image projected by the camera; Specific means for associating the image of the device shown in the image displayed on the display with the device,
The portable device displays an operation screen related to the device specified by the specifying means as an annotation on the image of the device shown in the image displayed on the display, and displays the annotation on the annotation. An operation system for an indoor environment adjusting device, characterized in that information on an operation added to the device is transmitted to the specified device.   The indoor environment sensor which detects indoor environment information is provided, The said portable apparatus displays the indoor environment information obtained from an indoor environment sensor as an annotation with the said operation screen annotation on a display. The operation system of the indoor environmental adjustment apparatus as described.   3. A control unit that centrally controls a plurality of indoor environment adjustment devices, and the portable device performs operations on each indoor environment adjustment device through the control unit. The operation system of the indoor environmental adjustment apparatus as described.

Images