JPWO2016129085A1 - Air conditioning system - Google Patents

Abstract

The air conditioning system 100 includes an air conditioner 1 and a mobile communication terminal 2. The communication unit 16 of the air conditioner 1 transmits the operation state information indicating the operation state of the own device and the indoor environment information indicating the indoor environment of the target space for air conditioning by the own device to the mobile communication terminal 2, and The image processing unit 27 of the terminal 2 captures the range in which the camera 22 includes the air conditioner 1 and at least a part of the air conditioning target space, and the operating state of the air conditioner 1 and the air conditioning target space. An image representing the indoor environment is superimposed and displayed on the display unit 21.

Description

  The present invention relates to an air conditioning system that performs air conditioning.

  A conventional invention that performs air conditioning is described in Patent Document 1. In the invention described in Patent Document 1, the air conditioner is superimposed on the image captured by the camera installed on the upper surface of the wall in the space and displayed on the monitor of the mobile communication terminal. It is possible to check the space around the air conditioner and the operating condition of the air conditioner at the same time. According to the present invention, it is possible to reduce the load on the initial setting work of the air conditioner and the load on the maintenance work.

JP 2012-42197 A

  In the above conventional invention, the camera is provided on the upper surface of the wall surface. For this reason, the video displayed on the monitor is very different from the viewpoint of the worker who performs the initial setting work or the maintenance work, and it is difficult for the worker to intuitively grasp the arrangement and operation state of the air conditioner. there were. The image displayed on the monitor is for confirming the installation position of the air conditioner and the operating condition of the air conditioner. When changing the operating condition of the air conditioner, It was necessary to perform the operation using a remote controller or directly from an operation panel provided on the air conditioner body. In other words, the monitor for confirming the installation position and the operation state is different from the device for changing the operation state of the air conditioner, and it becomes a work load when they are installed at remote locations.

  This invention is made in view of the above, Comprising: Obtaining the air conditioning system which can improve workability | operativity so that an operator can grasp | ascertain the arrangement | positioning and operation state of an air conditioner intuitively. With the goal.

  In order to solve the above-described problems and achieve the object, the air conditioning system includes an air conditioner and a portable communication terminal. The air conditioner transmits operating state information indicating the operating state of the own device and indoor environment information indicating the indoor environment of the target space for air conditioning by the own device to the mobile communication terminal. An image representing the operating condition of the air conditioner and the indoor environment of the air conditioning target space is superimposed on an image obtained by capturing a range including the air conditioner and at least a part of the air conditioning target space, and is displayed on the display unit. .

  The air conditioning system according to the present invention has an effect of improving workability during initial setting work and maintenance work.

The figure which shows an example of the room to which the air conditioning system concerning Embodiment 1 is applied. The figure which shows an example of the range which can detect the sensor part of Embodiment 1. FIG. 3 illustrates an example of a mobile communication terminal according to the first embodiment. FIG. 3 illustrates an example of a mobile communication terminal according to the first embodiment. FIG. 6 is a diagram illustrating an example of an image captured by the camera of the mobile communication terminal according to the first embodiment. The figure which shows an example of the content displayed on the display part of the portable communication terminal of Embodiment 1 The figure which shows an example of the relative position information of Embodiment 1 The figure which shows the structural example of the air conditioner and portable communication terminal of Embodiment 1. A flowchart showing an operation procedure of the relative position calculation unit according to the first embodiment. A flowchart showing an operation procedure of the relative position calculation unit according to the first embodiment. A flowchart showing an operation procedure of the image processing unit according to the first embodiment. The flowchart which shows the operation | movement procedure of the communication part of the air conditioner of Embodiment 1. The figure which shows the outline | summary of the air conditioning system of Embodiment 2. FIG. The figure which shows the structural example of the air conditioner and portable communication terminal of Embodiment 2. A flowchart showing an operation procedure of the image processing unit according to the second embodiment. The flowchart which shows the operation | movement procedure in case the portable communication terminal of Embodiment 2 transmits a driving | running state change command with respect to an air conditioner. The figure which shows the hardware structural example for implement | achieving the air conditioning system of Embodiment 1,2.

  Below, the air conditioning system concerning an embodiment of the invention is explained in detail based on a drawing. Note that the present invention is not limited to the embodiments.

Embodiment 1 FIG.
FIG. 1 is a diagram illustrating an example of a room to which the air conditioning system according to the first embodiment of the present invention is applied. The air conditioning system includes an air conditioner 1 and a portable communication terminal 2 that can display the operating state and indoor environment of the air conditioner 1. In the example of FIG. 1, the air conditioner 1 is installed on the wall surface, but the installation location is not limited to the wall surface. It may be installed on the ceiling or floor. The air conditioner 1 includes a sensor unit 11. This sensor unit 11 can detect the temperature of at least the wall surface 5, the floor surface 6, the ceiling, people, and objects in the room, which is the air conditioning target space. For example, the sensor unit 11 includes a plurality of infrared sensors arranged vertically. The detection range of the sensor unit 11 is not particularly defined. In the present embodiment, it is assumed that the sensor unit 11 performs reciprocating rotational movement in the horizontal direction and scans up, down, left, and right in the front direction of the air conditioner 1. At this time, the sensor unit 11 detects the temperature a plurality of times during the rotational movement. FIG. 2 shows an example of a detectable range of the sensor unit 11 as an overhead view of the room. In FIG. 2, the fan-shaped region shown on the floor surface 6 is a detection region 61 of the sensor unit 11. In the present embodiment, since the sensor unit 11 includes a plurality of infrared sensors arranged vertically, the detection area 61 can be divided into a plurality of small areas 62. FIG. 2 shows that the detection area 61 is composed of a plurality of lattice-shaped small areas 62. The sensor unit 11 can detect the temperature in each of the plurality of small regions 62. You may make it detect the person who exists in the detection area | region 61. FIG. Although the detection area 61 of the floor surface 6 is shown in FIG. 2, the sensor unit 11 can detect the temperature of the wall surface 5 and the ceiling in the same manner.

  The air conditioner 1 preferably includes a humidity sensor, a room temperature sensor, and the like in addition to the sensor unit 11. In the present embodiment, it is assumed that the humidity sensor 12 and the room temperature sensor 13 are provided. In addition, the air conditioner 1 has an AR (Augmented Reality) marker 14 attached to the surface of the housing. The AR marker 14 may be printed on the surface of the housing. The AR marker 14 is used when the mobile communication terminal 2 calculates a relative positional relationship with the air conditioner 1.

  In the room shown in FIG. 1, the worker 3 has the mobile communication terminal 2 and is in the vicinity of the air conditioner 1. The mobile communication terminal 2 will be described with reference to FIGS. 3 and 4. FIG. 3 is a diagram illustrating an example of the mobile communication terminal 2. As illustrated, the mobile communication terminal 2 includes a display unit 21. The surface on which the display unit 21 exists is the front of the mobile communication terminal 2. FIG. 4 is a diagram illustrating an example of the back surface of the mobile communication terminal 2. As shown in FIG. 4, the mobile communication terminal 2 includes a camera 22 on the back surface. The mobile communication terminal 2 can dynamically display an image captured by the camera 22 on the display unit 21. FIG. 5 is a diagram illustrating an example of an image captured by the camera 22 of the mobile communication terminal 2. FIG. 5 shows an example of an image taken in the room shown in FIG. 1, and the air conditioner 1 and the person 4 are displayed on the display unit 21. The mobile communication terminal 2 includes an acceleration sensor that is not shown in FIGS. 3 and 4, and can calculate the amount of change in the absolute position of the mobile communication terminal 2 from the output value of the acceleration sensor. In addition, the mobile communication terminal 2 includes a geomagnetic sensor and can calculate the amount of change in the direction of the mobile communication terminal 2.

  The air conditioner 1 is assumed to have a wireless communication function for communicating with an external device. In the present embodiment, the air conditioner 1 detects detection information (detection information of the humidity sensor 12) indicating the detection result by the humidity sensor 12 and detection information (room temperature) indicating the detection result by the room temperature sensor 13 with respect to the mobile communication terminal 2. Detection information of the sensor 13), detection information indicating the detection result by the sensor unit 11 (detection information of the sensor unit 11), and operation state information indicating the operation state of the air conditioner 1 are transmitted by the wireless communication function. The driving state information is information including airflow direction information, wind speed information, and the like. In the following description, the detection information of the humidity sensor 12, the detection information of the room temperature sensor 13, and the detection information of the sensor unit 11 are collectively described as room environment information. The indoor environment information is information indicating the indoor environment of the room where the air conditioner 1 is installed.

  FIG. 6 is a diagram illustrating an example of contents displayed on the display unit 21 of the mobile communication terminal 2. More specifically, the content displayed on the display unit 21 by the mobile communication terminal 2 based on various information acquired from the air conditioner 1 is shown. In FIG. 6, an example in which an image showing the contents of various information acquired from the air conditioner 1 by the mobile communication terminal 2 is superimposed on an image captured by the camera 22 and displayed on the display unit 21 is shown.

  Using the information acquired from the air conditioner 1, the mobile communication terminal 2 displays the image on the display unit 21 as follows. That is, using the detection information of the humidity sensor 12 and the detection information of the room temperature sensor 13, an image showing the current room temperature and humidity in the room is generated and displayed as the room temperature & humidity display 54 of FIG.

  As described with reference to FIG. 2, the sensor unit 11 can acquire temperature information for each small region 62 of the floor surface 6. Therefore, the mobile communication terminal 2 displays the floor surface temperature displays 51 and 52 in FIG. 6 on the display unit 21 using the temperature information for each small region 62. The floor surface temperature displays 51 and 52 may represent the temperature numerically based on the detection information of the sensor unit 11 or may be represented by a character expression such as “high” or “low”. Further, a difference in temperature may be expressed by a difference in display contents such as a color displayed on the display unit 21 and a display size.

  Further, the mobile communication terminal 2 displays the wind direction & wind speed display 53 of FIG. 6 on the display unit 21 using the airflow blowing direction information and the wind speed information acquired from the air conditioner 1. The wind direction & wind speed display 53 represents the airflow discharged from the air conditioner 1 as an image. In the present embodiment, as shown in FIG. 6, the wind direction is expressed as the direction of the arrow of the wind direction & wind speed display 53, and the wind speed is expressed by the size of the arrow and the description of numerical values.

  The operation state information displayed on the display unit 21 is not limited to the above, and for example, the power consumption of the air conditioner 1, the continuous operation time, the time until filter cleaning is required, and the like may be displayed.

  The room temperature & humidity display 54, floor surface temperature display 51 and 52, and wind direction & wind speed display 53 calculate the display location and display shape to be superimposed on the image captured by the camera 22. In order to realize this, it is necessary that the relative positions of the air conditioner 1 and the portable communication terminal 2 are known in advance. Therefore, in the air conditioning system of the present embodiment, the mobile communication terminal 2 obtains the relative position using the AR marker 14 shown in FIGS. The AR marker 14 is a pattern affixed or printed on the housing surface of the air conditioner 1. The mobile communication terminal 2 images the AR marker 14 with the camera 22 and recognizes the feature, size, shape, and tilt of the pattern of the AR marker 14 as an image, so that the mobile communication terminal 2 and the air conditioner 1 Information indicating the relative positional relationship with the above is calculated. In the present embodiment, information calculated based on an image obtained by capturing the AR marker 14 is handled as relative position information having the configuration shown in FIG. The relative position information includes at least a relative distance, a pitch angle, a roll angle, and a yaw angle. The relative distance is a value representing an interval between the air conditioner 1 and the mobile communication terminal 2. The pitch angle, the roll angle, and the yaw angle represent the rotation angle around each axis of the three-dimensional orthogonal coordinates with the mobile communication terminal 2 shown in FIG. 3 as the origin. The pitch angle, the roll angle, and the yaw angle are values representing how much the air conditioner 1 is tilted in the captured image of the camera 22. In this embodiment, the rotation angle around the x axis is the pitch angle, the rotation angle around the y axis is the roll angle, and the rotation angle around the z axis is the yaw angle.

  The derivation of the relative positional relationship is performed at least once when the mobile communication terminal 2 starts displaying the content shown in FIG. After the relative positional relationship is determined, the amount of change in the absolute position of the mobile communication terminal 2 is grasped at any time by using an acceleration sensor and a geomagnetic sensor mounted on the mobile communication terminal 2, and the determined value of the relative positional relationship is stored in the mobile communication. By giving the change amount of the absolute position of the terminal 2 as a correction value, the relative positional relationship between the air conditioner 1 and the portable communication terminal 2 is updated to the latest state.

  In the present embodiment, the relative positional relationship between the air conditioner 1 and the mobile communication terminal 2 is calculated using the AR marker 14, but the method for obtaining the relative positional relationship is not limited to this. As another method, there is a method in which the shape of the air conditioner 1 is captured by the camera 22 and the relative positional relationship between the air conditioner 1 and the portable communication terminal 2 is calculated from the feature amount such as the size and inclination. It is done. Further, the position information of the air conditioner 1 and the portable communication terminal 2 is acquired using position specifying information that can be acquired by using GPS (Global Positioning System) or the like, and the relative positional relationship is obtained from the position information. It may be.

  Next, the internal configuration of the air conditioning system according to the present embodiment will be described with reference to FIG. FIG. 8 is a diagram illustrating a configuration example of the air conditioner 1 and the mobile communication terminal 2 constituting the air conditioning system 100.

  First, the configuration of the air conditioner 1 will be described. The air conditioner 1 controls the sensor unit 11, the humidity sensor 12, and the room temperature sensor 13, and sensor information that collects sensor values that are detection values by the sensors by controlling the sensor unit 11, the humidity sensor 12, and the room temperature sensor 13. The communication unit 16 that transmits and receives data between the collection unit 15 and other devices such as the mobile communication terminal 2 and the operation control of the air conditioner 1, specifically, air such as cooling, heating, dehumidification, and air blowing And an operation control unit 17 that adjusts a harmony function, a wind direction, a wind speed, and the like.

  Next, the configuration of the mobile communication terminal 2 will be described. The mobile communication terminal 2 acquires sensor values from the display unit 21 and camera 22 described above, the communication unit 23 that transmits and receives data to and from other devices such as the air conditioner 1, and the acceleration sensor 24A and the geomagnetic sensor 24B. A sensor information processing unit 24, an imaging unit 25 that controls the camera 22 to acquire image data, a relative position calculation unit 26 that calculates a relative positional relationship between the air conditioner 1 and its own device (mobile communication terminal 2), An image processing unit 27 that generates an image to be displayed on the display unit 21 and a display unit 21 that displays an image generated by the image processing unit 27 are provided.

  In the mobile communication terminal 2, the sensor information processing unit 24 estimates the amount of change in the absolute position of the mobile communication terminal 2 based on the sensor values acquired from the acceleration sensor 24A and the geomagnetic sensor 24B. For example, if the mobile communication terminal 2 is stationary in the room, the acceleration sensor 24A of the mobile communication terminal 2 detects only the gravitational acceleration of the earth. When the acceleration sensor 24A detects an acceleration other than gravitational acceleration, the sensor information processing unit 24 estimates that the absolute position of the mobile communication terminal 2 has changed. The imaging unit 25 receives and holds image data acquired by the imaging element of the camera 22. The relative position calculation unit 26 analyzes the image captured by the camera 22 and calculates relative position information indicating the relative position between the air conditioner 1 and the own apparatus (mobile communication terminal 2). In addition, the relative position calculation unit 26 calculates the moving speed and the moving amount of the mobile communication terminal 2 from the relationship between the acceleration detected by the acceleration sensor 24A and the time when detecting that the absolute position of the mobile communication terminal 2 has changed. To do. Furthermore, the relative position calculation unit 26 reflects the calculated movement amount in the relative position relationship with the air conditioner 1 and estimates the relative position relationship after the absolute position of the mobile communication terminal 2 has changed.

  The image processing unit 27 performs a process of superimposing the operation state information of the air conditioner 1 and the indoor environment information on the image captured by the camera 22 and generates an image to be displayed on the display unit 21. At this time, the operating state information and the indoor environment information are superimposed on the image by performing image processing based on the relative positional relationship between the air conditioner 1 and the portable communication terminal 2. Information on the relative positions of the air conditioner 1 and the portable communication terminal 2 is acquired from the relative position calculation unit 26. By considering the relative position of the air conditioner 1 and the portable communication terminal 2, the operating state information of the air conditioner 1, for example, the display position of the wind direction & wind speed display 53 is arranged in the vicinity of the display position of the air conditioner 1. Is possible.

  Next, operation | movement of the air conditioning system of this Embodiment is demonstrated using FIGS. 9-12. FIG. 9 and FIG. 10 are flowcharts illustrating the operation procedure of the relative position calculation unit 26 of the mobile communication terminal 2 according to the first embodiment. FIG. 11 is a flowchart of an operation procedure of the image processing unit 27 of the mobile communication terminal 2 according to the first embodiment. FIG. 12 is a flowchart of an operation procedure of the communication unit 16 of the air conditioner 1 according to the first embodiment.

  First, using FIG. 9 and FIG. 10, an operation in which the relative position calculation unit 26 of the mobile communication terminal 2 obtains relative position information indicating the relative positions of the air conditioner 1 and the mobile communication terminal 2 will be described. In the mobile communication terminal 2 according to the present embodiment, first, the camera 22 images the AR marker 14 of the air conditioner 1. Then, based on the image data obtained by imaging, the relative position calculation unit 26 obtains initial values of the relative position information of the air conditioner 1 and the mobile communication terminal 2. After obtaining the initial value, the relative position calculator 26 updates the relative position information by correcting the relative position information based on the detected value by the acceleration sensor 24A and the detected value by the geomagnetic sensor 24B. The AR marker 14 is imaged, for example, by performing an operation determined by the operator.

  FIG. 9 shows a processing flow when the relative position calculation unit 26 obtains the initial value of the relative position information of the air conditioner 1 and the mobile communication terminal 2 using the AR marker 14. When calculating the initial value of the relative position information, the relative position calculation unit 26 first obtains image data of an image captured by the camera 22 from the imaging unit 25 (step S11). Next, the relative position calculation unit 26 analyzes the acquired image data to check whether or not there is an AR marker in the image (step S12). If there is no AR marker (step S12: No), the process ends. On the other hand, if there is an AR marker (step S12: Yes), the relative position information of the air conditioner 1 and the portable communication terminal 2 is estimated based on the size, shape and inclination of the AR marker in the image. An initial value is generated (step S13). That is, the relative position of the mobile communication terminal 2 is estimated based on the air conditioner 1 to which the AR marker 14 is attached by obtaining the relative position with the AR marker in the image. A method for analyzing the AR marker image and estimating the relative position of the AR marker is not particularly defined. Any existing technique may be used for estimation.

  The relative position calculation unit 26 of the mobile communication terminal 2 obtains the initial value of the relative information between the air conditioner 1 and the mobile communication terminal 2 based on the image obtained by the camera 22 capturing the AR marker 14, and then illustrated in FIG. 10. Correct the relative position information in the procedure. The relative position calculation unit 26 periodically repeats the procedure shown in FIG.

  In the operation of correcting the relative position information, the relative position calculation unit 26 first acquires sensor information that is the detection value of the acceleration sensor 24A and the detection value of the geomagnetic sensor 24B from the sensor information processing unit 24 (step S21). Next, the relative position calculator 26 confirms the sensor information and confirms whether or not the sensor information has changed (step S22). Specifically, the detection value of the acceleration sensor 24A acquired last time and the detection value of the acceleration sensor 24A acquired this time are compared, and the detection value of the geomagnetic sensor 24B acquired last time and the detection value of the geomagnetic sensor 24B acquired this time are compared. Compare When at least one of the detection value of the acceleration sensor 24A and the detection value of the geomagnetic sensor 24B has changed, it is determined that the sensor information has changed. Whether or not the detection value has changed is determined by comparing the difference between the previous detection value and the current detection value with a threshold value for change detection. If the difference between the detected values reaches the threshold value, there is a change. If the detected value difference is less than the threshold value, it is determined that there is no change. When there is no change in the sensor information (step S22: No), the relative position calculation unit 26 ends the process.

  When the sensor information has a change (step S22: Yes), the relative position calculation unit 26 changes at least one of the absolute position and the posture of the mobile communication terminal 2. Therefore, based on the sensor information, that is, the detection value of the acceleration sensor 24A and the detection value of the geomagnetic sensor 24B, the position change amount and the posture change amount of the mobile communication terminal 2 are calculated. The amount of change in position is calculated based on the detection value of the acceleration sensor 24A, and the amount of change in posture is calculated based on the detection value of the geomagnetic sensor 24B (step S23). Next, the relative position calculation unit 26 corrects the relative position information by using the position change amount and the posture change amount obtained in step S22 (step S24).

  Next, the operation | movement which the image processing part 27 of the mobile communication terminal 2 produces | generates the image displayed on the display part 21 is demonstrated using FIG. Here, description will be made assuming that the mobile communication terminal 2 displays a moving image on the display unit 21.

  In order to output an image captured by the camera 22 to the display unit 21 as a moving image, it is necessary to periodically update the image output to the display unit 21. Although the cycle for updating the image is not particularly defined, an update cycle is required so that the worker 3 does not feel unnatural when the image output to the display unit 21 changes dynamically. From this, the image processing unit 27 creates an image to be output to the display unit 21 for each update cycle. Specifically, first, the image processing unit 27 acquires the relative position information of the air conditioner 1 and the mobile communication terminal 2 from the relative position calculation unit 26 (step S31). Next, the image processing unit 27 acquires operating state information and indoor environment information of the air conditioner 1 from the air conditioner 1 (step S32). The timing at which the image processing unit 27 acquires the driving state information and the indoor environment information is not defined. It is good also as a system which the air conditioner 1 transmits to the portable communication terminal 2 periodically, and the system which the air conditioner 1 transmits to the portable communication terminal 2 when the driving | running state information or indoor environment information of the air conditioner 1 changes. It is good. A transmission request may be made from the image processing unit 27 of the mobile communication terminal 2 to the air conditioner 1, and the air conditioner 1 that has received this request may transmit operating state information and room environment information. Next, the image processing unit 27 uses the relative position information acquired in step S31 to calculate display positions and shapes of various images indicating the driving state and the indoor environment output to the display unit 21 (step S33). . Specifically, the image processing unit 27 obtains the sizes of various images indicating the driving state and the indoor environment based on the value of the relative distance included in the relative position information. Moreover, based on the pitch angle, the roll angle, and the yaw angle included in the relative position information, display locations and display shapes of various images indicating the driving state and the indoor environment are obtained. Next, the image processing unit 27 performs image composition processing for superimposing various images indicating the driving state and the indoor environment calculated in step S33 on the image captured by the camera 22, and creates an image to be displayed on the display unit 21. (Step S34). The image processing unit 27 executes the above steps S31 to S34 for each update cycle. When the image processing unit 27 finishes creating the image, the image processing unit 27 outputs the created image to the display unit 21, and the display unit 21 displays the image created by the image processing unit 27.

  Next, the operation | movement in which the communication part 16 of the air conditioner 1 transmits driving | running state information and room environment information is demonstrated using FIG.

  First, the communication unit 16 acquires indoor environment information from the sensor information collection unit 15 (step S41). Next, the communication part 16 acquires the operation state information of the air conditioner 1 from the operation control part 17 (step S42). The communication unit 16 transmits the indoor environment information and the driving state information to the mobile communication terminal 2 (step S43). As described above, the timing for transmitting the information may be transmitted at a constant cycle, or may be transmitted when at least one of the indoor environment information and the driving state information changes. You may transmit when there exists a request | requirement from the mobile communication terminal 2. FIG.

  As described above, in the air conditioning system of the present embodiment, the air conditioner 1 transmits the operating state information and the indoor environment information to the mobile communication terminal 2, and the mobile communication terminal 2 receives the air conditioner 1. Based on the information, an image indicating the content of the received information is generated, and the generated image is superimposed on an image captured by the camera 22 and displayed on the display unit 21. As a result, the operator 3 who has the mobile communication terminal 2 can set the operating condition of the air conditioner 1 and the indoor environment information, specifically, the air conditioner during installation and maintenance of the air conditioner 1. It is possible to easily know invisible information such as the wind direction, wind speed, temperature, and floor temperature of the discharged airflow. Furthermore, since these pieces of information are displayed on the display unit 21 of the mobile communication terminal 2 so as to be superimposed on the video imaged by the camera 22, it is possible to acquire information from a viewpoint close to the operator 3 itself, and the air conditioner It is possible to contribute to the improvement of work efficiency during the installation work and the maintenance work.

Embodiment 2. FIG.
The air conditioning system of Embodiment 2 is demonstrated. In the air conditioning system of the first embodiment, the mobile communication terminal 2 superimposes an image indicating the operating state of the air conditioner 1 and the indoor environment information on the image captured by the camera and displays the image on the display unit. The operating state of the air conditioner 1 and the indoor environment can be easily grasped. In contrast, the air conditioning system of the second embodiment is obtained by further adding the following configuration to the air conditioning system of the first embodiment.

  The air conditioning system 100a of this Embodiment is comprised by the air conditioner 1 and the portable communication terminal 2a which were demonstrated in Embodiment 1. FIG. It is assumed that the mobile communication terminal 2a can transmit an operation state change command such as a wind direction, a wind speed, a target set temperature, and a target set humidity to the air conditioner 1. The air conditioner 1 that has received the operation state change command from the mobile communication terminal 2a reflects the received operation state change command in the control of the operation state.

  FIG. 13 is a diagram illustrating an outline of the air-conditioning system 100a according to the second embodiment. In FIG. 13, the same reference numerals are given to the parts common to FIG. 6 used in the description of the first embodiment. The portions denoted by the same reference numerals as those in FIG. 6 are the same as those in the first embodiment, and thus the description thereof is omitted.

  In the air conditioning system 100a of the second embodiment, the display unit 21 of the mobile communication terminal 2a is configured with a touch panel that can sense that the display surface has been touched, and the mobile communication terminal 2a When the surface of 21 is touched, it can be detected. When the operator inputs an operation state change command to the mobile communication terminal 2a, as shown in FIG. 13, the state display displayed on the display unit 21, that is, the room temperature & humidity display 54, the floor surface temperature displays 51 and 52, This is performed by touching each display location of the wind direction & wind speed display 53 (operation 57 in FIG. 13). For example, when it is desired to lower the temperature of the floor corresponding to the floor temperature display 51, the position where the floor temperature display 51 is displayed is touched with two fingers and moved so as to reduce the interval between the two fingers. A state change command is input to the mobile communication terminal 2a. Conversely, when the floor temperature corresponding to the floor surface temperature display 51 is to be raised, the position where the floor surface temperature display 51 is displayed is touched with two fingers so as to widen the interval between the two fingers. The operation state change command is input to the mobile communication terminal 2a. Thus, when the change of the floor surface temperature corresponding to the floor surface temperature display 51 is input as the operation state change command, the information is transmitted from the portable communication terminal 2a to the air conditioner 1. The air conditioner 1 that has received the information on the operation state change command reflects the content indicated by the received information in the control of the operation state. That is, the air conditioner 1 adjusts the temperature, the wind direction, and the wind speed of the discharged air flow so as to change the temperature of the portion corresponding to the floor surface temperature display 51. It is assumed that the operation state change command includes position information of a location to be changed. When the air conditioner 1 changes the operation state in accordance with the operation state change command, the air conditioner 1 transmits the changed operation state information to the mobile communication terminal 2a. The mobile communication terminal 2 a that has received the driving state information updates the display of the driving state displayed on the display unit 21.

  Next, the internal configuration of the air conditioning system according to the present embodiment will be described with reference to FIG. FIG. 14 is a diagram illustrating a configuration example of the air conditioner 1 and the portable communication terminal 2a constituting the air conditioning system 100a.

  Since the air conditioner 1 is the same as that of Embodiment 1, description is abbreviate | omitted. The mobile communication terminal 2a is obtained by adding an operation unit 31 and an operation management unit 32 to the mobile communication terminal 2 of the first embodiment shown in FIG. Since parts other than the operation unit 31 and the operation management unit 32 are the same as those in the first embodiment, description thereof is omitted.

  The operation unit 31 is a functional module that controls the user interface of the mobile communication terminal 2a. The operation unit 31 detects an operation performed on the mobile communication terminal 2a by the operator touching the display unit 21, and generates operation information indicating the content of the detected operation. When the operation unit 31 generates operation information, the operation unit 31 passes the generated operation information to the image processing unit 27 via the operation management unit 32. The operation management unit 32 is a functional module that manages the operation state of the air conditioner 1. The operation management unit 32 acquires operation state information of the air conditioner 1 through the communication unit 23. When the operation management unit 32 receives the operation information from the operation unit 31, the operation management unit 32 passes the operation information to the image processing unit 27. At this time, the operation management unit 32 confirms the operation information to be passed to the image processing unit 27, and when the operation information indicates an operation to change the driving state or the indoor environment, the operation management unit 32 passes the communication unit 23 to the air conditioner 1. An operating state change command is transmitted, and an instruction to change the operating state or the indoor environment is given.

  Next, operation | movement of the air conditioning system of this Embodiment is demonstrated using FIG. 15 and FIG. FIG. 15 is a flowchart of an operation procedure of the image processing unit 27 of the mobile communication terminal 2a according to the second embodiment. FIG. 16 is a flowchart illustrating an operation procedure when the mobile communication terminal 2 a according to the second embodiment transmits an operation state change command to the air conditioner 1.

  The operation | movement which produces | generates the moving image which the image process part 27 of the mobile communication terminal 2a displays on the display part 21 is demonstrated using FIG. The operation of generating a moving image to be displayed on the display unit 21 by the image processing unit 27 of the present embodiment is the same as the operation described in the first embodiment, that is, the operation shown in FIG. It is a thing. Specifically, the process of step S51 is executed between the process of step S32 and the process of step S33. Detailed description of portions common to the first embodiment is omitted.

  The image processing unit 27 acquires relative position information from the relative position calculation unit 26 (step S31), and further acquires operating state information and room environment information from the air conditioner 1 (step S32). Next, the image processing unit 27 acquires operation information indicating the content of the operation performed by the worker from the operation unit 31 (step S51). In addition, when the operation by the operator is not performed, the acquired operation information is content indicating that the operator's operation is not performed.

  Next, the image processing unit 27 executes Step S33. That is, as in the first embodiment, the image processing unit 27 calculates the display location and shape of various images indicating the driving state and indoor environment output to the display unit 21 based on the relative position information (step S33). At this time, when the operation information acquired in step S51 is a content indicating a change command of the driving state or the indoor environment, the image processing unit 27 reflects the content of the change command in the calculation of the display location and the display shape. In other words, the contents of the change command are reflected in the driving state information and the indoor environment information to update the information, and various images indicating the driving state and the indoor environment are displayed based on the updated driving state information and the indoor environment information. Calculate location and display shape. Next, the image processing unit 27 performs an image composition process for superimposing various images indicating the driving state and the indoor environment calculated in step S33 on the image captured by the camera 22 (step S34).

  Although step S51 is executed after step S32, step S51 may be executed before or after step S31.

  When the mobile communication terminal 2a notifies the air conditioner 1 of the change in the operating state or the indoor environment, the notification is made according to the procedure shown in FIG.

  When the operation information received from the operation unit 31 indicates an operation for changing the driving state or the indoor environment, the driving management unit 32 of the mobile communication terminal 2a outputs a command for changing the driving state or the indoor environment to the communication unit 23. . The communication unit 23 that has acquired the operation state or indoor environment change command from the operation management unit 32 transmits the operation state or indoor environment change command to the air conditioner 1 (steps S61 and S62). In the air conditioner 1, the communication unit 16 receives the change command transmitted in step S62, and notifies the operation control unit 17 of the received change command (step S63). When receiving the change command from the communication unit 16, the operation control unit 17 changes the operation state of the air conditioner 1 according to the content of the received change command (step S64).

  As described above, in the air conditioning system of the present embodiment, the air conditioner 1 transmits the operating state information and the indoor environment information to the mobile communication terminal 2a, and the mobile communication terminal 2a receives the air conditioner 1 from the air conditioner 1. Based on the information, an image indicating the content of the received information is generated, and the generated image is superimposed on an image captured by the camera 22 and displayed on the display unit 21 disposed on the opposite surface of the camera 22. The mobile communication terminal 2a detects the operation of the operator via the display unit 21, reflects the detected operation content on the display content on the display unit 21, and sends a change command corresponding to the operation content to the air conditioner. 1 is transmitted. Thereby, the operator can input the operation state change command from the same display unit 21 while confirming the operation state of the air conditioner 1 displayed on the display unit 21 of the mobile communication terminal 2a. During installation work and maintenance work, it is possible to greatly reduce the labor of checking the operating state. Therefore, it can contribute to the improvement of work efficiency. In addition, when a consumer uses an air conditioner on a daily basis, conventionally, the actual operating state of the air conditioner 1 is confirmed by looking at the display on the remote control device, or the housing state of the air conditioner 1 is directly checked. Although there was no choice but to confirm, the operating state of the air conditioner 1 can be confirmed in a form that can be easily grasped intuitively by display on the display unit 21 of the mobile communication terminal 2a.

  Some of the functions of the air conditioner 1 and the portable communication terminals 2 and 2a described in the first and second embodiments are the hardware shown in FIG. 17, specifically, the processor 201, the RAM ( It can be realized by a memory 202 configured by a random access memory (ROM), a read only memory (ROM), a communication device 203, and a display 204. The processor 201, the memory 202, the communication device 203, and the display 204 are connected to the bus 200 and are configured to be able to exchange data, control information, and the like via the bus 200.

  The sensor information collection unit 15 and the operation control unit 17 of the air conditioner 1 are realized by storing a program for the air conditioner in the memory 202 and executing the program by the processor 201. In addition, the sensor information processing unit 24, the imaging unit 25, the image processing unit 27, the operation unit 31, and the operation management unit 32 of the mobile communication terminals 2 and 2a store a program for the mobile communication terminal in the memory 202. This is realized by the processor 201 executing the program. The communication unit 16 of the air conditioner 1 and the communication unit 23 of the mobile communication terminals 2 and 2a are realized by the communication device 203. The display unit 21 of the mobile communication terminals 2 and 2a is realized by the display 204.

  In addition, you may make it implement | achieve the said function with which the air conditioner 1 and the portable communication terminals 2 and 2a are provided in cooperation with a some processor and some memory.

  The configuration described in the above embodiment shows an example of the contents of the present invention, and can be combined with another known technique, and can be combined with other configurations without departing from the gist of the present invention. It is also possible to omit or change the part.

  DESCRIPTION OF SYMBOLS 1 Air conditioner, 2, 2a Portable communication terminal, 3 worker, 4 persons, 5 Wall surface, 6 Floor surface, 11 Sensor part, 12 Humidity sensor, 13 Room temperature sensor, 14 AR marker, 15 Sensor information collection part, 16, 23 communication unit, 17 operation control unit, 21 display unit, 22 camera, 24 sensor information processing unit, 24A acceleration sensor, 24B geomagnetic sensor, 25 imaging unit, 26 relative position calculation unit, 27 image processing unit, 31 operation unit, 32 Operation management unit, 100, 100a Air conditioning system, 200 bus, 201 processor, 202 memory, 203 communication device, 204 display.

Claims (2)

An air conditioner,
A portable communication terminal capable of wireless communication with the air conditioner;
With
The air conditioner
A communication unit for transmitting operation state information indicating an operation state of the own device and indoor environment information indicating an indoor environment of a target space for air conditioning by the own device to the mobile communication terminal;
With
The mobile communication terminal is
A camera,
A display unit;
A communication unit that receives the operating state information and the indoor environment information from the air conditioner;
A relative position calculation unit that calculates relative position information indicating a relative position between the apparatus and the air conditioner based on an image captured by the camera;
The camera acquires a first image that is an image of a range including the air conditioner and at least a part of the air conditioning target space, and the operating state information, the indoor environment information, and the relative position Based on the information, a second image that is an image representing the operating state of the air conditioner and the indoor environment of the air conditioning target space is generated, and the second image is superimposed on the first image. An image processing unit for displaying an image on the display unit;
An air conditioning system comprising: The display unit is configured to detect that the display surface is touched,
The mobile communication terminal is
Operation information indicating a detection result by detecting an operation on the air conditioner performed by a user of the air conditioner touching the display surface in a state where the display unit displays the second image. An operation unit for generating
An operation management unit for instructing the air conditioner to perform operation according to the operation information by transmitting the operation information generated by the operation unit to the air conditioner;
The air conditioning system according to claim 1, further comprising:

Images