JP7286125B1 - Device control server - Google Patents

Abstract

Kind Code: A1 A graphical user interface for operating equipment irrelevant to the location of a mobile terminal is suppressed from being displayed on the mobile terminal. A device control server identifies an area within a facility that is estimated to be the location of the mobile terminal based on first location information received by the mobile terminal from a first location information transmitting device; causing the mobile terminal to display a graphical user interface for accepting operations of the associated device; receiving radio waves of the second location information received from the second location information transmitting device when the mobile terminal receives the first location information receive, from a mobile terminal, reception record information that records the state; Build a machine learning model to estimate the location of the device. [Selection drawing] Fig. 1

Description

This specification discloses a technology related to a device control server.

Patent Literature 1 describes a system for estimating the position of a mobile terminal using GPS signals and displaying on the mobile terminal a graphical user interface for operating devices existing in the vicinity of the mobile terminal. Further, Patent Literature 2 describes a technique for estimating the position of a mobile terminal using a beacon device.

WO2014/030377 JP 2018-093428 A

When GPS signals are used indoors to estimate the position of a mobile terminal, the accuracy of the GPS signal is reduced indoors, and graphical user interfaces are displayed on the mobile terminal to operate equipment independent of the location of the mobile terminal. there was a problem In addition, even when a beacon device is used indoors to estimate the position of a mobile terminal, depending on the installation environment of the beacon device, at least one of the strength of the received radio waves and the direction of arrival of the radio waves from the beacon device at the mobile terminal may differ from the mobile terminal. Since the positional relationship between the GPS signal and the beacon device may be irregular, there is a problem similar to that when using the GPS signal.

The technology disclosed in this specification can be implemented as the following modes.

(1) One form disclosed in this specification is a device control server. The device control server is configured to be able to control a plurality of devices arranged in a facility based on an operation from a mobile terminal, and an area in the facility estimated as the location of the mobile terminal among the plurality of devices. from the mobile terminal. The device control server comprises a communication module configured to communicate with the mobile terminal; a processor; and a memory storing program instructions. By the execution of the program instructions by the processor, the device control server transmits the mobile terminal to the mobile terminal via wireless communication conforming to the first communication standard from the first location information transmitting device arranged in the facility. receiving the received first location information from the mobile terminal using the communication module; and based on the first location information received from the mobile terminal, the facility estimated as the location of the mobile terminal. identifying an area within the facility; using the communication module, a graphical user interface that accepts operation of a device associated with the area within the facility identified based on the first position information among the plurality of devices is displayed on the mobile terminal; when the mobile terminal receives the first location information, the communicable distance from the second location information transmitting device placed in the facility is longer than the first communication standard receiving from the mobile terminal, using the communication module, reception record information that records the radio wave reception state of the second location information received via wireless communication conforming to a long second communication standard; A machine learning model for estimating the position of the mobile terminal from the radio wave reception state of the second position information in the mobile terminal is constructed by machine learning using the received first position information and the reception record information. According to the device control server of this form, the location of the mobile terminal is estimated using the second location information transmitting device while performing the operation of estimating the location of the mobile terminal using the first location information transmitting device. It is possible to build a machine learning model for mobile terminal location and improve the accuracy of estimating the location of the mobile terminal by the machine learning model. Then, when the position of the mobile terminal is estimated using the second position information transmitting device, by using the machine learning model, a graphical system for operating the device irrelevant to the position of the mobile terminal is generated. It is possible to prevent the user interface from being displayed on the mobile terminal.

(2) In the device control server of the above-described mode, the program instructions are executed by the processor so that the mobile terminal can perform wireless communication conforming to the second communication standard without receiving the first location information. receiving, from the mobile terminal, using the communication module, reception state information indicating a radio wave reception state of the second location information received from the second location information transmitting device via communication; identifying an area within the facility that is presumed to be the location of the mobile terminal based on the reception status information received from the mobile terminal; using the communication module to identify, among the plurality of devices, The mobile terminal may display a graphical user interface that accepts operation of a device associated with the area within the facility identified based on the reception status information. According to the device control server of this form, the position of the mobile terminal can be estimated using a machine learning model with improved accuracy in estimating the position of the mobile terminal.

(3) In the device control server of the form described above, the first location information transmission device may be an RFID tag, and the second location information transmission device may be a BLE beacon device. According to the device control server of this form, a machine learning model for estimating the position of the mobile terminal using the BLE beacon device is constructed while performing operation for estimating the position of the mobile terminal using the RFID tag. , can improve the accuracy of estimating the location of the mobile terminal by its machine learning model.

(4) In the device control server of the form described above, the plurality of devices may include at least one of a lighting device, an air conditioner, an electric shade, a floor heating device, an audio device, a video device, an electric door, and an electric lock. According to the device control server of this form, it is possible to improve the operability of devices that require adjustment for each area in the facility.

The technology disclosed in this specification can be implemented in various forms different from the device control server. The technology disclosed in this specification can be implemented in the form of, for example, a mobile terminal, a device management system, a computer program for a device control server, a computer program for a mobile terminal, a machine learning model building method, and the like.

It is an explanatory view showing composition of a device management system. FIG. 2 is an explanatory diagram showing a detailed configuration of a mobile terminal; FIG. 4 is an explanatory diagram showing an example of a graphical user interface displayed on a touch panel display; FIG. 4 is an explanatory diagram showing a detailed configuration of a device control server; 4 is a flowchart showing GUI display processing executed by a mobile terminal; 4 is a flowchart showing GUI display processing executed by the device control server; 4 is a flowchart showing machine learning processing executed by the device control server; 4 is a flowchart showing position determination change processing executed by the device control server;

FIG. 1 is an explanatory diagram showing the configuration of the device management system 10. As shown in FIG. The device management system 10 is a system that manages a plurality of devices 20 arranged within the facility 800 . A facility 800 is a relatively large space in which a plurality of devices 20 can be installed. In this embodiment, facility 800 is an office building. In other embodiments, facility 800 may be a factory, a commercial facility, or a residence.

In the equipment management system 10, the equipment 20 placed in the facility 800 is managed in association with the area 810 in the facility 800 where the equipment 20 is placed. A plurality of areas 810 in the facility 800 can be set in units of building floors, aisles, divisions, rooms, partitioned seats, fixtures, and the like. In the description of this specification, the code "810" is used to collectively indicate a plurality of areas within the facility 800, and the code Codes with suffixes to "810" are used (eg, 810-1, 810-2, 810-3). In the example of FIG. 1, each of areas 810-1, 810-2, 810-3 is a room provided in facility 800. In FIG. Each of the areas 810-1a and 810-1b is a partition seat (booth) provided in the area 810-1.

Each of the plurality of devices 20 is an electronically controllable device located within facility 800 . In the description of this specification, the code "20" is used to collectively indicate a plurality of devices, and a branch number is added to the code "20" to individually indicate a specific device among the plurality of devices. (eg, 20-1a, 20-1b, 20-1c, etc.). In the example of FIG. 1, device 20-1a is a lighting device located in area 810-1a. Equipment 20-1b is a lighting equipment arranged in area 810-1b. Equipment 20-1c is an air conditioner placed in area 810-1. Device 20-2a is a lighting device located in area 810-2. Equipment 20-2c is an air conditioner placed in area 810-2. The plurality of devices 20 may be devices that can be electronically controlled, and are not limited to air conditioners and lighting devices, and may include electric shades, floor heating, audio equipment, video equipment, electric doors (gates), electric locks, and the like. . As a result, it is possible to improve the operability of the equipment 20 that requires adjustment for each area 810 within the facility 800 .

The device management system 10 includes a plurality of beacon devices 50, a plurality of RFID tags 60, a plurality of access points 70, a plurality of mobile terminals 100, a device control server 200, a facility control device 300, and a management terminal 400. Prepare. The device management system 10 is configured so that a user of the facility 800 can operate a plurality of devices 20 arranged in the facility 800 using the mobile terminal 100 .

Each of the plurality of beacon devices 50 is a positional information transmitting device that is arranged within facility 800 and transmits positional information indicating area 810 within facility 800 using wireless communication. Each of the plurality of beacon devices 50 uses wireless communication to transmit unique beacon identification information as position information. In the device management system 10 , the beacon identification information of the beacon device 50 is managed in association with at least one of the plurality of areas 810 and can be used as position information indicating the area 810 within the facility 800 . In this embodiment, the beacon device 50 is a BLE beacon device that transmits BLE identification information as position information in compliance with BLE (Bluetooth Low Energy, registered trademark), which is one of short-range wireless communication standards. The communicable distance of the beacon device 50 is longer than the communicable distance of the RFID tag 60 . In this embodiment, the communicable distance of the beacon device 50 is set to around 10 meters.

In the description of this specification, the code “50” is used when collectively indicating a plurality of beacon devices, and the code “50” is used when individually indicating a specific beacon device among the plurality of beacon devices. Numbered codes are used (eg 50-1, 50-2). In the example of FIG. 1, beacon device 50-1 is located in area 810-1. Beacon device 50-2 is located in area 810-2.

Each of the plurality of RFID tags 60 is a location information transmitting device that is placed within the facility 800 and transmits location information indicating an area 810 within the facility 800 using wireless communication. Each of the plurality of RFID tags 60 uses wireless communication to transmit unique RFID identification information as position information. In the device management system 10 , the RFID identification information of the RFID tag 60 is managed in association with at least one of the plurality of areas 810 and can be used as position information indicating the area 810 within the facility 800 . In this embodiment, the RFID tag 60 is an NFC tag conforming to NFC (Near Field Communication, registered trademark), which is one of the short-range wireless communication standards. In this embodiment, the communicable distance of the RFID tag 60 is set to around 5 centimeters.

In the description of this specification, the code "60" is used when collectively indicating a plurality of RFID tags, and the code "60" is used when individually indicating a specific RFID tag among the plurality of RFID tags. Numbered codes are used (eg 60-1a, 60-1b, 60-2). In the example of FIG. 1, RFID tag 60-1a is located in area 810-1a. RFID tag 60-1b is located in area 810-1b. RFID tag 60-2 is located in area 810-2.

Each of the plurality of access points 70 is arranged within the facility 800 and configured to be able to construct a wireless LAN to which the mobile terminal 100 can be connected. The access point 70 enables communication between the mobile terminal 100 and the device control server 200 by relaying between the wireless LAN connected to the mobile terminal 100 and the wired LAN connected to the device control server 200. Connecting. In the description of this specification, the code "70" is used to collectively indicate a plurality of access points, and the code "70" is used to individually indicate a specific access point among the plurality of access points. Numbered codes are used (eg 70-1, 70-2, 70-3).

Each of the plurality of mobile terminals 100 is information equipment that can be carried by a user of the facility 800. FIG. In this embodiment, the mobile terminal 100 is a smart phone. The plurality of mobile terminals 100 may be portable information devices, and may include not only smart phones but also tablet terminals, personal computers, and the like. Mobile terminal 100 is configured to be able to operate a plurality of devices 20 placed in facility 800 . Mobile terminal 100 is configured to be able to receive location information from beacon device 50 . The mobile terminal 100 is configured to be able to receive location information from the RFID tag 60 . The mobile terminal 100 is configured to be able to communicate with the device control server 200 via the wireless LAN of the access point 70 . In the description of this specification, the code "100" is used to collectively indicate a plurality of mobile terminals, and the code "100" is used to individually indicate a specific mobile terminal among the plurality of mobile terminals. Numbered codes are used (eg 100-1, 100-2). Details of the mobile terminal 100 will be described later.

The device control server 200 is a computer that processes information between the mobile terminal 100 and the facility control device 300 . The device control server 200 is configured to be able to control a plurality of devices 20 arranged in the facility 800 based on operations from the mobile terminals 100 . The device control server 200 receives from the mobile terminal 100 an operation of the device 20 associated with the area 810 in the facility 800 which is assumed to be the position of the mobile terminal 100 among the plurality of devices 20 . The equipment control server 200 is communicably connected to a plurality of access points 70 and equipment control devices 300 via a computer network (for example, at least one of wired LAN, wireless LAN, and the Internet). In the example of FIG. 1, the number of device control servers 200 is one, but in other embodiments, there may be a plurality of devices depending on the processing load. Details of the device control server 200 will be described later.

The equipment control device 300 is a computer that controls equipment provided in the facility 800 . The equipment control device 300 is connected to each of the plurality of devices 20 so as to be electronically controllable. In this embodiment, the equipment control device 300 is a device conforming to KNX (registered trademark).

The management terminal 400 is a personal computer configured to be operable by the administrator of the equipment management system 10 . The management terminal 400 is communicably connected to the device control server 200 via a computer network. The management terminal 400 instructs the device control server 200 to set the operation of the device management system 10 based on the operation input from the administrator.

FIG. 2 is an explanatory diagram showing the detailed configuration of the mobile terminal 100. As shown in FIG. Mobile terminal 100 includes processor 110 , memory 120 , touch panel display 130 , wireless module 152 , wireless module 154 , and wireless module 156 .

Processor 110 of mobile terminal 100 controls touch panel display 130 and wireless modules 152 , 154 , 156 by executing a plurality of program instructions contained in device operation program 122 stored in memory 120 . The number of processors 110 may be one or plural.

The memory 120 of the mobile terminal 100 stores data handled by the processor 110 . The number of memories 120 may be one or plural. The memory 120 stores an equipment operation program 122 describing program instructions to be executed by the processor 110, equipment layout data 124, and a position determination flag Ft.

The device operation program 122 in the memory 120 is a computer program for operating the plurality of devices 20 arranged in the facility 800 based on the operation input of the operator of the mobile terminal 100 . The device placement data 124 in the memory 120 is data that associates each of the plurality of devices 20 with each area 810 within the facility 800 .

A position determination flag Ft in the memory 120 is a flag for selecting a method for estimating the position of the mobile terminal 100 within the facility 800 . The method selected when the value of the position determination flag Ft is “0” is the method of estimating the position of the mobile terminal 100 based on the position information from the RFID tag 60 . The method selected when the position determination flag Ft is “1” is a method of estimating the position of the mobile terminal 100 based on the position information from the beacon device 50 .

When the position determination flag Ft is “0”, the mobile terminal 100 receives RFID identification information from the RFID tag 60 as position information for estimating the position of the mobile terminal 100 . Further, when the position determination flag Ft is the value “0”, the mobile terminal 100 keeps recording the radio wave reception state of the BLE identification information, which is the position information received from the beacon device 50 . Then, in response to receiving the RFID identification information, the mobile terminal 100 generates BLE reception record information that records the radio wave reception state of the BLE identification information for a predetermined period (for example, 3 seconds) before receiving the RFID identification information. . The mobile terminal 100 then transmits RFID identification information and BLE reception record information to the device control server 200 . The RFID identification information transmitted to the device control server 200 is used for estimating the location of the mobile terminal 100 . Also, the BLE reception record information transmitted to the device control server 200 is used for machine learning for estimating the position of the mobile terminal 100 based on the position information from the beacon device 50 .

When the position determination flag Ft is "1", the mobile terminal 100 receives BLE reception state information indicating the radio wave reception state of the BLE identification information from the beacon device 50 as position information for estimating the position of the mobile terminal 100. Send to the device control server 200 . The BLE reception state information transmitted to the device control server 200 is used for estimating the location of the mobile terminal 100 .

The wireless module 152 of the mobile terminal 100 is an electronic component configured to communicate with the device control server 200 via the wireless LAN constructed by the access point 70 . The wireless module 152 integrally includes a wireless chip, peripheral circuits, a controller, and software. Wireless communication by the wireless module 152 complies with wireless LAN standards that allow connection with the access point 70 .

The wireless module 154 of the mobile terminal 100 is an electronic component configured to communicate with the beacon device 50 via wireless communication. Wireless module 154 includes a wireless chip, a peripheral circuit, a controller, and software. Wireless communication by the wireless module 154 conforms to BLE, which is one of short-range wireless communication standards that enable communication with the beacon device 50 .

The wireless module 156 of the mobile terminal 100 is an electronic component configured to communicate with the RFID tag 60 via wireless communication. The wireless module 156 integrally includes a wireless chip, peripheral circuits, controller, and software. Wireless communication by the wireless module 156 conforms to NFC, which is one of short-range wireless communication standards that enable communication with the RFID tag 60 .

The touch panel display 130 of the mobile terminal 100 is an electronic component configured to be able to display an image and receive an operation input on the screen. Touch panel display 130 can display multiple graphical user interfaces 170 (GUI: Graphical User Interface) for operating each of multiple devices 20 . In the description of this specification, the code "170" is used to collectively indicate a plurality of GUIs, and a branch number is added to the code "170" to individually indicate a specific GUI among the plurality of GUIs. (eg 170-1, 170-2, 170-3).

Mobile terminal 100 receives an operation input for operating device 20 via graphical user interface 170 displayed on touch panel display 130 . Thereafter, mobile terminal 100 uses wireless module 152 to request 200 to control device 20 based on the operation input received via graphical user interface 170 .

The mobile terminal 100 uses the wireless modules 154 and 156 to receive location information from at least one location information transmitter among the plurality of beacon devices 50 and the plurality of RFID tags 60 . After that, the mobile terminal 100 receives a response from the device control server 200 after transmitting the location information to the device control server 200 . After that, device control server 200 opens graphical user interface 170 to accept operation of device 20 associated with area 810 in facility 800 estimated as the location of mobile terminal 100 based on the response from device control server 200 . It is displayed on the touch panel display 130 .

Using the wireless module 152 , the mobile terminal 100 acquires from the device control server 200 operation status information indicating the operation status of the device 20 operable with the graphical user interface 170 displayed on the touch panel display 130 . Based on the operating status information acquired from the device control server 200 , the mobile terminal 100 notifies the operating status of the device 20 through the graphical user interface 170 displayed on the touch panel display 130 .

FIG. 3 is an explanatory diagram showing an example of the graphical user interface 170 displayed on the touch panel display 130. As shown in FIG. The example of FIG. 3 is touch panel display 130 of mobile terminal 100-1 located in area 810-1 within facility 800. FIG. The devices 20 associated with the area 810-1 are the three devices 20-1a, 20-1b, 20-1c installed in the area 810-1. Graphical user interface 170 displayed on touch panel display 130 of FIG. 1b, 20-1c are limited to graphical user interfaces 170-1, 170-2, 170-3.

The graphical user interface 170-1 is a user interface for operating the device 20-1a, which is a lighting device. The graphical user interface 170-2 is a user interface for operating the device 20-1b, which is a lighting device. Each of the graphical user interfaces 170-1 and 170-2 for the lighting equipment has a location display field 171, a power icon 172, a dimming icon 173, and a dimming icon 174. FIG. The place display column 171 displays information indicating the place where the device 20 to be operated is arranged.

The power icon 172 indicates the operating state of whether the device 20 to be operated is powered on or off, and receives an operation input to power on or power off the device 20 to be operated. In the example of FIG. 3, power icon 172 of graphical user interface 170-1 indicates power off, and power icon 172 of graphical user interface 170-2 indicates power on.

The dimming icon 173 indicates, as an operating state, the degree of brightness of light set in the device 20 to be operated, which is a lighting device, and receives an operation input for adjusting the brightness of the light. In the example of FIG. 3, the dimming icon 173 of the graphical user interface 170-1 indicates the third level of brightness among four levels of brightness, and the dimming icon 173 of the graphical user interface 170-2 indicates It shows the brightness of the 4th level among the 4 levels of brightness.

The color adjustment icon 174 indicates, as an operation state, the color of light set in the device 20 to be operated, which is a lighting device, and receives an operation input for adjusting the color of the light. In the example of FIG. 3, the toning icon 174 of the graphical user interface 170-1 indicates the second color of five colors, and the toning icon 174 of the graphical user interface 170-2 indicates the five colors. 2 shows the color of the second stage among the colors of .

The graphical user interface 170-3 is a user interface for operating the device 20-1c, which is an air conditioner. The graphical user interface 170-3 for the air conditioner has a location display field 176 and an air volume adjustment icon 177. FIG. The location display field 176 displays information indicating the location where the device 20 to be operated is arranged. The air volume adjustment icon 177 indicates the air volume of the device 20 to be operated, which is an air conditioner, as an operating state, and accepts operation input for adjusting the air volume. In the example of FIG. 3, the air volume adjustment icon 177 of the graphical user interface 170-3 indicates the "medium" air volume among the four air volumes "off", "low", "medium" and "high".

FIG. 4 is an explanatory diagram showing the detailed configuration of the device control server 200. As shown in FIG. Device control server 200 includes processor 210 , memory 220 , and communication module 250 .

Processor 210 of device control server 200 controls communication module 250 by executing a plurality of program instructions contained in device control program 222 stored in memory 220 . The number of processors 210 may be one or plural.

Memory 220 of device control server 200 stores data handled by processor 210 . The number of memories 220 may be one or plural. Memory 220 stores device control program 222 , device location data 224 , position determination flag Fs, machine learning program 226 , accumulated data 227 and machine learning model 228 .

The device control program 222 in the memory 220 is a computer program for controlling the plurality of devices 20 arranged in the facility 800 based on the operation from the mobile terminal 100. FIG. The device placement data 224 in the memory 220 includes data that associates the RFID identification information of the plurality of RFID tags 60 with each area 810 within the facility 800, and data that associates each of the plurality of devices 20 with each area 810 within the facility 800. including. The equipment arrangement data 224 is appropriately updated by the administrator of the equipment management system 10 via the management terminal 400 . The device placement data 124 of the mobile terminal 100 is updated based on the device placement data 224 of the device control server 200 .

The position determination flag Fs of the memory 220 is a flag for selecting a method of estimating the position of the mobile terminal 100 within the facility 800 . The method selected when the value of the position determination flag Ft is “0” is the method of estimating the position of the mobile terminal 100 based on the position information from the RFID tag 60 . The method selected when the position determination flag Ft is “1” is a method of estimating the position of the mobile terminal 100 based on the position information from the beacon device 50 . The location determination flag Ft of the mobile terminal 100 is set to the same value as the location determination flag Fs of the device control server 200 .

A machine learning program 226 in the memory 220 is a computer program for constructing a machine learning model 228 by machine learning using accumulated data 227 . The accumulated data 227 is a database in which RFID identification information and BLE reception record information received from the mobile terminal 100 are accumulated. The machine learning model 228 is constructed by machine learning using the accumulated data 227, and is a file containing algorithms and parameters for estimating the position of the mobile terminal 100 from the radio reception state of the position information from the beacon device 50 in the mobile terminal 100. is.

The communication module 250 of the device control server 200 is an electronic component configured to be able to communicate via a wired LAN. Communication module 250 includes a communication chip, a peripheral circuit, a controller, and software. The device control server 200 is configured to be able to communicate with the mobile terminal 100 via the access point 70 using the communication module 250 . The device control server 200 is configured to be able to communicate with the facility control device 300 using the communication module 250 .

The device control server 200 uses the communication module 250 to accept a control request for the device 20 from the mobile terminal 100 . The device control server 200 instructs the facility control device 300 to control the device 20 based on the control request from the mobile terminal 100 .

The equipment control server 200 uses the communication module 250 to acquire operation status information indicating the operation status of the equipment 20 from the equipment control device 300 . The device control server 200 transmits the operation status information acquired from the facility control device 300 to the mobile terminal 100 .

FIG. 5 is a flowchart showing GUI display processing executed by the mobile terminal 100. As shown in FIG. The GUI display processing of FIG. 5 is processing for displaying the graphical user interface 170 on the touch panel display 130 . As the processor 110 executes the program instructions of the device operation program 122, the mobile terminal 100 repeatedly executes the GUI display process of FIG. 5 at predetermined timings.

After starting the GUI display process of FIG. 5, the mobile terminal 100 determines whether the value of the position determination flag Ft stored in the memory 120 is "0" (step S111). If the value of the position determination flag Ft is "0" (step S111: "YES"), the mobile terminal 100 determines whether or not it has received RFID identification information as position information from the RFID tag 60 (step S112). . In this embodiment, the mobile terminal 100 receives RFID identification information from the RFID tag 60 based on an operation by the operator of the mobile terminal 100 . In another embodiment, mobile terminal 100 receives RFID identification information from RFID tag 60 regardless of whether or not the operator of mobile terminal 100 operates when mobile terminal 100 is within a range where mobile terminal 100 can communicate with RFID tag 60. may be received. If the RFID identification information has not been received (step S112: "NO"), the mobile terminal 100 terminates the GUI display processing of FIG.

When the RFID identification information is received (step S112: "YES"), the mobile terminal 100 generates BLE reception record information recorded when the RFID identification information is received (step S114). In response to the reception of the RFID identification information, the mobile terminal 100 determines the radio wave reception state of the BLE identification information (for example, received radio wave intensity and radio wave arrival direction) for a predetermined period (for example, 3 seconds) before receiving the RFID identification information. ) to generate BLE reception record information. The BLE reception record information includes data indicating radio wave reception states from one or more beacon devices 50 .

After generating the BLE reception record information (step S114), the mobile terminal 100 transmits the RFID identification information received from the RFID tag 60 and the BLE reception record information recording the radio wave reception state from the beacon device 50 to the wireless module 152. to the device control server 200 (step S115).

After transmitting the BLE reception record information to the device control server 200 (step S115), the mobile terminal 100 moves to an area 810 in the facility 800 estimated as the location of the mobile terminal 100 based on the response from the device control server 200. The graphical user interface 170 for accepting the operation of the associated device 20 is displayed on the touch panel display 130 (step S128). After that, the mobile terminal 100 ends the GUI display processing of FIG.

In this embodiment, the mobile terminal 100 receives, as a response from the device control server 200, information indicating an area 810 within the facility 800 estimated as the position of the mobile terminal 100. FIG. Then, mobile terminal 100 displays on touch panel display 130 graphical user interface 170 that accepts operation of device 20 associated with area 810 by referring to device layout data 124 . In another embodiment, the mobile terminal 100 may receive, as a response from the device control server 200, information indicating the device 20 associated with the area 810 within the facility 800 estimated as the location of the mobile terminal 100. . Then, the mobile terminal 100 may display the graphical user interface 170 for receiving the operation of the device 20 on the touch panel display 130 .

When the value of the position determination flag Ft is "1" (step S111: "NO"), the mobile terminal 100 determines the radio wave reception state of the BLE identification information, which is the position information received from the beacon device 50 (for example, the received radio wave BLE reception state information indicating strength, direction of arrival of radio waves, etc.) is generated (step S116). The BLE reception state information includes data indicating radio wave reception states from one or more beacon devices 50 .

After generating the BLE reception state information (step S116), the mobile terminal 100 transmits the BLE reception state information to the device control server 200 using the wireless module 152 (step S117). After that, based on the response from the device control server 200, the mobile terminal 100 opens the graphical user interface 170 that accepts the operation of the device 20 associated with the area 810 in the facility 800 estimated as the location of the mobile terminal 100. It is displayed on the touch panel display 130 (step S128). After that, the mobile terminal 100 ends the GUI display processing of FIG.

FIG. 6 is a flowchart showing GUI display processing executed by the device control server 200. As shown in FIG. The GUI display processing of FIG. 6 is processing for displaying the graphical user interface 170 on the touch panel display 130 of the mobile terminal 100. FIG. The device control server 200 repeatedly executes the GUI display process of FIG. 6 at a predetermined timing by executing the program instructions of the device control program 222 by the processor 210 .

After starting the GUI display process of FIG. 6, the device control server 200 determines whether or not RFID identification information or BLE reception status information has been received as location information from the mobile terminal 100 (step S211). If location information has not been received from the mobile terminal 100 (step S211: "NO"), the device control server 200 terminates the GUI display processing of FIG.

If position information has been received from the mobile terminal 100 (step S211: "YES"), the device control server 200 determines whether the value of the position determination flag Fs stored in the memory 220 is "0". (Step S212).

If the value of the position determination flag Fs is "0" (step S212: "YES"), the device control server 200 stores the combination of the RFID identification information and the BLE reception record information received from the mobile terminal 100 as the accumulated data 227. Store in memory 220 (step S214).

After accumulating the RFID identification information and the BLE reception record information (step S214), the device control server 200 identifies an area 810 within the facility 800 estimated as the location of the mobile terminal 100 based on the RFID identification information (step S215). ). Device control server 200 identifies area 810 within facility 800 associated with the RFID identification information received from mobile terminal 100 as the location of mobile terminal 100 by referring to device location data 224 .

After identifying the area 810 within the facility 800 based on the RFID identification information (step S215), the device control server 200 displays the graphical user interface 170 corresponding to the area 810 within the facility 800 identified based on the location information. A response to be displayed on the terminal 100 is transmitted to the mobile terminal 100 (step S218). After that, the device control server 200 terminates the GUI display processing of FIG.

In this embodiment, the device control server 200 transmits to the mobile terminal 100 as a response information indicating an area 810 within the facility 800 estimated as the location of the mobile terminal 100 . In another embodiment, the device control server 200 may transmit to the mobile terminal 100 information indicating the device 20 associated with the area 810 in the facility 800 estimated as the location of the mobile terminal 100 as a response. .

If the value of the position determination flag Fs is "1" (step S212: "NO"), the device control server 200 determines the machine stored in the memory 220 based on the BLE reception state information received from the mobile terminal 100. Using the learning model 228, an area 810 within the facility 800 that is estimated to be the location of the mobile terminal 100 is identified (step S216).

After identifying the area 810 within the facility 800 based on the BLE reception status information (step S216), the device control server 200 displays the graphical user interface 170 corresponding to the area 810 within the facility 800 identified based on the position information. A response to be displayed on the mobile terminal 100 is transmitted to the mobile terminal 100 (step S218). After that, the device control server 200 terminates the GUI display processing of FIG.

FIG. 7 is a flow chart showing machine learning processing executed by the device control server 200 . The machine learning process in FIG. 7 is a process for constructing a machine learning model 228 based on the accumulated data 227. FIG. By executing the program instructions of the machine learning program 226 by the processor 210, the device control server 200 repeatedly executes the machine learning process of FIG. 7 at a predetermined timing. In this embodiment, the device control server 200 waits for a predetermined period of time (for example, one week) from the previous execution when the data amount of the accumulated data 227 exceeds a threshold, when there is an instruction from the management terminal 400, or when the device control server 200 If exceeded, the machine learning process of FIG. 7 is started.

After starting the machine learning process of FIG. 7, the device control server 200 determines whether the value of the position determination flag Fs stored in the memory 220 is "0" (step S222). If the value of the position determination flag Fs is "1" (step S222: "NO"), the device control server 200 terminates the machine learning process of FIG.

If the value of position determination flag Fs is "0" (step S222: "YES"), device control server 200 uses accumulated data 227 in which RFID identification information and BLE reception record information received from mobile terminal 100 are accumulated. A machine learning model 228 for estimating the position of the mobile terminal 100 from the radio wave reception state of the beacon device 50 in the mobile terminal 100 is constructed by machine learning. In this embodiment, the machine learning model 228 includes parameters for deriving the relationship between combinations of received radio field strengths and radio wave arrival directions from the plurality of beacon devices 50 and each area 810 within the facility 800 . After completing the machine learning (step S224), the device control server 200 ends the machine learning process of FIG.

FIG. 8 is a flow chart showing position determination change processing executed by the device control server 200 . The position determination change processing of FIG. 8 is processing for changing the method of determining the position of the mobile terminal 100 . By executing the program instructions of the device control program 222 by the processor 210, the device control server 200 repeatedly executes the position determination change processing of FIG. 8 at a predetermined timing.

After starting the position determination change process of FIG. 8, the device control server 200 determines whether or not a change instruction for changing the method of determining the position of the mobile terminal 100 has been received from the management terminal 400 (step S232). If no change instruction has been received from the management terminal 400 (step S232: "NO"), the device control server 200 terminates the position determination change process of FIG.

If a change instruction has been received from the management terminal 400 (step S232: “YES”), the device control server 200, in response to the change instruction from the management terminal 400, changes the value of the position determination flag Ft of the mobile terminal 100 and the device control The value of the position determination flag Fs of the server 200 is updated (step S234). When an instruction to change to the method using the RFID tag 60 is received from the management terminal 400, the device control server 200 sets the value of the position determination flag Fs stored in the memory 220 of the device control server 200 to "0". At the same time, the mobile terminal 100 is instructed to set the value of the position determination flag Ft stored in the memory 120 of the mobile terminal 100 to "0". When an instruction to change to the method using the beacon device 50 is received from the management terminal 400, the device control server 200 sets the value of the position determination flag Fs stored in the memory 220 of the device control server 200 to "1". At the same time, the mobile terminal 100 is instructed to set the value of the position determination flag Ft stored in the memory 120 of the mobile terminal 100 to "1". After updating the position determination flags Fs and Ft (step S234), the device control server 200 ends the position determination change process of FIG.

According to the embodiment described above, the machine learning model 228 for estimating the position of the mobile terminal 100 using the beacon device 50 while performing the operation of estimating the position of the mobile terminal 100 using the RFID tag 60. to improve the accuracy with which the machine learning model 228 estimates the location of the mobile terminal 100 . When the position of the mobile terminal 100 is estimated using the beacon device 50, the machine learning model 228 is used to operate the device 80 regardless of the position of the mobile terminal 100. Displaying the graphical user interface 170 on the mobile terminal 100 can be suppressed.

The technology disclosed in this specification is not limited to the above-described embodiments, examples, and modifications, and can be implemented in various configurations without departing from the gist thereof. For example, among the technical features in the above-described embodiments, examples, and modifications, those corresponding to the technical features in each form described in the summary column of the invention solve some or all of the above-described problems. , or to achieve some or all of the above effects, they can be replaced and combined as appropriate. Moreover, technical features that are not described as essential in this specification can be deleted as appropriate.

In the above-described embodiment, the operation of the mobile terminal 100 is switched by updating the value of the position determination flag Ft, but in another embodiment, the operation of the mobile terminal 100 is switched by updating the device operation program 122. good too.

In the above-described embodiment, the operation of the device control server 200 is switched by updating the value of the position determination flag Fs. You can switch.

DESCRIPTION OF SYMBOLS 10... Equipment management system 20... Equipment 50... Beacon device 60... RFID tag 70... Access point 80... Equipment 100... Mobile terminal 110... Processor 120... Memory 122... Equipment operation program 124... Equipment arrangement data 130... Touch panel display 152... Wireless Module 154... Wireless module 156... Wireless module 170... Graphical user interface 171... Location display field 172... Power supply icon 173... Dimming icon 174... Toning icon 176... Location display field 177... Air volume adjustment icon 200... Equipment control server 210... Processor 220 Memory 222 Equipment control program 224 Equipment arrangement data 226 Machine learning program 227 Accumulated data 228 Machine learning model 250 Communication module 300 Equipment control device 400 Management terminal 800 Facility 810 Area

Claims (4)

A device that is configured to be able to control a plurality of devices placed within a facility based on an operation from a mobile terminal, and that is associated with an area within the facility that is presumed to be the location of the mobile terminal among the plurality of devices. A device control server that receives the operation of from the mobile terminal,
a communication module configured to communicate with the mobile terminal;
a processor;
and a memory storing program instructions, wherein execution of the program instructions by the processor causes:
using the communication module from the mobile terminal, the first location information received by the mobile terminal from a first location information transmitting device arranged in the facility via wireless communication complying with a first communication standard; and receive
Identifying an area within the facility that is presumed to be the location of the mobile terminal based on the first location information received from the mobile terminal;
causing the mobile terminal to display, using the communication module, a graphical user interface that accepts operation of a device among the plurality of devices that is associated with an area within the facility identified based on the first location information; ,
When the mobile terminal receives the first location information, it complies with a second communication standard having a longer communicable distance than the first communication standard from a second location information transmitting device placed in the facility. receiving from the mobile terminal, using the communication module, reception record information that records the radio wave reception state of the second location information received via wireless communication;
A machine learning model for estimating the location of the mobile terminal from the radio wave reception state of the second location information in the mobile terminal by machine learning using the first location information and the reception record information received from the mobile terminal. A device control server that builds 2. The device control server of claim 1, wherein execution of said program instructions by said processor causes:
A radio wave reception state of the second location information received by the mobile terminal from the second location information transmitting device via wireless communication complying with the second communication standard without receiving the first location information. from the mobile terminal using the communication module,
using the machine learning model to identify an area within the facility that is estimated to be the location of the mobile terminal based on the reception status information received from the mobile terminal;
using the communication module to display, on the mobile terminal, a graphical user interface that accepts operation of a device associated with an area within the facility identified based on the reception state information among the plurality of devices. control server. The device control server according to claim 1,
The first location information transmitting device is an RFID tag,
The device control server, wherein the second location information transmission device is a BLE beacon device. 4. The device according to any one of claims 1 to 3, wherein the plurality of devices include at least one of lighting equipment, air conditioning equipment, electric shades, floor heating, audio equipment, video equipment, electric doors and electric locks. Equipment control server described.

Images