JP5644635B2 - Information distribution apparatus and information distribution method - Google Patents

Description

  The present invention relates to a technique for distributing information of each device connected to a network.

  Patent Document 1 discloses a data input / output processing system that can facilitate a user's setting operation.

  In this data input / output processing system, each unit of the multifunction printer is attached with a QR code (registered trademark) by a sticker or the like. When the user captures a QR code attached to a desired unit using the camera function of the mobile terminal, the mobile terminal transmits the QR code to the data input / output server. When the data input / output server receives the QR code from the portable terminal, the data input / output server transmits an instruction to display the operation screen of the unit linked to the QR code to the multifunction printer. In response to this, the multi-function printer displays the operation screen of the unit linked to the QR code on its operation panel, and accepts an operation on this unit from the user. For this reason, the user can operate the unit by displaying the operation screen of the unit on the operation panel of the multifunction printer only by photographing the QR code attached to the unit to be operated with the portable terminal.

JP 2007-108947 A

  However, the technique described in Patent Document 1 displays an operation screen of a unit linked to a QR code on the operation panel of the target device and accepts an operation from the user. Not considering the case where there is no place.

  A technique for accessing a device using a mobile terminal and performing maintenance / operation of the device is known. However, with this technology, it is necessary to register device address information (for example, an IP address) and a device-specific maintenance / operation program in advance in the mobile terminal, and a plurality of devices are subject to maintenance / operation. The convenience of is bad.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a technique capable of performing maintenance / operation of a device from a portable terminal without knowing access information of the device. is there.

  In order to solve the above problems, in the present invention, each device having a network connection function is provided with a code symbol such as a QR code (printing, pasting, displaying, etc.). The information distribution apparatus is connected to these devices via a network, and acquires information about the devices from these devices regularly or irregularly.

  Further, when accessed from a mobile terminal with a camera function, the information distribution apparatus transmits shooting operation screen data into which a shooting program using the camera function is plugged in to the mobile terminal with a camera function. In response, the mobile terminal with a camera function displays a shooting operation screen on the display unit, and receives a shooting operation from the user by the shooting program. And if a user image | photographs a desired apparatus so that the code symbol provided to this apparatus may be included, imaging data will be transmitted to an information delivery apparatus.

  When the image distribution data is received from the mobile terminal with the camera function, the information distribution device performs an image recognition process on the image capture data, detects a code symbol from the image capture data, and specifies a device associated with the code symbol. To do. A setting operation screen data including an information window on which information related to the device is displayed and an operation program for the device is plugged in is generated, and the setting operation screen data is transmitted to the mobile terminal with a camera function.

  In response to this, the mobile terminal with a camera function displays a setting operation screen on the display unit, and accepts an apparatus setting operation from the user by the operation program. When a setting operation is received from the user, the operation data is transmitted to the information distribution apparatus.

  When the operation data is received from the mobile terminal with the camera function, the information distribution apparatus transmits a setting instruction corresponding to the operation data to the maintenance / operation target device. In response, the maintenance / operation target device performs the setting process according to the setting instruction received from the information distribution apparatus.

For example, the present invention is an information distribution apparatus that distributes information related to a device to a mobile terminal with a camera function using a code symbol given to the device,
Information acquisition means for acquiring information related to the device from the plurality of devices;
Information storage means for storing information about the device acquired from the device by the information acquisition means for each device;
Program storage means for storing, for each device, an operation program for receiving a setting operation of the device from the mobile terminal with the camera function;
In response to a request from the mobile terminal with the camera function, a shooting program for acquiring the imaging data of the device captured using the camera function of the mobile terminal with the camera function from the mobile terminal with the camera function is plugged Shooting operation screen data transmitting means for transmitting the shooting operation screen data entered to the mobile terminal with the camera function;
Code symbol detection means for performing image recognition processing on the imaging data received from the camera-equipped mobile terminal and detecting the code symbol from the imaging data;
An information window displaying information related to the device stored in the information storage unit in association with a device linked to the code symbol detected by the code symbol detection unit; Setting operation screen data generating means for generating setting operation screen data in which the operation program stored in the program storage means in association with the associated device is plugged in;
Setting operation screen data transmitting means for transmitting the setting operation screen data generated by the setting operation screen data generating means to the mobile terminal with camera function;
Setting instruction transmission means for transmitting a setting instruction according to operation data received from the mobile terminal with camera function to the device linked to the code symbol;
When the operation data received from the mobile terminal with camera function is related to a playback operation of media data, the media data is received from the mobile terminal with camera function, and the device specified by the operation data is received. And media relay means for transmitting the media data .
Alternatively, the present invention is an information distribution device that distributes information related to a device to a mobile terminal with a camera function using a code symbol given to the device,
Information acquisition means for acquiring information related to the device from the plurality of devices;
Information storage means for storing information about the device acquired from the device by the information acquisition means for each device;
Program storage means for storing, for each device, an operation program for receiving a setting operation of the device from the mobile terminal with the camera function;
In response to a request from the mobile terminal with the camera function, a shooting program for acquiring the imaging data of the device captured using the camera function of the mobile terminal with the camera function from the mobile terminal with the camera function is plugged Shooting operation screen data transmitting means for transmitting the shooting operation screen data entered to the mobile terminal with the camera function;
Code symbol detection means for performing image recognition processing on the imaging data received from the camera-equipped mobile terminal and detecting the code symbol from the imaging data;
An information window displaying information about the device stored in the information storage unit in association with the device linked to the code symbol detected by the code symbol detection unit; and the code symbol Setting operation screen data generating means for generating setting operation screen data in which the operation program stored in the program storage means in association with the device associated with the device is plugged in;
Setting operation screen data transmitting means for transmitting the setting operation screen data generated by the setting operation screen data generating means to the mobile terminal with camera function;
Setting instruction transmission means for transmitting a setting instruction according to operation data received from the mobile terminal with camera function to the device linked to the code symbol;
3D model storage means for storing 3D model data of the device for each device;
The image data is subjected to image recognition processing, and the 3D model data stored in the 3D model storage unit in association with the device linked to the code symbol detected from the image data is stored. And a display position determining means for determining the display position of the information on the device on the imaging data by using the specified contour to identify the contour of the device from the imaging data,
The setting operation screen data generation means includes:
Information on the device stored in the information storage unit in association with the device associated with the code symbol detected from the imaging data is determined by the display position determination unit together with the imaging data. The information window is generated so that the information window is displayed so as to overlap the display position on the imaging data.

  According to the present invention, it is possible to perform maintenance / operation of a device from a mobile terminal with a camera function without knowing access information of the device, that is, without directly accessing the device.

FIG. 1 is a schematic diagram of a maintenance / operation system according to an embodiment of the present invention. FIG. 2 is a sequence diagram for explaining an operation example of the maintenance / operation system according to the embodiment of the present invention. FIG. 3 is a schematic functional configuration diagram of the information distribution server 1. FIG. 4 is a diagram schematically showing the registration contents of the device related information storage unit 104. FIG. 5 is a flowchart for explaining the operation of the information distribution server 1. 6A is a diagram illustrating a display example of a shooting operation screen on the mobile terminal 2 with a camera function, and FIG. 6B is a diagram illustrating a display example of the setting operation screen on the mobile terminal 2 with a camera function. is there. FIG. 7A and FIG. 7B are diagrams showing display examples of the setting operation screen in the mobile terminal 2 with a camera function.

  Embodiments of the present invention will be described below.

  FIG. 1 is a schematic diagram of a maintenance / operation system according to an embodiment of the present invention.

  As shown in the figure, the maintenance / operation system according to the present embodiment includes a network via an information distribution server 1 and a plurality of devices 3 connected to a network 4 such as a LAN or WAN, and a wireless AP (access point) 5. And a mobile terminal 2 with a camera function connected to 4. Here, the equipment 3 includes office equipment (copy machine, monitor, etc.), home appliances (air conditioner, refrigerator, etc.), lighting equipment (ceiling light, standlight, etc.), communication equipment (phone, router, hub, etc.), sensor equipment. Corresponding to thermometers, hygrometers, security sensors, etc., actuator devices (various switches, etc.), etc., each device 3 has a code symbol 6 such as a QR code in which a device ID that is identification information of the device 3 is recorded. Is granted.

  In the configuration as described above, the maintenance / operation system according to the present embodiment uses the code symbol 6 assigned to the device 3 to maintain the device 3 using the mobile terminal 2 with the camera function via the information distribution server 1.・ Realize operation.

  FIG. 2 is a sequence diagram for explaining an operation example of the maintenance / operation system according to the present embodiment. Here, the case where the maintenance / operation target device 3 is the monitor 3A is shown.

  Each of the devices 3 and 3A transmits its own device-related information including device information, operating state, setting state, and the like to the information distribution server 1 regularly or irregularly (S101). In response to this, the information distribution server 1 registers and updates the device related information in association with the transmission source devices 3 and 3A (S102).

  When the mobile terminal with camera function 2 receives an access operation to the information distribution server 1 from the user (S103), the portable terminal 2 with the camera function transmits an access request to the information distribution server 1 (S104). In response to this, the information distribution server 1 transmits the shooting operation screen data into which the shooting program using the camera function is plugged in to the mobile terminal 2 with the camera function as the access request source (S105).

  Next, the mobile terminal 2 with a camera function displays a shooting operation screen according to the shooting operation screen data received from the information distribution server 1 (S106), and the user takes a picture with a shooting program plugged into the shooting operation screen data. An operation is accepted (S107). Then, according to the user's photographing operation, the mobile terminal 2 with the camera function photographs the monitor 3A so that the code symbol 6 given to the monitor 3A is included in the imaging data (S108), and the imaging data is transmitted to the information distribution server. 1 (S109).

  Next, the information distribution server 1 performs image recognition processing on the imaging data received from the mobile terminal 2 with a camera function, detects the code symbol 6 from the imaging data (S110), and is recorded in the code symbol 6. The device related information and operation program of the monitor 3A to which the device ID is assigned are specified (S111). In addition, image recognition processing is performed on the imaging data, the outline of the monitor 3A is specified from the imaging data, and the display position of the device-related information of the monitor 3A on the imaging data is determined based on the outline (S112). Then, the information distribution server 1 includes the setting operation screen data including an information window in which the device-related information of the monitor 3A is displayed at the determined display position on the imaging data, and the operation program of the monitor 3A is plugged in. Is generated (S113). And this setting operation screen data is transmitted to the portable terminal 2 with a camera function (S114).

  Next, the mobile terminal 2 with a camera function displays a setting operation screen according to the setting operation screen data received from the information distribution server 1 (S115), and is monitored from the user by an operation program plugged into the setting operation screen data. 3A setting operation is accepted. Here, when the reproduction operation of the media data (for example, the reproduction target data of the movie file) stored in the mobile terminal 2 with the camera function is received from the user (S116), the portable terminal 2 with the camera function includes the contents of the reproduction operation. Is transmitted to the information distribution server 1 (S117).

  Next, in accordance with the operation data received from the mobile terminal 2 with a camera function, the information distribution server 1 transmits a playback instruction for media data stored in the mobile terminal 2 with a camera function to the monitor 3A (S118). Also, relay processing between the monitor 3A and the mobile terminal 2 with camera function is started (S119).

  When the monitor 3A receives a media data reproduction instruction from the information distribution server 1, the monitor 3A transmits a transmission request for the media data (data to be reproduced) designated by the reproduction instruction to the information distribution server 1 (S120). Then, the information distribution server 1 relays this transmission request to the mobile terminal 2 with a camera function (S121).

  Next, the mobile terminal 2 with the camera function transmits the media data (reproduction target data) specified by the transmission request sent from the monitor 3A via the information distribution server 1 to the information distribution server 1 (S122). . The information distribution server 1 relays this transmission request to the monitor 3A (S123). In response to this, the monitor 3A reproduces and displays the media data received from the mobile terminal 2 with the camera function via the information distribution server 1 (S124).

  Next, details of the information distribution server 1 will be described.

  The mobile terminal 2 with a camera function can use various information processing apparatuses such as a display unit, a tablet terminal having a camera function and a wireless communication function, a PDA (Personal Digital Assistant), and a mobile phone. The device 3 can use various devices having a network connection function and a remote operation function from other devices. Therefore, detailed description of the portable terminal 2 with camera function and the device 3 is omitted.

  FIG. 3 is a schematic functional configuration diagram of the information distribution server 1.

  As illustrated, the information distribution server 1 includes a network IF unit 101, a device communication unit 102, a mobile terminal communication unit 103, a device related information storage unit 104, an operation program storage unit 105, and a three-dimensional model storage unit. 106, device-related information acquisition unit 107, imaging operation screen data transmission unit 108, imaging data reception unit 109, code symbol detection unit 110, display position determination unit 111, setting operation screen data generation unit 112, A setting operation screen data transmission unit 113, an operation data reception unit 114, a setting instruction transmission unit 115, and a relay processing unit 116 are included.

  The network IF unit 101 is an interface for connecting to the network 4.

  The device communication unit 102 communicates with a plurality of devices 3 via the network IF unit 101.

  The mobile terminal communication unit 103 communicates with the mobile terminal 2 with a camera function via the network IF unit 101.

  In the device-related information storage unit 104, device-related information for each of the plurality of devices 3 is stored. FIG. 4 is a diagram schematically showing the registration contents of the device related information storage unit 104. As illustrated, the device-related information storage unit 104 stores a record 1040 for each device 3. The record 1040 includes a field 1041 in which a device ID is registered and a field 1042 in which device related information is registered. A field 1042 includes a subfield 1043 in which device information such as a model name, model name, manufacturer name, and MAC address is registered, power on / off status, operation mode, failure information, operating environment information, and device-specific functions. It has a subfield 1044 in which an operating state such as an on / off state is registered, and a subfield 1045 in which a setting state such as an IP address setting, a power on / off setting, an operation mode setting, and an on / off setting of a device-specific function is registered.

  Here, when the device 3 is configured by a plurality of units, information on the operating state and the setting state is registered in the subfields 1044 and 1045 for each unit. For example, in FIG. 4, a device 3 with a device ID “0003” is a copier that includes a main body, a paper feed tray 1, and a paper feed tray 2, and the subfields 1044 and 1045 include the main body and the paper feed tray. 1 and information on the operation state and the setting state are registered for each of the paper feed trays 2.

  The operation program storage unit 105 stores an operation program for each of the plurality of devices 3 in association with the device ID. Here, the operation program is a program for the device 3 to receive a remote operation from the mobile terminal 2 with a camera function via the information distribution server 1, and a GUI (graphical user interface) unique to the device 3 in the mobile terminal 2 with a camera function. I will provide a.

  The 3D model storage unit 106 stores 3D model data of each of the plurality of devices 3 in association with the device ID. Here, when the device 3 is configured by a plurality of units, the three-dimensional model data is configured so that the positional relationship between these units can be grasped. For example, in the case of a copying machine, it is configured to include a main body and a plurality of paper feed trays. However, in the 3D model data of the copying machine, it is understood which part of the 3D model data corresponds to these units. It is configured to be able to.

  The device-related information acquisition unit 107 associates the device-related information received from each of the plurality of devices 3 via the device communication unit 102 regularly or irregularly with the device ID of the transmission source device 3, and Registration or update registration is performed in the storage unit 104.

  In response to an access request received from the mobile terminal 2 with camera function via the mobile terminal communication unit 103, the shooting operation screen data transmission unit 108 performs a shooting operation on the mobile terminal 2 with camera function via the mobile terminal communication unit 103. Send screen data. Here, in the shooting operation screen data, a shooting program for acquiring the imaging data of the device 3 shot using the camera function from the mobile terminal 2 with the camera function is plugged in. For example, Web page data includes Used.

  The imaging data receiving unit 109 receives imaging data from the mobile terminal 2 with a camera function via the mobile terminal communication unit 103.

  The code symbol detection unit 110 performs image recognition processing on the imaging data received by the imaging data reception unit 109, detects the code symbol 6 from the imaging data, and reads the device ID recorded in the code symbol 6. .

  The display position determination unit 111 performs image recognition processing on the imaging data received by the imaging data reception unit 109, and is stored in the 3D model storage unit 106 in association with the device ID read by the code symbol detection unit 110. The contour of the device 3 to which the code symbol is assigned is specified from the imaging data using the three-dimensional model data. And the display position of the apparatus relevant information on imaging data is determined using this outline. For example, the display position of the device related information is determined in the vicinity of the contour (in the vicinity of the device 3 in the imaging data).

  The three-dimensional model data associated with the device ID read by the code symbol detection unit 110 and stored in the three-dimensional model storage unit 106 can grasp the positional relationship of each of the plurality of units constituting the device 3. In such a configuration, the display position determination unit 111 uses the contour of the device 3 identified from the imaging data and the three-dimensional model data to coordinate information of each unit constituting the device 3 on the imaging data. Is identified. Then, using the coordinate information of each unit on the imaging data, the display position on the imaging data of the part related to each unit in the device-related information is determined. For example, the display position of the device related information of the part related to the unit is determined in the vicinity of the coordinates of this unit.

  The setting operation screen data generation unit 112 includes a setting operation including an information window in which device-related information stored in the device-related information storage unit 104 is displayed in association with the device ID read by the code symbol detection unit 110. Generate screen data.

  Here, the setting operation screen data is plugged in with an operation program stored in the operation program storage unit 105 in association with the device ID read by the code symbol detection unit 110. For example, Web page data is used. Is done.

  Further, the information window is generated so that the device-related information is displayed on the display position determined by the display position determination unit 111 together with the imaging data. If the display position for each unit constituting the device 3 is determined by the display position determination unit 111, the device-related information regarding each unit is displayed together with the imaging data on the display position determined for each unit. Is generated as follows.

  The setting operation screen data transmission unit 113 transmits the setting operation screen data generated by the setting operation screen data generation unit 112 to the mobile terminal 2 with a camera function via the mobile terminal communication unit 103.

  The operation data receiving unit 114 receives operation data from the mobile terminal 2 with a camera function via the mobile terminal communication unit 103.

  The setting instruction transmission unit 115 sends a setting instruction corresponding to the operation data received by the operation data receiving unit 114 to the device 3 specified by the device ID specified by the operation data via the device communication unit 102. Send.

  The relay processing unit 116 cooperates with the mobile terminal communication unit 103 and the device communication unit 102 in a case where the operation data received by the operation data receiving unit 114 relates to a reproduction operation of media data. 2 and the maintenance / operation target device 3 are relayed.

  FIG. 5 is a flowchart for explaining the operation of the information distribution server 1.

  When the device-related information acquisition unit 107 receives device-related information with a device ID from any device 3 via the device communication unit 102 (YES in S100), the record in which the device ID is registered in the field 1041 1040 is searched from the device-related information storage unit 104. Then, the device information, the operation state, and the setting state included in the device-related information are registered or updated and registered in the subfields 1043 to 1045 of the searched record 1040 (S101). Thereafter, the process returns to S100.

  In addition, when the shooting operation screen data transmission unit 108 receives an access request from the mobile terminal 2 with camera function via the mobile terminal communication unit 103 (YES in S110), the mobile terminal with camera function via the mobile terminal communication unit 103 The above-described shooting operation screen data is transmitted to 2 (S111). In response to this, the mobile terminal 2 with the camera function displays the shooting operation screen on the display unit according to the shooting operation screen data.

  FIG. 6A is a diagram illustrating a display example of a shooting operation screen in the mobile terminal 2 with a camera function. Here, reference numeral 201 denotes a finder window for displaying imaging data of a subject photographed by the camera function of the mobile terminal 2 with a camera function. Reference numerals 202 to 204 denote operation reception buttons for receiving a shooting operation from the user. For example, the operation accepting button 202 is a button for accepting an operation for recording imaging data displayed in the finder window 201, and the operation accepting button 203 is a button for accepting an operation for canceling recording of imaging data. The operation acceptance button 204 is a button for accepting an operation for transmitting the recorded image data to the information distribution server 1.

  As described above, a shooting program is plugged in to the shooting operation screen data, and the portable terminal 2 with the camera function executes the shooting program to enable the camera function and display the shooting data in the finder window 201. To display. Further, when any of the operation reception buttons 202 to 204 is selected by the user, the process assigned to the selected operation reception buttons 202 to 204 is executed.

  Next, the imaging data receiving unit 109 receives imaging data from the mobile terminal 2 with a camera function via the mobile terminal communication unit 103 (S112). The code symbol detection unit 110 performs image recognition processing on the captured data, and detects the code symbol 6 from the captured data. Then, the device ID recorded in the code symbol 6 is read (S113). Here, if a plurality of code symbols 6 are detected from the imaging data, the device ID is read from each code symbol 6.

  If the detection of the code symbol 6 from the imaging data or the reading of the device ID from the code symbol 6 fails (NO in S114), the code symbol detection unit 110 is a portable terminal with a camera function via the portable terminal communication unit 103. The failure notification is transmitted to 2 (S115), and then the process returns to S100. On the other hand, if the detection of the code symbol 6 from the imaging data and the reading of the device ID from the code symbol 6 are successful (YES in S114), the setting operation screen data generation unit 112 is notified of this.

  In response to this, the setting operation screen data generation unit 112 reads the record 1040 in which the device ID read from the code symbol 6 is registered in the field 1041 from the device related information storage unit 104 and associates it with the device ID. The operation program stored in the operation program storage unit 105 is read (S116). In addition, the display position determination unit 111 is notified of the device ID.

  Here, when a plurality of code symbols 6 are detected by the code symbol detection unit 110 and the device ID is read from each code symbol 6, the setting operation screen data generation unit 112 records the device-related information for each device ID. 1040 and the operation program are read out. In addition, the display position determination unit 111 is notified of each device ID.

  The display position determination unit 111 performs image recognition processing on the imaging data received by the imaging data reception unit 109, and associates with the device ID notified from the setting operation screen data generation unit 112 in the 3D model storage unit 106. Using the stored three-dimensional model data, the contour of the device 3 to which the code symbol 6 is assigned is specified from the imaging data. And the display position of the apparatus relevant information on imaging data is determined using this outline (S117).

  Here, when the plurality of device IDs are notified by the setting operation screen data generation unit 112, the display position determination unit 111 determines the display position of the device related information on the imaging data for each device ID.

  Further, when the 3D model data is configured so that the positional relationship between each of the plurality of units constituting the device 3 can be grasped, the display position determination unit 111 determines the outline of the device 3 identified from the imaging data, and the 3 Using the dimensional model data, coordinate information on the imaging data is specified for each unit constituting the device 3. Then, using the coordinate information of each unit on the imaging data, the display position on the imaging data of the part related to each unit in the device-related information is determined.

  Next, the setting operation screen data generation unit 112 displays the device related information registered in the field 1042 of the record 1040 read from the device related information storage unit 104 together with the imaging data received by the imaging data reception unit 109. An information window displayed overlapping the display position on the imaging data determined by the position determination unit 111 is generated (S118).

  Here, when a plurality of code symbols 6 are detected by the code symbol detection unit 110 and the device ID is read from each code symbol 6, the setting operation screen data generation unit 112 reads the record 1040 read for each device ID. An information window is generated so that the device-related information registered in the field 1042 is displayed at the display position on the imaging data determined for each device ID by the display position determination unit 111.

  Further, when the display position of each of a plurality of units constituting the device 3 is determined by the display position determination unit 111, the setting operation screen data generation unit 112 reads the subfield of the record 1040 read from the device related information storage unit 104. The operating state and setting state information registered in 1044 and 1045 is divided for each unit. Then, an information window is generated so that these pieces of information divided for each unit are displayed at the display position on the imaging data determined for each unit.

  Then, the setting operation screen data generation unit 112 includes the information window and generates setting operation screen data in which the operation program read from the operation program storage unit 105 is plugged in. The setting operation screen data transmission unit 113 The setting operation screen data is transmitted to the mobile terminal 2 with the camera function via the mobile terminal communication unit 103 (S119). In response to this, the mobile terminal with camera function 2 displays the setting operation screen on the display unit in accordance with the setting operation screen data.

  FIG. 6B is a diagram illustrating a first display example of the setting operation screen in the mobile terminal 2 with a camera function. Here, reference numeral 210 denotes an information window, and reference numeral 220 denotes a GUI (operation window) provided by an operation program plugged into the setting operation screen data.

  As shown in the figure, in the information window 210, a device related information storage unit associated with the device ID recorded in the code symbol 6 on the imaging data of the device 3 (air conditioner) to which the code symbol 6 is assigned. The device-related information 211 stored in 104 is displayed superimposed on the display position determined according to the coordinate information on the imaging data of the device 3.

  The operation window 220 displays operation reception buttons 221A to 221D for receiving a setting operation for the device 3 (air conditioner) from the user. For example, the operation reception button 221A is a button for receiving a power on / off setting operation, the operation reception button 221B is a button for receiving an operation mode switching operation, and the operation reception button 221C is a room temperature setting operation. The operation accepting button 221D is a button for accepting a timer switching operation.

  FIG. 7A is a diagram illustrating a second display example of the setting operation screen in the mobile terminal 2 with the camera function. Here, the same reference numerals are assigned to the same display examples as those in the first display example shown in FIG. In this example, a display example in which two devices 3 (ceiling light, standlight) are included in the imaging data is shown.

  As shown in the figure, the information window 210 displays two devices 3 (ceiling light, standlight) and corresponds to the device ID recorded in the code symbol 6 assigned to each of these devices 3. Device-related information 211A and 211B to be displayed are displayed at display positions determined according to coordinate information on the imaging data of the corresponding device 3, respectively.

  Further, the operation program for each device 3 displayed in the information window 210 is plugged into the setting operation screen data, whereby the operation windows 220A and 220B of each device 3 are displayed on the setting operation screen. . The operation windows 220A and 220B also display operation reception buttons 221E and 221F for receiving a setting operation for the device 3 (ceiling light, standlight) from the user. For example, the operation reception button 221E is a button for receiving a power on / off setting operation, and the operation reception button 221F is a button for receiving an operation mode switching operation.

  FIG. 7B is a diagram illustrating a third display example of the setting operation screen in the mobile terminal 2 with the camera function. Here, the same reference numerals are given to the same components as those in the first and second display examples shown in FIGS. 6 (B) and 7 (A). In this example, a display example in the case where a device 3 (copier) configured by a plurality of units (main body, tray 1, tray 2) is included in the imaging data is shown.

  As shown in the figure, in the information window 210, device related information is stored in association with the device ID recorded in the code symbol 6 on the imaging data of the device 3 (copier) to which the code symbol 6 is assigned. The apparatus related information 211C to 211F stored in the unit 104 is displayed in an overlapping manner. Here, the device-related information 211C is device information and is displayed at a display position determined according to the coordinate information of the device 3. The device related information 211D to 211F is an operating state and a setting state of each unit (main body, paper feed tray 1, paper feed tray 2) constituting the device 3, and a display position determined according to the coordinate information of each unit. Is displayed.

  The operation window 220 displays operation reception buttons 221G to 221J for receiving a setting operation for the device 3 (copy machine) from the user. For example, the operation reception button 221G is a button for receiving a power on / off setting operation, the operation reception button 221H is a button for receiving an operation mode (paper feed type) switching operation, and the operation reception button 221J is The button for accepting an operation mode (printing method) switching operation.

  As described above, the setting operation screen data is plugged in with an operation program corresponding to the device ID recorded in the code symbol 6 assigned to the device 3 in the information window 210. 2 displays the operation window 220 in the setting operation screen by executing this operation program. When any of the operation reception buttons 221A to 221J is selected by the user, operation data indicating the setting contents of the selected operation reception buttons 221A to 221J is transmitted to the information distribution server 1 together with the device ID.

  Next, when the operation data receiving unit 114 receives operation data from the mobile terminal 2 with a camera function via the mobile terminal communication unit 103 (YES in S120), the setting instruction transmitting unit 115 receives the operation data from the operation data receiving unit 114. A setting instruction according to the contents of the operation data thus generated is generated. Further, the record 1040 in which the device ID specified by the operation data is registered in the field 1041 is read from the device-related information storage unit 104, and the maintenance / operation is performed from the setting state registered in the subfield 1045 of the record 1040. The IP address of the target device 3 is specified. And a setting instruction | indication is transmitted to the apparatus 3 to which this IP address was provided via the apparatus communication part 102 (S121).

  Next, when the operation data received by the operation data receiving unit 114 relates to the reproduction operation of the media data stored in the mobile terminal 2 with the camera function (YES in S122), the setting instruction transmitting unit 115 The relay processing unit 116 is notified of the address information of the mobile terminal 2 with the camera function that is the transmission source of the operation data and the address information of the device 3 that is the transmission destination of the setting instruction based on the operation data. Is instructed to start relaying. In response to this, the relay processing unit 116 cooperates with the mobile terminal communication unit 103 and the device communication unit 102 to connect the mobile terminal 2 with the camera function as the operation data transmission source and the device 3 as the setting instruction transmission destination based on the operation data. A relay path is established between the mobile terminal 2 with the camera function and the transmission of media data from the mobile terminal 2 to the device 3 (S123). Here, when the encoding method of the media data transmitted from the mobile terminal 2 with the camera function is a method that cannot be decoded on the device 3 side, the relay processing unit 116 can decode this media data on the device 3 side. It is also possible to transmit the data to the device 3 after converting it into encoded data of an appropriate system.

  When the operation data receiving unit 114 receives end operation data from the mobile terminal 2 with camera function via the mobile terminal communication unit 103 (YES in S124), the setting instruction transmission unit 115 receives the mobile terminal 2 with camera function and If a relay path is established between the devices 3, the relay processing unit 116 disconnects the relay path (S125), and then the process returns to S100. The end operation data is transmitted from the mobile terminal 2 with camera function to the information distribution server 1 when, for example, the user performs an operation of closing the setting operation screen being displayed on the mobile terminal 2 with camera function. That's fine.

  The embodiment of the present invention has been described above.

  In the maintenance / operation system according to the present embodiment, each device 3 having a network connection function is given a code symbol 6 (printing, pasting, displaying, etc.). The information distribution server 1 is connected to these devices 3 via the network 4 and acquires device-related information from these devices 3 regularly or irregularly.

  In addition, when the information distribution server 1 receives an access request from the mobile terminal 2 with a camera function, the information distribution server 1 transmits to the mobile terminal 2 with a camera function the shooting operation screen data into which a shooting program using the camera function is plugged. In response to this, the mobile terminal 2 with a camera function displays a shooting operation screen and receives a shooting operation from the user by the shooting program. When the user photographs the desired device 3 so as to include the code symbol 6 assigned to the device 3, the image data is transmitted to the information distribution server 1.

  When the information distribution server 1 receives the image data from the mobile terminal 2 with the camera function, the information distribution server 1 performs image recognition processing on the image data and detects the code symbol 6 from the image data. Then, the device 3 associated with the code symbol 6 is specified, and the setting operation screen data including the information window 210 in which the device related information of the device 3 is displayed and the operation program is plugged in is generated. Then, this setting operation screen data is transmitted to the mobile terminal 2 with the camera function. In response to this, the mobile terminal 2 with a camera function displays a setting operation screen and accepts a setting operation from the user by the operation program. Then, operation data indicating the contents of the setting operation received from the user is transmitted to the information distribution server 1.

  When receiving the operation data from the mobile terminal 2 with the camera function, the information distribution server 1 transmits a setting instruction according to the operation data to the device 3 specified by the operation data. The device 3 performs a setting process according to the setting instruction received from the information distribution server 1.

  Therefore, according to the present embodiment, the user can perform maintenance / operation of the device 3 from the portable terminal 2 with the camera function without knowing the access information of the device 3, that is, without directly accessing the device 3. Is possible.

  In the present embodiment, the information distribution server 1 performs image recognition processing on the imaging data received from the mobile terminal 2 with a camera function, and is three-dimensionally associated with the code symbol 6 detected from the imaging data. Using the model data, the contour of the device 3 is specified from the imaging data. Then, using this contour, the display position of the device-related information of the device 3 on the imaging data is determined, and the device-related information of the device 3 is superimposed on the determined display position together with the imaging data. An information window 210 is generated to be displayed.

  Therefore, according to the present embodiment, for example, even when a plurality of devices 3 are included in the imaging data, it is easy to grasp the correspondence between the device 3 and the device-related information of the device 3, and usability is improved. .

  In this embodiment, when the device 3 to be maintained / operated is composed of a plurality of units, the information distribution server 1 determines the outline of the device 3 identified from the imaging data and the three-dimensional of the device 3. Using the model data, the display position on the imaging data of the device related information regarding each unit constituting the device 3 is determined. And the information window 210 is produced | generated so that the apparatus relevant information regarding each unit which comprises this apparatus 3 may be overlaid and displayed on each display position with this imaging data.

  Therefore, according to the present embodiment, when the device 3 included in the imaging data is composed of a plurality of units, it becomes easy to grasp the correspondence between each unit and device-related information related to this unit. Usability is improved.

  In the present embodiment, the information distribution server 1 receives media data from the mobile terminal 2 with a camera function when the operation data received from the mobile terminal 2 with a camera function relates to a playback operation of the media data. Then, this media data is relayed to the device 3 designated by the operation data.

  Therefore, according to this Embodiment, it becomes possible to reproduce the media data stored in the mobile terminal 2 with a camera function on a display screen having a size larger than the display screen of the mobile terminal 2 with a camera function.

  In addition, this invention is not limited to said embodiment, Many deformation | transformation are possible within the range of the summary.

  For example, in the above-described embodiment, the information distribution server 1 uses the three-dimensional model data of the device 3 to which the code symbol 6 detected from the imaging data received from the mobile terminal 2 with the camera function is added. The contour of the device 3 is specified, and the display position of the device related information of the device 3 on the imaging data is determined using the contour. However, the present invention is not limited to this. For example, based on the coordinate information on the imaging data of the code symbol 6 detected from the imaging data, the display position (for example, the code symbol 6) of the equipment related information of the equipment 3 to which the code symbol 6 is assigned. May be determined.

  In the above embodiment, the case where the code symbol 6 such as a QR code in which the device ID is recorded is given to each device 3 has been described as an example, but the present invention is not limited to this. The code symbol given to the device 3 may be a marker that can hold the device ID. Moreover, the lighting pattern of LED used for a power lamp etc. may be sufficient, for example. By using the lighting pattern of the LED, it is possible to easily detect the device ID of the device 3 at a remote location. However, in this case, the lighting pattern of the power supply lamp of the device 3 is recognized from the captured image data of the moving image, and the device ID of the device 3 is detected.

  In the above embodiment, the functional configuration of the information distribution server 1 shown in FIG. 3 is realized by an integrated logic IC such as ASIC (Application Specific Integrated Circuit) and FPGA (Field Programmable Gate Array). It may be a thing, or may be realized by software by a computer such as a DSP (Digital Signal Processor). Alternatively, in a general-purpose computer such as a CPU (Personal Computer) equipped with an auxiliary storage device such as a CPU, memory, HDD, DVD-ROM, and a communication interface such as a NIC (Network Interface Card) and a modem, the CPU executes a predetermined program. It may be realized by loading from an auxiliary storage device onto a memory and executing it.

  1: Information distribution server, 2: Mobile terminal with camera function, 3: Device, 4: Network, 5: Wireless AP, 6: Code symbol, 101: Network IF unit, 102: Device communication unit, 103: Mobile terminal communication unit 104: device-related information storage unit, 105: operation program storage unit, 106: three-dimensional model storage unit, 107: device-related information acquisition unit, 108: shooting operation screen data transmission unit, 109: imaging data reception unit, 110: Code symbol detection unit 111: Display position determination unit 112: Setting operation screen data generation unit 113: Setting operation screen data transmission unit 114: Operation data reception unit 115: Setting instruction transmission unit 116: Relay processing unit

Claims (6)

An information distribution device that distributes information about a device to a mobile terminal with a camera function using a code symbol assigned to the device,
Information acquisition means for acquiring information related to the device from the plurality of devices;
Information storage means for storing information about the device acquired from the device by the information acquisition means for each device;
Program storage means for storing, for each device, an operation program for receiving a setting operation of the device from the mobile terminal with the camera function;
In response to a request from the mobile terminal with the camera function, a shooting program for acquiring the imaging data of the device captured using the camera function of the mobile terminal with the camera function from the mobile terminal with the camera function is plugged Shooting operation screen data transmitting means for transmitting the shooting operation screen data entered to the mobile terminal with the camera function;
Code symbol detection means for performing image recognition processing on the imaging data received from the camera-equipped mobile terminal and detecting the code symbol from the imaging data;
An information window displaying information related to the device stored in the information storage unit in association with a device linked to the code symbol detected by the code symbol detection unit; Setting operation screen data generating means for generating setting operation screen data in which the operation program stored in the program storage means in association with the associated device is plugged in;
Setting operation screen data transmitting means for transmitting the setting operation screen data generated by the setting operation screen data generating means to the mobile terminal with camera function;
Setting instruction transmission means for transmitting a setting instruction according to operation data received from the mobile terminal with camera function to the device linked to the code symbol;
When the operation data received from the mobile terminal with camera function is related to a playback operation of media data, the media data is received from the mobile terminal with camera function, and the device specified by the operation data is received. And a media relay means for transmitting the media data . An information distribution device that distributes information about a device to a mobile terminal with a camera function using a code symbol assigned to the device,
Information acquisition means for acquiring information related to the device from the plurality of devices;
Information storage means for storing information about the device acquired from the device by the information acquisition means for each device;
Program storage means for storing, for each device, an operation program for receiving a setting operation of the device from the mobile terminal with the camera function;
In response to a request from the mobile terminal with the camera function, a shooting program for acquiring the imaging data of the device captured using the camera function of the mobile terminal with the camera function from the mobile terminal with the camera function is plugged Shooting operation screen data transmitting means for transmitting the shooting operation screen data entered to the mobile terminal with the camera function;
Code symbol detection means for performing image recognition processing on the imaging data received from the camera-equipped mobile terminal and detecting the code symbol from the imaging data;
An information window displaying information related to the device stored in the information storage unit in association with a device linked to the code symbol detected by the code symbol detection unit; Setting operation screen data generating means for generating setting operation screen data in which the operation program stored in the program storage means in association with the associated device is plugged in;
Setting operation screen data transmitting means for transmitting the setting operation screen data generated by the setting operation screen data generating means to the mobile terminal with camera function;
Setting instruction transmission means for transmitting a setting instruction according to operation data received from the mobile terminal with camera function to the device linked to the code symbol;
3D model storage means for storing 3D model data of the device for each device;
The image data is subjected to image recognition processing, and the 3D model data stored in the 3D model storage unit in association with the device linked to the code symbol detected from the image data is stored. And a display position determining means for determining the display position of the information on the device on the imaging data by using the specified contour to identify the contour of the device from the imaging data,
The setting operation screen data generation means includes:
Information on the device stored in the information storage unit in association with the device associated with the code symbol detected from the imaging data is determined by the display position determination unit together with the imaging data. The information window is generated so that the information window is displayed so as to overlap the display position on the imaging data. The information distribution device according to claim 2,
The information storage means includes
For each device, as information about the device, information about each unit constituting the device is stored,
The three-dimensional model storage means includes
For each device, the 3D model data of the device composed of a plurality of units is stored,
The display position determining means includes
Using the outline of the device specified from the imaging data and the 3D model data associated with the device and stored in the 3D model storage unit, information on each unit constituting the device , Determine the display position on the imaging data,
The setting operation screen data generation means includes:
Generating the information window so that information about each unit constituting the device is displayed together with the imaging data on each display position on the imaging data determined by the display position determining means. A characteristic information distribution apparatus. The information distribution device according to claim 2 or 3 ,
When the operation data received from the mobile terminal with camera function is related to a playback operation of media data, the media data is received from the mobile terminal with camera function, and the device specified by the operation data is received. An information distribution device further comprising media relay means for transmitting the media data. An information distribution method for distributing information about the device from the information distribution device to the mobile terminal with a camera function using a code symbol given to the device,
Each of the plurality of devices transmits information about the device to the information distribution device regularly or irregularly,
In accordance with the request of the mobile terminal with the camera function, the information distribution device transmits the shooting operation screen data in which the shooting program using the camera function is plugged in to the mobile terminal with the camera function,
The mobile terminal with the camera function displays a shooting operation screen according to the shooting operation screen data received from the information distribution device, and accepts a shooting operation from the user by the shooting program plugged into the shooting operation screen data. Transmitting the imaging data of the device to be operated to the information distribution device,
The information distribution device performs image recognition processing on the imaging data received from the mobile terminal with the camera function, detects the code symbol from the imaging data, and the operation target device associated with the code symbol Specific information is generated, and setting operation screen data including an information window on which information on the device is displayed and an operation program is plugged in is transmitted to the mobile terminal with the camera function.
The mobile terminal with camera function displays a setting operation screen according to the setting operation screen data received from the information distribution device, and accepts a setting operation from the user by the operation program plugged into the setting operation screen data. Transmitting the operation data of the device to be operated to the information distribution device,
When the information distribution apparatus transmits a setting instruction according to the operation data received from the mobile terminal with a camera function to the device to be operated, and the operation data relates to a reproduction operation of media data. , Receiving the media data from the mobile terminal with the camera function, and transmitting the media data to the device specified by the operation data,
Each of the plurality of devices performs setting processing according to the setting instruction received from the information distribution apparatus, and receives and reproduces the media data from the information distribution apparatus when the setting instruction is a reproduction instruction. An information distribution method characterized by: An information distribution method for distributing information about the device from the information distribution device to the mobile terminal with a camera function using a code symbol given to the device,
  Each of the plurality of devices transmits information about the device to the information distribution device regularly or irregularly,
  In accordance with the request of the mobile terminal with the camera function, the information distribution device transmits the shooting operation screen data in which the shooting program using the camera function is plugged in to the mobile terminal with the camera function,
  The mobile terminal with the camera function displays a shooting operation screen according to the shooting operation screen data received from the information distribution device, and accepts a shooting operation from the user by the shooting program plugged into the shooting operation screen data. Transmitting the imaging data of the device to be operated to the information distribution device,
  The information distribution device performs image recognition processing on the imaging data received from the mobile terminal with the camera function, detects the code symbol from the imaging data, and the operation target device associated with the code symbol And the contour of the device is identified from the imaging data using the three-dimensional model data stored in advance associated with the device associated with the code symbol, and the identified contour is used. The display position of the information related to the device on the imaging data is determined, and the information related to the device linked to the code symbol is displayed in the determined display position on the imaging data together with the imaging data. It generates setting operation screen data that has an information window displayed in an overlapping manner and is plugged in with an operation program. Transmitted the setting operation screen data to said mobile terminal with camera function,
  The mobile terminal with camera function displays a setting operation screen according to the setting operation screen data received from the information distribution device, and accepts a setting operation from the user by the operation program plugged into the setting operation screen data. Transmitting the operation data of the device to be operated to the information distribution device,
  The information distribution device transmits a setting instruction according to the operation data received from the camera-equipped mobile terminal to the device to be operated,
  Each of the plurality of devices performs setting processing in accordance with the setting instruction received from the information distribution apparatus
  An information delivery method characterized by the above.

Images