JP2019082811A - Cooperation rule setting support system - Google Patents

Abstract

To provide a cooperation rule setting support system by means of a card unit including a first card corresponding to conditions and a second card corresponding to execution.SOLUTION: The cooperation rule setting support system according to an embodiment sets a cooperation rule in a control device for outputting a control signal to operate an external device and/or an internal application based on an operation result of the external device, an external Web service or an internal application in which the rule is based on a combination of condition clause information corresponding to the operation result and execution clause information corresponding to an output control of the control signal. The cooperation rule setting support system is provided with a card unit having a first card including first card information corresponding to the condition clause information and a second card including second card information corresponding to the execution clause information, and a cooperation rule setting device that generates a cooperation rule based on a combination of the condition clause information corresponding to the first card information and the execution clause information corresponding to the second card information in which the first card information and the second card information are read by a reading device and outputs the collaboration rule to the control device.SELECTED DRAWING: Figure 1

Description

  The embodiment of the present invention relates to a setting support technique of linkage rules configured by a trigger (condition) and its action (execution).

  Conventionally, for example, when a user sets a trigger (condition) and its action (execution), such as lighting a lighting device when playing music or notifying by voice when receiving a mail, when the set trigger is satisfied There is a web service or application that performs the corresponding predetermined action.

IFTTT Inc, "IFTTT", [search date of October 20, 2017], Internet <URL: https://ifttt.com/> Yahoo Japan Corporation, "mythings", [search date of October 20, 2017], Internet <URL: https://mythings.yahoo.co.jp/>

  Provided is a cooperation rule setting support system using a card unit including a first card corresponding to a trigger (condition) and a second card corresponding to an action (execution).

  The cooperation rule setting support system according to the embodiment operates the external device or / and the internal application based on the operation result output from the external device, the operation result provided by the external Web service, or the operation result of the internal application. A cooperation rule based on a combination of conditional clause information corresponding to the operation result and execution clause information corresponding to the output control of the control signal is set in the control device that outputs the control signal.

  The cooperation rule setting support system includes at least one first card including first card information corresponding to the conditional clause information, and at least one second card including second card information corresponding to the execution clause information. Corresponding to the conditional clause information and the second card information corresponding to the first card information read through the reading unit that reads the first card information of the card unit and the second card information of the card unit. And a cooperation rule setting device that generates a cooperation rule based on a combination with the execution clause information, and outputs the generated cooperation rule to the control device.

It is a figure for demonstrating the cooperation rule setting assistance system using IF-THEN card of 1st Embodiment. It is a figure which shows the network configuration of the cooperation rule setting assistance system of 1st Embodiment, and the functional block of each apparatus. It is a figure which shows an example of the device operation setting information of 1st Embodiment. It is a figure which shows an example of the device operation | movement definition information of 1st Embodiment, and card attribute information. It is a figure which shows the processing flow of the cooperation rule setting assistance system of 1st Embodiment. It is a figure which shows the processing flow of IF-THEN card reading process of the cooperation rule setting assistance system of 1st Embodiment, and a rule structure information generation process. It is a figure for demonstrating the arrangement | sequence direction between two or more IF cards contained in the card unit of 1st Embodiment, and mutual association between IF cards. It is a figure for demonstrating the arrangement | sequence direction between two or more THEN cards contained in the card unit of 1st Embodiment, and mutual association between THEN cards. It is a flowchart which shows the device cooperation process based on the cooperation rule of the user apparatus of 1st Embodiment. It is a flowchart which shows the cooperation process of the device based on the cooperation rule of the user apparatus of 1st Embodiment, and an application. It is a flowchart which shows the cooperation process of the external web service and device (or application) based on the cooperation rule of the user apparatus of 1st Embodiment. It is a figure which shows the network configuration of the cooperation rule setting assistance system of 2nd Embodiment, and the functional block of each apparatus. It is a figure which shows the processing flow of the cooperation rule setting assistance system of 2nd Embodiment. It is a figure which shows the network configuration of the cooperation rule setting assistance system of 3rd Embodiment, and the functional block of each apparatus. It is a figure which shows the processing flow of the cooperation rule setting assistance system of 3rd Embodiment.

  Embodiments will be described below with reference to the drawings.

First Embodiment
1 to 11 are diagrams showing a first embodiment. The cooperation rule setting support system of the present embodiment supports setting of a cooperation rule including a conditional clause such as IF-THEN and an execution clause, for example. Hereinafter, although the IF-THEN type cooperation rule (IF-THEN rule) will be described as an example, the present invention is not limited to this. For example, it is a cooperation rule including a conditional clause and an execution clause such as a CASE type or DICISION_TABLE type. Just do it.

  When setting an IF-THEN rule configured of a trigger (condition) and its action (execution) as in Non-Patent Document 1 described above, it has to be set in the GUI. That is, since it is necessary to search IF (conditions) and THEN (execution) on the predetermined rule setting screen and to search for them from the list, it takes labor and effort to create a rule. .

  In addition, it is necessary to consider the rules and then perform input on the rule setting screen (GUI) in a scene where many IF-THEN rules are desirable and ideas for creating rules are conceived and tried. It took time and effort to confirm the validity of the idea that was conceived on the spot.

  The cooperation rule setting support system of the present embodiment does not perform setting of the IF-THEN rule with the GUI, but generates an event as a trigger or a processing result (operation result) of the generated event as an IF card The user uses the IF card and the THEN card (corresponding to a second card) in which predetermined operation control and processing control of the external device and the internal application are described as an action for the trigger. The card unit arbitrarily combined with the physical medium of the card is read by the reading device, and is set in an apparatus (corresponding to a control device) that executes the IF-THEN rule.

  That is, the cooperation rule setting support system according to the present embodiment is a cooperation rule based on a combination of conditional clause information as a trigger and execution clause information corresponding to output control of a control signal to an external device or internal application as an action to the trigger. Are created by physically combining card media, and can be set as an apparatus that executes the IF-THEN rule.

  By this configuration, it is possible to support creation of a more suitable cooperation rule, since it does not take time and effort to search for a trigger (IF) and its action (THEN).

  Also, the user can think of any IF-THEN rule desired simply by simply reading the IF-THEN card with a reader, thinking about any combination of physical IF-THEN cards. For this reason, the effort, effort, and time which reflect the idea of a rule creation on execution environment can be reduced.

  The collaboration rule setting support system of this embodiment, for example, spreads a large number of IF cards and THEN cards on a desk at one time, and examines a large number of various rule elements that are difficult in a GUI with screen constraints while viewing simultaneously. This makes it easy to create combinations of IF-THEN rules. And since the IF-THEN rules created by the physical card selection can be reflected to the equipment that executes the IF-THEN rules quickly without effort, providing a useful environment to search for effective IF-THEN rules can do.

  FIG. 1 is a diagram for explaining a cooperation rule setting support system using an IF-THEN card. The IF card C1 includes conditional clause information C11, an image diagram C12 of the external device 500 as a trigger, a type C13 of the external device 500, a name C14 of the external device 500, and a communication method between the external device 500 and the device executing the IF-THEN rule. Communication standard C15 such as a protocol or the like, description C16 of the external device 500 and the condition clause information, control parameters C17a to C17c of the external device 500, and code information C18 obtained by encoding card attribute information with a bar code or QR code. The code information C18 may be information encoded using digital watermark technology or near field communication technology (NFC: Near Field Communication) in addition to the barcode and the QR code (registered trademark).

  Similarly, the THEN card C2 executes the execution clause information C21, an image diagram C22 of the external device 500 for executing the action on the trigger, a type C23 of the external device 500, a name C24 of the external device 500, and the IF-THEN rule with the external device 500. Communication standard C25 such as communication method and protocol with the device, description C26 of external device 500 and execution section information, control parameters C27a and C27b of external device 500, code which codes card attribute information by bar code or QR code etc. It contains information C28. The code information C28 may be information encoded using digital watermark technology or near field communication technology (NFC: Near Field Communication), in addition to the bar code and the QR code (registered trademark).

  The user device 100 includes an imaging device such as a camera having an imaging device such as a CCD or a CMOS, and a reading device such as a code reader of a laser light system, and can read the code information C18 and C28. The user reads, with the user device 100, a card unit in which at least one IF card and at least one THEN card are set. At this time, it is possible to read the IF card and the THEN card together or read one card in a stepwise manner and then read the other card. That is, the combination of the IF-THEN card may be read as a card unit as a set.

  The user device 100 of the present embodiment is configured as a device (corresponding to a control device) that executes the IF-THEN rule, and creates, through the management device 300, a cooperation rule based on the IF-THEN card read by the user device 100. Then, the collaboration rule created from the management device 300 to the user device 100 is distributed.

  The user device 100 cooperates with the management device 300 to check the condition clauses and execution clauses of the IF-THEN card read on the rule editor screen, or to control parameters of each external device 500 of the condition clauses and execution clauses. Provide users with the ability to change and update. A cooperation rule based on a combination of IF-THEN cards determined through the rule editor screen is registered in the management device 300 and distributed from the management device 300 to the user device 100, whereby the cooperation rule is set in the user device 100. .

  FIG. 2 is a diagram showing a network configuration of the cooperation rule setting support system of the present embodiment and functional blocks of each device.

  The user device 100 includes, for example, a portable (mobile) information terminal having a data communication function and an arithmetic function (CPU etc.) such as a multifunctional mobile phone and a PDA (Personal Digital Assistant), a notebook computer, a tablet computer and the like. . Further, as described above, the photographing device 160 such as a camera is provided as an example of the reading device.

  The external device 500 is a sensor device such as a temperature sensor, a humidity sensor or an acceleration sensor, a lighting device including a light emitting element such as an LED lamp, and an input device including an input unit such as an operation button. The external device 500 also includes one device in which the sensor device and the LED lamp are combined, and one device in which the input device and the LED lamp are combined.

  Such an external device 500 is a device physically separated from the user device 100, and can communicate (connect) with the user device 100 by near-field wireless communication such as Bluetooth or wireless communication such as Wi-Fi. it can. Also, the external device 500 can be directly connected to the user device 100 by a USB connector provided in the device, or can be connected to the user device 100 by wire using a USB cable. In addition, the external device 500 may be incorporated in the user apparatus 100. That is, in some cases, an acceleration sensor, a light amount sensor or the like of the multifunctional mobile phone may be used as an input device, and a speaker of the multifunctional mobile phone may be used as an output device.

  When the external device 500 is a sensor device, sensor detection information is output to the user device 100. Also, in the case of an input device, operation information (for example, a signal indicating that the operation button has been pressed) to the input unit is output to the user device 100. When the external device 500 is a lighting device, a control signal is input from the user device 100, and can be lit or blinked with a predetermined color light based on the control signal.

  On the other hand, when the external device 500 is one device in which the sensor device and the LED lamp are combined, the external device 500 itself can perform an operation such as lighting the LED lamp based on the sensor detection information. Similarly, in the case of one device in which the input device and the LED lamp are combined, the external device 500 itself can perform an operation such as lighting the LED lamp based on the operation result with respect to the input unit.

  Furthermore, the external device 500 can include drive devices such as a robot and a radio controlled car. A driving device such as a robot can receive a control signal output from the user device 100, and can shake arms, walk, run, or output voice. A driving device such as a robot may include the above-described sensor device, lighting device, input device, and the like.

  The user device 100 includes a communication unit 110, a control unit 120, a cooperative connection management unit 130, a storage unit 140, an input / output unit 150, an imaging device 160, and a connection I / F 170. The control unit 120 (CPU) is responsible for control of the entire user device 100.

  The cooperative connection management unit 130 manages the connection between each external device 500 and the user device 100. The connection connection management unit 130 includes an adapter (Ad) for each of the plurality of external devices 500, and has a relay function of connecting the external device 500 and the control unit 120 to exchange data and control signals and perform mutual conversion. The adapter (Ad) has a one-to-one or N-to-one connection relationship with the external device 500, and waits for input of data output from the external device 500, or periodically collects data from the external device 500, The collected data is passed to the control unit 120. Furthermore, the adapter (Ad) compares data collected from the external device 500 with data collected in the past, and indicates that an event indicating that the value has changed, or that the collected data has exceeded a threshold value. An event or the like is generated and passed to the control unit 120. Also, the adapter (Ad) can be installed in advance in the user device 100 or can be downloaded and installed from the management device 300 or a predetermined server as needed.

  The cooperative connection management unit 130 also includes an adapter (Ad1) for connecting to the external service system 400. The external service system 400 is, for example, a cloud service system that performs speech recognition and speech synthesis. The cooperative connection management unit 130 is connected to the connection I / F 170. The connection I / F is, for example, a wired connection port such as USB.

  The communication unit 110 performs wireless / wired communication control with the management apparatus 300 via an IP network such as the Internet. The communication unit 110 also functions as a communication interface with the external device 500. That is, the communication unit 110 includes communication devices for short distance wireless communication and wireless communication, and performs communication control with the outside such as the management device 300, the external service system 400, and the external device 500.

  The input / output unit 150 includes a display unit such as a display device, an input operation button or a touch panel, an input unit such as a microphone, and an output unit such as a speaker.

  The control unit 120 includes a first control unit 121 and a second control unit 122. The first control unit 121 includes an IF-THEN card information reading unit 121A and a rule creation control unit 121B. The IF-THEN card information reading unit 121A is connected to the photographing device 160, reads the respective pieces of code information C18 and C28 of the IF card and the THEN card photographed by the photographing device 160, and extracts card attribute information. Each card attribute information extracted from the code information C18 and C28 is output to the rule creation control unit 121B. The rule creation control unit 121 B generates a combination of pieces of card attribute information extracted from the IF-THEN card unit as rule configuration information, and transmits the combination to the management apparatus 300. The rule creation control unit 121B causes the user device 100 to display the rule editor screen provided from the management device 300, controls the operation input to the rule editor screen, and supports the IF-THEN card unit read by the photographing device 160. Control registration of collaboration rules.

  The imaging device 160 and the first control unit 121 of the present embodiment provide a cooperation rule registration function based on the IF-THEN card in cooperation with the management device 300.

  Next, the second control unit 122 includes a rule management unit 122A, a rule control unit 122B, and an application control unit 122C. The second control unit 122 provides the function of executing the IF-THEN rule together with the cooperative connection management unit 130, receives the operation result output from the external device 500, and transmits the control signal based on the IF-THEN rule to the external device 500. Functions as a cooperative control device that outputs

  The rule management unit 122A uploads the device setup information of the user device 100 to the management device 300, and receives (or downloads) a cooperation rule from the management device 300. The rule control unit 122B controls the external device 500, controls the application via the application control unit 122C, and controls the input / output unit 150 in accordance with the cooperation rules stored in the storage unit 140. The application control unit 122C controls various kinds of software (for example, a mail function) installed in advance in the user device 100 and functions provided by connecting with the external service system 400.

  Next, the management device 300 will be described. As shown in FIG. 2, the management device 300 is configured to include a communication device 310, a control device 320 and a storage device 330.

  The device registration unit 321 performs registration processing of the external device 500. The registration of the external device 500 can be performed, for example, by a business operator (device registrant) or the like who provides the external device 500 by connecting to the management device 300 via the Internet or the like by a computer device.

  The rule setting unit 322 transmits a cooperation rule setting screen to the user device 100, and performs registration control and update control of cooperation rules based on the IF-THEN card through the cooperation rule setting screen (see FIG. 1). The rule distribution unit 323 distributes the registered collaboration rule to the user device 100.

  FIG. 3 is a diagram showing an example of device operation definition information of the external device 500. As shown in FIG. The device operation definition information is a definition file set for each registered external device 500.

  In the example of FIG. 3, the external device 500A is a device provided with an input (press) button and a lamp. The external device 500A detects “single click”, “double click”, and “long click (long press)” as an operation input to the input button, and outputs a control value to each detected operation input. In addition, the lamp can emit light in a predetermined color from a plurality of preset colors, and emits light in a plurality of types of prepared light emission patterns ("always on", "flashing every 100 ms, etc.) .

  The device registrant has a device input operation definition which gives operation result information from the device to the user apparatus 100 (cooperation control apparatus) how the external device 500 to be operated operates, and the user apparatus 100 (cooperation control apparatus And the device output operation definition which gives a signal to operate the device.

  The device input operation definition is information including, for example, the type of operation input to the external device 500 and control values (control parameters) for identifying each operation input. When the external device 500 is a sensor device, as shown in FIG. 3, “sensor detection information” is included as a device input operation definition. Note that, as the device input operation definition of the sensor device, for example, attached information (for example, an alert) can be included in addition to the sensor detection information. In this case, when the sensor device side has a circuit configuration that outputs an alert when the sensor detection value exceeds a predetermined threshold, the sensor detection information or / and the alert information is set as the device input operation definition. Can. In the example of FIG. 3, the device input operation definition is defined as a conditional clause <IF>.

  On the other hand, the device output operation definition is control information for causing the external device 500 to perform a predetermined operation from the user device 100 (cooperation control device). That is, the action that the external device 500 can perform and the control information for performing the action are defined by the execution clause <THEN>.

  In the example of FIG. 3, the external device 500A defines the device input operation definition and the device output operation definition as a set, but the external device 500B which is a sensor device defines only the device input operation definition. That is, the external device 500B only provides sensor detection information and the like to the user apparatus 100, and no information for causing the user apparatus 100 to perform a predetermined operation is input, so only <IF> is defined, and <THEN Is not specified.

  In addition, the external device 500C is a robot capable of swinging an arm, and includes a speaker. At this time, in the external device 500C, only the device output operation definition is defined, and <IF> corresponding to the device input operation definition is not defined. That is, the external device 500C only receives a signal for operating the external device 500C from the user device 100, and operates only under the control of the user device 100. The external device 500C is not a device that provides the user apparatus 100 with operation result information.

  As described above, in the present embodiment, cooperation between a physical device and the user device 100 (cooperation control device) is supported, but, for example, the external service system 400 can also be positioned as the external device 500. That is, the external service system 400 receives a signal for operating the service function provided by the external service system 400 from the user device 100, and operates under control (request) from the user device 100. For this reason. For example, just as the external device 500A performs the "lighting" operation based on the control signal related to "lighting" output from the user device 100, the external service system 400 may also provide a predetermined service function. It can be considered as cooperation with the device.

  Therefore, in the present embodiment, for example, the external service system 400 that performs voice recognition processing / voice synthesis output processing can be registered as the external device 500D of the speech application, and device operation definition information of the external device 500D is set. As in the example of FIG. 3, a device output operation definition such as uttering “○” for the speech application is defined by <THEN>.

  FIG. 4 is a diagram showing an example of device operation definition information and card attribute information. As shown in FIG. 4, in this embodiment, the device input operation definition is assigned an IF number having an IF card attribute, and the device output operation definition is assigned a THEN number having a THEN card attribute. The IF number and the THEN number are registered as card attribute information, and a card ID and a card category (IF / THEN) are associated with each other. In the IF card and the THEN card, coded card attribute information (code information C18, 28) is described, and is linked with device operation definition information.

  FIG. 5 is a diagram showing a process flow of the cooperation rule setting support system of the present embodiment. First, the device registrant connects to the management apparatus 300 using a computer device. The device registration unit 321 performs registration processing of the external device 500 that cooperates with the user device 100 (cooperation control device) through the device / service registration screen and registration processing of the operation definition of the external device 500 to be registered (S311, S312). The device registrant registers the device input operation definition and / or the device output operation definition together with the thumbnail image and name of the device (S501, S502), and the device registration unit 321 stores these registered information for each device It is stored in the device 330.

  In addition, the device registration unit 321 performs registration processing of card attribute information through the card registration screen (S313). The card creator registers a card category, an IF number, and a THEN number for each card ID, and selects a device input operation definition or a device output operation definition registered for the registered card attribute information (S 503). As illustrated in FIG. 4, the device registration unit 321 generates card attribute information, associates the card attribute information (for example, IF number or THEN number) with the device operation definition information, and stores it in the storage device 330.

  Next, the user, using the IF-THEN card registered in the management apparatus 300, arbitrarily combines the IF card and the THEN card to form a card unit including at least one IF card and at least one THEN card. create. The user activates the photographing device 160 (reading device) of the user device 100, and photographs card information of the created card unit. The photographed card unit is output to the IF-THEN card information reading unit 121A, and identifies the card information C18 of the IF card and the code information C28 of the THEN card to extract each card attribute information. The rule creation control unit 121B generates rule configuration information including the extracted card attribute information (S111). The rule configuration information includes, for example, the IF number read from the code information C18 and the THEN number read from the code information C28. The rule creation control unit 121B transmits the generated rule configuration information to the management device 300 (S112).

  The rule setting unit 322 of the management device 300 extracts the condition clause information corresponding to the IF card read by the photographing device 160 of the user device 100 and the execution clause information corresponding to the THEN card from the device operation definition information (S314) A cooperation rule setting screen including the extracted conditional clause information and execution clause information is transmitted to the user device 100 (S315). The rule setting unit 322 performs registration control and update control of cooperation rules based on the IF-THEN card through the cooperation rule setting screen (see FIG. 1), and stores the registered or updated cooperation rules in the storage device 330 ( S316). At this time, the rule setting unit 322 controls the user to perform operation input of selection and input of control values and parameters, change and deletion of combinations of IF-THEN rules, and the like on the cooperation rule setting screen (S113).

  The rule distribution unit 323 distributes the registered cooperation rule to the user device 100 (S317). The rule management unit 122A stores the distributed association rule in the storage unit 140 (S114).

  Here, the IF-THEN card reading process and the rule configuration information generation process (S111 in FIG. 5) of the present embodiment will be described in detail with reference to FIG. As described above, after the reading start operation from the user is input, the IF-THEN card information reading unit 121A activates the photographing device 160 to photograph the card unit created by the user (S1111). The IF-THEN card information reading unit 121A identifies the code information C18 of the IF card and the code information C28 of the THEN card included in the photographed card unit, and extracts each card attribute information (S1112).

  The rule creation control unit 121B determines whether a plurality of card attribute information extracted by the IF-THEN card information reading unit 121A has at least one set of IF-THEN cards, in other words, at least one IF number, It is determined whether or not at least one THEN number is included (S1113). If it is determined that at least one each of the IF number and the THEN number is not included (NO in S1113), the process returns to the code information reading process (step S1111).

  On the other hand, if it is determined that at least one each of the IF number and the THEN number is included (YES in S1113), the rule creation control unit 121B confirms the sequentially extracted card attribute information, and determines the IF number. Card attribute information to be included is registered as an item regarding "IF card" of rule configuration information (YES in S1114, S1115), and card attribute information including a THEN number is registered as an item regarding "THEN card" in rule configuration information (S1114 NO, YES at S1116, S1117). After all IF cards and THEN cards included in the captured card unit are registered (YES in S1118), the IF cards are associated with each other and THEN cards are mutually linked based on the arrangement direction of physically arranged cards. To determine the association of

  FIG. 7 is a diagram for explaining the alignment direction between two or more IF cards included in the card unit of the present embodiment and the mutual association between IF cards. As shown in FIG. 7, when two or more IF cards to be read collectively are arranged side by side, the rule creation control unit 121B connects the condition clauses corresponding to the respective IF cards arranged in the side by side with the and condition. To associate. On the other hand, when two or more IF cards to be read collectively are arranged vertically, the rule creation control unit 121B links condition clauses corresponding to the vertically arranged IF cards together by an or condition and associates them.

  The imaging device (reading device) 160 or the IF-THEN card information reading unit 121A determines the alignment direction between two or more cards using image processing technology, and the determination result (arrangement direction) is controlled according to the rule creation control It can be output to the part 121B. For example, in the two-dimensional coordinate system of the imaging range, whether each X (horizontal) coordinate at which each code information is located falls within a predetermined allowable range that can be determined as horizontal alignment, Y (vertical) where each code information is located It is possible to determine whether or not each coordinate is within a predetermined allowable range that can be determined to be vertically aligned, and to determine the alignment direction of two or more captured IF cards.

  Similarly, FIG. 8 is a diagram for explaining the alignment direction between two or more THEN cards included in the card unit of this embodiment and the mutual association between THEN cards. When two or more THEN cards to be read collectively are arranged side by side, the rule creation control unit 121B sequentially executes (sequence execution) execution clauses in the order of the arrangement with respect to the respective THEN cards arranged side by side. Associate. On the other hand, when two or more THEN cards to be read collectively are aligned vertically, the rule creation control unit 121B associates the execution clauses to be executed simultaneously in parallel with each of the vertically aligned THEN cards. do. The association between the card arrangement direction and the cards can be arbitrarily set without being limited to horizontal and vertical.

  Returning to FIG. 6, in step S1119, if there are two or more IF cards or THEN cards, the process advances to step S1120, and it is determined whether or not to apply the logical operator application determination processing based on the card arrangement direction. The assignment determination process of the logical operator can be arbitrarily applied, and when not applied, control can be performed to assign a predetermined logical operator (for example, “and”) by default (S1122).

  In step S1121, the rule creation control unit 121B assigns a logical operator to associate two or more IF cards or THEN cards according to the physical card arrangement direction of two or more IF cards or THEN cards (S1121). ).

  The rule creation control unit 121B, for example, applies a first IF number, a second IF number, a logical operator, and a THEN number to a card unit including two IF cards in a row and one THEN card. Rule configuration information to be included can be generated (S1123).

  When the received rule configuration information includes a logical operator, the rule setting unit 322 of the management device 300 generates a logical operator based on the card arrangement direction between the conditional clauses along with a plurality of corresponding conditional clauses on the rule editor screen. Perform display control linked with. Then, the rule setting unit 322 corresponds to each of the two or more IF cards included in the card unit based on the logical operator defined in advance according to the alignment direction between the two or more IF cards read together. Linkage rules are generated by linking conditional clause information with logical operators. The same is true for execution clauses.

  FIG. 9 is a flowchart showing external device cooperation processing based on the cooperation rules of the user device (cooperation control device) 100 of the present embodiment.

  The rule management unit 122 </ b> A outputs a connection request with the external device 500 to the cooperation connection management unit 130. The cooperative connection management unit 130 performs connection processing to each of the external devices 500 via each adapter (S121). When the rule control unit 122B receives the input information (operation result information) from the external device 500 to the user device 100 (YES in S122), the rule control unit 122B refers to the cooperation rule stored in the storage unit 140 (S123). The rule control unit 122B specifies (searches) the cooperation rule of the corresponding external device 500, and extracts “THEN” which is an execution clause of the specified cooperation rule as control information (S124). The rule control unit 122B performs operation control on the external device 500 based on “THEN” with respect to the external device 500 included in the extracted control information (S125).

  For example, cooperation rule control of the external device 500A and the external device 500C of FIG. 3 will be described. When the button of the external device 500A is pressed, a signal indicating that the button is pressed is output from the external device 500A to the user device 100. The rule control unit 122 </ b> B searches the cooperation rule with the key that the external device 500 </ b> A and the button are pressed. As a result of the search, the rule control unit 122B determines whether “THEN”, which is an execution clause for the button of the external device 500A being pressed, exists, and, if it exists, the cooperation defined in “THEN” The target device and its control signal (control information indicating that the cooperation target is the external device 500C and control information for raising the left arm) are extracted. The rule control unit 122 </ b> B outputs a control signal “to raise the left arm” to the external device 500 </ b> C via the cooperative connection management unit 130.

  In addition, an example of cooperation with the external service system 400 will be described. When the button of the external device 500A is pressed, a signal indicating that the button is pressed is output from the external device 500A to the user device 100. The rule control unit 122 </ b> B searches for a cooperation rule using the pressing of the button of the external device 500 </ b> A as a key. As a result of the search, the rule control unit 122B determines whether “THEN”, which is an execution clause for the button of the external device 500A being pressed, exists, and, if it exists, the cooperation defined in “THEN” The target device and its control signal (that the cooperation target is the external device 500D and outputting a predetermined sound) are extracted. The rule control unit 122B outputs an acquisition request signal of “predetermined voice” to the external service system 400 which is the external device 500D via the cooperative connection management unit 130.

  When receiving the acquisition request signal of “predetermined voice”, the external service system 400 outputs corresponding voice data to the user device 100. The voice data may be voice data generated in advance, or voice data generated by voice synthesis each time based on an acquisition request signal. The rule control unit 122 </ b> B outputs the audio data received via the cooperative connection management unit 130 to the speaker (output unit) 150 and reproduces it.

  In addition, cooperation rule control in which the lamp of the external device 500A is lit with the device input operation information (two IF cards) of the two external devices 500A and 500B as a condition (and condition) will be described. When the button of the external device 500A is pressed, a signal indicating that the button is pressed is output from the external device 500A to the user device 100. When the external device 500B, which is an acceleration sensor, is shaken, a signal indicating that the external device 500B is shaken is output from the external device 500B to the user device 100.

  For example, when device input operation information is input from the external devices 500A and 500B to the user device 100 within a predetermined time, the rule control unit 122B searches for a cooperation rule using two device input operation information as keys. As a result of the search, the rule control unit 122B determines whether “THEN”, which is an execution clause for the button of the external device 500A being pressed and the external device 500B being shaken, exists, The cooperation target device defined in “THEN” and its control signal (control information to control that the cooperation target is the external device 500A and turn on the lamp) are extracted. The rule control unit 122B outputs a “lights on lamp” control signal to the external device 500A via the cooperative connection management unit 130.

  In addition, cooperation rule control in which two external devices 500A and 500C (two THEN cards) are operated with the external device 500B as a condition (device input operation information) will be described. An alert based on the temperature detection value is output from the external device 500B to the user device 100. The rule control unit 122B searches the cooperation rule with the device input operation information of the external device 500B as a key. As a result of the search, the rule control unit 122B determines whether “THEN”, which is an execution clause for the “alert” of the external device 500B, exists, and if it exists, it cooperates with the collaboration target device specified in “THEN”. The control signals (control information to be cooperated with the external devices 500A and 500C, control information to blink the lamp of the external device 500A, and control information such as “right arm raised” of the external device 500C) are extracted. The rule control unit 122B outputs a "lights on lamp" control signal to the external device 500A via the cooperative connection management unit 130, and outputs a "right arm raise" control signal to the external device 500C.

  FIG. 10 is a flowchart showing cooperation processing of an external device and an application based on the cooperation rule of the user device (cooperation control device) 100 of the present embodiment. The application is an internal application installed in the user device 100.

  An application installed in the user apparatus 100 can be registered as device registration, and application operation definition information can be registered in the same manner as device operation definition information. The application operation definition information may be, for example, an email input application definition that gives the user device 100 that it has received an email from the email application, and a signal for operating the email application from the user device 100 (for example, , And an application output operation definition for transmitting fixed form mail, displaying a mail browsing screen, and the like.

  Similar to the device operation definition information shown in FIG. 4, the application input operation definition and the application output operation definition can be associated with card attribute information, and can be registered as IF cards and THEN cards.

  The application control unit 122B controls mailers, such as mail transmission / reception control and mail viewing control, for example. When receiving the e-mail, the application control unit 122B notifies the rule control unit 122 that the e-mail has been received (S132). The rule control unit 122B searches for a cooperation rule using the reception of the mail as a key (S133). As a result of the search, the cooperation rule control unit 122B determines whether “THEN”, which is an execution clause for receiving the mail, exists, and if it exists, the cooperation target device specified in “THEN” and its device A control signal (for example, control information indicating that the cooperation target is the external device 500A and lighting the lamp) is extracted (S134). The rule control unit 122B outputs a control signal to light the lamp to the external device 500A via the cooperative connection management unit 130 (S135).

  FIG. 11 is a flowchart showing cooperation processing of the external Web service and the device (or application) based on the cooperation rule of the user device (cooperation control device) 100 of the present embodiment. As another example of the external service system 400, an external web service system can be applied.

  The external web service is, for example, a collaboration service system based on IF-THEN rules on the web. For example, the external web service system generates an event such as "I want to know immediately when a specific user posts an article on a predetermined site" or "I want to know when a specific item is exhibited on a predetermined auction site" Provide an action based on

  Such an external web service system can also be positioned as the external device 500, and can be registered as a device input operation definition. That is, it can be registered and used as an IF card. For example, when the external Web service system executes the IF-THEN rule that "I want to know immediately when a specific user posts an article on a predetermined site", the specific user is specified in a message box assigned to the user, etc. The notice (message data) which posted the article on the site is stored.

  Therefore, the user device (cooperation control device) 100 connects to the external Web service system via the cooperation connection management unit 130, and confirms whether or not the message data is stored in the message box provided by the external Web service system. An execution clause that causes the external device 500 or the internal application to perform a predetermined operation can be set, with the message data stored as a condition clause. As described above, occurrence of an event in the external Web service system (execution history of IF-THEN rules in the external Web service system) can be registered as an IF card using the input operation definition.

  As illustrated in FIG. 11, the rule management unit 122 </ b> B outputs, to the cooperative connection management unit 130, a connection request for connection with the external Web service system. The cooperative connection management unit 130 performs connection processing to the external Web service system via the adapter Ad1 (S141). When the rule control unit 122B receives input information (operation result information) from the external Web service system to the user device 100 (YES in S142), the rule control unit 122B refers to the cooperation rule stored in the storage unit 140 (S143). The rule control unit 122B specifies (searches) the cooperation rule of the corresponding external Web service system, and extracts “THEN” which is an execution clause of the specified cooperation rule as control information (S144). The rule control unit 122B performs operation control based on “THEN” on the external device 500 or the internal application included in the extracted control information (S145). Further, instead of the operation procedures of step S141 and step S142 of FIG. 11, the adapter Ad1 periodically performs connection processing with the external Web service system 400 periodically, and input information from the external Web service system 400 (operation result information ) May be received.

  The cooperation rule setting support system of the present embodiment can also support setting of IF-THEN rules for the external Web service system described above. That is, the IF card and the THEN card of the present embodiment can be configured to include the conditional clause and the execution clause of the IF-THEN rule executed by the external Web service system.

  Therefore, the system according to the present embodiment generates or generates an event in an external Web service system (corresponding to a Web service server) that provides a user with a predetermined action based on the generation of an event or the processing result of the generated event. The system can be configured as a cooperation rule setting support system for setting a cooperation rule in which conditional clause information corresponding to a processing result of an event and execution clause information corresponding to an action are combined. At this time, the card unit includes an IF card including card attribute information corresponding to conditional clause information of IF-THEN rule executed by the external Web service system, and a THEN card including card attribute information corresponding to execution clause information. Including.

  Then, the management device 300 (rule setting unit 322) reads the card unit based on the IF-THEN rule executed by the external Web service system by the reading device, and reads the conditional clause corresponding to the read IF card and the THEN card Generate linkage rules based on combinations with corresponding run clauses. Then, as shown in FIG. 2 and FIG. 5 (S317), the rule distribution unit 323 outputs (sends) the generated cooperation rule to the external Web service system.

  The external Web service system can be provided with a function of receiving the linkage rule generated in the present embodiment and setting it as an IF-THEN rule executed by the external Web service system.

Second Embodiment
12 and 13 show a second embodiment. The present embodiment is an aspect in which the cooperation rule setting function and the rule distribution function of the management apparatus 300 of the first embodiment are integrated in the user device 100, and the user device 100 alone realizes the cooperation rule setting support system. The same reference numerals are given to the same functions and the like as the first embodiment, and the description will be omitted.

  FIG. 12 is a diagram showing a network configuration of the cooperation rule setting support system of the present embodiment and functional blocks of respective devices. In the example of FIG. 12, the rule creation control unit 121B performs generation control of linkage rules via the rule editor screen. The rule creation control unit 121B can also perform distribution control for transmitting the generated collaboration rule to the external Web service system.

  FIG. 13 is a diagram showing a processing flow of the cooperation rule setting support system of the present embodiment. Steps S311 to S313 and S501 to S503 are similar to the example of FIG. Then, in the present embodiment, the device registration unit 321 transmits the generated card attribute information and the device operation definition information associated with the card attribute information to the user device 100 (S3001).

  The user device 100 stores the card attribute information and the device operation definition information transmitted from the management device 300 in the storage unit 140 (S1001). The user activates the photographing device 160 (reading device) of the user device 100, and photographs card information of a card unit created by arbitrarily combining the IF card and the THEN card. The photographed card unit is output to the IF-THEN card information reading unit 121A, and identifies the card information C18 of the IF card and the code information C28 of the THEN card to extract each card attribute information. The rule creation control unit 121B generates rule configuration information including the extracted card attribute information (S1002).

  The rule creation control unit 121B extracts the condition clause information corresponding to the IF card read by the photographing device 160 of the user device 100 and the execution clause information corresponding to the THEN card from the device operation definition information (S1003). A cooperation rule setting screen including the conditional clause information and the execution clause information is displayed on the user device 100 (S1004). The rule creation control unit 121B performs registration control and update control of cooperation rules based on the IF-THEN card through the cooperation rule setting screen (see FIG. 1), and stores the registered or updated cooperation rules in the storage unit 140. (S1005, S1006, S1007). At this time, the rule creation control unit 121B performs control so that the user can perform operation input selection and input of control values and parameters, change and deletion of combinations of IF-THEN rules, and the like on the cooperation rule setting screen.

  The rule creation control unit 121B updates the cooperation rules generated by the user device 100 to the management device 300 (S1008), and the management device 300 stores the cooperation rules uploaded from the user device 100 in the storage device 330 for each user. It can be stored. Also, the rule creation control unit 121B can transmit the cooperation rule to the external web service system (S1009).

  As described above, according to the present embodiment, the cooperation rule registration function based on the IF-THEN card in cooperation with the management apparatus 300 according to the first embodiment is integrated in the user apparatus 100 and is a cooperation control apparatus provided with the cooperation rule registration function. Operate.

Third Embodiment
14 and 15 show the third embodiment. FIG. 14 is a diagram showing a network configuration of the cooperation rule setting support system of the present embodiment and functional blocks of respective devices. In the present embodiment, the function of the user apparatus 100 according to the first embodiment as a cooperation control apparatus is configured as a control apparatus 200 separate from the user apparatus 100, and the user apparatus 100 manages the management according to the first embodiment. Only the cooperation rule registration function based on the IF-THEN card in cooperation with the device 300 is provided. The same reference numerals are given to the same functions and the like as the first embodiment, and the description will be omitted.

  As shown in FIG. 14, the control device 200 has a control unit 220 corresponding to the second control unit 122 of the first embodiment. The rule management unit 221, the rule control unit 222, and the application control unit 223 correspond to the rule management unit 122A, the rule control unit 122B, and the application control unit 122C in the first embodiment. The communication unit 210, the cooperation connection management unit 230, the storage unit 240, the input / output unit 250, and the connection I / F 270 correspond to the communication unit 110, the cooperation connection management unit 130, the storage unit 140, and the like in the first embodiment. The input / output unit 150 corresponds to the connection I / F 170. Then, the control device 200 performs control as the cooperation control device as shown in FIGS. 9 to 11 described in the first embodiment, and executes the cooperation rule generated based on the IF-THEN card.

  FIG. 15 is a diagram showing a processing flow of the cooperation rule setting support system of the present embodiment. Steps S311 to S313 and S501 to S503 are similar to the example of FIG. Further, the same applies to the cooperation rule registration function based on the IF-THEN card in which the user device 100 and the management device 300 cooperate (S111 to S113, S314 to S317).

  The management apparatus 300 (the rule distribution unit 323) of the present embodiment transmits, to the control apparatus 200, the cooperation rule created through the user device 100. The control device 200 stores the cooperation rule received from the management device 300 in the storage unit 240.

  As described above, the present embodiment provides the function of generating a cooperation rule based on the IF-THEN card to an individual cooperation control device that executes the IF-THEN rule in cooperation with the external device 500 and the external service system 400. be able to. The mode in which the cooperation rule registration function based on the IF-THEN card in cooperation with the management apparatus 300 shown in the second embodiment is integrated in the user apparatus 100 can also be applied to the present embodiment.

  As mentioned above, each function of each device which constitutes the above-mentioned cooperation rule setting support system can be realized by a program, and a computer program prepared in advance for realizing each function is stored in the auxiliary storage device. The control unit reads the program stored in the auxiliary storage device into the main storage device, and the control unit executes the program read into the main storage device to operate the functions of the respective units.

  In addition, the program may be provided to a computer in a state of being recorded on a computer readable recording medium. The computer readable recording medium may be an optical disk such as a CD-ROM, a phase change optical disk such as a DVD-ROM, a magneto-optical disk such as MO (Magnet Optical) or MD (Mini Disk), a floppy (registered trademark) disk Examples include magnetic disks such as removable hard disks, compact flash (registered trademark), smart media, SD memory cards, and memory cards such as memory sticks. In addition, hardware devices such as integrated circuits (such as IC chips) specially designed and configured for the purpose of the present invention are also included as recording media.

  Although the embodiment of the present invention has been described, the embodiment is presented as an example, and is not intended to limit the scope of the invention. This novel embodiment can be implemented in other various forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and the gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

100 user device 110 communication unit 120 control unit 121 first control unit 121A IF-THEN card information reading unit 121B rule creation control unit 122 second control unit 122A rule management unit 122B rule control unit 122C application control unit 130 cooperation connection management unit 140 Storage unit 150 Input / output unit 160 Shooting device 170 Connection I / F
300 management apparatus 310 communication apparatus 320 control apparatus 321 device registration unit 322 rule setting unit 323 rule distribution unit 330 storage device 400 external service system 500 external device C1 IF card C2 THEN card

The cooperation rule setting support system includes at least one first card including first card information corresponding to the conditional clause information, and at least one second card including second card information corresponding to the execution clause information. Corresponding to the conditional clause information and the second card information corresponding to the first card information read through the reading unit that reads the first card information of the card unit and the second card information of the card unit. wherein based on the combination of the execution node information to generate collaboration rule, the generated the coordination rules have a, a cooperative rule setting device that outputs to the control device, further, cooperation rule setting device, the condition clauses that Operation definition information including information and the execution clause information, and the first card information and the execution clause information associated with the condition clause information Storage unit for storing card attribute information including the second card information, and the condition clause information corresponding to the first card information read by the reading device and the second card information A cooperation rule setting screen including execution clause information is provided, registration control or update control of the cooperation rule through the cooperation rule setting screen is performed, and the registered or updated condition clause information and the execution clause information And generating a combination rule based on a combination, and storing the combination rule in the storage unit.

Claims (6)

A control device that outputs a control signal for operating the external device or / and the internal application based on an operation result output from the external device, an operation result provided by the external Web service, or an operation result of the internal application; A cooperation rule setting support system for setting a cooperation rule based on a combination of conditional clause information corresponding to an operation result and execution clause information corresponding to output control of the control signal,
A card unit including at least one first card including first card information corresponding to the conditional clause information; and at least one second card including second card information corresponding to the execution clause information;
The condition clause information corresponding to the first card information read through the reader reading the first card information and the second card information of the card unit and the execution clause information corresponding to the second card information A cooperation rule setting device that generates a cooperation rule based on a combination of the above and the above, and outputs the generated cooperation rule to the control device;
Cooperation rule setting support system characterized by having. The cooperation rule setting device
Operation definition information including the condition clause information and the execution clause information; card attribute information including the first card information associated with the condition clause information and the second card information associated with the execution clause information; A storage unit for storing
A cooperation rule setting screen including the condition clause information corresponding to the first card information read by the reader and the execution clause information corresponding to the second card information is provided, and the cooperation rule setting screen is provided. A rule setting unit that performs registration control or update control of the cooperation rule, and generates the cooperation rule based on a combination of the registered or updated condition clause information and the execution clause information, and stores the generated combination rule in the storage unit; The cooperation rule setting support system according to claim 1, comprising: The card unit includes two or more of the first cards,
The reading device collectively reads two or more of the first cards included in the card unit,
The cooperation rule setting device compares the condition clause information corresponding to each of the two or more first cards included in the card unit based on the alignment direction between the two or more first cards read in a batch. The cooperation rule setting support system according to claim 1 or 2, further comprising: a rule setting unit that generates the associated cooperation rule. The card unit includes two or more of the second cards,
The reading device collectively reads two or more of the second cards included in the card unit,
The cooperation rule setting device compares the execution clause information corresponding to each of the two or more second cards included in the card unit based on the alignment direction between the two or more second cards that are collectively read. The cooperation rule setting support system according to any one of claims 1 to 3, further comprising: a rule setting unit configured to generate the associated cooperation rule. In the Web service server that provides a user with a predetermined action based on the occurrence of an event or the processing result of the occurred event, conditional clause information corresponding to the occurrence of the event or the processed result of the generated event and the action A cooperation rule setting support system for setting a cooperation rule combining the execution clause information
A card unit including at least one first card including first card information corresponding to the conditional clause information; and at least one second card including second card information corresponding to the execution clause information;
The condition clause information corresponding to the first card information read through the reader reading the first card information and the second card information of the card unit and the execution clause information corresponding to the second card information An association rule setting device that generates an association rule based on a combination of the above, and the generated association rule to the Web service server;
Cooperation rule setting support system characterized by having. A control device that outputs a control signal for operating the external device or / and the internal application operation based on an operation result output from an external device, an operation result provided by an external Web service, or an operation result of an internal application; A cooperation rule setting device that generates a cooperation rule based on a combination of conditional clause information corresponding to the operation result and execution clause information corresponding to output control of the control signal, and outputs the generated cooperation rule to the control device And a card unit used in the cooperation rule setting support system including
At least one first card including first card information corresponding to the conditional clause information read via a reader;
At least one second card including second card information corresponding to the execution clause information read via the reader and read together with the first card;
A card unit characterized by including.