JP2019114302A - System, information processing device, information processing method, and program - Google Patents

Abstract

To achieve a function by causing hardware or software to conduct cooperative operations, and to respond to various requests from a user.SOLUTION: The method includes: providing elements of hardware or software; providing a program for causing the elements to conduct cooperative operations; and achieving a function by causing the elements disposed in an execution environment to conduct the cooperative operations in accordance with a program, therein the elements and the program can be mutually provided in an independent manner.SELECTED DRAWING: Figure 21

Description

  The present disclosure relates to a system, an information processing apparatus, an information processing method, and a program.

  In recent years, with the development of the information society, it has become possible to reflect various needs of users in product development of hardware and software. For example, in Patent Document 1, a technology is proposed in which the investor appropriately invests in the development of the application program, and the developer appropriately develops. With this technology, it is possible to develop an application program in accordance with the intention of the investor by scoring the intention of the investor's contribution.

JP, 2013-92997, A

  However, even with the technology as described in Patent Document 1 mentioned above, it is not always possible to sufficiently reflect various needs of the user in the product. A product, such as an application program, provides one complete function, so the consumer is limited to the user who needs the function. Therefore, it has been difficult to establish a product unless the function has a certain degree of generality. Although Patent Document 1 is an example of software, the situation is the same for hardware.

  Therefore, the present disclosure proposes a novel and improved method and system that enables functions to be realized by operating hardware or software in cooperation and meeting various needs of users.

According to the present disclosure, function information indicating functions of a plurality of elements including any one of a motion sensor, a camera sensor, and a human sensor is recorded, and the plurality of elements are recorded based on the function information. A system that specifies a function that can be realized by linking a plurality of element icons displayed corresponding to the information, generates a program corresponding to the function, and transmits information of the program to the first device Be done.
Further, according to the present disclosure, function information indicating functions of a plurality of elements including any one of at least one motion sensor, a camera sensor, and a human sensor is recorded, and the plurality of the plurality of elements based on the function information. Information that specifies a function that can be realized by linking a plurality of element icons displayed corresponding to the elements of, generates a program corresponding to the function, and transmits information of the program to the first device A processing device is provided.

Further, according to the present disclosure, function information indicating functions of a plurality of elements including any one of at least one motion sensor, a camera sensor, and a human sensor is recorded, and the plurality of the plurality of elements based on the function information. Information that specifies a function that can be realized by linking a plurality of element icons displayed corresponding to the elements of, generates a program corresponding to the function, and transmits information of the program to the first device A method of treatment is provided.
Further, according to the present disclosure, the computer records function information indicating functions of a plurality of elements including any one of a motion sensor, a camera sensor, and a human sensor, and based on the function information Identifying a function that can be realized by linking a plurality of element icons displayed corresponding to the plurality of elements, generating a program corresponding to the function, and transmitting the information of the program to the first device A program for functioning as an information processing apparatus to transmit is provided.

  As described above, according to the present disclosure, functions can be realized by cooperative operation of hardware or software, and various needs of users can be met.

  Note that the above-mentioned effects are not necessarily limited, and, along with or in place of the above-mentioned effects, any of the effects shown in the present specification, or other effects that can be grasped from the present specification May be played.

It is a figure showing the rough composition of the system which can apply art concerning an embodiment of this indication. It is a figure which shows the 1st specific example of a structure of the system shown by FIG. It is a figure which shows the 2nd specific example of a structure of the system shown by FIG. It is a figure which shows the 3rd specific example of a structure of the system shown by FIG. It is a figure which shows the 4th specific example of a structure of the system shown by FIG. It is a figure which shows the 5th specific example of a structure of the system shown by FIG. It is a figure which shows the 6th specific example of a structure of the system shown by FIG. It is a figure which shows the 7th specific example of a structure of the system shown by FIG. It is a figure which shows the 8th specific example of a structure of the system shown by FIG. FIG. 2 is a diagram showing a first example of a UI provided in the system shown in FIG. 1; FIG. 6 is a diagram showing a second example of a UI provided in the system shown in FIG. 1; It is a figure for demonstrating the 1st specific example of the association operation of the element in the system shown by FIG. It is a figure for demonstrating the 2nd specific example of the association operation of the element in the system shown by FIG. It is a figure for demonstrating the 3rd specific example of the association operation of the element in the system shown by FIG. It is a figure for demonstrating the 4th specific example of the association operation | movement of the element in the system shown by FIG. It is a figure for demonstrating the 5th specific example of the cooperation operation of the element in the system shown by FIG. It is a figure for demonstrating the 6th specific example of the cooperation operation | movement of the element in the system shown by FIG. BRIEF DESCRIPTION OF DRAWINGS FIG. 1 is a diagram illustrating an exemplary configuration of a system according to an embodiment of the present disclosure. It is a figure showing an example of functional composition of a system concerning one embodiment of this indication. It is a figure showing an example of composition of a service platform in one embodiment of this indication. It is a figure which shows the 1st example of exchange of the information regarding the element in one embodiment of this indication. It is a figure which shows the 2nd example of exchange of the information regarding the element in one embodiment of this indication. It is a figure which shows the 3rd example of exchange of the information regarding the element in one embodiment of this indication. It is a figure which shows the 4th example of exchange of the information regarding the element in one embodiment of this indication. It is a figure which shows the 5th example of exchange of the information regarding the element in one embodiment of this indication. It is a figure for demonstrating the example of the package sold in the example of FIG. It is a figure which shows the 6th example of exchange of the information regarding the element in one embodiment of this indication. It is a figure for demonstrating the superiority of a structure like the example of FIG. It is a figure for demonstrating the superiority of a structure like the example of FIG. It is a figure which shows the 7th example of exchange of the information regarding the element in one embodiment of this indication. It is a block diagram showing an example of hardware constitutions of an information processor concerning an embodiment of this indication.

  Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the present specification and the drawings, components having substantially the same functional configuration will be assigned the same reference numerals and redundant description will be omitted.

The description will be made in the following order.
1. Examples of Applicable Systems 1-1. Schematic configuration 1-2. Specific Configuration Example 1-3. Example of user interface 1-4. Example of linkage operation 2. Embodiments of the present disclosure 2-1. System configuration example 2-2. Configuration of Service Platform 2-3. Example of exchange of information about element 2-4. Summary of one embodiment 3. Hardware configuration 4. Supplement

(1. Example of applicable system)
(1-1. Schematic configuration)
FIG. 1 is a diagram showing a schematic configuration of a system to which the technology according to an embodiment of the present disclosure can be applied. Referring to FIG. 1, the system 10 includes an element 100, a manager 200, a server 300, and a user interface (UI) device 400. These devices are connected to one another by a network NW. The network NW may include, for example, Bluetooth (registered trademark), Wi-Fi, the Internet, and the like. In addition, although the system 10 is demonstrated as an example below, the technique concerning embodiment of this indication is applicable also in various other systems.

  The element 100 is a device including a communication unit 110, a control unit 120, a functional unit 130, and a power supply unit 140. The communication unit 110 includes a communication device that communicates with the manager 200 and / or other elements 100 via the network NW. The control unit 120 is implemented by, for example, a microcontroller or a central processing unit (CPU), and controls the functional unit 130. The functional unit 130 includes, for example, a sensor, an actuator, and the like, and implements functions unique to the respective elements 100. The power supply unit 140 includes a battery, a power plug, and the like, and supplies power for operating the communication unit 110, the control unit 120, and the functional unit 130. Although devices other than the element 100 also have a power supply unit, illustration is omitted.

  The manager 200 is an apparatus including a communication unit 210, a control unit 220, and a storage unit 230. The communication unit 210 can include a communication device that communicates with the element 100, the server 300 and the UI device 400 via the network NW. The control unit 220 is realized by, for example, a microcontroller or a CPU, and controls communication between the elements 100 and between the element 100 and the server 300 via the communication unit 210. The control unit 220 may include an arithmetic unit 221. The calculation unit 221 performs calculations on information received from the element 100, information to be transmitted to the element 100, information to be transmitted to the server 300, information received from the server 300, and the like. The storage unit 230 includes a memory or a storage, and stores information exchanged by communication controlled by the control unit 220, information calculated by the calculation unit 221, and the like.

  The server 300 includes a communication unit 310, a control unit 320, and a storage unit 330. The communication unit 310 includes a communication device that communicates with the manager 200 via the network NW. The control unit 320 is realized by, for example, a microcontroller or a CPU, and can include an arithmetic unit 321 and a UI providing unit 323. The calculation unit 321 performs calculations on information received from the element 100 or the manager 200, information to be transmitted to the element 100 or the manager 200, information received from another server, information to be transmitted to another server, and the like. . The UI providing unit 323 provides a UI for the user to specify a combination of the element 100 and / or the manager 200 and to confirm various information. The UI is provided, for example, via a display and a touch panel included in the input / output unit 430 of the UI device 400. The storage unit 330 includes a memory or a storage, and stores various types of information related to the element 100, a program for operating the plurality of elements 100 in combination, software combined with the element 100, information calculated by the operation unit 321, and the like. Do.

  Here, in the storage unit 330 of the server 300, for example, identification information (ID) of the element 100 in the system 10 is stored. Element 100 may be added to system 10 at any time. In addition, the storage unit 330 also stores a program for operating the plurality of elements 100 in combination. The program can be added at any time by, for example, a user, a developer, or a system administrator. Further, the storage unit 330 stores software. The software realizes a function by being executed in combination with the element 100, for example. Alternatively, the function may be realized by executing software in combination. The functions realized by the software may include, for example, provision of materials such as voice and images, timers, calendars, analysis functions such as image recognition and speech recognition, and information acquisition functions from external services such as weather forecast and news. . Software can be added at any time by, for example, a user, a developer, or a system administrator.

  On the other hand, the UI providing unit 323 of the server 300 provides the UI via, for example, a display and a touch panel included in the input / output unit 430 of the UI device 400. The user selects, for example, a program for operating a plurality of elements 100 in combination, from a program pre-installed on the element 100 or the manager 200, a program provided by the server 300, etc., via the UI. can do. Also, the user can specify a combination of a plurality of elements 100, a combination of an element 100 and software, and a combination of a plurality of software via the above-described UI. The designated combination is stored as a program in the storage unit 330 of the server 300, and the program is executed by the element 100 and the software, whereby the user can obtain a desired application.

  The UI device 400 is a device including a communication unit 410, a control unit 420, and an input / output unit 430. The communication unit 410 can include a communication device that communicates with the manager 200 and the server 300 via the network NW. The control unit 420 is realized by, for example, a microcontroller or a CPU, and controls the input / output unit 430 and controls exchange of information via the communication unit 410. The input / output unit 430 includes, for example, a display, a speaker, and a touch panel, presents various information to the user via the UI, and receives an operation input from the user.

(1-2. Specific configuration example)
(First example)
FIG. 2 is a diagram showing a first specific configuration example of the system shown in FIG. Referring to FIG. 2, the system 10 a includes a first tablet functioning as an element 100, a second tablet functioning as an element 100, a manager 200 and a UI device 400, and a server 300.

  Each of the first and second tablets similarly includes a display, a touch panel, a CPU, a sensor, and the like. In the system 10a, one of the two tablets also functions as the element 100, the manager 200, and the UI device 400, and the other functions as the element 100. The role of these tablets may be compatible, and the tablet functioning as the manager 200 or the UI device 400 may be changed according to the situation. In the system 10a, for example, by using various sensors included in the tablet, two tablets can be operated in combination to realize the function desired by the user.

  The first and second tablets in the example shown in FIG. 2 are a functional unit 130 (such as a sensor) for functioning as the element 100 and a control unit 220 (for example, a CPU) for functioning as the manager 200. It is an example of the terminal device which it has. Such a terminal device is not limited to a tablet, and may be another device such as a smartphone. Further, the number of terminal devices included in the system 10a is not limited to the illustrated example, and may be, for example, three or more.

(Second example)
FIG. 3 is a diagram showing a second specific configuration example of the system shown in FIG. Referring to FIG. 3, system 10 b includes elements 100 a to 100 g, a tablet functioning as manager 200 and UI device 400, and server 300.

  In the system 10 b, the tablet functions as the manager 200 and the UI device 400. Similar to the first example above, the tablet may be replaced by another device such as a smartphone. In the illustrated example, the element 100 includes an acceleration sensor 100a, a camera 100b, a human sensor 100c, a button 100d, a speaker 100e, an LED (Light Emitting Diode) lamp 100f, and a microphone 100g. Each element 100 communicates with the tablet by wireless communication such as Bluetooth (registered trademark), and cooperates according to the control of the manager 200 realized by the tablet.

  In the following example, a part or all of the acceleration sensor 100a to the microphone 100g are illustrated as an example of the element 100, but this is intended to limit the type of the element 100 used in each example. is not. In each example, the system 10 may include any one of the acceleration sensor 100a to the microphone 100g or any other type of element 100.

(Third example)
FIG. 4 is a diagram showing a third specific configuration example of the system shown in FIG. Referring to FIG. 4, the system 10 c includes an element 100, a manager 200, a tablet functioning as a UI device 400, and a server 300.

  In the system 10 c, the manager 200 exists separately from the tablet functioning as the UI device 400. The manager 200 may be realized, for example, by a dedicated device or may be realized as one of the functions of a base station such as Wi-Fi. Similar to the above first and second examples, the tablet functioning as the UI device 400 may be replaced by another device such as a smartphone. The manager 200 and the tablet may be able to communicate with the server 300 independently. In addition, when the setting of the system 10 c is changed through the UI provided by the tablet, the tablet may transmit the setting information to the manager 200 directly via Wi-Fi or the like.

  Further, in the example of FIG. 4, it is shown that not only Bluetooth (registered trademark) but also Wi-Fi is used for communication between the manager 200 and the element 100. In addition, a mesh network repeater NW_m such as Wi-Fi is used for connection with the element 100 located at a distant place. Not only in the third example illustrated, but also in other examples, various types of wireless communication such as Bluetooth (registered trademark) and Wi-Fi can be used for communication between the element 100 and the manager 200 and / or between the elements 100. Can be used.

(4th example)
FIG. 5 is a diagram showing a fourth specific configuration example of the system shown in FIG. Referring to FIG. 5, the system 10 d includes an element 100 partially functioning as a manager 200, a tablet functioning as a UI device 400, and a server 300.

  In the system 10d, at least one of the elements 100 also functions as the manager 200, unlike the first to third examples described above. Further, in the system 10d, the elements 100 form a mesh network by Bluetooth (registered trademark) or the like. With such a configuration, in the system 10d, even when the communication with the server 300 and the UI device 400 (tablet) is temporarily disconnected, the element 100 can autonomously cooperate with each other.

(Fifth example)
FIG. 6 is a diagram showing a fifth specific configuration example of the system shown in FIG. Referring to FIG. 6, the system 10 e includes an element 100 partially functioning as a manager 200, a tablet functioning as a UI device 400, and a server 300. The system 10 e is an example in which the manager 200 is incorporated into any of the elements 100 in the system 10 c according to the third example described above.

(Sixth example)
FIG. 7 is a diagram showing a sixth specific configuration example of the system shown in FIG. Referring to FIG. 7, the system 10 f includes an element 100, managers 200 a and 200 b, a tablet functioning as a UI device 400, and a server 300. The system 10 f is an example in which a plurality of managers 200 are arranged in the system 10 c according to the third example described above. Each of the elements 100 can be connected to, for example, the closer one of the managers 200a and 200b. Further, among the plurality of managers 200a and 200b, the connection state of the element 100 and the program for linking the element 100 are synchronized as needed or periodically.

(Seventh example)
FIG. 8 is a diagram showing a seventh specific configuration example of the system shown in FIG. Referring to FIG. 8, the system 10 g includes an element 100, a manager 200 a, a tablet functioning as a manager 200 b and a UI device 400, and a server 300. The system 10g is an example in which the function of the manager 200b is integrated into a tablet in the system 10f according to the sixth example described above. Each element 100 can be connected to, for example, the manager 200a or the tablet closer in position. Also, between the manager 200a and the tablet, the connection state of the element 100 and the program for linking the element 100 are synchronized as needed or periodically.

(Eighth example)
FIG. 9 is a diagram showing an eighth specific configuration example of the system shown in FIG. Referring to FIG. 9, the system 10 h includes an element 100, a tablet functioning as a UI device 400, and a server 300 also functioning as a manager 200. The system 10 h is an example in which the function of the manager 200 is incorporated into the server 300 in the system 10 b according to the second example described above. Each element 100 directly communicates with the server 300 via, for example, a mobile communication network.

  Hereinabove, several specific configuration examples of the system 10 illustrated in FIG. 1 have been described. The specific configuration example of the system 10 is not limited to the examples described above, and may include various modifications that are clearly understood by those skilled in the art based on these examples.

(1-3. Example of user interface)
FIG. 10 shows a first example of a UI provided in the system shown in FIG. Referring to FIG. 10, the screen 4100 displayed on the display of the terminal device functioning as the UI device 400 includes a user profile 4101, a program list tab 4103, and an element list tab 4105. In the illustrated example, since the program list tab 4103 is selected, the program list 4107 is displayed. The program list 4107 includes a program icon 4109, a used element icon 4111, and a description 4113. The screen 4100 may be displayed as, for example, a portal screen when the user uses a service provided by the system 10.

  FIG. 11 is a diagram showing a second example of the UI provided in the system shown in FIG. Referring to FIG. 11, the screen 4200 displayed on the display of the terminal device functioning as the UI device 400 includes a toolbar 4201, a canvas 4203, and a tray 4205. The screen 4200 is used, for example, for editing a program for linking the element 100 in the system 10. In the toolbar 4201, function buttons such as "save" and "redo" are arranged. On the canvas 4203, an element icon 4207, a detailed information icon 4209, and a link 4211 can be arranged or drawn. By these icons and links, it is possible to set and confirm the elements 100 used for the linkage operation, the processing executed by each of the elements 100, and the relationship between the elements 100. Furthermore, an element property box 4213 is arranged on the canvas 4203, and displays, for example, the attribute and the state of the element 100 arranged as the element icon 4207. The tray 4205 displays, as icons, elements 100, software, etc. that can be incorporated into a program by being arranged on the canvas 4203.

  Note that the UIs described with reference to FIGS. 10 and 11 are merely examples, and various forms of UIs may be provided in this embodiment. For example, in the screen for editing a program described with reference to FIG. 11, various UIs used in the screen for visual programming can be applied.

(Example of 1-4. Linkage operation)
Hereinafter, a specific example of the association operation of the elements in the system shown in FIG. 1 will be further described. In the following description, in order to facilitate understanding, reference is made to a diagram visually expressing a program for causing the element 100 to operate in conjunction. Note that these figures are not necessarily related to the UI provided by the UI device 400 (for example, the UI illustrated as the screen 4200 in FIG. 11). The software described below may be provided as an element (software element) similar to the element 100 (hardware element), or may be provided as part of the function or operation of the element 100.

(First specific example)
FIG. 12 is a diagram for describing a first specific example of the association operation of the elements in the system shown in FIG. Referring to FIG. 12, in this example, an acceleration sensor 100 a and a camera 100 b of the element 100 are used. For example, the acceleration sensor 100a is attached to the door of the refrigerator, and the camera 100b is attached at a position where the inside of the refrigerator can be viewed. In the illustrated example, the link 601 directed from the acceleration sensor 100a to the camera 100b means "the camera 100b performs shooting based on the detection value of the acceleration sensor 100a". Furthermore, in the illustrated example, “upload the captured image to the server” is specified as the operation of the camera 100 b.

  Furthermore, in the illustrated example, software 603a is used to detect that the door is opened based on the acceleration. The software 603a is executed by, for example, the calculation unit 221 of the manager 200, and determines that the door of the refrigerator is opened based on the analysis result of the detection value of the acceleration sensor 100a. With the introduction of the software 603a, the link 601 is processed as "the camera 100b performs shooting when it is determined that the door of the refrigerator is opened based on the detection value of the acceleration sensor 100a."

  According to the setting of the program as described above, in this example, an image taken by the camera 100b when the refrigerator door is opened is uploaded to the server. The user can understand changes in the contents of the refrigerator and the latest stock status by browsing the uploaded image.

  Here, if it is desired to detect that the door of the refrigerator is open, a sensor dedicated to open / close detection using magnetism or the like can be used. However, in this example, by introducing software 603a, it is possible to detect that the door is opened using the acceleration sensor 100a. Therefore, in order to detect that the door of the refrigerator is opened, not the dedicated sensor but, for example, the acceleration sensor 100a which has been used in other applications can be diverted. Also, when it is no longer necessary to detect that the refrigerator door is open, the acceleration sensor 100a can be diverted to other applications. Thus, in the present embodiment, the same element 100 can be used in various applications by changing the combination with software or other elements 100.

(Second specific example)
FIG. 13 is a diagram for describing a second specific example of the association operation of elements in the system shown in FIG. Referring to FIG. 13, in this example, an acceleration sensor 100 a and a button 100 d of the element 100 are used. For example, the acceleration sensor 100a is attached to the toilet door, and the button 100d is attached to the bathroom. In the illustrated example, software 603a for detecting that the door is opened based on the acceleration and software 603b for recording the provided data are further used. The link 601 from the acceleration sensor 100a to the software 603b through the software 603a means that the software 603b records that it is determined that the door is opened based on the detection value of the acceleration sensor 100a. Further, the link 601 directed from the button 100 d to the software 603 b means that “the software 603 b records that the signal is output from the button 100 d”.

  By the setting of the program as described above, in this example, the time when the user presses the button 100d in the washroom and the time when the door of the toilet is opened are recorded as a log. For example, if the user decides to press the button 100d when washing the face in the bathroom after getting up, the time when the button 100d is pressed can be recorded as the wake-up time. From such a log, for example, changes in the daily wake up time and the time spent on the toilet can be referenced in time series, which can be used to improve the user's life rhythm.

(Third specific example)
FIG. 14 is a diagram for describing a third specific example of the association operation of the elements in the system shown in FIG. Referring to FIG. 14, in this example, among the elements 100, an acceleration sensor 100a and a human sensor 100c are used. For example, the acceleration sensor 100a is attached to a chair, and the human sensor 100c is attached to a desk in front of the chair. In the illustrated example, software 603c for recording the time that the user has been sitting in a chair is further used based on the detection results of the acceleration sensor 100a and the human sensor 100c. The link 601 from the acceleration sensor 100a to the software 603c means "providing the detection value of the acceleration sensor 100a to the software 603c". Further, the link 601 directed from the human sensor 100c to the software 603c means "providing the detection value of the human sensor 100c to the software 603c".

  By the setting of the program as described above, in this example, the time when the user is sitting in the chair is recorded. Based on this record, the user can grasp the time spent sitting at work etc., and can take a break if it seems that the time spent sitting continuously is too long. Alternatively, software that outputs an alert from a smartphone or the like is further combined based on the detection result of the software 603c, and the alert is output from the smartphone or the like when the user is sitting continuously for more than a predetermined time. You may be prompted to take it.

(The fourth concrete example)
FIG. 15 is a diagram for describing a fourth specific example of the association operation of the elements in the system shown in FIG. Referring to FIG. 15, in this example, among the elements 100, an acceleration sensor 100a, a speaker 100e, and an LED lamp 100f are used. For example, the acceleration sensor 100a, the speaker 100e, and the LED lamp 100f are respectively attached to appropriate parts of the body of the user (for example, a child). A plurality of acceleration sensors 100a may be used. In the illustrated example, software 603 d for reproducing sound effects according to the pattern of acceleration and software 603 e for blinking the lamp in a predetermined pattern according to the pattern of acceleration are also shown. The acceleration pattern handled by the software 603 may be a single acceleration waveform pattern or a combination of a plurality of acceleration waveforms. The link 601 is set from the acceleration sensor 100a to each of the software 603d and 603e. These links 601 mean that “the detection values of the acceleration sensor 100 a are provided to each of the software 603 d and 603 e”. Further, links 601 are set to the speaker 100e from the software 603d and to the LED lamp 100f from the software 603e. These links 601 mean "the speaker 100e outputs sound according to the audio signal provided by the software 603d" and "the LED lamp 100f emits light according to the signal provided by the software 603e".

  According to the setting of the program as described above, in this example, when the user (for example, a child) moves his / her hands and feet in a specific pattern, a sound effect is output from the speaker 100e or the LED lamp 100f emits light. This makes it possible to add sound effects and lights for an exciting experience, for example when a child is playing as a superhero.

(Fifth specific example)
FIG. 16 is a diagram for describing a fifth specific example of the association operation of the elements in the system shown in FIG. Referring to FIG. 16, in this example, among the elements 100, an acceleration sensor 100a, a human sensor 100c, a camera 100b, and an LED lamp 100f are used. For example, the acceleration sensor 100a, the human sensor 100c, and the camera 100b are attached to a garden bird table, and the LED lamp 100f is attached inside a house. In the illustrated example, software 603 f for determining that a bird has stopped on the food stand is further shown based on the detection results of the acceleration sensor 100 a and the human sensor 100 c. Links 601 are set from the acceleration sensor 100a and the human sensor 100c toward the software 603f. The link 601 from the acceleration sensor 100a means "providing the detection value of the acceleration sensor 100a to the software 603f". Further, the link 601 from the human sensor 100c means "providing the detection value of the human sensor 100c to the software 603f". The software 603 f provides, for example, a condition established by a combination of sensor data provided by each of the acceleration sensor 100 a and the human sensor 100 c. Further, a link 601 from the software 603 f to the camera 100 b and the LED lamp 100 f is set. The link 601 to the camera 100 b means “the camera 100 b performs shooting based on the output of the software 603 f”. The link to the LED lamp 100 f means “make the LED lamp 100 f emit light based on the output of the software 603 f”.

  According to the setting of the program as described above, in this example, when a bird stops on the food stand, a still image or a moving image is automatically taken by the camera 100b, and it is possible to know what kind of bird came. In addition, when the bird stops on the food stand, the LED lamp 100f in the house emits light, so that it is possible to observe the bird that is actually coming out of the garden.

(Sixth specific example)
FIG. 17 is a diagram for describing a sixth specific example of the association operation of the elements in the system shown in FIG. Referring to FIG. 17, in this example, the button 100 d and the speaker 100 e of the element 100 are used. For example, the speaker 100e is disposed in the bedroom, and the button 100d is disposed in the bathroom. In the illustrated example, a wakeup alarm software 603g is also shown. From the software 603g, the link 601 is set to the speaker 100e. This link 601 means "the speaker 100e outputs a sound according to the sound signal to be output when the software 603 reaches a set time". Further, from the button 100d, a link 601 is set in the software 603g. The link 601 means that “when the button 100 d is pressed, the output of the audio signal by the software 603 g is stopped”.

  Due to the setting of the program as described above, in this example, the sound of the alarm alarm output from the speaker 100e disposed in the bedroom does not stop until the button 100d of the washroom is pressed. This makes it less likely that the alarm will stop while sleeping, and can reliably wake up at the scheduled time.

(2. Embodiment of the present disclosure)
(2-1. System configuration example)
FIG. 18 is a diagram illustrating an exemplary configuration of a system according to an embodiment of the present disclosure. Referring to FIG. 18, system 1000 includes an end user terminal 1100 and a server 1300. End user terminal 1100 and server 1300 are connected to each other by network 1200.

  End user terminal 1100 is a terminal device used by an end user. The end user is, for example, a user of the system 10 described above with reference to FIG. As described later, the end user has software elements, hardware elements, and an execution environment. The end user terminal 1100 exchanges information with the server 1300, such as information on elements, for example, information on purchase of elements, information on how to combine elements, and proposal of new elements. The end user terminal 1100 may also be able to download an execution environment or software element from the server 1300. The end user terminal 1100 outputs the information received from the server 1300 to the user via an output unit such as a display, and corresponds to the operation input given by the user via an input unit such as a touch panel, a keyboard, or a mouse. The information is sent to the server 1300. In the illustrated example, the end user terminal 1100 includes the smartphone 1100a, the personal computer 1100b, and the tablet 1100c, but the end user terminal 1100 is not limited to these devices, and all kinds of functions that can realize the above functions. It may include a terminal device.

  The server 1300 provides a service to at least one end user terminal 1100. The server 1300 is configured by one or more server devices. In the illustrated example, the server 1300 includes the server devices 1300a to 1300c, but the number of server devices is not limited to this example and may be single or may be more than 2 or 3. Good. Also, the server 1300 may be operated by one or more service providers. For example, the server 1300 may be operated by a service provider who manages the entire service, a supplier or a manufacturer of elements or content, or the like. For example, the server apparatuses 1300a to 1300c in the illustrated example may be operated by the same service providing entity, or may be operated by different service providing entities. Also, a single server device, for example, the server device 1300a may be shared by multiple service providers. The server 1300 exchanges information with the end user terminal 1100 with information on elements, such as information on purchase of elements, information on how to combine elements, and proposal of new elements. Also, the server 1300 may be able to download the execution environment or software element to the end user terminal 1100. The server 1300 transmits information for output to the user in the end user terminal 1100 and receives information corresponding to the operation input given by the user in the end user terminal 1100.

  FIG. 19 is a diagram illustrating an example of a functional configuration of a system according to an embodiment of the present disclosure. Referring to FIG. 19, end user terminal 1100 includes a communication unit 1110, a control unit 1120, a storage unit 1130, and an input / output unit 1140. Also, the server 1300 includes a communication unit 1310, a control unit 1320, and a storage unit 1330.

  In end user terminal 1100, communication unit 1110 is implemented by a communication device that executes wired or wireless communication, and executes communication with server 1300 via network 1200. The control unit 1120 is realized by a processing circuit such as a CPU, and executes various operations for controlling the entire end user terminal 1100. The storage unit 1130 is realized by a memory or a storage device, and stores various data used by the end user terminal 1100 such as a program for causing the control unit 1120 to function. The input / output unit 1140 is realized by an input device such as a touch panel, a keyboard, or a mouse, and an output device such as a display, and receives user's operation input and outputs various information to the user.

  In the server 1300, the communication unit 1310 is realized by a communication device that executes wired or wireless communication, and executes communication with the end user terminal 1100 via the network 1200. The control unit 1320 is realized by a processing circuit such as a CPU, and executes various operations for controlling the entire server 1300 (or each server device). The storage unit 1330 is realized by a memory or a storage device, and stores various data used by the server 1300 such as a program for causing the control unit 1320 to function. In the illustrated example, the server 1300 does not include an input / output unit because the server 1300 provides the service to the end user terminal 1100 according to the program stored in the storage unit 1330. However, in some examples of this embodiment, the server 1300 may include an input / output unit in order to change service settings or update information on elements, for example, a service provider, a supplier, or a manufacturer. Good.

(2-2. Configuration of service platform)
FIG. 20 is a diagram illustrating an exemplary configuration of a service platform according to an embodiment of the present disclosure. Referring to FIG. 20, the service platform 2200 includes a manager function 2201, an element sales charge function 2207, a user management function 2209, and an element management function 2211. A service platform 2200 is provided, for example, to operate the system 10 described above with reference to FIG.

  In service platform 2200, manager function 2201 may correspond to the functions of manager 200 of system 10 in the example of FIG. Thus, service platform 2200 may be implemented, for example, in the devices of manager 200 described above with reference to FIGS. 2-9. Alternatively, while the manager function 2201 is implemented in the device of the manager 200, other functions may be implemented in other devices such as the server 300. Also, the device in which the service platform 2200 is implemented may be the same as or different from the end user terminal 1100 described above. The element sales charging function 2207, the user management function 2209, and the element management function 2211 may be implemented in the end user terminal 1100, or implemented in another device and between the end user terminal 1100 as needed. You may exchange information with Each component will be described below.

  The manager function 2201 includes a program management function 2203 and an execution environment 2205. The manager function 2201 manages the hardware element 100 h and / or the software element 100 s to realize association operation by these elements. The program management function 2203 manages a program that defines linkage operations by these elements. More specifically, the program management function 2203 reads a pre-installed program or a program provided by the server, and updates these programs, corrects them according to the user's operation, or changes a new program. It may be possible to create The execution environment 2205 operates the hardware element 100 h and / or the software element 100 s in accordance with a program managed by the program management function 2203.

  The element sales charge function 2207 manages sales and charges of the hardware element 100h and the software element 100s. These elements may be sold, for example, by sending the main body of the hardware element 100h or a medium on which the program of the software element 100s is recorded, or the activation key of the hardware element 100h or the software element 100s The program may be sold by being downloaded. Also, the hardware element 100 h and the software element 100 s may be validated only for a predetermined period by billing. The element sales charging function 2207 provides the element management function 2211 with information indicating the sales and charging status of the elements included in the system 10.

  The user management function 2209 manages the users of the system 10. As described later, in the service according to the present embodiment, the element 100 included in the system 10 is managed for each user, and it is possible for each user to construct the system 10 using any element 100. It is managed. The user management function 2209 enables the element management function 2211 to identify elements available to the user in the system 10 by managing the user of the system 10 in conjunction with the element sales charge function 2207.

  The element management function 2211 manages elements included in the system 10. As mentioned above, the elements include hardware elements 100h and software elements 100s. In order to incorporate the hardware element 100 h into the system 10, first, the main body needs to be delivered to the user of the system 10. Also, the software part incorporated in the hardware element 100 h may be validated by the input of authentication information by the validation key or the like, or the validation operation via the execution environment 2205. In this case, the hardware element 100 h in which the software part is not activated is not incorporated in the system 10 only when the main body is at the user's hand, but can be incorporated in the system 10 only after the software part is activated.

  On the other hand, when incorporating the software element 100s into the system 10, the API (Application Program) of the software element 100s provided that the program module is downloaded to the user's hand (manager 200 or element 100 having a computing function) or provided on the server Interface) needs to be available. Also for the software element 100s, an activation procedure may be required as with the hardware element 100h. In this case, the software element 100s can only be incorporated into the system 10 after being activated.

  The above-mentioned element management function 2211 is downloaded to the user's hand with the hardware element 100 h whose main body is at hand of the user and the software part is activated (or the activation procedure is not required). The software element 100s that is used (or the API on the server is available) and that has been activated (or does not require an activation procedure) is managed as an element included in the system 10.

  Furthermore, the element management function 2211 has a hardware element whose main body is not at hand of the user or a software part is not activated, and has not been downloaded to the hand of the user (or the API on the server is not available Or software elements that are not validated may be treated as elements not included in the system 10, for example to simulate combinations with elements included in the system 10. Elements not included in the system 10 can be newly included in the system 10 by shipping or acquiring an activation key or downloading a program by purchasing or charging.

  The information on the elements not included in the system 10 may be provided from the server 1300 to the end user terminal 1100 as described later. The element management function 2211 can acquire this information from the user terminal 1100 (the element management function 2211 may be implemented in the user terminal 1100).

(Example of exchange of information about 2-3. Element)
(First example)
FIG. 21 is a diagram illustrating a first example of exchange of information regarding an element in an embodiment of the present disclosure. In the example shown in FIG. 21, the end user purchases the element 100 sold on the service provider server 1300 via the end user terminal 1100. The end user already possesses the execution environment 2205 and the element 100 p. In the illustrated example, an end user can use the end user terminal 1100 to utilize the simulations provided for sale on the server 1300.

  When using simulation, the user first inputs, at the end user terminal 1100, the function that the system 10 wants to realize and / or the information of the element 100p that the user already possesses. The end user terminal 1100 transmits these pieces of information to the server 1300 (S041). For example, the server 1300 generates simulation information of a combination of elements 100 that can realize the function that the user wants to realize in the system 10 and / or a combination of elements 100 that utilizes the element 100 p that the user already possesses. , And transmits it to the end user terminal 1100 (S042). The simulation is realized when the information of the element 100 q not yet held (or not available) by the user among the proposed combinations of elements 100 or the combination of the elements 100 is executed on the execution environment 2205. Information such as the function to be

  The user who refers to the simulation information using end user terminal 1100 may execute the purchase of element 100 q not yet possessed if the function provided by the combination of proposed elements 100 satisfies the request. it can. The purchase request of the element 100 q is transmitted from, for example, the end user terminal 1100 to the server 1300. The service provider that has received the purchase request at the server 1300 sells the element 100 q to the user by shipping the hardware element related to the purchase request or making the software element downloadable. The user who can use the element 100 q makes use of a desired function in the system 10 by linking the already held element 100 p and the newly purchased element 100 q on the execution environment 2205. Can.

  In the above example, for example, when the end user terminal 1100 refers to the simulation information, a program that defines the association operation of the elements related to the simulation may be downloadable. Accordingly, if the user can use the element 100 q by purchase, for example, the user can realize the element association operation without performing a separate setting operation or the like for defining the association operation. The execution environment 2205 sets, for example, communication paths of the elements 100 p and 100 q and determines identifiers of the elements 100 p and 100 q in the system 10 according to the downloaded program.

(Second example)
FIG. 22 is a diagram illustrating a second example of exchange of information on an element according to an embodiment of the present disclosure. In the example shown in FIG. 22, the end user A transmits a program defining the association operation of the element 100 in the system 10 to the server 1300 of the service provider using the end user terminal 1100a (S051). In this second example, the information of the program provided by end user A here is shared with another end user B. More specifically, the information provided by end user A is used as simulation information for end user B.

  In the illustrated example, the end user B inputs, at the end user terminal 1100b, the function that the system 10 wants to realize and / or the information of the element 100p that the end user B already possesses. The end user terminal 1100b transmits these pieces of information to the server 1300 (S052). The server 1300, based on the information provided by the end user A at S051, a combination of the elements 100 that can realize the functions that the end user B wants to realize in the system 10, and / or the elements 100p that the user already possesses. The simulation information of the combination of the elements 100 utilizing the above is generated and transmitted to the end user terminal 1100 (S053). The simulation is realized when the information of the element 100 q not yet held (or not available) by the user among the proposed combinations of elements 100 or the combination of the elements 100 is executed on the execution environment 2205. Information such as the function to be

  The end user B who has referred to the simulation information using the end user terminal 1100 b still holds it, as in the first example above, if the function provided by the combination of the proposed elements 100 satisfies the request. It is possible to carry out the purchase of the element 100 q which is not done. The user who can use the element 100 q makes use of a desired function in the system 10 by linking the already held element 100 p and the newly purchased element 100 q on the execution environment 2205. Can.

(Third example)
FIG. 23 is a diagram illustrating a third example of exchange of information on an element according to an embodiment of the present disclosure. In the example shown in FIG. 23, the service provider server 1300a includes an element 100 (including content) provided by a software supplier (server 1300b), a hardware supplier (server 1300c), and a content supplier (1300d). To mediate.

  In the illustrated example, the end user uses the end user terminal 1100 to perform a simulation similar to the first or second example above. That is, the end user terminal 1100 transmits to the server 1300a the function that the user wants the system 10 to realize and / or information of the element 100p already held (S061), and the server 1300a transmits simulation information to the end user terminal 1100. Is sent (S062). The user who has referred to the simulation information can execute the purchase of the element 100 q not yet possessed if the function provided by the combination of the proposed elements 100 meets the requirement. At this time, payment of compensation from the end user to the service provider is executed, for example, by settlement processing between the end user terminal 1100 and the server 1300a (S063).

  On the other hand, the element 100 q purchased by the user in the above process may be one registered in advance by the software supplier, the hardware supplier, or the content supplier from the servers 1300 b to 1300 d. For example, the supplier registers the element 100 by transmitting information such as the specification and price of the element 100 from the server 1300 b to 1300 d to the server 1300 a (S 064). As described above, when sales of the element 100 from the service provider to the end user occur, part of the consideration paid by the end user is returned from the service provider to the supplier (S065). There are various schemes for returning the price to the supplier, but for example, a revenue share scheme may be adopted.

(4th example)
FIG. 24 is a diagram illustrating a fourth example of exchange of information on an element according to an embodiment of the present disclosure. In the example shown in FIG. 24, the end user A transmits the information of the function to be realized by the system 10 to the server 1300a using the end user terminal 1100a (S071). For example, the end user A may express the function to be realized in a form not necessarily directly related to the components of the system 10, such as photos and texts. The server 1300a publishes the post from the end user A to other users including the end user B (S072). The end user B who has referred to the post creates a program that defines the linkage operation of the element 100 in the system 10 that can realize the function desired by the end user A, and transmits it from the end user terminal 1100b to the server 1300a (S073).

  The server 1300a generates simulation information of a combination of elements 100 that can realize the function that the end user B wants to realize in the system 10 based on the information provided by the end user B, and sends it to the end user terminal 1100a. It transmits (S074). At this time, there may be a plurality of users corresponding to the end user B. In this case, a plurality of simulation information is transmitted from the server 1300a to the end user terminal 1100a. The user who has referred to the simulation information can execute the purchase of the element 100 q not yet possessed if the function provided by the combination of the proposed elements 100 meets the requirement. At this time, payment of compensation from the end user to the service provider is performed, for example, by a settlement process between the end user terminal 1100 and the server 1300 a.

  In the illustrated example, as in the third example above, the elements 100 sold by the service provider are registered by the supplier from the servers 1300 b to 1300 d (S 075), and the service provider to the end user A When the sale of the element 100 occurs, a part of the consideration paid by the end user A is returned to the supplier (S 076). At this time, when the end user A purchases the element 100 based on the information provided by the end user B, that is, when the combination of the elements 100 proposed by the end user B is adopted, the service provider From the end user A to the end user B, part of the value paid to the element 100 by the end user A may be reduced. There are various methods for returning the price to the end user, but for example, a revenue share method may be adopted. Note that the service provider may sell the element 100 directly to the end user instead of intermediary as in the first and second examples described above.

(Fifth example)
FIG. 25 is a diagram illustrating a fifth example of exchange of information on an element according to an embodiment of the present disclosure. In the example shown in FIG. 25, the end user A uses the end user terminal 1100a to implement, as a package PKG, an element 100 for realizing a certain function in the system 10 and a program for defining their linkage operation. It registers with the server 1300a of the service provider (S081). Note that, as illustrated, the end user A may not necessarily have an element or program corresponding to the package PKG. For example, end user A holds service platform 2200 including execution environment 2205, and registers package PKG in server 1300a based on the result of simulation executed using service platform 2200 and end user terminal 1100. It is also good.

  On the other hand, the end user B refers to the information on the package PKG registered in the server 1300a using the end user terminal 1100b (S082), and purchases the package PKG capable of realizing the desired function (P102) S083). The service provider ships the element 100 included in the package PKG to the end user B, and makes the program defining the association operation thereof downloadable (it may be stored in the medium and may be shipped). When the sale of the package PKG from the service provider to the end user B occurs, part of the consideration paid by the end user B is returned from the service provider to the end user A (S084).

  FIG. 26 is a diagram for describing an example of a package sold in the example of FIG. FIG. 25 shows a baby monitor kit as an example of a product realized by the package PKG. The baby monitor kit includes an acceleration sensor 100a, a camera 100b, a speaker 100e, an LED lamp 100f, a microphone 100g, and a motor 100m. The acceleration sensor 100a, the speaker 100e, and the microphone 100g are incorporated in the housing of the pedestal portion. The camera 100b is attached to the top of the column. In addition, the LED lamp 100f and the motor 100m are incorporated in a bird-shaped doll, and the motor 100m moves the wing of a bird.

  These elements 100 operate in cooperation according to a program, for example, turn on the LED lamp 100f, move the blade with the motor 100m, check the situation with the camera 100b, etc. by remote operation from a smartphone or the like. To realize the function of such a baby monitor. The program for such a linkage operation is, for example, when the respective elements 100 are delivered to the end user and associated with the end user's account by being connected to the manager 200, It is downloaded to element 100 via 200. Not limited to the program, for example, content such as a material of sound reproduced by the speaker 100 e is similarly downloaded from the server 300 to the element 100 via the manager 200.

  When the end user B purchases the package PKG in the example described above with reference to FIG. 25, for example, the housing in which the element 100 is incorporated as shown in FIG. 26 is from the service provider to the end user Ship to B. The housing may be shipped complete or may be shipped disassembled into parts that can be easily assembled. At the same time, the end user B can download the program from the server 1300a, for example, via the end user terminal 1100b. As described above, the downloaded program enables linked operation of the element 100 as described above, for example, by being downloaded from the manager 200 to the element 100.

  Further, in the present embodiment, even the element 100 sold as the package PKG can be combined with the different element 100 and operated in conjunction by resetting the program. For example, in the above example, if elements such as the acceleration sensor 100a and the camera 100b are removed from the housing and another program is installed via the manager 200, linked operation is performed with a combination of elements 100 different from the above example. Can realize functions different from baby monitors. Also, even if the baby monitor is to be used continuously, it is possible to easily upgrade or customize the functions by updating the program installed in each element 100 via the manager 200.

(Sixth example)
FIG. 27 is a diagram illustrating a sixth example of exchange of information on an element according to an embodiment of the present disclosure. In the example shown in FIG. 27, the hardware manufacturer posts the idea of the new element 100 from the server 1300e to the server 1300a of the service provider (S101). At this time, the hardware manufacturer may post an example of the function realized using the new element 100.

  The service provider publishes the posted new element 100 idea and an example of the function realized using the new element 100 on the server 1300a. A plurality of end users browse the published ideas using the end user terminals 1100a to 1100c (which may actually be more) (S102). If the end user has an intention to purchase for the element 100 of the published idea, the end user indicates it using the end user terminals 1100a to 1100c (S103). At this time, the end user may indicate which function he / she would like to use among the examples of the functions implemented using the new element 100.

  Alternatively, the end user may newly propose a function to be realized using the new element 100. The functions newly proposed by the end user may be published with the idea of the new element 100 submitted by the hardware manufacturer. By this, the end user can add the added value of useful functions to the element 100 that he / she wants to be desired, and increase the possibility that the element 100 can be manufactured by the other end user asserting the intention of purchase. it can.

  If a predetermined number of end users express their intention to purchase (S104), the hardware manufacturer manufactures a new element 100. In this case, the end user pays when expressing the intention to purchase, and a part of the price may be used to manufacture the new element 100. Alternatively, the end user may purchase and pay for element 100 after it has been manufactured. In addition, the hardware manufacturer, together with the new element 100, for example, a program for realizing the function that has many intentions of use by the end user among the functions realized using the new element 100, You may manufacture together.

  FIGS. 28A and 28B are diagrams for explaining the advantage of the mechanism as in the example of FIG.

  FIG. 28A shows an example in the case of recruiting applicants for purchase in units of products. In this case, for example, a product A including an element 100x and an element 100y (a portion corresponding to), a product B including an element 100x and an element 100z (a portion corresponding to), an element 100x and an element 100w (a portion corresponding to) With respect to the product C including the above, purchase applicants are individually required. In the illustrated example, if it is difficult to manufacture a product if, for example, 1000 buyers are gathered, it is difficult to manufacture because the number of buyers is less than 1000 for any product.

  FIG. 28B shows an example of a case in which purchase applicants are recruited in element units using a mechanism like the example of FIG. In this case, for example, if the elements 100y, 100z, and 100w are already in circulation, it is sufficient to collect purchase applicants for the element 100x. Then, the consumer of the product A (elements 100x and 100y), the product B (elements 100x and 100z), and the product C (elements 100x and 100w) totals the purchaser of the element 100x. Therefore, even if the number of consumers of each product is less than 1000, the number of purchasers of the element 100x which totals them exceeds 1000, and manufacture of the element 100x becomes possible.

(Seventh example)
FIG. 29 is a diagram illustrating a seventh example of exchange of information on an element according to an embodiment of the present disclosure. In the example shown in FIG. 29, the end user A uses the end user terminal 1100a to post an idea of a new element 100 to the server 1300a of the service provider (S121). At this time, the end user A may post an example of the function realized using the new element 100.

  The service provider publishes the posted new element 100 idea and an example of the function realized using the new element 100 on the server 1300a. A plurality of end users browse the published ideas using the end user terminals 1100b and 1100c (which may actually be more) (S122). If the end user has an intention to purchase for the element 100 of the published idea, the end user indicates it using the end user terminals 1100a to 1100c (S123). At this time, the end user may indicate which function he / she would like to use among the examples of the functions implemented using the new element 100. Alternatively, the end user may propose a new function to be realized using the new element 100, and the proposed function may be published along with the new element 100 idea.

  If a predetermined number of end users express their intention to purchase, the hardware manufacturer is commissioned to manufacture the new element 100 (S124). In this case, the end user pays when expressing the intention to purchase, and a part of the price may be used to manufacture the new element 100. Alternatively, the end user may purchase and pay for element 100 after it has been manufactured. In addition, the hardware manufacturer, together with the new element 100, for example, a program for realizing the function that has many intentions of use by the end user among the functions realized using the new element 100, You may manufacture together. The manufactured element 100 or program is provided to the end user via the service provider (S125).

  At this time, to the end user A who provided the idea of the element 100, a part of the value paid by the other end user who has purchased the element 100 is reduced (S126). The service provider server 1300a may determine the rate of return of the price to the end user A according to the originality of the idea, the degree of contribution in the case where there are a plurality of drafters, and the like.

(2-4. Summary of one embodiment)
One embodiment of the present disclosure described above can also be expressed as follows.

(1) Providing an element of hardware or software, providing a program for causing the element to cooperate, and realizing a function by causing the element arranged in the execution environment to cooperate according to the program , And the element and the program can be provided independently of each other.
The system 10 according to the present embodiment is provided with software or hardware elements 100, and a program for linking these elements (for example, the element 100 as conceptually shown in FIGS. 12 to 17). A program defining interlinking operations between one another can be provided independently of each other apart from the element 100.
Thus, various functions can be realized by changing the combination of the elements 100 or changing the program with the same combination of the elements 100. Therefore, functions more adapted to the needs of the user can be easily realized.
For example, as shown in the example of FIG. 21, it may be possible for an end user to additionally purchase the element 100 one after another as needed. A simulation of what function is realized when the element 100 is additionally purchased may be provided, for example, in the server 1300 operated by the service provider.

(2) Providing the program includes: uploading a program created by a first end user to a server; and a second end user different from the first end user using the uploaded program. And downloading from the server.
A program for linking the elements 100 in the system 10 can be created by the end user himself. In the execution environment of the system 10, a GUI may be provided for the end user to change the program or create a new program. For example, as shown in the example of FIG. 22, a program created by an end user may be uploaded to the server 1300 of the service provider, and another end user may download this program and use it for the association operation of the element 100. It may be possible.

(3) Providing the element includes: uploading information of the element manufactured by the supplier to the server of the intermediary, and an end user purchasing the element with reference to the information of the uploaded element. And may be included.
The service provider in this embodiment may include a supplier of hardware or software elements and an intermediary that mediates the distribution of the elements. For example, as shown in the example of FIG. 23, the mediator facilitates the end user to obtain various elements by publishing the information of the elements supplied by the supplier to the end user. In addition, suppliers can also supply elements to many end users.

(4) Providing the program includes: uploading to the server information of a function desired to be realized by a first end user; and a second end user different from the first end user uploading the program Uploading to the server a program capable of realizing the function created with reference to information of the function, and the first end user downloading the uploaded program from the server Good.
For example, as shown in the example of FIG. 24, the creation of a new program by an end user may be performed based on the information of the function to be provided which is provided by another end user. In this case, when another end user purchases a new element 100 in order to realize the function according to the new program, a part of the consideration of the element 100 is also returned to the end user who created the new program. May be

(5) Providing the element and providing the program, the package of the program created by the first end user and the element relating to the program with the first end user It may also include purchases made by different second end users.
As described above, although the element 100 and the program can be provided independently of each other, they may be packaged and provided, for example, as shown in the example of FIG. Even in such a case, for example, when the function of the product provided as a package is no longer required, the element 100 can be changed by changing the combination of the elements 100 or changing the program for linkage operation. It is possible to realize the other functions required of 100.

(6) The package may include an element of the hardware to be delivered, an element of the software to be delivered stored in a medium or downloaded, and the program.
For example, as shown in the example of FIG. 26, the package may include hardware and software elements 100, and a program for linking the elements 100. For example, there are various ways to deliver the element 100 or program from the service provider to the end user, such as hardware elements are delivered, software elements and programs are stored in a medium and delivered or downloaded, etc. Alternatively, multiple delivery methods may be used in combination within the same package.

(7) Providing the element means that a manufacturer of the element uploads a proposal of a new element to the server, and an end user who refers to the proposal states a purchase intention for the new element. Sending to a server and, when a predetermined number of said intentions have been sent, said manufacturer produces said new element and sells said manufactured element to the end user who sent said intentions. May be included.
For example, as shown in the example of FIG. 27, the manufacturer of the element 100 can recruit purchase candidates of this new element 100 by uploading a proposal of the new element 100 to the server 1300. By manufacturing a new element 100 on condition that a predetermined number of purchase applicants gather, a manufacturer can develop the new element 100 with low risk.

(8) The new element may be capable of realizing a plurality of different functions by combining with other existing elements.
For example, as described with reference to FIGS. 28A and 28B, a plurality of different functions (corresponding to a plurality of different products) can be realized by combining the new element 100x with the existing elements 100y, 100z, 100w, etc. In some cases, by making the element 100 a unit as described above, a wide variety of purchase applicants can be collected.

(9) Providing the element means that an end user uploads a proposal of a new element to the server, and an end user who has referred to the proposal transmits an intention to purchase the new element to the server And the manufacturer of the element manufactures the new element and sells the manufactured element to the end user who sent the intention, when a predetermined number of the intentions are transmitted. May be included.
For example, as described with reference to FIG. 29, the proposal of a new element may be made from the end user side instead of the manufacturer. In this case, the service provider can newly add the element 100 with higher demand by requesting the manufacturer to manufacture the element 100 when a predetermined number of users agree with the proposal.

(3. Hardware configuration)
Next, the hardware configuration of the information processing apparatus according to the embodiment of the present disclosure will be described with reference to FIG. FIG. 30 is a block diagram showing an example of the hardware configuration of the information processing apparatus according to the embodiment of the present disclosure. The illustrated information processing apparatus 900 can realize, for example, an element, a manager, a server, a UI apparatus, an end user terminal, and / or a server apparatus in the above embodiment.

  The information processing apparatus 900 includes a central processing unit (CPU) 901, a read only memory (ROM) 903, and a random access memory (RAM) 905. The information processing apparatus 900 may also include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 923, and a communication device 925. Furthermore, the information processing device 900 may include an imaging device 933 and a sensor 935 as necessary. The information processing apparatus 900 may have a processing circuit such as a digital signal processor (DSP) or an application specific integrated circuit (ASIC) in place of or in addition to the CPU 901.

  The CPU 901 functions as an arithmetic processing unit and a control unit, and controls the overall operation or a part of the information processing apparatus 900 according to various programs recorded in the ROM 903, the RAM 905, the storage unit 919, or the removable recording medium 927. The ROM 903 stores programs used by the CPU 901, calculation parameters, and the like. The RAM 905 primarily stores programs used in the execution of the CPU 901, parameters that appropriately change in the execution, and the like. The CPU 901, the ROM 903 and the RAM 905 are mutually connected by a host bus 907 configured by an internal bus such as a CPU bus. Furthermore, the host bus 907 is connected to an external bus 911 such as a peripheral component interconnect / interface (PCI) bus via the bridge 909.

  The input device 915 is, for example, a device operated by the user, such as a mouse, a keyboard, a touch panel, a button, a switch, and a lever. The input device 915 may be, for example, a remote control device using infrared rays or other radio waves, or may be an external connection device 929 such as a mobile phone corresponding to the operation of the information processing apparatus 900. The input device 915 includes an input control circuit that generates an input signal based on information input by the user and outputs the generated signal to the CPU 901. The user operates the input device 915 to input various data to the information processing apparatus 900 and instruct processing operation.

  The output device 917 is configured of a device capable of visually or aurally notifying the user of the acquired information. The output device 917 may be, for example, a display device such as an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), an organic EL (Electro-Luminescence) display, an audio output device such as speakers and headphones, and a printer. . The output device 917 outputs the result obtained by the process of the information processing apparatus 900 as a video such as text or an image, or outputs it as an audio such as audio or sound.

  The storage device 919 is a device for data storage configured as an example of a storage unit of the information processing device 900. The storage device 919 is configured of, for example, a magnetic storage unit device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, or a magneto-optical storage device. The storage device 919 stores programs executed by the CPU 901, various data, various data acquired from the outside, and the like.

  The drive 921 is a reader / writer for a removable recording medium 927 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and is built in or externally attached to the information processing apparatus 900. The drive 921 reads out the information recorded in the mounted removable recording medium 927 and outputs it to the RAM 905. The drive 921 also writes a record on the attached removable recording medium 927.

  The connection port 923 is a port for directly connecting a device to the information processing apparatus 900. The connection port 923 may be, for example, a Universal Serial Bus (USB) port, an IEEE 1394 port, a Small Computer System Interface (SCSI) port, or the like. Further, the connection port 923 may be an RS-232C port, an optical audio terminal, an HDMI (registered trademark) (High-Definition Multimedia Interface) port, or the like. By connecting the external connection device 929 to the connection port 923, various data can be exchanged between the information processing device 900 and the external connection device 929.

  The communication device 925 is, for example, a communication interface configured of a communication device or the like for connecting to the communication network 931. The communication device 925 may be, for example, a communication card for a wired or wireless Local Area Network (LAN), Bluetooth (registered trademark), or WUSB (Wireless USB). The communication device 925 may be a router for optical communication, a router for Asymmetric Digital Subscriber Line (ADSL), or a modem for various types of communication. The communication device 925 transmits and receives signals and the like to and from the Internet or another communication device using a predetermined protocol such as TCP / IP. A communication network 931 connected to the communication device 925 is a network connected by wire or wireless, and is, for example, the Internet, a home LAN, infrared communication, radio wave communication, satellite communication, or the like.

  The imaging device 933 uses various members such as an imaging device such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS), and a lens for controlling the formation of an object image on the imaging device. It is an apparatus which images real space and generates a captured image. The imaging device 933 may capture a still image, or may capture a moving image.

  The sensor 935 is, for example, various sensors such as an acceleration sensor, a gyro sensor, a geomagnetic sensor, an optical sensor, and a sound sensor. The sensor 935 acquires information related to the environment of the information processing apparatus 900, such as information on the state of the information processing apparatus 900 itself, such as the posture of the housing of the information processing apparatus 900, and brightness and noise around the information processing apparatus 900. Do. The sensor 935 may also include a GPS sensor that receives a Global Positioning System (GPS) signal and measures the latitude, longitude and altitude of the device.

  The example of the hardware configuration of the information processing apparatus 900 has been described above. Each of the components described above may be configured using a general-purpose member, or may be configured by hardware specialized for the function of each component. Such configuration may be changed as appropriate depending on the level of technology to be implemented.

(4. Supplement)
An embodiment of the present disclosure, for example, functions as an information processing apparatus (end user terminal and / or server apparatus) as described above, a system, an information processing method executed by the information processing apparatus or system, and an information processing apparatus And a non-transitory tangible medium on which the program is recorded.

  The preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such examples. It is obvious that those skilled in the art of the present disclosure can conceive of various modifications or alterations within the scope of the technical idea described in the claims. It is understood that also of course falls within the technical scope of the present disclosure.

  In addition, the effects described in the present specification are merely illustrative or exemplary, and not limiting. That is, the technology according to the present disclosure can exhibit other effects apparent to those skilled in the art from the description of the present specification, in addition to or instead of the effects described above.

The following configurations are also within the technical scope of the present disclosure.
(1) providing hardware or software elements;
Providing a program for causing the elements to operate in conjunction;
Implementing functions by causing the elements arranged in the execution environment to operate in accordance with the program.
The method wherein the element and the program can be provided independently of each other.
(2) Providing the program
Uploading the program created by the first end user to the server;
The second end user different from the first end user downloading the uploaded program from the server.
(3) Providing the element
Uploading the information of the element manufactured by the supplier to the server of the intermediary;
The end user purchases the element with reference to the information of the uploaded element, The method according to (1) or (2).
(4) Providing the program
Uploading to the server information of functions that the first end user wants to realize;
Uploading a program capable of realizing the function, created by referring to the information of the uploaded function, to the server, a second end user different from the first end user;
The first end user downloading the uploaded program from the server. The method according to any one of (1) to (3).
(5) Providing the element and providing the program, the package of the program created by the first end user and the element relating to the program with the first end user The method according to any one of the above (1) to (4), comprising purchasing by a different second end user.
(6) The method according to (5), wherein the package includes an element of the hardware to be delivered, an element of the software to be delivered stored in a medium or downloaded, and the program.
(7) Providing the element
The manufacturer of the element uploads a proposal for a new element to the server;
An end user who has referred to the proposal sends an indication of purchase for the new element to the server;
The manufacturer including manufacturing the new element and selling the manufactured element to the end user who sent the statement, when a predetermined number of the statements are sent; 1) The method of any one of (6).
(8) The method according to (7), wherein the new element can realize a plurality of different functions by combining with other existing elements.
(9) Providing the element
End users upload new element proposals to the server,
An end user who has referred to the proposal sends an indication of purchase for the new element to the server;
The manufacturer of the element producing the new element when a predetermined number of the intentions have been sent;
Selling the manufactured element to the end user who sent the statement of intent. The method according to any one of the above (1) to (8).
(10) A terminal device used by an end user and a server operated by a service provider
The terminal device and the server execute communication for providing a hardware or software element and a program for linking the element from the provider to the end user;
A function is realized by causing the elements arranged in the execution environment to operate in accordance with the program,
A system in which the element and the program can be provided independently of each other.

Reference Signs List 10 system 100 element 110 communication unit 120 control unit 130 functional unit 140 power supply unit 200 manager 210 communication unit 220 control unit 230 storage unit 300 server 310 communication unit 320 control unit 330 storage unit 400 UI device 410 communication unit 420 control unit 430 input / output Part 1100 End User Terminal 1300 Server 2200 Service Platform

Claims (4)

Recording functional information indicating functions of a plurality of elements including at least one motion sensor, a camera sensor, and a human sensor
A function that can be realized by linking a plurality of element icons displayed corresponding to the plurality of elements is specified based on the function information, and a program corresponding to the function is generated.
A system for transmitting information of the program to a first device. Recording functional information indicating functions of a plurality of elements including at least one motion sensor, a camera sensor, and a human sensor
A function that can be realized by linking a plurality of element icons displayed corresponding to the plurality of elements is specified based on the function information, and a program corresponding to the function is generated.
An information processing apparatus that transmits information of the program to a first device. Recording functional information indicating functions of a plurality of elements including at least one motion sensor, a camera sensor, and a human sensor
A function that can be realized by linking a plurality of element icons displayed corresponding to the plurality of elements is specified based on the function information, and a program corresponding to the function is generated.
An information processing method for transmitting information of the program to a first device. Computer,
Recording functional information indicating functions of a plurality of elements including at least one motion sensor, a camera sensor, and a human sensor
A function that can be realized by linking a plurality of element icons displayed corresponding to the plurality of elements is specified based on the function information, and a program corresponding to the function is generated.
A program for causing information of the program to function as an information processing apparatus that transmits the information to a first device.

Images