KR102592880B1 - Internet of things platforms, apparatuses, and methods - Google Patents

Abstract

An Internet of Things system and method is described. For example, one embodiment of the system includes a WAN interface for coupling an IoT hub to an IoT service via a WAN, and a local communication interface for communicatively coupling the IoT hub to a plurality of different types of IoT devices. IoT hub including; and at least one IoT device having a memory for storing the program code and a microcontroller for executing the program code, wherein the program code is configured to implement an arbitrary IoT device by generating application program code using the library program code. Contains library program code containing basic building blocks usable by a developer, at least one of the basic building blocks comprising a communication stack to enable communication with an IoT hub, and the library program code provides software for the microcontroller. It is provided to developers as a development kit (SDK).

Description

INTERNET OF THINGS PLATFORMS, APPARATUSES, AND METHODS}

The present invention relates generally to the field of computer systems. More specifically, the present invention relates to Internet of Things (IoT) platforms, devices, and methods.

“Internet of Things” refers to the interconnection of uniquely identifiable embedded devices within the Internet infrastructure. Ultimately, IoT is a new broad type of application in which virtually any type of physical object can provide information about itself or its surroundings and/or be controlled remotely via client devices over the Internet. It is expected to cause them.

IoT development and adoption has been slowed by issues related to connectivity, power, and lack of standardization. For example, one obstacle to IoT development and adoption is that no standard platform exists to allow developers to design and provide new IoT devices and services. To enter the IoT market, developers must design an entire IoT platform from start to finish, including the network protocols and infrastructure, hardware, software, and services required to support the desired IoT implementation. As a result, each provider of IoT devices uses proprietary techniques for designing and connecting IoT devices, making the adoption of multiple types of IoT devices burdensome for end users. Another obstacle to IoT adoption is the difficulties associated with connecting and powering IoT devices. For example, connecting devices such as refrigerators, garage door openers, environmental sensors, home security sensors/controllers, etc. requires an electrical source to power each connected IoT device, and such electrical source is often not conveniently located.

A better understanding of the present invention can be obtained from the following detailed description in conjunction with the following drawings.
1A and 1B illustrate different embodiments of IoT system architecture.
Figure 2 illustrates an IoT device according to an embodiment of the present invention.
Figure 3 illustrates an IoT hub according to an embodiment of the present invention.
4A and 4B illustrate one embodiment of an IoT device for receiving and processing input from an end user.
5A illustrates one embodiment of an IoT hub implemented as a clock and information device.
5B illustrates one embodiment of an IoT clock hub/information device coupled to a frame with integrated speakers.
5C-5F illustrate different embodiments of an IoT watch hub.
6 illustrates a specific application of IoT devices to detect when specific products need to be replenished in a user's home.

In the following specification, for purposes of explanation, numerous specific details are set forth to provide a thorough understanding of the embodiments of the invention described below. However, it will be apparent to those skilled in the art that embodiments of the invention may be practiced without some of these specific details. In other instances, well-known structures and devices are shown in block diagram form to avoid obscuring the basic principles of embodiments of the invention.

One embodiment of the present invention includes an Internet of Things (IoT) platform that can be used by developers to design and build new IoT devices and applications. In particular, one embodiment includes a basic hardware/software platform for IoT devices that includes an IoT hub and a predefined networking protocol stack through which IoT devices are coupled to the Internet. Additionally, one embodiment includes an IoT service through which IoT hubs and connected IoT devices can be accessed and managed as described below. Additionally, one embodiment of an IoT platform includes an IoT app or web application (e.g., running on a client device) to access and configure IoT services, hubs, and connected devices. Existing online retailers and other website operators can leverage the IoT platform described herein to easily provide unique IoT capabilities to their existing user base.

1A illustrates an overview of an architectural platform on which embodiments of the invention may be implemented. In particular, the illustrated embodiment includes a plurality of IoT devices 101 - 105 communicatively coupled via local communication channels 130 to a central IoT hub 110 . It is itself communicatively coupled to the IoT service 120 via the Internet 220 . Each of IoT devices 101 - 105 may initially be paired with IoT hub 110 (e.g., using pairing techniques described below) to enable each of the local communication channels 130 .

IoT devices 101 to 105 collect information about themselves and their surroundings and share the collected information with the IoT service 120, user devices 135, and/or external websites through the IoT hub 110. Various types of sensors may be mounted to provide 130. Some of the IoT devices 101 to 105 may perform specified functions in response to control commands transmitted through the IoT hub 110. Various specific examples of information and control commands collected by IoT devices 101-105 are provided below. In one embodiment described below, IoT device 101 is a user input device designed to record user selections and transmit user selections to IoT service 120 and/or website.

In one embodiment, IoT hub 110 includes a cellular radio to establish a connection to the Internet 220 via a cellular service 115, such as 4G (e.g., mobile WiMax, LTE) or 5G cellular data service. Includes. Alternatively or additionally, IoT hub 110 may include a WiFi access point or router that couples IoT hub 110 to the Internet (e.g., through an Internet service provider that provides Internet services to end users). It may include a WiFi radio for establishing a WiFi connection via 116. Of course, it should be noted that the basic principles of the present invention are not limited to any particular type of communication channel or protocol.

In one embodiment, IoT devices 101 - 105 are ultra-low power devices that can operate for extended periods of time (eg, years) on battery power. To conserve power, local communication channels 130 may be implemented using low-power wireless communication technology, such as Bluetooth Low Energy (LE). In this embodiment, each of the IoT devices 101 to 105 and the IoT hub 110 are equipped with Bluetooth LE radios and protocol stacks.

As mentioned, in one embodiment, the IoT platform provides a user interface to allow users to access and configure connected IoT devices 101 - 105, IoT hub 110, and/or IoT services 120. Includes IoT apps or web applications running on devices 135. In one embodiment, an app or web application may be designed by the operator of website 130 to provide IoT functionality to its user base. As illustrated, a website may maintain a user database 131 containing account records related to each user.

1B illustrates additional connectivity options for a plurality of IoT hubs 110 and 111, 190. In this embodiment, a single user may have multiple hubs 110 and 111 installed on-site at single user premises 180 (e.g., the user's home or business). This may be done, for example, to extend the wireless range needed to connect all of IoT devices 101-105. As indicated, if a user has multiple hubs 110, 111, the hubs may be connected via a local communication channel (eg, WiFi, Ethernet, power line networking, etc.). In one embodiment, hubs 110 and 111 may each establish a direct connection to IoT service 120 via a cellular 115 or WiFi 116 connection (not explicitly shown in Figure 1B). . Alternatively or additionally, one of the IoT hubs, such as IoT hub 110, may be connected to IoT hub 111 (as indicated by the dotted line connecting IoT hub 110 and IoT hub 111). Likewise, it may act as a “master” hub that connects to and/or provides local services to all other IoT hubs on the user's premises 180. For example, the master IoT hub 110 may be the only IoT hub to establish a direct connection to the IoT service 120. In one embodiment, only the “master” IoT hub 110 is equipped with a cellular communication interface for establishing a connection to the IoT service 120. Therefore, all communications between the IoT service 120 and other IoT hubs 111 will flow through the master IoT hub 110. In this role, the master IoT hub 110 filters data exchanged between other IoT hubs 111 and IoT services 120 (e.g., servicing some data requests locally where possible). Additional program code may be provided to perform operations.

Regardless of how IoT hubs 110 and 111 are connected, in one embodiment, IoT service 120 provides a single, comprehensive user interface (and/ or a browser-based interface), the hubs will be logically associated with the user and all of the attached IoT devices 101 to 105 will be combined.

In this embodiment, the master IoT hub 110 and one or more slave IoT hubs 111 are connected to a local network, which may be a WiFi network 116, an Ethernet network, and/or power-line communication (PLC) networking in use. (e.g., where all or parts of the network are powered via the user's power lines). Additionally, for IoT hubs 110 and 111, each of IoT devices 101 - 105 can use any type of local network channel, such as WiFi, Ethernet, PLC, or Bluetooth LE, to name a few. It can be interconnected with IoT hubs 110 and 111.

Figure 1B also shows IoT hub 190 installed at second user premises 181. A virtually unlimited number of such IoT hubs 190 can be installed and configured to collect data from IoT devices 191 and 192 on user premises around the world. In one embodiment, two user premises 180 and 181 may be configured for the same user. For example, one user premises 180 may be the user's primary home and another user premises 181 may be the user's vacation home. In such a case, IoT service 120 can be used with IoT hubs 110 and 111 , 190 under a single comprehensive user interface (and/or browser-based interface) accessible through user devices with app 135 installed. will logically associate with the user and combine all of the attached IoT devices (101 to 105, 191 and 192).

As illustrated in FIG. 2 , an example embodiment of IoT device 101 includes a memory 210 for storing program code and data 201 - 203 and a low-power microcontroller for executing the program code and processing data. Includes (200). Memory 210 may be volatile memory, such as dynamic random access memory (DRAM), or may be non-volatile memory, such as flash memory. In one embodiment, non-volatile memory may be used for persistent storage and volatile memory may be used for execution of program code and data at run time. Additionally, memory 210 may be integrated within low-power microcontroller 200 or may be coupled to low-power microcontroller 200 via a bus or communication fabric. The basic principles of the present invention are not limited to any particular implementation of memory 210.

As illustrated, the program code includes application program code 203, which defines an application-specific set of functions to be performed by IoT device 201, and a preset program code that can be used by an application developer of IoT device 101. It may include library code 202 containing a set of defined building blocks. In one embodiment, the library code 202 provides basic functions required to implement IoT devices, such as a communication protocol stack 201 to enable communication between each IoT device 101 and the IoT hub 110. Includes a set of As mentioned, in one embodiment, communication protocol stack 201 includes a Bluetooth LE protocol stack. In this embodiment, a Bluetooth LE radio and antenna 207 may be integrated within low-power microcontroller 200. However, the basic principles of the present invention are not limited to any particular communication protocol.

The particular embodiment shown in FIG. 2 also includes a plurality of input devices or sensors 210 for receiving user input and providing user input to a low-power microcontroller, which may execute application code 203. and processes user input according to library code 202. In one embodiment, each of the input devices includes an LED 209 to provide feedback to the end user.

Additionally, the illustrated embodiment includes a battery 208 to power the low-power microcontroller. In one embodiment, a non-rechargeable coin cell battery is used. However, in alternative embodiments, an integrated rechargeable battery may be used (eg, rechargeable by connecting the IoT device to an AC power supply (not shown)).

A speaker 205 for generating audio is also provided. In one embodiment, low-power microcontroller 299 provides audio processing to decode a compressed audio stream (e.g., an MPEG-4/Advanced Audio Coding (AAC) stream) to generate audio on speaker 205. Contains decoding logic. Alternatively, low-power microcontroller 200 and/or application code/data 203 may digitally convert audio to provide verbal feedback to the end user as the user enters selections via input devices 210. It can contain snippets sampled as .

In one embodiment, one or more other/alternative I/O devices or sensors 250 may be included on IoT device 101 based on the specific application for which IoT device 101 is designed. For example, environmental sensors may be included to measure temperature, pressure, humidity, etc. If an IoT device is used as a security device, it may include security sensors and/or door lock openers. Of course, these examples are provided for illustrative purposes only. The basic principles of the present invention are not limited to any particular type of IoT device. In fact, given the highly programmable nature of the low-power microcontroller 200 with library code 202, application developers can create new application code 203 to interface with the low-power microcontroller for virtually any type of IoT application. ) and new I/O devices 250 can be easily developed.

In one embodiment, low-power microcontroller 200 also includes a secure key repository for storing encryption keys used by the embodiments described below (e.g., see FIGS. 4-6 and associated text). Includes. Alternatively, the keys may be held securely in a subscriber identity module (SIM), as discussed below.

In one embodiment, wakeup receiver 207 is included to wake the IoT device from an ultra-low power state in which the IoT device is consuming virtually no power. In one embodiment, the wakeup receiver 207 causes the IoT device 101 to wake up in response to a wakeup signal received from the wakeup transmitter 307 configured on the IoT hub 110, as shown in FIG. 3. It is configured to exit this low power state. In particular, in one embodiment, transmitter 307 and receiver 207 together form an electrically resonant transformer circuit, such as a Tesla coil. In operation, when hub 110 needs to wake IoT device 101 from a very low power state, energy is transmitted from transmitter 307 to receiver 207 via radio frequency signals. Because of the energy transfer, the IoT device 101 is able to When a device is in its low-power state, it can be configured to consume virtually no power. Rather, the microcontroller 200 of the IoT device 101 can be configured to wake up after being powered down efficiently, by using energy electrically transmitted from the transmitter 307 to the receiver 207. there is.

As illustrated in FIG. 3 , IoT hub 101 also includes memory 317 for storing program code and data 305 and hardware logic 301 such as a microcontroller for executing program code and processing data. ) includes. A wide area network (WAN) interface 302 and antenna 310 couple IoT hub 110 to cellular services 115. Alternatively, as mentioned above, IoT hub 110 may also include a local network interface (not shown), such as a WiFi interface (and WiFi antenna) or an Ethernet interface for establishing a local area network communication channel. there is. In one embodiment, hardware logic 301 also includes a secure key storage for storing encryption keys used by the embodiments described below (e.g., see FIGS. 4-6 and associated text). do. Alternatively, the keys may be held securely in a subscriber identity module (SIM), as discussed below.

The local communication interface 303 and the antenna 311 establish local communication channels with each of the IoT devices 101 to 105. As mentioned above, in one embodiment, local communication interface 303/antenna 311 implements the Bluetooth LE standard. However, the basic principles of the present invention are not limited to any specific protocols for establishing local communication channels with IoT devices 101 to 105. Although illustrated as separate units in FIG. 3 , WAN interface 302 and/or local communication interface 303 may be embedded within the same chip as hardware logic 301 .

In one embodiment, the program code and data includes a communication protocol stack 308, which may include separate stacks for communicating over a local communication interface 303 and a WAN interface 302. Additionally, device pairing program code and data 306 may be stored in memory to allow the IoT hub to pair with new IoT devices. In one embodiment, each new IoT device 101 - 105 is assigned a unique code that is communicated to IoT hub 110 during the pairing process. For example, the unique code can be embedded into a barcode on an IoT device and can be read by a barcode reader 106 or communicated over a local communication channel 130. In an alternative embodiment, a unique ID code is magnetically embedded on the IoT device, and the IoT hub uses a radio frequency to detect the code when IoT device 101 is moved within a few inches of IoT hub 110. It has a magnetic sensor, such as an ID (RFID) or Near Field Communication (NFC) sensor.

In one embodiment, once the unique ID is communicated, IoT hub 110 queries a local database (not shown) and performs a hash to verify that the code is acceptable. and/or verify the unique ID by communicating with IoT service 120, user device 135, and/or website 130 to validate the ID code. Once approved, in one embodiment, IoT hub 110 pairs IoT device 101 and stores the pairing data in memory 317 (which, as noted, may include non-volatile memory) . Once pairing is completed, IoT hub 110 can be connected to IoT device 101 to perform various IoT functions described herein.

In one embodiment, an organization running IoT service 120 may provide an IoT hub 110 and a basic hardware/software platform to allow developers to easily design new IoT services. In particular, in addition to the IoT hub 110, developers may be provided with a software development kit (SDK) for updating the program code and data 305 running within the hub 110. Additionally, for IoT devices 101, the SDK includes basic IoT hardware (e.g., the low-power microcontroller 200 shown in FIG. 2) to facilitate the design of a variety of different types of applications 101. ) and other components). In one embodiment, the SDK includes a graphical design interface that requires developers to specify only the inputs and outputs for the IoT device. All of the networking code, including the communications stack 201 that allows IoT devices 101 to connect to hubs 110 and services 120, is already in place for developers. Additionally, in one embodiment, the SDK also includes a library code base to facilitate the design of apps for mobile devices (eg, iPhone and Android devices).

In one embodiment, IoT hub 110 manages a continuous bidirectional stream of data between IoT devices 101 - 105 and IoT service 120 . In environments where updates to/from IoT devices 101-105 are required in real time (e.g., a user needs to view the current status of security devices or environmental readings), an IoT hub may have an open TCP socket for providing regular updates to the user device 135 and/or external websites 130. The specific networking protocol used to provide updates can be tweaked based on the needs of the underlying application. For example, in some cases, where it may not be feasible to have a continuous two-way stream, a simple request/response protocol may be used to collect information when needed.

In one embodiment, IoT hub 110 and IoT devices 101 to 105 are automatically upgradeable over the network. In particular, when a new update is available to IoT hub 110, the IoT hub can automatically download and install the update from IoT service 120. The IoT hub first copies the updated code to local memory and can run and verify updates before replacing outdated program code. Similarly, if updates are available to each of IoT devices 101 through 105, the updates may be initially downloaded by IoT hub 110 and pushed out to each of IoT devices 101 through 105. . Thereafter, each IoT device 101 to 105 may apply an update to the IoT hub in a similar manner as described above and report the results of the update back to the IoT hub 110. If the update is successful, IoT hub 110 deletes the update from its memory and installs it on each IoT device (e.g., so that the IoT hub can keep checking for new updates for each IoT device). You can record the latest version of the code.

In one embodiment, IoT hub 110 is powered via A/C power. In particular, the IoT hub 110 may include a power unit 390 having a transformer for transforming the A/C voltage supplied through the A/C power cord to a lower DC voltage.

As mentioned, FIGS. 4A and 4B illustrate one particular embodiment of an IoT device 400 that can receive a card 410 containing a list of selectable items 411-415. As shown in Figure 4B, the card may have a barcode 420 printed thereon, which identifies each of the printed items and displays a plurality of user-selectable buttons 401 corresponding to the items. ) can be read by the barcode reader of the IoT device 400 to associate with each. For example, in Figure 4A, once card 410 is inserted into a slot on device 400, button 401 is associated with item 411, button 402 is associated with item 412, and Button 403 is associated with item 413, button 404 is associated with item 414, and button 405 is associated with item 415. In this particular example, items 411-415 each include grocery and grocery items (eg, bottled water, plum juice, rice, toilet paper, and canned tuna). However, the basic principles of the present invention are not limited to any particular type of items. A set of magnets 430-432 may be coupled to the back of IoT device 400 to allow a user to magnetically attach IoT device 400 to the front of the refrigerator.

The illustrated IoT device 400 is particularly suitable for elderly users or other users who are not technically savvy (and/or do not have access to a full-featured client). In one embodiment, the end user's child or other relative sets up an account on a grocery and grocery website and places cards on the end user's behalf, based on grocery and grocery items commonly ordered by the end user. 410) can be uniquely designed. In this example, grocery and grocery website 130 uses IoT service 120 to manage IoT devices 400 and cards 410 on behalf of grocery and grocery website 130. ) may have an established business agreement with. Accordingly, once items are selected for each of the cards, the IoT service creates a new IoT device 400, an IoT hub 110 (if the end user does not already have an IoT hub installed), and a set of cards 410. It can be sent to the end user (or the user's relatives).

In one embodiment, the IoT device 400 is pre-provided by the IoT service 120 with a unique ID known by the IoT service embedded therein. When an end user inserts card 410 into a slot and selects one or more buttons 401 - 405 corresponding to items 411 - 415 displayed on the card, a unique ID associated with device 400 and identification data identifying the items selected by the end user are transmitted via cellular service 115 (or WiFi) to the IoT service and/or directly to the grocery and grocery website 130. In one embodiment, the grocery and grocery website maintains a mapping between the end user's account and device ID that can be communicated to the grocery and grocery service by the IoT service 120 after providing a new device 400. . Accordingly, grocery and grocery website 130 uses the device ID to identify the end user and fulfill the order for the items selected by the end user. For example, a grocery and grocery service may schedule delivery of items to an end-user's home address, which may be stored in the end-user database 121 along with an association with the end-user's account and the user's device ID. there is. Accordingly, in this embodiment, IoT service 120 does not need to maintain a database containing any user account data (thereby protecting the privacy of end users and simplifying implementation of the IoT service). Rather, the IoT service can only track the device ID for each IoT device provided to end users.

In one embodiment, when the user selects a particular item, the LED 209 within that button may illuminate to reflect the selection. In one embodiment, a user may select a particular button 401-405 multiple times to order multiple instances of an item. In this case, the LEDs may change colors to reflect the number of each item ordered. Alternatively, each button may have a small LCD (or other electronic visual display) configured to indicate the number of items selected by the end user. In one embodiment, a user may insert multiple cards 410 to select items in this manner and, when complete, select a Done button 406 to complete the transaction. Additionally, the transaction may be completed automatically after a specified period of time has elapsed without additional user input. Once the transaction is complete, in one embodiment, the LED in button 406 (or a separate “order on route” LED) lights up to indicate that the ordered items are on route until delivery occurs. It can be kept illuminated.

In response, low-power microcontroller 200 transmits the device ID along with identification data for each of the selected items (and the number selected) to IoT hub 110, which then sends the user's selections to IoT service 120 and /Or directly forward to the grocery and general merchandise website 130. As mentioned, the user's address and other account information may be associated with a device ID within end-user database 121. Accordingly, upon receipt of the transaction details, the user's account may be debited in an amount equal to the cost of the selected items and delivery to the user's home may be scheduled. Upon delivery, IoT device 400 may be reset to reflect that no new orders are currently pending.

In one embodiment, audio feedback is used to communicate ordered items and quantities for each item. For example, in one embodiment, digital audio samples for each item on each of cards 410 may be transmitted to device 400 via IoT hub 410. The audio samples can then be played using an audio decoder in low-power microcontroller 200 and speaker 205. For example, if a user selects a package of bottled water 411, application program code 203 running on low-power microcontroller 200 identifies the item (based on the barcode) and identifies the associated item with the selected item. Digital audio samples can be additionally identified. The code can then cause the low-power microcontroller 200 to render a digital audio sample on speaker 205 with the digital audio sample indicating the number ordered.

In an alternative embodiment, application program code 203 running on low-power microcontroller 200 may be capable of speech synthesis. In this case, a text description of each item may be provided to IoT device 400, which may use text-to-speech to verbalize the text description upon selection of each item by the end user. We will perform synthesis.

In one embodiment, once the user has completed selecting the items and pressed the Done button 406, the details of the transaction may be read audibly back to the user through a speaker. This may include, for example, a description of ordered items and/or an expected delivery date. In one embodiment, delivery date information is transmitted by the website to IoT device 400 after order details have been received and evaluated by grocery and grocery website 130.

Although described above in the context of a grocery and grocery application, IoT device 400 can be used for virtually any application that requires a user to select from a set of options. For example, a set of such devices could be placed outside an apartment complex, and cards listing the names of residences in each apartment could be inserted. In response to the selection, IoT device 400 may send a notification to IoT service 120 (potentially with an image of the user who made the selection, if a network camera is available at that location) to IoT service 120. Service 120 may ring the doorbell of the appropriate residence and/or transmit a text or voice call to the user's device 135 at the residence. In one embodiment, the doorbell is implemented as another IoT device communicatively coupled to IoT services through an IoT hub, as described herein.

As another example, the IoT device 400 may be implemented as a toy or educational device. For example, listings of different types of dinosaurs, animals, or other objects can be printed on the cards. In response to selection of a button, a description of the corresponding object may be audibly generated for the end user. A virtually unlimited number of applications are possible where the user is required to select from a displayed set of options.

In one embodiment illustrated in FIG. 5A , IoT hub 550 is implemented as a smart watch/calendar device that can be mounted on a wall in a user's home or placed on an end table. In addition to the architectural components shown in Figure 3, this embodiment displays various types of information, including the current time 551 and temperature 552 and a set of calendar events 560-563 for the date. Includes a video display interface and screen for The video display interface may be integrated within the low-power microcontroller 200 or may be implemented on a separate chip communicatively coupled to the microcontroller 200.

Each of the calendar events is scheduled to occur, and as illustrated, a time scale 565 is shown to provide a visual indication of the time at which different graphics are used to suggest different types of calendar events. In the specific example shown in Figure 5A, the user has a doctor's appointment 561 at 9am, a lunch appointment 563 at noon, and a travel event at approximately 2pm. Additionally, weather event 560 is displayed to indicate that in the forecast, snow will begin falling at 3:30pm. As indicated, changing weather events, such as snow or rain, may be displayed in the background using graphics and/or animation (eg, animation representing snow, rain, wind, etc.). In one embodiment, when a user has an appointment, a small map may be displayed to indicate the appointment location and/or the appointment address may simply be displayed. The map/address display may also include an indication of the current amount of time required to travel from the location of IoT watch hub 550 to the appointment location. All moving information is on Google Maps™ Or it can be extracted from an online mapping service such as MapQuest™. In one embodiment, indications of major events, such as an earthquake, may also be displayed on IoT watch hub 550 along with related information (such as the location of the event). Of course, the above are just illustrative examples. Various other types of information may be displayed on IoT watch hub 550 within the context of timeline 565.

In one embodiment, IoT watch hub 550 will connect to the user's social networking service to download recently posted pictures and/or comments from the user's social networking account. These may include postings made by the user and/or by friends and/or family members specified by the user. For example, a user may configure IoT watch hub 550 to display new postings made only by certain specified “friends” of the user on a social networking site.

In one embodiment, updates to data displayed on the watch may be sent to an IoT service 120, one or more websites 130 for which the user has accounts, and/or directly to an app on the user's device 135. is transmitted from For example, calendar data may be provided by a calendar managed by the user via an app on user device 135 and/or when the user (e.g., on IoT service 120 or website 130) It can be provided through a server-side calendar, such as a Microsoft Exchange server or a cloud-based server that holds the calendar (running the calendar). Current time and temperature may also be provided by network servers, such as IoT service 120 and/or read from one or more IoT devices 101-105 coupled to IoT clock hub 550. there is. For example, one of the IoT devices 101 to 105 may be an environmental sensor and may provide current temperature, pressure, humidity, etc. to the IoT watch hub 550.

In one embodiment, watch hub 550 is further configured to play the user's audio playlist from an external server and/or the user's mobile device. For example, IoT watch hub 550 may retrieve a playlist from a user's music library (e.g., using protocols common to that library) and then use a built-in audio decoder and Speaker 205 can be used to stream and play music in the playlist. In one embodiment, IoT watch hub 550 establishes a direct local connection with the user's mobile device 135 using the same network protocols that the hub uses to communicate with IoT devices 101-105. . For example, the hub may establish a Bluetooth LE audio connection with the user's mobile device 135 and then operate as a connected audio output to the mobile device.

In one embodiment, to keep the cost of IoT clock hub 550 low, the hub does not include an input device for entering new entries directly on the clock. That is, IoT watch hub 550 receives data from network sources, but does not receive data directly from a user updating entries through an app on mobile device 135. Alternatively, in one embodiment, a user may interact directly with the IoT watch hub 550 itself to enter new data (e.g., via a touchscreen built into the IoT watch hub 550). .

In addition to audio, one embodiment of IoT watch hub 550 can support the user's mobile device 135, IoT service 120, and/or one or more other external servers where the user stores images (e.g. , the images to be displayed can be downloaded directly from any one of the websites 130). Certain images, audio and other content to be displayed on IoT watch hub 550 may be accessed through IoT service 120 (which, as noted, may be accessible through an app installed on the user's computing device 135). It can be specified by the users who interact with and configure the hub through the hub.

In one embodiment, IoT watch hub 550 may be configured to receive and display electronic messages sent by an end user. For example, the hub can be configured using an email message address or a text message address. For example, if IoT watch hub 550 is located in a highly visible location in the user's home, the user can send a message to the entire household by sending a text message or email message to IoT watch hub 550. In one embodiment, if the message includes a photo, IoT watch hub 550 may display the photo.

In one embodiment, IoT service 120 operates as a converter for content to be displayed or played on IoT hub 110 and/or IoT devices 101 to 105. For example, in one embodiment, photos transmitted from the user's mobile device 135 are sent to the IoT service ( 120). Similarly, for audio, IoT service 120 may be configured to play audio (potentially at a lower bitrate or different type of compression) that IoT hub 110 and/or IoT devices 101 - 105 are configured to play. ) You can convert audio to format.

As mentioned above, IoT clock hub 550 may be designed with mounting brackets or holes so that the hub can be mounted on a wall in a convenient location, such as a user's kitchen. Additionally, in one embodiment illustrated in FIG. 5B , IoT clock hub 550 can be adapted to interface with different types/styles of artistic frames 501 . In one embodiment, magnets 506 are attached or embedded within each frame 501, magnetically attaching the frame to an IoT watch hub 550, which has corresponding magnets around its perimeter. Or it may contain metal. Additionally, the IoT watch hub 550 may detect a model of the attached frame based on the positions of the magnets 506 and/or based on an ID code encoded in the magnets. Accordingly, the encoding or position of magnets contained within the magnetic material can act as a fingerprint to uniquely identify different types of frames. Alternatively, or in addition to the use of magnets, IoT watch hub 550 may include a physical interface for interfacing with frame 501. In this embodiment, an ID code identifying the frame may be provided through the interface. Additionally, the interface may include a physical audio connection for embodiments described below in which the frame includes speakers 505.

In one embodiment, the style of information displayed within the IoT watch hub display may automatically change based on the type of frame attached. For example, if a frame with a “modern” style is attached, the colors/fonts/graphic styles used to display information on the IoT watch hub 550 will automatically match the modern frame style. can be switched. Similarly, when a frame with a “traditional” style is attached, the colors/fonts/graphic styles used to display information on the IoT watch hub 550 can be automatically switched to match the traditional frame style. there is. One embodiment of frame 501 may be designed for use in a child's room (e.g., a Hello Kitty ^™ frame or a cuckoo clock may be designed). In response, IoT clock hub 550 may be configured to display an appropriate background (e.g., displaying images of a cuckoo or Hello Kitty on time) to match the frame type. Additionally, although a rectangular frame is shown in Figure 5B, other shapes such as circular or oval frames are also contemplated. In the case of a circular/oval frame, the display on IoT watch hub 550 can be adjusted to accommodate the frame shape (e.g., not display content in areas of the screen obscured by the frame).

As mentioned, in one embodiment, frame 501 is equipped with a set of high-quality speakers 505 for producing audio provided through an audio interface from IoT watch hub 550. For example, in one embodiment where the IoT watch hub 550 downloads the user's audio playlist (as discussed above) and streams/decodes the audio identified in the playlist, the audio is transmitted to the IoT watch hub 550. ) can be played through high-quality speakers 505 rather than the built-in speaker 205.

A variety of different types of frames 501 may be coupled to IoT hub 550 to provide a variety of different I/O capabilities. For example, a frame with an embedded camera may be installed to take images or capture video in response to commands sent to the IoT hub 550 from the user's mobile device/app 135. Accordingly, frame 501 may operate as a local security camera in the user's home. In another embodiment, the frame includes an integrated IR blaster (e.g., to control local A/V equipment such as the user's TV and receiver) to operate as a remote control device controllable via a user device/app. You can have a blaster). In other embodiments, frame 501 may be equipped with heat sensors, smoke sensors, and/or carbon monoxide detectors. In this embodiment, IoT clock hub 550 may generate an alarm in response to any of the sensors indicating levels above acceptable thresholds. The hub may also be configured to transmit alarms to services such as a home monitoring service and/or a local fire department.

Another embodiment of IoT clock hub 550 is illustrated in FIGS. 5C-5F , including options for mounting IoT clock hub 550 on a wall or placing IoT clock hub 550 on a desk (or other structure). do. Referring first to FIGS. 5C and 5D, the IoT watch hub 550 is to be transported to the end user with a circular plate 510 magnetically attached within a circular cavity 513 formed on the rear of the IoT watch hub 550. You can. Figure 5C shows circular plate 510 magnetically attached within cavity 513, and Figure 5D shows circular plate 510 removed from cavity 513. The circular plate 510 may be formed from a magnetic material and/or the magnetic material may be included under the circular cavity 513 to allow the plate 510 to be securely attached when in contact with the circular cavity 513. . In one embodiment, circular plate 510 includes holes 512 through which screws may be drilled to attach the circular plate to the wall. Afterwards, the IoT watch hub 550 can be attached to the circular plate 510 to attach the IoT watch hub 550 to the wall, as shown in FIG. 5E.

The circular plate 510 is particularly advantageous for wall mounting because the user can attach the circular plate 510 to the wall in any orientation (i.e., without using a level). The user then magnetically engages circular cavity 513 and circular plate 510 on the back of IoT watch hub 550 and rotates IoT watch hub 550 as needed to achieve accurate leveling. The IoT watch hub (550) can be magnetically attached to the wall.

Additionally, as shown in FIGS. 5C and 5D, the rear of the IoT watch hub 550 has a circular shape if the user chooses to place the IoT watch hub 550 on a table or desk (or other structure). Plate 510 may include an insertion slot 511 into which the plate 510 may be inserted to provide support. FIG. 5F illustrates circular plate 510 inserted into insertion slot 511 of one embodiment of IoT watch hub 550. As illustrated, once inserted, the IoT watch hub 550 can be tilted backwards in a slightly angled orientation depending on the balance provided by the circular plate 510.

Accordingly, a single support element, circular plate 510, can be used for both wall mounting of IoT watch hub 550 and supporting IoT watch hub 550 on a table or other surface.

FIG. 6 illustrates a specific application in which one IoT device 101 is coupled to or embedded in a bottled water dispenser 601 and another IoT device 102 is embedded in a rice dispenser 602 . In one embodiment, IoT device 101 includes a sensor (illustrated at 250 in FIG. 2) to detect whether the current amount of bottled water in dispenser 601 is below a specified threshold amount. For example, sensor 250 may measure the weight of bottled water in a dispenser and report the current weight to low-power microcontroller 200. Based on application program code 203, when the weight reaches a specified threshold, IoT device 101 may transmit a message indicating that a new bottle of bottled water is needed. A message may be delivered to IoT service 120 and/or external website 130 through IoT hub 110 to place an order for additional bottled water. The order may include the identity (using a unique ID code) of the IoT device 101 associated with the user's account, including the user's home address and billing data. Afterwards, the new bottle of water can be automatically transported to the user's home. Similarly, IoT device 102 within rice dispenser 602 may detect when the weight of rice contained therein reaches a specified threshold. IoT device 102 may then automatically transmit a message (based on application program code 203) when the weight reaches a specified threshold.

Various other sensors may be integrated within IoT devices 101-105 to collect various different types of information. For example, in one embodiment, IoT devices with thermal sensors may be configured on or near a stove to detect when the stove's burners are on. In one embodiment, IoT devices may also be configured to control the stove (e.g., turn the stove on/off) in response to signals transmitted from an app on the user's device 135. As another example, IoT devices may include accelerometers to detect movement (e.g., the number of steps taken by a user, or the frequency with which certain objects within the user's home are used, etc.) It may be coupled to devices around the user's home and/or to the user himself. The basic principles of the invention can be implemented in a virtually unlimited number of applications and contexts.

Embodiments of the invention may include various steps described above. The steps may be implemented as machine-executable instructions that can be used to cause a general-purpose processor or special-purpose processor to perform the steps. Alternatively, these steps may be performed by specific hardware components that include hardwired logic to perform the steps, or by any combination of programmed computer components and custom hardware components.

As described herein, instructions may be configured to perform certain operations, or may be implemented as software instructions stored in a memory, embodied in a non-transitory computer-readable medium, or as application specific integrated circuits (ASICs) with predetermined functionality. Can refer to specific configurations of hardware. Accordingly, the techniques depicted in the figures may be implemented using data and code executed and stored on one or more electronic devices (eg, end stations, network elements, etc.). Such electronic devices include non-transitory computer machine-readable storage media (e.g., magnetic disks; optical disks; random access memory; read-only memory; flash memory devices; phase-change memory) and computer machine transients. -using computer machine-readable media, such as readable communication media (e.g., electrical, optical, acoustic or other forms of propagated signals such as carrier waves, infrared signals, digital signals, etc.) Stores and communicates code and data (internally and/or with other electronic devices over a network). Additionally, such electronic devices typically include one or more storage devices (non-transitory machine-readable storage media), user input/output devices (e.g., keyboard, touchscreen, and/or display). , and one or more other components such as network connections. Coupling of a set of processors with other components is typically through one or more buses and bridges (also called bus controllers). The signals carrying the storage device and network traffic represent one or more machine-readable storage media and machine-readable communication media, respectively. Accordingly, a storage device of a given electronic device typically stores code and/or data for execution on a set of one or more processors of that electronic device. Of course, one or more portions of an embodiment of the invention may be implemented using different combinations of software, firmware, and/or hardware. Throughout this detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the invention. However, it will be apparent to those skilled in the art that the present invention may be practiced without some of these specific details. In certain instances, well-known structures and functions have not been described in detail to avoid obscuring the subject matter of the invention. Accordingly, the scope and spirit of the present invention should be judged in light of the following claims.

Claims (55)

As an Internet of Things (IoT) system,
The IoT hub comprising a WAN interface for coupling the IoT hub to IoT services via a WAN and a local communication interface for communicatively coupling the IoT hub to a plurality of different types of IoT devices; and
At least one IoT device having a memory for storing program code and a microcontroller for executing the program code,
The program code includes the library program code including basic building blocks that can be used by a developer to implement any IoT device by generating application program code that uses the library program code, and at least one of the basic building blocks is and a communication stack for enabling communication with the IoT hub and IoT service, wherein the library program code is provided to the developer as a software development kit (SDK) for the microcontroller, and the SDK is provided to the developer. A graphical user design interface that simply specifies inputs and outputs for an IoT device, and the SDK includes the application program code that includes the communication stack to enable communication between the IoT hub and the IoT device. automatically generated;
The SDK also allows the developer to update IoT hub program code stored in IoT hub memory and executed by an IoT hub microcontroller, wherein the IoT hub program code causes the IoT hub to communicate via the local communication interface. A first communication stack that enables communication with the IoT device, a second communication stack that allows the IoT hub to communicate with the IoT service through the WAN interface, and a second communication stack that allows the IoT hub to pair with the IoT device. Containing device pairing program code that allows
Internet of Things system. The Internet of Things system according to claim 1, wherein the IoT device includes a sensor for collecting local data according to the application program code and/or an output control device for performing an output control function according to the application program code. . 2. The method of claim 1, wherein the application program code is executable by the microcontroller to cause the IoT device to perform one or more application-specific functions,
An Internet of Things system, wherein at least one of the functions includes collecting local data or performing a local control function. The Internet of Things system according to claim 1, wherein the IoT device further includes a low-power communication interface for establishing a local communication channel with the IoT hub according to the library program code. The Internet of Things system according to claim 4, wherein the low-power communication interface includes a Bluetooth LE radio for establishing a Bluetooth low energy (LE) communication channel with the IoT hub. The Internet of Things system of claim 1, wherein the WAN includes the Internet. The Internet of Things system according to claim 1, wherein the SDK includes the IoT hub and provides access to the IoT service to the developer. As a method,
Providing the IoT hub including a WAN interface for coupling the IoT hub to IoT services via a WAN and a local communication interface for communicatively coupling the IoT hub to a plurality of different types of IoT devices;
Providing at least one IoT device having a memory for storing program code and a microcontroller for executing the program code; and
providing the program code comprising the library program code containing basic building blocks usable by a developer to implement any IoT device by generating application program code that utilizes the library program code,
At least one of the basic building blocks includes a communication stack to enable communication with the IoT hub, and the library program code is provided to the developer as a software development kit (SDK) for the microcontroller, The SDK includes a graphical user design interface through which the developer only needs to specify inputs and outputs for the IoT device, and the SDK includes the communication stack to enable communication between the IoT hub and the IoT device. automatically generate the application program code that does;
The SDK also allows the developer to update IoT hub program code stored in IoT hub memory and executed by an IoT hub microcontroller, wherein the IoT hub program code causes the IoT hub to communicate via the local communication interface. A first communication stack that enables communication with the IoT device, a second communication stack that allows the IoT hub to communicate with the IoT service through the WAN interface, and a second communication stack that allows the IoT hub to pair with the IoT device. Containing device pairing program code that allows
method. The method of claim 8, wherein the IoT device includes a sensor for collecting local data according to the application program code and/or an output control device for performing an output control function according to the application program code. 9. The method of claim 8, wherein the application program code is executable by the microcontroller to cause the IoT device to perform one or more application-specific functions,
At least one of the functions includes collecting local data or performing a local control function. The method of claim 8, wherein the IoT device further includes a low-power communication interface for establishing a local communication channel with the IoT hub according to the library program code. The method of claim 11 , wherein the low-power communication interface includes a Bluetooth LE radio for establishing a Bluetooth low energy (LE) communication channel with the IoT hub. 9. The method of claim 8, wherein the WAN includes the Internet. The method of claim 8, wherein the SDK includes the IoT hub and provides access to the IoT service to the developer. delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete

Images