WO2019003214A1 - A communication method between at least two devices using natural-language - Google Patents

A communication method between at least two devices using natural-language Download PDF

Info

Publication number
WO2019003214A1
WO2019003214A1 PCT/IL2017/050723 IL2017050723W WO2019003214A1 WO 2019003214 A1 WO2019003214 A1 WO 2019003214A1 IL 2017050723 W IL2017050723 W IL 2017050723W WO 2019003214 A1 WO2019003214 A1 WO 2019003214A1
Authority
WO
WIPO (PCT)
Prior art keywords
instructions
natural
language
executed
devices
Prior art date
Application number
PCT/IL2017/050723
Other languages
French (fr)
Inventor
Assi Abramovitz
Original Assignee
Thomson Licensing
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing filed Critical Thomson Licensing
Priority to PCT/IL2017/050723 priority Critical patent/WO2019003214A1/en
Publication of WO2019003214A1 publication Critical patent/WO2019003214A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/08—Protocols for interworking; Protocol conversion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/56—Provisioning of proxy services
    • H04L67/565—Conversion or adaptation of application format or content

Definitions

  • the present invention relates to a communication method between devices located in a same local network. More particularly, the invention relates to a method enabling devices using different communication protocols to communicate with each other.
  • the Internet of things is the inter-networking of those connected devices, vehicles, etc. embedded with electronics, software, sensors, actuators, and network connectivity that enable these connected devices to collect and exchange data. These connected devices may also be sensed or controlled remotely across existing network infrastructure, creating opportunities for more direct integration of the physical world into computer-based systems, and resulting in improved efficiency, accuracy.
  • IoT is expected to offer advanced connectivity for the connected devices, systems, and services that goes beyond machine-to-machine (M2M) communications and covers a variety of protocols, domains, and applications.
  • the connected devices may refer to a wide variety of devices such as heart monitoring implants, biochip transponders on farm animals, electric clams in coastal waters, automobiles with built-in sensors, current market examples include home automation (also known as smart home devices) such as the control and automation of lighting, heating (like smart thermostat), ventilation, air conditioning systems, air purifiers, ovens or refrigerators/ freezers that use Wi-Fi for remote monitoring, etc.
  • the connected devices located in a network may use different communication protocols to transmit data or receive instructions from remote communication equipments or to communicate with other devices in the local network, for example, depending on their manufacturers.
  • a network such as a home network
  • connected devices located in a same network may not be able to communicate with each other because they do not use the same communication protocols. This leads to a cumbersome situation in which an end-user needs to question himself about the compatibility of the connected devices he introduces in his local network.
  • a communication method between a first device and a least one second device the method being executed by the first device and comprising :
  • Such a method enables a first device located on a local network, e.g. a home network, to agnostically command a second device.
  • converting sets of instructions, intended for one of the second devices located in the local network, received by the first device in different formats and according to different protocols into natural-language makes it possible to command a second device which would not be capable to communicate with the first device otherwise. This is the case for example when the first device and the second devices are manufactured by different companies, each having developed proprietary communication protocols which are not interoperable.
  • the first device and the second devices are within "earshot", e.g. they may be located in a same local network.
  • the method described above takes advantage of the use of natural-language to command other devices in the local network which enables to reduce the amount of integration required for two devices manufactured by different companies to cooperate. Indeed, there is no longer a need for the two devices to discover and authenticate each other, to determine which commands are supported by each of the two devices, when natural language is used for exchanging commands.
  • One of the advantages of using natural-language for commanding devices in a local network is that those devices are made substitutable.
  • the end-user no longer needs to question himself about the compatibility of the devices of his local network, he may introduce any new device in his local network as long as the newly introduced device is capable to process instructions issued in natural- language.
  • the method comprises, prior to converting said set of instructions to be executed by the at least one second device :
  • emitting, through said second interface, said second message comprising said set of natural-language instructions to be executed by said at least one second device consists in converting an electro-magnetic signal carrying said set of natural- language instructions to be executed by said at least one second device into a sound.
  • the second interface of the first device emits sounds corresponding to the set of natural-language instructions to be executed by one of the second devices located in the local network as if the set of natural-language instructions were voiced by the end-user themselves.
  • the second device to which the set of natural-language instructions is intended, acquires sounds corresponding to the set of natural-language instructions to be executed by the second device and converts these sounds into an electro-magnetic signal carrying said set of natural-language instructions. Once this set of natural-language instructions is received, it is then processed and executed by the second device.
  • the sounds emitted by the first device may be voice recordings of the end-user voice, voicing the set of natural-language instructions and played by the second interface of the first device.
  • the sounds emitted by the first device may be synthetized by the second interface of the first device.
  • the set of instructions to be executed by said at least one second device received on said first interface of the first device being a first set of natural- language instructions expressed in a first language
  • the method comprises :
  • Such an embodiment of the invention enables end-users speaking in a first language to instruct via the first device a second device to execute an action while said second device is configured to process instructions issued in a second language.
  • a French speaking end-user may introduce a Chinese speaking second device in his local network and be able to instruct said Chinese speaking second device by issuing natural- language instructions voiced in French.
  • Another object of the invention is a device capable of communicating with at least another device, the device comprising a processor configured to :
  • said processor is further configured to :
  • said processor is further configured to :
  • the set of instructions to be executed by said other device received on said first interface being a first set of natural-language instructions expressed in a first language
  • said processor is further configured to :
  • said device is a gateway interfacing the local network with at least another communication network.
  • elements of the invention may be computer implemented. Accordingly, such elements may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a "circuit", "module” or “system”. Furthermore, such elements may take the form of a computer program product embodied in any tangible medium of expression having computer usable program code embodied in the medium. Since elements of the present invention can be implemented in software, the present invention can be embodied as computer readable code for provision to a programmable apparatus on any suitable carrier medium.
  • a tangible carrier medium may comprise a storage medium such as a floppy disk, a CD-ROM, a hard disk drive, a magnetic tape device or a solid state memory device and the like.
  • a transient carrier medium may include a signal such as an electrical signal, an electronic signal, an optical signal, an acoustic signal, a magnetic signal or an electromagnetic signal, e.g. a microwave or RF signal.
  • FIG. 1 represents a communication system, comprising a plurality of connected devices in which the method according to an embodiment of the invention is executed;
  • FIG. 2 is a schematic block diagram illustrating an example of the device according to an embodiment of the invention.
  • FIG. 3 is a schematic block diagram illustrating an example of the devices according to an embodiment of the invention.
  • FIG. 4 is a flow chart for explaining a process for controlling a plurality of devices, for example, located in a same communication network using natural-language instructions according to an embodiment of the invention
  • FIG. 5 is a flow chart for explaining a process of communication between devices using natural-language instructions according to an embodiment of the invention.
  • aspects of the present principles can be embodied as a system, method or computer readable medium. Accordingly, aspects of the present principles can take the form of an entirely hardware embodiment, an entirely software embodiment, (including firmware, resident software, micro-code, and so forth) or an embodiment combining software and hardware aspects that can all generally be referred to herein as a "circuit", "module”, or “system”. Furthermore, aspects of the present principles can take the form of a computer readable storage medium. Any combination of one or more computer readable storage medium(a) may be utilized.
  • Figure 1 represents a communication system, comprising a plurality of connected devices 10-
  • a device 10 interconnects a first communication network WAN, such as the Internet or more generally a broadband network, and a second communication network LAN, such as a local network and more particularly a home network.
  • a plurality of devices 11-13 are located in the home network LAN and are connected to the device 10 by means of wired links, such as Ethernet links, or wireless links, such as through a Z-Wave connection, an Alljoyn connection, or a Zig Bee connection, etc.
  • the devices 10-13 may be within earshot one from another. Thus, the devices 10-13 may not be located on a same local network.
  • the device 11 may be for example a device capable of controlling lights in a garden.
  • the device 11 controls the lights through a Z-Wave controller.
  • the device 12 may be for example a device capable of controlling a garage door.
  • the device 12 may be for example a device capable of controlling a garage door.
  • the device 13 may be for example a device capable of controlling a water heater.
  • the device 13 may be for example a device capable of controlling a water heater.
  • the devices 10-13 embed interfaces supporting natural-language based communication so that the device 10 is capable of issuing natural-language instructions to the devices 11-13 instead of using a dedicated communication protocol for issuing instructions to each devices 11-13.
  • FIG. 2 is a schematic block diagram illustrating an example of the device 10 according to an embodiment of the invention.
  • the device 10 may be, for example, a home gateway interfacing a home network with a broadband network or an access point of a local network. More generally, the device 10 is a device capable of communicating with a plurality of other devices.
  • the device 10 comprises a processor 201, a storage unit 202, an input device 203, a display device 204, and an interface unit 205 which are connected by a bus 206. Of course, constituent elements of the device 10 may be connected by a connection other than a bus connection.
  • the device 10 further comprises at least one network interface 207 for communicating with the broadband network.
  • Such a network interface 207 is for example configured to receive and transmit data from and to a DSLAM (Digital Subscriber Line Access Multiplexer) using xDSL (x Digital Subscriber Line) or from and to an OLT ⁇ Optical Line Termination) through an optical fiber or from a eNodeB (evolved Node B) of a LTE (Long Term Evolution) network.
  • DSLAM Digital Subscriber Line Access Multiplexer
  • xDSL x Digital Subscriber Line
  • OLT ⁇ Optical Line Termination
  • the processor 201 controls operations of the device 10.
  • the storage unit 202 stores at least one program capable of, upon reception on the interface unit 205, the input device 203, or the network interface 207, of at least a set of instructions to be executed by at least one of the devices 11-13, converting the received set of instructions into a set of natural-language instructions, and controlling a transmission interface 208, embedded in the device 10 and connected to the bus 206, capable of transmitting the set of natural-language instructions to one of the devices 11-13.
  • the program stored on the storage unit 202 is to be executed by the processor 201, as well as parameters used by computations performed by the processor 301, intermediate data of computations performed by the processor 301, and so on are stored as well on the storage unit 202.
  • the processor 201 may be formed by any known and suitable hardware, or software, or a combination of hardware and software.
  • the processor 201 may be formed by dedicated hardware such as a processing circuit, or by a programmable processing unit such as a CPU (Central Processing Unif) that executes a program stored in a memory thereof.
  • a CPU Central Processing Unif
  • the storage unit 202 may be formed by any suitable storage or means capable of storing the program, data, or the like in a computer-readable manner. Examples of the storage unit 202 include non-transitory computer-readable storage media such as semiconductor memory devices, and magnetic, optical, or magneto-optical recording media loaded into a read and write unit.
  • the program causes the processor 201 to perform, upon reception of at least a set of instructions to be executed by at least one of the devices 11-13, a process for converting the received set of instructions into a set of natural-language instructions, and controlling the transmission interface 208 capable of transmitting the set of natural-language instructions to one of the devices 11-13, according to an embodiment of the present disclosure as described hereinafter with reference to figures 4 and 5.
  • the input device 203 may be formed by a keyboard, a pointing device such as a mouse, or the like for use by the user to input commands or instructions to be executed by the devices 11-13.
  • the output device 204 may be formed by a display device to display, for example, a Graphical User Interface (GUI).
  • GUI Graphical User Interface
  • the input device 203 and the output device 204 may be formed integrally by a touchscreen panel, for example.
  • the interface unit 205 provides an interface between the device 10 and an external apparatus.
  • the interface unit 205 may be communicable with the external apparatus via cable or wireless communication.
  • Figure 3 is a schematic block diagram illustrating an example of the devices 11-13 according to an embodiment of the invention.
  • the devices 11-13 each comprise a processor 301, a storage unit 302, an input device 303, a display device 304, and an interface unit 305 which are connected by a bus 306.
  • constituent elements of the devices 11-13 may be connected by a connection other than a bus connection.
  • the processors 301 control operations of the devices 11-13.
  • the storage units 302 each store at least one program capable to convert a set of natural-language instructions received from the device 10 into instructions that can be executed by the processor 301, as well as parameters used by computations performed by the processors 301, intermediate data of computations performed by the processors 301, and so on.
  • the processors 301 may be formed by any known and suitable hardware, or software, or a combination of hardware and software.
  • the processors 301 may be formed by dedicated hardware such as a processing circuit, or by a programmable processing unit such as a CPU ⁇ Central Processing Unit) that executes a program stored in a memory thereof.
  • the storage units 302 may be formed by any suitable storage or means capable of storing the program, data, or the like in a computer-readable manner. Examples of storage units 302 include non- transitory computer-readable storage media such as semiconductor memory devices, and magnetic, optical, or magneto-optical recording media loaded into a read and write unit.
  • the program causes the processors 301 to perform a process for converting a set of natural-language instructions received from the device 10 into instructions executable by the processors 301 according to an embodiment of the present disclosure as described hereinafter with reference to figure 4.
  • the input devices 303 may be formed by a keyboard, a pointing device such as a mouse, or the like for use by the user to input commands, to make user's selections of parameters used for selecting the transmission interface to be used.
  • the output devices 304 may be formed by a display device to display, for example, a Graphical User Interface (GUI).
  • GUI Graphical User Interface
  • the input devices 303 and the output devices 304 may be formed integrally by a touchscreen panel, for example.
  • the interface units 305 provide an interface between the devices 11-13 and an external apparatus.
  • the interface units 305 may be communicable with the external apparatus via cable, wireless communication.
  • Figure 4 is a flow chart for explaining a process for controlling a plurality of devices, for example, located in a same communication network using natural-language instructions according to an embodiment of the invention.
  • a first set of instructions to be executed by one of the devices 11-13 is received through the interface unit 205, the input device 203, or the network interface 207 of the device 10.
  • the device 10 may receive a message comprising the set of instructions to be executed by one of the devices 11-13 through the network interface 207 and via an xDSL link or a radio link.
  • the device 10 may receive the set of instructions through either the input device 203 when the message comprises written natural-language instructions or through the interface unit 205, which in this case is a microphone, when the message comprises voiced natural-language instructions.
  • An end-user can issue instructions for one of the devices 11-13 by sending messages to the device 10 by different means such as for example an application, which may be loaded on a mobile device, by direcriy voicing the instructions to the device 10 or through a dedicated API ⁇ Application Programming Interface) embedded in the device 10.
  • an application which may be loaded on a mobile device, by direcriy voicing the instructions to the device 10 or through a dedicated API ⁇ Application Programming Interface) embedded in the device 10.
  • the processor 201 converts the received set of instructions into a set of natural-language instructions such as "heat the water” or "turn on the lights", in a step 402.
  • step 402 the set of natural-language instructions obtained during step 402 is transmitted through the transmission interface 208 in a step 403.
  • the processor 201 transmits said set of natural-language instructions to the device 11-13 for which the instructions are intended through the transmission interface 208 during step 403.
  • the set of natural-language instructions to be transmitted to one of the devices 11-13 may be voiced to the device 11-13 or written and sent in a message to the device 11-13.
  • the processor 201 converts an electro-magnetic signal carrying said set of natural-language instructions into a sound in a step 404.
  • the emitted sound is then emitted by the transmission interface 208 during step 403.
  • the emitted sound may be a voice recording of the end-user voice played by the transmission interface 208, or may be synthetized by the transmission interface 208.
  • the processor 201 When the set of natural-language instructions is written, the processor 201 generates a message comprising the written set of natural-language instructions, such as a message according to HTTP (HyperText Transfer Protocol) or MQTT (Message Queue Telemetry Transport) protocol for example, which is then transmitted by the transmission interface 208 during step 403.
  • HTTP HyperText Transfer Protocol
  • MQTT Message Queue Telemetry Transport
  • the device 10 may receive a first set of natural- language instructions expressed in a first language, such as French for example, through the interface unit 205, the input device 203, or the network interface 207.
  • the processor 201 thus converts, in a step 405, this first set of natural-language instructions expressed in a first language into a second set of natural-language instructions expressed in a second language such as Chinese for example, prior to emitting said set of natural-language instructions during step 403.
  • the second set of natural-language instructions expressed in a second language may be voiced to the device 11-13 or written and sent in a message to the device 11-13.
  • Figure 5 is a flow chart for explaining a process of communication between devices using natural-language instructions according to an embodiment of the invention.
  • a step 501 a set of natural-language instructions to be executed is received by one the devices 11-13 through the interface unit 305.
  • the set of natural-language instructions received by one of the devices 11-13 may be voiced by the device 10 or written and sent in a message by the device 10
  • the processor 301 converts a sound carrying said set of natural-language instructions into an electro-magnetic signal in a step 502.
  • the interface unit 305 receives a message comprising the written set of natural-language instructions, such as a message according to HTTP or MQTT for example.
  • the processor 301 then converts the received set of natural-language instructions into a set of instructions issued according to a communication protocol used by the device 11, 12, 13, in a step 503.

Abstract

The Internet of things is the inter-networking of connected devices, and network connectivity that enable these connected devices to collect and exchange data. The connected devices located in a network, such as a home network, may use different communication protocols to transmit data or receive instructions from remote communication equipments or to communicate with other devices. However, because of their heterogeneity, these connected devices not be able to communicate with each other because they do not use the same communication protocols. The method according to an embodiment of the invention enables a first device to agnostically command a second device by converting sets of instructions, intended for the second device and received by the first device according to different protocols into natural-language.

Description

A COMMUNICATION METHOD BETWEEN AT LEAST TWO DEVICES USING
NATURAL-LANGUAGE
TECHNICAL FIELD The present invention relates to a communication method between devices located in a same local network. More particularly, the invention relates to a method enabling devices using different communication protocols to communicate with each other.
BACKGROUND
In the past years, with the developing of communication networks, and more particularly wireless networks, a new kind of devices, called connected devices or smart devices, appeared.
The Internet of things (IoT) is the inter-networking of those connected devices, vehicles, etc. embedded with electronics, software, sensors, actuators, and network connectivity that enable these connected devices to collect and exchange data. These connected devices may also be sensed or controlled remotely across existing network infrastructure, creating opportunities for more direct integration of the physical world into computer-based systems, and resulting in improved efficiency, accuracy.
Typically, IoT is expected to offer advanced connectivity for the connected devices, systems, and services that goes beyond machine-to-machine (M2M) communications and covers a variety of protocols, domains, and applications. The connected devices may refer to a wide variety of devices such as heart monitoring implants, biochip transponders on farm animals, electric clams in coastal waters, automobiles with built-in sensors, current market examples include home automation (also known as smart home devices) such as the control and automation of lighting, heating (like smart thermostat), ventilation, air conditioning systems, air purifiers, ovens or refrigerators/ freezers that use Wi-Fi for remote monitoring, etc. The connected devices located in a network, such as a home network, may use different communication protocols to transmit data or receive instructions from remote communication equipments or to communicate with other devices in the local network, for example, depending on their manufacturers. Thus, because of their heterogeneity, connected devices located in a same network may not be able to communicate with each other because they do not use the same communication protocols. This leads to a cumbersome situation in which an end-user needs to question himself about the compatibility of the connected devices he introduces in his local network.
Therefore, there is a need for a solution for making compatible connected devices which are currently not compatible. The present invention has been devised with the foregoing in mind.
SUMMARY OF INVENTION
According to a first aspect of the invention there is provided a communication method between a first device and a least one second device, the method being executed by the first device and comprising :
- converting a set of instructions to be executed by the at least one second device into a set of natural-language instructions to be executed by said at least one second device,
- emitting, through a second interface, at least a second message comprising said set of natural- language instructions to be executed by said at least one second devices.
Such a method enables a first device located on a local network, e.g. a home network, to agnostically command a second device. Indeed, converting sets of instructions, intended for one of the second devices located in the local network, received by the first device in different formats and according to different protocols into natural-language makes it possible to command a second device which would not be capable to communicate with the first device otherwise. This is the case for example when the first device and the second devices are manufactured by different companies, each having developed proprietary communication protocols which are not interoperable. The first device and the second devices are within "earshot", e.g. they may be located in a same local network.
The method described above takes advantage of the use of natural-language to command other devices in the local network which enables to reduce the amount of integration required for two devices manufactured by different companies to cooperate. Indeed, there is no longer a need for the two devices to discover and authenticate each other, to determine which commands are supported by each of the two devices, when natural language is used for exchanging commands.
One of the advantages of using natural-language for commanding devices in a local network is that those devices are made substitutable. The end-user no longer needs to question himself about the compatibility of the devices of his local network, he may introduce any new device in his local network as long as the newly introduced device is capable to process instructions issued in natural- language.
According to an embodiment of the invention, the method comprises, prior to converting said set of instructions to be executed by the at least one second device :
- receiving, on a first interface, at least a first message comprising said set of instructions to be executed by at least one of the second devices.
According to an embodiment of the invention, emitting, through said second interface, said second message comprising said set of natural-language instructions to be executed by said at least one second device, consists in converting an electro-magnetic signal carrying said set of natural- language instructions to be executed by said at least one second device into a sound.
In this embodiment of the invention, the second interface of the first device emits sounds corresponding to the set of natural-language instructions to be executed by one of the second devices located in the local network as if the set of natural-language instructions were voiced by the end-user themselves. The second device, to which the set of natural-language instructions is intended, acquires sounds corresponding to the set of natural-language instructions to be executed by the second device and converts these sounds into an electro-magnetic signal carrying said set of natural-language instructions. Once this set of natural-language instructions is received, it is then processed and executed by the second device.
The sounds emitted by the first device may be voice recordings of the end-user voice, voicing the set of natural-language instructions and played by the second interface of the first device.
The sounds emitted by the first device may be synthetized by the second interface of the first device.
According to an embodiment of the invention, the set of instructions to be executed by said at least one second device received on said first interface of the first device being a first set of natural- language instructions expressed in a first language, the method comprises :
- converting said first set of natural-language instructions expressed in a first language into said set of natural-language instructions to be executed by said at least one second device expressed in a second language, prior to emitting said set of natural-language instructions to be executed by said at least one second device expressed in a second language through said second interface.
Such an embodiment of the invention enables end-users speaking in a first language to instruct via the first device a second device to execute an action while said second device is configured to process instructions issued in a second language.
For example, a French speaking end-user may introduce a Chinese speaking second device in his local network and be able to instruct said Chinese speaking second device by issuing natural- language instructions voiced in French.
These natural-language instructions voiced in French are concerted in natural-language instructions expressed in Chinese by the first device.
Another object of the invention is a device capable of communicating with at least another device, the device comprising a processor configured to :
- convert a set of instructions to be executed by the other device into a set of natural-language instructions to be executed by said other device, - emit, through a second interface of said device, at least a second message comprising said set of natural-language instructions to be executed by said other device.
According to an embodiment of the invention, said processor is further configured to :
- receive, on a first interface of said device, at least a first message comprising said set of instructions to be executed by the other device, prior to convert said set of instructions.
According to an embodiment of the invention, said processor is further configured to :
- convert an electro-magnetic signal carrying said message comprising said set of natural- language instructions to be executed by said other device into a sound,
- emit said sound through said second interface.
According to an embodiment of the invention, the set of instructions to be executed by said other device received on said first interface being a first set of natural-language instructions expressed in a first language, said processor is further configured to :
- convert said first set of natural-language instructions expressed in a first language into said set of natural-language instructions to be executed by said other device expressed in a second language, prior to emit said set of natural-language instructions to be executed by said other device expressed in a second language through said second interface.
According to an embodiment of the invention, said device is a gateway interfacing the local network with at least another communication network.
Some processes implemented by elements of the invention may be computer implemented. Accordingly, such elements may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a "circuit", "module" or "system". Furthermore, such elements may take the form of a computer program product embodied in any tangible medium of expression having computer usable program code embodied in the medium. Since elements of the present invention can be implemented in software, the present invention can be embodied as computer readable code for provision to a programmable apparatus on any suitable carrier medium. A tangible carrier medium may comprise a storage medium such as a floppy disk, a CD-ROM, a hard disk drive, a magnetic tape device or a solid state memory device and the like. A transient carrier medium may include a signal such as an electrical signal, an electronic signal, an optical signal, an acoustic signal, a magnetic signal or an electromagnetic signal, e.g. a microwave or RF signal.
BRIEF DESCRIPTION OF THE DRAWINGS
Embodiments of the invention will now be described, by way of example only, and with reference to the following drawings in which:
FIG. 1 represents a communication system, comprising a plurality of connected devices in which the method according to an embodiment of the invention is executed;
FIG. 2 is a schematic block diagram illustrating an example of the device according to an embodiment of the invention,
FIG. 3 is a schematic block diagram illustrating an example of the devices according to an embodiment of the invention,
FIG. 4 is a flow chart for explaining a process for controlling a plurality of devices, for example, located in a same communication network using natural-language instructions according to an embodiment of the invention,
FIG. 5 is a flow chart for explaining a process of communication between devices using natural-language instructions according to an embodiment of the invention.
DETAILED DESCRIPTION
As will be appreciated by one skilled in the art, aspects of the present principles can be embodied as a system, method or computer readable medium. Accordingly, aspects of the present principles can take the form of an entirely hardware embodiment, an entirely software embodiment, (including firmware, resident software, micro-code, and so forth) or an embodiment combining software and hardware aspects that can all generally be referred to herein as a "circuit", "module", or "system". Furthermore, aspects of the present principles can take the form of a computer readable storage medium. Any combination of one or more computer readable storage medium(a) may be utilized.
Figure 1 represents a communication system, comprising a plurality of connected devices 10-
13. A device 10, such as a gateway, interconnects a first communication network WAN, such as the Internet or more generally a broadband network, and a second communication network LAN, such as a local network and more particularly a home network. A plurality of devices 11-13 are located in the home network LAN and are connected to the device 10 by means of wired links, such as Ethernet links, or wireless links, such as through a Z-Wave connection, an Alljoyn connection, or a Zig Bee connection, etc.
More generally, the devices 10-13 may be within earshot one from another. Thus, the devices 10-13 may not be located on a same local network.
The device 11 may be for example a device capable of controlling lights in a garden. The device 11 controls the lights through a Z-Wave controller.
The device 12 may be for example a device capable of controlling a garage door. The device
12 controls the garage door through an Alljoyn controller.
The device 13 may be for example a device capable of controlling a water heater. The device
13 controls the water heater through a Zig Bee controller.
According to an embodiment of the invention, the devices 10-13 embed interfaces supporting natural-language based communication so that the device 10 is capable of issuing natural-language instructions to the devices 11-13 instead of using a dedicated communication protocol for issuing instructions to each devices 11-13.
Figure 2 is a schematic block diagram illustrating an example of the device 10 according to an embodiment of the invention. The device 10 may be, for example, a home gateway interfacing a home network with a broadband network or an access point of a local network. More generally, the device 10 is a device capable of communicating with a plurality of other devices.
The device 10 comprises a processor 201, a storage unit 202, an input device 203, a display device 204, and an interface unit 205 which are connected by a bus 206. Of course, constituent elements of the device 10 may be connected by a connection other than a bus connection. The device 10 further comprises at least one network interface 207 for communicating with the broadband network. Such a network interface 207 is for example configured to receive and transmit data from and to a DSLAM (Digital Subscriber Line Access Multiplexer) using xDSL (x Digital Subscriber Line) or from and to an OLT {Optical Line Termination) through an optical fiber or from a eNodeB (evolved Node B) of a LTE (Long Term Evolution) network.
The processor 201 controls operations of the device 10. The storage unit 202 stores at least one program capable of, upon reception on the interface unit 205, the input device 203, or the network interface 207, of at least a set of instructions to be executed by at least one of the devices 11-13, converting the received set of instructions into a set of natural-language instructions, and controlling a transmission interface 208, embedded in the device 10 and connected to the bus 206, capable of transmitting the set of natural-language instructions to one of the devices 11-13. The program stored on the storage unit 202 is to be executed by the processor 201, as well as parameters used by computations performed by the processor 301, intermediate data of computations performed by the processor 301, and so on are stored as well on the storage unit 202. The processor 201 may be formed by any known and suitable hardware, or software, or a combination of hardware and software. For example, the processor 201 may be formed by dedicated hardware such as a processing circuit, or by a programmable processing unit such as a CPU (Central Processing Unif) that executes a program stored in a memory thereof.
The storage unit 202 may be formed by any suitable storage or means capable of storing the program, data, or the like in a computer-readable manner. Examples of the storage unit 202 include non-transitory computer-readable storage media such as semiconductor memory devices, and magnetic, optical, or magneto-optical recording media loaded into a read and write unit. The program causes the processor 201 to perform, upon reception of at least a set of instructions to be executed by at least one of the devices 11-13, a process for converting the received set of instructions into a set of natural-language instructions, and controlling the transmission interface 208 capable of transmitting the set of natural-language instructions to one of the devices 11-13, according to an embodiment of the present disclosure as described hereinafter with reference to figures 4 and 5.
The input device 203 may be formed by a keyboard, a pointing device such as a mouse, or the like for use by the user to input commands or instructions to be executed by the devices 11-13. The output device 204 may be formed by a display device to display, for example, a Graphical User Interface (GUI). The input device 203 and the output device 204 may be formed integrally by a touchscreen panel, for example.
The interface unit 205 provides an interface between the device 10 and an external apparatus. The interface unit 205 may be communicable with the external apparatus via cable or wireless communication.
Figure 3 is a schematic block diagram illustrating an example of the devices 11-13 according to an embodiment of the invention.
The devices 11-13 each comprise a processor 301, a storage unit 302, an input device 303, a display device 304, and an interface unit 305 which are connected by a bus 306. Of course, constituent elements of the devices 11-13 may be connected by a connection other than a bus connection.
The processors 301 control operations of the devices 11-13. The storage units 302 each store at least one program capable to convert a set of natural-language instructions received from the device 10 into instructions that can be executed by the processor 301, as well as parameters used by computations performed by the processors 301, intermediate data of computations performed by the processors 301, and so on. The processors 301 may be formed by any known and suitable hardware, or software, or a combination of hardware and software. For example, the processors 301 may be formed by dedicated hardware such as a processing circuit, or by a programmable processing unit such as a CPU {Central Processing Unit) that executes a program stored in a memory thereof.
The storage units 302 may be formed by any suitable storage or means capable of storing the program, data, or the like in a computer-readable manner. Examples of storage units 302 include non- transitory computer-readable storage media such as semiconductor memory devices, and magnetic, optical, or magneto-optical recording media loaded into a read and write unit. The program causes the processors 301 to perform a process for converting a set of natural-language instructions received from the device 10 into instructions executable by the processors 301 according to an embodiment of the present disclosure as described hereinafter with reference to figure 4.
The input devices 303 may be formed by a keyboard, a pointing device such as a mouse, or the like for use by the user to input commands, to make user's selections of parameters used for selecting the transmission interface to be used. The output devices 304 may be formed by a display device to display, for example, a Graphical User Interface (GUI). The input devices 303 and the output devices 304 may be formed integrally by a touchscreen panel, for example.
The interface units 305 provide an interface between the devices 11-13 and an external apparatus. The interface units 305 may be communicable with the external apparatus via cable, wireless communication.
Figure 4 is a flow chart for explaining a process for controlling a plurality of devices, for example, located in a same communication network using natural-language instructions according to an embodiment of the invention.
In a step 401, a first set of instructions to be executed by one of the devices 11-13 is received through the interface unit 205, the input device 203, or the network interface 207 of the device 10. For example, the device 10 may receive a message comprising the set of instructions to be executed by one of the devices 11-13 through the network interface 207 and via an xDSL link or a radio link. In another example, the device 10 may receive the set of instructions through either the input device 203 when the message comprises written natural-language instructions or through the interface unit 205, which in this case is a microphone, when the message comprises voiced natural-language instructions. An end-user can issue instructions for one of the devices 11-13 by sending messages to the device 10 by different means such as for example an application, which may be loaded on a mobile device, by direcriy voicing the instructions to the device 10 or through a dedicated API {Application Programming Interface) embedded in the device 10.
When the received set of instructions comprises instructions issued according to a communication protocol used by one of the devices 11-13, such as Zig Bee, i.e. the instructions are not issued in natural-language, the processor 201 converts the received set of instructions into a set of natural-language instructions such as "heat the water" or "turn on the lights", in a step 402.
Known methods exist for converting instructions issued according to a communication protocol into natural-language instructions. An example of such a method is given in table 1 :
Figure imgf000013_0001
Table 1
Then, the set of natural-language instructions obtained during step 402 is transmitted through the transmission interface 208 in a step 403.
When the received set of instructions already consists in natural-language instructions, the processor 201 transmits said set of natural-language instructions to the device 11-13 for which the instructions are intended through the transmission interface 208 during step 403.
The set of natural-language instructions to be transmitted to one of the devices 11-13 may be voiced to the device 11-13 or written and sent in a message to the device 11-13.
When the set of natural-language instructions is to be voiced to the device 11-13, the processor 201 converts an electro-magnetic signal carrying said set of natural-language instructions into a sound in a step 404.
This sound is then emitted by the transmission interface 208 during step 403. The emitted sound may be a voice recording of the end-user voice played by the transmission interface 208, or may be synthetized by the transmission interface 208.
When the set of natural-language instructions is written, the processor 201 generates a message comprising the written set of natural-language instructions, such as a message according to HTTP (HyperText Transfer Protocol) or MQTT (Message Queue Telemetry Transport) protocol for example, which is then transmitted by the transmission interface 208 during step 403.
According to an embodiment of the invention, the device 10 may receive a first set of natural- language instructions expressed in a first language, such as French for example, through the interface unit 205, the input device 203, or the network interface 207. The processor 201 thus converts, in a step 405, this first set of natural-language instructions expressed in a first language into a second set of natural-language instructions expressed in a second language such as Chinese for example, prior to emitting said set of natural-language instructions during step 403. The second set of natural-language instructions expressed in a second language may be voiced to the device 11-13 or written and sent in a message to the device 11-13.
Figure 5 is a flow chart for explaining a process of communication between devices using natural-language instructions according to an embodiment of the invention. In a step 501, a set of natural-language instructions to be executed is received by one the devices 11-13 through the interface unit 305.
The set of natural-language instructions received by one of the devices 11-13 may be voiced by the device 10 or written and sent in a message by the device 10
When the set of natural-language instructions is voiced by the device 10, the processor 301 converts a sound carrying said set of natural-language instructions into an electro-magnetic signal in a step 502.
When the set of natural-language instructions is written, the interface unit 305 receives a message comprising the written set of natural-language instructions, such as a message according to HTTP or MQTT for example.
The processor 301 then converts the received set of natural-language instructions into a set of instructions issued according to a communication protocol used by the device 11, 12, 13, in a step 503.
Known methods exist for converting natural-language instructions into instructions issued according to a communication protocol.
Although the present invention has been described hereinabove with reference to specific embodiments, the present invention is not limited to the specific embodiments, and modifications will be apparent to a skilled person in the art which lie within the scope of the present invention.
Many further modifications and variations will suggest themselves to those versed in the art upon making reference to the foregoing illustrative embodiments, which are given by way of example only and which are not intended to limit the scope of the invention, that being determined solely by the appended claims. In particular the different features from different embodiments may be interchanged, where appropriate.

Claims

CLAIMS:
1. A communication method between a first device and a least one second device, the method being executed by the first device and comprising :
- converting a set of instructions to be executed by the at least one second device into a set of natural-language instructions to be executed by said at least one second device,
- emitting, through a second interface, at least a second message comprising said set of natural- language instructions to be executed by said at least one second devices.
2. The communication method according to claim 1, comprising prior to converting said set of instructions to be executed by the at least one second device :
- receiving, on a first interface, at least a first message comprising said set of instructions to be executed by at least one of the second devices.
3. The communication method according to claim 1, wherein emitting, through said second interface, said second message comprising said set of natural-language instructions to be executed by said at least one second device, consists in converting an electro-magnetic signal carrying said set of natural-language instructions to be executed by said at least one second device into a sound.
4. The communication method according to claim 3 wherein, the set of instructions to be executed by said at least one second device received on said first interface of the first device being a first set of natural-language instructions expressed in a first language, the method comprises :
- converting said first set of natural-language instructions expressed in a first language into said set of natural-language instructions to be executed by said at least one second device expressed in a second language, prior to emitting said set of natural-language instructions to be executed by said at least one second device expressed in a second language through said second interface.
5. A device capable of communicating with at least another device, the device comprising a processor configured to : - convert a set of instructions to be executed by the other device into a set of natural-language instructions to be executed by said other device,
- emit, through a second interface of said device, at least a second message comprising said set of natural-language instructions to be executed by said other device.
6. The device according to claim 5 wherein said processor is further configured to :
- receive, on a first interface of said device, at least a first message comprising said set of instructions to be executed by the other device, prior to convert said set of instructions.
7. The device according to claim 5 wherein said processor is further configured to :
- convert an electro-magnetic signal carrying said message comprising said set of natural- language instructions to be executed by said other device into a sound,
- emit said sound through said second interface.
8. The device according to claim 7 wherein, the set of instructions to be executed by said other device received on said first interface being a first set of natural-language instructions expressed in a first language, said processor is further configured to :
- convert said first set of natural-language instructions expressed in a first language into said set of natural-language instructions to be executed by said other device expressed in a second language, prior to emit said set of natural-language instructions to be executed by said other device expressed in a second language through said second interface.
9. The device according to any of claims 5 to 8 wherein said device is a gateway interfacing the local network with at least another communication network.
10. A computer program characterized in that it comprises program code instructions for the implementation of the communication method according to any of claims 1 to 4 when the program is executed by a processor.
11. A processor readable medium having stored therein instructions for causing a processor to perform the communication method according to any of claims 1 to 4.
PCT/IL2017/050723 2017-06-29 2017-06-29 A communication method between at least two devices using natural-language WO2019003214A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/IL2017/050723 WO2019003214A1 (en) 2017-06-29 2017-06-29 A communication method between at least two devices using natural-language

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IL2017/050723 WO2019003214A1 (en) 2017-06-29 2017-06-29 A communication method between at least two devices using natural-language

Publications (1)

Publication Number Publication Date
WO2019003214A1 true WO2019003214A1 (en) 2019-01-03

Family

ID=59313288

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL2017/050723 WO2019003214A1 (en) 2017-06-29 2017-06-29 A communication method between at least two devices using natural-language

Country Status (1)

Country Link
WO (1) WO2019003214A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020161928A1 (en) * 2000-10-10 2002-10-31 Awele Ndili Smart agent for providing network content to wireless devices
US20040010561A1 (en) * 2002-07-11 2004-01-15 Lg Electronics Inc. System for remotely controlling home appliances and method for operating the same

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020161928A1 (en) * 2000-10-10 2002-10-31 Awele Ndili Smart agent for providing network content to wireless devices
US20040010561A1 (en) * 2002-07-11 2004-01-15 Lg Electronics Inc. System for remotely controlling home appliances and method for operating the same

Similar Documents

Publication Publication Date Title
CN105471686B (en) Terminal control method, device and system
CN112995348B (en) Control method, device and system of Internet of things equipment
CN108683574A (en) A kind of apparatus control method, server and intelligent domestic system
EP1569419B1 (en) Method of assigning addresses to a plurality of devices on a network and a network system therefor
US20100121968A1 (en) System and method for automating operations of household systems from remote applications
WO2018192304A1 (en) Intelligent terminal, network entry device, network distribution system, and method
JP7043615B2 (en) Methods and devices for identifying information domain values in DCI
CN113783831B (en) Internet of things information processing method, device and system
TW201408019A (en) System, method and computer program product for protocol adaptation
BR112020010717A2 (en) methods, devices, and systems for determining concession-free initial transmission
CN111741538B (en) Communication link establishing method based on gateway, equipment control method and device
JP2008152343A (en) Home electric appliance controller and home electric appliance control method
CN108431701A (en) Control method, control panel and the control system of smart home device
CN108234562B (en) Equipment control method, control equipment and controlled equipment
CN106688197A (en) Beamforming configuration scheme
US11098914B2 (en) System and method for operating a HVAC system by determining occupied state of a structure via IP address
JP2005176382A (en) X10 communication of one or more messages between one or more mobile communication devices and one or more module components
CN108989157B (en) Method and device for controlling intelligent equipment
KR102320027B1 (en) Voice transmission method, voice transmission apparatus implementing the same, and system including the same
CN109741593A (en) A kind of remote control method of household electrical appliances, the remote control system of mobile terminal and household electrical appliances
WO2019003214A1 (en) A communication method between at least two devices using natural-language
JP2015119389A (en) Communication adapter
WO2017132826A1 (en) Ventilation management method and system for internet of things
CN115314864A (en) Communication system, method and device
KR20120027687A (en) M2m module for supporting serial communication emulation through wibro network and operation method thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17737648

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17737648

Country of ref document: EP

Kind code of ref document: A1