CN109618202B - Method for controlling peripheral equipment, television and readable storage medium - Google Patents

Method for controlling peripheral equipment, television and readable storage medium Download PDF

Info

Publication number
CN109618202B
CN109618202B CN201811586659.4A CN201811586659A CN109618202B CN 109618202 B CN109618202 B CN 109618202B CN 201811586659 A CN201811586659 A CN 201811586659A CN 109618202 B CN109618202 B CN 109618202B
Authority
CN
China
Prior art keywords
control instruction
information
voice
controlling
controlled
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811586659.4A
Other languages
Chinese (zh)
Other versions
CN109618202A (en
Inventor
尚应生
刘华兵
雷倍一
吕伟龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Skyworth RGB Electronics Co Ltd
Original Assignee
Shenzhen Skyworth RGB Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Skyworth RGB Electronics Co Ltd filed Critical Shenzhen Skyworth RGB Electronics Co Ltd
Priority to CN201811586659.4A priority Critical patent/CN109618202B/en
Priority to PCT/CN2019/078836 priority patent/WO2020133741A1/en
Publication of CN109618202A publication Critical patent/CN109618202A/en
Application granted granted Critical
Publication of CN109618202B publication Critical patent/CN109618202B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4108—Peripherals receiving signals from specially adapted client devices characterised by an identification number or address, e.g. local network address
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00—Speaker identification or verification techniques
    • G10L17/22—Interactive procedures; Man-machine interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42225—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details characterized by types of remote control, e.g. universal remote control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42684—Client identification by a unique number or address, e.g. serial number, MAC address, socket ID
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Acoustics & Sound (AREA)
  • Computational Linguistics (AREA)
  • General Engineering & Computer Science (AREA)
  • Power Engineering (AREA)
  • Telephonic Communication Services (AREA)
  • Selective Calling Equipment (AREA)

Abstract

The invention discloses a method for controlling peripheral equipment, a television and a readable storage medium, wherein the method for controlling the peripheral equipment comprises the following steps: when the television is in a starting or standby state, receiving voice information; generating a control instruction based on the voice information; sending the control instruction to the shadow equipment corresponding to the equipment to be controlled through the IOT platform; and making a response action corresponding to the control instruction through the controller. The method for the synchronization state of the shadow device can avoid the problems that the device state cannot be synchronized and the state load of multiple application program request devices is overlarge due to unstable network, and greatly improves the response efficiency of the multiple platforms for requesting the device state at the same time.

Description

Method for controlling peripheral equipment, television and readable storage medium
Technical Field
The invention relates to the technical field of televisions, in particular to a method for controlling peripheral equipment, a television and a readable storage medium.
Background
In recent years, the technology of internet of things has been rapidly developed, the application range of the technology of internet of things relates to a plurality of industries such as electronics, communication, software and the like, as the realization of the internet of things of home life in the future, the development of smart homes has attracted attention, and the development speed is more and more different. The television is used as a leading role of a living room in future home life, bears the intelligence and the interestingness of large-screen entertainment life of the living room, and is an indispensable ring in an intelligent home ecological system.
However, the existing tv usually has only the functions of playing tv programs and connecting to the network, and the functions are single.
Disclosure of Invention
The invention mainly aims to provide a method for controlling peripheral equipment, a television and a readable storage medium, and aims to solve the technical problem that the function of the television is single in the prior art.
In order to achieve the above object, the present invention provides a method for controlling a peripheral device, which is applied to a television, and comprises the following steps:
when the television is in a starting or standby state, receiving voice information;
generating a control instruction based on the voice information;
sending the control instruction to a shadow device corresponding to a device to be controlled through an IOT (Internet of things) platform so that the shadow device can synchronize the control instruction to a controller of the device to be controlled;
and making a response action corresponding to the control instruction through the controller.
Preferably, the control instruction is a first control instruction; the step of generating a control instruction based on the voice information comprises:
judging whether the voice information is analyzed information;
if not, analyzing the voice information into the user intention;
and when the user intention is judged to have first authorization information, converting the user intention into a first control instruction.
Preferably, the step of parsing the voice information into the user's intention includes:
analyzing the voice information into corresponding voice texts;
and converting the voice text into corresponding user intentions.
Preferably, before the step of converting the user intention into the first control instruction when it is determined that the first authorization information exists, the method of controlling the peripheral further includes:
judging whether the user intention has first authorization information or not, wherein if yes, the user intention is converted into a first control instruction;
if not, performing authorization verification operation when the first account information is received, and returning to execute the step of judging whether the voice information is analyzed information after the first account information is successfully authorized.
Preferably, after the step of determining whether the voice information is parsed information, the method for controlling an external device further includes:
if the voice information is judged to be analyzed information, judging whether second authorization information exists in the voice information or not;
if the voice information is judged to have second authorization information, converting the voice information into a second control instruction;
if the voice message is judged not to have the second authorization message, authorization verification operation is carried out when the second account information is received, and the step of judging whether the voice message is analyzed is returned to be executed after the second account information is successfully authorized.
Preferably, the control instruction is a first control instruction or a second control instruction; the step of sending the control instruction to the shadow device of the device to be controlled through the IOT platform so that the shadow device synchronizes the control instruction to the controller of the device to be controlled comprises the following steps:
acquiring the ID of the equipment to be controlled based on the first authorization information or the second authorization information;
sending the first control instruction collocation ID or the second control instruction collocation ID to a message management center through an IOT (Internet of things) platform, wherein the message management center comprises a plurality of shadow devices, and each shadow device corresponds to a device to be controlled;
subscribing the same message queue through the shadow device and the device to be controlled, and carrying out state synchronization through the message queue;
and synchronizing the control instruction to a controller of the equipment to be controlled through the message queue.
Preferably, before the step of subscribing to the same message queue through the shadow device and the device to be controlled, the method for controlling the peripheral further includes:
converting the first control instruction or the second control instruction into a machine instruction set;
looking up a list of devices based on the set of machine instructions;
when the first to-be-controlled device corresponding to the ID is found, the shadow device corresponding to the first to-be-controlled device is obtained, and the step of subscribing the same message queue through the shadow device and the to-be-controlled device is executed.
Preferably, the step of receiving the voice message when the television is in the on or standby state includes:
when voice information is received, judging whether the television is in a starting state or not;
if not, awakening the IOT platform to receive the voice information and then executing the step of generating a control instruction based on the voice information;
and if so, executing the step of generating the control instruction based on the voice information.
In addition, to achieve the above object, the present invention also provides a television comprising: a memory, a processor and a program for controlling a peripheral stored on the memory and executable on the processor, the program for controlling a peripheral implementing the steps of the method for controlling a peripheral according to any one of the above when executed by the processor.
In addition, to achieve the above object, the present invention further provides a readable storage medium having a program for controlling a peripheral stored thereon, the program for controlling a peripheral implementing the steps of the method for controlling a peripheral according to any one of the above when being executed by a processor.
In the invention, the voice information is received when the television is in a starting or standby state, and the control instruction is generated based on the voice information, so that the voice receiving and the control instruction generation of the television in the starting or standby state are realized; the control instruction is sent to the shadow equipment of the equipment to be controlled through the IOT platform, and the control instruction is synchronized with the controller of the equipment to be controlled through the shadow equipment, so that the control instruction controls the equipment to be controlled through the shadow equipment, and the response of the equipment to be controlled to the control instruction is realized. The method for the synchronization state of the shadow device can avoid the problems that the device state cannot be synchronized and the state load of multiple application program request devices is overlarge due to unstable network, greatly improves the response efficiency of the multiple platforms requesting the device state at the same time, and can better adapt to the cross-platform and high-concurrency device processing requirements.
Drawings
Fig. 1 is a schematic diagram of a hardware structure of a television according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a first embodiment of a method for controlling a peripheral device according to the present invention;
FIG. 3 is a flowchart illustrating a method for controlling a peripheral device according to a second embodiment of the present invention;
fig. 4 is a flowchart illustrating a method for controlling a peripheral device according to a third embodiment of the present invention.
The objects, features and advantages of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As shown in fig. 1, fig. 1 is a schematic diagram of a television structure of a hardware operating environment according to an embodiment of the present invention.
As shown in fig. 1, the television may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Optionally, the television may also include a camera, RF (Radio Frequency) circuitry, sensors, audio circuitry, a WiFi module, and so forth. Of course, the television may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which are not described herein again.
Those skilled in the art will appreciate that the television architecture shown in fig. 1 is not intended to be limiting of televisions, and may include more or fewer components than those shown, or some components in combination, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a program for controlling peripheral devices.
In the television shown in fig. 1, the network interface 1004 is mainly used for connecting a background server and performing data communication with the background server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to call a program stored in the memory 1005 for controlling the peripheral and perform the following operations:
when the television is in a starting or standby state, receiving voice information;
generating a control instruction based on the voice information;
sending the control instruction to a shadow device corresponding to a device to be controlled through an IOT (Internet of things) platform so that the shadow device can synchronize the control instruction to a controller of the device to be controlled;
and making a response action corresponding to the control instruction through the controller.
Further, the processor 1001 may call a program stored in the memory 1005 for controlling a peripheral device, and also perform the following operations:
judging whether the voice information is analyzed information;
if not, analyzing the voice information into the user intention;
and when the user intention is judged to have first authorization information, converting the user intention into a first control instruction.
Further, the processor 1001 may call a program stored in the memory 1005 for controlling a peripheral device, and also perform the following operations:
analyzing the voice information into corresponding voice texts;
and converting the voice text into corresponding user intentions.
Further, the processor 1001 may call a program stored in the memory 1005 for controlling a peripheral device, and also perform the following operations:
judging whether first authorization information exists in the user intention;
if not, performing authorization verification operation when first account information is received, and returning to execute the step of judging whether the voice information is analyzed information after the first account information is successfully authorized;
and if so, converting the user intention into a first control instruction.
Further, the processor 1001 may call a program stored in the memory 1005 for controlling a peripheral device, and also perform the following operations:
if the voice information is judged to be analyzed information, judging whether second authorization information exists in the voice information or not;
if the voice information is judged to have second authorization information, converting the voice information into a second control instruction;
if the voice message is judged not to have the second authorization message, authorization verification operation is carried out when the second account information is received, and the step of judging whether the voice message is analyzed is returned to be executed after the second account information is successfully authorized.
Further, the processor 1001 may call a program stored in the memory 1005 for controlling a peripheral device, and also perform the following operations:
acquiring the ID of the equipment to be controlled based on the first authorization information or the second authorization information;
sending the first control instruction collocation ID or the second control instruction collocation ID to a message management center through an IOT (Internet of things) platform, wherein the message management center comprises a plurality of shadow devices, and each shadow device corresponds to a device to be controlled;
subscribing the same message queue through the shadow device and the device to be controlled, and carrying out state synchronization through the message queue;
and synchronizing the control instruction to a controller of the equipment to be controlled through the message queue.
Further, the processor 1001 may call a program stored in the memory 1005 for controlling a peripheral device, and also perform the following operations:
converting the first control instruction or the second control instruction into a machine instruction set;
looking up a list of devices based on the set of machine instructions;
when the first to-be-controlled device corresponding to the ID is found, the shadow device corresponding to the first to-be-controlled device is obtained, and the step of subscribing the same message queue through the shadow device and the to-be-controlled device is executed.
Further, the processor 1001 may call a program stored in the memory 1005 for controlling a peripheral device, and also perform the following operations:
when voice information is received, judging whether the television is in a starting state or not;
if not, awakening the IOT platform to receive the voice information and then executing the step of generating a control instruction based on the voice information;
and if so, executing the step of generating the control instruction based on the voice information.
Referring to fig. 2, fig. 2 is a flowchart illustrating a first embodiment of a method for controlling a peripheral device according to the present invention, where in the first embodiment, the method for controlling a peripheral device includes:
step S10, receiving voice information when the television is in a power-on or standby state.
In this embodiment, when the user uses the television, the user speaks an operation to be implemented through a near-field voice function of the remote controller or a far-field voice function of the television, and the voice of the user is uploaded to the television through the remote controller or the microphone array on the television. Firstly, whether the television is started or not is judged, and when the television is judged to be in a starting state, an IOT (Internet of things) platform at the television end can quickly respond and generate a control instruction based on voice information; if the television is in a standby state, the voice recognition function of the television needs to be awakened, namely the IOT platform of the Internet of things of the television is awakened, so that the television can still complete the corresponding function of the IOT platform service of the Internet of things in the standby state.
Step S20, a control instruction is generated based on the voice information.
In this embodiment, no matter in the power-on state or the standby state, when receiving the voice message, the voice message is generated into a control instruction, specifically: the method comprises the steps that voice information of a user is uploaded to a voice analysis platform of the television, the voice analysis platform judges whether the voice information is analyzed or not, if not, voice analysis is started, the voice is analyzed to be user intention, whether first authorization information exists in the user intention is judged, and if yes, the user intention is converted into a first control instruction.
The method includes the steps that a plurality of devices to be controlled in an intelligent home, such as a television, an air conditioner, a washing machine and the like, need to be analyzed, if the voice information is analyzed, the voice information is used as a control instruction to control the corresponding devices to be controlled, if a user never opens the air conditioner through voice, when the voice information for opening the air conditioner is received, the voice information can be judged to be unresolved voice, at the moment, the voice information is analyzed to be a user intention, whether first authorization information exists in the user intention or not is judged, namely whether the air conditioner is authorized to the intelligent home system or not is judged, and if the first authorization information exists, the voice information for opening the air conditioner is converted into the first control instruction.
The voice information is verified by judging whether the voice information is analyzed information or not, if not, when the user intention is judged to have the first authorization information, the user intention is converted into the first control instruction, and when the verification is successful, the controllability of the equipment to be controlled is realized.
Step S30, the control instruction is sent to the shadow device corresponding to the device to be controlled through the IOT platform, so that the shadow device can synchronize the control instruction to the controller of the device to be controlled.
In this embodiment, after the control instruction is generated, the control instruction is sent to the shadow device corresponding to the device to be controlled through the internet of things IOT platform, so that the shadow device synchronizes the control instruction to the controller of the device to be controlled.
IOT (Internet of things) is an important component of a new generation of information technology and an important development stage of the information era, and the Internet of things is the Internet connected with objects. This has two layers: firstly, the core and the foundation of the internet of things are still the internet, and the internet is an extended and expanded network on the basis of the internet; and secondly, the user side extends and expands to any article to perform information exchange and communication, namely, the article information. The internet of things is widely applied to network fusion through communication perception technologies such as intelligent perception, identification technology and pervasive computing, and is also called as the third wave of development of the world information industry after computers and the internet.
The IOT platform connects household appliances such as air conditioners, washing machines, refrigerators and televisions in intelligent homes in a network mode.
The shadow device, i.e. the shadow system (PowerShadow), constructs a virtual image of the existing operating system, i.e. the shadow mode, which is identical to the real system, and the user can select to enable or quit the virtual image at any time. After the user enters a Shadow mode, all operations are virtual, the real system cannot be influenced, and all changes disappear after the user exits the Shadow mode.
The shadow device of this case, it is the software of simulation equipment of treating to control in fact, is equipped with a plurality of shadow devices in thing networking IOT platform, and each shadow device all corresponds the identifier of a equipment of treating to control, like the ID, because shadow device and the equipment of treating to control that corresponds go on in step, consequently, thing networking IOT platform just can control the equipment of treating to control that corresponds through the shadow device.
And step S40, making a response action corresponding to the control instruction through the controller.
In this embodiment, because the IOT platform of the internet of things controls the corresponding device to be controlled through the shadow device, that is, controls the controller MCU of the device to be controlled, after receiving the control instruction, the IOT platform of the internet of things synchronizes the controller of the corresponding device to be controlled through the corresponding shadow device, so that the controller makes a response action corresponding to the control instruction.
If the control instruction is 'turn on the air conditioner', the IOT platform synchronizes the instruction to the controller of the air conditioner through the shadow device corresponding to the air conditioner when receiving the control instruction of 'turn on the air conditioner', and at the moment, the controller of the air conditioner executes the turning on action.
The device comprises three platforms, namely a hardware device platform of a device to be controlled (comprising a television end, an air conditioner, a washing machine and other household appliances), an IOT (Internet of things) platform and a background server management platform, wherein the three platforms are matched to meet the control requirements of users under different scenes. Meanwhile, the equipment can be controlled in a cross-platform mode, for example, the IOT platform controls a controller of the equipment to be controlled through the shadow equipment to realize cross-platform control; the response of the equipment is not limited by the platform any more, and the applicability of the scheme is greatly improved. The method for synchronizing the state of the shadow device can solve the problems that the device state cannot be synchronized and the state load of the multi-application program request device is overlarge due to unstable network, greatly improves the response efficiency of the multi-platform simultaneous request device state, does not influence the response efficiency when simultaneously requesting some states among a hardware device platform of the device to be controlled, an IOT (Internet of things) platform and a background server management platform, and can better adapt to cross-platform and high-concurrency device processing requirements.
When receiving the voice information, the invention generates a control instruction based on the voice information, thereby realizing the voice receiving and the control instruction generation when the television is started or in standby; the control instruction is sent to the shadow equipment of the equipment to be controlled through the IOT platform, and the control instruction is synchronized with the controller of the equipment to be controlled through the shadow equipment, so that the control instruction controls the equipment to be controlled through the shadow equipment, and the response of the equipment to be controlled to the control instruction is realized. The method for the synchronization state of the shadow device can avoid the problems that the device state cannot be synchronized and the state load of multiple application program request devices is overlarge due to unstable network, greatly improves the response efficiency of the multiple platforms requesting the device state at the same time, and can better adapt to the cross-platform and high-concurrency device processing requirements.
Based on the first embodiment, the present invention further provides a second embodiment of a method for controlling a peripheral, as shown in fig. 3, where the control instruction is a first control instruction; step S20 includes:
step S21, judging whether the voice information is analyzed information;
the voice information of the user is uploaded to a voice analysis platform of the television, the voice analysis platform judges whether the voice information is analyzed, if the user never opens the air conditioner through voice, the voice information can be judged to be the unresolved voice when the voice information of opening the air conditioner is received.
Step S22, if not, analyzing the voice information as the user intention;
when the voice information is judged to be unanalyzed voice, firstly, the voice information is analyzed into the user intention, specifically: corresponding voice contents are identified through an intelligent voice identification algorithm, and the voice contents are intelligently added, deleted and modified through a semantic conversion server, so that the voice contents are analyzed as user intentions and identified as control instructions which can be received by specific intelligent equipment.
And step S23, when the user intention is judged to have the first authorization information, converting the user intention into a first control instruction.
In the embodiment, the voice information of the user is uploaded to a voice analysis platform of the television, the voice analysis platform judges whether the voice information is analyzed, if not, the voice analysis is started to analyze the voice into the user intention, then whether the user intention has first authorization information is judged, and if yes, the user intention is converted into a first control instruction.
The method comprises the steps of analyzing voice information, if the voice information is analyzed, the voice information is used as a control instruction to control a corresponding device to be controlled, if the user never opens the device to be controlled of the air conditioner through voice, when the voice information of opening the air conditioner is received, the voice information can be judged to be unresolved voice, at the moment, the voice information is analyzed to be the user intention, whether first authorization information exists in the user intention or not is judged, namely whether the air conditioner is authorized to the intelligent home system or not is judged, and if the user intention exists, the voice information of opening the air conditioner is converted into the first control instruction.
The voice information is verified by judging whether the voice information is analyzed information or not, if not, when the user intention is judged to have the first authorization information, the user intention is converted into the first control instruction, and when the verification is successful, the controllability of the equipment to be controlled is realized.
Further, step S22 includes:
step S221, analyzing the voice information into corresponding voice texts;
step S222, converting the voice text into a corresponding user intention.
In this embodiment, when determining that the voice information is an unanalyzed voice, first, the voice information needs to be analyzed as a user intention, specifically: the speech information is parsed into corresponding speech text using speech recognition techniques, and the speech text is then converted into responsive user intent via semantic understanding techniques.
Speech recognition technology refers to the conversion of lexical content in human speech into computer readable input such as keystrokes, binary codes or character sequences. Unlike speaker recognition and speaker verification, the latter attempts to recognize or verify the speaker who uttered the speech rather than the vocabulary content contained therein.
The semantic understanding technology refers to learning and understanding semantic contents represented by a text by using various methods, and any language understanding can be classified into the category of semantic analysis. A text segment is usually composed of words, sentences and paragraphs, and the semantic analysis can be further decomposed into vocabulary level semantic analysis, sentence level semantic analysis and chapter level semantic analysis according to different language units of the comprehension object. Generally speaking, vocabulary-level semantic analysis focuses on how to obtain or distinguish the semantics of words, sentence-level semantic analysis attempts to analyze the expressed semantics of an entire sentence, and chapter semantic analysis aims at studying the inherent structure of natural language text and understanding the semantic relationships between text elements (which may be sentence clauses or paragraphs). Briefly, the goal of semantic analysis is to realize automatic semantic analysis in each language unit (including vocabulary, sentences, chapters, etc.) by establishing an effective model and system, thereby realizing understanding of the true semantics of the whole text expression.
Further, before step S23, the method for controlling peripheral further includes:
step S231, judging whether the user intention has first authorization information, wherein if yes, the user intention is converted into a first control instruction;
step S232, if not, performing authorization verification operation when the first account information is received, and returning to execute step S21 after the first account information is successfully authorized.
In this embodiment, before determining that a user intends to have first authorization information, first determining whether the user intends to have the first authorization information, where the first authorization information refers to that a user can control a corresponding device to be controlled through voice, that is, unique feature information such as an identifier, for example, an ID, of the device to be controlled is included; if the user intends to have no first authorization information, authorization verification is required to be performed, specifically: the user inputs the first account information, corresponding authorization operation can be performed by scanning the two-dimensional code on the television or manually inputting the first account information, the first account information is verified, if the verification is successful, the authorization is successful, the step S21 is returned, and whether the voice information is analyzed information is determined again.
If the user intention is judged to have the authorization information, the user intention is shown to contain the unique characteristic information of the identifier of the device to be controlled, such as the ID, and at this time, the user intention can be directly converted into the first control instruction.
The method comprises the steps of judging whether the controllability of the equipment to be controlled exists in voice information or not by judging whether the first authorization information exists in the user intention or not, and converting the user intention into a first control instruction when the controllability of the equipment to be controlled exists in the user intention is judged.
Further, after step S21, the method for controlling peripheral further includes:
step S211, if the voice message is judged to be analyzed, judging whether a second authorization message exists in the voice message;
if the voice information is judged to be analyzed information, whether second authorization information exists in the voice information is judged, for example, a user turns on an air conditioner by voice, a voice analysis platform of a television analyzes the voice of turning on the air conditioner, at the moment, the voice is judged to be analyzed information, whether a unique identifier such as an ID of a specific air conditioner is contained in the turning on air conditioner is judged, and since each household has a plurality of air conditioners, at the moment, although the user turns on an air conditioner A by voice, an air conditioner B which does not represent the user is authorized information, if the user wants to turn on the air conditioner B, whether the second authorization information exists in the turning on air conditioner is judged.
Step S212, if the voice message is judged to have second authorization information, converting the voice message into a second control instruction;
when the voice information is judged to have the second authorization information, the voice information is converted into a second control instruction, for example, the user turns on the air conditioner B by voice, and when the voice information is 'turn on the air conditioner B', the unique identifier ID of the air conditioner B is included, so that the voice information can be directly converted into the second control instruction.
Step S213, if it is determined that the voice message does not have the second authorization information, performing authorization verification operation when the second account information is received, and returning to perform step S21 after the second account information is successfully authorized.
In this embodiment, if it is determined that the voice information does not have the second authorization information, an authorization verification operation is performed when the second account information is received, where a specific verification manner is similar to that of verifying the first authorization information, and when the user inputs the second account information, the user may scan a two-dimensional code on the television or manually input the second account information to perform a corresponding authorization operation, and verify the second account information, and when the verification is successful, it indicates that the authorization is successful, the method returns to perform step S21, and determines whether the voice information is parsed information again.
Further, based on the second embodiment, a third embodiment of the method for controlling a peripheral device according to the present invention is provided, as shown in fig. 4, where the control instruction is a first control instruction or a second control instruction, and step S30 includes:
step S31, acquiring an ID of the device to be controlled based on the first authorization information or the second authorization information;
because the first authorization information and the second authorization information both contain the unique identifier, such as the ID, of the device to be controlled, after the unique identifier of the device to be controlled is obtained, the internet of things IOT platform can know the device to be controlled, which is specifically operated by the voice information.
Step S32, sending the first control instruction collocation ID or the second control instruction collocation ID to a message management center through an IOT platform, wherein the message management center comprises a plurality of shadow devices, and each shadow device corresponds to a device to be controlled;
the message management center comprises a plurality of shadow devices, each shadow device corresponds to a device to be controlled, if the shadow device A corresponds to the air conditioner A, the shadow device B corresponds to the air conditioner B, and if the ID of the air conditioner A matched with the first control instruction is sent to the message management center through the IOT platform, the message management center knows that the air conditioner A is to be controlled, and at the moment, the message management center sends the ID of the air conditioner A matched with the first control instruction to the shadow device A.
Step S33, subscribing the same message queue with the device to be controlled through the shadow device, and performing state synchronization through the message queue;
and the state synchronization between the shadow device and the corresponding device to be controlled is realized by subscribing the same message queue through the shadow device and the corresponding device to be controlled. If the shadow device A receives the control instruction of opening the air conditioner A, the control instruction of opening the air conditioner A is synchronized to the controller of the air conditioner A by subscribing the same message queue.
And step S34, synchronizing the control instruction to the controller of the device to be controlled through the message queue.
And synchronizing the control instruction to the controller of the equipment to be controlled through the message queue, so that the controller of the equipment to be controlled makes a response action corresponding to the control instruction. If the shadow device A receives the control instruction of turning on the air conditioner A, the control instruction of turning on the air conditioner A is synchronized to the controller of the air conditioner A by subscribing the same message queue, and at the moment, the controller of the air conditioner A executes a response action of turning on a switch of the air conditioner A, so that the air conditioner A is controlled by voice.
Further, before step S33, the method for controlling peripheral further includes:
converting the first control instruction or the second control instruction into a machine instruction set;
looking up a list of devices based on the set of machine instructions;
when the first device to be controlled corresponding to the ID is found, the shadow device corresponding to the first device to be controlled is obtained, and step S33 is executed.
In the embodiment, on the basis of accurately understanding the voice intention of the user, the first control instruction or the second control instruction is converted into a machine instruction set which can be recognized by a machine. And searching a device list based on the machine instruction set, namely, synchronously acquiring a controllable device list of the user by the television according to the identification of the current user. And if the intelligent equipment to be controlled is found, sending a control instruction to the shadow equipment of the equipment to be controlled. At this time, the shadow device will automatically synchronize all the states of the device to the real device of the shadow device. Otherwise, an intelligent prompt appears, so that the user can obtain correct and effective response.
Further, step S10 includes:
when voice information is received, judging whether the television is in a starting state or not;
if not, awakening the IOT platform to receive the voice information and then executing the step of generating a control instruction based on the voice information;
if yes, go to step S20.
When a user uses the television, the user speaks an operation to be realized through a near-field voice function of the remote controller or a far-field voice function carried by the television, and the voice of the user is uploaded to the television through the remote controller or a microphone array on the television. Firstly, whether the television is started or not is judged, and when the television is judged to be in a starting state, an IOT (Internet of things) platform at the television end can quickly respond and generate a control instruction based on voice information; if the television is in a standby state, the voice recognition function of the television needs to be awakened, namely the IOT platform of the Internet of things of the television is awakened, so that the television can still complete the corresponding function of the IOT platform service of the Internet of things in the standby state.
The invention has the following specific advantages:
compared with the method for directly controlling the equipment by simply adopting the MQTT protocol, the method disclosed by the invention is more prone to realizing the management and control of the equipment by adopting the current mainstream IOT platform technology of the Internet of things.
The IOT platform technology has great inclusion in the access aspect of equipment. The method not only provides 2/3/4G, NB-IOT, LoRA and other different network equipment access schemes, but also provides equipment SDK with multiple protocols including MQTT and CoPA protocols, thereby not only meeting the real-time requirement of long connection, but also meeting the low power consumption requirement of short connection.
The IOT platform technology has natural advantages in the aspects of equipment management and data acquisition and analysis. The system can provide a complete device life cycle management function, support the registration, function definition, script analysis, online debugging, remote configuration, firmware upgrading, remote maintenance and real-time monitoring of the device, and can also perform grouping management on the device and selectively delete the device.
In the aspects of data acquisition and analysis management, IOT platform technology has good performance. The device can be backed up in real time through the IOT technology, and data can be uploaded to a cloud platform to be stored, calculated and other services.
In the aspect of safety, the IOT platform technology also provides super-strong safety guarantee capability. When logging in the IOT background, not only multiple identity authentications are needed, but also the operation authorities corresponding to different identities are greatly different. When data is transmitted and communicated, the IOT platform encrypts the data in multiple layers, so that confidentiality and integrity of the data are guaranteed, communication resource isolation at the equipment level is supported, and the problems of equipment unauthorized and the like are prevented.
Besides, the IOT platform technology is adopted to control the peripheral equipment, so that the unified management and data acquisition of the equipment are facilitated, and the voice recognition and awakening technology is also incorporated into the IOT platform technology. In the whole logic process that a user controls the peripheral equipment through a voice technology, voice awakening is carried out through awakening words from the beginning, then voice input of a microphone is carried out, analysis processing is carried out on a voice background, and finally voice synthesis feedback is carried out on the user.
The invention also uses a key technology, which realizes that the television can still control the peripheral equipment in the standby state. The intelligent hardware screen-turning technology is characterized in that when a user turns off a television, a hardware end carries out intelligent response, a CPU can selectively close necessary services and simultaneously keep IOT related services, and therefore when the user sends a voice instruction, the CPU can normally carry out analysis operation, and therefore control over the peripheral in a standby state is achieved.
The scheme designed by the invention can intelligently select the voice recognition mode according to the current state of the television. And simultaneously recognizing the voice of the user as a control instruction which can be received by the hardware equipment. The method of the shadow device for synchronizing data is adopted, so that the problems that the device state cannot be synchronized and the load of the multi-application program request device is overlarge due to unstable network are solved, and the requirement that a television controls a large amount of devices in various complex application scenes can be met.
The invention enables a user to conveniently and quickly control peripheral household equipment such as an intelligent air purifier, an intelligent air conditioner, an intelligent sound box and the like through the voice of the television end when watching the television, and even under the standby condition of the television, the user can still realize the control of the equipment through the voice, thereby enriching the role positioning of the television, enhancing the main corner halo of the television, further emphasizing the brand new concept that the television is used as an intelligent household control inlet to carry out peripheral control, and bringing great convenience to the household life of people.
Furthermore, an embodiment of the present invention further provides a readable storage medium, where a program for controlling a peripheral is stored, and when the program for controlling a peripheral is executed by a processor, the steps of the method for controlling a peripheral as described above are implemented.
The specific embodiment of the readable storage medium of the present invention is substantially the same as the embodiments of the method for controlling the peripheral device, and is not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling an apparatus (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to perform the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (8)

1. A method for controlling peripheral equipment is applied to a television, and the method for controlling the peripheral equipment comprises the following steps:
when the television is in a starting or standby state, receiving voice information;
when the television is in a power-off state, the IOT platform is awakened to receive voice information;
generating a control instruction based on the voice information;
sending the control instruction to a shadow device corresponding to a device to be controlled through the IOT platform so that the shadow device can synchronize the control instruction to a controller of the device to be controlled;
making a response action corresponding to the control instruction through the controller;
wherein the control instruction is a first control instruction; the step of generating a control instruction based on the voice information comprises:
judging whether the voice information is analyzed information;
if not, analyzing the voice information into the user intention;
and when the user intention is judged to have first authorization information, converting the user intention into a first control instruction.
2. The method of controlling a peripheral device according to claim 1, wherein the step of parsing the voice information into the user's intention comprises:
analyzing the voice information into corresponding voice texts;
and converting the voice text into corresponding user intentions.
3. The method of controlling a peripheral device according to claim 1, wherein prior to the step of converting the user intent into the first control instruction upon determining that the first authorization information exists, the method of controlling a peripheral device further comprises:
judging whether the user intention has first authorization information or not, wherein if yes, the user intention is converted into a first control instruction;
if not, performing authorization verification operation when the first account information is received, and returning to execute the step of judging whether the voice information is analyzed information after the first account information is successfully authorized.
4. The method of controlling a peripheral device according to claim 3, wherein after the step of determining whether the voice message is parsed message, the method of controlling a peripheral device further comprises:
if the voice information is judged to be analyzed information, judging whether second authorization information exists in the voice information or not;
if the voice information is judged to have second authorization information, converting the voice information into a second control instruction;
if the voice message is judged not to have the second authorization message, authorization verification operation is carried out when the second account information is received, and the step of judging whether the voice message is analyzed is returned to be executed after the second account information is successfully authorized.
5. The method of controlling a peripheral device according to claim 4, wherein the control instruction is a first control instruction or a second control instruction; the step of sending the control instruction to the shadow device of the device to be controlled through the IOT platform so that the shadow device synchronizes the control instruction to the controller of the device to be controlled comprises the following steps:
acquiring the ID of the equipment to be controlled based on the first authorization information or the second authorization information;
sending the first control instruction collocation ID or the second control instruction collocation ID to a message management center through an IOT (Internet of things) platform, wherein the message management center comprises a plurality of shadow devices, and each shadow device corresponds to a device to be controlled;
subscribing the same message queue through the shadow device and the device to be controlled, and carrying out state synchronization through the message queue;
and synchronizing the control instruction to a controller of the equipment to be controlled through the message queue.
6. The method of controlling a peripheral device of claim 5, wherein prior to the step of subscribing to the same message queue as the device to be controlled through the shadow device, the method of controlling a peripheral device further comprises:
converting the first control instruction or the second control instruction into a machine instruction set;
looking up a list of devices based on the set of machine instructions;
when the first to-be-controlled device corresponding to the ID is found, the shadow device corresponding to the first to-be-controlled device is obtained, and the step of subscribing the same message queue through the shadow device and the to-be-controlled device is executed.
7. A television, the television comprising: memory, a processor and a program for controlling a peripheral stored on the memory and executable on the processor, which program for controlling a peripheral when executed by the processor implements the steps of the method for controlling a peripheral as claimed in any one of claims 1 to 6.
8. A readable storage medium, characterized in that the readable storage medium has stored thereon a program for controlling a peripheral, which when executed by a processor implements the steps of the method for controlling a peripheral according to any one of claims 1 to 6.
CN201811586659.4A 2018-12-24 2018-12-24 Method for controlling peripheral equipment, television and readable storage medium Active CN109618202B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201811586659.4A CN109618202B (en) 2018-12-24 2018-12-24 Method for controlling peripheral equipment, television and readable storage medium
PCT/CN2019/078836 WO2020133741A1 (en) 2018-12-24 2019-03-20 Peripheral control method, television, and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811586659.4A CN109618202B (en) 2018-12-24 2018-12-24 Method for controlling peripheral equipment, television and readable storage medium

Publications (2)

Publication Number Publication Date
CN109618202A CN109618202A (en) 2019-04-12
CN109618202B true CN109618202B (en) 2020-12-08

Family

ID=66011071

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811586659.4A Active CN109618202B (en) 2018-12-24 2018-12-24 Method for controlling peripheral equipment, television and readable storage medium

Country Status (2)

Country Link
CN (1) CN109618202B (en)
WO (1) WO2020133741A1 (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110753921B (en) * 2019-01-11 2023-08-29 Oppo广东移动通信有限公司 Query request processing method, device, computer equipment and storage medium
WO2021012235A1 (en) * 2019-07-24 2021-01-28 Oppo广东移动通信有限公司 Method for generating shadow device, device, and storage medium
CN110501988B (en) * 2019-09-25 2020-06-09 北京金茂绿建科技有限公司 Method and device for realizing integration control of Internet of things equipment
CN111478965A (en) * 2020-04-07 2020-07-31 四川虹美智能科技有限公司 Method, device and system for processing device shadow
CN113676382B (en) * 2020-05-13 2023-04-07 云米互联科技(广东)有限公司 IOT voice command control method, system and computer readable storage medium
CN114244860A (en) * 2020-09-07 2022-03-25 北京金山云网络技术有限公司 Internet of things equipment management method and device, electronic equipment and storage medium
CN112600881A (en) * 2020-12-01 2021-04-02 珠海格力电器股份有限公司 Method, device, server and storage medium for providing service of internet of things
CN112556988B (en) * 2020-12-02 2023-09-26 海信视像科技股份有限公司 Display device and detection circuit thereof
CN115134343A (en) * 2021-03-29 2022-09-30 深圳绿米联创科技有限公司 Equipment control method, system, device, server and storage medium
CN114137888B (en) * 2021-12-10 2023-10-03 珠海格力电器股份有限公司 Linkage control method of equipment, processor and equipment linkage control system
CN114900384B (en) * 2022-04-11 2024-03-22 哈尔滨工业大学 Cross-platform communication system and method for Internet of things and intelligent equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106385347A (en) * 2016-09-09 2017-02-08 珠海格力电器股份有限公司 Household appliances control method and device
CN106792028A (en) * 2016-12-29 2017-05-31 重庆金鑫智慧科技有限公司 A kind of Set Top Box control intelligent domestic system based on Internet of Things
CN107911492A (en) * 2017-12-27 2018-04-13 浙江力石科技股份有限公司 The method and device that equipment accesses in platform of internet of things
CN108255934A (en) * 2017-12-07 2018-07-06 北京奇艺世纪科技有限公司 A kind of sound control method and device

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN203966093U (en) * 2014-07-18 2014-11-26 谭迎建 Intelligent home integration apparatus
KR101662396B1 (en) * 2014-10-13 2016-10-05 한국과학기술원 Method and system for controlling device based internet of things
CN105717797A (en) * 2016-01-29 2016-06-29 四川长虹电器股份有限公司 Household management device, system and method based on speech recognition
CN105872075B (en) * 2016-05-06 2018-08-31 东莞中科智城软件有限公司 A method of internet of things equipment is mapped to smart city resource model
US10459687B2 (en) * 2017-03-28 2019-10-29 Wipro Limited Method and system for controlling an internet of things device using multi-modal gesture commands
US10686865B2 (en) * 2017-04-10 2020-06-16 Ayla Networks, Inc. Third-party application control of devices in an IoT platform
CN107515944A (en) * 2017-08-31 2017-12-26 广东美的制冷设备有限公司 Exchange method, user terminal and storage medium based on artificial intelligence
CN107370649B (en) * 2017-08-31 2020-09-11 广东美的制冷设备有限公司 Household appliance control method, system, control terminal and storage medium
CN107479400A (en) * 2017-09-28 2017-12-15 广东美的制冷设备有限公司 Control method, device, home appliance and the readable storage medium storing program for executing of home appliance
CN108111617A (en) * 2017-12-27 2018-06-01 浙江力石科技股份有限公司 The implementation method and device of rule control in platform of internet of things

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106385347A (en) * 2016-09-09 2017-02-08 珠海格力电器股份有限公司 Household appliances control method and device
CN106792028A (en) * 2016-12-29 2017-05-31 重庆金鑫智慧科技有限公司 A kind of Set Top Box control intelligent domestic system based on Internet of Things
CN108255934A (en) * 2017-12-07 2018-07-06 北京奇艺世纪科技有限公司 A kind of sound control method and device
CN107911492A (en) * 2017-12-27 2018-04-13 浙江力石科技股份有限公司 The method and device that equipment accesses in platform of internet of things

Also Published As

Publication number Publication date
WO2020133741A1 (en) 2020-07-02
CN109618202A (en) 2019-04-12

Similar Documents

Publication Publication Date Title
CN109618202B (en) Method for controlling peripheral equipment, television and readable storage medium
CN107370649B (en) Household appliance control method, system, control terminal and storage medium
CN107276864B (en) Method, device and system for controlling household appliances by intelligent voice equipment
CN107909998B (en) Voice instruction processing method and device, computer equipment and storage medium
WO2016206494A1 (en) Voice control method, device and mobile terminal
JP6752870B2 (en) Methods and systems for controlling artificial intelligence devices using multiple wake words
KR102309540B1 (en) Server for seleting a target device according to a voice input, and controlling the selected target device, and method for operating the same
CN105471705B (en) Intelligent control method, equipment and system based on instant messaging
US20210043205A1 (en) Electronic device managing plurality of intelligent agents and operation method thereof
CN111880645A (en) Server for determining and controlling target device based on voice input of user and operating method thereof
US11804224B2 (en) Electronic device and method for operation thereof
CN110246499A (en) The sound control method and device of home equipment
CN110992937B (en) Language off-line identification method, terminal and readable storage medium
CN112163086A (en) Multi-intention recognition method and display device
CN112511882A (en) Display device and voice call-up method
US11749271B2 (en) Method for controlling external device based on voice and electronic device thereof
US20200125603A1 (en) Electronic device and system which provides service based on voice recognition
CN111933135A (en) Terminal control method and device, intelligent terminal and computer readable storage medium
CN111212327A (en) Control method and device of playing equipment and storage medium
CN111385624B (en) Voice-based data transmission control method, smart television and storage medium
CN107621874B (en) Content distribution method and system
KR20200057501A (en) ELECTRONIC APPARATUS AND WiFi CONNECTING METHOD THEREOF
US11264031B2 (en) Method for processing plans having multiple end points and electronic device applying the same method
CN113678119A (en) Electronic device for generating natural language response and method thereof
US20220287110A1 (en) Electronic device and method for connecting device thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant