WO2020133741A1 - 控制外设的方法、电视及可读存储介质 - Google Patents

控制外设的方法、电视及可读存储介质 Download PDF

Info

Publication number
WO2020133741A1
WO2020133741A1 PCT/CN2019/078836 CN2019078836W WO2020133741A1 WO 2020133741 A1 WO2020133741 A1 WO 2020133741A1 CN 2019078836 W CN2019078836 W CN 2019078836W WO 2020133741 A1 WO2020133741 A1 WO 2020133741A1
Authority
WO
WIPO (PCT)
Prior art keywords
controlled
information
control instruction
voice
voice information
Prior art date
Application number
PCT/CN2019/078836
Other languages
English (en)
French (fr)
Inventor
尚应生
刘华兵
雷倍一
吕伟龙
Original Assignee
深圳创维－Rgb电子有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳创维－Rgb电子有限公司 filed Critical 深圳创维－Rgb电子有限公司
Publication of WO2020133741A1 publication Critical patent/WO2020133741A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4108—Peripherals receiving signals from specially adapted client devices characterised by an identification number or address, e.g. local network address
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00—Speaker identification or verification
    • G10L17/22—Interactive procedures; Man-machine interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42225—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details characterized by types of remote control, e.g. universal remote control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42684—Client identification by a unique number or address, e.g. serial number, MAC address, socket ID
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command

Definitions

  • This application relates to the technical field of television, and in particular to a method of controlling peripheral devices, a television, and a readable storage medium.
  • the existing TVs usually only have the functions of broadcasting TV programs and connecting to the network, and the functions are relatively simple.
  • the main purpose of the present application is to provide a method for controlling peripheral devices, a TV, and a readable storage medium, aiming to solve the technical problem of a relatively single TV function in the prior art.
  • the present application provides a method for controlling peripherals, which is applied to a television.
  • the method for controlling peripherals includes the following steps:
  • the controller makes a response action corresponding to the control instruction.
  • control instruction is a first control instruction; the step of generating a control instruction based on the voice information includes:
  • the user's intention is converted into a first control instruction.
  • the step of parsing the voice information into the user's intention includes:
  • the method of controlling the peripheral device before the step of converting the user's intention into the first control instruction when determining that the user's intention exists the first authorization information, the method of controlling the peripheral device further includes:
  • an authorization verification operation is performed when the first account information is received, and after the authorization of the first account information is successfully returned, the step of determining whether the voice information is resolved information is performed.
  • the method of controlling peripheral devices further includes:
  • the voice information is converted into a second control instruction
  • an authorization verification operation is performed when the second account information is received, and after successful authorization of the second account information, return to execute whether the voice information is resolved Information steps.
  • control instruction is a first control instruction or a second control instruction; the control instruction is sent to the shadow device of the device to be controlled through the Internet of Things IOT platform, so that the shadow device can control the
  • the step of synchronizing the instruction to the controller of the device to be controlled includes:
  • the message management center includes multiple shadow devices, and each shadow device corresponds to a device to be controlled ;
  • the control instruction is synchronized to the controller of the device to be controlled through the message queue.
  • the method of controlling peripheral devices before the step of subscribing to the same message queue through the shadow device and the device to be controlled, the method of controlling peripheral devices further includes:
  • a shadow device corresponding to the first to-be-controlled device is acquired, and the step of subscribing to the same message queue through the shadow device and the to-be-controlled device is performed .
  • the step of receiving voice information when the TV is on or in standby includes:
  • step of generating a control instruction based on the voice information is performed.
  • the present application also provides a television
  • the television includes: a memory, a processor, and a program for controlling peripheral devices stored on the memory and running on the processor, the control When the program of the peripheral device is executed by the processor, the steps of the method for controlling the peripheral device described in any one of the above items are implemented.
  • the present application also provides a readable storage medium on which a program for controlling peripherals is stored, and the program for controlling peripherals is implemented by a processor to implement any of the above Steps of the method for controlling peripherals as described in item
  • the TV when the TV is turned on or in the standby state, it receives voice information, and generates control commands based on the voice information to realize the voice reception and control command generation when the TV is turned on or in standby; the control commands are sent to the standby through the IOT platform of the Internet of Things
  • the shadow device of the control device is synchronized with the controller of the device to be controlled by the shadow device to realize the control command.
  • the device to be controlled is controlled by the shadow device, so that the device to be controlled responds to the control command.
  • This application implements the function that the TV receives voice generation control commands when the TV is turned on or turned on, and the device to be controlled responds to meet the user's control needs in different scenarios.
  • the device to be controlled can be controlled across platforms to make the device to be controlled
  • the response of the device is no longer limited by the platform.
  • the method of synchronizing the status of the shadow device can avoid the problem of the device status being unable to synchronize due to network instability and the excessive load of the application status requested by multiple applications, which greatly improves the multi-platform
  • the response efficiency problem of requesting device status can better adapt to cross-platform and high-concurrency device processing requirements.
  • FIG. 1 is a schematic diagram of a structure of a TV hardware involved in the solution of an embodiment of the present application
  • FIG. 2 is a schematic flowchart of a first embodiment of a method for controlling peripheral devices of the present application
  • FIG. 3 is a schematic flowchart of a second embodiment of a method for controlling peripheral devices of this application
  • FIG. 4 is a schematic flowchart of a third embodiment of a method for controlling peripheral devices of this application.
  • FIG. 1 is a schematic diagram of a TV structure of a hardware operating environment involved in an embodiment of the present application.
  • the television may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002.
  • the communication bus 1002 is used to implement connection communication between these components.
  • the user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface and a wireless interface.
  • the network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).
  • the memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as disk storage.
  • the memory 1005 may optionally be a storage device independent of the foregoing processor 1001.
  • the TV may also include a camera, RF (Radio Frequency (radio frequency) circuits, sensors, audio circuits, WiFi modules, etc.
  • RF Radio Frequency (radio frequency) circuits
  • sensors audio circuits
  • WiFi modules etc.
  • the TV can also be equipped with other sensors such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, which will not be repeated here.
  • FIG. 1 does not constitute a limitation on the television, and may include more or less components than those illustrated, or combine certain components, or arrange different components.
  • the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a program for controlling peripheral devices.
  • the network interface 1004 is mainly used to connect to the back-end server and perform data communication with the back-end server;
  • the user interface 1003 is mainly used to connect to the client (user end) and perform data communication with the client;
  • the processor 1001 can be used to call programs for controlling peripherals stored in the memory 1005, and perform the following operations:
  • the controller makes a response action corresponding to the control instruction.
  • the processor 1001 can call a program for controlling peripheral devices stored in the memory 1005, and also perform the following operations:
  • the user's intention is converted into a first control instruction.
  • the processor 1001 can call a program for controlling peripheral devices stored in the memory 1005, and also perform the following operations:
  • the processor 1001 can call a program for controlling peripheral devices stored in the memory 1005, and also perform the following operations:
  • the processor 1001 can call a program for controlling peripheral devices stored in the memory 1005, and also perform the following operations:
  • the voice information is converted into a second control instruction
  • an authorization verification operation is performed when the second account information is received, and after successful authorization of the second account information, return to execute whether the voice information is resolved Information steps.
  • the processor 1001 can call a program for controlling peripheral devices stored in the memory 1005, and also perform the following operations:
  • the message management center includes multiple shadow devices, and each shadow device corresponds to a device to be controlled ;
  • the control instruction is synchronized to the controller of the device to be controlled through the message queue.
  • the processor 1001 can call a program for controlling peripheral devices stored in the memory 1005, and also perform the following operations:
  • a shadow device corresponding to the first to-be-controlled device is acquired, and the step of subscribing to the same message queue through the shadow device and the to-be-controlled device is performed .
  • the processor 1001 can call a program for controlling peripheral devices stored in the memory 1005, and also perform the following operations:
  • step of generating a control instruction based on the voice information is performed.
  • FIG. 2 is a schematic flowchart of a first embodiment of a method for controlling peripheral devices of the present application.
  • the method of controlling peripheral devices includes:
  • Step S10 when the television is in a power-on or standby state, receiving voice information.
  • the near field voice function of the remote control or the far field voice function of the TV comes with the desired operation, and the user's voice is uploaded to the remote control or the microphone array on the TV.
  • TV First of all, it will be judged whether the TV is turned on. When it is judged that the TV is turned on, the Internet of Things IOT platform of the TV will respond quickly, and a control command will be generated based on the voice information; if the TV is in the standby state, it is necessary to wake up the TV’s voice first Identify function, that is, wake up the TV's Internet of Things IOT platform, so as to ensure that the TV can still complete the corresponding functions of the Internet of Things IOT platform service in the standby state.
  • Step S20 generating a control instruction based on the voice information.
  • the voice information is generated into a control instruction, specifically: the user's voice information is uploaded to the voice analysis platform of the TV, and the voice analysis platform judges the voice Whether the information has been parsed, if it has not been parsed, the voice analysis is started, the voice is parsed into the user's intention, and then it is judged whether the user's intention exists the first authorization information, and if it exists, the user's intention is converted into the first control instruction.
  • the voice information needs to be parsed. If the voice information is parsed, it means that the voice information has been used as a control command to control the corresponding device to be controlled, such as The user has never turned on the air conditioner by voice. Then, when the voice message of “turn on the air conditioner” is received, it can be determined that the voice information is unparsed voice. At this time, the voice information is parsed into the user’s intention, and the user Whether the intention is to have the first authorization information, that is, whether the air conditioner is authorized to the smart home system, and if so, convert the voice message "turn on the air conditioner" into the first control instruction.
  • the voice information is parsed into the user’s intention, and the user Whether the intention is to have the first authorization information, that is, whether the air conditioner is authorized to the smart home system, and if so, convert the voice message "turn on the air conditioner" into the first control instruction.
  • the user's intention is converted into the first control instruction only when it is determined that the user's intention has the first authorization information, the voice information is verified, and when the verification is successful, the treatment is realized Controllability of control equipment.
  • Step S30 Send the control instruction to the shadow device corresponding to the device to be controlled through the Internet of Things IOT platform, so that the shadow device synchronizes the control instruction to the controller of the device to be controlled.
  • control command is generated, it is sent to the shadow device corresponding to the device to be controlled through the Internet of Things IOT platform, so that the shadow device synchronizes the control command to the controller of the device to be controlled.
  • IOT Internet of Things
  • Internet of Things Internet of Things
  • the Internet of Things is widely used in the integration of networks through communication perception technologies such as intelligent perception, recognition technology, and ubiquitous computing. It is therefore known as the third wave of development of the world’s information industry after computers and the Internet.
  • the Internet of Things IOT platform in this case connects home appliances such as air conditioners, washing machines, refrigerators, and televisions in smart homes via the Internet.
  • the shadow device that is, the shadow system (PowerShadow) builds a virtual image of the existing operating system, that is, the shadow mode (shadow) mode), it is exactly the same as the real system, the user can choose to enable or exit this virtual image at any time.
  • the user enters shadow mode (shadow mode), all operations are virtual and will not affect the real system, all changes will disappear after exiting the Shadow mode.
  • the shadow device in this case is actually a piece of software that simulates a device to be controlled.
  • Each shadow device corresponds to an identifier of the device to be controlled, such as an ID.
  • Corresponding devices to be controlled are synchronized. Therefore, the IOT platform of the Internet of Things can control the corresponding devices to be controlled through the shadow device.
  • Step S40 the controller makes a response action corresponding to the control instruction.
  • the IoT IOT platform since the IoT IOT platform controls the corresponding to-be-controlled device through the shadow device, that is, the controller MCU that controls the to-be-controlled device, after receiving the control instruction, the IoT IOT platform synchronizes to the corresponding The controller of the device to be controlled causes the controller to make a response action corresponding to the control instruction.
  • control instruction is "turn on the air conditioner”
  • the IoT IOT platform receives the "turn on the air conditioner” control instruction, it synchronizes the instruction to the controller of the air conditioner through the shadow device corresponding to the air conditioner. Actions.
  • the case includes three platforms, which are the hardware device platform of the equipment to be controlled (including the TV terminal itself, air conditioners, washing machines and other home appliances), the Internet of Things IOT platform and the background server management platform.
  • the cooperation of the three platforms can meet the user's different scenarios. Control needs.
  • the device can be controlled across platforms.
  • the IoT IOT platform controls the controller of the device to be controlled through the shadow device to achieve cross-platform control; the response of the device is no longer limited by the platform, which greatly improves the applicability of the solution.
  • the method of synchronizing the status of the shadow device can avoid the problems of the unsynchronized device status caused by the network instability and the excessive load of requesting the device status by multiple applications, which greatly improves the response efficiency of multiple platforms requesting the device status at the same time, such as
  • the hardware device platform of the device to be controlled, the IOT platform of the Internet of Things, and the backstage server management platform simultaneously request some statuses without affecting the response efficiency, and can better adapt to the cross-platform and high-concurrency device processing requirements.
  • the application When the application receives voice information, it will generate control commands based on the voice information to realize the voice reception and control command generation of the TV when it is turned on or in standby; the control commands will be sent to the shadow device of the device to be controlled through the Internet of Things IOT platform, and Through the synchronization of the shadow device and the controller of the device to be controlled, the control command is realized.
  • the device to be controlled is controlled by the shadow device, so that the device to be controlled responds to the control command.
  • This application realizes the function that the TV receives the voice generation control command when the TV is turned on or turned on, and the device to be controlled responds to meet the user's control needs in different scenarios.
  • the device to be controlled can be controlled across platforms to make the device to be controlled
  • the response of the device is no longer limited by the platform.
  • the method of synchronizing the state of the shadow device can avoid the problem of the device state cannot be synchronized due to network instability and the excessive load of the device state requested by multiple applications, greatly improving the multi-platform
  • the response efficiency of the request device status can better adapt to the cross-platform and high-concurrency device processing requirements.
  • the present application also proposes a second embodiment of a method for controlling peripheral devices.
  • the control instruction is a first control instruction; step S20 includes:
  • Step S21 Determine whether the voice information is parsed information
  • the user's voice information is uploaded to the TV's voice parsing platform.
  • the voice parsing platform determines whether the voice information has been parsed. If the user has never turned on the air conditioner by voice, then when receiving the voice message "turn on the air conditioner", It is determined that the voice information is unparsed voice.
  • Step S22 if not, parse the voice information into user intent
  • the voice information is parsed into the user's intention, specifically: the corresponding voice content is recognized through an intelligent voice recognition algorithm, and these voice content are intelligently added, deleted, and modified by the semantic conversion server, thereby parsed as The user's intention is recognized as a control instruction that the specific smart device can receive.
  • step S23 when it is determined that the user's intention exists the first authorization information, the user's intention is converted into a first control instruction.
  • the user's voice information is uploaded to the TV's voice parsing platform.
  • the voice parsing platform determines whether the voice information has been parsed. If it has not been parsed, it starts voice parsing to parse the voice into the user's intention, and then judges Whether the user's intention exists the first authorization information, and if it exists, convert the user's intention into the first control instruction.
  • the voice information Analyzes the voice information. If the voice information has been parsed, it means that the voice information has been used as a control command to control the corresponding device to be controlled. If the user has never turned on the device to be controlled by voice, then after receiving "Turn on the air conditioner" ", it can be determined that the voice information is unresolved voice. At this time, the voice information is parsed into the user's intention, and it is judged whether the user's intention has the first authorization information, that is, whether the air conditioner is authorized to the smart home system. If yes, the voice message "turn on the air conditioner" is converted into the first control command.
  • the user's intention is converted into the first control instruction only when it is determined that the user's intention has the first authorization information, the voice information is verified, and when the verification is successful, the treatment is realized Controllability of control equipment.
  • step S22 includes:
  • Step S221 Parse the voice information into corresponding voice text
  • Step S222 converting the voice text into the corresponding user intention.
  • the voice information when it is determined that the voice information is unparsed voice, the voice information needs to be first parsed into user intent, specifically: using voice recognition technology to parse the voice information into corresponding voice text, and then through semantic understanding technology, Convert the voice text to the responding user intent.
  • Speech recognition technology refers to the conversion of vocabulary content in human speech into computer-readable input, such as keystrokes, binary codes, or character sequences. Unlike speaker recognition and speaker confirmation, the latter attempts to recognize or confirm the speaker who made the speech rather than the vocabulary content contained therein.
  • Semantic understanding technology refers to the use of various methods to learn and understand the semantic content represented by a piece of text. Any understanding of language can be classified as semantic analysis.
  • a piece of text is usually composed of words, sentences, and paragraphs.
  • semantic analysis can be further decomposed into lexical-level semantic analysis, sentence-level semantic analysis, and chapter-level semantic analysis.
  • lexical-level semantic analysis focuses on how to acquire or distinguish the semantics of words.
  • Sentence-level semantic analysis attempts to analyze the semantics expressed by the entire sentence.
  • Textual semantic analysis aims to study the internal structure of natural language text and understand the text units. (It can be a sentence clause or a paragraph).
  • the goal of semantic analysis is to achieve automatic semantic analysis in various language units (including vocabulary, sentences, and chapters) through the establishment of effective models and systems, so as to realize the understanding of the true semantics of the entire text expression.
  • the method of controlling peripheral devices further includes:
  • Step S231 judging whether the user's intention exists the first authorization information, wherein, if it is, converting the user's intention into the first control instruction;
  • Step S232 if not, perform authorization verification operation when the first account information is received, and return to step 21 after the first account information is successfully authorized.
  • the first authorization information refers to that the user can control the corresponding device to be controlled by voice, that is, owns the device to be controlled Unique feature information such as identifiers such as IDs; if the user intends that the first authorization information does not exist, authorization verification is first required, specifically: the user enters the first account information, and can scan the QR code on the TV, or Manually input the first account information to perform the corresponding authorization operation, and verify the first account information. When the verification is successful, it indicates that the authorization is successful, and then returns to step S21 to re-judge whether the voice information is analyzed information.
  • the judgment of whether the voice information has the controllability of the device to be controlled is realized, and the user's intention can be converted into the first control only when it is determined that the user's intention has the controllability of the device to be controlled instruction.
  • the method for controlling peripheral devices further includes:
  • Step S211 if it is determined that the voice information is resolved information, it is determined whether the voice information has second authorization information;
  • the voice information is the parsed information
  • the user has turned on the air conditioner by voice, and the voice analysis platform of the TV has parsed the voice of “turn on the air conditioner”.
  • the voice is determined to be The information has been parsed to determine whether the unique identifier such as the ID of the specific air conditioner is included in the "turn on the air conditioner". Since each household has multiple air conditioners, at this time, although the user has turned on the A air conditioner by voice, but The B air conditioner that does not represent the user is authorized information. Therefore, if the user wants to turn on the B air conditioner, it is necessary to determine whether the second authorization information exists in "turn on the air conditioner".
  • Step S212 If it is determined that the voice information has second authorization information, convert the voice information into a second control instruction
  • the voice information is converted into a second control instruction, for example, if the user has turned on the B air conditioner by voice, when the voice information is "turn on the B air conditioner", the unique identifier ID of the B air conditioner is included Therefore, the voice information can be directly converted into the second control instruction.
  • Step S213 if it is determined that there is no second authorization information in the voice information, an authorization verification operation is performed when the second account information is received, and after the second account information authorization is successful, step S21 is returned to.
  • an authorization verification operation is performed when the second account information is received.
  • the specific verification method is similar to the verification of the first authorization information.
  • the user enters the second account information and can pass Scan the QR code on the TV, or manually enter the second account information to perform the corresponding authorization operation, and verify the second account information.
  • the verification is successful, indicating that the authorization is successful, then return to step S21 and re-voice the voice Determine whether the information is resolved information.
  • control instruction is a first control instruction or a second control instruction
  • step S30 includes:
  • Step S31 Acquire the ID of the device to be controlled based on the first authorization information or the second authorization information;
  • the IOT platform of the Internet of Things can learn the specific operation of the voice information Device to be controlled.
  • Step S32 Send the first control command with ID or the second control command with ID to the message management center through the Internet of Things IOT platform, where the message management center includes multiple shadow devices, and each shadow device corresponds to one Equipment to be controlled;
  • each shadow device corresponds to a device to be controlled, for example, shadow device A corresponds to air conditioner A, and shadow device B corresponds to air conditioner B.
  • shadow device A corresponds to air conditioner A
  • shadow device B corresponds to air conditioner B.
  • the ID of air conditioner A is passed
  • the IOT platform of the Internet of Things is sent to the message management center, so that the message management center knows that it is to control the air conditioner A.
  • the message management center sends the first control command together with the ID of the air conditioner A to the shadow device A.
  • Step S33 subscribing to the same message queue through the shadow device and the device to be controlled, and performing state synchronization through the message queue;
  • the shadow device and the corresponding to-be-controlled device subscribe to the same message queue to realize the state synchronization between the shadow device and the corresponding to-be-controlled device.
  • the shadow device A receives the control command "turn on the air conditioner A", and by subscribing to the same message queue, the control command "turn on the air conditioner A" is synchronized to the controller of the air conditioner A.
  • Step S34 Synchronize the control instruction to the controller of the device to be controlled through the message queue.
  • the control instruction is synchronized to the controller of the device to be controlled through a message queue, so that the controller of the device to be controlled makes a response action corresponding to the control instruction. If the shadow device A receives the control command "turn on the air conditioner A", by subscribing to the same message queue, the control command "turn on the air conditioner A" is synchronized to the controller of the air conditioner A. At this time, the controller of the air conditioner A performs The response action of the switch realizes voice control of air conditioner A.
  • the method of controlling peripheral devices further includes:
  • step S33 is executed.
  • the first control instruction or the second control instruction is converted into a machine instruction set that can be recognized by the machine.
  • a device list is searched based on the machine instruction set, that is, the TV terminal synchronously obtains the user's controllable device list according to the current user's identification. If the intelligent device to be set is found, the control command is issued to the shadow device of the device to be controlled. At this time, the shadow device will automatically synchronize all the state of the device to the real device of the shadow device. Otherwise, an intelligent prompt will appear to enable the user to get a correct and effective response.
  • step S10 includes:
  • step S20 is executed.
  • the near-field voice function of the remote control or the far-field voice function of the TV comes to say the desired operation.
  • the user's voice is uploaded to the TV through the remote control or the microphone array on the TV.
  • the Internet of Things IOT platform of the TV will respond quickly, and a control command will be generated based on the voice information; if the TV is in the standby state, it is necessary to wake up the TV’s voice first Identify function, that is, wake up the TV's Internet of Things IOT platform, so as to ensure that the TV can still complete the corresponding functions of the Internet of Things IOT platform service in the standby state.
  • this application prefers to use the current mainstream Internet of Things IOT platform technology to implement device management and control.
  • the IoT IOT platform technology is extremely inclusive in terms of device access. It not only provides 2/3/4G, NB-IOT, LoRA and other network equipment access solutions, but also provides a variety of protocol SDKs including MQTT and CoPA protocols, which meets the real-time nature of long connections The demand also meets the low power consumption requirement of short connection.
  • the Internet of Things IOT platform technology has natural advantages in device management and data collection and analysis. It can provide complete device lifecycle management functions, support device registration, function definition, script analysis, online debugging, remote configuration, firmware upgrade, remote maintenance, real-time monitoring, and can also group and manage devices. Selective deletion.
  • IOT platform technology also has a good performance. We can back up the device in real time through IOT technology, and we can also upload data to the cloud platform for storage, computing and other services.
  • the IOT platform technology of the Internet of Things also provides superior security guarantee capabilities.
  • the IOT platform of the Internet of Things encrypts the data at multiple levels to ensure the confidentiality and integrity of the data, and supports device-level communication resource isolation to prevent problems such as unauthorized devices.
  • this application also incorporates voice recognition and wake-up technology.
  • voice recognition and wake-up technology In the entire logic process of users controlling peripherals through voice technology, from the initial voice wake-up through wake-up words, and then the voice input of the microphone, then to the voice background analysis processing, and finally the voice synthesis feedback to the user, the entire process of processing Fast and efficient, greatly enriching the user's movie viewing experience.
  • This application also uses a key technology, which enables the TV to still control peripherals in standby mode. That is, the intelligent hardware screen technology, when the user shuts down the TV, the hardware side responds intelligently, and the CPU will selectively shut down some necessary services, while retaining IOT related services, so that when the user is issuing voice commands At this time, the CPU will perform the analysis operation normally, so as to realize the control of peripherals in the standby state.
  • the intelligent hardware screen technology when the user shuts down the TV, the hardware side responds intelligently, and the CPU will selectively shut down some necessary services, while retaining IOT related services, so that when the user is issuing voice commands At this time, the CPU will perform the analysis operation normally, so as to realize the control of peripherals in the standby state.
  • the solution designed in this application can intelligently select the voice recognition method according to the current state of the TV.
  • the user's voice is recognized as a control instruction that the hardware device can receive.
  • the method of synchronizing data with the shadow device avoids the problems of unsynchronized device status caused by network instability and excessive load of multi-application request device, which can enable the TV to control a large number of devices in various complex application scenarios.
  • This application allows users to easily and quickly control peripheral home devices, such as smart air purifiers, smart air conditioners, smart speakers, etc., through the voice of the TV side when watching TV, even when the TV is in standby.
  • peripheral home devices such as smart air purifiers, smart air conditioners, smart speakers, etc.
  • the realization of the control of this type of equipment has enriched the role of the TV, strengthened the protagonist halo of the TV, and further emphasized the new concept of the TV as a smart home control entrance for peripheral control, which has brought great importance to people's home life. Great convenience.
  • an embodiment of the present application further proposes a readable storage medium on which a program for controlling a peripheral device is stored, and the program for controlling the peripheral device is executed by the processor to implement the control peripheral device as described above Steps of the method.
  • the methods in the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware, but in many cases the former is better Implementation.
  • the technical solution of the present application can be embodied in the form of a software product in essence or part that contributes to the existing technology, and the computer software product is stored in a storage medium (such as ROM/RAM as described above) , Magnetic disks, optical disks), including several instructions to enable a device device (which may be a mobile phone, computer, server, air conditioner, or network equipment, etc.) to perform the method described in each embodiment of the present application.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Computational Linguistics (AREA)
  • Power Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Selective Calling Equipment (AREA)
  • Telephonic Communication Services (AREA)

Abstract

本申请公开了一种控制外设的方法、电视及可读存储介质，其中，控制外设的方法包括：在电视处于开机或待机状态时，接收语音信息；基于所述语音信息生成控制指令；将所述控制指令通过物联网IOT平台发送至待控设备对应的影子设备；通过所述控制器做出与所述控制指令对应的响应动作。本申请实现电视在开机或开机情况下接收语音生成控制指令，且待控设备做出响应的功能，满足用户不同情景下的控制需求，同时，使待控设备能够跨平台进行控制，使待控设备的响应不再受到平台的限制，影子设备同步状态的方法，可以避免由于网络不稳定所导致的设备状态无法同步和多应用程序请求设备状态负载过大的问题，极大的提高了多平台同时请求设备状态的响应效率问题。

Description

控制外设的方法、电视及可读存储介质
技术领域
本申请涉及电视技术领域，尤其涉及控制外设的方法、电视及可读存储介质。
背景技术
近年来，物联网技术飞速发展，其应用范围已经涉及到电子、通信、软件等多个行业，作为未来家居生活物联化的体现，智能家居发展也备受瞩目，发展速度日新月异。电视作为未来家居生活中客厅的主角，承载着客厅大屏娱乐生活的智能性和趣味性，是智能家居生态系统中不可或缺的一环。
然而，现有的电视通常只有播放电视节目及连接网络的功能，功能较为单一。
发明内容
本申请的主要目的在于提供一种控制外设的方法、电视及可读存储介质，旨在解决现有技术中电视功能较为单一的技术问题。
为实现上述目的，本申请提供一种控制外设的方法，应用于电视，所述控制外设的方法包括以下步骤：
在所述电视处于开机或待机状态时，接收语音信息；
基于所述语音信息生成控制指令；
将所述控制指令通过物联网IOT平台发送至待控设备对应的影子设备，以供所述影子设备将所述控制指令同步至所述待控设备的控制器；
通过所述控制器做出与所述控制指令对应的响应动作。
可选地，所述控制指令为第一控制指令；所述基于所述语音信息生成控制指令的步骤包括：
判断所述语音信息是否为已解析信息；
若否，则将所述语音信息解析为用户意图；
在判定所述用户意图存在第一授权信息时，将所述用户意图转化为第一控制指令。
可选地，所述将所述语音信息解析为用户意图的步骤包括：
将所述语音信息解析为对应的语音文本；
将所述语音文本转化为对应的用户意图。
可选地，所述在判定所述用户意图存在第一授权信息时，将所述用户意图转化为第一控制指令的步骤之前，所述控制外设的方法还包括：
判断所述用户意图是否存在第一授权信息，其中，若是，则将所述用户意图转化为第一控制指令；
若否，则在接收到第一账号信息时进行授权验证操作，在所述第一账号信息授权成功后返回执行所述判断所述语音信息是否为已解析信息的步骤。
可选地，所述判断所述语音信息是否为已解析信息的步骤之后，所述控制外设的方法还包括：
若判定所述语音信息为已解析信息，则判断所述语音信息是否存在第二授权信息；
若判定所述语音信息存在第二授权信息，则将所述语音信息转化为第二控制指令；
若判定所述语音信息未存在第二授权信息，则在接收到第二账号信息时进行授权验证操作，在所述第二账号信息授权成功后返回执行所述判断所述语音信息是否为已解析信息的步骤。
可选地，所述控制指令为第一控制指令或第二控制指令；所述将所述控制指令通过物联网IOT平台发送至待控设备的影子设备，以供所述影子设备将所述控制指令同步至所述待控设备的控制器的步骤包括：
基于所述第一授权信息或第二授权信息获取所述待控设备的ID；
将所述第一控制指令搭配ID或第二控制指令搭配ID通过物联网IOT平台发送至消息管理中心，其中，所述消息管理中心包括多个影子设备，且每个影子设备对应一个待控设备；
通过所述影子设备与所述待控设备订阅同一个消息队列，且通过所述消息队列进行状态同步；
通过所述消息队列将所述控制指令同步至所述待控设备的控制器。
可选地，所述通过所述影子设备与所述待控设备订阅同一个消息队列的步骤之前，所述控制外设的方法还包括：
将所述第一控制指令或第二控制指令转换为机器指令集；
基于所述机器指令集查找设备列表；
在查找到所述ID对应的第一待控设备时，获取所述第一待控设备对应的影子设备，并执行所述通过所述影子设备与所述待控设备订阅同一个消息队列的步骤。
可选地，所述在所述电视处于开机或待机状态时，接收语音信息的步骤包括：
在接收到语音信息时，判断所述电视是否处于开机状态；
若否，则唤醒所述物联网IOT平台接收所述语音信息后，执行所述基于所述语音信息生成控制指令的步骤；
若是，则执行所述基于所述语音信息生成控制指令的步骤。
此外，为实现上述目的，本申请还提供一种电视，所述电视包括：存储器、处理器及存储在所述存储器上并可在所述处理器上运行的控制外设的程序，所述控制外设的程序被所述处理器执行时实现上述中任一项所述的控制外设的方法的步骤。
此外，为实现上述目的，本申请还提供一种可读存储介质，所述可读存储介质上存储有控制外设的程序，所述控制外设的程序被处理器执行时实现上述中任一项所述的控制外设的方法的步骤。
本申请中，在电视处于开机或待机状态时接收语音信息，将基于语音信息生成控制指令，实现电视在开机或待机时的语音接收及控制指令生成；将控制指令通过物联网IOT平台发送至待控设备的影子设备，且通过影子设备与待控设备的控制器同步，实现控制指令通过影子设备控制待控设备，从而实现待控设备对控制指令的响应。本申请实现电视在开机或开机情况下接收语音生成控制指令，且待控设备做出响应的功能，满足用户不同情景下的控制需求，同时，使待控设备能够跨平台进行控制，使待控设备的响应不再受到平台的限制，影子设备同步状态的方法，可以避免由于网络不稳定所导致的设备状态无法同步和多应用程序请求设备状态负载过大的问题，极大的提高了多平台同时请求设备状态的响应效率问题，能够更好的适应跨平台及高并发的设备处理需求。
附图说明
图1为本申请实施例方案涉及的电视硬件结构示意图；
图2为本申请控制外设的方法第一实施例的流程示意图；
图3为本申请控制外设的方法第二实施例的流程示意图；
图4为本申请控制外设的方法第三实施例的流程示意图。
本申请目的实现、功能特点及优点将结合实施例，参照附图做进一步说明。
具体实施方式
应当理解，此处所描述的具体实施例仅仅用以解释本申请，并不用于限定本申请。
如图1所示，图1是本申请实施例方案涉及的硬件运行环境的电视结构示意图。
如图1所示，该电视可以包括：处理器1001，例如CPU，网络接口1004，用户接口1003，存储器1005，通信总线1002。其中，通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏（Display）、输入单元比如键盘（Keyboard），可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口（如WI-FI接口）。存储器1005可以是高速RAM存储器，也可以是稳定的存储器（non-volatile memory），例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。
可选地，电视还可以包括摄像头、RF（Radio Frequency，射频）电路，传感器、音频电路、WiFi模块等等。当然，电视还可配置陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器，在此不再赘述。
本领域技术人员可以理解，图1中示出的电视结构并不构成对电视的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。
如图1所示，作为一种计算机存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及控制外设的程序。
在图1所示的电视中，网络接口1004主要用于连接后台服务器，与后台服务器进行数据通信；用户接口1003主要用于连接客户端（用户端），与客户端进行数据通信；而处理器1001可以用于调用存储器1005中存储的控制外设的程序，并执行以下操作：
在所述电视处于开机或待机状态时，接收语音信息；
基于所述语音信息生成控制指令；
将所述控制指令通过物联网IOT平台发送至待控设备对应的影子设备，以供所述影子设备将所述控制指令同步至所述待控设备的控制器；
通过所述控制器做出与所述控制指令对应的响应动作。
进一步地，处理器1001可以调用存储器1005中存储的控制外设的程序，还执行以下操作：
判断所述语音信息是否为已解析信息；
若否，则将所述语音信息解析为用户意图；
在判定所述用户意图存在第一授权信息时，将所述用户意图转化为第一控制指令。
进一步地，处理器1001可以调用存储器1005中存储的控制外设的程序，还执行以下操作：
将所述语音信息解析为对应的语音文本；
将所述语音文本转化为对应的用户意图。
进一步地，处理器1001可以调用存储器1005中存储的控制外设的程序，还执行以下操作：
判断所述用户意图是否存在第一授权信息；
若否，则在接收到第一账号信息时进行授权验证操作，在所述第一账号信息授权成功后返回执行所述判断所述语音信息是否为已解析信息的步骤；
若是，则将所述用户意图转化为第一控制指令。
进一步地，处理器1001可以调用存储器1005中存储的控制外设的程序，还执行以下操作：
若判定所述语音信息为已解析信息，则判断所述语音信息是否存在第二授权信息；
若判定所述语音信息存在第二授权信息，则将所述语音信息转化为第二控制指令；
若判定所述语音信息未存在第二授权信息，则在接收到第二账号信息时进行授权验证操作，在所述第二账号信息授权成功后返回执行所述判断所述语音信息是否为已解析信息的步骤。
进一步地，处理器1001可以调用存储器1005中存储的控制外设的程序，还执行以下操作：
基于所述第一授权信息或第二授权信息获取所述待控设备的ID；
将所述第一控制指令搭配ID或第二控制指令搭配ID通过物联网IOT平台发送至消息管理中心，其中，所述消息管理中心包括多个影子设备，且每个影子设备对应一个待控设备；
通过所述影子设备与所述待控设备订阅同一个消息队列，且通过所述消息队列进行状态同步；
通过所述消息队列将所述控制指令同步至所述待控设备的控制器。
进一步地，处理器1001可以调用存储器1005中存储的控制外设的程序，还执行以下操作：
将所述第一控制指令或第二控制指令转换为机器指令集；
基于所述机器指令集查找设备列表；
在查找到所述ID对应的第一待控设备时，获取所述第一待控设备对应的影子设备，并执行所述通过所述影子设备与所述待控设备订阅同一个消息队列的步骤。
进一步地，处理器1001可以调用存储器1005中存储的控制外设的程序，还执行以下操作：
在接收到语音信息时，判断所述电视是否处于开机状态；
若否，则唤醒所述物联网IOT平台接收所述语音信息后，执行所述基于所述语音信息生成控制指令的步骤；
若是，则执行所述基于所述语音信息生成控制指令的步骤。
参照图2，图2为本申请控制外设的方法第一实施例的流程示意图，在第一实施例中，控制外设的方法包括：
步骤S10，在所述电视处于开机或待机状态时，接收语音信息。
本实施例中，用户在使用电视时，通过遥控器的近场语音功能或者电视自带的远场语音功能说出想要实现的操作，用户的语音通过遥控器或者电视上的麦克风阵列上传到电视中。首先，会对电视是否开机进行判断，在判定电视处于开机状态时，则电视端的物联网IOT平台会迅速进行响应，将基于语音信息生成控制指令；若电视处于待机状态，首先需要唤醒电视的语音识别功能，即唤醒电视的物联网IOT平台，从而保证电视在待机状态下仍然能完成物联网IOT平台服务相应的功能。
步骤S20，基于所述语音信息生成控制指令。
本实施例中，不管是开机状态还是待机状态，在接收到语音信息时，会将语音信息生成控制指令，具体为：用户的语音信息上传到电视的语音解析平台，语音解析平台判断所述语音信息是否被解析过，如果没被解析过，则开始进行语音解析，将语音解析为用户意图，再判断用户意图是否存在第一授权信息，如果存在，则将用户意图转化为第一控制指令。
由于智能家居中待控设备有很多，如电视、空调、洗衣机等，因此，需要对语音信息进行解析，如果语音信息被解析过，说明该语音信息作为控制指令控制过对应的待控设备，如用户从未通过语音打开过空调，那么，在接收到“打开空调”的语音信息时，可判定该语音信息为未解析语音，此时，将该语音信息解析为用户意图，并且，判断该用户意图是否存在第一授权信息，即空调是否被授权到智能家居系统中，若是，则将该语音信息“打开空调”转化为第一控制指令。
通过判断语音信息是否为已解析信息，若否，在判定用户意图存在第一授权信息时，才将用户意图转化为第一控制指令，实现了对语音信息的验证，在验证成功时，实现对待控设备的可控性。
步骤S30，将所述控制指令通过物联网IOT平台发送至待控设备对应的影子设备，以供所述影子设备将所述控制指令同步至所述待控设备的控制器。
本实施例中，在控制指令生成后，通过物联网IOT平台发送至待控设备对应的影子设备，以供影子设备将控制指令同步至待控设备的控制器。
IOT（Internet of things，物联网）是新一代信息技术的重要组成部分，也是“信息化”时代的重要发展阶段，物联网就是物物相连的互联网。这有两层意思：其一，物联网的核心和基础仍然是互联网，是在互联网基础上的延伸和扩展的网络；其二，其用户端延伸和扩展到了任何物品与物品之间，进行信息交换和通信，也就是物物相息。物联网通过智能感知、识别技术与普适计算等通信感知技术，广泛应用于网络的融合中，也因此被称为继计算机、互联网之后世界信息产业发展的第三次浪潮。
本案的物联网IOT平台，将智能家居中的如空调、洗衣机、冰箱、电视机等家用电器通过网络的形式连接起来。
影子设备，即影子系统(PowerShadow)构建现有操作系统的虚拟影像，即影子模式（shadow mode），它和真实的系统完全一样，用户可随时选择启用或者退出这个虚拟影像。用户进入影子模式（shadow mode）后，所有操作都是虚拟的，不会对真正的系统产生影响，一切改变将在退出Shadow模式后消失。
本案的影子设备，其实是模拟待控设备的一款软件，一个物联网IOT平台内设有多个影子设备，每一个影子设备都对应一个待控设备的标识符，如ID，由于影子设备与对应的待控设备是同步进行的，因此，物联网IOT平台通过影子设备就能控制对应的待控设备。
步骤S40，通过所述控制器做出与所述控制指令对应的响应动作。
本实施例中，由于物联网IOT平台通过影子设备控制对应的待控设备，即控制待控设备的控制器MCU，物联网IOT平台在接收到控制指令后，通过对应的影子设备同步给对应的待控设备的控制器，使得控制器做出与控制指令对应的响应动作。
如控制指令为“打开空调”，物联网IOT平台在接收到“打开空调”的控制指令时，通过与空调对应的影子设备同步该指令给空调的控制器，此时，空调的控制器执行打开的动作。
本案包括三个平台，分别为待控设备（包括电视端自身、空调、洗衣机等家电）的硬件设备平台、物联网IOT平台以及后台服务器管理平台，三个平台的配合可以满足用户不同情景下的控制需要。同时使设备可以跨平台进行控制，比如，物联网IOT平台通过影子设备控制待控设备的控制器，实现跨平台控制；使设备的响应不再受到平台的限制，大大提高了方案的适用性。影子设备同步状态的方法，可以避免由于网络不稳定所导致的设备状态无法同步和多应用程序请求设备状态负载过大的问题，极大的提高了多平台同时请求设备状态的响应效率问题，如待控设备的硬件设备平台、物联网IOT平台以及后台服务器管理平台三个平台之间同时请求一些状态时不会影响响应效率，能够更好的适应跨平台及高并发的设备处理需求。
本申请在接收到语音信息时，将基于语音信息生成控制指令，实现电视在开机或待机时的语音接收及控制指令生成；将控制指令通过物联网IOT平台发送至待控设备的影子设备，且通过影子设备与待控设备的控制器同步，实现控制指令通过影子设备控制待控设备，从而实现待控设备对控制指令的响应。本申请实现电视在开机或开机情况下接收语音生成控制指令，且待控设备做出响应的功能，满足用户不同情景下的控制需求，同时，使待控设备能够跨平台进行控制，使待控设备的响应不再受到平台的限制，影子设备同步状态的方法，可以避免由于网络不稳定所导致的设备状态无法同步和多应用程序请求设备状态负载过大的问题，极大的提高了多平台同时请求设备状态的响应效率问题，能够更好的适应跨平台及高并发的设备处理需求。
基于第一实施例，本申请还提出控制外设的方法的第二实施例，如图3所示，所述控制指令为第一控制指令；步骤S20包括：
步骤S21，判断所述语音信息是否为已解析信息；
用户的语音信息上传到电视的语音解析平台，语音解析平台判断所述语音信息是否被解析过，如用户从未通过语音打开过空调，那么，在接收到“打开空调”的语音信息时，可判定该语音信息为未解析语音。
步骤S22，若否，则将所述语音信息解析为用户意图；
在判定语音信息为未解析语音，首先，将语音信息解析为用户意图，具体为：通过智能语音识别算法，识别出相应的语音内容，这些语音内容经过语义转换服务器的智能增删改，从而解析为用户意图，识别为具体的智能设备可以接收的控制指令。
步骤S23，在判定所述用户意图存在第一授权信息时，将所述用户意图转化为第一控制指令。
本实施例中，用户的语音信息上传到电视的语音解析平台，语音解析平台判断所述语音信息是否被解析过，如果没被解析过，则开始进行语音解析将语音解析为用户意图，再判断用户意图是否存在第一授权信息，如果存在，则将用户意图转化为第一控制指令。
对语音信息进行解析，如果语音信息被解析过，说明该语音信息作为控制指令控制过对应的待控设备，如用户从未通过语音打开过空调的待控设备，那么，在接收到“打开空调”的语音信息时，可判定该语音信息为未解析语音，此时，将该语音信息解析为用户意图，并且，判断该用户意图是否存在第一授权信息，即空调是否被授权到智能家居系统中，若是，则将该语音信息“打开空调”转化为第一控制指令。
通过判断语音信息是否为已解析信息，若否，在判定用户意图存在第一授权信息时，才将用户意图转化为第一控制指令，实现了对语音信息的验证，在验证成功时，实现对待控设备的可控性。
进一步地，步骤S22包括：
步骤S221，将所述语音信息解析为对应的语音文本；
步骤S222，将所述语音文本转化为对应的用户意图。
本实施例中，在判定所述语音信息为未解析语音时，首先需要将语音信息解析为用户意图，具体为：利用语音识别技术将语音信息解析成对应的语音文本，然后通过语义理解技术，将语音文本转换为响应的用户意图。
语音识别技术是指将人类的语音中的词汇内容转换为计算机可读的输入，例如按键、二进制编码或者字符序列。与说话人识别及说话人确认不同，后者尝试识别或确认发出语音的说话人而非其中所包含的词汇内容。
语义理解技术，是指运用各种方法，学习与理解一段文本所表示的语义内容，任何对语言的理解都可以归为语义分析的范畴。一段文本通常由词、句子和段落来构成，根据理解对象的语言单位不同，语义分析又可进一步分解为词汇级语义分析、句子级语义分析以及篇章级语义分析。一般来说，词汇级语义分析关注的是如何获取或区别单词的语义，句子级语义分析则试图分析整个句子所表达的语义，而篇章语义分析旨在研究自然语言文本的内在结构并理解文本单元（可以是句子从句或段落）间的语义关系。简单地讲，语义分析的目标就是通过建立有效的模型和系统，实现在各个语言单位（包括词汇、句子和篇章等）的自动语义分析，从而实现理解整个文本表达的真实语义。
进一步地，步骤S23之前，所述控制外设的方法还包括：
步骤S231，判断所述用户意图是否存在第一授权信息，其中，若是，则将所述用户意图转化为第一控制指令；
步骤S232，若否，则在接收到第一账号信息时进行授权验证操作，在所述第一账号信息授权成功后返回执行步骤21。
本实施例中，在判定用户意图存在第一授权信息之前，首先判断该用户意图是否存在第一授权信息，第一授权信息是指用户能通过语音控制对应的待控设备，即拥有待控设备标识符如ID之类的唯一特征信息；若用户意图未存在第一授权信息时，首先需要进行授权验证，具体为：用户输入第一账号信息，可以通过扫描电视上的二维码，或者是手动输入第一账号信息进行相应的授权操作，并且，对第一账号信息进行验证，在验证成功时，说明授权成功，则返回执行步骤S21，重新对语音信息是否为已解析信息进行判断。
若判定用户意图存在授权信息，则说明用户意图已包含了待控设备标识符如ID之类的唯一特征信息，此时，可直接将用户意图转换为第一控制指令。
通过对用户意图是否存在第一授权信息的判断，实现对语音信息是否存在待控设备可控性的判断，在判定用户意图对待控设备存在可控性时，才能将用户意图转换为第一控制指令。
进一步地，步骤S21之后，所述控制外设的方法还包括：
步骤S211，若判定所述语音信息为已解析信息，则判断所述语音信息是否存在第二授权信息；
在判定语音信息为已解析信息，则判断语音信息是否存在第二授权信息，比如，用户用语音打开过空调，电视的语音解析平台解析过“打开空调”的语音，此时，判定该语音为已解析信息，判断“打开空调”中是否包含了具体的空调的ID之类的唯一标识符，由于每家每户都有多台空调，此时，尽管用户用语音打开过A空调，但是并不代表用户的B空调为已授权信息，因此，若用户想要打开B空调，需要判断“打开空调”是否存在第二授权信息。
步骤S212，若判定所述语音信息存在第二授权信息，则将所述语音信息转化为第二控制指令；
在判定语音信息存在第二授权信息时，将语音信息转换为第二控制指令，如用户用语音打开过B空调，在语音信息为“打开B空调”时，包含了B空调的唯一标识符ID，因此，可直接将语音信息转换为第二控制指令。
步骤S213，若判定所述语音信息未存在第二授权信息，则在接收到第二账号信息时进行授权验证操作，在所述第二账号信息授权成功后返回执行步骤S21。
本实施例中，若判定语音信息未存在第二授权信息，则在接收到第二账号信息时进行授权验证操作，具体验证方式与验证第一授权信息类似，用户输入第二账号信息，可以通过扫描电视上的二维码，或者是手动输入第二账号信息进行相应的授权操作，并且，对第二账号信息进行验证，在验证成功时，说明授权成功，则返回执行步骤S21，重新对语音信息是否为已解析信息进行判断。
进一步地，基于第二实施例，提出本申请控制外设的方法的第三实施例，如图4所示，所述控制指令为第一控制指令或第二控制指令，步骤S30包括：
步骤S31，基于所述第一授权信息或第二授权信息获取所述待控设备的ID；
由于第一授权信息及第二授权信息均包含了待控设备的唯一标识符如ID，在获取待控设备的唯一标识符后，使得物联网IOT平台能够得知所述语音信息具体要操作的待控设备。
步骤S32，将所述第一控制指令搭配ID或第二控制指令搭配ID通过物联网IOT平台发送至消息管理中心，其中，所述消息管理中心包括多个影子设备，且每个影子设备对应一个待控设备；
由于消息管理中心包括多个影子设备，且每个影子设备均对应一个待控设备，如影子设备A对应空调A，影子设备B对应空调B，如，根据第一控制指令搭配空调A的ID通过物联网IOT平台发送至消息管理中心，使得消息管理中心得知是要控制空调A，此时，消息管理中心将第一控制指令搭配空调A的ID发送至影子设备A。
步骤S33，通过所述影子设备与所述待控设备订阅同一个消息队列，且通过所述消息队列进行状态同步；
通过影子设备与对应的待控设备订阅同一个消息队列，实现影子设备与对应的待控设备之间的状态同步。如影子设备A接收到控制指令“打开空调A”，通过订阅同一个消息队列，使得控制指令“打开空调A”同步至空调A的控制器。
步骤S34，通过所述消息队列将所述控制指令同步至所述待控设备的控制器。
通过消息队列将所述控制指令同步至所述待控设备的控制器，使得待控设备的控制器做出与控制指令对应的响应动作。如影子设备A接收到控制指令“打开空调A”，通过订阅同一个消息队列，使得控制指令“打开空调A”同步至空调A的控制器，此时，空调A的控制器执行打开空调A的开关的响应动作，实现语音控制空调A。
进一步地，步骤S33之前，所述控制外设的方法还包括：
将所述第一控制指令或第二控制指令转换为机器指令集；
基于所述机器指令集查找设备列表；
在查找到所述ID对应的第一待控设备时，获取所述第一待控设备对应的影子设备，并执行步骤S33。
本实施例中，在准确理解用户语音意图的基础上，将第一控制指令或第二控制指令转换为机器可以识别的机器指令集。基于所述机器指令集查找设备列表，即电视端根据当前用户的标识同步去获取用户的可控的设备列表。如果查找到该智能待设设备，就将控制指令下发给该待控设备的影子设备。此时影子设备会自动将设备的所有状态同步给该影子设备的真实设备。否则则出现智能提示，使用户得到正确及有效的响应。
进一步地，步骤S10包括：
在接收到语音信息时，判断所述电视是否处于开机状态；
若否，则唤醒所述物联网IOT平台接收所述语音信息后，执行所述基于所述语音信息生成控制指令的步骤；
若是，则执行步骤S20。
用户在使用电视时，通过遥控器的近场语音功能或者电视自带的远场语音功能说出想要实现的操作，用户的语音通过遥控器或者电视上的麦克风阵列上传到电视中。首先，会对电视是否开机进行判断，在判定电视处于开机状态时，则电视端的物联网IOT平台会迅速进行响应，将基于语音信息生成控制指令；若电视处于待机状态，首先需要唤醒电视的语音识别功能，即唤醒电视的物联网IOT平台，从而保证电视在待机状态下仍然能完成物联网IOT平台服务相应的功能。
本申请的具体优势在于：
相对于单纯采用MQTT协议对设备直接进行控制，本申请更倾向于采用目前主流的物联网IOT平台技术去实现设备的管理和控制。
物联网IOT平台技术在设备的接入方面有着极大的包容性。它不但提供了2/3/4G、NB-IOT、LoRA等不同网络设备接入的方案，而且提供了包括MQTT、CoPA协议在内的多种协议的设备SDK，既满足了长连接的实时性需求，也满足了短连接的低功耗需求。
物联网IOT平台技术在对设备管理和数据采集分析方面有着天然的优势。它可以提供完整的设备生命周期管理功能，支持设备的注册、功能定义、脚本解析、在线调试、远程配置、固件升级、远程维护、实时监控，而且还可以对设备进行分组管理以及对设备进行有选择性的删除。
在数据采集及分析管理方面，物联网IOT平台技术也有着不错的表现。我们可以通过IOT技术对设备进行实时的备份，还可以将数据上传至云平台进行存储、计算等其他服务。
在安全性方面，物联网IOT平台技术也提供了超强的安全保障能力。当我们登录IOT后台时，不但需要经过多重身份验证，而且不同的身份所对应的操作权限也会有很大的区别。当数据进行传输通信时，物联网IOT平台对数据进行了多层次的加密，保证了数据的机密性和完整性，而且支持设备级别的通信资源隔离，防止设备越权等问题的出现。
除了采用物联网IOT平台技术去控制外设，方便了对设备的统一管理和数据采集，本申请也将语音识别和唤醒技术纳入其中。在用户通过语音技术去控制外设的整个逻辑过程中，从最初的通过唤醒词进行语音唤醒，然后麦克风的语音录入，再到语音后台的解析处理，最后进行语音合成反馈用户，整个过程的处理快捷高效，极大丰富了用户的观影体验。
本申请还用到一项关键技术，它实现了电视在待机状态下仍然可以去控制外设。即智能化硬件息屏技术，用户在对电视进行关机操作时，硬件端进行智能响应，CPU会有选择性地去关闭一些必要性的服务，同时保留IOT相关服务，这样当用户在发出语音指令时，CPU会正常地进行解析运转，从而实现在待机状态下对外设的控制。
本申请设计的方案，可以根据电视的当前状态，智能选择语音的识别方式。同时将用户的语音识别为硬件设备可以接收到的控制指令。采用影子设备同步数据的方式，避免了由于网络不稳定所导致的设备状态无法同步和多应用程序请求设备负载过大的问题，可以使电视在各种复杂的应用场景下控制大量设备的要求。
本申请使得用户在看电视的时候可以通过电视端的语音去很方便快捷地去控制周边家居设备，比如智能空气净化器、智能空调、智能音箱等，甚至在电视待机的情况下依然可以通过语音去实现对该类设备的操控，从而丰富了电视的角色定位，增强了电视的主角光环，更进一步强调了电视作为智能家居控制入口进行外设控制的全新概念，给人们的家居生活带来了极大的便利。
此外，本申请实施例还提出一种可读存储介质，所述可读存储介质上存储有控制外设的程序，所述控制外设的程序被处理器执行时实现如上所述的控制外设的方法的步骤。
本申请可读存储介质的具体实施例与上述控制外设的方法的各个实施例基本相同，在此不做赘述。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。
上述本申请实施例序号仅仅为了描述，不代表实施例的优劣。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台装置设备(可以是手机，计算机，服务器，空调器，或者网络设备等)执行本申请各个实施例所述的方法。
以上仅为本申请的优选实施例，并非因此限制本申请的专利范围，凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本申请的专利保护范围内。

Claims (15)

  1. 一种控制外设的方法，其中，应用于电视，所述控制外设的方法包括以下步骤：
    在所述电视处于开机或待机状态时，接收语音信息；
    基于所述语音信息生成控制指令；
    将所述控制指令通过物联网IOT平台发送至待控设备对应的影子设备，以供所述影子设备将所述控制指令同步至所述待控设备的控制器；
    通过所述控制器做出与所述控制指令对应的响应动作。
  2. 如权利要求1所述的控制外设的方法，其中，所述控制指令为第一控制指令；所述基于所述语音信息生成控制指令的步骤包括：
    判断所述语音信息是否为已解析信息；
    若否，则将所述语音信息解析为用户意图；
    在判定所述用户意图存在第一授权信息时，将所述用户意图转化为第一控制指令。
  3. 如权利要求2所述的控制外设的方法，其中，所述将所述语音信息解析为用户意图的步骤包括：
    将所述语音信息解析为对应的语音文本；
    将所述语音文本转化为对应的用户意图。
  4. 如权利要求2所述的控制外设的方法，其中，所述在判定所述用户意图存在第一授权信息时，将所述用户意图转化为第一控制指令的步骤之前，所述控制外设的方法还包括：
    判断所述用户意图是否存在第一授权信息，其中，若是，则将所述用户意图转化为第一控制指令；
    若否，则在接收到第一账号信息时进行授权验证操作，在所述第一账号信息授权成功后返回执行所述判断所述语音信息是否为已解析信息的步骤。
  5. 如权利要求4所述的控制外设的方法，其中，所述判断所述语音信息是否为已解析信息的步骤之后，所述控制外设的方法还包括：
    若判定所述语音信息为已解析信息，则判断所述语音信息是否存在第二授权信息；
    若判定所述语音信息存在第二授权信息，则将所述语音信息转化为第二控制指令；
    若判定所述语音信息未存在第二授权信息，则在接收到第二账号信息时进行授权验证操作，在所述第二账号信息授权成功后返回执行所述判断所述语音信息是否为已解析信息的步骤。
  6. 如权利要求5所述的控制外设的方法，其中，所述控制指令为第一控制指令或第二控制指令；所述将所述控制指令通过物联网IOT平台发送至待控设备的影子设备，以供所述影子设备将所述控制指令同步至所述待控设备的控制器的步骤包括：
    基于所述第一授权信息或第二授权信息获取所述待控设备的ID；
    将所述第一控制指令搭配ID或第二控制指令搭配ID通过物联网IOT平台发送至消息管理中心，其中，所述消息管理中心包括多个影子设备，且每个影子设备对应一个待控设备；
    通过所述影子设备与所述待控设备订阅同一个消息队列，且通过所述消息队列进行状态同步；
    通过所述消息队列将所述控制指令同步至所述待控设备的控制器。
  7. 如权利要求6所述的控制外设的方法，其中，所述通过所述影子设备与所述待控设备订阅同一个消息队列的步骤之前，所述控制外设的方法还包括：
    将所述第一控制指令或第二控制指令转换为机器指令集；
    基于所述机器指令集查找设备列表；
    在查找到所述ID对应的第一待控设备时，获取所述第一待控设备对应的影子设备，并执行所述通过所述影子设备与所述待控设备订阅同一个消息队列的步骤。
  8. 如权利要求1所述的控制外设的方法，其中，所述在所述电视处于开机或待机状态时，接收语音信息的步骤包括：
    在接收到语音信息时，判断所述电视是否处于开机状态；
    若否，则唤醒所述物联网IOT平台接收所述语音信息后，执行所述基于所述语音信息生成控制指令的步骤；
    若是，则执行所述基于所述语音信息生成控制指令的步骤。
  9. 一种电视，其中，所述电视包括：存储器、处理器及存储在所述存储器上并可在所述处理器上运行的控制外设的程序，所述控制外设的程序被所述处理器执行时实现如权利要求1所述的控制外设的方法的步骤。
  10. 一种电视，其中，所述电视包括：存储器、处理器及存储在所述存储器上并可在所述处理器上运行的控制外设的程序，所述控制外设的程序被所述处理器执行时实现如权利要求2所述的控制外设的方法的步骤。
  11. 一种电视，其中，所述电视包括：存储器、处理器及存储在所述存储器上并可在所述处理器上运行的控制外设的程序，所述控制外设的程序被所述处理器执行时实现如权利要求3所述的控制外设的方法的步骤。
  12. 一种电视，其中，所述电视包括：存储器、处理器及存储在所述存储器上并可在所述处理器上运行的控制外设的程序，所述控制外设的程序被所述处理器执行时实现如权利要求4所述的控制外设的方法的步骤。
  13. 一种电视，其中，所述电视包括：存储器、处理器及存储在所述存储器上并可在所述处理器上运行的控制外设的程序，所述控制外设的程序被所述处理器执行时实现如权利要求5所述的控制外设的方法的步骤。
  14. 一种电视，其中，所述电视包括：存储器、处理器及存储在所述存储器上并可在所述处理器上运行的控制外设的程序，所述控制外设的程序被所述处理器执行时实现如权利要求6所述的控制外设的方法的步骤。
  15. 一种可读存储介质，其中，所述可读存储介质上存储有控制外设的程序，所述控制外设的程序被处理器执行时实现如权利要求1所述的控制外设的方法的步骤。
PCT/CN2019/078836 2018-12-24 2019-03-20 控制外设的方法、电视及可读存储介质 WO2020133741A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811586659.4A CN109618202B (zh) 2018-12-24 2018-12-24 控制外设的方法、电视及可读存储介质
CN201811586659.4 2018-12-24

Publications (1)

Publication Number Publication Date
WO2020133741A1 true WO2020133741A1 (zh) 2020-07-02

Family

ID=66011071

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/078836 WO2020133741A1 (zh) 2018-12-24 2019-03-20 控制外设的方法、电视及可读存储介质

Country Status (2)

Country Link
CN (1) CN109618202B (zh)
WO (1) WO2020133741A1 (zh)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110753921B (zh) * 2019-01-11 2023-08-29 Oppo广东移动通信有限公司 查询请求的处理方法、装置、计算机设备和存储介质
CN113454966B (zh) * 2019-07-24 2023-02-17 Oppo广东移动通信有限公司 一种影子设备的生成方法、设备及存储介质
CN110501988B (zh) * 2019-09-25 2020-06-09 北京金茂绿建科技有限公司 一种实现物联网设备融合控制方法及其装置
CN111478965A (zh) * 2020-04-07 2020-07-31 四川虹美智能科技有限公司 设备影子的处理方法、装置和系统
CN113676382B (zh) * 2020-05-13 2023-04-07 云米互联科技(广东)有限公司 Iot语音命令的控制方法、系统及计算机可读存储介质
CN114244860A (zh) * 2020-09-07 2022-03-25 北京金山云网络技术有限公司 一种物联网设备管理方法、装置、电子设备及存储介质
CN112600881A (zh) * 2020-12-01 2021-04-02 珠海格力电器股份有限公司 提供物联网服务的方法、设备、服务器及存储介质
CN112556988B (zh) * 2020-12-02 2023-09-26 海信视像科技股份有限公司 显示装置及其检测电路
CN115134343A (zh) * 2021-03-29 2022-09-30 深圳绿米联创科技有限公司 设备控制方法、系统、装置、服务器及存储介质
CN114137888B (zh) * 2021-12-10 2023-10-03 珠海格力电器股份有限公司 设备的联动控制方法、处理器与设备联动控制系统
CN114900384B (zh) * 2022-04-11 2024-03-22 哈尔滨工业大学 一种跨平台的物联网与智能设备的通信系统及其通信方法

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105872075A (zh) * 2016-05-06 2016-08-17 东莞中科智城软件有限公司 一种将物联网设备映射到智慧城市资源模型的方法
CN107370649A (zh) * 2017-08-31 2017-11-21 广东美的制冷设备有限公司 家电控制方法、系统、控制终端、及存储介质
CN107479400A (zh) * 2017-09-28 2017-12-15 广东美的制冷设备有限公司 家电设备的控制方法、装置、家电设备及可读存储介质
CN107515944A (zh) * 2017-08-31 2017-12-26 广东美的制冷设备有限公司 基于人工智能的交互方法、用户终端、及存储介质
CN108111617A (zh) * 2017-12-27 2018-06-01 浙江力石科技股份有限公司 物联网平台中规则控制的实现方法及装置
US20180285062A1 (en) * 2017-03-28 2018-10-04 Wipro Limited Method and system for controlling an internet of things device using multi-modal gesture commands
CN108696575A (zh) * 2017-04-10 2018-10-23 艾拉物联公司 物联网平台中设备的第三方应用控制

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN203966093U (zh) * 2014-07-18 2014-11-26 谭迎建 智能居家一体化设备
KR101662396B1 (ko) * 2014-10-13 2016-10-05 한국과학기술원 IoT 장치를 제어하기 위한 방법 및 시스템
CN105717797A (zh) * 2016-01-29 2016-06-29 四川长虹电器股份有限公司 一种基于语音识别的家居管理设备、系统及方法
CN106385347A (zh) * 2016-09-09 2017-02-08 珠海格力电器股份有限公司 一种家电设备控制方法和装置
CN106792028A (zh) * 2016-12-29 2017-05-31 重庆金鑫智慧科技有限公司 一种基于物联网的机顶盒控制智能家居系统
CN108255934B (zh) * 2017-12-07 2020-10-27 北京奇艺世纪科技有限公司 一种语音控制方法及装置
CN107911492A (zh) * 2017-12-27 2018-04-13 浙江力石科技股份有限公司 物联网平台中设备接入的方法及装置

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105872075A (zh) * 2016-05-06 2016-08-17 东莞中科智城软件有限公司 一种将物联网设备映射到智慧城市资源模型的方法
US20180285062A1 (en) * 2017-03-28 2018-10-04 Wipro Limited Method and system for controlling an internet of things device using multi-modal gesture commands
CN108696575A (zh) * 2017-04-10 2018-10-23 艾拉物联公司 物联网平台中设备的第三方应用控制
CN107370649A (zh) * 2017-08-31 2017-11-21 广东美的制冷设备有限公司 家电控制方法、系统、控制终端、及存储介质
CN107515944A (zh) * 2017-08-31 2017-12-26 广东美的制冷设备有限公司 基于人工智能的交互方法、用户终端、及存储介质
CN107479400A (zh) * 2017-09-28 2017-12-15 广东美的制冷设备有限公司 家电设备的控制方法、装置、家电设备及可读存储介质
CN108111617A (zh) * 2017-12-27 2018-06-01 浙江力石科技股份有限公司 物联网平台中规则控制的实现方法及装置

Also Published As

Publication number Publication date
CN109618202A (zh) 2019-04-12
CN109618202B (zh) 2020-12-08

Similar Documents

Publication Publication Date Title
WO2020133741A1 (zh) 控制外设的方法、电视及可读存储介质
WO2019041856A1 (zh) 家电控制方法、系统、控制终端、及存储介质
WO2014073823A1 (en) Display apparatus, voice acquiring apparatus and voice recognition method thereof
WO2014038916A1 (en) System and method of controlling external apparatus connected with device
WO2013187715A1 (en) Server and method of controlling the same
WO2018143711A1 (en) System and method of providing sensing data to electronic device
WO2014023223A1 (zh) 一种实现家庭中多媒体终端相互控制的方法和系统
WO2014030889A1 (en) Method and apparatus for sharing content
WO2017012417A1 (zh) 多屏互动设备之间的控制方法、多屏互动设备及系统
WO2020145552A1 (en) Image display device and operation method thereof
WO2019156506A1 (en) System and method for providing conversational contents
WO2016080747A1 (en) User terminal and method for controlling display apparatus
WO2020032443A1 (en) Electronic device supporting personalized device connection and method thereof
WO2020133764A1 (zh) 语音遥控方法、系统、受控装置及计算机可读存储介质
WO2018076840A1 (zh) 数据分享方法、装置、存储介质及服务器
WO2020145631A1 (en) Content reproducing apparatus and content reproducing method
EP3011751A1 (en) Server, control method thereof, image processing apparatus, and control method thereof
WO2020032465A1 (en) Method for contents playback with continuity and electronic device therefor
WO2016119414A1 (zh) 一种基于二维码的文件共享方法、系统及移动终端
WO2017206880A1 (zh) 终端数据处理方法、装置、存储介质及电子设备
WO2020007099A1 (zh) 电视终端控制方法、设备及计算机可读存储介质
WO2012099402A2 (en) Method and apparatus for phone communication using home network
WO2018117536A1 (en) Electronic apparatus, control authority authentication method thereof and user terminal apparatus
WO2017090931A1 (ko) 이벤트 관리 서비스를 제공하는 전자 장치 및 방법
WO2017135776A1 (en) Display apparatus, user terminal apparatus, system, and controlling method thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19905730

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19905730

Country of ref document: EP

Kind code of ref document: A1