WO2021047248A1 - Multiple control terminal-based iot device control method, control terminal, and storage medium - Google Patents

Multiple control terminal-based iot device control method, control terminal, and storage medium Download PDF

Info

Publication number
WO2021047248A1
WO2021047248A1 PCT/CN2020/099241 CN2020099241W WO2021047248A1 WO 2021047248 A1 WO2021047248 A1 WO 2021047248A1 CN 2020099241 W CN2020099241 W CN 2020099241W WO 2021047248 A1 WO2021047248 A1 WO 2021047248A1
Authority
WO
WIPO (PCT)
Prior art keywords
iot device
control
iot
wake
user
Prior art date
Application number
PCT/CN2020/099241
Other languages
French (fr)
Chinese (zh)
Inventor
李宾
Original Assignee
深圳创维-Rgb电子有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳创维-Rgb电子有限公司 filed Critical 深圳创维-Rgb电子有限公司
Publication of WO2021047248A1 publication Critical patent/WO2021047248A1/en

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00Speaker identification or verification techniques
    • G10L17/22Interactive procedures; Man-machine interfaces
    • G10L17/24Interactive procedures; Man-machine interfaces the user being prompted to utter a password or a predefined phrase
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • H04L12/2816Controlling appliance services of a home automation network by calling their functionalities
    • H04L12/282Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home

Definitions

  • This application relates to the field of Internet of Things, and in particular to an IOT device control method based on multiple control terminals, a control terminal, and a computer-readable storage medium.
  • IOTs Internet of Things (Internet of Things) equipment and multiple control terminals
  • IOTs Internet of Things (Internet of Things) equipment and multiple control terminals
  • multiple control terminals will collect the wake-up word yelled by the user and be awakened at the same time.
  • Multiple control terminals perform voice broadcasts at the same time, resulting in confusion and mutual voice broadcasts.
  • Interference identification, and multiple control terminals simultaneously issue control commands to the same IOT device, which will also cause the control commands to be disordered and affect the control of the IOT device.
  • the main purpose of this application is to propose an IOT device control method based on multiple control terminals, a control terminal, and a computer-readable storage medium, which aims to solve the problem of waking up multiple control terminals simultaneously in the prior art, which leads to confusion in voice broadcast, mutual interference recognition, and The technical problem of control disorder caused by multiple control terminals controlling the same device.
  • this application provides an IOT device control method based on multiple control terminals, which is applied to any control terminal and includes the steps:
  • the IOT device corresponding to the device type is controlled according to the control instruction.
  • the step of controlling the IOT device corresponding to the device identifier according to the control instruction includes:
  • the control instruction is sent to the IOT device to be controlled, so that the IOT device to be controlled executes the control instruction.
  • the method before the step of selecting at least one IOT device from all IOT devices corresponding to the device type as the IOT device to be controlled according to preset screening rules, the method further includes:
  • Extract voiceprint features in voice information including wake-up words and voiceprint features in voice information including device type and control instructions;
  • the step of selecting at least one IOT device from all IOT devices corresponding to the device type as the IOT device to be controlled according to a preset screening rule includes:
  • the step of selecting at least one IOT device from all IOT devices corresponding to the device type as the IOT device to be controlled according to a preset screening rule includes:
  • the step of selecting the IOT device corresponding to the device type in the area where the device is located as the IOT device to be controlled includes:
  • the method further includes:
  • the method further includes:
  • the present application also provides a control terminal, the control terminal including a memory, a processor, and a computer program stored on the memory and running on the processor, the computer program being The processor implements the steps of the IOT device control method based on multiple control terminals as described above when executed.
  • the present application also provides a computer-readable storage medium having a computer program stored on the computer-readable storage medium, and when the computer program is executed by a processor, the above-mentioned multi-control terminal-based IOT is realized. Steps of the device control method.
  • the IOT device control method, control terminal, and computer-readable storage medium proposed in this application are based on a multi-control terminal, which receives voice information including a wake-up word sent by a user, and extracts the decibel value of the voice information; the extracted decibel The value is sent to the preset judgment terminal, so that the preset judgment terminal sends a wake-up notification to the control corresponding to the maximum decibel value based on the decibel value and the corresponding decibel value fed back when other control terminals receive the voice information at the same time Terminal; when receiving a wake-up notification sent by the preset judgment terminal, enter the wake-up mode according to the wake-up notification; when receiving voice information including device type and control instructions sent by the user in the wake-up mode, according to the The control instruction controls the IOT device corresponding to the device type.
  • control terminals in the home simultaneously collect the user's output voice information including the wake-up word, they will not all enter the wake-up mode, but select the one with the largest decibel value of the collected voice information to enter the wake-up mode.
  • the control terminal controls the IOT device according to the subsequent control instructions sent by the user, which can prevent multiple control terminals from performing voice broadcasts at the same time, resulting in confusion of voice broadcasts and mutual interference recognition, and control caused by multiple control terminals controlling IOT devices at the same time It is confusing, and is conducive to more clearly collecting the voice control instructions sent by the user after the control terminal enters the working mode, so it can control the IOT device better and more accurately.
  • FIG. 1 is a schematic structural diagram of a hardware operating environment involved in a solution of an embodiment of the present application
  • FIG. 2 is a schematic flowchart of a first embodiment of an IOT device control method based on multiple control terminals according to this application;
  • FIG. 3 is a detailed flow diagram of the step S40 in the second embodiment of the IOT device control method based on multiple control terminals according to the control instruction to control the IOT device corresponding to the device identifier in the second embodiment of this application;
  • step S50 is a detailed flowchart of step S50 in the fourth embodiment of an IOT device control method based on multiple control terminals according to this application;
  • step S50 is a detailed flowchart of step S50 in the fifth embodiment of the IOT device control method based on multiple control terminals according to this application;
  • FIG. 6 is a detailed flowchart of step S54 in the sixth embodiment of the IOT device control method based on multiple control terminals of this application.
  • FIG. 1 is a schematic diagram of the hardware structure of the control terminal provided in each embodiment of the application.
  • the control terminal includes a communication module 10, a memory 20, a processor 30 and other components.
  • the processor 30 is respectively connected to the memory 20 and the communication module 10, and a computer program is stored on the memory 20, and the computer program is executed by the processor 30 at the same time.
  • the communication module 10 can be connected to external devices via a network.
  • the communication module 10 can receive data sent by an external device, and can also send data, instructions, and information to the external device.
  • the external device can be an IOT device, other control terminals, mobile phones, tablet computers, notebook computers, and desktop computers. equipment.
  • the memory 20 can be used to store software programs and various data.
  • the memory 20 may mainly include a storage program area and a storage data area.
  • the storage program area may store an operating system, an application program required by at least one function (to extract the decibel value of the voice information including the wake-up word), etc.; the storage data area may store Data or information created based on the use of the control terminal.
  • the memory 20 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.
  • the processor 30 is the control center of the control terminal. It uses various interfaces and lines to connect the various parts of the entire control terminal, runs or executes the software programs and/or modules stored in the memory 20, and calls those stored in the memory 20. Data, perform various functions of the control terminal and process data, so as to monitor the control terminal as a whole.
  • the processor 30 may include one or more processing units; preferably, the processor 30 may integrate an application processor and a modem processor, where the application processor mainly processes the operating system, user interface, application programs, etc., and the modem The processor mainly deals with wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 30.
  • control terminal may further include a circuit control module, which is used to connect to the mains power supply to realize power supply control and ensure the normal operation of other components.
  • control terminal shown in FIG. 1 does not constitute a limitation on the control terminal, and may include more or less components than shown in the figure, or a combination of certain components, or different component arrangements.
  • the multi-control terminal-based IOT device control method includes the steps:
  • Step S10 receiving the voice message including the wake-up word sent by the user, and extracting the decibel value of the voice message
  • the home control terminal can connect to all smart home appliances in the home through a wireless network, and control any smart home appliance in the home by sending control instructions.
  • the control terminal has voice collection and voice recognition functions.
  • the control terminal can be a smart home appliance integrating voice collection and voice recognition functions, or a smart terminal or smart robot with voice collection and voice recognition functions alone.
  • Each control terminal in the home will collect the voice information sent by the user in real time and perform voice recognition.
  • the user needs to wake up the control terminal, and needs to output voice information including a wake-up word.
  • the wake-up word can be a preset specific vocabulary.
  • each control terminal When each control terminal collects the voice information sent by the user in the dormant state, it will perform voice recognition on the voice information, extract keywords, and determine whether the keywords are preset specific words, so as to determine whether the voice information includes wake-up words If the wake-up word is included, the decibel value of the voice information will be extracted; if the wake-up word is not included, the voice information sent by the user will continue to be collected.
  • Step S20 Send the extracted decibel value to a preset judgment terminal, so that the preset judgment terminal sends a wake-up notification based on the decibel value and the corresponding decibel value fed back when other control terminals receive the voice information at the same time
  • the microphone of the control terminal After the microphone of the control terminal extracts the decibel value of the voice information including the wake-up word sent by the user, it will send the extracted decibel value to the preset judgment terminal through the wireless network or the wired network, and the preset judgment terminal receives the information of the family.
  • the decibel value sent by the control terminal will send a wake-up notification to the control terminal corresponding to the maximum decibel value. If the maximum decibel value corresponds to at least two control terminals, the wake-up notification can be sent to any one of the at least two control terminals corresponding to the maximum decibel value, or the wake-up notification can be sent to the maximum decibel according to the preset priority of each control terminal
  • the control terminal with the highest priority is preset among the at least two control terminals corresponding to the value.
  • Step S30 when receiving the wake-up notification sent by the preset judgment terminal, enter the wake-up mode according to the wake-up notification
  • Step S40 When the voice information including the device type and the control instruction sent by the user is received in the wake-up mode, the IOT device corresponding to the device type is controlled according to the control instruction.
  • the control terminal that has received the wake-up notification switches from the sleep mode to the wake-up mode, while the other control terminals do not receive the wake-up notification.
  • the sleep mode continues to be maintained, and the control terminal that enters the wake-up mode receives the voice information including the device type and the control instruction sent by the user, and controls the IOT device corresponding to the device type according to the control instruction.
  • one of the control terminals can be selected in advance as the preset judgment terminal, and the other control terminals send the extracted decibel value to the preset judgment terminal through the wireless network or the wired network, and the preset judgment terminal is based on the received Compare the decibel value sent by other control terminals with the decibel value extracted by itself to determine the control terminal with the maximum decibel value. If the control terminal with the maximum decibel value is another control terminal, a wake-up notification is sent to the control terminal with the maximum decibel value, So that the control terminal receiving the wake-up notification switches from the sleep mode to the wake-up mode; if the maximum decibel value control terminal is itself, it directly switches from the sleep mode to the wake-up mode.
  • the voice information including the wake-up word sent by the user is received, and the decibel value of the voice information is extracted; the extracted decibel value is sent to the preset judgment terminal, so that the preset judgment terminal is based on the decibel value and other controls
  • the terminal sends a wake-up notification to the control terminal corresponding to the maximum decibel value based on the corresponding decibel value fed back when the voice information is received at the same time; when receiving the wake-up notification sent by the preset judgment terminal, according to the wake-up notification Enter the wake-up mode; when the voice information including the device type and the control instruction sent by the user is received in the wake-up mode, the IOT device corresponding to the device type is controlled according to the control instruction.
  • control terminals in the home simultaneously collect the user's output voice information including the wake-up word, they will not all enter the wake-up mode, but select the one with the largest decibel value of the collected voice information to enter the wake-up mode.
  • the control terminal controls the IOT device according to the subsequent control instructions sent by the user, which can prevent multiple control terminals from performing voice broadcasts at the same time, resulting in confusion of voice broadcasts and mutual interference recognition, and control caused by multiple control terminals controlling IOT devices at the same time It is confusing, and is conducive to more clearly collecting the voice control instructions sent by the user after the control terminal enters the working mode, so it can control the IOT device better and more accurately.
  • step S40 The step of controlling the IOT device corresponding to the device identifier according to the control instruction in S40 includes:
  • Step S50 according to a preset screening rule, select at least one IOT device from all IOT devices corresponding to the device type as the IOT device to be controlled;
  • Step S60 Send the control instruction to the IOT device to be controlled, so that the IOT device to be controlled executes the control instruction.
  • the control terminal after the control terminal enters the wake-up mode, when the voice information including the device type and the control instruction sent by the user is collected, it recognizes the voice, obtains the device type and control instruction, and obtains the device type and control instruction according to the preset screening rules. At least one IOT device is selected from all IOT devices corresponding to the device type as the IOT device to be controlled.
  • the preset filtering rule may be to randomly select one IOT device from the IOT devices corresponding to the device type, which may be based on the The device type corresponds to the distance between each IOT device and the control terminal, and the closest IOT device is selected.
  • This embodiment proposes a strategy for the control terminal in the wake-up mode to receive the control instruction and device type sent by the user, and the control terminal sends the control instruction to the device to be controlled corresponding to the device type to control the device to be controlled.
  • the awakened control terminal is closest to the user, and the voice sent by the user is the clearest received by the control terminal, so that the control instructions and device types obtained by recognizing the voice are more accurate, thereby improving the control of the IOT device more accurately.
  • the step S50 is include:
  • Step S70 extracting voiceprint features in the voice information including the wake-up word and voiceprint features in the voice information including the device type and control instructions;
  • Step S80 It is determined whether the voiceprint feature in the voice information including the device type and the control instruction is consistent with the voiceprint feature in the voice information including the wake-up word; if so, step S50 is executed.
  • the control terminal in the wake-up mode receives the voice information including the device type and the control instruction sent by the user
  • the control terminal will extract the voiceprint features and the voice information in the voice information including the wake-up words sent by the user before.
  • the voiceprint feature in the voice message including the device type and control instruction sent by the current user and the voiceprint feature in the voice message including the wake-up word sent by the previous user and the voice message including the device type and control instruction sent by the current user Compare the voiceprint features of the device. When they are consistent, perform voice recognition on the voice information, obtain the device type and control instructions, and select at least one IOT from all the IOT devices corresponding to the device type according to the preset screening rules.
  • the device is an IOT device to be controlled.
  • the preset screening rule may be to randomly select one IOT device from the IOT devices corresponding to the device type, and the distance between each IOT device and the control terminal may be corresponding to the device type according to the device type. Select the closest IOT device, or randomly select one IOT device from the IOT devices in the same area as the control terminal according to the area of each IOT device corresponding to the device type, or select the one with the highest preset priority, It is also possible to select the IOT device closest to the control terminal from the IOT devices in the same area as the control terminal according to the area of each IOT device corresponding to the device type and the distance corresponding to the control terminal. After the device to be controlled is determined, the control instruction is sent to the IOT device to be controlled, so that the IOT device to be controlled executes the control instruction.
  • the voiceprint feature in the voice information including the wake-up word sent by the user is inconsistent with the voiceprint feature in the voice information including the device type and control instructions sent by the current user, the voice information will not be processed .
  • the voice information including the control instruction sent by the user after receiving the voice information including the control instruction sent by the user, firstly determine whether the voiceprint feature in the voice information including the control instruction and the voiceprint in the voice information including the wake-up word are the same.
  • Will control the device to be controlled according to the control instruction in the voice message including the control instruction so as to ensure that only the user who has awakened the control terminal can issue the control instruction to the IOT device to control the device, and avoid other users who have not awakened the control terminal
  • Controlling IOT devices, especially in families with children, can prevent children from disturbing and controlling IOT devices by mistake.
  • the fourth embodiment of the IOT device control method based on multiple control terminals of the present application is proposed.
  • the step S50 includes:
  • Step S51 Obtain the distance of each IOT device corresponding to the device type, and select the closest IOT device as the IOT device to be controlled.
  • the control terminal in the wake-up mode obtains the distance between each IOT device corresponding to the device type and the control terminal according to the device type in the voice information sent by the user. According to the distance between each IOT device corresponding to the name and the control terminal, select the IOT device corresponding to the device type closest to the control terminal. For example, when the equipment type is air conditioner, the control terminal inquires that there are 4 air conditioners in total, namely the air conditioner in the living room, the main bedroom air conditioner, the second bedroom air conditioner, and the study room air conditioner. The distance of the control terminal is from the nearest to the farthest for the master bedroom air conditioner, the second bedroom air conditioner, the study air conditioner and the living room air conditioner. According to the distance between each air conditioner and the control terminal, the control terminal will select the master bedroom air conditioner as the air conditioner to be controlled.
  • control terminal when the control terminal cannot find the IOT device corresponding to the device type according to the device type in the voice information sent by the user, it will feedback an error message to the user. When the control terminal is based on the voice information sent by the user If only one IOT device corresponding to the device type is queried, the IOT device is directly used as the device to be controlled.
  • This embodiment proposes a strategy of selecting the IOT device closest to the control terminal as the IOT device to be controlled, so that when there are multiple IOT devices corresponding to the device type sent by the user, the device closest to the user is automatically selected as the device to be controlled. Smarter.
  • the step S50 includes:
  • Step S52 Obtain the distance of each IOT device corresponding to the device type and the area where each IOT device is located;
  • Step S53 judging whether there is an IOT device corresponding to the device type in the area where each IOT device is located according to the area where each IOT device is located;
  • step S54 select the IOT device corresponding to the device type in the area where it is located as the IOT device to be controlled;
  • step S55 is executed to select the closest IOT device from the IOT devices corresponding to the device type as the IOT device to be controlled.
  • the control terminal in the wake-up mode obtains the distance between each IOT device corresponding to the device type and the control terminal and the area where each IOT device is located according to the device type in the voice information sent by the user. Then determine whether there is an IOT device corresponding to the device type in the area where the control terminal is located, and if so, select each IOT device corresponding to the device type in the area where the control terminal is located as the device to be controlled, for example, the area where the control terminal is located is the main area In the bedroom, the equipment type is lights. If there are lights in the master bedroom, turn on all the lights in the master bedroom.
  • the control terminal selects the IOT device corresponding to the device type closest to the control terminal. For example, when the area where the control terminal is located is the kitchen, the device The type is air conditioner, but there is no air conditioner in the kitchen. Only the main bedroom, the second bedroom and the living room have air conditioners, and the air conditioner in the living room is the closest to the control terminal. The control terminal will select the air conditioner in the living room as the IOT device to be controlled.
  • control terminal when the control terminal cannot find the IOT device corresponding to the device type according to the device type in the voice information sent by the user, it will feedback an error message to the user. When the control terminal is based on the voice information sent by the user If only one IOT device corresponding to the device type is queried, the IOT device is directly used as the device to be controlled.
  • This embodiment proposes a strategy of selecting the IOT device in the same area as the control terminal as the IOT device to be controlled, so that the device in the same area as the user is automatically selected as the device to be controlled, which is more intelligent.
  • the sixth embodiment of the IOT device control method based on multiple control terminals of the present application is proposed.
  • the step S54 includes:
  • Step S56 Select the IOT device corresponding to the device type closest to the device in the area where the user is located as the IOT device to be controlled.
  • the control terminal in the wake-up mode obtains the distance between each IOT device corresponding to the device type and the control terminal and the area where each IOT device is located according to the device type in the voice information sent by the user. Then determine whether there is an IOT device corresponding to the device type in the area where the control terminal is located, and if so, select the IOT device closest to the control terminal from the IOT devices corresponding to the device type in the area where the control terminal is located as the to-be-controlled IOT device Equipment, for example, the area where the control terminal is located is the entrance of the living room, the equipment type is lights, and there are multiple lights in the living room, and the distribution positions are the entrance of the living room and the center of the living room, etc., and the light at the entrance of the living room is the closest to the control terminal.
  • the control terminal will turn on the light at the entrance door of the living room. If the judgment result is no, then according to the distance between each IOT device corresponding to the name and the control terminal, select the IOT device corresponding to the device type closest to the control terminal. For example, when the area where the control terminal is located is the kitchen, the device The type is air conditioner, but there is no air conditioner in the kitchen. Only the main bedroom, the second bedroom and the living room have air conditioners, and the air conditioner in the living room is the closest to the control terminal. The control terminal will select the air conditioner in the living room as the IOT device to be controlled.
  • control terminal when the control terminal cannot find the IOT device corresponding to the device type according to the device type in the voice information sent by the user, it will feedback an error message to the user. When the control terminal is based on the voice information sent by the user If only one IOT device corresponding to the device type is queried, the IOT device is directly used as the device to be controlled.
  • This embodiment proposes a strategy for selecting the IOT device that is in the same area as the control terminal and is closest to the control terminal as the IOT device to be controlled, so that it can be automatically controlled when there are multiple IOT devices corresponding to the device type sent by the user in the area where the user is located. Choose the device closest to the user as the device to be controlled, which is more intelligent.
  • a seventh embodiment of the IOT device control method based on multiple control terminals of the present application is proposed.
  • the step S40 is followed by include:
  • Step S90 sending a request to enter the sleep mode to the user, so that the user feeds back the instruction to enter the sleep mode;
  • Step S100 when receiving a sleep mode entry command fed back by the user, enter the sleep mode.
  • the control terminal after the control terminal sends a control instruction to the IOT device to be controlled, the control terminal will output a request to enter the sleep mode by voice to the user, and the user will feed back the instruction whether to enter the sleep mode according to their own needs. Feed back the instruction to enter the sleep mode.
  • the control terminal After the control terminal receives the instruction to enter the sleep mode feedback from the user, it will enter the sleep mode. When the user feedbacks the instruction not to enter the sleep mode, the control terminal will receive the instruction not to enter the sleep mode feedback from the user. Continue to maintain the wake-up mode until receiving the user's feedback to enter the sleep mode command.
  • This embodiment proposes a strategy of actively asking the user if the user needs to enter the sleep mode after controlling the IOT device, and passively performing the sleep mode according to the user feedback result, so as to avoid the IOT device from being in the wake-up mode for a long time after controlling the IOT device, and to save power by entering the sleep mode.
  • step S80 is followed by include:
  • Step S110 It is judged whether the voice information including the device type and the control instruction sent by the user again is received within a preset time after the control of the IOT device is completed;
  • Step S120 within a preset time after completing the control of the IOT device, when the voice information including the device type and the control instruction sent by the user is not received again, the sleep mode is directly entered.
  • the control terminal After the control terminal completes the control of the IOT device, it is judged whether the voice message including the device type and control instruction sent by the user is received again within a preset time.
  • the preset time may be 10 seconds, 30 seconds, or 1 The minutes are not limited here. If the user does not receive the voice information including the device type and the control instruction again sent by the user within the preset time, it directly enters the sleep mode.
  • step S40 if the voice information including the device type and the control instruction sent by the user again is received within the preset time, then return to step S40.
  • This embodiment proposes a strategy for the control terminal to automatically enter the dormant state when it does not receive a control command sent by the user again within a preset time after the control of the IOT device to be controlled is completed, thereby avoiding the IOT device from being in the wake-up mode for a long time after controlling the IOT device. Entering the sleep mode saves power, and does not need to ask the user to automatically enter the sleep mode, which improves the user's experience.
  • the computer-readable storage medium may be the memory 20 in the control terminal of FIG. 1, or may be, for example, ROM (Read-Only Memory)/RAM (Random Access Memory), magnetic disk, At least one of the optical discs, and the computer-readable storage medium includes several pieces of information for enabling the server or the TV to execute the methods described in the various embodiments of the present application.

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Automation & Control Theory (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computational Linguistics (AREA)
  • Selective Calling Equipment (AREA)

Abstract

Provided are a multiple control terminal-based Internet-of-Things (IoT) device control method, control terminal, and storage medium, the method comprising: receiving a voice message comprising a wake-up word sent by a user, and extracting the decibel value of the voice information (S10); sending the extracted decibel value to a preset determination terminal, such that the preset determination terminal, according to the decibel value and a corresponding decibel value fed back by other control terminals when the voice information is received at the same time, sends a wake-up notification to a control terminal corresponding to the maximum decibel value (S20); upon receiving the wake-up notification sent by the preset determination terminal, entering a wake-up mode according to the wake-up notification (S30); upon receiving, in the wake-up mode, voice information comprising the device type and a control instruction sent by the user, controlling, according to the control instruction, an IoT device corresponding to the device type (S40).

Description

基于多控制终端的IOT设备控制方法、控制终端及存储介质IOT device control method based on multiple control terminals, control terminal and storage medium
本申请要求于2019年9月10日申请的、申请号为201910857917.6、名称为“基于多控制终端的IOT设备控制方法、控制终端及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed on September 10, 2019, with application number 201910857917.6, titled "Multi-control terminal-based IOT device control method, control terminal and storage medium", the entire content of which is incorporated by reference Incorporated in this application.
技术领域Technical field
本申请涉及物联网领域,尤其涉及一种基于多控制终端的IOT设备控制方法、控制终端及计算机可读存储介质。This application relates to the field of Internet of Things, and in particular to an IOT device control method based on multiple control terminals, a control terminal, and a computer-readable storage medium.
背景技术Background technique
当前家庭的智能家居系统中都存在多个IOT(Internet of Things,物联网)设备和多个控制终端,从而实现家庭的IOT设备互联互控。但由于设置多个控制终端,在用户喊出唤醒词时,多个控制终端都会采集到用户喊出的唤醒词,从而同时被唤醒,多个控制终端同时进行语音播报,导致语音播报混乱和相互之间干扰识别,并且多个控制终端同时对同一IOT设备下发控制指令,也会导致控制指令错乱,影响对IOT设备的控制。There are multiple IOTs (Internet of Things (Internet of Things) equipment and multiple control terminals, so as to realize the interconnection and mutual control of home IOT equipment. However, due to the setting of multiple control terminals, when the user shouts the wake-up word, multiple control terminals will collect the wake-up word yelled by the user and be awakened at the same time. Multiple control terminals perform voice broadcasts at the same time, resulting in confusion and mutual voice broadcasts. Interference identification, and multiple control terminals simultaneously issue control commands to the same IOT device, which will also cause the control commands to be disordered and affect the control of the IOT device.
技术解决方案Technical solutions
本申请的主要目的在于提出一种基于多控制终端的IOT设备控制方法、控制终端及计算机可读存储介质,旨在解决现有技术中同时唤醒多控制终端,导致语音播报混乱、相互干扰识别及多控制终端控制同台设备造成控制错乱的技术问题。The main purpose of this application is to propose an IOT device control method based on multiple control terminals, a control terminal, and a computer-readable storage medium, which aims to solve the problem of waking up multiple control terminals simultaneously in the prior art, which leads to confusion in voice broadcast, mutual interference recognition, and The technical problem of control disorder caused by multiple control terminals controlling the same device.
为实现上述目的,本申请提供一种基于多控制终端的IOT设备控制方法,应用于任一控制终端,包括步骤:To achieve the above objective, this application provides an IOT device control method based on multiple control terminals, which is applied to any control terminal and includes the steps:
接收用户发送的包括唤醒词的语音信息,并提取该语音信息的分贝值;Receive the voice message including the wake-up word sent by the user, and extract the decibel value of the voice message;
将提取的分贝值发送至预设判断终端,以使预设判断终端根据所述分贝值以及其他控制终端在同一时间接收到所述语音信息时所反馈的对应分贝值,发送唤醒通知至最大分贝值对应的控制终端;Send the extracted decibel value to the preset judgment terminal, so that the preset judgment terminal sends a wake-up notification to the maximum decibel based on the decibel value and the corresponding decibel value fed back when other control terminals receive the voice information at the same time The control terminal corresponding to the value;
当接收到所述预设判断终端发送的唤醒通知时,根据所述唤醒通知进入唤醒模式;When receiving a wake-up notification sent by the preset judgment terminal, enter the wake-up mode according to the wake-up notification;
当在唤醒模式下接收到用户发送的包括设备类型和控制指令的语音信息时,根据所述控制指令控制所述设备类型对应的IOT设备。When the voice information including the device type and the control instruction sent by the user is received in the wake-up mode, the IOT device corresponding to the device type is controlled according to the control instruction.
在一实施例中,所述根据所述控制指令控制所述设备标识对应的IOT设备的步骤包括:In an embodiment, the step of controlling the IOT device corresponding to the device identifier according to the control instruction includes:
根据预设的筛选规则,从所述设备类型对应的所有IOT设备中选择至少一台IOT设备作为待控制IOT设备;According to preset screening rules, select at least one IOT device from all IOT devices corresponding to the device type as the IOT device to be controlled;
将所述控制指令发送至所述待控制IOT设备,以使所述待控制IOT设备执行所述控制指令。The control instruction is sent to the IOT device to be controlled, so that the IOT device to be controlled executes the control instruction.
在一实施例中,所述根据预设的筛选规则,从所述设备类型对应的所有IOT设备中选择至少一台IOT设备作为待控制IOT设备的步骤之前,还包括:In an embodiment, before the step of selecting at least one IOT device from all IOT devices corresponding to the device type as the IOT device to be controlled according to preset screening rules, the method further includes:
提取包括唤醒词的语音信息中的声纹特征和包括设备类型和控制指令的语音信息中的声纹特征;Extract voiceprint features in voice information including wake-up words and voiceprint features in voice information including device type and control instructions;
判断包括设备类型和控制指令的语音信息中的声纹特征是否与包括唤醒词的语音信息中的声纹特征一致;Determine whether the voiceprint feature in the voice information including the device type and the control instruction is consistent with the voiceprint feature in the voice information including the wake-up word;
若是,则执行步骤:根据预设的筛选规则,从所述设备类型对应的所有IOT设备中选择至少一台IOT设备作为待控制IOT设备。If yes, perform the step: according to a preset screening rule, select at least one IOT device from all IOT devices corresponding to the device type as the IOT device to be controlled.
在一实施例中,所述根据预设的筛选规则,从所述设备类型对应的所有IOT设备中选择至少一台IOT设备作为待控制IOT设备的步骤包括:In an embodiment, the step of selecting at least one IOT device from all IOT devices corresponding to the device type as the IOT device to be controlled according to a preset screening rule includes:
获取与所述设备类型对应的各IOT设备的距离,并选择距离最近的IOT设备作为待控制IOT设备。Obtain the distance of each IOT device corresponding to the device type, and select the closest IOT device as the IOT device to be controlled.
在一实施例中,所述根据预设的筛选规则,从所述设备类型对应的所有IOT设备中选择至少一台IOT设备作为待控制IOT设备的步骤包括:In an embodiment, the step of selecting at least one IOT device from all IOT devices corresponding to the device type as the IOT device to be controlled according to a preset screening rule includes:
获取与所述设备类型对应的各IOT设备的距离以及各IOT设备的所在区域;Acquiring the distance of each IOT device corresponding to the device type and the area where each IOT device is located;
根据各IOT设备的所在区域判断自身所在区域内是否存在所述设备类型对应的IOT设备;Judging whether there is an IOT device corresponding to the device type in the area where each IOT device is located according to the area where each IOT device is located;
若是,则选择自身所在区域内所述设备类型对应的IOT设备作为待控制IOT设备;If yes, select the IOT device corresponding to the device type in the area where it is located as the IOT device to be controlled;
若否,则从所述设备类型对应的各IOT设备中选择距离最近的IOT设备作为待控制IOT设备。If not, select the closest IOT device from the IOT devices corresponding to the device type as the IOT device to be controlled.
在一实施例中,所述选择自身所在区域内所述设备类型对应的IOT设备作为待控制IOT设备的步骤包括:In an embodiment, the step of selecting the IOT device corresponding to the device type in the area where the device is located as the IOT device to be controlled includes:
选择自身所在区域内距离最近的所述设备类型对应的IOT设备作为待控制IOT设备。Select the IOT device corresponding to the device type closest in the area where it is located as the IOT device to be controlled.
在一实施例中,所述根据所述控制指令控制所述设备类型对应的IOT设备的步骤之后还包括:In an embodiment, after the step of controlling the IOT device corresponding to the device type according to the control instruction, the method further includes:
发送进入休眠模式的请求至用户,以使用户反馈进入休眠模式指令;Send a request to enter the sleep mode to the user, so that the user will feed back the instruction to enter the sleep mode;
当接收到用户反馈的进入休眠模式指令时,进入休眠模式。When receiving a user's feedback to enter the sleep mode instruction, enter the sleep mode.
在一实施例中,所述根据所述控制指令控制所述设备类型对应的IOT设备的步骤之后还包括:In an embodiment, after the step of controlling the IOT device corresponding to the device type according to the control instruction, the method further includes:
判断完成IOT设备控制后的预设时间内是否接收到用户再次发送的包括设备类型和控制指令的语音信息;Determine whether the voice message including the device type and control instruction sent by the user again is received within the preset time after the control of the IOT device is completed;
在完成IOT设备控制后的预设时间内,当未接收到用户再次发送的包括设备类型和控制指令的语音信息时,直接进入休眠模式。Within the preset time after the control of the IOT device is completed, when the user does not receive the voice information including the device type and control instruction again sent by the user, it directly enters the sleep mode.
为实现上述目的,本申请还提供一种控制终端,所述控制终端包括存储器、处理器和存储在所述存储器上并可在所述处理器上运行的计算机程序,所述计算机程序被所述处理器执行时实现如上所述的基于多控制终端的IOT设备控制方法的步骤。In order to achieve the above objective, the present application also provides a control terminal, the control terminal including a memory, a processor, and a computer program stored on the memory and running on the processor, the computer program being The processor implements the steps of the IOT device control method based on multiple control terminals as described above when executed.
为实现上述目的,本申请还提供一种计算机可读存储介质,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现如上所述的基于多控制终端的IOT设备控制方法的步骤。In order to achieve the foregoing objective, the present application also provides a computer-readable storage medium having a computer program stored on the computer-readable storage medium, and when the computer program is executed by a processor, the above-mentioned multi-control terminal-based IOT is realized. Steps of the device control method.
本申请提出的一种基于多控制终端的IOT设备控制方法、控制终端及计算机可读存储介质,通过接收用户发送的包括唤醒词的语音信息,并提取该语音信息的分贝值;将提取的分贝值发送至预设判断终端,以使预设判断终端根据所述分贝值以及其他控制终端在同一时间接收到所述语音信息时所反馈的对应分贝值,发送唤醒通知至最大分贝值对应的控制终端;当接收到所述预设判断终端发送的唤醒通知时,根据所述唤醒通知进入唤醒模式;当在唤醒模式下接收到用户发送的包括设备类型和控制指令的语音信息时,根据所述控制指令控制所述设备类型对应的IOT设备。从而当家庭内多个控制终端同时采集到用户的输出的包括唤醒词的语音信息时,不会全部进入唤醒模式,而是选择采集到的语音信息的分贝值最大的一个控制终端进入唤醒模式,并由该控制终端根据用户后续发送的控制指令控制IOT设备,可以避免多台控制终端同时进行语音播报,导致语音播报混乱和相互之间干扰识别,以及多台控制终端同时控制IOT设备导致的控制错乱,并且有利于控制终端进入工作模式后能够更清晰的采集到用户发送的语音控制指令,故能够更好地更精准地控制IOT设备。The IOT device control method, control terminal, and computer-readable storage medium proposed in this application are based on a multi-control terminal, which receives voice information including a wake-up word sent by a user, and extracts the decibel value of the voice information; the extracted decibel The value is sent to the preset judgment terminal, so that the preset judgment terminal sends a wake-up notification to the control corresponding to the maximum decibel value based on the decibel value and the corresponding decibel value fed back when other control terminals receive the voice information at the same time Terminal; when receiving a wake-up notification sent by the preset judgment terminal, enter the wake-up mode according to the wake-up notification; when receiving voice information including device type and control instructions sent by the user in the wake-up mode, according to the The control instruction controls the IOT device corresponding to the device type. Therefore, when multiple control terminals in the home simultaneously collect the user's output voice information including the wake-up word, they will not all enter the wake-up mode, but select the one with the largest decibel value of the collected voice information to enter the wake-up mode. And the control terminal controls the IOT device according to the subsequent control instructions sent by the user, which can prevent multiple control terminals from performing voice broadcasts at the same time, resulting in confusion of voice broadcasts and mutual interference recognition, and control caused by multiple control terminals controlling IOT devices at the same time It is confusing, and is conducive to more clearly collecting the voice control instructions sent by the user after the control terminal enters the working mode, so it can control the IOT device better and more accurately.
附图说明Description of the drawings
图1是本申请实施例方案涉及的硬件运行环境的结构示意图;FIG. 1 is a schematic structural diagram of a hardware operating environment involved in a solution of an embodiment of the present application;
图2为本申请基于多控制终端的IOT设备控制方法第一实施例的流程示意图;2 is a schematic flowchart of a first embodiment of an IOT device control method based on multiple control terminals according to this application;
图3为本申请基于多控制终端的IOT设备控制方法第二实施例中步骤S40中所述根据所述控制指令控制所述设备标识对应的IOT设备的步骤的细化流程示意图;3 is a detailed flow diagram of the step S40 in the second embodiment of the IOT device control method based on multiple control terminals according to the control instruction to control the IOT device corresponding to the device identifier in the second embodiment of this application;
图4为本申请基于多控制终端的IOT设备控制方法第四实施例中步骤S50的细化流程示意图;4 is a detailed flowchart of step S50 in the fourth embodiment of an IOT device control method based on multiple control terminals according to this application;
图5为本申请基于多控制终端的IOT设备控制方法第五实施例中步骤S50的细化流程示意图;5 is a detailed flowchart of step S50 in the fifth embodiment of the IOT device control method based on multiple control terminals according to this application;
图6为本申请基于多控制终端的IOT设备控制方法第六实施例中步骤S54的细化流程示意图。FIG. 6 is a detailed flowchart of step S54 in the sixth embodiment of the IOT device control method based on multiple control terminals of this application.
本申请目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization, functional characteristics, and advantages of the purpose of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.
本发明的实施方式Embodiments of the present invention
应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。It should be understood that the specific embodiments described here are only used to explain the application, and not used to limit the application.
请参照图1,图1为本申请各个实施例中所提供的控制终端的硬件结构示意图。所述控制终端包括通信模块10、存储器20及处理器30等部件。本领域技术人员可以理解,图1中所示出的控制终端还可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。其中,所述处理器30分别与所述存储器20和所述通信模块10连接,所述存储器20上存储有计算机程序,所述计算机程序同时被处理器30执行。Please refer to FIG. 1, which is a schematic diagram of the hardware structure of the control terminal provided in each embodiment of the application. The control terminal includes a communication module 10, a memory 20, a processor 30 and other components. Those skilled in the art can understand that the control terminal shown in FIG. 1 may also include more or less components than those shown in the figure, or combine certain components, or different component arrangements. The processor 30 is respectively connected to the memory 20 and the communication module 10, and a computer program is stored on the memory 20, and the computer program is executed by the processor 30 at the same time.
通信模块10,可通过网络与外部设备连接。通信模块10可以接收外部设备发出的数据,还可发送数据、指令及信息至所述外部设备,所述外部设备可以是IOT设备、其他控制终端、手机、平板电脑、笔记本电脑和台式电脑等电子设备。The communication module 10 can be connected to external devices via a network. The communication module 10 can receive data sent by an external device, and can also send data, instructions, and information to the external device. The external device can be an IOT device, other control terminals, mobile phones, tablet computers, notebook computers, and desktop computers. equipment.
存储器20,可用于存储软件程序以及各种数据。存储器20可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(提取包括唤醒词的语音信息的分贝值)等;存储数据区可存储根据控制终端的使用所创建的数据或信息等。此外,存储器20可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory 20 can be used to store software programs and various data. The memory 20 may mainly include a storage program area and a storage data area. The storage program area may store an operating system, an application program required by at least one function (to extract the decibel value of the voice information including the wake-up word), etc.; the storage data area may store Data or information created based on the use of the control terminal. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.
处理器30,是控制终端的控制中心,利用各种接口和线路连接整个控制终端的各个部分,通过运行或执行存储在存储器20内的软件程序和/或模块,以及调用存储在存储器20内的数据,执行控制终端的各种功能和处理数据,从而对控制终端进行整体监控。处理器30可包括一个或多个处理单元;优选的,处理器30可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器30中。The processor 30 is the control center of the control terminal. It uses various interfaces and lines to connect the various parts of the entire control terminal, runs or executes the software programs and/or modules stored in the memory 20, and calls those stored in the memory 20. Data, perform various functions of the control terminal and process data, so as to monitor the control terminal as a whole. The processor 30 may include one or more processing units; preferably, the processor 30 may integrate an application processor and a modem processor, where the application processor mainly processes the operating system, user interface, application programs, etc., and the modem The processor mainly deals with wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 30.
尽管图1未示出,但上述控制终端还可以包括电路控制模块,电路控制模块用于与市电连接,实现电源控制,保证其他部件的正常工作。Although not shown in FIG. 1, the above-mentioned control terminal may further include a circuit control module, which is used to connect to the mains power supply to realize power supply control and ensure the normal operation of other components.
本领域技术人员可以理解,图1中示出的控制终端结构并不构成对控制终端的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Those skilled in the art can understand that the structure of the control terminal shown in FIG. 1 does not constitute a limitation on the control terminal, and may include more or less components than shown in the figure, or a combination of certain components, or different component arrangements.
根据上述硬件结构,提出本申请方法各个实施例。Based on the above hardware structure, various embodiments of the method of the present application are proposed.
参照图2,在本申请基于多控制终端的IOT设备控制方法的第一实施例中,应用于任一控制终端,所述基于多控制终端的IOT设备控制方法包括步骤:2, in the first embodiment of the multi-control terminal-based IOT device control method of the present application, which is applied to any control terminal, the multi-control terminal-based IOT device control method includes the steps:
步骤S10,接收用户发送的包括唤醒词的语音信息,并提取该语音信息的分贝值;Step S10, receiving the voice message including the wake-up word sent by the user, and extracting the decibel value of the voice message;
在本方案中,家庭的控制终端可以通过无线网络与家庭中的所有智能家电设备进行连接,并通过发送控制指令控制家庭中任一台智能家电设备。控制终端具有语音采集和语音识别功能,该控制终端可以为集成了语音采集和语音识别功能的智能家电设备,也可以单独具有语音采集和语音识别功能的智能终端或智能机器人。家庭中的各控制终端会实时采集用户发送的语音信息,并进行语音识别。用户需要唤醒控制终端,需要输出包括唤醒词的语音信息,该唤醒词可以为预设的特定词汇。当各控制终端在休眠状态下采集到用户发送语音信息后,会对该语音信息进行语音识别,提取关键词,判断该关键词是否为预设的特定词汇,从而确定该语音信息是否包括唤醒词,若包括唤醒词,会提取该语音信息的分贝值,若不包括唤醒词,则继续采集用户发送的语音信息。In this solution, the home control terminal can connect to all smart home appliances in the home through a wireless network, and control any smart home appliance in the home by sending control instructions. The control terminal has voice collection and voice recognition functions. The control terminal can be a smart home appliance integrating voice collection and voice recognition functions, or a smart terminal or smart robot with voice collection and voice recognition functions alone. Each control terminal in the home will collect the voice information sent by the user in real time and perform voice recognition. The user needs to wake up the control terminal, and needs to output voice information including a wake-up word. The wake-up word can be a preset specific vocabulary. When each control terminal collects the voice information sent by the user in the dormant state, it will perform voice recognition on the voice information, extract keywords, and determine whether the keywords are preset specific words, so as to determine whether the voice information includes wake-up words If the wake-up word is included, the decibel value of the voice information will be extracted; if the wake-up word is not included, the voice information sent by the user will continue to be collected.
步骤S20,将提取的分贝值发送至预设判断终端,以使预设判断终端根据所述分贝值以及其他控制终端在同一时间接收到所述语音信息时所反馈的对应分贝值,发送唤醒通知至最大分贝值对应的控制终端;Step S20: Send the extracted decibel value to a preset judgment terminal, so that the preset judgment terminal sends a wake-up notification based on the decibel value and the corresponding decibel value fed back when other control terminals receive the voice information at the same time The control terminal corresponding to the maximum decibel value;
控制终端的麦克风提取到用户发送的包括唤醒词的语音信息的分贝值后,会将提取的分贝值通过无线网络或有线网络发送至预设判断终端,所述预设判断终端接收该家庭的各控制终端发送的分贝值,会发送唤醒通知至最大分贝值对应的控制终端。若最大分贝值对应至少两个控制终端,可以发送唤醒通知至最大分贝值对应的至少两个控制终端中任一个控制终端,也可以根据各控制终端的预设优先级,发送唤醒通知至最大分贝值对应的至少两个控制终端中预设优先级最高的控制终端。After the microphone of the control terminal extracts the decibel value of the voice information including the wake-up word sent by the user, it will send the extracted decibel value to the preset judgment terminal through the wireless network or the wired network, and the preset judgment terminal receives the information of the family. The decibel value sent by the control terminal will send a wake-up notification to the control terminal corresponding to the maximum decibel value. If the maximum decibel value corresponds to at least two control terminals, the wake-up notification can be sent to any one of the at least two control terminals corresponding to the maximum decibel value, or the wake-up notification can be sent to the maximum decibel according to the preset priority of each control terminal The control terminal with the highest priority is preset among the at least two control terminals corresponding to the value.
步骤S30,当接收到所述预设判断终端发送的唤醒通知时,根据所述唤醒通知进入唤醒模式;Step S30, when receiving the wake-up notification sent by the preset judgment terminal, enter the wake-up mode according to the wake-up notification;
步骤S40,当在唤醒模式下接收到用户发送的包括设备类型和控制指令的语音信息时,根据所述控制指令控制所述设备类型对应的IOT设备。Step S40: When the voice information including the device type and the control instruction sent by the user is received in the wake-up mode, the IOT device corresponding to the device type is controlled according to the control instruction.
当家庭的各控制终端中任一控制终端接收到所述唤醒通知后,根据所述唤醒通知,接收到所述唤醒通知的控制终端从休眠模式切换到唤醒模式,而其他控制终端未接收到所述唤醒通知后,继续保持休眠模式,进入唤醒模式的控制终端接收用户发送的包括设备类型和控制指令的语音信息,并根据所述控制指令控制所述设备类型对应的IOT设备。When any one of the control terminals in the family receives the wake-up notification, according to the wake-up notification, the control terminal that has received the wake-up notification switches from the sleep mode to the wake-up mode, while the other control terminals do not receive the wake-up notification. After the wake-up notification, the sleep mode continues to be maintained, and the control terminal that enters the wake-up mode receives the voice information including the device type and the control instruction sent by the user, and controls the IOT device corresponding to the device type according to the control instruction.
需要说明的是可以预先从各控制终端中选择一个控制终端作为预设判断终端,其他控制终端将提取到的分贝值通过无线网络或有线网络发送至预设判断终端,预设判断终端根据接收到的其他控制终端发送的分贝值和本身提取的分贝值进行比较,确定最大分贝值的控制终端,若该最大分贝值的控制终端为其他控制终端,则发送唤醒通知至最大分贝值的控制终端,以使接收到唤醒通知的控制终端从休眠模式切换到唤醒模式;若该最大分贝值控制终端为本身,则直接从休眠模式切换到唤醒模式。It should be noted that one of the control terminals can be selected in advance as the preset judgment terminal, and the other control terminals send the extracted decibel value to the preset judgment terminal through the wireless network or the wired network, and the preset judgment terminal is based on the received Compare the decibel value sent by other control terminals with the decibel value extracted by itself to determine the control terminal with the maximum decibel value. If the control terminal with the maximum decibel value is another control terminal, a wake-up notification is sent to the control terminal with the maximum decibel value, So that the control terminal receiving the wake-up notification switches from the sleep mode to the wake-up mode; if the maximum decibel value control terminal is itself, it directly switches from the sleep mode to the wake-up mode.
本实施例通过接收用户发送的包括唤醒词的语音信息,并提取该语音信息的分贝值;将提取的分贝值发送至预设判断终端,以使预设判断终端根据所述分贝值以及其他控制终端在同一时间接收到所述语音信息时所反馈的对应分贝值,发送唤醒通知至最大分贝值对应的控制终端;当接收到所述预设判断终端发送的唤醒通知时,根据所述唤醒通知进入唤醒模式;当在唤醒模式下接收到用户发送的包括设备类型和控制指令的语音信息时,根据所述控制指令控制所述设备类型对应的IOT设备。从而当家庭内多个控制终端同时采集到用户的输出的包括唤醒词的语音信息时,不会全部进入唤醒模式,而是选择采集到的语音信息的分贝值最大的一个控制终端进入唤醒模式,并由该控制终端根据用户后续发送的控制指令控制IOT设备,可以避免多台控制终端同时进行语音播报,导致语音播报混乱和相互之间干扰识别,以及多台控制终端同时控制IOT设备导致的控制错乱,并且有利于控制终端进入工作模式后能够更清晰的采集到用户发送的语音控制指令,故能够更好地更精准地控制IOT设备。In this embodiment, the voice information including the wake-up word sent by the user is received, and the decibel value of the voice information is extracted; the extracted decibel value is sent to the preset judgment terminal, so that the preset judgment terminal is based on the decibel value and other controls The terminal sends a wake-up notification to the control terminal corresponding to the maximum decibel value based on the corresponding decibel value fed back when the voice information is received at the same time; when receiving the wake-up notification sent by the preset judgment terminal, according to the wake-up notification Enter the wake-up mode; when the voice information including the device type and the control instruction sent by the user is received in the wake-up mode, the IOT device corresponding to the device type is controlled according to the control instruction. Therefore, when multiple control terminals in the home simultaneously collect the user's output voice information including the wake-up word, they will not all enter the wake-up mode, but select the one with the largest decibel value of the collected voice information to enter the wake-up mode. And the control terminal controls the IOT device according to the subsequent control instructions sent by the user, which can prevent multiple control terminals from performing voice broadcasts at the same time, resulting in confusion of voice broadcasts and mutual interference recognition, and control caused by multiple control terminals controlling IOT devices at the same time It is confusing, and is conducive to more clearly collecting the voice control instructions sent by the user after the control terminal enters the working mode, so it can control the IOT device better and more accurately.
进一步地,参照图3,根据本申请基于多控制终端的IOT设备控制方法的第一实施例提出本申请基于多控制终端的IOT设备控制方法的第二实施例,在本实施例中,在步骤S40中所述根据所述控制指令控制所述设备标识对应的IOT设备的步骤包括:Further, referring to FIG. 3, according to the first embodiment of the IOT device control method based on multiple control terminals of the present application, a second embodiment of the IOT device control method based on multiple control terminals of the present application is proposed. In this embodiment, in step The step of controlling the IOT device corresponding to the device identifier according to the control instruction in S40 includes:
步骤S50,根据预设的筛选规则,从所述设备类型对应的所有IOT设备中选择至少一台IOT设备作为待控制IOT设备;Step S50, according to a preset screening rule, select at least one IOT device from all IOT devices corresponding to the device type as the IOT device to be controlled;
步骤S60,将所述控制指令发送至所述待控制IOT设备,以使所述待控制IOT设备执行所述控制指令。Step S60: Send the control instruction to the IOT device to be controlled, so that the IOT device to be controlled executes the control instruction.
在本实施例中,控制终端进入唤醒模式后,当采集到用户发送的包括设备类型和控制指令的语音信息时,对语音识别,获取设备类型和控制指令,根据预设的筛选规则,从所述设备类型对应的所有IOT设备中选择至少一台IOT设备作为待控制IOT设备,该预设的筛选规则可以为从所述设备类型对应的IOT设备中随机选择一台IOT设备,可以根据所述设备类型对应各IOT设备与该控制终端的距离,从中选择距离最近的IOT设备,还可以根据所述设备类型对应的各IOT设备所在区域,从与该控制终端处于同一区域的各IOT设备中随机选择一台IOT设备或选择预设优先级最高的,也可以根据所述设备类型对应的各IOT设备所在区域和与该控制终端对应的距离,从与该控制终端处于同一区域的各IOT设备中选择距该控制终端最近的一台IOT设备。确定待控制设备后,将所述控制指令发送至所述待控制IOT设备,以使所述待控制IOT设备执行所述控制指令。In this embodiment, after the control terminal enters the wake-up mode, when the voice information including the device type and the control instruction sent by the user is collected, it recognizes the voice, obtains the device type and control instruction, and obtains the device type and control instruction according to the preset screening rules. At least one IOT device is selected from all IOT devices corresponding to the device type as the IOT device to be controlled. The preset filtering rule may be to randomly select one IOT device from the IOT devices corresponding to the device type, which may be based on the The device type corresponds to the distance between each IOT device and the control terminal, and the closest IOT device is selected. It can also be randomly selected from the IOT devices in the same area as the control terminal according to the area where each IOT device corresponding to the device type is located. Choose an IOT device or choose the one with the highest preset priority, or according to the area of each IOT device corresponding to the device type and the distance corresponding to the control terminal, from the IOT devices in the same area as the control terminal Select the IOT device closest to the control terminal. After the device to be controlled is determined, the control instruction is sent to the IOT device to be controlled, so that the IOT device to be controlled executes the control instruction.
本实施例提出一种由处于唤醒模式的控制终端接收用户发送的控制指令和设备类型,并由其控制终端通过发送控制指令至设备类型对应的待控制设备,控制待控制设备的策略,由于被唤醒的控制终端距用户最近,该控制终端接收到的用户发送的语音最清晰,从而对该语音进行识别获得的控制指令和设备类型的准确率更高,进而提高了对IOT设备控制更准确。This embodiment proposes a strategy for the control terminal in the wake-up mode to receive the control instruction and device type sent by the user, and the control terminal sends the control instruction to the device to be controlled corresponding to the device type to control the device to be controlled. The awakened control terminal is closest to the user, and the voice sent by the user is the clearest received by the control terminal, so that the control instructions and device types obtained by recognizing the voice are more accurate, thereby improving the control of the IOT device more accurately.
进一步地,根据本申请基于多控制终端的IOT设备控制方法的第二实施例提出本申请基于多控制终端的IOT设备控制方法的第三实施例,在本实施例中,所述步骤S50之前还包括:Further, according to the second embodiment of the IOT device control method based on multiple control terminals of the present application, a third embodiment of the IOT device control method based on multiple control terminals of the present application is proposed. In this embodiment, the step S50 is include:
步骤S70,提取包括唤醒词的语音信息中的声纹特征和包括设备类型和控制指令的语音信息中的声纹特征;Step S70, extracting voiceprint features in the voice information including the wake-up word and voiceprint features in the voice information including the device type and control instructions;
步骤S80,判断包括设备类型和控制指令的语音信息中的声纹特征是否与包括唤醒词的语音信息中的声纹特征一致;若是,则执行步骤S50。Step S80: It is determined whether the voiceprint feature in the voice information including the device type and the control instruction is consistent with the voiceprint feature in the voice information including the wake-up word; if so, step S50 is executed.
在本实施例中,当处于唤醒模式的控制终端接收到用户发送的包括设备类型和控制指令的语音信息后,该控制终端会提取之前用户发送的包括唤醒词的语音信息中的声纹特征以及当前用户发送的包括设备类型和控制指令的语音信息中的声纹特征,将之前用户发送的包括唤醒词的语音信息中的声纹特征与当前用户发送的包括设备类型和控制指令的语音信息中的声纹特征进行对比,当一致时,则对该语音信息进行语音识别,获取设备类型和控制指令,根据预设的筛选规则,从所述设备类型对应的所有IOT设备中选择至少一台IOT设备作为待控制IOT设备,该预设的筛选规则可以为从所述设备类型对应的IOT设备中随机选择一台IOT设备,可以根据所述设备类型对应各IOT设备与该控制终端的距离,从中选择距离最近的IOT设备,还可以根据所述设备类型对应的各IOT设备所在区域,从与该控制终端处于同一区域的各IOT设备中随机选择一台IOT设备或选择预设优先级最高的,也可以根据所述设备类型对应的各IOT设备所在区域和与该控制终端对应的距离,从与该控制终端处于同一区域的各IOT设备中选择距该控制终端最近的一台IOT设备。确定待控制设备后,将所述控制指令发送至所述待控制IOT设备,以使所述待控制IOT设备执行所述控制指令。In this embodiment, after the control terminal in the wake-up mode receives the voice information including the device type and the control instruction sent by the user, the control terminal will extract the voiceprint features and the voice information in the voice information including the wake-up words sent by the user before. The voiceprint feature in the voice message including the device type and control instruction sent by the current user, and the voiceprint feature in the voice message including the wake-up word sent by the previous user and the voice message including the device type and control instruction sent by the current user Compare the voiceprint features of the device. When they are consistent, perform voice recognition on the voice information, obtain the device type and control instructions, and select at least one IOT from all the IOT devices corresponding to the device type according to the preset screening rules. The device is an IOT device to be controlled. The preset screening rule may be to randomly select one IOT device from the IOT devices corresponding to the device type, and the distance between each IOT device and the control terminal may be corresponding to the device type according to the device type. Select the closest IOT device, or randomly select one IOT device from the IOT devices in the same area as the control terminal according to the area of each IOT device corresponding to the device type, or select the one with the highest preset priority, It is also possible to select the IOT device closest to the control terminal from the IOT devices in the same area as the control terminal according to the area of each IOT device corresponding to the device type and the distance corresponding to the control terminal. After the device to be controlled is determined, the control instruction is sent to the IOT device to be controlled, so that the IOT device to be controlled executes the control instruction.
需要说明的是,当之前用户发送的包括唤醒词的语音信息中的声纹特征与当前用户发送的包括设备类型和控制指令的语音信息中的声纹特征不一致时,则不对该语音信息进行处理。It should be noted that when the voiceprint feature in the voice information including the wake-up word sent by the user is inconsistent with the voiceprint feature in the voice information including the device type and control instructions sent by the current user, the voice information will not be processed .
本实施例通过在接收到用户发送的包括控制指令的语音信息后,先判断包括控制指令的语音信息中的声纹特征和发送包括唤醒词的语音信息中的声纹是否一致,在一致情况下,才会根据包括控制指令的语音信息中的控制指令对待控制设备进行控制,从而确保只有唤醒了控制终端的用户才能下达对IOT设备的控制指令来控制设备,避免非唤醒了控制终端的其他用户控制IOT设备,特别是有小孩的家庭,可以防止小孩捣乱误操控IOT设备。In this embodiment, after receiving the voice information including the control instruction sent by the user, firstly determine whether the voiceprint feature in the voice information including the control instruction and the voiceprint in the voice information including the wake-up word are the same. In the case of consistency, , Will control the device to be controlled according to the control instruction in the voice message including the control instruction, so as to ensure that only the user who has awakened the control terminal can issue the control instruction to the IOT device to control the device, and avoid other users who have not awakened the control terminal Controlling IOT devices, especially in families with children, can prevent children from disturbing and controlling IOT devices by mistake.
进一步地,参照图4,根据本申请基于多控制终端的IOT设备控制方法的第二实施例或第三实施例提出本申请基于多控制终端的IOT设备控制方法的第四实施例,在本实施例中,所述步骤S50包括:Further, referring to FIG. 4, according to the second or third embodiment of the IOT device control method based on multiple control terminals of the present application, the fourth embodiment of the IOT device control method based on multiple control terminals of the present application is proposed. In an example, the step S50 includes:
步骤S51,获取与所述设备类型对应的各IOT设备的距离,并选择距离最近的IOT设备作为待控制IOT设备。Step S51: Obtain the distance of each IOT device corresponding to the device type, and select the closest IOT device as the IOT device to be controlled.
在本实施例中,处于唤醒模式下的控制终端根据用户发送的语音信息中的设备类型,获得所述设备类型对应的各IOT设备与该控制终端的距离。根据所述名称对应的各IOT设备与该控制终端的距离,选择与该控制终端距离最近的所述设备类型对应的IOT设备。例如,当该设备类型为空调,该控制终端总共查询到有4台空调,分别是处于客厅的空调、主卧空调、次卧空调和书房空调,而该控制终端处于主卧,各空调与该控制终端的距离从近至远依次为主卧空调、次卧空调、书房空调和客厅空调,根据各空调与该控制终端的距离,该控制终端会选择主卧空调作为待控制的空调。In this embodiment, the control terminal in the wake-up mode obtains the distance between each IOT device corresponding to the device type and the control terminal according to the device type in the voice information sent by the user. According to the distance between each IOT device corresponding to the name and the control terminal, select the IOT device corresponding to the device type closest to the control terminal. For example, when the equipment type is air conditioner, the control terminal inquires that there are 4 air conditioners in total, namely the air conditioner in the living room, the main bedroom air conditioner, the second bedroom air conditioner, and the study room air conditioner. The distance of the control terminal is from the nearest to the farthest for the master bedroom air conditioner, the second bedroom air conditioner, the study air conditioner and the living room air conditioner. According to the distance between each air conditioner and the control terminal, the control terminal will select the master bedroom air conditioner as the air conditioner to be controlled.
需要说明的是,当该控制终端根据用户发送的语音信息中的设备类型,查询不到所述设备类型对应的IOT设备时,会反馈错误提示给用户,当该控制终端根据用户发送的语音信息中的设备类型,只查询到一台所述设备类型对应的IOT设备时,直接将该IOT设备作为待控制设备。It should be noted that when the control terminal cannot find the IOT device corresponding to the device type according to the device type in the voice information sent by the user, it will feedback an error message to the user. When the control terminal is based on the voice information sent by the user If only one IOT device corresponding to the device type is queried, the IOT device is directly used as the device to be controlled.
本实施例提出一种选择距控制终端最近的IOT设备作为待控制IOT设备的策略,从而在用户发送的设备类型对应的IOT设备存在多个情况下自动选择离用户最近的设备作为待控制设备,更加智能。This embodiment proposes a strategy of selecting the IOT device closest to the control terminal as the IOT device to be controlled, so that when there are multiple IOT devices corresponding to the device type sent by the user, the device closest to the user is automatically selected as the device to be controlled. Smarter.
进一步地,参照图5,根据本申请基于多控制终端的IOT设备控制方法的第二实施例或第三实施例提出本申请基于多控制终端的IOT设备控制方法的第五实施例,在本实施例中,所述步骤S50包括:Further, referring to FIG. 5, according to the second or third embodiment of the IOT device control method based on multiple control terminals of the present application, the fifth embodiment of the IOT device control method based on multiple control terminals of the present application is proposed. In an example, the step S50 includes:
步骤S52,获取与所述设备类型对应的各IOT设备的距离以及各IOT设备的所在区域;Step S52: Obtain the distance of each IOT device corresponding to the device type and the area where each IOT device is located;
步骤S53,根据各IOT设备的所在区域判断自身所在区域内是否存在所述设备类型对应的IOT设备;Step S53, judging whether there is an IOT device corresponding to the device type in the area where each IOT device is located according to the area where each IOT device is located;
若是,则执行步骤S54,选择自身所在区域内所述设备类型对应的IOT设备作为待控制IOT设备;If yes, perform step S54 to select the IOT device corresponding to the device type in the area where it is located as the IOT device to be controlled;
若否,则执行步骤S55,从所述设备类型对应的各IOT设备中选择距离最近的IOT设备作为待控制IOT设备。If not, step S55 is executed to select the closest IOT device from the IOT devices corresponding to the device type as the IOT device to be controlled.
在本实施例中,处于唤醒模式下的控制终端根据用户发送的语音信息中的设备类型,获得所述设备类型对应的各IOT设备与该控制终端的距离以及各IOT设备所在区域。然后判断该控制终端所在区域是否有所述设备类型对应的IOT设备,若是,则选择该控制终端所在区域的所述设备类型对应的各IOT设备作为待控制设备,例如该控制终端所在区域为主卧,设备类型为灯,若主卧存在灯,则将主卧中的所有灯打开。若判断结果为否,则根据所述名称对应的各IOT设备与该控制终端的距离,选择与该控制终端距离最近的所述设备类型对应的IOT设备,例如当控制终端所在区域为厨房,设备类型为空调,而厨房不存在空调,只有主卧、次卧和客厅存在空调,并且客厅的空调距该控制终端距离最近,则该控制终端会选择客厅的空调作为待控制IOT设备。In this embodiment, the control terminal in the wake-up mode obtains the distance between each IOT device corresponding to the device type and the control terminal and the area where each IOT device is located according to the device type in the voice information sent by the user. Then determine whether there is an IOT device corresponding to the device type in the area where the control terminal is located, and if so, select each IOT device corresponding to the device type in the area where the control terminal is located as the device to be controlled, for example, the area where the control terminal is located is the main area In the bedroom, the equipment type is lights. If there are lights in the master bedroom, turn on all the lights in the master bedroom. If the judgment result is no, then according to the distance between each IOT device corresponding to the name and the control terminal, select the IOT device corresponding to the device type closest to the control terminal. For example, when the area where the control terminal is located is the kitchen, the device The type is air conditioner, but there is no air conditioner in the kitchen. Only the main bedroom, the second bedroom and the living room have air conditioners, and the air conditioner in the living room is the closest to the control terminal. The control terminal will select the air conditioner in the living room as the IOT device to be controlled.
需要说明的是,当该控制终端根据用户发送的语音信息中的设备类型,查询不到所述设备类型对应的IOT设备时,会反馈错误提示给用户,当该控制终端根据用户发送的语音信息中的设备类型,只查询到一台所述设备类型对应的IOT设备时,直接将该IOT设备作为待控制设备。It should be noted that when the control terminal cannot find the IOT device corresponding to the device type according to the device type in the voice information sent by the user, it will feedback an error message to the user. When the control terminal is based on the voice information sent by the user If only one IOT device corresponding to the device type is queried, the IOT device is directly used as the device to be controlled.
本实施例提出一种选择与控制终端处于同一区域的IOT设备作为待控制IOT设备的策略,从而自动选择与用户处于同一区域的设备作为待控制设备,更加智能。This embodiment proposes a strategy of selecting the IOT device in the same area as the control terminal as the IOT device to be controlled, so that the device in the same area as the user is automatically selected as the device to be controlled, which is more intelligent.
进一步地,参照图6,根据本申请基于多控制终端的IOT设备控制方法的第二实施例或第三实施例提出本申请基于多控制终端的IOT设备控制方法的第六实施例,在本实施例中,所述步骤S54包括:Further, referring to FIG. 6, according to the second or third embodiment of the IOT device control method based on multiple control terminals of the present application, the sixth embodiment of the IOT device control method based on multiple control terminals of the present application is proposed. In an example, the step S54 includes:
步骤S56,选择自身所在区域内距离最近的所述设备类型对应的IOT设备作为待控制IOT设备。Step S56: Select the IOT device corresponding to the device type closest to the device in the area where the user is located as the IOT device to be controlled.
在本实施例中,处于唤醒模式下的控制终端根据用户发送的语音信息中的设备类型,获得所述设备类型对应的各IOT设备与该控制终端的距离以及各IOT设备所在区域。然后判断该控制终端所在区域是否有所述设备类型对应的IOT设备,若是,则从该控制终端所在区域的所述设备类型对应的各IOT设备中选择距该控制终端最近的IOT设备作为待控制设备,例如该控制终端所在区域为客厅进门处,设备类型为灯,而客厅存在多个灯,分布位置为客厅进门处和客厅正中央等,而客厅进门处的灯与该控制终端距离最近,故该控制终端会将客厅进门处的灯打开。若判断结果为否,则根据所述名称对应的各IOT设备与该控制终端的距离,选择与该控制终端距离最近的所述设备类型对应的IOT设备,例如当控制终端所在区域为厨房,设备类型为空调,而厨房不存在空调,只有主卧、次卧和客厅存在空调,并且客厅的空调距该控制终端距离最近,则该控制终端会选择客厅的空调作为待控制IOT设备。In this embodiment, the control terminal in the wake-up mode obtains the distance between each IOT device corresponding to the device type and the control terminal and the area where each IOT device is located according to the device type in the voice information sent by the user. Then determine whether there is an IOT device corresponding to the device type in the area where the control terminal is located, and if so, select the IOT device closest to the control terminal from the IOT devices corresponding to the device type in the area where the control terminal is located as the to-be-controlled IOT device Equipment, for example, the area where the control terminal is located is the entrance of the living room, the equipment type is lights, and there are multiple lights in the living room, and the distribution positions are the entrance of the living room and the center of the living room, etc., and the light at the entrance of the living room is the closest to the control terminal. Therefore, the control terminal will turn on the light at the entrance door of the living room. If the judgment result is no, then according to the distance between each IOT device corresponding to the name and the control terminal, select the IOT device corresponding to the device type closest to the control terminal. For example, when the area where the control terminal is located is the kitchen, the device The type is air conditioner, but there is no air conditioner in the kitchen. Only the main bedroom, the second bedroom and the living room have air conditioners, and the air conditioner in the living room is the closest to the control terminal. The control terminal will select the air conditioner in the living room as the IOT device to be controlled.
需要说明的是,当该控制终端根据用户发送的语音信息中的设备类型,查询不到所述设备类型对应的IOT设备时,会反馈错误提示给用户,当该控制终端根据用户发送的语音信息中的设备类型,只查询到一台所述设备类型对应的IOT设备时,直接将该IOT设备作为待控制设备。It should be noted that when the control terminal cannot find the IOT device corresponding to the device type according to the device type in the voice information sent by the user, it will feedback an error message to the user. When the control terminal is based on the voice information sent by the user If only one IOT device corresponding to the device type is queried, the IOT device is directly used as the device to be controlled.
本实施例提出一种选择与控制终端处于同一区域并且距控制终端最近的IOT设备作为待控制IOT设备的策略,从而在用户所在区域内用户发送的设备类型对应的IOT设备存在多个情况下自动选择与用户最近的设备作为待控制设备,更加智能。This embodiment proposes a strategy for selecting the IOT device that is in the same area as the control terminal and is closest to the control terminal as the IOT device to be controlled, so that it can be automatically controlled when there are multiple IOT devices corresponding to the device type sent by the user in the area where the user is located. Choose the device closest to the user as the device to be controlled, which is more intelligent.
进一步地,根据本申请基于多控制终端的IOT设备控制方法的第一实施例提出本申请基于多控制终端的IOT设备控制方法的第七实施例,在本实施例中,所述步骤S40之后还包括:Further, according to the first embodiment of the IOT device control method based on multiple control terminals of the present application, a seventh embodiment of the IOT device control method based on multiple control terminals of the present application is proposed. In this embodiment, the step S40 is followed by include:
步骤S90,发送进入休眠模式的请求至用户,以使用户反馈进入休眠模式指令;Step S90, sending a request to enter the sleep mode to the user, so that the user feeds back the instruction to enter the sleep mode;
步骤S100,当接收到用户反馈的进入休眠模式指令时,进入休眠模式。Step S100, when receiving a sleep mode entry command fed back by the user, enter the sleep mode.
在本实施例中,当控制终端将控制指令发送至待控制IOT设备后,控制终端会通过语音方式输出进入休眠模式的请求至用户,用户会根据自身需求反馈是否进入休眠模式的指令,当用户反馈进入休眠模式的指令,控制终端接收到用户反馈的进入休眠模式指令后,会进入休眠模式,当用户反馈不进入休眠模式的指令,控制终端接收到用户反馈的不进入休眠模式指令后,会继续保持唤醒模式,直至接收到用户反馈的进入休眠模式指令。In this embodiment, after the control terminal sends a control instruction to the IOT device to be controlled, the control terminal will output a request to enter the sleep mode by voice to the user, and the user will feed back the instruction whether to enter the sleep mode according to their own needs. Feed back the instruction to enter the sleep mode. After the control terminal receives the instruction to enter the sleep mode feedback from the user, it will enter the sleep mode. When the user feedbacks the instruction not to enter the sleep mode, the control terminal will receive the instruction not to enter the sleep mode feedback from the user. Continue to maintain the wake-up mode until receiving the user's feedback to enter the sleep mode command.
本实施例提出一种控制IOT设备后主动询问用户是否需要进入休眠模式,根据用户反馈结果被动进行休眠模式的策略,从而避免控制IOT设备后长时间处于唤醒模式,通过进入休眠模式节约电能。This embodiment proposes a strategy of actively asking the user if the user needs to enter the sleep mode after controlling the IOT device, and passively performing the sleep mode according to the user feedback result, so as to avoid the IOT device from being in the wake-up mode for a long time after controlling the IOT device, and to save power by entering the sleep mode.
进一步地,根据本申请基于多控制终端的IOT设备控制方法的第一实施例提出本申请基于多控制终端的IOT设备控制方法的第八实施例,在本实施例中,所述步骤S80之后还包括:Further, according to the first embodiment of the IOT device control method based on multiple control terminals of the present application, an eighth embodiment of the IOT device control method based on multiple control terminals of the present application is proposed. In this embodiment, the step S80 is followed by include:
步骤S110,判断完成IOT设备控制后的预设时间内是否接收到用户再次发送的包括设备类型和控制指令的语音信息;Step S110: It is judged whether the voice information including the device type and the control instruction sent by the user again is received within a preset time after the control of the IOT device is completed;
步骤S120,在完成IOT设备控制后的预设时间内,当未接收到用户再次发送的包括设备类型和控制指令的语音信息时,直接进入休眠模式。Step S120, within a preset time after completing the control of the IOT device, when the voice information including the device type and the control instruction sent by the user is not received again, the sleep mode is directly entered.
在本实施例中,当控制终端完成IOT设备控制后,判断预设时间内是否再次接收到用户发送的包括设备类型和控制指令的语音信息,该预设时间可以为10秒、30秒或1分钟,在此不作限定。若预设时间内未接收到用户再次发送的包括设备类型和控制指令的语音信息,则直接进入休眠模式。In this embodiment, after the control terminal completes the control of the IOT device, it is judged whether the voice message including the device type and control instruction sent by the user is received again within a preset time. The preset time may be 10 seconds, 30 seconds, or 1 The minutes are not limited here. If the user does not receive the voice information including the device type and the control instruction again sent by the user within the preset time, it directly enters the sleep mode.
需要说明的是,若预设时间内接收到用户再次发送的包括设备类型和控制指令的语音信息,则返回执行步骤S40。It should be noted that, if the voice information including the device type and the control instruction sent by the user again is received within the preset time, then return to step S40.
本实施例提出一种控制终端在完成对待控制IOT设备控制后预设时间内未再次接收到用户发送的控制指令时自动进入休眠状态的策略,从而避免控制IOT设备后长时间处于唤醒模式,通过进入休眠模式节约电能,并且不需要询问用户自动进入休眠模式,提高用户的体验度。This embodiment proposes a strategy for the control terminal to automatically enter the dormant state when it does not receive a control command sent by the user again within a preset time after the control of the IOT device to be controlled is completed, thereby avoiding the IOT device from being in the wake-up mode for a long time after controlling the IOT device. Entering the sleep mode saves power, and does not need to ask the user to automatically enter the sleep mode, which improves the user's experience.
本申请还提出一种计算机可读存储介质,其上存储有计算机程序。所述计算机可读存储介质可以是图1的控制终端中的存储器20,也可以是如ROM(Read-Only Memory,只读存储器)/RAM(Random Access Memory,随机存取存储器)、磁碟、光盘中的至少一种,所述计算机可读存储介质包括若干信息用以使得服务器或电视执行本申请各个实施例所述的方法。This application also proposes a computer-readable storage medium on which a computer program is stored. The computer-readable storage medium may be the memory 20 in the control terminal of FIG. 1, or may be, for example, ROM (Read-Only Memory)/RAM (Random Access Memory), magnetic disk, At least one of the optical discs, and the computer-readable storage medium includes several pieces of information for enabling the server or the TV to execute the methods described in the various embodiments of the present application.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。It should be noted that in this article, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements not only includes those elements, It also includes other elements that are not explicitly listed, or elements inherent to the process, method, article, or system. Without more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article, or system that includes the element.
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the foregoing embodiments of the present application are only for description, and do not represent the superiority or inferiority of the embodiments.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。Through the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better.的实施方式。
以上仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above are only the preferred embodiments of the application, and do not limit the scope of the patent for this application. Any equivalent structure or equivalent process transformation made using the content of the description and drawings of the application, or directly or indirectly applied to other related technical fields , The same reason is included in the scope of patent protection of this application.

Claims (10)

  1. 一种基于多控制终端的IOT设备控制方法,其中,应用于任一控制终端,所述方法包括步骤:An IOT device control method based on multiple control terminals, wherein, applied to any control terminal, the method includes the steps:
    接收用户发送的包括唤醒词的语音信息,并提取该语音信息的分贝值;Receive the voice message including the wake-up word sent by the user, and extract the decibel value of the voice message;
    将提取的分贝值发送至预设判断终端,以使预设判断终端根据所述分贝值以及其他控制终端在同一时间接收到所述语音信息时所反馈的对应分贝值,发送唤醒通知至最大分贝值对应的控制终端;Send the extracted decibel value to the preset judgment terminal, so that the preset judgment terminal sends a wake-up notification to the maximum decibel based on the decibel value and the corresponding decibel value fed back when other control terminals receive the voice information at the same time The control terminal corresponding to the value;
    当接收到所述预设判断终端发送的唤醒通知时,根据所述唤醒通知进入唤醒模式;When receiving a wake-up notification sent by the preset judgment terminal, enter the wake-up mode according to the wake-up notification;
    当在唤醒模式下接收到用户发送的包括设备类型和控制指令的语音信息时,根据所述控制指令控制所述设备类型对应的IOT设备。When the voice information including the device type and the control instruction sent by the user is received in the wake-up mode, the IOT device corresponding to the device type is controlled according to the control instruction.
  2. 根据权利要求1所述的基于多控制终端的IOT设备控制方法,其中,所述根据所述控制指令控制所述设备标识对应的IOT设备的步骤包括:The IOT device control method based on multiple control terminals according to claim 1, wherein the step of controlling the IOT device corresponding to the device identifier according to the control instruction comprises:
    根据预设的筛选规则,从所述设备类型对应的所有IOT设备中选择至少一台IOT设备作为待控制IOT设备;According to preset screening rules, select at least one IOT device from all IOT devices corresponding to the device type as the IOT device to be controlled;
    将所述控制指令发送至所述待控制IOT设备,以使所述待控制IOT设备执行所述控制指令。The control instruction is sent to the IOT device to be controlled, so that the IOT device to be controlled executes the control instruction.
  3. 根据权利要求2所述的基于多控制终端的IOT设备控制方法,其中,所述根据预设的筛选规则,从所述设备类型对应的所有IOT设备中选择至少一台IOT设备作为待控制IOT设备的步骤之前,还包括:The IOT device control method based on multiple control terminals according to claim 2, wherein, according to a preset screening rule, at least one IOT device is selected from all IOT devices corresponding to the device type as the IOT device to be controlled Before the steps, it also includes:
    提取包括唤醒词的语音信息中的声纹特征和包括设备类型和控制指令的语音信息中的声纹特征;Extract voiceprint features in voice information including wake-up words and voiceprint features in voice information including device type and control instructions;
    判断包括设备类型和控制指令的语音信息中的声纹特征是否与包括唤醒词的语音信息中的声纹特征一致;Determine whether the voiceprint feature in the voice information including the device type and the control instruction is consistent with the voiceprint feature in the voice information including the wake-up word;
    若是,则执行步骤:根据预设的筛选规则,从所述设备类型对应的所有IOT设备中选择至少一台IOT设备作为待控制IOT设备。If yes, perform the step of selecting at least one IOT device from all IOT devices corresponding to the device type as the IOT device to be controlled according to a preset screening rule.
  4. 根据权利要求2或3所述的基于多控制终端的IOT设备控制方法,其中,所述根据预设的筛选规则,从所述设备类型对应的所有IOT设备中选择至少一台IOT设备作为待控制IOT设备的步骤包括:The method for controlling an IOT device based on multiple control terminals according to claim 2 or 3, wherein, according to a preset screening rule, at least one IOT device is selected as the to-be-controlled device from all IOT devices corresponding to the device type The steps of IoT equipment include:
    获取与所述设备类型对应的各IOT设备的距离,并选择距离最近的IOT设备作为待控制IOT设备。Obtain the distance of each IOT device corresponding to the device type, and select the closest IOT device as the IOT device to be controlled.
  5. 根据权利要求2或3所述的基于多控制终端的IOT设备控制方法,其中,所述根据预设的筛选规则,从所述设备类型对应的所有IOT设备中选择至少一台IOT设备作为待控制IOT设备的步骤包括:The method for controlling an IOT device based on multiple control terminals according to claim 2 or 3, wherein, according to a preset screening rule, at least one IOT device is selected as the to-be-controlled device from all IOT devices corresponding to the device type The steps of IoT equipment include:
    获取与所述设备类型对应的各IOT设备的距离以及各IOT设备的所在区域;Acquiring the distance of each IOT device corresponding to the device type and the area where each IOT device is located;
    根据各IOT设备的所在区域判断自身所在区域内是否存在所述设备类型对应的IOT设备;Judging whether there is an IOT device corresponding to the device type in the area where each IOT device is located according to the area where each IOT device is located;
    若是,则选择自身所在区域内所述设备类型对应的IOT设备作为待控制IOT设备;If yes, select the IOT device corresponding to the device type in the area where it is located as the IOT device to be controlled;
    若否,则从所述设备类型对应的各IOT设备中选择距离最近的IOT设备作为待控制IOT设备。If not, select the closest IOT device from the IOT devices corresponding to the device type as the IOT device to be controlled.
  6. 根据权利要求5所述的基于多控制终端的IOT设备控制方法,其中,所述选择自身所在区域内所述设备类型对应的IOT设备作为待控制IOT设备的步骤包括:The IOT device control method based on multiple control terminals according to claim 5, wherein the step of selecting the IOT device corresponding to the device type in the area where the device is located as the IOT device to be controlled comprises:
    选择自身所在区域内距离最近的所述设备类型对应的IOT设备作为待控制IOT设备。Select the IOT device corresponding to the device type closest in the area where it is located as the IOT device to be controlled.
  7. 根据权利要求1至3任一项所述的基于多控制终端的IOT设备控制方法,其中,所述根据所述控制指令控制所述设备类型对应的IOT设备的步骤之后还包括:The IOT device control method based on multiple control terminals according to any one of claims 1 to 3, wherein the step of controlling the IOT device corresponding to the device type according to the control instruction further comprises:
    发送进入休眠模式的请求至用户,以使用户反馈进入休眠模式指令;Send a request to enter the sleep mode to the user, so that the user will feed back the instruction to enter the sleep mode;
    当接收到用户反馈的进入休眠模式指令时,进入休眠模式。When receiving a user's feedback to enter the sleep mode instruction, enter the sleep mode.
  8. 根据权利要求1至3任一项所述的基于多控制终端的IOT设备控制方法,其中,所述根据所述控制指令控制所述设备类型对应的IOT设备的步骤之后还包括:The IOT device control method based on multiple control terminals according to any one of claims 1 to 3, wherein the step of controlling the IOT device corresponding to the device type according to the control instruction further comprises:
    判断完成IOT设备控制后的预设时间内是否接收到用户再次发送的包括设备类型和控制指令的语音信息;Determine whether the voice message including the device type and control instruction sent by the user again is received within the preset time after the control of the IOT device is completed;
    在完成IOT设备控制后的预设时间内,当未接收到用户再次发送的包括设备类型和控制指令的语音信息时,直接进入休眠模式。Within the preset time after the control of the IOT device is completed, when the user does not receive the voice information including the device type and control instruction again sent by the user, it directly enters the sleep mode.
  9. 一种控制终端,其中,所述控制终端包括存储器、处理器和存储在所述存储器上并可在所述处理器上运行的计算机程序,所述计算机程序被所述处理器执行时实现如权利要求1至8中任一项所述的基于多控制终端的IOT设备控制方法的步骤。A control terminal, wherein the control terminal includes a memory, a processor, and a computer program that is stored on the memory and can run on the processor. When the computer program is executed by the processor, the The steps of the IOT device control method based on multiple control terminals described in any one of 1 to 8 are required.
  10. 一种计算机可读存储介质,其中,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求1至8中任一项所述的基于多控制终端的IOT设备控制方法的步骤。A computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the multi-control-based terminal according to any one of claims 1 to 8 is implemented. The steps of the IOT device control method.
PCT/CN2020/099241 2019-09-10 2020-06-30 Multiple control terminal-based iot device control method, control terminal, and storage medium WO2021047248A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910857917.6 2019-09-10
CN201910857917.6A CN110556115A (en) 2019-09-10 2019-09-10 IOT equipment control method based on multiple control terminals, control terminal and storage medium

Publications (1)

Publication Number Publication Date
WO2021047248A1 true WO2021047248A1 (en) 2021-03-18

Family

ID=68739868

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/099241 WO2021047248A1 (en) 2019-09-10 2020-06-30 Multiple control terminal-based iot device control method, control terminal, and storage medium

Country Status (2)

Country Link
CN (1) CN110556115A (en)
WO (1) WO2021047248A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110556115A (en) * 2019-09-10 2019-12-10 深圳创维-Rgb电子有限公司 IOT equipment control method based on multiple control terminals, control terminal and storage medium
CN111123875A (en) * 2019-12-31 2020-05-08 创维集团有限公司 Intelligent household control method and system and intelligent tea table
CN111276139B (en) * 2020-01-07 2023-09-19 百度在线网络技术(北京)有限公司 Voice wake-up method and device
CN111880855A (en) * 2020-07-31 2020-11-03 宁波奥克斯电气股份有限公司 Equipment control method and distributed voice system
CN112363625A (en) * 2020-11-19 2021-02-12 成都金都超星天文设备有限公司 Method and control system for controlling planetarium
CN112597474B (en) * 2020-12-16 2024-08-23 佛山市顺德区美的电子科技有限公司 Identity determination method, control method and system, storage medium and terminal equipment
CN113450791B (en) * 2021-04-28 2023-08-04 珠海格力电器股份有限公司 Voice equipment control method and device, storage medium and voice equipment

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107450390A (en) * 2017-07-31 2017-12-08 绵阳美菱软件技术有限公司 A kind of intelligent electrical appliance control device, control method and control system
CN108766422A (en) * 2018-04-02 2018-11-06 青岛海尔科技有限公司 Response method, device, storage medium and the computer equipment of speech ciphering equipment
CN108766446A (en) * 2018-04-18 2018-11-06 上海问之信息科技有限公司 Method for recognizing sound-groove, device, storage medium and speaker
CN109215663A (en) * 2018-10-11 2019-01-15 北京小米移动软件有限公司 Equipment awakening method and device
CN109391528A (en) * 2018-08-31 2019-02-26 百度在线网络技术(北京)有限公司 Awakening method, device, equipment and the storage medium of speech-sound intelligent equipment
US20190147904A1 (en) * 2017-11-16 2019-05-16 Baidu Online Network Technology (Beijing) Co., Ltd Method, device and apparatus for selectively interacting with multi-devices, and computer-readable medium
CN110556115A (en) * 2019-09-10 2019-12-10 深圳创维-Rgb电子有限公司 IOT equipment control method based on multiple control terminals, control terminal and storage medium

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104978955A (en) * 2014-04-14 2015-10-14 美的集团股份有限公司 Voice control method and system
CN106128456A (en) * 2016-06-16 2016-11-16 美的集团股份有限公司 The sound control method of intelligent appliance, terminal and system
CN107622767B (en) * 2016-07-15 2020-10-02 青岛海尔智能技术研发有限公司 Voice control method of household appliance system and household appliance control system
CN106653021B (en) * 2016-12-27 2020-06-02 上海智臻智能网络科技股份有限公司 Voice wake-up control method and device and terminal
CN108337601A (en) * 2018-01-30 2018-07-27 出门问问信息科技有限公司 The control method and device of speaker
CN108667697B (en) * 2018-04-28 2020-12-08 新华三技术有限公司 Voice control conflict resolution method and device and voice control system
CN108922524A (en) * 2018-06-06 2018-11-30 西安Tcl软件开发有限公司 Control method, system, device, Cloud Server and the medium of intelligent sound equipment
CN109003609A (en) * 2018-08-15 2018-12-14 珠海格力电器股份有限公司 Voice equipment, intelligent voice system, equipment control method and device
CN109377987B (en) * 2018-08-31 2020-07-28 百度在线网络技术(北京)有限公司 Interaction method, device, equipment and storage medium between intelligent voice equipment
CN109032039B (en) * 2018-09-05 2021-05-11 出门问问创新科技有限公司 Voice control method and device
CN109039842A (en) * 2018-09-13 2018-12-18 珠海格力电器股份有限公司 Control method, device and system of household appliance
CN109360559A (en) * 2018-10-23 2019-02-19 三星电子(中国)研发中心 The method and system of phonetic order is handled when more smart machines exist simultaneously
CN109450750A (en) * 2018-11-30 2019-03-08 广东美的制冷设备有限公司 Sound control method, device, mobile terminal and the household appliance of equipment
CN109410943A (en) * 2018-12-10 2019-03-01 珠海格力电器股份有限公司 Voice control method and system of equipment and intelligent terminal
CN109917663B (en) * 2019-03-25 2022-02-15 北京小米移动软件有限公司 Method and device for controlling equipment
CN110211578B (en) * 2019-04-16 2022-01-04 百度在线网络技术(北京)有限公司 Sound box control method, device and equipment
CN110211580B (en) * 2019-05-15 2021-07-16 海尔优家智能科技(北京)有限公司 Multi-intelligent-device response method, device, system and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107450390A (en) * 2017-07-31 2017-12-08 绵阳美菱软件技术有限公司 A kind of intelligent electrical appliance control device, control method and control system
US20190147904A1 (en) * 2017-11-16 2019-05-16 Baidu Online Network Technology (Beijing) Co., Ltd Method, device and apparatus for selectively interacting with multi-devices, and computer-readable medium
CN108766422A (en) * 2018-04-02 2018-11-06 青岛海尔科技有限公司 Response method, device, storage medium and the computer equipment of speech ciphering equipment
CN108766446A (en) * 2018-04-18 2018-11-06 上海问之信息科技有限公司 Method for recognizing sound-groove, device, storage medium and speaker
CN109391528A (en) * 2018-08-31 2019-02-26 百度在线网络技术(北京)有限公司 Awakening method, device, equipment and the storage medium of speech-sound intelligent equipment
CN109215663A (en) * 2018-10-11 2019-01-15 北京小米移动软件有限公司 Equipment awakening method and device
CN110556115A (en) * 2019-09-10 2019-12-10 深圳创维-Rgb电子有限公司 IOT equipment control method based on multiple control terminals, control terminal and storage medium

Also Published As

Publication number Publication date
CN110556115A (en) 2019-12-10

Similar Documents

Publication Publication Date Title
WO2021047248A1 (en) Multiple control terminal-based iot device control method, control terminal, and storage medium
CN108447480B (en) Intelligent household equipment control method, intelligent voice terminal and network equipment
US20200075018A1 (en) Control method of multi voice assistants
CN107544272B (en) Terminal control method, device and storage medium
WO2016065825A1 (en) Method and apparatus for recommending scenario mode for smart device
WO2016065812A1 (en) Scenario mode setting-based smart device control method and apparatus
CN103017292B (en) Ward attending method and system based on intelligent air conditioner
WO2020199673A1 (en) Method and device for controlling household appliance, and household appliance
WO2020168571A1 (en) Device control method, apparatus, system, electronic device and cloud server
WO2021082131A1 (en) Air conditioning device, and temperature control method and apparatus
CN109164715A (en) A kind of smart home system, control method, equipment and medium
CN110767225B (en) Voice interaction method, device and system
WO2020107698A1 (en) Air-conditioning device control method and air-conditioning device
CN109143879A (en) Method for controlling household appliances by taking air conditioner as center
CN109195201A (en) Network connection method, device, storage medium and user terminal
WO2019227370A1 (en) Method, apparatus and system for controlling multiple voice assistants, and computer-readable storage medium
CN110376907A (en) Intelligent home furnishing control method, device, equipment and storage medium
CN112908321A (en) Device control method, device, storage medium, and electronic apparatus
CN114120996A (en) Voice interaction method and device
CN113676382B (en) IOT voice command control method, system and computer readable storage medium
WO2023231894A1 (en) Wake-up method, apparatus and system based on collaborative error correction, and medium and device
CN116582382B (en) Intelligent device control method and device, storage medium and electronic device
CN116566760B (en) Smart home equipment control method and device, storage medium and electronic equipment
TW202125215A (en) Sound control method and terminal device
CN108663942B (en) Voice recognition equipment control method, voice recognition equipment and central control server

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20863611

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20863611

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 30.08.2022)

122 Ep: pct application non-entry in european phase

Ref document number: 20863611

Country of ref document: EP

Kind code of ref document: A1