CN115798476A

CN115798476A - Equipment control method, device, readable storage medium and chip

Info

Publication number: CN115798476A
Application number: CN202211193984.0A
Authority: CN
Inventors: 蔡纯兴; 张秀云; 徐吉轩
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2022-09-28
Filing date: 2022-09-28
Publication date: 2023-03-14

Abstract

The disclosure relates to an equipment control method, an equipment control device, a readable storage medium and a chip, and relates to the technical field of smart home. The method comprises the following steps: registering first device information of the first target device to a first server; synchronizing the first equipment information to a second server through the first server, wherein the first equipment information is used for establishing connection between the second server and a target voice module according to the first equipment information; and under the condition that the second server is connected with the target voice module, controlling a second target device through the target voice module or the processor according to a first control instruction sent by the second server, wherein the first control instruction is an instruction obtained by converting sound emitted by a sound source. By using the device control method provided by the disclosure, the user can control the second target device by using the first target device capable of conversation, and convenience is brought to the user for controlling the second target device.

Description

Equipment control method, device, readable storage medium and chip

Technical Field

The present disclosure relates to the field of smart home technologies, and in particular, to a device control method, an apparatus, a readable storage medium, and a chip.

Background

Along with the increasing improvement of the living standard of people, the intelligent home plays an important role in the daily life of people, and brings great convenience to the life of people.

In the related art, a user can control the smart home on a terminal such as a mobile phone, however, when the user does not carry the terminal and wants to control the smart home, the user is required to actively go to the location where the smart home is located to control the smart home, or go to the location where the terminal is located to control the smart home using the terminal, which also brings inconvenience to the life of the user.

Disclosure of Invention

In order to overcome the problems in the related art, the present disclosure provides a device control method, apparatus, readable storage medium, and chip.

According to a first aspect of the embodiments of the present disclosure, there is provided an apparatus control method, which is applied to a target voice module, the method including:

registering first device information of the first target device to a first server;

synchronizing the first equipment information to a second server through the first server, wherein the first equipment information is used for establishing connection between the second server and the target voice module according to the first equipment information;

and under the condition that the second server is connected with the target voice module, controlling a second target device through the target voice module or the processor according to a first control instruction sent by the second server, wherein the first control instruction is an instruction obtained by converting sound sent by a sound source.

Optionally, the controlling, by the target voice module or the processor, the second target device according to the first control instruction sent by the second server includes:

sending the collected first voice information to a third server, wherein the first voice information is used for converting the first voice information into a first control instruction by the third server and sending the first control instruction to the second server, and the first voice information comprises information for controlling the second target equipment;

and controlling the second target equipment through the target voice module or the processor according to the first control instruction fed back by the second server.

Optionally, the inter-core communication between the target voice module and the processor, and the controlling, by the target voice module or the processor, the second target device according to the first control instruction sent by the second server includes:

and forwarding the first control instruction to the processor through the inter-core communication under the condition that the first voice information is first preset voice information, wherein the first control instruction is used for instructing the processor to control the second target device according to the first control instruction.

and under the condition that the first voice message is a second preset voice message, controlling the second target device according to the first control instruction.

Optionally, the synchronizing the first device information to a second server includes:

synchronizing, by the first server, the first device information to the second server;

under the condition that the second server receives the first equipment information, feeding back the first equipment information to the first server through the second server;

under the condition that the binding result fed back by the first server is received, determining that the first server successfully synchronizes first equipment information to the second server; and the first server generates the binding result under the condition of receiving the first equipment information fed back by the second server.

Optionally, the method further comprises:

receiving upgrading information sent by the second server;

acquiring an upgrade file required for updating from the second server according to the upgrade information and the file information of the first target device;

and upgrading the target voice module and/or the processor by using the upgrading file.

Optionally, when the second server establishes a connection with the target voice module, controlling, by the target voice module or the processor, a second target device according to a first control instruction sent by the second server includes:

and under the condition that the second server is connected with the target voice module and the target voice module is awakened, controlling a second target device through the target voice module or the processor according to a first control instruction sent by the second server.

Optionally, the target voice module is awakened by:

and sending second voice information to a fourth server through third target equipment, wherein the fourth server awakens the target voice module from the plurality of voice modules according to the priorities of the plurality of voice modules and the distance between the plurality of voice modules and a sound source outputting the second voice information.

According to a second aspect of the embodiments of the present disclosure, there is provided an apparatus for controlling a device, the apparatus being applied to a target voice module, the apparatus including:

a registration module configured to register first device information of the first target device to a first server;

the synchronization module is configured to synchronize the first device information to a second server through the first server, wherein the first device information is used for the second server to establish connection with the target voice module according to the first device information;

and the control module is configured to control a second target device through the target voice module or the processor according to a first control instruction sent by the second server under the condition that the second server is connected with the target voice module, wherein the first control instruction is an instruction obtained by converting sound emitted by a sound source.

According to a third aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the steps of the device control method provided by the first aspect of the present disclosure.

According to a fourth aspect of embodiments of the present disclosure, there is provided a chip comprising a processor and an interface; the processor is configured to read instructions to execute the steps of the device control method provided by the first aspect of the present disclosure.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects

According to the device control method provided by the disclosure, the first device information of the first target device can be registered on the first server, the first device information is synchronized to the second server through the first server, and the second server can establish connection with the target voice module of the first target device through the first device information, so that the first target device can receive a first control instruction which is sent by the second server and is converted according to the voice of a user on the basis of the connection between the first device information and the target voice module, so that the second target device is controlled.

In the process, if the user does not carry the terminal, the user only needs to communicate with the first target device capable of being in conversation with the user, the second target device can be controlled, the user does not need to walk to the position where the second target device is located to control the second target device, the user does not need to walk to the position where the terminal is located to control the second target device through the terminal, and convenience is brought to the user for controlling the second target device.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a flow chart illustrating a device control method according to an exemplary embodiment.

Fig. 2 is an interaction diagram illustrating a related art device control method according to an exemplary embodiment.

FIG. 3 is an interaction diagram illustrating a device control method according to an example embodiment.

Fig. 4 is a block diagram illustrating an appliance control device according to an exemplary embodiment.

FIG. 5 is a block diagram illustrating an apparatus in accordance with an example embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the disclosure, as detailed in the appended claims.

It should be noted that all actions of acquiring signals, information or data in the present application are performed under the premise of complying with the corresponding data protection regulation policy of the country of the location and obtaining the authorization given by the owner of the corresponding device.

Fig. 1 is a flowchart illustrating a device control method according to an exemplary embodiment, where the device control method is used in a target voice module, as shown in fig. 1, and includes the following steps.

In step S11, first device information of the first target device is registered to a first server.

In the disclosure, a processor is configured in a target voice module, the target voice module is disposed in a first target device, and the target voice module and the processor are in inter-core communication. The first device information comprises information of the target voice module and information of the processor.

The first target device is a device which is woken up and can control the second target device, and can also be understood as a device which can have a conversation with the user under the condition that the user does not move; the first device information is device information of a first target device, the first device information comprises an identifier, registration information, a type and the like of the device, and the information is used for uniquely identifying one device; the first server may be an iot (Internet of Things) server, and the iot server is mainly used for synchronizing the first device information to the second server.

According to the method and the system for establishing the connection between the smart home and the first server, the smart home such as the second target device and the third target device which are subsequently provided by the disclosure registers the device information of the smart home to the first server, so that the smart home in the home local area network where the user is located can be connected with the first server.

The first target device comprises a target voice module and a processor, the processor is configured in the target voice module, the target voice module and the processor are located on the same Central Processing Unit (CPU), the CPU has a plurality of cores, a first core of the plurality of cores is allocated to the target voice module, and a second core of the plurality of cores is allocated to the processor, so that the target voice module performs data transmission with the processor through inter-core communication.

Specifically, the target voice module may be a favorite voice module, which is a chip formed by a plurality of circuits; the target voice module receives data from the plurality of servers and forwards the data to the processor through inter-core communication between the first core and the second core.

In step S12, the first device information is synchronized to a second server through the first server, and the first device information is used for the second server to establish a connection with the target voice module according to the first device information.

In this disclosure, the second server may be a server that issues a control instruction in the whole device control method, most of the instructions need to be issued by the second server to a target voice module in the first target device, and the second server may be a Micro (Micro-controller based Internet Connectivity Operating system) server.

In the related art, please refer to fig. 3, the target voice module is connected to the processor through a hard wire, and the processor is externally connected to the target voice module through a hard wire, so that the hardware development cost is increased by the additional hardware device, i.e., the processor.

In order to reduce the hardware development cost, in an exemplary embodiment of the present disclosure, the processor may be configured in the target voice module in a software form, and the processor in the software form is configured by the hardware of the target voice module without additional configuration of hardware, so the hardware development cost is reduced.

When the processor is configured in the target voice module in a software form, the processor cannot communicate with the target voice module through a hard-wire connection, so the present disclosure additionally allocates a first core to the target voice module, and after the target voice module is allocated with the first core, the target voice module can perform data transmission with a second core of the processor through the first core to implement communication.

The target voice module in the related art is not configured with the first core, so that the target voice module cannot be developed for the second time, and after the target voice module is allocated with the first core, a second open interface is provided, so that developers can develop the target voice module for the second time to expand the function of the target voice module.

In the related art, the first target device receives the update packet from the first server, and updates the target voice module and the processor in the second target device through two lines. In the disclosure, after the processor is configured in the target voice module in a software form, the processor and the target voice module are merged into a whole, so that the first server cannot determine whether the first control instruction is issued to the processor or the target voice module.

Specifically, after the second server has the update package, the second server only needs to send the update package to the target voice module through one line, specifically, the update package is sent to the processor, or the target voice module is sent to the processor, and the update package is sent to the processor through logic inside the first target device.

When the first server synchronizes the first device information to the second server, the method can be realized by the following substeps:

substep A1: synchronizing, by the first server, the first device information to the second server.

The first server returns the binding result to the first target device after the first device information is successfully registered, and the second server also returns the binding result to the first target device through the first server after the first device information is successfully registered, so that the first target device can repeatedly receive the binding result, and the data processing amount of the server is large.

In order to reduce the processing load of the servers, the present disclosure does not return the binding result to the first target device immediately after the first server receives the first device information, but synchronizes the first device information to the second server.

Specifically, the first server may receive first device information reported by the voice modules of the multiple smart homes, and then synchronize the first device information to the second server.

Substep A2: and under the condition that the second server receives the first equipment information, feeding back the first equipment information to the first server through the second server.

Specifically, if the second server successfully receives the first device information, the second server returns the first device information to the first server, which indicates that the second server has successfully registered the first device information.

Substep A3: under the condition that the binding result fed back by the first server is received, determining that the first server successfully synchronizes first equipment information to the second server; and the first server generates the binding result under the condition of receiving the first equipment information fed back by the second server.

Specifically, if the first server successfully receives the first device information fed back by the second server, it may be determined that the second server has successfully registered the first device information, at this time, the first device information may be registered in the first server, and after the first server successfully registers the first device information, a binding result is generated and returned to the target voice module of the first target device.

In the process, the first server only returns the binding result to the target voice module once, which indicates that the first server and the second server have successfully registered the first device information, and the binding result does not need to be repeatedly returned, so that the data processing amount of the first server is reduced.

In the related art, the first device information is registered in the first server and the second server at the same time, and the first device information on the two servers is compared to determine whether the first device information is the same, so as to synchronize the information of the two servers.

In order to reduce the calculation amount of the two servers, the first server synchronizes the transmission of the first equipment information to the second server, so that the first server only needs to resend the first equipment information under the condition that the second server fails to receive the first equipment information, information comparison is not needed, and the calculation amount of the first server is reduced; and synchronizing the first equipment information on the first server to the second server, so that the second server executes the control function of the first server according to the first equipment information to issue a first control instruction for the target voice module and the processor which are combined into a whole.

Of course, in another embodiment, the processor may also be stored in the first target device in a hardware form, and connected to the target voice module through a serial port.

In step S13, under the condition that the second server is connected to the target voice module, the target voice module or the processor controls a second target device according to a first control instruction sent by the second server, where the first control instruction is an instruction converted from a sound emitted by a sound source.

In the disclosure, under the condition that the first server and the second server receive the first device information, the first server and the second server can uniquely determine a target voice module of the smart home according to the first device information, so as to establish communication connection with the target voice module of the smart home.

The second target device refers to a device controlled by the first target device, and certainly, the second target device may also implement a control function of the first target device to control other smart homes, which is not limited in this disclosure.

The first control instruction received by the target voice module of the first target device may be a request value, and different control instructions correspond to different request values, for example, the request value requesting to turn on the washing machine is 1, the request value requesting to turn on the television is 2, and the like.

Under the condition that the second server is connected with the target voice module of the first target equipment, the second server has the function of issuing the first control instruction, so that the second server can issue the first control instruction obtained by converting the sound emitted by the sound source to the first target equipment, and the target voice module or the processor in the first target equipment can control the second target equipment according to the first control instruction.

For example, the user house has three smart homes, namely a washing machine, an air conditioner and a microwave oven, and when the voice modules of the three smart homes are all connected with the second server, the user can output voice towards the washing machine, and the voice module or the processor in the washing machine can control the air conditioner or the microwave oven according to the first control instruction converted by the voice.

As shown in fig. 2, the target voice module in the first target device may be equipped with a sound collection device and an audio playing device, the sound collection device may be a microphone, the audio playing device may be a player, the first target device may collect first voice information output by a user through the sound collection device on the target voice module, and then play information related to voice through the audio playing device on the target voice module, or feed back the first voice information output by the user through the audio playing device. The first target device may also control lights and function buttons of the second target device via the processor.

Target voice modules in smart homes such as the second target device and a third target device mentioned later can be provided with a voice collecting device and an audio playing device so as to realize the functions of collecting voice and playing audio; the processor may also be equipped to control the function buttons and the light of other smart homes, so as to implement the same function as the first target device, which is not limited in this disclosure.

According to the device control method provided by the disclosure, the first device information of the first target device can be registered on the first server, the first device information is synchronized to the second server through the first server, and the second server can establish connection with the target voice module of the first target device through the first device information, so that the target voice module of the first target device can receive a first control instruction which is sent by the second server and is converted according to the voice of a user on the basis of the connection between the first device information and the target voice module, and the second target device is controlled through the target voice module or a processor.

In the process, if the user does not carry the terminal, the user only needs to communicate with the target voice module of the first target device capable of talking, so that the second target device can be controlled, the user does not need to walk to the position of the second target device to control the second target device, and does not need to walk to the position of the terminal to control the second target device by using the terminal, so that convenience is brought to the user for controlling the second target device.

In the second aspect, since the second server synchronizes the first device information of the first server, the second server may have a function of the first server to determine the first target device according to the first device information, and then send the first control instruction to the second target device, thereby solving a problem that the first control instruction cannot be accurately issued by the first server when the processor is configured in the target voice module.

In the third aspect, since the processor can be configured in the target voice module in the form of software, the cost of the processor for additionally configuring hardware is reduced.

In the fourth aspect, since the target voice module is assigned with the first core, the target voice module can open the secondary development interface through the first core to extend the function of the target voice module.

In one possible embodiment, the second target device may be controlled by the following steps.

In step S21, the collected first voice information is sent to a third server, where the first voice information is used for the third server to convert the first voice information into a first control instruction and send the first control instruction to the second server, and the first voice information includes information for controlling the second target device.

The third server may be a server capable of processing voice information, for example, a favorite server; the first control instruction corresponds to the first voice information and is used for controlling the second target device.

Specifically, as shown in fig. 2, the target voice module of the first target device sends the collected first voice information to the third server, the third server analyzes the first voice information, converts the first voice information into the first control instruction and forwards the first control instruction to the second server, the second server forwards the first control instruction to the target voice module, and the target voice module or the processor controls the second target device through the first control instruction.

For example, when a user outputs a first voice message of 'turning on a television', a target voice module in the washing machine sends the first voice message to the favorite server; after the Xiao' ai server analyzes the first voice information, the first voice information is converted into a first control instruction, the first control instruction is forwarded to the micro server, the micro server forwards the first control instruction to a target voice module in the washing machine, the target voice module in the washing machine forwards the first control instruction to a processor in the washing machine, and the processor in the washing machine controls the television to be turned on according to the first control instruction.

In step S22, when the second server is connected to the target voice module and the target voice module is awakened, the target voice module or the processor controls a second target device according to a first control instruction sent by the second server.

In the disclosure, the target voice module is awakened and connected to the second server, and then the second target device can be controlled by itself or the processor, and specifically, the second voice message can be sent to the fourth server through the third target device, and the fourth server awakens the target voice module from the plurality of voice modules according to priorities of the plurality of voice modules and distances between the plurality of voice modules and a sound source outputting the second voice message.

The fourth server may be a server that wakes up the first target device from a plurality of servers, for example, may be a cooperative server, the third target device may be a device closer to a sound source that outputs the second voice information, and the third target device, the second target device, and the first target device may be the same smart home or different smart homes.

Specifically, in the space of the position of the sound source, a voice module of a third target device close to the sound source receives second voice information output by a user and sends the second voice information to a fourth server, and the fourth server receives the second voice information sent by the third target device; and awakening the target voice module from the plurality of voice modules according to the priorities of the plurality of voice modules in the space where the sound source is located and the distances between the plurality of voice modules and the sound source. The second voice message is used for indicating the third target device to wake up the target voice module of the first target device, and the first voice message is used for indicating the target voice module or the processor in the first target device to control the second target device.

The house is provided with three smart homes including a washing machine, a television and a microwave oven, a first target device is the washing machine, a second target device is the television, a third target device is the microwave oven, a second server is a micro server, a fourth server is a Xiao ai server, and the fourth server is a collaboration server.

Referring to fig. 2, the user sends a second voice message "do love you, do you," in the house, and at this time, the voice module of the microwave oven closest to the user in the house receives the second voice message, and transmits the second voice message to the collaboration server; the cooperative server awakens the target voice module of the washing machine from the three intelligent household voice modules in the house according to the priorities of the three intelligent household voice modules in the house and the distances between the three intelligent household voice modules and the user, so that the target voice module of the washing machine is in an awakened state.

After the third target device receives the second voice information, the target voice module of the first target device can be awakened through the fourth server, and the target voice module of the first target device is controlled through the fourth server to feed back the second voice information output by the user.

For example, when the third target device receives the second voice message of "do love classmate", the third target device wakes up the target voice module of the first target device through the collaboration server, and the first target voice module can output the "i am" voice through the audio playing device, so as to feed back the voice message output by the user.

The fourth server can awaken the target voice module from the plurality of voice modules according to the priorities of the plurality of voice modules and the distance between the plurality of voice modules and the sound source outputting the second voice information.

Specifically, when the number of the voice modules in the space where the sound source is located is 1, the fourth server takes the unique voice module as a target voice module to wake up; when the number of the voice modules in the space where the sound source is located is greater than 1, the fourth server can take the voice module with the highest priority as a target voice module from the plurality of voice modules; and under the condition that a plurality of voice modules with the highest priority exist, taking the voice module which is closest to the sound source outputting the second voice information in the plurality of voice modules with the highest priority as a target voice module.

It can be understood that the higher the priority, the higher the capability of the voice module to process the audio data, for example, the audio processing capability of the voice module in the equipment such as the toy, the player, etc. is higher than that of the equipment such as the washing machine, the microwave oven, etc., so the higher the audio processing capability, the higher the priority of the voice module is than that of the voice module with the weaker audio processing capability.

For example, when the fourth server wakes up the target voice module from the plurality of voice modules, the voice module of the equipment such as the xiaoai can be preferentially woken up, and when the xiaoai does not exist, the priority of the voice module of the equipment such as the washing machine and the microwave oven is the same, so that the voice module of the washing machine closest to the user can be woken up as the target voice module from the plurality of voice modules with the same priority.

In this disclosure, the second target device controlled by the first target device may be itself, or may be other smart homes.

When the first voice message received by the target voice module is the first preset voice message, the target voice module determines that the target voice module cannot control the second target equipment according to a first control instruction sent by the second server; when the first voice message received by the target voice module is the second preset voice message, the target voice module determines that the target voice module can control the second target equipment according to a first control instruction sent by a second server; and when the first voice message received by the target voice module is the third preset voice message, the target voice module determines that the target voice module can interact with the user sending the sound source according to the second control instruction sent by the first server. The method specifically comprises the following three conditions:

case 1: and forwarding the first control instruction fed back by the second server to the processor through the inter-core communication under the condition that the first voice information is first preset voice information, wherein the first control instruction is used for instructing the processor to control the second target device according to the first control instruction.

The first preset voice information is voice irrelevant to audio playing, such as turning on a television, adjusting brightness of the television, turning on a microwave oven, adjusting heating time of the microwave oven, and the like.

When the first voice message is the first preset voice message, it indicates that the user wants to control the second target device, but not play the audio, and at this time, after the target voice module receives the first control instruction output by the second server, it is determined that the target voice module cannot process the first control instruction, so that the first control instruction is forwarded to the processor, and the processor is instructed to control the second target device according to the first control instruction.

For example, after the target voice module of the washing machine is awakened by the cooperative server, when the user outputs the first voice message of turning on the television again, the awakened target voice module sends the first voice message to the Xiao' ai server; after the Xiaoai server analyzes the first voice information, the first voice information is converted into a first control instruction, the first control instruction is forwarded to the micro server, the micro server forwards the first control instruction to the target voice module, the target voice module forwards the first control instruction to a processor in the washing machine, and the processor in the washing machine controls the television to be turned on according to the first control instruction.

Case 2: and under the condition that the first voice information is second preset voice information, controlling the second target equipment through a target voice module directly according to the first control instruction sent by the second server.

The second preset voice information is voice related to audio playing, such as playing music, pausing playing music, and the like.

When the first voice message is the second preset voice message, it indicates that the user wants to control the audio function of the second target device, and at this time, after the target voice module receives the first control instruction output by the second server, it is determined that the target voice module can process the first control instruction, so that the second target device can be controlled directly according to the first control instruction.

For example, after a user outputs first voice information of ' playing music ', the awakened target voice module uploads the first voice information to the Xiao ' ai server, the Xiao ai server converts the first voice information into a first control instruction and forwards the first control instruction to the micro server, the micro server forwards the first control instruction to the target voice module, and the target voice module controls the micro server or the player to play music according to the first control instruction.

Case 3: and under the condition that the first voice information is third preset voice information, receiving a second control instruction sent by a third server through the target voice module, and controlling a second target device according to the second control instruction.

The third preset voice information may be voice related to voice interaction, for example, voice that the user needs to interact with the second target device.

And under the condition that the first voice message is the third preset voice message, indicating that the user wants to interact with the second target device. At the moment, after receiving a second control instruction output by a third server, the target voice module determines that the target voice module can process the second control instruction, so that voice interaction can be performed with a user directly according to first voice information sent by a second control instruction responding sound source.

In the process, the target voice module is provided with the voice acquisition device and the audio playing device, so that the target voice module can acquire voice and play audio, and the audio playing function and the voice interaction function of the second target device are realized; the processor is directly connected to the device so that the processor can directly control the second target device to perform the non-audio related function.

After the processor successfully executes the first control instruction, the processor returns feedback information of the first control instruction to the target voice module, and the target voice module returns to the second server, so that the second server determines that the processor meets functions required by a user; similarly, after the target voice module successfully executes the second control instruction, the target voice module may also return feedback information of the successfully executed second control instruction to the second server or the third server, so that the second server or the third server determines that the target voice module satisfies the function required by the user.

As shown in fig. 2, the first server (iot server in fig. 2), the second server (mico server in fig. 2), the third server (xiaoai server in fig. 2), and the fourth server (collaboration server in fig. 2) may all be in communication connection with the application program, and a user may initialize a distribution network on the application program, so that the first target device connected to each server can be in a networking state.

In addition, the user may also directly issue a control instruction to control the second target device using the application program, which is not described herein again.

In the related art, different second target devices need to be connected to different device masters adapted to the second target devices to receive data fed back by multiple servers, which results in lower generality of the device masters.

According to the equipment control method provided by the disclosure, the target voice module can process the first control instruction which can be processed by the target voice module to realize the functions related to audio control, such as audio playing and pausing, the target voice module can also forward the first control instruction which cannot be processed by the target voice module to the processor, the direct control of the second target equipment is realized through the processor, and the functions unrelated to audio control, such as starting, screen brightness control, timing function and the like of the television are realized. Therefore, different application scenarios can be adapted between the processor included in the first target device and the target voice module, so as to adapt to different devices, to realize various functions required by a user, without configuring a device master control for each device, and the universality is high.

In a possible implementation manner, before the target voice module of the first target device communicates with each server, a communication connection between the target voice module and each server needs to be established, data transmission between the target voice module and each server can be realized based on the connection, and when the connection is established, the connection sequence is further specifically divided, specifically including:

in step S31, first device information of a first target device is registered to a first server, and the first device information is synchronized to a second server through the first server.

When different servers are connected with the target voice module of the first target device, the target voice module is required to upload first device information in different formats, and the first device information can be analyzed by the different servers.

For example, when the target voice module registers the first device information to the first server, the first device information needs to be uploaded to the first server in a model format or a pid format; the first server can analyze the first device information according to the first device information in the model format or the pid format, and determines the first target device according to the first device information to establish connection with the target voice module of the first target device.

For another example, when the target voice module registers the first device information to the second server, the first device information needs to be uploaded to the second server in a hardware format; the second server can analyze the first device information in the hardware format, and determine the first target device according to the first device information to establish connection with the target voice module of the first target device.

Specifically, as shown in fig. 2, the multiple servers are in communication connection with an Application program, the Application program may be a mikkai App (Application program) installed in the terminal, the Application program checks version information, when it is determined that there is a version update, the version information is issued to the target voice module through the second server, and the target voice module acquires an upgrade file required for upgrading from the second server, so as to upgrade the upgrade file to itself, and/or transmit the upgrade file to the processor, so as to upgrade the processor. The upgrade file may be a file for upgrading the processor, may also be a file for upgrading the target voice module, and certainly may also be a file for upgrading both the target voice module and the processor.

After the target voice module of the first target device is connected to the second server, an OTA (Over-the-Air Technology) may be implemented, or a configuration file may be downloaded from the second server to update the wake-up function of the target voice module of the first target device; the log may also be uploaded to a second server.

Specifically, when the awakening function of the target voice module of the first target device is updated, after the first target device is awakened for multiple times by the cooperative server, the situation that the target voice module is not awakened may still exist, and at this time, a log of the awakening failure can be uploaded to the second server; and the developer develops the configuration file on the second server and then sends the configuration file to the target voice module to update the awakening function of the target voice module so as to ensure that the target voice module can be awakened normally.

Specifically, when the upgrading function of the first target equipment is updated, the second server checks an updated version, if the new version exists, the upgrading information of a plurality of files in the new version is sent to the first target equipment, the first target equipment obtains differential file information between the upgrading information and the file information of the first target equipment, the upgrading file corresponding to the differential file information is obtained from the second server, and finally the first target equipment is upgraded by the upgrading file.

Because the first target device comprises the processor and the target voice module, when the upgrading file is used for upgrading the processor, the target voice module forwards the upgrading file to the processor through the inter-core communication so as to upgrade the processor; when the upgrade file is used for upgrading the target voice module, the target voice module directly utilizes the upgrade file to upgrade the target voice module.

In step S32, the first device information of the first target device is registered to the third server, and the third server establishes a connection with the target voice module of the first target device according to the first device information.

In this disclosure, the third server may be a favorite server, and after the first device information is successfully registered in the first server and the second server, the first device information is registered in the third server to establish a connection with the third server.

When the first target device registers the first device information on the third server, the first device information needs to be registered on the third server in an Appid format, and the third server can analyze the first device information in the Appid format and determine the first target device according to the first device information to establish connection with the target voice module of the first target device.

Specifically, the target voice module sends the first device information to the third server through a Software Development Kit (sdk) to establish a voice interaction cloud channel between the target voice module and the third server, so as to upload the voice received by the target voice module to the third server, or download audio resources from the third server, and the like.

In step S33, the first device information of the first target device is registered to the fourth server, and the fourth server establishes a connection with the target voice module of the first target device according to the first device information.

In this disclosure, the fourth server may be a cooperative server, and after the first device information is successfully registered in the third server, the first device information is registered in the fourth server, so as to establish a connection with the fourth server.

When the first target device registers the first device information to the fourth server, the first device information needs to be registered on the fourth server in a hardware format, and the fourth server can analyze the first device information in the hardware format and determine the first target device according to the first device information to establish connection with the target voice module of the first target device.

Specifically, the target voice module registers the first device information to the fourth server through the collaboration sdk to establish connection with the collaboration server, so that the collaboration server can wake up and control the target voice module.

FIG. 4 is a block diagram illustrating an appliance control device for use in a target speech module according to one exemplary embodiment. Referring to fig. 4, the device control apparatus 120 includes a registration module 121, a synchronization module 122, and a control module 123.

A registration module 121 configured to register first device information of the first target device to a first server;

a synchronization module 122 configured to synchronize, by the first server, the first device information to a second server, where the first device information is used by the second server to establish a connection with the target voice module according to the first device information;

a control module 123, configured to, when the second server establishes a connection with the target voice module, control a second target device through the target voice module or the processor according to a first control instruction sent by the second server, where the first control instruction is an instruction converted from sound emitted by a sound source.

Optionally, the control module 123 comprises:

the conversion module is configured to send the collected first voice information to a third server, wherein the first voice information is used for the third server to convert the first voice information into a first control instruction and send the first control instruction to the second server, and the first voice information contains information for controlling the second target device;

and the first control module is configured to control the second target equipment through the target voice module or the processor according to the first control instruction fed back by the second server.

Optionally, the voice module and the processor communicate with each other through an inter-core, and the control module 123 includes:

the second control module is configured to forward the first control instruction to the processor through the inter-core communication when the first voice information is first preset voice information, where the first control instruction is used to instruct the processor to control the second target device according to the first control instruction.

Optionally, the control module 123 comprises:

and the third control module is configured to control the second target device according to the first control instruction under the condition that the first voice message is a second preset voice message.

Optionally, the synchronization module 122 includes:

a first synchronization module configured to synchronize, by the first server, the first device information to the second server;

a first feedback module configured to feed back, by the second server, the first device information to the first server if the second server receives the first device information;

a second feedback module configured to determine that the first server successfully synchronizes first device information to the second server in case of receiving the binding result fed back by the first server; and the first server generates the binding result under the condition of receiving the first device information fed back by the second server.

Alternatively, the device control apparatus 120 includes:

the upgrading information receiving module is configured to receive upgrading information sent by the second server;

the upgrade file acquisition module is configured to acquire an upgrade file required for updating from the second server according to the upgrade information and the file information of the first target device;

and the upgrading module is configured to upgrade the target voice module and/or the processor by the upgrading file.

Optionally, the control module 123 comprises:

and the third control module is configured to control a second target device through the target voice module or the processor according to the first control instruction sent by the second server under the condition that the second server is connected with the target voice module and the target voice module is awakened.

Optionally, the device control apparatus 120 includes:

and the awakening module is configured to send second voice information to a fourth server through a third target device, and the fourth server awakens the target voice module from the plurality of voice modules according to the priorities of the plurality of voice modules and the distance between the plurality of voice modules and a sound source outputting the second voice information.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

The present disclosure also provides a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the steps of the device control method provided by the present disclosure.

Fig. 5 is a block diagram illustrating an apparatus 800 for device control in accordance with an example embodiment. For example, the apparatus 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 5, the apparatus 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output interface 812, a sensor component 814, and a communication component 816.

The processing component 802 generally controls overall operation of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operations at the apparatus 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

Power components 806 provide power to the various components of device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 800.

The multimedia component 808 includes a screen that provides an output interface between the device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 800 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The input/output interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the device 800. For example, the sensor assembly 814 may detect the open/closed status of the device 800, the relative positioning of components, such as a display and keypad of the device 800, the sensor assembly 814 may also detect a change in the position of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration/deceleration of the device 800, and a change in the temperature of the device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate communications between the apparatus 800 and other devices in a wired or wireless manner. The device 800 may access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the device 800 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

The apparatus may be a part of a stand-alone electronic device, for example, in an embodiment, the apparatus may be an Integrated Circuit (IC) or a chip, where the IC may be one IC or a collection of multiple ICs; the chip may include, but is not limited to, the following categories: a GPU (Graphics Processing Unit), a CPU (Central Processing Unit), an FPGA (Field Programmable Gate Array), a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an SOC (System on Chip, SOC, system on Chip, or System on Chip), and the like. The integrated circuit or chip may be configured to execute executable instructions (or code) to implement the device control method. Where the executable instructions may be stored in the integrated circuit or chip or may be retrieved from another device or apparatus, for example, where the integrated circuit or chip includes a processor, a memory, and an interface for communicating with other devices. The executable instructions may be stored in the memory, and when executed by the processor, implement the device control method described above; alternatively, the integrated circuit or chip may receive executable instructions through the interface and transmit the executable instructions to the processor for execution, so as to implement the device control method.

In another exemplary embodiment, a computer program product is also provided, which comprises a computer program executable by a programmable apparatus, the computer program having code portions for performing the above-mentioned device control method when executed by the programmable apparatus.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An apparatus control method applied to a target voice module, the target voice module being configured in a first target apparatus, the target voice module having a processor therein, the method comprising:

and under the condition that the second server is connected with the target voice module, controlling a second target device through the target voice module or the processor according to a first control instruction sent by the second server, wherein the first control instruction is an instruction obtained by converting sound emitted by a sound source.

2. The method of claim 1, wherein the controlling, by the target voice module or the processor, the second target device according to the first control instruction sent by the second server comprises:

3. The method of claim 1, wherein the inter-core communication between the target voice module and the processor, and the controlling, by the target voice module or the processor, the second target device according to the first control instruction sent by the second server includes:

4. The method of claim 1, wherein the controlling, by the target voice module or the processor, the second target device according to the first control instruction sent by the second server comprises:

and under the condition that the first voice information is second preset voice information, controlling the second target equipment according to the first control instruction.

5. The method of claim 1, wherein synchronizing the first device information to a second server comprises:

under the condition that the binding result fed back by the first server is received, determining that the first server successfully synchronizes first equipment information to the second server; and the first server generates the binding result under the condition of receiving the first device information fed back by the second server.

6. The method of claim 1, further comprising:

receiving upgrading information sent by the second server;

7. The method according to claim 1, wherein the controlling, by the target voice module or the processor, the second target device according to the first control instruction sent by the second server in the case that the second server establishes the connection with the target voice module comprises:

8. The method of claim 7, wherein the target voice module is awakened by:

9. An apparatus for controlling a device, the apparatus being adapted to be used in a target speech module, the apparatus comprising:

10. A computer-readable storage medium, on which computer program instructions are stored, which program instructions, when executed by a processor, carry out the steps of the method according to any one of claims 1 to 8.

11. A chip comprising a processor and an interface; the processor is configured to read instructions to perform the method of any one of claims 1 to 8.