CN110276942A - Add method, apparatus, equipment and the readable storage medium storing program for executing of controlled device - Google Patents
Add method, apparatus, equipment and the readable storage medium storing program for executing of controlled device Download PDFInfo
- Publication number
- CN110276942A CN110276942A CN201910538718.9A CN201910538718A CN110276942A CN 110276942 A CN110276942 A CN 110276942A CN 201910538718 A CN201910538718 A CN 201910538718A CN 110276942 A CN110276942 A CN 110276942A
- Authority
- CN
- China
- Prior art keywords
- control function
- controlled
- controlled device
- instruction
- control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000006870 function Effects 0.000 claims description 225
- 238000012545 processing Methods 0.000 claims description 39
- 238000004590 computer program Methods 0.000 claims description 11
- 230000008569 process Effects 0.000 claims description 7
- 230000000694 effects Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000012217 deletion Methods 0.000 description 3
- 230000037430 deletion Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C23/00—Non-electrical signal transmission systems, e.g. optical systems
- G08C23/04—Non-electrical signal transmission systems, e.g. optical systems using light waves, e.g. infrared
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Selective Calling Equipment (AREA)
Abstract
The present invention provides a kind of method, apparatus, equipment and readable storage medium storing program for executing for adding controlled device.Method of the invention obtains the controlled device corresponding alternative instruction of control function and each control function to be added by the type and brand message according to controlled device；Alternative instruction corresponding to each control function is handled control as follows one by one: alternative instruction being sent to smart machine, so that smart machine sends alternative instruction to controlled device, executes control function to controlled device；Obtain the video data of the controlled device of captured in real-time in preset duration；Video analysis is carried out to video data, whether determination runs succeeded to the control function of controlled device；If it is determined that the control function to controlled device runs succeeded, alternative instruction is then determined as to the control instruction of control function, is manually operated without user, the addition of each control function of controlled device can be automatically completed, the efficiency for improving addition controlled device, improves user experience.
Description
Technical Field
The invention relates to the technical field of intelligent sound boxes, in particular to a method, a device and equipment for adding controlled equipment and a readable storage medium.
Background
The intelligent sound box with the infrared function needs to be added with controlled equipment when controlling infrared household electrical appliances. In the prior art, when a controlled device is added to an intelligent sound box, a user needs to input a lot of device information through voice, such as type and brand, whether the user successfully controls opening and closing, whether the user successfully adjusts volume, whether the user successfully adjusts temperature and the like, and the user and the intelligent sound box need to perform a series of voice interaction to complete the operation.
Disclosure of Invention
The invention provides a method, a device, equipment and a readable storage medium for adding controlled equipment, which are used for solving the problems that when the controlled equipment is added in the prior art, a user needs to perform a series of voice interaction with an intelligent sound box, the operation requirement on the user is high, time and labor are consumed, and the efficiency of adding the controlled equipment is low.
One aspect of the present invention provides a method for adding a controlled device, including:
according to the type and brand information of controlled equipment, acquiring control functions to be added by the controlled equipment and alternative instructions corresponding to each control function;
and performing the following control processing on the alternative instructions corresponding to each control function one by one:
sending the alternative instruction to an intelligent device, so that the intelligent device sends the alternative instruction to the controlled device to execute the control function on the controlled device;
acquiring video data of the controlled equipment shot in real time within a preset time length;
performing video analysis on the video data to determine whether the control function of the controlled device is successfully executed;
and if the control function of the controlled equipment is successfully executed, determining the alternative instruction as the control instruction of the control function.
Another aspect of the present invention provides an apparatus for adding a controlled device, including:
the control function and instruction management module is used for acquiring control functions to be added by the controlled equipment and alternative instructions corresponding to each control function according to the type and brand information of the controlled equipment;
an add control module to:
and performing the following control processing on the alternative instructions corresponding to each control function one by one:
sending the alternative instruction to an intelligent device, so that the intelligent device sends the alternative instruction to the controlled device to execute the control function on the controlled device;
acquiring video data of the controlled equipment shot in real time within a preset time length;
performing video analysis on the video data to determine whether the control function of the controlled device is successfully executed;
and if the control function of the controlled equipment is successfully executed, determining the alternative instruction as the control instruction of the control function.
Another aspect of the present invention is to provide a server apparatus including:
a processor, a memory, and a computer program stored on the memory and executable on the processor;
when the processor runs the computer program, the method for adding the controlled device is realized.
Another aspect of the present invention provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the method for adding a controlled device described above.
According to the method, the device, the equipment and the readable storage medium for adding the controlled equipment, the control function to be added of the controlled equipment and the alternative instruction corresponding to each control function are obtained according to the type and the brand information of the controlled equipment; and performing the following control processing on the alternative instructions corresponding to each control function one by one: sending the alternative instruction to an intelligent device, so that the intelligent device sends the alternative instruction to the controlled device to execute the control function on the controlled device; acquiring video data of the controlled equipment shot in real time within a preset time length; performing video analysis on the video data to determine whether the control function of the controlled device is successfully executed; and if the control function of the controlled equipment is successfully executed, determining the alternative instruction as the control instruction of the control function, so that the addition of each control function of the controlled equipment can be automatically completed without manual operation of a user, the efficiency of adding the controlled equipment is improved, and the user experience is improved.
Drawings
Fig. 1 is a flowchart of a method for adding a controlled device according to an embodiment of the present invention;
fig. 2 is a flowchart of a method for adding a controlled device according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of an apparatus for adding a controlled device according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of an apparatus for adding a controlled device according to a fourth embodiment of the present invention;
fig. 5 is a schematic structural diagram of a server device according to a fifth embodiment of the present invention.
With the above figures, certain embodiments of the invention have been illustrated and described in more detail below. The drawings and the description are not intended to limit the scope of the inventive concept in any way, but rather to illustrate it by those skilled in the art with reference to specific embodiments.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.
The terms "first", "second", etc. referred to in the present invention are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. In the description of the following examples, "plurality" means two or more unless specifically limited otherwise.
The specific application scenarios of the invention are as follows: in the intelligent home system, the intelligent equipment realizes the function of a remote controller and controls a plurality of controlled equipment in an infrared mode and the like. Before the controlled device is controlled, the controlled device which can be controlled by the intelligent device needs to be added to the intelligent device, namely, at least one control function of the intelligent device on the controlled device is added.
When controlled equipment is added, a user sends an equipment adding instruction to a user terminal where an intelligent device (APP) is located through software Application (APP) of the intelligent device, the APP starts a shooting device of the user terminal and prompts the user to align the shooting device to the controlled equipment to be added, the video data of the controlled equipment is shot in real time through the shooting device of the user terminal, and the video data shot in real time is sent to a background server.
In addition, if the intelligent equipment is provided with the shooting device, the APP of the intelligent equipment can also control the intelligent equipment to start the shooting device, prompt a user to aim the shooting device at the controlled equipment to be added, shoot the video data of the controlled equipment in real time and send the video data shot in real time to the background server.
The server equipment at the background can interact with the intelligent equipment, and the addition of the controlled equipment is automatically realized.
The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present invention will be described below with reference to the accompanying drawings.
Example one
Fig. 1 is a flowchart of a method for adding a controlled device according to an embodiment of the present invention. The embodiment of the invention provides a method for adding controlled equipment, aiming at the problems that when the controlled equipment is added in the prior art, a series of voice interaction is required between a user and an intelligent sound box, the operation requirement on the user is high, the time and the labor are consumed, and the efficiency of adding the controlled equipment is low.
The method in this embodiment is applied to a service device to which a controlled device is added, and in other embodiments, the method may also be applied to other devices, and this embodiment takes a server device as an example for exemplary explanation.
As shown in fig. 1, the method comprises the following specific steps:
step S101, obtaining control functions to be added by the controlled equipment and alternative instructions corresponding to each control function according to the type and brand information of the controlled equipment.
In this embodiment, when adding controlled devices to the intelligent device, the controlled devices may be identified by type and brand information, and for controlled devices of different brands and types, the control functions available when the intelligent device controls, and the control instructions of each control function are different.
For example, the intelligent device may be an intelligent sound box or the like, the controlled device may be a television, a refrigerator, an air conditioner or the like, the control function may be power on, power off, temperature adjustment, volume adjustment, wind power adjustment or the like, and the control instruction refers to an instruction used when the intelligent device executes the control function on the controlled device.
A control function information base can be maintained in the server device, and is used for storing all control functions of the controlled device corresponding to each brand and type of the intelligent sound box and alternative instructions corresponding to each control function.
In addition, the control function information base is also used for storing: and when the controlled equipment is added to the intelligent equipment, the control function to be added is corresponding to each brand and type. The control functions to be added are subsets of all control functions of controlled equipment corresponding to various brands and types.
After determining the type and brand information of the controlled device, the server device may obtain, according to the type and brand information of the controlled device, a corresponding control function to be added and an alternative instruction corresponding to each control function.
Step S102, the control processing of steps S103 to S106 is performed one by one for the candidate commands corresponding to each control function.
In this embodiment, each control function to be added may correspond to one or more candidate instructions, and after the control function to be added of the controlled device and the candidate instruction corresponding to each control function are obtained, the control processing in steps S103 to S106 is performed on each candidate instruction in sequence.
And step S103, sending the alternative instruction to the intelligent device, so that the intelligent device sends the alternative instruction to the controlled device, and the controlled device is controlled to execute a control function.
For each alternative instruction, the server device sends the alternative instruction to the intelligent device, and after receiving the alternative instruction, the intelligent device sends the alternative instruction to the controlled device to execute a corresponding control function on the controlled device.
If the intelligent device can successfully execute the corresponding control function on the controlled device through the alternative instruction, the controlled device can execute the alternative instruction after receiving the alternative instruction, and the effect corresponding to the control function is presented.
And step S104, acquiring video data of the controlled equipment shot in real time within a preset time length.
In this embodiment, the user terminal or the shooting device of the intelligent device can shoot the video data of the controlled device in real time.
After the alternative instruction is sent to the intelligent device, the server can acquire video data of the controlled device within a preset time length in real time.
The preset duration may be set by a technician according to actual needs, and in addition, for different controlled devices, the preset duration may be set to different values, which is not specifically limited in this embodiment.
And step S105, carrying out video analysis on the video data, and determining whether the control function of the controlled device is successfully executed.
The video analysis is carried out on the video data of the controlled equipment within the preset time length acquired in real time, whether the controlled equipment has the effect corresponding to the control function is analyzed, and whether the control function of the controlled equipment is executed successfully is determined.
After the alternative instruction is sent to the intelligent device, if the controlled device presents the effect corresponding to the control function within the preset time length, the control function of the controlled device can be determined to be successfully executed.
After the alternative instruction is sent to the intelligent device, if the controlled device does not present the effect corresponding to the control function within the preset time period, it may be determined that the control function of the controlled device is failed to be executed.
And step S106, if the control function of the controlled equipment is successfully executed, determining the alternative instruction as the control instruction of the control function.
If it is determined that the control function of the controlled device is successfully executed, the server device may determine the alternative instruction as the control instruction of the control function, so that the addition of the control function of the controlled device may be completed.
For example, the controlled device is a television, and after the intelligent device sends a correct power-on instruction to the television, the television executes the power-on instruction and is powered on, and the television presents a power-on picture and power-on sound when being powered on. If the television shows a startup picture and startup sound within a preset time after the server device sends the startup instruction to the intelligent device, the intelligent device can be determined to successfully control the television to be started up through the current startup instruction, and the current startup instruction is determined as a control instruction of the startup function of the television.
In this embodiment, the addition process of each control function of the controlled device is consistent, and the addition process of any one of the control functions is exemplarily described in this embodiment.
According to the embodiment of the invention, the control functions to be added of the controlled equipment and the alternative instructions corresponding to each control function are obtained according to the type and brand information of the controlled equipment; and performing the following control processing on the alternative instructions corresponding to each control function one by one: sending the alternative instruction to the intelligent device so that the intelligent device sends the alternative instruction to the controlled device to execute a control function on the controlled device; acquiring video data of controlled equipment shot in real time within a preset time length; performing video analysis on the video data to determine whether the control function of the controlled equipment is successfully executed; if the control function of the controlled equipment is successfully executed, the alternative instruction is determined as the control instruction of the control function, so that the addition of each control function of the controlled equipment can be automatically completed without manual operation of a user, the efficiency of adding the controlled equipment is improved, and the user experience is improved.
Example two
Fig. 2 is a flowchart of a method for adding a controlled device according to a second embodiment of the present invention. On the basis of the first embodiment, in this embodiment, the video data of the controlled device photographed in real time may be acquired; according to the video data of the controlled equipment, image recognition and voice recognition are carried out, and the type and brand information of the controlled equipment are determined, so that the type and brand information of the controlled equipment can be automatically recognized, and a user does not need to inquire and manually input the type and brand information.
As shown in fig. 2, the method comprises the following specific steps:
and step S201, acquiring video data of the controlled device shot in real time.
In this embodiment, when adding controlled device, the user sends the add device instruction to the user terminal where the APP is located through the software Application (APP) of the intelligent device, the APP starts the shooting device of the user terminal, and prompts the user to aim the shooting device at the controlled device to be added, so as to shoot the video data of the controlled device in real time through the shooting device of the user terminal, and send the video data shot in real time to the background server.
Accordingly, one possible implementation of this step is as follows:
and receiving video data of the controlled equipment, which is acquired and sent by a user terminal in real time, wherein the user terminal is the terminal equipment where the software application corresponding to the intelligent equipment is located, and the user terminal is used for shooting the controlled equipment.
In addition, if the intelligent equipment is provided with the shooting device, the APP of the intelligent equipment can also control the intelligent equipment to start the shooting device, prompt a user to aim the shooting device at the controlled equipment to be added, shoot the video data of the controlled equipment in real time and send the video data shot in real time to the background server.
Accordingly, another possible implementation of this step is as follows:
and receiving video data of the controlled equipment, which is acquired and sent by the intelligent equipment in real time, wherein the intelligent equipment is used for shooting the controlled equipment.
Step S202, image recognition and voice recognition are carried out according to the video data of the controlled equipment, and the type and brand information of the controlled equipment are determined.
In this embodiment, by performing image recognition and voice recognition on the video data of the controlled device, image information such as the appearance of the controlled device, the content displayed on the display screen, and sound information such as sound presented by the controlled device can be matched with image and sound information of each type of controlled device of each existing brand, so as to determine the type and brand information of the controlled device.
This step can be implemented in any way of performing image recognition and voice recognition by collecting the appearance, display screen, sound, and the like of the device in the prior art to determine the type and brand of the device, which is not described herein again.
Illustratively, if the type of the controlled device cannot be identified according to the video data of the controlled device, the user is prompted through the smart speaker that the type of the controlled device cannot be automatically identified, and the user is prompted to manually input the type of the controlled device through the APP of the smart device.
If according to the video data of controlled equipment, the brand information of controlled equipment can't be discerned, then through the brand information that intelligent audio amplifier suggestion user can't automatic identification controlled equipment, suggestion user passes through the APP manual input of intelligent equipment controlled equipment brand information.
The server device may also receive the type and/or brand information of the controlled device sent by the user terminal where the APP of the smart device is located.
Step S203, acquiring a control function of the controlled equipment according to the type and brand information of the controlled equipment.
In this embodiment, when adding controlled devices to the intelligent device, the controlled devices may be identified by type and brand information, and for controlled devices of different brands and types, the control functions available when the intelligent device controls, and the control instructions of each control function are different.
For example, the intelligent device may be an intelligent sound box or the like, the controlled device may be a television, a refrigerator, an air conditioner or the like, the control function may be power on, power off, temperature adjustment, volume adjustment, wind power adjustment or the like, and the control instruction refers to an instruction used when the intelligent device executes the control function on the controlled device.
A control function information base can be maintained in the server device, and is used for storing all control functions of the controlled device corresponding to each brand and type and alternative instructions corresponding to each control function of the intelligent device.
In addition, the control function information base is also used for storing: and when the controlled equipment is added to the intelligent equipment, the control function to be added is corresponding to each brand and type. The control functions to be added are subsets of all control functions of controlled equipment corresponding to various brands and types.
For example, the control function information base may store the control function to be added and its alternative instruction, corresponding to the type and brand information. When the control function to be added to the controlled device is acquired according to the type and the brand information of the controlled device, the control function to be added corresponding to the type and the brand information is acquired according to the type and the brand information of the controlled device.
Further, the control function to be added of the controlled device specified by the control function information base may be some basic control functions set in advance. The user can increase the control function to be added of the controlled device according to the requirement of the user.
Specifically, the user may send, to the server device, an increase instruction of the control function to be added to the controlled device through the smart device or the smart device APP, where the increase instruction includes the type and brand information of the controlled device, and the control function to be added. The server equipment receives an adding instruction of the control function to be added to the controlled equipment, and adds the control function to be added to the control function to be added corresponding to the type and brand information of the controlled equipment.
Optionally, the user may also send, to the server device, a deletion instruction for the control function to be added to the controlled device through the smart device or the smart device APP, where the deletion instruction includes the type and brand information of the controlled device and the control function to be deleted. And the server equipment receives a deletion instruction of the control function to be added to the controlled equipment, and deletes the control function to be deleted in the control function to be added corresponding to the type and brand information of the controlled equipment.
Optionally, the controlled device may be an infrared control device such as an air conditioner, a television, a set-top box, and the like, and the corresponding alternative instruction may be an infrared code.
When the intelligent device controls the controlled device through other communication modes, the alternative instruction may be another type of instruction corresponding to the communication mode, and this embodiment is not limited in detail here.
After determining the type and brand information of the controlled device, the server device may sequentially acquire one control function to be added of the controlled device according to the type and brand information of the controlled device, and perform the following addition processing of steps S204 to S211 on the current control function.
And step S204, acquiring an alternative instruction of the control function.
In this embodiment, each control function to be added of the controlled device may correspond to one or more alternative instructions.
And when adding processing is carried out on each control function, carrying out control processing of subsequent steps on each alternative instruction one by one.
And step S205, sending the alternative instruction to the intelligent device, so that the intelligent device sends the alternative instruction to the controlled device, and the controlled device is controlled to execute a control function.
For each alternative instruction, the server device sends the alternative instruction to the intelligent device, and after receiving the alternative instruction, the intelligent device sends the alternative instruction to the controlled device to execute a corresponding control function on the controlled device.
If the intelligent device can successfully execute the corresponding control function on the controlled device through the alternative instruction, the controlled device can execute the alternative instruction after receiving the alternative instruction, and the effect corresponding to the control function is presented.
And S206, acquiring video data of the controlled equipment shot in real time within a preset time length.
In this embodiment, the user terminal or the shooting device of the intelligent device can shoot the video data of the controlled device in real time.
After the alternative instruction is sent to the intelligent device, the server can acquire video data of the controlled device within a preset time length in real time.
The preset duration may be set by a technician according to actual needs, and in addition, for different controlled devices, the preset duration may be set to different values, which is not specifically limited in this embodiment.
Step S207, performing video analysis on the video data, and determining whether the control function of the controlled device is successfully executed.
The video analysis is carried out on the video data of the controlled equipment within the preset time length acquired in real time, whether the controlled equipment has the effect corresponding to the control function is analyzed, and whether the control function of the controlled equipment is executed successfully is determined.
After the alternative instruction is sent to the intelligent device, if the controlled device presents the effect corresponding to the control function within the preset time length, the control function of the controlled device can be determined to be successfully executed.
After the alternative instruction is sent to the intelligent device, if the controlled device does not present the effect corresponding to the control function within the preset time period, it may be determined that the control function of the controlled device is failed to be executed.
If it is determined that the execution of the control function of the controlled device is successful, after the candidate instruction is determined as the control instruction of the control function, step S208 is executed to stop performing the control processing on the remaining candidate instructions of the control function.
If the control function of the controlled device is determined to be unsuccessfully executed, the step S210 is continuously executed to determine whether an alternative instruction of the control function which has not been subjected to the control processing exists.
And step S208, if the control function of the controlled device is successfully executed, determining the alternative instruction as the control instruction of the control function.
If it is determined that the control function of the controlled device is successfully executed, the server device may determine the alternative instruction as the control instruction of the control function, so that the addition of the control function of the controlled device may be completed.
In this embodiment, if it is determined that the control function of the controlled device is successfully executed, after determining the alternative instruction as the control instruction of the control function, the remaining alternative instructions of the control function are no longer controlled; step S209 is continuously executed to determine whether or not there is a control function that has not been processed yet.
Step S209 determines whether or not there is a control function that has not yet been processed.
If there is a control function that has not been processed, step S203 is continuously executed to acquire the next control function, and the processing of the subsequent steps is performed on the next control function.
If there is no control function that has not yet been processed, it may be determined that the addition processing for all the control functions to be added has been completed, the addition of the controlled device is completed, and the process ends.
Step S210, if it is determined that the control function of the controlled device is not successfully executed, determining whether there is an alternative instruction of the control function that has not been subjected to the control processing.
If the judgment result in the step is as follows: if there is an alternative instruction of the control function that has not been subjected to the control processing, the step S204 is continuously executed to obtain the next alternative instruction of the air function, and the control processing is continuously performed on the next alternative instruction.
If the judgment result in the step is as follows: if there is no candidate instruction of the control function that has not been subjected to the control processing, it indicates that the smart device cannot execute the corresponding control function on the controlled device through all the candidate instructions of the control function, and then the step S211 is continuously executed to determine that the addition of the control function of the controlled device fails.
And step S211, if the alternative instruction of the control function which has not been subjected to the control processing does not exist, determining that the control function addition of the controlled equipment fails.
If there is no candidate instruction of the control function that has not been subjected to the control processing, it indicates that the smart device cannot execute the corresponding control function on the controlled device by all the candidate instructions of the control function, and determines that the addition of the control function of the controlled device has failed, and then continues to execute step S209 to determine whether to store the control function that has not been subjected to the control processing.
For example, the server device may further record a result of whether each control function is successfully added and a control instruction corresponding to each successfully added control function, and send the information to the user terminal where the intelligent device or the intelligent device APP is located, so that the intelligent device or the user terminal displays the information to the user.
The embodiment of the invention obtains the video data of the controlled equipment shot in real time; according to the video data of the controlled equipment, image recognition and voice recognition are carried out, the type and brand information of the controlled equipment are determined, the type and brand information of the controlled equipment can be automatically recognized, user operation is reduced, the efficiency of adding the controlled equipment is further improved, and user experience is improved.
EXAMPLE III
Fig. 3 is a schematic structural diagram of an apparatus for adding a controlled device according to a third embodiment of the present invention. The device for adding the controlled equipment provided by the embodiment of the invention can execute the processing flow provided by the method for adding the controlled equipment. As shown in fig. 3, the apparatus 30 for adding a controlled device includes: a control function and instruction management module 301 and an add control module 302.
Specifically, the control function and instruction management module 301 is configured to obtain, according to the type and brand information of the controlled device, a control function to be added by the controlled device and an alternative instruction corresponding to each control function.
The addition control module 302 is to:
and performing the following control processing on the alternative instructions corresponding to each control function one by one:
sending the alternative instruction to the intelligent device so that the intelligent device sends the alternative instruction to the controlled device to execute a control function on the controlled device; acquiring video data of controlled equipment shot in real time within a preset time length; performing video analysis on the video data to determine whether the control function of the controlled equipment is successfully executed; and if the control function of the controlled equipment is successfully executed, determining the alternative instruction as the control instruction of the control function.
The apparatus provided in the embodiment of the present invention may be specifically configured to execute the method embodiment provided in the first embodiment, and specific functions are not described herein again.
According to the embodiment of the invention, the control functions to be added of the controlled equipment and the alternative instructions corresponding to each control function are obtained according to the type and brand information of the controlled equipment; and performing the following control processing on the alternative instructions corresponding to each control function one by one: sending the alternative instruction to the intelligent device so that the intelligent device sends the alternative instruction to the controlled device to execute a control function on the controlled device; acquiring video data of controlled equipment shot in real time within a preset time length; performing video analysis on the video data to determine whether the control function of the controlled equipment is successfully executed; if the control function of the controlled equipment is successfully executed, the alternative instruction is determined as the control instruction of the control function, so that the addition of each control function of the controlled equipment can be automatically completed without manual operation of a user, the efficiency of adding the controlled equipment is improved, and the user experience is improved.
Example four
Fig. 4 is a schematic structural diagram of an apparatus for adding a controlled device according to a fourth embodiment of the present invention. On the basis of the third embodiment, as shown in fig. 4, in this embodiment, the apparatus 30 for adding a controlled device further includes: type and brand identification processing module 303.
Type and brand identification processing module 303 is configured to:
acquiring video data of controlled equipment shot in real time; and performing image recognition and voice recognition according to the video data of the controlled equipment, and determining the type and brand information of the controlled equipment.
Optionally, the type and brand identification processing module 303 is further configured to:
receiving video data of controlled equipment acquired and sent by a user terminal in real time, wherein the user terminal is terminal equipment where software application corresponding to intelligent equipment is located, and the user terminal is used for shooting the controlled equipment; or receiving video data of the controlled device, which is acquired and sent by the intelligent device in real time, wherein the intelligent device is used for shooting the controlled device.
Optionally, the adding control module is further configured to:
the remaining alternative instructions of the control function are no longer subject to control processing.
Optionally, the adding control module is further configured to:
if the control function of the controlled equipment is determined to be unsuccessfully executed, judging whether an alternative instruction of the control function which is not subjected to control processing exists; if the alternative instruction of the control function which is not subjected to the control processing exists, continuing to perform the control processing on the next alternative instruction; and if the alternative instruction of the control function which does not perform the control processing does not exist, determining that the control function addition of the controlled equipment fails.
Optionally, the control function and instruction management module is further configured to:
receiving an adding instruction of a control function to be added to the controlled equipment, wherein the adding instruction comprises the type and brand information of the controlled equipment and the control function to be added; and adding the control function to be added in the control function to be added corresponding to the type and brand information of the controlled equipment.
Optionally, the alternative instruction is an infrared code.
The apparatus provided in the embodiment of the present invention may be specifically configured to execute the method embodiment provided in the second embodiment, and specific functions are not described herein again.
The embodiment of the invention obtains the video data of the controlled equipment shot in real time; according to the video data of the controlled equipment, image recognition and voice recognition are carried out, the type and brand information of the controlled equipment are determined, the type and brand information of the controlled equipment can be automatically recognized, user operation is reduced, the efficiency of adding the controlled equipment is further improved, and user experience is improved.
EXAMPLE five
Fig. 5 is a schematic structural diagram of a server device according to a fifth embodiment of the present invention. As shown in fig. 5, the server apparatus 70 includes: a processor 701, a memory 702, and a computer program stored on the memory 702 and executable on the processor 701;
when the processor 701 runs the computer program, the method for adding the controlled device provided by any of the above method embodiments is implemented.
According to the embodiment of the invention, the control functions to be added of the controlled equipment and the alternative instructions corresponding to each control function are obtained according to the type and brand information of the controlled equipment; and performing the following control processing on the alternative instructions corresponding to each control function one by one: sending the alternative instruction to the intelligent device so that the intelligent device sends the alternative instruction to the controlled device to execute a control function on the controlled device; acquiring video data of controlled equipment shot in real time within a preset time length; performing video analysis on the video data to determine whether the control function of the controlled equipment is successfully executed; if the control function of the controlled equipment is successfully executed, the alternative instruction is determined as the control instruction of the control function, so that the addition of each control function of the controlled equipment can be automatically completed without manual operation of a user, the efficiency of adding the controlled equipment is improved, and the user experience is improved.
In addition, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the method for adding a controlled device provided in any of the above method embodiments is implemented.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
The integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions to enable a computer device (which may be a personal computer, a server, or a network device) or a processor (processor) to execute some steps of the methods according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
It is obvious to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be performed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to perform all or part of the above described functions. For the specific working process of the device described above, reference may be made to the corresponding process in the foregoing method embodiment, which is not described herein again.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.
Claims (10)
1. A method of adding a controlled device, comprising:
according to the type and brand information of controlled equipment, acquiring control functions to be added by the controlled equipment and alternative instructions corresponding to each control function;
and performing the following control processing on the alternative instructions corresponding to each control function one by one:
sending the alternative instruction to an intelligent device, so that the intelligent device sends the alternative instruction to the controlled device to execute the control function on the controlled device;
acquiring video data of the controlled equipment shot in real time within a preset time length;
performing video analysis on the video data to determine whether the control function of the controlled device is successfully executed;
and if the control function of the controlled equipment is successfully executed, determining the alternative instruction as the control instruction of the control function.
2. The method according to claim 1, wherein before the obtaining, according to the type and brand information of the controlled device, the control function to be added by the controlled device and the alternative instruction corresponding to each control function, further comprising:
acquiring video data of the controlled equipment shot in real time;
and performing image recognition and voice recognition according to the video data of the controlled equipment, and determining the type and brand information of the controlled equipment.
3. The method of claim 2, wherein the obtaining video data of the controlled device taken in real time comprises:
receiving video data of the controlled device, which is acquired and sent by a user terminal in real time, wherein the user terminal is a terminal device where a software application corresponding to the intelligent device is located, and the user terminal is used for shooting the controlled device;
or,
and receiving video data of the controlled device, which is acquired and sent by the intelligent device in real time, wherein the intelligent device is used for shooting the controlled device.
4. The method according to claim 1, wherein the determining the alternative instruction as the control instruction of the control function after determining that the control function of the controlled device is successfully executed further comprises:
the control process is no longer performed on the remaining alternative instructions of the control function.
5. The method of claim 4, wherein after performing video analysis on the video data to determine whether the control function of the controlled device is successfully executed, further comprising:
if the control function of the controlled equipment is determined to be unsuccessfully executed, judging whether an alternative instruction of the control function which is not subjected to the control processing exists or not;
if the alternative instruction of the control function which has not been subjected to the control processing exists, continuing to perform the control processing on the next alternative instruction;
and if the alternative instruction of the control function which does not perform the control processing does not exist, determining that the control function addition of the controlled equipment fails.
6. The method according to any one of claims 1 to 5, further comprising:
receiving an adding instruction of a control function to be added to the controlled equipment, wherein the adding instruction comprises the type and brand information of the controlled equipment and the control function to be added;
and adding the control function to be added in the control function to be added corresponding to the type and the brand information of the controlled equipment.
7. The method of any of claims 1 to 5, wherein the alternative instruction is an infrared code.
8. An apparatus for adding a controlled device, comprising:
the control function and instruction management module is used for acquiring control functions to be added by the controlled equipment and alternative instructions corresponding to each control function according to the type and brand information of the controlled equipment;
an add control module to:
and performing the following control processing on the alternative instructions corresponding to each control function one by one:
sending the alternative instruction to an intelligent device, so that the intelligent device sends the alternative instruction to the controlled device to execute the control function on the controlled device;
acquiring video data of the controlled equipment shot in real time within a preset time length;
performing video analysis on the video data to determine whether the control function of the controlled device is successfully executed;
and if the control function of the controlled equipment is successfully executed, determining the alternative instruction as the control instruction of the control function.
9. A server device, comprising:
a processor, a memory, and a computer program stored on the memory and executable on the processor;
wherein the processor, when executing the computer program, implements the method of any of claims 1 to 7.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910538718.9A CN110276942A (en) | 2019-06-20 | 2019-06-20 | Add method, apparatus, equipment and the readable storage medium storing program for executing of controlled device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910538718.9A CN110276942A (en) | 2019-06-20 | 2019-06-20 | Add method, apparatus, equipment and the readable storage medium storing program for executing of controlled device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110276942A true CN110276942A (en) | 2019-09-24 |
Family
ID=67962330
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910538718.9A Pending CN110276942A (en) | 2019-06-20 | 2019-06-20 | Add method, apparatus, equipment and the readable storage medium storing program for executing of controlled device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110276942A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111246268A (en) * | 2020-02-06 | 2020-06-05 | 深圳创维－Rgb电子有限公司 | Pairing method of infrared devices, television and storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103596000A (en) * | 2013-11-22 | 2014-02-19 | 乐视致新电子科技（天津）有限公司 | Method and system for multi-interface switching test of smart television |
| CN104574927A (en) * | 2014-12-14 | 2015-04-29 | 杭州赫智电子科技有限公司 | Infrared matching method and infrared matching system with feedback function |
| CN204497489U (en) * | 2015-01-15 | 2015-07-22 | 大连交通大学 | Intelligent cloud insert row |
| CN106302562A (en) * | 2015-05-12 | 2017-01-04 | 上海瑛世得信息科技有限公司 | The tele-control system of household electrical appliances and control method thereof |
| CN106911949A (en) * | 2015-12-23 | 2017-06-30 | 北京奇虎科技有限公司 | A kind of method and mobile terminal based on mobile terminal control apparatus equipment |
| US20170326725A1 (en) * | 2013-06-07 | 2017-11-16 | Pixart Imaging Inc. | Remote control system for pointing robot |
| CN108307147A (en) * | 2017-12-28 | 2018-07-20 | 天地融科技股份有限公司 | A kind of method and system carrying out security control using safety equipment |
| CN109088804A (en) * | 2018-09-28 | 2018-12-25 | 南宁学院 | A kind of home appliance repair maloperation early warning system being associated with Bluetooth AP P |
| CN109725543A (en) * | 2018-12-25 | 2019-05-07 | 深圳绿米联创科技有限公司 | Equipment control code configuration method, device, Cloud Server and network system |
-
2019
- 2019-06-20 CN CN201910538718.9A patent/CN110276942A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170326725A1 (en) * | 2013-06-07 | 2017-11-16 | Pixart Imaging Inc. | Remote control system for pointing robot |
| CN103596000A (en) * | 2013-11-22 | 2014-02-19 | 乐视致新电子科技（天津）有限公司 | Method and system for multi-interface switching test of smart television |
| CN104574927A (en) * | 2014-12-14 | 2015-04-29 | 杭州赫智电子科技有限公司 | Infrared matching method and infrared matching system with feedback function |
| CN204497489U (en) * | 2015-01-15 | 2015-07-22 | 大连交通大学 | Intelligent cloud insert row |
| CN106302562A (en) * | 2015-05-12 | 2017-01-04 | 上海瑛世得信息科技有限公司 | The tele-control system of household electrical appliances and control method thereof |
| CN106911949A (en) * | 2015-12-23 | 2017-06-30 | 北京奇虎科技有限公司 | A kind of method and mobile terminal based on mobile terminal control apparatus equipment |
| CN108307147A (en) * | 2017-12-28 | 2018-07-20 | 天地融科技股份有限公司 | A kind of method and system carrying out security control using safety equipment |
| CN109088804A (en) * | 2018-09-28 | 2018-12-25 | 南宁学院 | A kind of home appliance repair maloperation early warning system being associated with Bluetooth AP P |
| CN109725543A (en) * | 2018-12-25 | 2019-05-07 | 深圳绿米联创科技有限公司 | Equipment control code configuration method, device, Cloud Server and network system |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111246268A (en) * | 2020-02-06 | 2020-06-05 | 深圳创维－Rgb电子有限公司 | Pairing method of infrared devices, television and storage medium |
| CN111246268B (en) * | 2020-02-06 | 2022-02-15 | 深圳创维－Rgb电子有限公司 | Pairing method of infrared devices, television and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3792913A1 (en) | Auxiliary speech control method and device and air conditioner | |
| CN104635543B (en) | It is managed the method and apparatus of operation | |
| CN104918109A (en) | Intelligent playing method and device | |
| CN104978957A (en) | Voice control method and system based on voiceprint identification | |
| CN109243448A (en) | Voice control method and device | |
| US11852357B2 (en) | Method for controlling air conditioner, air conditioner | |
| CN113572669B (en) | Scene processing method and device, intelligent gateway and processor | |
| CN107742520B (en) | Voice control method, device and system | |
| CN117255211A (en) | Live broadcast room display method, server side and live broadcast client side | |
| CN110276942A (en) | Add method, apparatus, equipment and the readable storage medium storing program for executing of controlled device | |
| CN111953572A (en) | Control method and device of intelligent service equipment | |
| CN108959889A (en) | A kind of Accreditation System and method of intelligent appliance | |
| CN110661888B (en) | Voice control method and device for household appliance and readable storage medium | |
| CN110361978B (en) | Intelligent equipment control method, device and system based on Internet of things operating system | |
| CN104079635A (en) | Updating method and system for screen protection pictures | |
| CN108366297B (en) | Method and device for following terminal information and smart television | |
| CN110701737A (en) | Air conditioner temperature compensation setting method, computer device and computer readable storage medium | |
| CN109539495B (en) | Control method, air conditioning apparatus, and storage medium | |
| CN112312166B (en) | Content monitoring method, device and system for television media, storage medium and electronic equipment | |
| CN108632662B (en) | Television screen capturing method and device and equipment comprising television screen capturing device | |
| CN108196817B (en) | Audio recognition method, device and storage medium | |
| CN110691256B (en) | Video associated information processing method and device, server and storage medium | |
| CN109410933B (en) | Device control method and apparatus, storage medium, and electronic apparatus | |
| CN106657837B (en) | Television system switching method and television | |
| CN113300920A (en) | Intelligent household appliance control method and control equipment based on household appliance control group |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210518 Address after: 100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing Applicant after: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd. Applicant after: Shanghai Xiaodu Technology Co.,Ltd. Address before: 100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing Applicant before: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190924 |