CN107817701B - Equipment control method and device, computer readable storage medium and terminal - Google Patents
Equipment control method and device, computer readable storage medium and terminal Download PDFInfo
- Publication number
- CN107817701B CN107817701B CN201710853346.XA CN201710853346A CN107817701B CN 107817701 B CN107817701 B CN 107817701B CN 201710853346 A CN201710853346 A CN 201710853346A CN 107817701 B CN107817701 B CN 107817701B
- Authority
- CN
- China
- Prior art keywords
- equipment
- control
- operation interface
- user
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
Abstract
The invention provides a device control method, a device, a computer readable storage medium and a terminal. The equipment control method comprises the following steps: giving an equipment operation interface of the equipment according to received equipment basic information, wherein the equipment basic information comprises an equipment image, an equipment model, an equipment ID number, a bar code of the equipment and/or a two-dimensional code of the equipment; and receiving a voice instruction of a user through the equipment operation interface, and controlling the equipment according to the received voice instruction of the user. The technical scheme provided by the invention solves the limitation that a user can not leave the remote controller, avoids the complicated key pressing process when operating the remote controller, easily realizes the operation and control of the equipment through voice control, vividly and intuitively displays the control and running states of the equipment, and has good user experience.
Description
Technical Field
The invention relates to the technical field of electric appliances, in particular to a device control method, a device, a computer readable storage medium and a terminal.
Background
The household and office electrical equipment brings great convenience to the life of people, but at present, the household and office equipment (such as an air conditioner, a refrigerator, a television, a washing machine, an electric fan and the like) still adopts modes of manual control, remote controller control, mobile phone APP control and the like. These control methods are all performed through manual key pressing, for example, the key pressing process when the control device operates the remote controller is complicated, many complex instructions can be realized only by the composite key pressing of the remote controller, and the user experience is poor. The problem to be solved at present is to develop a more convenient and intuitive equipment control mode.
Disclosure of Invention
The present invention is directed to overcome the above-mentioned drawbacks of the prior art, and provides a device control method, an apparatus, a computer-readable storage medium, and a terminal, so as to solve the problem of a complicated device control method in the prior art.
One aspect of the present invention provides an apparatus control method, including: giving an equipment operation interface of the equipment according to received equipment basic information, wherein the equipment basic information comprises an equipment image, an equipment model, an equipment ID number, a bar code of the equipment and/or a two-dimensional code of the equipment; and receiving a voice instruction of a user through the equipment operation interface, and controlling the equipment according to the received voice instruction of the user.
Optionally, the method further comprises: and when the equipment is controlled according to the received voice instruction of the user, demonstrating the control process on the equipment operation interface.
Optionally, the providing an equipment operation interface of the equipment according to the received basic information of the equipment includes: pre-storing the basic information of the equipment and an equipment operation interface corresponding to the basic information of the equipment; and responding to the received basic equipment information, matching the received basic equipment information with the prestored basic equipment information, and giving an equipment operation interface corresponding to the basic equipment information if the matching is successful.
Optionally, the receiving a voice instruction of a user, and controlling the device according to the received voice instruction of the user includes: receiving a voice instruction of a user, performing voice recognition on the received voice instruction of the user, and recognizing the voice instruction of the user as a control instruction; and controlling the equipment according to the identified control instruction.
Optionally, the process of controlling is demonstrated on the device operation interface, and the process includes: the control instruction and a corresponding device control process demonstration model are stored in advance; and when the equipment is controlled according to the identified control instruction, matching the identified control instruction with the prestored control instruction, if the matching is successful, giving an equipment control process demonstration model corresponding to the control instruction, and demonstrating the controlled process on the equipment operation interface according to the equipment control process demonstration model.
Optionally, the device operation interface includes a device model interface and/or a remote controller model interface.
Optionally, constructing the device operation interface by using the AR.
Alternatively, the device basic information is received by inputting in an input box, selecting in a drop-down menu or a selection box, voice input, or image recognition.
Optionally, the method further comprises: the device is an air conditioner.
Another aspect of the present invention provides an apparatus control device, including: the demonstration unit is used for giving an equipment operation interface of the equipment according to received equipment basic information, wherein the equipment basic information comprises an equipment image, an equipment model, an equipment ID number, a bar code of the equipment and/or a two-dimensional code of the equipment; a voice control unit to: and receiving a voice instruction of a user through the equipment operation interface, and controlling the equipment according to the received voice instruction of the user.
Optionally, the presentation unit is further configured to: and when the equipment is controlled according to the received voice instruction of the user, demonstrating the control process on the equipment operation interface.
Optionally, the presentation unit is further configured to: pre-storing the basic information of the equipment and an equipment operation interface corresponding to the basic information of the equipment; and responding to the received basic equipment information, matching the received basic equipment information with the prestored basic equipment information, and giving an equipment operation interface corresponding to the basic equipment information if the matching is successful.
Optionally, the voice control unit is further configured to: receiving a voice instruction of a user, performing voice recognition on the received voice instruction of the user, and recognizing the voice instruction of the user as a control instruction; and controlling the equipment according to the identified control instruction.
Optionally, the presentation unit is further configured to: the control instruction and a corresponding device control process demonstration model are stored in advance; and when the equipment is controlled according to the identified control instruction, matching the identified control instruction with the prestored control instruction, if the matching is successful, giving an equipment control process demonstration model corresponding to the control instruction, and demonstrating the controlled process on the equipment operation interface according to the equipment control process demonstration model.
Optionally, the device operation interface includes a device model interface and/or a remote controller model interface.
Optionally, the system further comprises an AR constructing unit, configured to construct the device operation interface by applying AR.
Optionally, an information receiving unit is further included for receiving the device basic information by inputting in an input box, selecting in a drop-down menu or a selection box, voice inputting, or image recognition.
Optionally, the method further comprises: the device is an air conditioner.
The invention further provides a terminal with any one of the above devices.
Optionally, the terminal comprises a mobile phone or a computer.
Yet another aspect of the present invention provides a computer readable storage medium having a computer program stored thereon, which when executed by a processor, performs the steps of any of the methods described above.
Yet another aspect of the present invention provides a terminal comprising a processor, a memory, and a computer program stored on the memory and operable on the processor, the processor implementing the steps of any of the methods described above when executing the program.
Optionally, the terminal comprises a mobile phone or a computer.
The technical scheme provided by the invention solves the limitation that a user can not leave the remote controller, avoids the complicated key pressing process when operating the remote controller, easily realizes the operation and control of the equipment through voice control, vividly and intuitively displays the control and running states of the equipment, and has good user experience.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is an overall block diagram of an apparatus control method provided by the present invention;
FIG. 2 is a flow chart of the operation of a preferred embodiment of the apparatus control method provided by the present invention;
FIG. 3 is a flowchart of a device operation interface of the device control method provided by the present invention;
FIG. 4 is a work flow diagram of voice control of the device control method provided by the present invention;
FIG. 5 is a workflow diagram of a process of demonstration control of the apparatus control method provided by the present invention;
FIG. 6 is a network deployment and workflow diagram of a preferred embodiment of the device control method provided by the present invention;
FIG. 7 is an overall block diagram of an apparatus control device provided by the present invention;
fig. 8 is a schematic structural diagram of a preferred embodiment of the device control apparatus provided in the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the specific embodiments of the present invention and the accompanying drawings. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The invention provides a device control method. Fig. 1 is an overall block diagram of an apparatus control method provided by the present invention. As shown in fig. 1, the apparatus control method of the present invention includes: step S110, an equipment operation interface of the equipment is given according to received equipment basic information, wherein the equipment basic information comprises an equipment image, an equipment model, an equipment ID number, a bar code of the equipment and/or a two-dimensional code of the equipment; and step S120, receiving a voice instruction of a user through the equipment operation interface, and controlling the equipment according to the received voice instruction of the user.
Fig. 2 is a flowchart of the operation of a preferred embodiment of the device control method provided by the present invention. As shown in fig. 2, according to an embodiment of the device control method of the present invention, after step S120, step S130 is further included, and when the device is controlled according to the received voice instruction of the user, the process of the control is demonstrated on the device operation interface.
According to an embodiment of the device control method of the present invention, the method further includes constructing the device operation interface by using an AR (Augmented Reality technology). The augmented reality technology is a new technology for seamlessly integrating real world information and virtual world information, and is characterized in that entity information (visual information, sound, taste, touch and the like) which is difficult to experience in a certain time space range of the real world originally is overlapped after simulation through scientific technologies such as computers and the like, virtual information is applied to the real world, real environment and virtual objects are overlapped to the same picture or space in real time and exist at the same time and are perceived by human senses, and therefore sensory experience beyond reality is achieved. The AR technology is applied to construct the equipment operation interface, so that a consumer can intuitively feel the 3D appearance of the equipment and visually display the controlled process, and synchronously present the corresponding state of the equipment or the states of keys, display and the like of the remote controller in the control process through the AR model of the equipment or the remote controller of the equipment.
On the one hand, the augmented reality technology is a technology for calculating the position and the angle of a camera image in real time and adding corresponding images, videos and 3D simulation, and the aim of the technology is to sleeve a virtual world on a screen in the real world and interact with the virtual world. The augmented reality technology comprises new technologies and new means such as multimedia, three-dimensional modeling, real-time video display and control, multi-sensor fusion, real-time tracking and registration, scene fusion and the like. AR has three prominent features: integrating real world and virtual information; real-time interactivity is achieved; is to add the positioning virtual object in the three-dimensional scale space.
On the other hand, the speech recognition technology is a high and new technology for converting a speech signal into a corresponding command through recognition and analysis by a machine, and mainly comprises three aspects of a feature extraction technology, a pattern matching criterion and a model training technology. The voice recognition technology is widely applied to the Internet and the smart home industry, such as voice air conditioners, voice televisions, mobile phone apps and the like.
The technical scheme of the invention combines the AR technology and the voice control, a user does not need to press keys when controlling the equipment, the control is easily finished through voice, and meanwhile, the user can visually see the state or animation effect synchronously presented by the AR model through the AR technology, so that the user can feel the real effect achieved by the control, the limitation that the user cannot leave the remote controller is solved, and the equipment can be easily controlled by a simple voice instruction.
According to one embodiment of the apparatus control method of the present invention, the apparatus is an air conditioner. The common household appliances such as the air conditioner are complicated and uninteresting to operate by using the remote controller, and by applying the technical scheme of the invention, flexible interaction is increased by the AR model while voice control is simple and easy, and user experience is improved.
Fig. 3 is a flowchart of a device operation interface of the device control method according to the present invention. As shown in fig. 3, according to an embodiment of the device control method of the present invention, the providing a device operation interface of the device according to the received device basic information includes: step S210, pre-storing the basic information of the equipment and an equipment operation interface corresponding to the basic information of the equipment; step S220, responding to the received basic information of the equipment, matching the received basic information of the equipment with the basic information of the equipment stored in advance, and if the matching is successful, giving an equipment operation interface corresponding to the matching. The pre-stored basic device information and the corresponding device operation interface can be stored in a background server or a local computer or a mobile phone APP. For example: shooting a real object (such as an air conditioner) of equipment through a mobile phone APP, if information needing to be matched is stored in a background server, uploading a shot real object picture of the air conditioner to the background server, matching the shot real object picture of the air conditioner with pre-stored basic information of the equipment, and acquiring an AR equipment operation interface corresponding to the air conditioner model if matching is successful.
Specifically, in the following description, the devices are all described by taking an air conditioner as an example, scanning is performed on a real air conditioner by using an AR technology, the identified air conditioner appearance is compared with appearance templates of all air conditioners connected with a router in a current local area network in the scanning process, the air conditioner template with the highest similarity is taken out and an ID number is returned, and meanwhile, a virtual 3D air conditioner model corresponding to the ID number is displayed on an intelligent terminal (such as a mobile phone, a tablet and the like).
Fig. 4 is a work flow diagram of voice control of the device control method provided by the present invention. As shown in fig. 4, according to an embodiment of the device control method of the present invention, the receiving a voice instruction of a user, and controlling the device according to the received voice instruction of the user includes: step S310, receiving a voice instruction of a user, performing voice recognition on the received voice instruction of the user, and recognizing the voice instruction of the user as a control instruction; and step S320, controlling the equipment according to the identified control instruction. Specifically, when a virtual 3D air conditioner model is displayed on a display screen of an intelligent terminal (such as a mobile phone, a tablet and the like), a voice recognition function is immediately awakened, and the air conditioner is controlled through voice.
Fig. 5 is a flowchart of a procedure of demonstration control of the apparatus control method provided by the present invention. As shown in fig. 5, according to an embodiment of the device control method of the present invention, the process of the control is demonstrated on the device operation interface, which includes: step S410, pre-storing the control instruction and a corresponding device control process demonstration model; step S420, when the equipment is controlled according to the identified control instruction, matching the identified control instruction with the prestored control instruction, if the matching is successful, giving an equipment control process demonstration model corresponding to the control instruction, and demonstrating the control process on the equipment operation interface according to the equipment control process demonstration model.
Specifically, the interaction of the virtual 3D air conditioner model and the real air conditioner is realized with a voice recognition function. While the user is dictating the voice command, the virtual model presents a state of being monitored (such as a state of listening to animation or dynamic emission of signals by the lateral ears); and after the real air conditioner executes the command, the air conditioner model synchronously presents the corresponding state or animation effect.
Fig. 6 is a network deployment and workflow diagram of a preferred embodiment of the device control method provided by the present invention. The specific flow of the embodiment shown in fig. 6 is as follows:
and connecting the routers. A user intelligent terminal (such as a mobile phone and a tablet) is connected with WiFi, and an air conditioner is connected with a router by using the WiFi distribution network technology.
② scanning and matching to return model ID. And opening an APP scanning page, and scanning the real air conditioner by utilizing the AR augmented reality technology. And acquiring ID numbers of all air conditioners connected under the current router through the server, and inquiring a corresponding group of air conditioner appearance template feature codes in the local storage of the intelligent terminal or the server through the inquired group of ID numbers. And extracting the real air conditioner image feature codes in the scanning process, comparing the real air conditioner image feature codes with the air conditioner appearance template feature codes one by one, selecting the air conditioner template with the highest similarity, and returning the ID number of the air conditioner template. The ID number includes, but is not limited to, brand number, model number, project number, and the like.
In the above steps, the template feature codes corresponding to all air conditioners connected under the current router are firstly inquired, so as to narrow the scope of the template library, reduce the false recognition and make the inquiry more accurate.
And thirdly, generating a model by the AR and activating the voice recognition function. After the ID number is received, a virtual 3D air conditioner model corresponding to the ID number is generated on an intelligent terminal (such as a mobile phone, a tablet and the like), and meanwhile, a voice recognition function is activated.
And fourthly, voice instruction. The user sends a voice control instruction to the air-conditioning model at the page facing the intelligent terminal, such as instructions of 'starting up', 'left-right wind sweeping freeze frame 1' and the like facing the model. While the user is dictating the voice command, the virtual model assumes a listening state (e.g., a side-ear listening animation or a dynamic signal emanation).
And (6) wireless signal communication. The intelligent terminal recognizes the voice command as a control command and then sends the control command to the real air conditioner in the form of a wireless signal through the wireless device.
Sixthly, executing the instruction. After receiving the wireless signal, the wireless device in the air conditioner sends a control command to the main control board to execute the command. And after the real equipment executes the command, the air conditioner model synchronously presents corresponding states or animation effects.
According to one embodiment of the device control method of the present invention, the device operation interface includes a device model interface and/or a remote controller model interface.
In the above embodiment shown in fig. 6, the device operation interface is a virtual 3D air conditioner model, which is an example of the device operation interface including a device model interface. In another case, the specific flow of the embodiment in which the device operation interface includes a remote controller model interface is as follows:
1. and connecting the user intelligent terminal with WiFi, and connecting the air conditioner with the router by using a WiFi distribution network technology.
2. And opening an APP scanning page, scanning the real air conditioner by utilizing an AR augmented reality technology, comparing the currently identified air conditioner appearance with appearance templates of all air conditioners connected with a router in the current local area network in the scanning process, taking out the air conditioner template with the highest similarity and returning an ID number.
3. After the ID number is returned, a virtual 3D air conditioner model corresponding to the ID number is generated on the intelligent terminal (such as a mobile phone, a tablet and the like), and meanwhile, a virtual remote controller is generated.
4. Pressing a 'startup key' on the virtual remote controller, executing a startup command by the real air conditioner, and synchronously presenting a startup state by the virtual model; and (3) adjusting the virtual remote control to 'refrigeration 17 degrees', executing the instruction by the real air conditioner, adjusting the mode to a refrigeration mode, adjusting the temperature to 17 degrees, and synchronously presenting the corresponding state by the virtual model.
According to one embodiment of the device control method, the device basic information is received by inputting in an input box, selecting in a drop-down menu or a selection box, voice inputting, or image recognition. In this embodiment, the user may select a convenient way to input the device basic information via a computer or a mobile phone APP. The device model number, device ID number may also be input by entering in an input box, selecting in a drop-down menu or selection box, voice input, or the like.
In another aspect, the invention provides a device control apparatus. Fig. 7 is an overall block diagram of the device control apparatus provided by the present invention. As shown in fig. 7, the apparatus control device of the present invention includes: the demonstration unit 100 is used for giving an equipment operation interface of the equipment according to received equipment basic information, wherein the equipment basic information comprises an equipment image, an equipment model, an equipment ID number, a bar code of the equipment and/or a two-dimensional code of the equipment; and the voice control unit 200 is configured to receive a voice instruction of a user, and control the device according to the received voice instruction of the user.
According to an embodiment of the device control apparatus of the present invention, the presentation unit 100 is further configured to: and when the equipment is controlled according to the received voice instruction of the user, demonstrating the control process on the equipment operation interface.
According to an embodiment of the device control apparatus of the present invention, the presentation unit 100 is further configured to: pre-storing the basic information of the equipment and an equipment operation interface corresponding to the basic information of the equipment; and responding to the received basic equipment information, matching the received basic equipment information with the prestored basic equipment information, and giving an equipment operation interface corresponding to the basic equipment information if the matching is successful.
According to an embodiment of the device control apparatus of the present invention, the voice control unit 200 is further configured to: receiving a voice instruction of a user, performing voice recognition on the received voice instruction of the user, and recognizing the voice instruction of the user as a control instruction; and controlling the equipment according to the identified control instruction.
According to an embodiment of the device control apparatus of the present invention, the presentation unit 100 is further configured to: the control instruction and a corresponding device control process demonstration model are stored in advance; and when the equipment is controlled according to the identified control instruction, matching the identified control instruction with the prestored control instruction, if the matching is successful, giving an equipment control process demonstration model corresponding to the control instruction, and demonstrating the controlled process on the equipment operation interface according to the equipment control process demonstration model.
According to one embodiment of the device control apparatus of the present invention, the device operation interface includes a device model interface and/or a remote controller model interface.
Fig. 8 is a schematic structural diagram of a preferred embodiment of the device control apparatus provided in the present invention. As shown in fig. 8, an embodiment of the device control apparatus according to the present invention further includes an AR constructing unit 300, configured to construct the device operation interface by using AR.
An embodiment of the device control apparatus according to the present invention further comprises an information receiving unit 400 for receiving the device basic information by inputting in an input box, selecting in a pull-down menu or a selection box, voice inputting, or image recognition.
According to an embodiment of the device control apparatus of the present invention, further comprising: the device is an air conditioner.
The invention further provides a terminal with any one of the above devices. According to an embodiment of the terminal of the present invention, the terminal includes a mobile phone or a computer.
Yet another aspect of the present invention provides a computer readable storage medium having a computer program stored thereon, which when executed by a processor, performs the steps of any of the methods described above.
Yet another aspect of the present invention provides a terminal comprising a processor, a memory, and a computer program stored on the memory and operable on the processor, the processor implementing the steps of any of the methods described above when executing the program. According to an embodiment of the terminal of the present invention, the terminal includes a mobile phone or a computer.
The technical scheme provided by the invention solves the limitation that a user can not leave the remote controller, avoids the complicated key pressing process when operating the remote controller, easily realizes the operation and control of the equipment through voice control, vividly and intuitively displays the control and running states of the equipment, and has good user experience.
The functions described herein may be implemented in hardware, software executed by a processor, firmware, or any combination thereof. If implemented in software executed by a processor, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Other examples and implementations are within the scope and spirit of the invention and the following claims. For example, due to the nature of software, the functions described above may be implemented using software executed by a processor, hardware, firmware, hardwired, or a combination of any of these. In addition, each functional unit may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts serving as control devices may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The above description is only an example of the present invention, and is not intended to limit the present invention, and it is obvious to those skilled in the art that various modifications and variations can be made in the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the scope of the claims of the present invention.
Claims (19)
1. An apparatus control method characterized by comprising:
giving an equipment operation interface of the equipment according to received equipment basic information, wherein the equipment basic information comprises an equipment image, an equipment model, an equipment ID number, a bar code of the equipment and/or a two-dimensional code of the equipment;
receiving a voice instruction of a user through the equipment operation interface, and controlling the equipment according to the received voice instruction of the user;
synchronously demonstrating the control process through an equipment control process demonstration model on the equipment operation interface when the equipment is controlled according to the received voice instruction of the user;
demonstrating the process of controlling at the device operator interface, comprising:
pre-storing a control instruction and a device control process demonstration model corresponding to the control instruction;
and when the equipment is controlled according to the identified control instruction, matching the identified control instruction with the prestored control instruction, if the matching is successful, giving an equipment control process demonstration model corresponding to the control instruction, and demonstrating the control process on the equipment operation interface according to the equipment control process demonstration model.
2. The method according to claim 1, wherein the presenting the device operation interface of the device according to the received device basic information comprises:
pre-storing the basic information of the equipment and an equipment operation interface corresponding to the basic information of the equipment;
and responding to the received basic equipment information, matching the received basic equipment information with the prestored basic equipment information, and giving an equipment operation interface corresponding to the basic equipment information if the matching is successful.
3. The method according to any one of claims 1-2, wherein the receiving a user's voice command, controlling the device according to the received user's voice command, comprises:
receiving a voice instruction of a user, performing voice recognition on the received voice instruction of the user, and recognizing the voice instruction of the user as a control instruction;
and controlling the equipment according to the identified control instruction.
4. The method of claim 1, wherein the device operation interface comprises a device model interface and/or a remote control model interface.
5. The method of claim 1, further comprising constructing the device operation interface using AR.
6. The method of claim 1, wherein the device basis information is received by inputting in an input box, selecting in a drop-down menu or selection box, voice input, or image recognition.
7. The method of claim 1, further comprising: the device is an air conditioner.
8. An apparatus control device, characterized by comprising:
the demonstration unit is used for giving an equipment operation interface of the equipment according to received equipment basic information, wherein the equipment basic information comprises an equipment image, an equipment model, an equipment ID number, a bar code of the equipment and/or a two-dimensional code of the equipment;
a voice control unit to: receiving a voice instruction of a user through the equipment operation interface, and controlling the equipment according to the received voice instruction of the user;
the presentation unit is further configured to: synchronously demonstrating the control process through an equipment control process demonstration model on the equipment operation interface when the equipment is controlled according to the received voice instruction of the user;
the presentation unit is further configured to:
pre-storing a control instruction and a device control process demonstration model corresponding to the control instruction;
and when the equipment is controlled according to the identified control instruction, matching the identified control instruction with the prestored control instruction, if the matching is successful, giving an equipment control process demonstration model corresponding to the control instruction, and demonstrating the control process on the equipment operation interface according to the equipment control process demonstration model.
9. The apparatus of claim 8, wherein the presentation unit is further configured to:
pre-storing the basic information of the equipment and an equipment operation interface corresponding to the basic information of the equipment;
and responding to the received basic equipment information, matching the received basic equipment information with the prestored basic equipment information, and giving an equipment operation interface corresponding to the basic equipment information if the matching is successful.
10. The apparatus according to any of claims 8-9, wherein the voice control unit is further configured to:
receiving a voice instruction of a user, performing voice recognition on the received voice instruction of the user, and recognizing the voice instruction of the user as a control instruction;
and controlling the equipment according to the identified control instruction.
11. The apparatus of claim 8, wherein the device operation interface comprises a device model interface and/or a remote control model interface.
12. The apparatus of claim 8, further comprising an AR construction unit for constructing the device operation interface by applying AR.
13. The apparatus of claim 8, further comprising an information receiving unit for receiving the device basic information by inputting in an input box, selecting in a drop-down menu or a selection box, voice inputting, or image recognition.
14. The apparatus of claim 8, further comprising: the device is an air conditioner.
15. A terminal, characterized in that it has a device according to any of claims 8-14.
16. The terminal of claim 15, wherein the terminal comprises a mobile phone or a computer.
17. A terminal comprising a processor, a memory, and a computer program stored on the memory and operable on the processor, the processor implementing the steps of the method of any of claims 1 to 7 when executing the program.
18. The terminal of claim 17, wherein the terminal comprises a mobile phone or a computer.
19. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710853346.XA CN107817701B (en) | 2017-09-20 | 2017-09-20 | Equipment control method and device, computer readable storage medium and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710853346.XA CN107817701B (en) | 2017-09-20 | 2017-09-20 | Equipment control method and device, computer readable storage medium and terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107817701A CN107817701A (en) | 2018-03-20 |
| CN107817701B true CN107817701B (en) | 2020-09-29 |
Family
ID=61607769
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710853346.XA Active CN107817701B (en) | 2017-09-20 | 2017-09-20 | Equipment control method and device, computer readable storage medium and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107817701B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108683707B (en) * | 2018-04-12 | 2021-08-10 | 珠海奔图电子有限公司 | Network connection control method, network connection control terminal and system |
| CN108665897B (en) * | 2018-06-26 | 2020-09-15 | 珠海格力电器股份有限公司 | Electric appliance control method and device, storage medium and server |
| CN109905299A (en) * | 2019-02-18 | 2019-06-18 | 珠海格力电器股份有限公司 | A kind of control method and electronic equipment of household appliance |
| CN112911190A (en) * | 2019-12-04 | 2021-06-04 | 华为技术有限公司 | Remote assistance method, electronic equipment and system |
| CN113220202B (en) * | 2021-05-31 | 2023-08-11 | 中国联合网络通信集团有限公司 | Control method and device for Internet of things equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7657289B1 (en) * | 2004-12-03 | 2010-02-02 | Mark Levy | Synthesized voice production |
| CN105117004A (en) * | 2015-08-13 | 2015-12-02 | 小米科技有限责任公司 | Method and device for showing working state of equipment |
| CN106569409A (en) * | 2016-10-13 | 2017-04-19 | 杭州鸿雁电器有限公司 | Graph capturing based household equipment control system, device and method |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100538616C (en) * | 2006-11-10 | 2009-09-09 | 海尔集团公司 | Refrigerator with cartoon display operations |
| CN102692881A (en) * | 2012-05-16 | 2012-09-26 | 中国海洋大学 | Household appliance control method and control system based on two-dimension code |
| US9338493B2 (en) * | 2014-06-30 | 2016-05-10 | Apple Inc. | Intelligent automated assistant for TV user interactions |
| CN106328143A (en) * | 2015-06-23 | 2017-01-11 | 中兴通讯股份有限公司 | Voice control method and device and mobile terminal |
| CN105116734A (en) * | 2015-06-26 | 2015-12-02 | 青岛海信移动通信技术股份有限公司 | Control device and device for intelligent household electrical appliance and control terminal |
| CN105371279A (en) * | 2015-12-15 | 2016-03-02 | 威海鲁源科技环保设备有限公司 | Computer control system of cremation machine |
| CN106921789B (en) * | 2015-12-25 | 2019-07-26 | 美的集团股份有限公司 | Household appliance controlling system, method and household electrical appliance based on mobile terminal |
| CN105915418A (en) * | 2016-05-23 | 2016-08-31 | 珠海格力电器股份有限公司 | Method and device for controlling household appliance |
| CN106120242A (en) * | 2016-07-29 | 2016-11-16 | 无锡飞翎电子有限公司 | Washing machine and control device and control method |
| CN106445156A (en) * | 2016-09-29 | 2017-02-22 | 宇龙计算机通信科技(深圳)有限公司 | Method, device and terminal for intelligent home device control based on virtual reality |
| CN106789456A (en) * | 2016-11-25 | 2017-05-31 | 宇龙计算机通信科技(深圳)有限公司 | A kind of home equipment control method and device |
-
2017
- 2017-09-20 CN CN201710853346.XA patent/CN107817701B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7657289B1 (en) * | 2004-12-03 | 2010-02-02 | Mark Levy | Synthesized voice production |
| CN105117004A (en) * | 2015-08-13 | 2015-12-02 | 小米科技有限责任公司 | Method and device for showing working state of equipment |
| CN106569409A (en) * | 2016-10-13 | 2017-04-19 | 杭州鸿雁电器有限公司 | Graph capturing based household equipment control system, device and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107817701A (en) | 2018-03-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107817701B (en) | Equipment control method and device, computer readable storage medium and terminal | |
| CN107703872B (en) | Terminal control method and device of household appliance and terminal | |
| CN107340853B (en) | Remote presentation interaction method and system based on virtual reality and gesture recognition | |
| CN105471705B (en) | Intelligent control method, equipment and system based on instant messaging | |
| WO2016026247A1 (en) | Method and device for implementing intelligent mirror, intelligent mirror, and storage medium | |
| CN108038726B (en) | Article display method and device | |
| CN108604254A (en) | The closed caption of voice control is shown | |
| EP3090424A1 (en) | Assigning virtual user interface to physical object | |
| CN106648098B (en) | AR projection method and system for user-defined scene | |
| CN104396282A (en) | Configuration interface for a programmable multimedia controller | |
| CN102577250B (en) | Device for interaction with an augmented object | |
| CN104731441A (en) | Information processing method and electronic devices | |
| CN112068752B (en) | Space display method and device, electronic equipment and storage medium | |
| CN108919653B (en) | Method and device for searching home equipment | |
| CN103281580A (en) | Television set remote control method for separating user interface and system thereof | |
| CN107818490A (en) | Equipment choosing guidance method, device, computer-readable recording medium and terminal | |
| CN105933730A (en) | Video association information recommendation method and device | |
| KR20170024480A (en) | Display device and universal remote controller setting method thereof | |
| CN104835059A (en) | Somatosensory interaction technology-based intelligent advertisement delivery system | |
| CN104301661A (en) | Intelligent household monitoring method and client and related devices | |
| CN104038782A (en) | Interactive system and method of live-program-related content of smart television | |
| CN109147056A (en) | A kind of electric control method, device, storage medium and mobile terminal | |
| US20160048311A1 (en) | Augmented reality context sensitive control system | |
| CN108769261B (en) | Multi-screen interaction system, method and interaction screen equipment | |
| CN114465838A (en) | Display device, intelligent home system and multi-screen control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |