CN108614494B - Equipment control method, device, equipment and storage medium - Google Patents

Equipment control method, device, equipment and storage medium Download PDF

Info

Publication number
CN108614494B
CN108614494B CN201810612028.9A CN201810612028A CN108614494B CN 108614494 B CN108614494 B CN 108614494B CN 201810612028 A CN201810612028 A CN 201810612028A CN 108614494 B CN108614494 B CN 108614494B
Authority
CN
China
Prior art keywords
control
equipment
control function
execution
function
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810612028.9A
Other languages
Chinese (zh)
Other versions
CN108614494A (en
Inventor
许超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mobvoi Innovation Technology Co Ltd
Original Assignee
Mobvoi Innovation Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mobvoi Innovation Technology Co Ltd filed Critical Mobvoi Innovation Technology Co Ltd
Priority to CN201810612028.9A priority Critical patent/CN108614494B/en
Publication of CN108614494A publication Critical patent/CN108614494A/en
Application granted granted Critical
Publication of CN108614494B publication Critical patent/CN108614494B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/04Programme control other than numerical control, i.e. in sequence controllers or logic controllers
    • G05B19/042Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
    • G05B19/0423Input/output
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/20Pc systems
    • G05B2219/25Pc structure of the system
    • G05B2219/25257Microcontroller

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Selective Calling Equipment (AREA)

Abstract

The embodiment of the invention discloses a control method, a control device, equipment and a storage medium of the equipment, wherein the control method of the equipment comprises the steps of detecting control operation executed aiming at the control equipment, acquiring a first control function matched with the control operation, and mapping the first control function to a second control function matched with execution equipment, wherein the control equipment is not matched with the execution equipment; and generating a control instruction corresponding to the second control function and providing the control instruction to the execution equipment, wherein the control instruction is used for controlling the execution equipment to execute the second control function. The embodiment of the invention can enable the control device to realize the execution device with unmatched control operation, and can avoid the use limitation of a single control device of the execution device.

Description

Equipment control method, device, equipment and storage medium
Technical Field
The embodiment of the invention relates to the technical field of equipment control, in particular to an equipment control method, an equipment control device, equipment and a storage medium.
Background
With the rapid development of intelligent devices, various types of control devices are increasing. Generally, each intelligent device corresponds to a control device matched with the intelligent device, the control device inputs the state which the intelligent device expected to correspond to through the control platform, such as the temperature of an air conditioner is expected to rise/fall, the up-down wind sweeping/the left-right wind sweeping, or the volume of the intelligent television is expected to be large/small, the channel is adjusted, and therefore the control platform generates a control command according to the state, the control command is sent to the corresponding intelligent device, and the intelligent device executes the corresponding control command to change the state of the intelligent device.
However, each control device is matched with one corresponding intelligent device, which limits the use of the intelligent device, and for example, when the control device is lost, for example, a remote controller for controlling an air conditioner is lost, how to control the action of the intelligent device through the alternative control device is a difficulty in the field of device control.
Disclosure of Invention
Embodiments of the present invention provide a device control method, an apparatus, a device, and a readable storage medium, which can implement a control device to control an action of an execution device that is not matched with the control device, and can avoid a use limitation of a single control device of the execution device.
In a first aspect, an embodiment of the present invention provides a device control method, including:
detecting a control operation executed aiming at an operation control device, and acquiring a first control function matched with the control operation;
mapping the first control function to a second control function that matches an execution device, wherein the manipulation device does not match the execution device;
and generating a control instruction corresponding to the second control function and providing the control instruction to the execution equipment, wherein the control instruction is used for controlling the execution equipment to execute the second control function.
In a second aspect, an embodiment of the present invention further provides an apparatus for operating and controlling a device, including:
the first control function acquisition module is used for detecting control operation executed aiming at the control equipment and acquiring a first control function matched with the control operation;
a second control function mapping module, configured to map the first control function to a second control function that matches an execution device, where the manipulation device does not match the execution device;
and the control instruction generating module is used for generating a control instruction corresponding to the second control function and providing the control instruction to the execution equipment, and the control instruction is used for controlling the execution equipment to execute the second control function.
In a third aspect, an embodiment of the present invention further provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the method according to any embodiment of the present invention.
In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method according to any embodiment of the present invention.
According to the device control method provided by the embodiment of the invention, the control operation executed by the control device is detected, the first control function matched with the control operation is obtained, and the first control function is mapped to the second control function matched with the execution device, wherein the control device is not matched with the execution device; and generating a control instruction corresponding to the second control function and providing the control instruction to the execution equipment, wherein the control instruction is used for controlling the execution equipment to execute the second control function. The embodiment of the invention can enable the control device to realize the execution device with unmatched control operation, and can avoid the use limitation of a single control device of the execution device.
Drawings
Fig. 1 is a flowchart of a method for operating a device according to a first embodiment of the present invention;
fig. 2a is a flowchart of a method for operating a device according to a second embodiment of the present invention;
FIG. 2b is a flowchart of a method for acquiring a first control function according to a second embodiment of the present invention;
fig. 3 is a flowchart of a method for operating a device according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of an operating device of an apparatus according to a fourth embodiment of the present invention;
fig. 5 is a schematic structural diagram of a computer device according to a fifth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some but not all of the relevant aspects of the present invention are shown in the drawings.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Example one
Fig. 1 is a flowchart of a device control method according to an embodiment of the present invention, where the embodiment is applicable to a scenario where an execution device that is not matched with the control device performs operation control on the execution device, and the method may be executed by a control apparatus of the device, where the apparatus may be implemented by software and/or hardware, and may be generally integrated in a computer device. The method of the embodiment specifically comprises the following steps:
step 110, detecting a control operation executed for the control device, and acquiring a first control function matched with the control operation.
The detection can be accomplished by means of a third-party tool, such as a camera shooting a control operation executed by the control device, or a connection between the control device and the execution device is established through a hardware line, such as a universal adapter, a bidirectional USB interface, and the like. For example, the control device may be a remote controller, and the first control function matched with the control operation may be that the control device performs a control operation of volume + or volume-, channel + or channel-, and the like.
Step 120, mapping the first control function to a second control function matched with an execution device, wherein the control device is not matched with the execution device.
Wherein the execution device includes: the smart television, control equipment includes: and other remote controllers which are not matched with the intelligent television.
For example, if the control device and the execution device are connected through the bidirectional USB interface, the execution device may set a function conversion module matching with the control operation of the control device, and the module may convert a first control function of the control device into a second control function matching with the execution device. For example, in an intelligent home, the intelligent television is controlled and operated by the air conditioner remote controller, that is, the air conditioner remote controller is converted into a remote controller which can be used by the intelligent television, the air conditioner remote controller and the intelligent television can be connected by the USB, and the control function of the air conditioner remote controller is converted into the control function of the intelligent television by the function conversion module arranged in the intelligent television, for example, the temperature + of the air conditioner remote controller is converted into the volume + of the intelligent television, and the volume-of the air conditioner remote controller is converted into the volume-of the intelligent.
For example, a camera may be arranged on the execution device, the camera captures a control operation of the control device, and the camera or a built-in processor of the execution device learns the control operation and maps the control operation to the control operation corresponding to the execution device. For example, taking the smart home described in the above embodiment as an example, a camera may be disposed on the smart television, and the camera may monitor and learn the behavior of the user, for example, the user holds a piece of paper written with a "+" sign and presses the "+" sign, and the camera learns the behavior of the user pressing the "+" sign, and maps the behavior to the "volume +" operation of the smart television, and stores the "volume +" operation. When the camera detects the action of pressing the '+' by the user again, the volume of the current playing program of the intelligent television is automatically adjusted.
It can be understood that, in an intelligent home, a user usually wants to control all home appliances through one remote controller, and the remote controller in the prior art usually needs to set a plurality of function menus, such as a smart television, an air conditioner, a refrigerator, a washing machine, and the like. And through the mapping of the remote controller, the first control function of the remote controller is mapped to the second control function matched with the execution equipment, so that the remote controller can be converted into a universal remote controller, complicated function options are not required to be set, a user can randomly adjust the volume of the intelligent television, switch channels and the like in the using process, and other intelligent equipment, such as an air conditioner, a refrigerator and the like, can also be randomly adjusted and controlled.
And step 130, generating a control instruction corresponding to the second control function and providing the control instruction to the execution device, where the control instruction is used to control the execution device to execute the second control function.
The control instruction is generated by the execution equipment processor and controls the execution equipment to execute a control function corresponding to the control instruction. When the execution device receives that the mapping of the first control function of the control device is the second control function of the execution device, the execution device may determine the mapping behavior, that is, whether the second control function mapped to the execution device matches with the preset control function stored in the execution device, and if the matching is successful, generate a control instruction corresponding to the second control function and provide the control instruction to the execution device. It is understood that, if the second control function mapped to the execution device by the first control function is matched with the preset control function stored in the execution device, a similarity algorithm may be used to perform a matching measure, such as cosine similarity.
According to the device control method provided by the embodiment of the invention, the control operation executed by the control device is detected, the first control function matched with the control operation is obtained, and the first control function is mapped to the second control function matched with the execution device, wherein the control device is not matched with the execution device; and generating a control instruction corresponding to the second control function and providing the control instruction to the execution equipment, wherein the control instruction is used for controlling the execution equipment to execute the second control function. The embodiment of the invention can enable the control device to realize the execution device with unmatched control operation, and can avoid the use limitation of a single control device of the execution device.
Example two
Fig. 2a is a flowchart of a device control method according to a second embodiment of the present invention, where the embodiment is optimized based on the above-mentioned embodiment, in this embodiment, a control operation performed on a control device is detected, and a first control function matched with the control operation is obtained, which is specifically optimized as follows: detecting a control operation executed for an operation control device, and acquiring a first control function matched with the control operation, wherein the control operation is specifically optimized as follows: when the execution equipment is determined to meet the switching control condition, detecting control operation executed aiming at the control equipment, and acquiring a first control function matched with the control operation. Wherein the handover control conditions include: the execution equipment is in a working state, and/or the execution equipment runs a set application program; the setting application program comprises: a video file playing application, an audio file playing application, a picture browsing application, or a document browsing application.
Correspondingly, the control operation executed by the control device is detected, and the first control function matched with the control operation is obtained, which is further specifically optimized as follows: and monitoring the pressing operation of a user on the set physical key in the control equipment through a camera, and taking the key function corresponding to the pressed physical key as the first control function.
Accordingly, as shown in fig. 2a, the method of this embodiment includes:
step 210, when it is determined that the execution device meets the switching control condition, detecting a control operation executed for the control device, and acquiring a first control function matched with the control operation.
Wherein the handover control conditions include: the execution equipment is in a working state, and/or the execution equipment runs a set application program; the setting application program comprises: a video file playing application, an audio file playing application, a picture browsing application, or a document browsing application.
It can be understood that the control operation for the setting application program includes volume adjustment of the video file, video switching; adjusting the volume of the audio file and switching the audio; switching pictures of the picture browsing application; or a switching of document browsing applications such as a previous page, a next page, or a left page, a right page, etc.
And step 220, monitoring the pressing operation of the user on the set physical key in the control equipment through the camera, and taking the key function corresponding to the pressed physical key as the first control function.
For example, taking the case that the execution device is an intelligent television and the control device is a remote controller of an ordinary television that is not matched with the intelligent television as an example, the intelligent television needs to be in a power-on state or in a situation that a television program is running, and the volume of the intelligent television or video switching can be adjusted through the remote controller of the ordinary television. The remote controller of the common television is in contact with the common television through infrared communication, the existing smart television is usually remotely controlled through radio frequency RF communication, an RF receiving circuit needs to be arranged, MCU codes in the smart television are rewritten to be matched with an RF channel for decoding, or the combination of the RF communication and the infrared communication is adopted for remote control, a receiver needs to be arranged, and RF control instructions are translated into infrared instructions in the smart television in the receiver and then forwarded to the smart television for remote control. Therefore, the remote control setting of the intelligent television is complex, the remote controller is expensive, and when the remote controller is lost or damaged, the common remote controller can avoid resource waste due to the functional similarity with the remote controller of the intelligent television, and the user experience is better.
Taking remote controllers of an intelligent television and a common television as an example, the set physical key may be any key on the common television, such as "volume +", and the pressing operation of the user on the set physical key in the control device is monitored by the camera. Optionally, a picture characteristic of pressing a function key by a finger, such as a picture characteristic of ' volume + pressed by the finger ', may be pre-stored in the smart television, and when the user holds the ' volume + picture and performs a pressing operation, the camera acquires the picture characteristic, and a behavior characteristic of ' volume + pressed by the finger ' of the user may also be identified; or the angle of the remote controller is adjusted, so that the camera shoots the action of pressing the volume plus of the common remote controller by the user and the volume plus key, and the behavior characteristic of pressing the volume plus by the finger of the user can be identified.
Optionally, fig. 2b is a flowchart of a method for acquiring a first control function according to a second embodiment of the present invention, where the method is further optimized in step 220, that is, a camera monitors a pressing operation performed by a user on a set physical key in the control device, and takes a key function corresponding to the pressed physical key as the first control function, and the method is specifically optimized as follows: detecting a pressing action of a user pressing the control equipment through a plurality of video frames captured by a camera; if the pressing action is detected, identifying the pressed physical key in the plurality of video frames according to the pressing position of the pressing action; and acquiring a key function corresponding to the pressed physical key as the first control function according to the corresponding relation between the keys and the functions of the control equipment.
Accordingly, as shown in fig. 2b, the method steps of the first control function acquisition are as follows:
and 221, detecting the pressing action of the user pressing the control equipment through a plurality of video frames captured by the camera.
The user's finger pressing action can be recognized by processing a plurality of video frames through a video processing or image processing method, such as a human body posture estimation method.
Step 222, if the pressing action is detected, identifying the pressed physical key in the plurality of video frames according to the pressing position of the pressing action.
The video frame where the action of pressing the physical key by the finger is located may be utilized to search for the previous frame or frames associated with the video frame, and then the pressed physical key may be identified according to an image processing method, such as a feature point matching method.
And 223, acquiring a key function corresponding to the pressed physical key as the first control function according to the corresponding relationship between the keys and the functions of the control device.
For example, if the key is "volume +", the corresponding function is to turn up the volume, and the first control function is to turn up the volume.
In the method for acquiring the first control function provided by this embodiment, the first control function is determined by detecting the pressing action of the user, searching for the key in the video frame matched with the pressing action based on the pressing action, and identifying the key function. The embodiment can accurately determine the key function and realize the quick mapping of the key function.
Step 230, mapping the first control function to a second control function matched with an execution device, wherein the control device is not matched with the execution device.
And 240, generating a control instruction corresponding to the second control function and providing the control instruction to the execution device, wherein the control instruction is used for controlling the execution device to execute the second control function.
According to the device control method provided by the embodiment of the invention, the pressing operation executed by a user on a set physical key in the control device is monitored through the camera, the key function corresponding to the pressed physical key is used as the first control function, the first control function is mapped to the second control function matched with the execution device, the control instruction corresponding to the second control function is generated and provided for the execution device, and the control device is not matched with the execution device. In the embodiment, the control operation of the physical key of the user is monitored through the camera, so that the control operation of the control equipment can be realized by the execution equipment which is not matched with the control operation, and the use limitation of the single control equipment of the execution equipment can be avoided.
EXAMPLE III
Fig. 3 is a flowchart of a device control method according to an embodiment of the present invention, where the embodiment is optimized based on the above embodiment, in this embodiment, a control operation performed on a control device is detected, and a first control function matched with the control operation is obtained, which is specifically optimized as follows: monitoring the selection operation of a user on a set touch position in a touch screen of the control equipment through a camera or a monitoring program built in the control equipment; and determining that the screen function triggered by the user selection is used as the first control function according to the current display content of the control equipment and the touch position.
Accordingly, as shown in fig. 3, the steps of this embodiment include:
and 310, when the execution equipment is determined to meet the switching control condition, detecting a control operation executed by the control equipment, and acquiring a first control function matched with the control operation.
Wherein the handover control conditions include: the execution equipment is in a working state, and/or the execution equipment runs a set application program; the setting application program comprises: a video file playing application, an audio file playing application, a picture browsing application, or a document browsing application.
And step 320, monitoring the selection operation of the user on the set touch position in the touch screen of the control equipment through a camera or a monitoring program built in the control equipment.
The control operation of the touch screen by the user is monitored, and the monitoring can be performed by a camera, such as the above embodiment. Monitoring can also be performed through a monitoring program in the touch equipment. For example, if near field communication NFC chips are set in both the manipulation device and the execution device, a monitoring program in the manipulation device may be set on the NFC chip of the manipulation device, and when a user presses the touch screen, the monitoring program of the NFC chip of the manipulation device is started to send an operation of pressing the touch screen by the user to the NFC chip of the execution device, and at this time, the execution device may obtain an operation characteristic of pressing the touch screen by the user.
Step 330, determining a screen function triggered by the user selection as the first control function according to the current display content of the control device and the touch position.
The touch screen of the control device senses a touch action of a user and displays current content on the touch screen when the user touches the control device. For example, a remote controller is touched, and the touch-screen remote controller is not matched with the smart television. When the touch screen remote controller is started, the touch screen remote controller displays keys related to functions of the remote controller, such as a volume adjusting key and a channel switching key, and the touch screen remote controller senses the touch position of a user by touching the keys, so that a control function corresponding to the touch position is acquired as a first control function.
Step 340, mapping the first control function to a second control function matched with an execution device, wherein the control device is not matched with the execution device.
And 350, generating a control instruction corresponding to the second control function and providing the control instruction to the execution equipment, wherein the control instruction is used for controlling the execution equipment to execute the second control function.
According to the device control method provided by the embodiment of the invention, through a camera or a monitoring program built in the control device, selection operation of a user on a set touch position in a touch screen of the control device is monitored, according to the current display content of the control device and the touch position, a screen function triggered by user selection is determined to be used as a first control function, the first control function is mapped to a second control function matched with an execution device, a control instruction corresponding to the second control function is generated and provided for the execution device, and the control device is not matched with the execution device. The embodiment can enrich monitoring and identification modes of the touch screen in the control equipment, thereby realizing the control operation of the control equipment with the touch screen and the execution equipment unmatched with the control operation, and avoiding the use limitation of the single control equipment of the execution equipment.
It is understood that the permutation and combination between the various embodiments of the present invention also fall into the protection scope of the present invention.
Example four
Fig. 4 is a schematic structural diagram of an apparatus for controlling a device according to an embodiment of the present invention, and as shown in fig. 4, the apparatus includes a first control function module 410, a second control function mapping module 420, and a control instruction generating module 430, where:
a first control function obtaining module 410, configured to detect a control operation performed on a control device, and obtain a first control function matching the control operation;
a second control function mapping module 420 for mapping the first control function to a second control function that matches an execution device, wherein the manipulation device does not match the execution device;
a control instruction generating module 430, configured to generate a control instruction corresponding to the second control function and provide the control instruction to the execution device, where the control instruction is used to control the execution device to execute the second control function.
According to the control device of the equipment provided by the embodiment of the invention, the control operation executed by the control equipment is detected, the first control function matched with the control operation is obtained, and the first control function is mapped to the second control function matched with the execution equipment, wherein the control equipment is not matched with the execution equipment; and generating a control instruction corresponding to the second control function and providing the control instruction to the execution equipment, wherein the control instruction is used for controlling the execution equipment to execute the second control function. The embodiment of the invention can enable the control device to realize the execution device with unmatched control operation, and can avoid the use limitation of a single control device of the execution device.
Further, the first control function obtaining module includes:
and the first control function pressing acquisition submodule is used for monitoring pressing operation executed by a user on a set physical key in the control equipment through a camera and taking a key function corresponding to the pressed physical key as the first control function.
Further, the first control function obtaining module includes:
the touch selection operation monitoring submodule is used for monitoring the selection operation of a user on a set touch position in a touch screen of the control equipment through a camera or a monitoring program built in the control equipment;
and the first control function touch acquisition submodule is used for determining a screen function selected and triggered by a user as the first control function according to the current display content of the control equipment and the touch position.
Further, the first control function pressing obtaining sub-module further specifically includes:
the pressing action detection unit is used for detecting the pressing action of a user pressing the control equipment through a plurality of video frames captured by the camera;
a physical key identification unit configured to identify the pressed physical key in the plurality of video frames according to a pressed position of the pressing action if the pressing action is detected;
and the first control function pressing and acquiring unit is used for acquiring a key function corresponding to the pressed physical key as the first control function according to the corresponding relation between the keys and the functions of the control equipment.
Further, the first control function obtaining module is specifically configured to:
when the execution equipment is determined to meet the switching control condition, detecting control operation executed aiming at the control equipment, and acquiring a first control function matched with the control operation.
Further, on the basis of the foregoing embodiments, the handover control condition includes: the execution equipment is in a working state, and/or the execution equipment runs a set application program;
the setting application program comprises: a video file playing application, an audio file playing application, a picture browsing application, or a document browsing application.
Further, on the basis of the foregoing embodiments, the execution device includes: the smart television, control equipment includes: and other remote controllers which are not matched with the intelligent television.
Since the above-described control device of the device is a device capable of executing the control method of the device in the embodiment of the present invention, based on the control method of the device described in the embodiment of the present invention, a person skilled in the art can understand a specific implementation manner of the control device of the device in the basic embodiment and various variations thereof, so that a detailed description of how the control device of the device implements the control method of the device in the embodiment of the present invention is not provided here. The present invention is not limited to the embodiments described above, and various modifications and changes can be made without departing from the scope of the present invention.
EXAMPLE five
Fig. 5 is a schematic structural diagram of an apparatus according to a fifth embodiment of the present invention, as shown in fig. 5, the apparatus includes a processor 510, a memory 520, and a bus 530, the number of the processors 510 in the apparatus may be one or more, and one processor 510 is taken as an example in fig. 5; the processor 510 and the memory 520 in the device may be connected by means of a bus 530.
The memory 520 is a computer-readable storage medium, and can be used for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the control method of the device in the embodiment of the present invention (for example, the first control function acquiring module 410, the second control function mapping module 420, and the control instruction generating module 430 in the control apparatus of the device). The processor 510 executes various functional applications and data processing of the device by executing software programs, instructions and modules stored in the memory 520, that is, implements the above-described method for operating the device.
The memory 520 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 520 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, memory 520 may further include memory located remotely from processor 510, which may be connected to devices through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The device may further comprise input means and output means, wherein the input means may be arranged to receive entered numerical or character information and to generate key signal inputs relating to user settings and function control of the device. The output device may include a display device such as a display screen.
EXAMPLE six
An embodiment of the present invention further provides a storage medium containing computer-executable instructions, which when executed by a computer processor, perform a method for operating a device, the method including:
detecting a control operation executed aiming at an operation control device, and acquiring a first control function matched with the control operation;
mapping the first control function to a second control function that matches an execution device, wherein the manipulation device does not match the execution device;
and generating a control instruction corresponding to the second control function and providing the control instruction to the execution equipment, wherein the control instruction is used for controlling the execution equipment to execute the second control function.
Of course, the storage medium provided by the embodiment of the present invention contains computer-executable instructions, and the computer-executable instructions are not limited to the method operations described above, and may also perform related operations in the method for operating and controlling the device provided by any embodiment of the present invention.
From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods according to the embodiments of the present invention.
It should be noted that, in the embodiment of the control device of the above-mentioned apparatus, the included units and modules are merely divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be realized; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims (7)

1. A method of operating a device, comprising:
detecting a control operation executed aiming at an operation control device, and acquiring a first control function matched with the control operation;
the detecting is directed at the control operation that control equipment carried out, and obtains the first control function that matches with the control operation, includes:
monitoring pressing operation of a user on a set physical key in the control equipment through a camera, and detecting pressing action of the user on the control equipment;
if the pressing action is detected, identifying a pressed physical key in a plurality of video frames according to the pressing position of the pressing action;
acquiring a key function corresponding to the pressed physical key as the first control function according to the corresponding relation between the keys and the functions of the control equipment;
mapping the first control function to a second control function that matches an execution device, wherein the manipulation device does not match the execution device;
and generating a control instruction corresponding to the second control function and providing the control instruction to the execution equipment, wherein the control instruction is used for controlling the execution equipment to execute the second control function.
2. The method according to claim 1, wherein detecting a control operation performed for a manipulation device and acquiring a first control function matching the control operation comprises:
when the execution equipment is determined to meet the switching control condition, detecting control operation executed aiming at the control equipment, and acquiring a first control function matched with the control operation.
3. The method of claim 2, wherein the handover control condition comprises: the execution equipment is in a working state, and/or the execution equipment runs a set application program;
the setting application program comprises: a video file playing application, an audio file playing application, a picture browsing application, or a document browsing application.
4. A method according to any one of claims 1-3, characterized in that:
the execution device includes: the smart television, control equipment includes: and other remote controllers which are not matched with the intelligent television.
5. An apparatus control device, comprising:
the first control function acquisition module is used for detecting control operation executed aiming at the control equipment and acquiring a first control function matched with the control operation;
the first control function obtaining module specifically includes:
the pressing action detection unit is used for monitoring pressing operation executed by a user on a set physical key in the control equipment through a camera and detecting the pressing action of the user on pressing the control equipment;
a physical key identification unit for identifying a pressed physical key in a plurality of video frames according to a pressed position of the pressing action if the pressing action is detected;
a first control function pressing obtaining unit, configured to obtain, according to a correspondence between keys and functions of the control device, a key function corresponding to the pressed physical key as the first control function;
a second control function mapping module, configured to map the first control function to a second control function that matches an execution device, where the manipulation device does not match the execution device;
and the control instruction generating module is used for generating a control instruction corresponding to the second control function and providing the control instruction to the execution equipment, and the control instruction is used for controlling the execution equipment to execute the second control function.
6. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the method of any one of claims 1 to 4 when executing the program.
7. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method according to any one of claims 1-4.
CN201810612028.9A 2018-06-14 2018-06-14 Equipment control method, device, equipment and storage medium Active CN108614494B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810612028.9A CN108614494B (en) 2018-06-14 2018-06-14 Equipment control method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810612028.9A CN108614494B (en) 2018-06-14 2018-06-14 Equipment control method, device, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN108614494A CN108614494A (en) 2018-10-02
CN108614494B true CN108614494B (en) 2021-06-04

Family

ID=63665146

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810612028.9A Active CN108614494B (en) 2018-06-14 2018-06-14 Equipment control method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN108614494B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114363384B (en) * 2021-12-22 2023-04-07 珠海格力电器股份有限公司 Device pointing control method, device, system, electronic device and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004110074A2 (en) * 2003-06-05 2004-12-16 Nds Limited System for transmitting information from a streamed program to external devices and media
CN104570863A (en) * 2014-12-19 2015-04-29 广东九联科技股份有限公司 Position indication device for set top box remote control

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102008046493B4 (en) * 2008-09-09 2010-07-29 Fm Marketing Gmbh Multimedia arrangement with a programmable universal remote control
CN101504728B (en) * 2008-10-10 2013-01-23 深圳泰山在线科技有限公司 Remote control system and method of electronic equipment
CN101436344A (en) * 2008-12-16 2009-05-20 刘红敏 Intelligent universal remote controller system
US20110310050A1 (en) * 2010-06-16 2011-12-22 Holy Stone Enterprise Co., Ltd. Dual-view display operating method
CN102455985A (en) * 2010-10-22 2012-05-16 幻音科技(深圳)有限公司 Mode conversion device, terminal and control method of terminal
CN102857806A (en) * 2011-06-27 2013-01-02 联想(北京)有限公司 Leaning method between remote controllers, set-top box and intelligent television
CN102610084A (en) * 2012-03-07 2012-07-25 四川长虹电器股份有限公司 Universal remote controller implementing method
CN102932695B (en) * 2012-11-02 2016-03-30 华为技术有限公司 A kind of remote control thereof, intelligent terminal and intelligent remote control system
US9188965B2 (en) * 2013-03-06 2015-11-17 Arris Technology, Inc. Control device including a protocol translator
CN103905872A (en) * 2014-03-27 2014-07-02 青岛海信宽带多媒体技术有限公司 Method and device for controlling multi-device system
CN106920384A (en) * 2015-12-24 2017-07-04 阿里巴巴集团控股有限公司 The method and apparatus that intelligent electronic device is adapted to remote control
CN108132744B (en) * 2017-12-14 2020-11-13 亮风台(上海)信息科技有限公司 Method and equipment for remotely controlling intelligent equipment

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004110074A2 (en) * 2003-06-05 2004-12-16 Nds Limited System for transmitting information from a streamed program to external devices and media
CN104570863A (en) * 2014-12-19 2015-04-29 广东九联科技股份有限公司 Position indication device for set top box remote control

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于方向直方图的家居环境手势遥控方法研究;史存英等;《自动化仪表》;20171120;第39卷(第12期);27-31 *

Also Published As

Publication number Publication date
CN108614494A (en) 2018-10-02

Similar Documents

Publication Publication Date Title
CN109074819B (en) Operation-sound based preferred control method for multi-mode command and electronic device using the same
US20090285443A1 (en) Remote Control Based on Image Recognition
WO2017071093A1 (en) Electronic device control method and apparatus
RU2609101C2 (en) Touch control assembly, device control method, controller and electronic device
US20150139025A1 (en) Wireless Network Configuration Method and System for Smart Appliance
CN108833222B (en) Household appliance control method, household appliance control device, remote controller, terminal, server and medium
CN108563175B (en) Display interface display method and device, control equipment and readable storage medium
CN105182815A (en) Equipment control method and equipment control device
EP3016377B1 (en) Display apparatus, controlling method and display system
CN107870674B (en) Program starting method and mobile terminal
US11935398B1 (en) Electronic apparatus, remote control apparatus, control method thereof, and electronic system
US10507382B2 (en) Method for controlling set-top box game, remote control system, and handheld electronic apparatus
CN108734939B (en) Electronic equipment control method and device, electronic equipment and readable storage medium
CN105446607A (en) Camera touch shooting method and touch terminal thereof
US10198337B2 (en) Apparatus and method for controlling external device
CN104866226A (en) Terminal device and method for controlling same
CN105632159A (en) Remote control management method and terminal device
CN104898839A (en) Terminal device and control method thereof
CN108614494B (en) Equipment control method, device, equipment and storage medium
CN106101990B (en) Bluetooth device searching method and device
US20190052745A1 (en) Method For Presenting An Interface Of A Remote Controller In A Mobile Device
US20230384868A1 (en) Display apparatus
CN105187878A (en) Television Bluetooth connection method and device
CN104333792A (en) Key-value pair judging method and television
CN110691016B (en) Interactive method realized based on audio equipment and audio equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20210422

Address after: 210038 8th floor, building D11, Hongfeng science and Technology Park, Nanjing Economic and Technological Development Zone, Jiangsu Province

Applicant after: New Technology Co.,Ltd.

Address before: 100080, Haidian District, Suzhou Street, No. 16, floor 1602, room 3, Beijing

Applicant before: Mobvoi Information Technology Co.,Ltd.

GR01 Patent grant
GR01 Patent grant