CN112612361A - Equipment control method, device, system, terminal equipment and storage medium - Google Patents
Equipment control method, device, system, terminal equipment and storage medium Download PDFInfo
- Publication number
- CN112612361A CN112612361A CN202011493408.9A CN202011493408A CN112612361A CN 112612361 A CN112612361 A CN 112612361A CN 202011493408 A CN202011493408 A CN 202011493408A CN 112612361 A CN112612361 A CN 112612361A
- Authority
- CN
- China
- Prior art keywords
- information
- gesture
- icon
- preset
- preset position
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 63
- 238000004590 computer program Methods 0.000 claims description 19
- 238000004891 communication Methods 0.000 claims description 8
- 238000001514 detection method Methods 0.000 claims description 5
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 claims description 5
- 230000008569 process Effects 0.000 abstract description 17
- 230000006870 function Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/107—Static hand or arm
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention is suitable for the technical field of equipment control, and provides an equipment control method, a device, a system, terminal equipment and a storage medium, wherein the method comprises the following steps: detecting image information of a preset position, and acquiring gesture information in the image information; matching the gesture information with gesture instruction information of the preset position, and generating a control signal of corresponding equipment according to the matching condition; and transmitting the control signal to the corresponding equipment, and controlling the corresponding equipment to execute corresponding operation. The control method and the control device realize the control of the plurality of devices through the gestures, do not need to find or confirm the remote controller corresponding to each device in the control process, and the user only needs to make the corresponding gesture at the preset position, so the operation is simple, the use is convenient, and the use experience of the user is improved.
Description
Technical Field
The present invention belongs to the technical field of device control, and in particular, to a device control method, apparatus, system, terminal device, and storage medium.
Background
With the development of information technology, more and more intelligent devices enter people's daily life. In order to realize the control of the intelligent device, under a common condition, the intelligent device is provided with a remote controller, and the intelligent device is remotely controlled through the remote controller. Along with the increase of the added intelligent equipment, the number of remote controllers is increased, and people can control the intelligent equipment only by finding out the corresponding remote controller from the plurality of remote controllers when controlling each intelligent equipment.
However, more and more remote controllers become a pain point when various intelligent devices are used, and the use experience of consumers is seriously influenced.
Disclosure of Invention
In view of this, embodiments of the present invention provide a device control method, apparatus, system, terminal device and storage medium, so as to solve the technical problems in the prior art that the use of an intelligent device is inconvenient and the use experience is affected when a plurality of remote controllers are used to control the intelligent device respectively.
In a first aspect of the embodiments of the present invention, there is provided an apparatus control method, including:
detecting image information of a preset position, and acquiring gesture information in the image information;
matching the gesture information with gesture instruction information of the preset position, and generating a control signal of corresponding equipment according to the matching condition;
and transmitting the control signal to the corresponding equipment, and controlling the corresponding equipment to execute corresponding operation.
According to the device control method, the step of detecting the image information of the preset position and acquiring the gesture information in the image information includes:
acquiring image information of a preset position according to a preset frequency;
carrying out image recognition on the image information to acquire icon information in an image;
judging whether the icon shape of the icon information is matched with a preset icon shape;
if the icon shape is matched with the preset icon shape, then:
and performing gesture recognition on the image information to acquire gesture information in the image information.
According to the above-mentioned device control method, if the icon shape does not match the preset icon shape, then:
and returning to the step of acquiring the image information of the preset position according to the preset frequency.
According to the device control method, the step of matching the gesture information with the gesture instruction information of the preset position and generating the control signal of the corresponding device according to the matching condition comprises the following steps:
acquiring at least one preset gesture instruction message associated with the icon message according to the icon message in the image message;
matching the gesture information with the gesture instruction information to obtain matching degree;
judging whether the matching degree meets a preset requirement or not;
if the matching degree meets the preset requirement, the following steps are carried out:
and generating a control signal for controlling the equipment corresponding to the gesture instruction information.
According to the above device control method, if the matching degree does not meet a preset requirement:
and returning to the step of acquiring the image information of the preset position according to the preset frequency.
According to the device control method, before the step of detecting the image information of the preset position and acquiring the gesture information in the image information, the method further comprises:
judging whether gesture instruction information is input or not;
if no gesture instruction information is input, then:
acquiring icon information, wherein the icon information at least comprises a preset icon shape;
determining a preset position corresponding to the icon, and collecting gesture instruction information;
associating the gesture instruction information with the icon information.
In a second aspect of the embodiments of the present invention, there is provided an apparatus control device, including:
the camera assembly at least comprises a camera and is used for collecting images;
a host, the host comprising at least:
the gesture detection module is used for detecting image information of a preset position and acquiring gesture information in the image information;
the control signal generation module is used for matching the gesture information with the gesture instruction information of the preset position and generating a control signal of corresponding equipment according to the matching condition;
and the wireless communication module is used for transmitting the control signal to the corresponding equipment and controlling the corresponding equipment to execute corresponding operation.
In a third aspect of the embodiments of the present invention, there is provided an equipment control system, including the above equipment control device;
the device control system further comprises at least one icon arranged at a preset position.
In a fourth aspect of the embodiments of the present invention, there is provided a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the device control method as described above when executing the computer program.
In a fifth aspect of the embodiments of the present invention, a computer-readable storage medium is provided, which stores a computer program, and the computer program, when executed by a processor, implements the steps of the apparatus control method as described above.
Compared with the prior art, the embodiment of the invention has the following beneficial effects: according to the embodiment of the invention, the gesture instruction information is preset at the preset position, when the equipment needs to be controlled, the gesture information is matched with the gesture instruction information by acquiring the image information of the preset position and acquiring the gesture information therein, and the control signal is generated according to the matching result and sent to the corresponding equipment, so that the control on the equipment is realized. The embodiment of the invention realizes the control of a plurality of devices through gestures, does not need to find or confirm the remote controller corresponding to each device in the control process, and only needs to make corresponding gestures at preset positions by a user, so that the operation is simple, the use is convenient, and the use experience of the user is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed for the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
FIG. 1 is a schematic diagram of a plant control system provided by an embodiment of the present invention;
fig. 2 is a first schematic flow chart illustrating an implementation process of an apparatus control method according to an embodiment of the present invention;
fig. 3 is a schematic flow chart illustrating an implementation process of acquiring gesture information in image information in the device control method according to the embodiment of the present invention;
fig. 4 is a schematic flow chart illustrating an implementation of generating a control signal in a device control method according to an embodiment of the present invention;
fig. 5 is a schematic flow chart illustrating an implementation process of the device control method according to the embodiment of the present invention;
FIG. 6 is a schematic diagram of an apparatus control device provided by an embodiment of the present invention;
fig. 7 is a schematic diagram of a terminal device according to an embodiment of the present invention.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
In order to explain the technical means of the present invention, the following description will be given by way of specific examples.
With the development of information technology and the improvement of living standard of people, more and more devices enter daily life of people, such as televisions, air conditioners, washing machines, intelligent sound boxes and the like. When controlling devices, a remote controller is generally configured for each device, and the devices are remotely controlled through the remote controller. When the number of the devices in the room is small and the remote controller has a good storage habit, the devices can be well controlled through the remote controller. However, as the number of devices increases, the number of remote controllers also increases, and when people control the devices through the remote controllers, people need to find the remote controllers first, then confirm the remote controllers, and then control the devices. If the remote controller is not fixedly stored, the remote controller is easily lost, and the remote controller needs to be searched before the equipment is controlled each time; with the increasing convergence of remote controllers among devices, people are difficult to distinguish the remote controllers, and easily select the wrong remote controller, so that the target device cannot be controlled, other devices are controlled, and the use experience of the devices is poor.
In order to solve the problems that a plurality of remote controllers are inconvenient to use and influence use experience when the devices are controlled respectively, the embodiment of the invention provides the device control system. It should be understood that the room may be one room or a plurality of rooms, and is not limited herein.
In one aspect, referring to fig. 1, an embodiment of the present invention provides an equipment control system, which includes an equipment control device 11 and at least one icon. The device control apparatus 11 may be disposed at a preset position in a room, and includes a camera assembly 112 and a host 111, where the camera assembly 112 includes at least one camera for collecting images, and the camera is connected to the host 111; the host 111 is configured to generate a control signal according to an image acquired by the camera, and send the control signal to the target device, so as to control the target device. The host 111 may include a plurality of functional modules, and the functional modules are integrated on a motherboard, and the motherboard may select an STM32F407 chip, is compatible with a FreeRTOS system, and can process data in real time and respond. The host 111 further comprises a power supply module, wherein the power supply module can adopt a direct current 12V/5V adapter to supply power, and adopts a TPS54360 DC/DC chip to realize voltage transformation to supply power to a mainboard and other modules.
In order to describe the device control system and the device control method, in the embodiment of the present invention, the devices including the air conditioner 131 and the television 132 are described as an example. It should be understood that the specific type and number of devices may be set as desired and are not limited to the above-described situation. The air conditioner 131 may be installed on a wall surface in a room, an icon (denoted as a first icon 121) is disposed at a preset position of the wall surface where the air conditioner 131 is located, and the first icon 121 may include a "+" sign and a "-" sign, which respectively correspond to an increase and a decrease in temperature of the air conditioner. The television 132 may be mounted on another wall surface in the room. In order to facilitate the camera assembly 112 to capture images in the room, a table 14 is provided in the middle of the room, and the device control apparatus 11 is placed on the table 14. The camera assembly 112 includes three 3D cameras capable of rotating 360 degrees, and the three 3D cameras face three directions respectively, and are used for acquiring images in a room, and obtaining information of distance, height, shape and the like of an object in the acquired images. The specific type of the 3D camera may be selected according to the needs, and may be, for example, a comforter WS012C 3D camera, etc., without limitation. Another icon (denoted as a second icon 122) is disposed at a preset position on the desktop of the desk 14, and the second icon 122 may be a volume control icon corresponding to the adjustment of the television volume.
On the other hand, an embodiment of the present invention further provides an apparatus control method, which is used for controlling apparatuses in a room, and the apparatus control method may be implemented by the apparatus control system, or may be implemented by other devices or systems, which is not limited herein. The embodiment of the invention takes the above device control system as an example to explain the implementation process of the device control method.
Referring to fig. 2, an apparatus control method according to an embodiment of the present invention includes the following steps:
step S21: detecting image information of a preset position, and acquiring gesture information in the image information.
In order to control the device through a gesture, a user is required to make a gesture at a preset position corresponding to each icon, and therefore when the camera assembly 112 collects image information of the preset position, the image information of the preset position needs to be detected to confirm whether there is a gesture at the preset position. When a gesture exists at a preset position, acquiring gesture information from the image; when there is no gesture at the preset position, it means that the acquired gesture is empty. It will be appreciated that the preset positions may be set as desired, for example: for the first icon 121 corresponding to the air conditioner 131, the preset position corresponding to the first icon 121 may be a + or a-containing position of the first icon 121, and a lower position, an upper position or a surface thereof, and the preset position corresponding to the second icon 122 may be a position containing a volume control icon, and a lower position, an upper position or a surface thereof, and of course, other positions may be possible, which is not limited herein.
Step S22: and matching the gesture information with the gesture instruction information of the preset position, and generating a control signal of the corresponding equipment according to the matching condition.
It can be understood that, corresponding to the same icon, there may be a plurality of gestures to generate different control signals, and different control of the corresponding device is realized, so after the gesture is obtained, the obtained gesture information needs to be matched with the gesture instruction information of the preset position, only when the matching degree of the collected gesture and the gesture instruction information meets the preset condition, the control signal corresponding to the gesture instruction information is generated, and the control signal is used for controlling the corresponding device.
Step S23: and transmitting the control signal to the corresponding equipment, and controlling the corresponding equipment to execute corresponding operation.
In the embodiment of the invention, the gesture instruction information corresponds to the icon and the equipment, so that the gesture instruction information is associated with the equipment, and when the gesture detected at the preset position of the identified icon is matched with the gesture instruction information, a control signal for controlling the corresponding equipment is generated and sent to realize the control of the equipment.
The equipment control method provided by the embodiment of the invention has the beneficial effects that at least: according to the embodiment of the invention, the gesture instruction information is preset at the preset position, when the equipment needs to be controlled, the gesture information is matched with the gesture instruction information by acquiring the image information of the preset position and acquiring the gesture information therein, and the control signal is generated according to the matching result and sent to the corresponding equipment, so that the control on the equipment is realized. The embodiment of the invention realizes the control of a plurality of devices through gestures, does not need to find or confirm the remote controller corresponding to each device in the control process, and the user only needs to make corresponding gestures at the preset position, so that the operation is simple, the use is convenient, and the use experience of the user is effectively improved.
Before detecting the gesture information in step S21, it is also necessary to determine whether preset gesture instruction information is entered, and when no gesture instruction information is entered, the gesture instruction information needs to be entered, so that the collected gesture is subsequently matched with the preset gesture instruction information. When inputting the gesture instruction information, firstly, the icon is set at a selected position, for example, the first icon 121 is set on the wall where the air conditioner 131 is located, the second icon 122 is set on the tabletop of the table 14, and the like; then, the camera collects icon information such as icon shapes and the like, prompts to determine a preset position corresponding to the icon, inputs gesture instruction information, and associates the gesture instruction information with the icon; a control signal and corresponding device corresponding to the gesture instruction information are then determined. Namely, among the pre-entered information, icon information, gesture instruction information, devices, and control signals are associated.
It can be understood that, for the same icon, multiple pieces of gesture instruction information may be associated, and each piece of gesture instruction information may be associated with the same control signal or may be associated with different control signals. When at least two pieces of gesture instruction information are associated with the same control signal, the device can be controlled identically through different gestures; when each gesture instruction information is associated with a different control signal, it means that the device is controlled differently by different gestures. For example, for the first icon 121, the gesture instruction information for adjusting the air conditioner temperature may be "+" or "-" of the wall-shooting surface or pointing to the first icon 121, which corresponds to increasing the air conditioner temperature or decreasing the air conditioner temperature; for the second icon 122, the gesture instruction information for volume adjustment may be sliding above, below, or on the surface of the volume control icon in the direction of the volume control icon, corresponding to turning up or turning down the television volume. Of course, in other embodiments, the gesture instruction information may be set to other information, and is not limited to the above situation.
Referring to fig. 3, in an embodiment, the step of obtaining the gesture information in the image information in step S21 specifically includes the following steps:
step S211: and acquiring image information of a preset position according to a preset frequency.
The frequency at which the three cameras included in the camera assembly 112 respectively face three directions acquire images may be according to a preset frequency. If images of all positions in a room are continuously acquired through the camera assembly 112 and the images are subjected to image recognition, a large amount of memory and calculated amount are occupied, and in the process of controlling the equipment, only the preset positions containing icons need to be subjected to image acquisition and image recognition actually. Therefore, in the present embodiment, in order to reduce the workload of the device control system and improve the image recognition speed and efficiency of the device control system, the camera assembly 112 only collects the image information of the preset position when the camera assembly is turned to the specified position, and the invalid images collected by the camera assembly 112 can be greatly reduced.
Step S212: and carrying out image recognition on the image information to acquire icon information in an image.
In the embodiment of the present invention, after the camera assembly 112 of the device control apparatus 11 in the device control system collects an image of a preset position, the collected image information is sent to the host 111, and the host 111 performs image recognition on the collected image information to obtain icon information in the image. It is understood that when an icon (e.g., the first icon 121 or the second icon 122) is included in the captured image, the icon information in the image is acquired, and when an icon is not included in the captured image, it means that the acquired icon information is empty.
The first icon 121 is disposed on a wall surface where the air conditioner 131 is located, so that image acquisition is performed when the camera faces a preset position of the first icon 121, and icon information of the first icon 121, which includes at least an icon shape, can be acquired by performing image recognition on the image information. The second icon 122 is disposed on the desktop, so that image capture is performed when the camera is facing a preset position of the second icon 122, and icon information of the second icon 122 can be acquired by performing image recognition on the image information. Of course, in other embodiments, the icon may be disposed elsewhere on the sofa, etc., without limitation.
Illustratively, the icon shape may be a "+" sign, a "-" sign, a shape of a volume control icon, and the like, and may also be a shape of a channel plus sign, a channel minus sign, and the like, which is not limited herein.
Step S213: and judging whether the icon shape of the icon information is matched with a preset icon shape.
If the icon shape is not matched with the preset icon shape, it means that the acquired icon is not the preset icon, and at this time, the subsequent gesture recognition process does not need to be continued, and the process returns to step S211.
If the icon shape matches the preset icon shape, it means that the collected icon is a preset icon, and then step S214 is performed.
Step S214: and performing gesture recognition on the image information to acquire gesture information in the image information.
Since the gesture performed by the user at the preset position corresponding to the icon is regarded as the gesture for controlling the device, the gesture recognition needs to be performed on the image information at the preset position.
Referring to fig. 4, in an embodiment, the step of generating the control signal of the corresponding device in the step S22 includes the following steps:
step S221: and acquiring at least one preset gesture instruction message associated with the icon message according to the icon message in the image message.
Step S222: and matching the gesture information with the gesture instruction information to obtain matching degree.
As described above, for the same icon, one or more pieces of gesture instruction information may be associated, and each piece of gesture instruction information may be associated with the same control signal or different control signals. After the icon information is confirmed, gesture instruction information associated with the icon information can be acquired, and the gesture is matched with the acquired gesture instruction information to acquire the matching degree of the gesture and each piece of gesture instruction information.
Step S223: and judging whether the matching degree meets a preset requirement or not.
When only one gesture instruction information is obtained, whether the matching degree of the gesture and the gesture instruction information meets a preset requirement or not is directly judged, for example, the matching degree needs to exceed a certain threshold value, and only if the matching degree meets the preset requirement, the fact that the obtained gesture is matched with the gesture instruction information is confirmed. When a plurality of gesture instruction information are obtained, whether the highest matching degree of the obtained gesture and each gesture instruction information meets a preset requirement or not needs to be confirmed, and when the preset requirement is met, the gesture instruction information with the highest matching degree is confirmed to be matched with the obtained gesture.
If the matching degree meets the preset requirement, the following steps are carried out:
step S224: generating a control signal for controlling a device corresponding to the gesture instruction information;
if the matching degree does not meet the preset requirement, it means that the acquired gesture cannot control the device, and at this time, the process returns to step S211.
In an embodiment, when the control signal is sent to the device associated with the gesture instruction information, the sending may be directly sending the control signal to the device, or sending the control signal to the device through a local area network (at this time, the device control system and each device are interconnected through the local area network), or sending the control signal to the device through a network (at this time, the device control system and each device are interconnected through the network).
According to the embodiment of the invention, the combination of gesture control and environment is realized by inputting the icon, the gesture instruction information and the control signal which are mutually associated in advance, when the equipment needs to be controlled, the gesture at the preset position of the icon is acquired, the gesture is matched with the gesture instruction information, the control signal is generated according to the matching result, and the control signal is sent to the equipment, so that the purpose of controlling a plurality of pieces of equipment is realized, the complicated and various remote controllers are completely replaced, a user only needs to make the corresponding gesture at the preset position, the operation is simple, the use is convenient, and the use experience of the user is effectively improved.
A specific embodiment of the apparatus control method is given below, and it should be understood that the embodiment is only used for explaining the apparatus control method and is not used for limiting the apparatus control method given in the embodiment.
Referring to fig. 5, an apparatus control method includes:
step S301: starting an equipment control system;
step S302: judging whether gesture instruction information is input or not;
if no gesture instruction information is input, then:
step S303: acquiring icon information, wherein the icon information at least comprises a preset icon shape;
step S304: determining a preset position corresponding to the icon, and collecting gesture instruction information;
step S305: associating the gesture instruction information with the icon information;
step S306: determining that the gesture instruction information is input completely, and returning to the step S302;
if the gesture instruction information is input, then:
step S307: acquiring image information of a preset position according to a preset frequency;
step S308: performing image recognition on the image information to acquire icon information in the image, wherein the icon information at least comprises an icon shape;
step S309: judging whether the icon shape of the icon information is matched with a preset icon shape;
if the icon shape is not matched with the preset icon shape, returning to the step S307;
if the icon shape is matched with the preset icon shape, then:
step S310: performing gesture recognition on the image information to acquire gesture information in the image information;
step S311: acquiring at least one preset gesture instruction message associated with the icon message according to the icon message;
step S312: matching the gesture information with the gesture instruction information to obtain matching degree;
step S313: judging whether the matching degree meets a preset requirement or not;
if the matching degree does not meet the preset requirement, step S307;
if the matching degree meets the preset requirement, the following steps are carried out:
step S314: generating a control signal of the corresponding equipment;
step S315: and transmitting the control signal to the corresponding device, controlling the corresponding device to execute corresponding operation, and returning to the step S307.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
Referring to fig. 6, based on the same inventive concept, the host 111 in the device control apparatus 11 according to the embodiment of the present invention at least includes a gesture detection module 1111, a control signal generation module 1112, and a wireless communication module 1113. The gesture detection module 1111 is configured to detect a gesture of a preset position in the image corresponding to the icon according to the icon information; the control signal generating module 1112 is configured to generate a corresponding control signal according to a matching condition of the gesture and a preset gesture; the wireless communication module 1113 is configured to send the control signal to a device associated with the preset gesture. In this embodiment, the wireless communication module 1113 may be a wireless communication module (e.g., a WIFI module, a 2G module, a 3G module, a 4G module, a 5G module, etc.), a bluetooth module, an infrared remote control module, or the like.
The icon information acquiring module 1111 is configured to perform image recognition on the acquired image to acquire icon information in the image;
in one embodiment, the gesture detection module 1111 includes an image acquisition unit, an icon information acquisition unit, an icon shape determination unit, and a gesture acquisition unit. The image acquisition unit is used for acquiring image information of a preset position according to a preset frequency. The icon information acquisition unit is used for carrying out image recognition on the image information so as to acquire icon information in an image, and the icon information at least comprises an icon shape. The icon shape judging unit is used for judging whether the icon shape of the icon information is matched with a preset icon shape. And the gesture obtaining unit is used for performing gesture recognition on the image information to obtain gesture information in the image information if the icon shape is matched with the preset icon shape.
In one embodiment, the control signal generation module 1112 includes a gesture instruction acquisition unit, a gesture matching unit, a gesture determination unit, and a control signal generation unit. The gesture instruction acquisition unit is used for acquiring at least one piece of gesture instruction information associated with the icon information according to the icon information; the gesture matching unit is used for matching the gesture information with the gesture instruction information to obtain matching degree; the gesture judging unit is used for judging whether the matching degree meets a preset requirement; and the control signal generating unit is used for generating a control signal associated with the gesture instruction information if the matching degree meets a preset requirement.
Please refer to fig. 7, which is a schematic diagram of a terminal device according to an embodiment of the present invention. As shown in fig. 7, the terminal device 4 of this embodiment includes: a processor 40, a memory 41 and a computer program 42, such as a device control program, stored in said memory 41 and executable on said processor 40. The processor 40 implements the steps in the respective apparatus control method embodiments described above, such as the steps S21 to S23 shown in fig. 2, when executing the computer program 42. Alternatively, the processor 40, when executing the computer program 42, implements the functions of the modules/units in the device embodiments, such as the functions of the modules 1111 to 1113 shown in fig. 6.
Illustratively, the computer program 42 may be partitioned into one or more modules/units that are stored in the memory 41 and executed by the processor 40 to implement the present invention. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution process of the computer program 42 in the terminal device 4.
The terminal device 4 may be a desktop computer, a notebook, a palm computer, a cloud server, or other computing devices. The terminal device may include, but is not limited to, a processor 40, a memory 41. Those skilled in the art will appreciate that fig. 7 is merely an example of a terminal device 4 and does not constitute a limitation of terminal device 4 and may include more or fewer components than shown, or some components may be combined, or different components, e.g., the terminal device may also include input-output devices, network access devices, buses, etc.
The Processor 40 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 41 may be an internal storage unit of the terminal device 4, such as a hard disk or a memory of the terminal device 4. The memory 41 may also be an external storage device of the terminal device 4, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are provided on the terminal device 4. Further, the memory 41 may also include both an internal storage unit and an external storage device of the terminal device 4. The memory 41 is used for storing the computer program and other programs and data required by the terminal device 4. The memory 41 may also be used to temporarily store data that has been output or is to be output.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other ways. For example, the above-described terminal device embodiments are merely illustrative, and for example, the division of the modules or units is only one logical function division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment of the present invention.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present invention, and are intended to be included within the scope of the present invention.
Claims (10)
1. An apparatus control method characterized by comprising:
detecting image information of a preset position, and acquiring gesture information in the image information;
matching the gesture information with gesture instruction information of the preset position, and generating a control signal of corresponding equipment according to the matching condition;
and transmitting the control signal to the corresponding equipment, and controlling the corresponding equipment to execute corresponding operation.
2. The device control method according to claim 1, wherein the step of detecting image information of a preset position and acquiring gesture information in the image information comprises:
acquiring image information of a preset position according to a preset frequency;
carrying out image recognition on the image information to acquire icon information in an image;
judging whether the icon shape of the icon information is matched with a preset icon shape;
if the icon shape is matched with the preset icon shape, then:
and performing gesture recognition on the image information to acquire gesture information in the image information.
3. The device control method of claim 2, wherein if the icon shape does not match the preset icon shape:
and returning to the step of acquiring the image information of the preset position according to the preset frequency.
4. The device control method according to claim 2, wherein the step of matching the gesture information with the gesture instruction information of the preset position and generating the control signal of the corresponding device according to the matching condition comprises:
acquiring at least one preset gesture instruction message associated with the icon message according to the icon message in the image message;
matching the gesture information with the gesture instruction information to obtain matching degree;
judging whether the matching degree meets a preset requirement or not;
if the matching degree meets the preset requirement, the following steps are carried out:
and generating a control signal for controlling the equipment corresponding to the gesture instruction information.
5. The device control method according to claim 4, wherein if the matching degree does not satisfy a preset requirement:
and returning to the step of acquiring the image information of the preset position according to the preset frequency.
6. The device control method according to claim 1, wherein before the step of detecting the image information of the preset position and acquiring the gesture information in the image information, the method further comprises:
judging whether gesture instruction information is input or not;
if no gesture instruction information is input, then:
acquiring icon information, wherein the icon information at least comprises a preset icon shape;
determining a preset position corresponding to the icon, and collecting gesture instruction information;
associating the gesture instruction information with the icon information.
7. An apparatus control device, characterized by comprising:
the camera assembly at least comprises a camera and is used for collecting images;
a host, the host comprising at least:
the gesture detection module is used for detecting image information of a preset position and acquiring gesture information in the image information;
the control signal generation module is used for matching the gesture information with the gesture instruction information of the preset position and generating a control signal of corresponding equipment according to the matching condition;
and the wireless communication module is used for transmitting the control signal to the corresponding equipment and controlling the corresponding equipment to execute corresponding operation.
8. An appliance control system characterized by comprising the appliance control device of claim 7;
the device control system further comprises at least one icon arranged at a preset position.
9. A terminal device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the device control method according to any one of claims 1 to 6 when executing the computer program.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the device control method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011493408.9A CN112612361A (en) | 2020-12-17 | 2020-12-17 | Equipment control method, device, system, terminal equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011493408.9A CN112612361A (en) | 2020-12-17 | 2020-12-17 | Equipment control method, device, system, terminal equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112612361A true CN112612361A (en) | 2021-04-06 |
Family
ID=75240536
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011493408.9A Pending CN112612361A (en) | 2020-12-17 | 2020-12-17 | Equipment control method, device, system, terminal equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112612361A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113794824A (en) * | 2021-09-15 | 2021-12-14 | 深圳市智像科技有限公司 | Intelligent interactive acquisition method, device, system and medium for indoor visual documents |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130169786A1 (en) * | 2011-06-15 | 2013-07-04 | Hisense Hiview Tech Co., Ltd. | Television, control method and control device for the television |
| CN106249899A (en) * | 2016-08-15 | 2016-12-21 | 珠海格力电器股份有限公司 | A kind of gesture recognition system, electrical equipment and control method thereof |
| CN107291235A (en) * | 2017-06-22 | 2017-10-24 | 三星电子（中国）研发中心 | control method and device |
| CN111431775A (en) * | 2020-03-11 | 2020-07-17 | 青岛海尔智能技术研发有限公司 | Control method and device for household electrical appliance and range hood |
-
2020
- 2020-12-17 CN CN202011493408.9A patent/CN112612361A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130169786A1 (en) * | 2011-06-15 | 2013-07-04 | Hisense Hiview Tech Co., Ltd. | Television, control method and control device for the television |
| CN106249899A (en) * | 2016-08-15 | 2016-12-21 | 珠海格力电器股份有限公司 | A kind of gesture recognition system, electrical equipment and control method thereof |
| CN107291235A (en) * | 2017-06-22 | 2017-10-24 | 三星电子（中国）研发中心 | control method and device |
| CN111431775A (en) * | 2020-03-11 | 2020-07-17 | 青岛海尔智能技术研发有限公司 | Control method and device for household electrical appliance and range hood |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113794824A (en) * | 2021-09-15 | 2021-12-14 | 深圳市智像科技有限公司 | Intelligent interactive acquisition method, device, system and medium for indoor visual documents |
| CN113794824B (en) * | 2021-09-15 | 2023-10-20 | 深圳市智像科技有限公司 | Indoor visual document intelligent interactive acquisition method, device, system and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6968154B2 (en) | Control systems and control processing methods and equipment | |
| CN108386979B (en) | Control method and device of air conditioner | |
| CN103164022B (en) | Many fingers touch method and device, portable terminal | |
| CN103375880B (en) | The remote control of air-conditioner and method | |
| CN113170000B (en) | Equipment control method, device, system, electronic equipment and cloud server | |
| CN103324899A (en) | Electronic equipment and display screen peeping-prevention method thereof | |
| CN112068698A (en) | Interaction method and device, electronic equipment and computer storage medium | |
| TW201636887A (en) | Smart control apparatus and system | |
| CN107092350A (en) | A kind of remote computer based system and method | |
| CN112612361A (en) | Equipment control method, device, system, terminal equipment and storage medium | |
| CN110858814B (en) | Control method and device for intelligent household equipment | |
| WO2022160765A1 (en) | Household appliance control method, household appliance control system, and wearable device | |
| CN111028494B (en) | Virtual remote control method of electrical equipment, computer readable storage medium and intelligent household appliance | |
| CN104914985A (en) | Gesture control method and system and video flowing processing device | |
| CN113446717B (en) | Smart page display method and device and electronic equipment | |
| CN115802561A (en) | Intelligent household lighting method and device and storage medium | |
| GB2590207A (en) | Scenario control method and device, and electronic device | |
| CN115841707A (en) | Radar human body posture identification method based on deep learning and related equipment | |
| CN115268293A (en) | Touch screen control panel based on whole-house intelligent household appliance control | |
| CN207946727U (en) | A kind of all-in-one machine based on gesture identification | |
| CN113934323A (en) | Multi-point display method and device based on intelligent blackboard and terminal equipment | |
| CN202940855U (en) | Desktop cloud intelligent terminal with RFID device | |
| CN108614494B (en) | Equipment control method, device, equipment and storage medium | |
| CN111857350A (en) | Method, device and equipment for rotating display equipment | |
| CN110349531A (en) | A kind of brightness control method, device and the computer equipment of line control machine screen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210406 |