CN117369292A - Equipment control method, system, medium and device based on digital twin - Google Patents

Equipment control method, system, medium and device based on digital twin Download PDF

Info

Publication number
CN117369292A
CN117369292A CN202210771931.6A CN202210771931A CN117369292A CN 117369292 A CN117369292 A CN 117369292A CN 202210771931 A CN202210771931 A CN 202210771931A CN 117369292 A CN117369292 A CN 117369292A
Authority
CN
China
Prior art keywords
cleaning
target
parameter
indoor
equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210771931.6A
Other languages
Chinese (zh)
Inventor
吴贵英
邓邱伟
苏明月
王迪
张丽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Haier Technology Co Ltd
Qingdao Haier Intelligent Home Appliance Technology Co Ltd
Haier Smart Home Co Ltd
Original Assignee
Qingdao Haier Technology Co Ltd
Qingdao Haier Intelligent Home Appliance Technology Co Ltd
Haier Smart Home Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Haier Technology Co Ltd, Qingdao Haier Intelligent Home Appliance Technology Co Ltd, Haier Smart Home Co Ltd filed Critical Qingdao Haier Technology Co Ltd
Priority to CN202210771931.6A priority Critical patent/CN117369292A/en
Publication of CN117369292A publication Critical patent/CN117369292A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00Systems controlled by a computer
    • G05B15/02Systems controlled by a computer electric
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/20Pc systems
    • G05B2219/26Pc applications
    • G05B2219/2642Domotique, domestic, home control, automation, smart house
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Manufacturing & Machinery (AREA)
  • Quality & Reliability (AREA)
  • Electric Vacuum Cleaner (AREA)

Abstract

The application discloses a device control method, a system, a medium and a device based on digital twinning, which relate to the technical field of intelligent home/intelligent families, wherein the method comprises the following steps: acquiring detection parameters uploaded by an indoor target sensor, wherein the target sensor is a sensor of intelligent household equipment installed indoors, and if a preset cleaning mode is identified based on the detection parameters, controlling the indoor cleaning equipment to actively clean based on the cleaning mode; and if the preset cleaning mode is not identified based on the detection parameters, controlling the cleaning equipment to perform active cleaning work based on the indoor target image module and/or the indoor target voice module. According to the cleaning device, the cleaning device is controlled by the sensing information of the three sensing modules, and the cleaning device can actively clean under the condition that the instruction sent by the user is not received, so that the initiative of the cleaning device is improved, and the experience of the user is further improved.

Description

Equipment control method, system, medium and device based on digital twin
Technical Field
The application relates to the technical field of intelligent home/intelligent families, in particular to a device control method, a system, a medium and a device based on digital twinning.
Background
With the rapid development of science and technology, more and more intelligent devices are beginning to be applied in home life, and a comfortable living environment is provided for users.
In the prior art, indoor sanitary cleaning devices often execute cleaning work according to a cleaning instruction set in advance by a user, for example, cleaning is performed according to a cleaning instruction sent in real time by the user, or cleaning is performed when a cleaning time set by the user is detected.
The conventional cleaning method of the cleaning equipment generally adopts a cleaning mode which is passively controlled by a person only under the condition of receiving a manual instruction input by the user, and cannot cope with the sudden real-time sanitary cleaning requirement of the user, so that the intelligent level is low and the experience is poor.
Disclosure of Invention
The application provides a device control method, system, medium and device based on digital twinning, which are used for solving the technical problems that in the prior art, cleaning equipment adopts a cleaning mode that the cleaning equipment is passively controlled by manual, the sudden real-time sanitary cleaning requirement of a user cannot be met, the intelligent level is low, and the experience is poor.
The application provides a device control method based on digital twinning, which comprises the following steps:
acquiring detection parameters uploaded by an indoor target sensor, wherein the target sensor is a sensor of intelligent household equipment installed indoors;
If a preset cleaning mode is identified based on the detection parameters, controlling the indoor cleaning equipment to perform active cleaning work based on the cleaning mode;
if the preset cleaning mode is not identified based on the detection parameters, controlling the cleaning equipment to perform active cleaning work based on the indoor target image module and/or the indoor target voice module;
the target image module is an image module of target intelligent household equipment which is located in the same indoor space as the target sensor;
the target voice module is a voice module of target intelligent household equipment which is located in the same indoor space as the target sensor.
According to the device control method based on digital twin provided by the application, the cleaning device is controlled to perform active cleaning work based on the indoor target image module and/or the indoor target voice module, and the device control method comprises the following steps:
determining a first target cleaning mode and a first target cleaning space parameter corresponding to the cleaning equipment based on a dirt recognition result and a dirt space parameter reported by the indoor target image module, and controlling the cleaning equipment to actively clean according to the first target cleaning mode and the first target cleaning space parameter;
Or, receiving a second target cleaning mode corresponding to the cleaning equipment and input by a user based on the indoor target voice module, and controlling the cleaning equipment to perform active cleaning according to the second target cleaning mode and a second target cleaning space parameter corresponding to the detection parameter.
According to the device control method based on digital twin provided by the application, the cleaning device is controlled to perform active cleaning work based on the indoor target image module and/or the indoor target voice module, and the device control method further comprises the following steps:
under the condition that the dirt recognition result and the dirt space parameter reported by the indoor target image module are empty, receiving a second target cleaning mode corresponding to the cleaning equipment input by a user based on the indoor target voice module;
and controlling the cleaning equipment to perform active cleaning according to the second target cleaning mode and the second target cleaning space parameter corresponding to the detection parameter.
According to the device control method based on digital twin provided by the application, the second target cleaning mode corresponding to the cleaning device and input by the user is received based on the indoor target voice module, and the device control method comprises the following steps:
And receiving a voice command input by a user based on the indoor target voice module, analyzing the voice command, and determining a second target cleaning mode corresponding to the voice command.
According to the device control method based on digital twin provided by the application, the second target cleaning mode corresponding to the cleaning device and input by the user is received based on the indoor target voice module, and the device control method comprises the following steps:
and sending a user cleaning request based on the indoor target voice module, receiving voice information input by the user cleaning request user, analyzing the voice information, and determining a second target cleaning mode corresponding to the voice information.
According to the device control method based on digital twinning, the device control method controls the cleaning device to perform active cleaning work, and the device control method comprises the following steps:
determining a current position parameter of the cleaning equipment;
traversing each pre-stored cleaning track route based on the current position parameter and the first target cleaning space parameter to obtain a first cleaning track traversing result;
and when the first cleaning track traversing result shows that a first target cleaning track route is matched with the current position parameter and the first target cleaning space parameter, sending a cleaning instruction carrying the first target cleaning track route and the first target cleaning mode to the cleaning equipment.
According to the device control method based on digital twinning, the device control method controls the cleaning device to perform active cleaning work, and the device control method comprises the following steps:
determining a current position parameter of the cleaning equipment;
traversing each pre-stored cleaning track route based on the current position parameter and the second target cleaning space parameter to obtain a second cleaning track traversing result;
and when the second cleaning track traversing result shows that a second target cleaning track route is matched with the current position parameter and the second target cleaning space parameter, sending a cleaning instruction carrying the second target cleaning track route and the second target cleaning mode to the cleaning equipment.
According to the device control method based on digital twin, the preset cleaning mode is obtained based on the following method:
determining the parameter fluctuation amplitude and the parameter type of the detection parameter;
and under the condition that the parameter fluctuation amplitude reaches the preset parameter fluctuation amplitude range corresponding to the parameter type, determining the preset cleaning mode corresponding to the detection parameter based on a mapping table of the sensing parameter corresponding to the parameter type and the preset cleaning mode.
The application also provides a device control system based on digital twinning, comprising: the cleaning device, the multi-mode sensing module and the cloud brain module are arranged;
the multi-mode sensing module comprises intelligent home equipment with a sensor, intelligent home equipment with an image module and intelligent home equipment with a voice module;
the sensor comprises at least one of an odor sensor, a humidity sensor, a temperature sensor and a carbon monoxide sensor.
The present application also provides a computer-readable storage medium comprising a stored program, wherein the program when executed performs a device control method based on digital twinning as described in any one of the above.
The present application also provides an electronic device comprising a memory and a processor, the memory having stored therein a computer program, the processor being arranged to implement a digital twin based device control method as described in any of the above by execution of the computer program.
According to the digital twin-based equipment control method, system, medium and device, the detection parameters uploaded by the indoor target sensor are acquired, the target sensor is a sensor of the indoor intelligent household equipment, and if a preset cleaning mode is identified based on the detection parameters, the indoor cleaning equipment is controlled to perform active cleaning work based on the cleaning mode; if the preset cleaning mode is not recognized based on the detection parameters, the cleaning equipment is controlled to perform active cleaning based on the indoor target image module and/or the target voice module, and as the target image module and the target voice module are modules of the target intelligent household equipment in the same indoor space as the target sensor, the cleaning equipment can be controlled to perform active cleaning according to the sensing information of the three sensing modules in the same indoor space under the condition that the cleaning equipment does not receive an instruction sent by a user, the cleaning equipment does not need to perform passive cleaning according to the cleaning instruction issued by the user, the initiative of the cleaning equipment is improved, and the experience of the user is further improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
FIG. 1 is one of the flow diagrams of the digital twinning-based device control method provided herein;
FIG. 2 is a schematic diagram of a digital twinning-based plant control arrangement provided herein;
FIG. 3 is a schematic diagram of a digital twinning-based plant control system provided herein;
FIG. 4 is a schematic structural diagram of an electronic device provided in the present application;
fig. 5 is a schematic diagram of a hardware environment of an interaction method of a smart device according to an embodiment of the present application.
Reference numerals:
501: a terminal device; 502: and a server.
Detailed Description
In order to make the present application solution better understood by those skilled in the art, the following description will be made in detail and with reference to the accompanying drawings in the embodiments of the present application, it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, shall fall within the scope of the present application.
It should be noted that the terms "first," "second," and the like in the description of the present application and the above-described figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the present application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Fig. 1 is a schematic flow chart of a digital twin-based device control method provided in the present application, as shown in fig. 1, the method includes steps 100, 200, and 300.
Step 100, acquiring detection parameters uploaded by an indoor target sensor, wherein the target sensor is a sensor of intelligent household equipment installed indoors;
Specifically, the device control method based on digital twin provided by the embodiment of the application is suitable for actively cleaning the cleaning device in the room equipped with the intelligent home. The indoor space in the application can be the indoor space in a home field, including a living room, a bedroom, a study room and the like; and can also be in offices or business places, including meeting rooms, offices, activity rooms, etc. The execution main body of the equipment control method based on digital twinning is an active cleaning device of the cleaning equipment. The cleaning device active cleaning device can be a control device which is arranged independently, for example, the cleaning device active cleaning device is a cleaning device active cleaning device in a cloud brain module of an intelligent household device which is independent of indoor installation, and can be integrated with other intelligent household devices in the room, such as an intelligent sound box, an intelligent air conditioner, an intelligent refrigerator, an intelligent television, an intelligent lamp and the like.
The target sensor may be a sensor of an indoor-mounted smart home device, wherein the types of sensors include at least one of an odor sensor, a humidity sensor, a temperature sensor, a carbon monoxide sensor, such as a temperature and humidity sensor on an air conditioner, a carbon monoxide sensor on a range hood, an odor sensor on an intelligent garbage can, and the like. Other types of sensors are also possible, without limitation.
In addition, in order to improve the universality of the active cleaning of the cleaning equipment, the target sensor can be a sensor which is added by a user and is independent of the indoor intelligent household equipment, such as a temperature sensor which is independent of air conditioning equipment, a carbon monoxide sensor which is independent of a smoke exhaust ventilator, and the like.
The detection parameters can be sensor parameters detected by the target sensor at the current moment, so that the sensor parameters such as indoor smell, humidity and temperature are monitored in real time through the target sensor, and the initiative of the cleaning equipment is ensured. In addition, in order to realize energy saving of the smart home, the detection parameters can also be sensor parameters detected at the moment set by the user.
In the step, the sensor equipment in the intelligent household equipment is normally in a normally open state, so that real-time monitoring of indoor temperature, humidity, carbon monoxide, peculiar smell and the like can be realized by selecting the equipment of the sensor as monitoring equipment, and further the cleaning equipment is ensured to be capable of actively cleaning.
Step 200, if a preset cleaning mode is identified based on the detection parameters, controlling the indoor cleaning equipment to perform active cleaning work based on the cleaning mode;
specifically, the preset cleaning mode may be a first cleaning mode included in several fixed cleaning modes preset by the cleaning device, or may be several second cleaning modes including cleaning logic steps preset according to each detection parameter in the execution body of the digital twin-based device control method of the present application, where the first cleaning mode may be the same as or different from the second cleaning mode.
In an embodiment, in order to realize active cleaning of the cleaning device, the execution body of the digital twin-based device control method in the present application obtains cleaning parameters of various cleaning modes of the cleaning device in advance, such as the number of times of back-and-forth cleaning, the cleaning force, the cleaning duration, the cleaning mode, etc., and sets detection parameters corresponding to each cleaning mode according to the cleaning parameters of the various cleaning modes, such as the cleaning modes with large values for the number of times of back-and-forth cleaning, the cleaning force, the cleaning duration, etc., and the parameter values of the corresponding detection parameters of the same kind are also large, and in addition, the parameter types of the corresponding detection parameters of the cleaning modes of different cleaning modes are also different. If the fluctuation range of the odor concentration is too large, the liquid with odor can be judged to be scattered, and then the cleaning equipment is controlled to execute the cleaning mode.
In addition, under the condition that the preset cleaning mode is identified, the preset cleaning mode control instruction is issued to the cleaning equipment, and the space parameter of the target sensor is issued to the cleaning equipment, so that the cleaning is performed by directly reaching a destination according to the issued preset cleaning mode control instruction and the space parameter, the whole space cruising of the cleaning equipment is avoided, and the electricity saving of the intelligent household equipment is realized.
And 300, if the preset cleaning mode is not identified based on the detection parameters, controlling the cleaning equipment to perform active cleaning work based on the indoor target image module and/or the indoor target voice module.
The target image module is an image module of target intelligent household equipment which is located in the same indoor space as the target sensor; the target voice module is a voice module of target intelligent household equipment which is located in the same indoor space as the target sensor.
In practical application, a plurality of smart home devices are respectively disposed in a plurality of indoor spaces, such as N spaces in a living room, a bedroom, a study room, etc. The same indoor space in the application can be a pre-divided fixed indoor space in the same living room, the same bedroom, the same study room and the like, and can also be a flexible indoor space with the distance between the target sensors smaller than the preset interval distance.
Specifically, the target image module mainly comprises a camera device, such as a home security monitor, a sound box with a camera, a camera device of intelligent household equipment such as a refrigerator with a screen and the like, and the target voice module mainly comprises voice equipment such as a microphone and the like with voice interaction capability, such as voice equipment of intelligent household equipment such as a home security monitor, a sound box capable of working based on voice instructions, an air conditioner, a range hood and the like.
In the application, under the condition that the preset cleaning model is not recognized based on the sensor, image acquisition is performed based on the target image module, and voice information acquisition can be performed based on the target voice module, so that the cleaning equipment is controlled to perform active cleaning work according to an image acquisition result or a voice information acquisition result.
In practical application, the position of the sensor of the intelligent household equipment installed indoors may be too high or too low, or an obstacle is placed around the intelligent household equipment, so that the detection parameter of the sensor exceeds the normal detection parameter range corresponding to the preset cleaning mode, for example, the parameter is too high or too low, and therefore in order to avoid the situation that the detection accuracy is low due to the fact that the sensor is influenced by the installation position or the surrounding obstacle, the detection parameter is not identified to be preset in the indoor space based on the detection parameter.
According to the digital twin-based equipment control method, detection parameters uploaded by an indoor target sensor are acquired, the target sensor is a sensor of an indoor intelligent household device, and under the condition that a preset cleaning mode is identified based on the detection parameters, the indoor cleaning equipment is controlled to perform active cleaning work based on the cleaning mode; or under the condition that a preset cleaning mode is not recognized based on detection parameters, the cleaning equipment is controlled to perform active cleaning based on the indoor target image module and/or the target voice module, and as the target image module and the target voice module are modules of the target intelligent household equipment in the same indoor space as the target sensor, the cleaning equipment can be controlled to perform active cleaning according to the perception information of the three perception modules in the same indoor space under the condition that the instruction sent by a user is not received, the cleaning equipment does not need to perform passive cleaning according to the cleaning instruction issued by the user, the initiative of the cleaning equipment is improved, and the experience of the user is further improved.
Based on the above embodiment, step 300 includes:
Determining a first target cleaning mode and a first target cleaning space parameter corresponding to the cleaning equipment based on a dirt recognition result and a dirt space parameter reported by the indoor target image module, and controlling the cleaning equipment to actively clean according to the first target cleaning mode and the first target cleaning space parameter;
or, receiving a second target cleaning mode corresponding to the cleaning equipment and input by a user based on the indoor target voice module, and controlling the cleaning equipment to perform active cleaning according to the second target cleaning mode and a second target cleaning space parameter corresponding to the detection parameter.
Specifically, the dirty identification result is an image of the indoor space corresponding to the detection parameter uploaded by the shot target sensor and reported by the target image module, and the dirty space parameter may be a space parameter of the target image module or a space parameter of a space where the dirty is located.
After the dirt identification result and the dirt space parameters are obtained, the image is subjected to fuzzy identification through an image classification algorithm, whether dirt exists in the image is judged, after the dirt in the image is identified, the image is further subjected to accurate identification, and dirt parameters used for representing the dirt properties such as dirt types, dirt object properties, dirt sizes and the like, for example, spilled liquid, carpets spilled with the liquid and the size of a spilled liquid region are identified. And then determining a first target cleaning mode according to the dirt parameters, and determining the first target cleaning space parameters according to the dirt space parameters.
In addition, besides photographing the indoor space corresponding to the detection parameter uploaded by the target sensor according to the target image module, a second target cleaning mode input by a user can be actively acquired according to the target voice module, so that active cleaning work of the cleaning equipment is realized.
According to the digital twin-based equipment control method, through secondary identification of the target image module of the target intelligent home equipment which is located in the same indoor space as the target sensor or the target voice module of the target intelligent home equipment which is located in the same indoor space as the target sensor, the real-time requirement of indoor burstiness is timely perceived from multiple dimensions, indoor sanitation cleaning is ensured to be actively carried out by cleaning equipment, the space parameters are actively reported by the target sensor, the target image module and the target voice module, the cleaning equipment is in sanitary cleaning at the space parameters which are directly reported after receiving the instruction, and whole space cruising is not needed, so that electricity is saved.
Based on the above embodiment, step 300 further includes:
under the condition that the dirt recognition result and the dirt space parameter reported by the indoor target image module are not received, receiving a second target cleaning mode corresponding to the cleaning equipment and input by a user based on the indoor target voice module;
And controlling the cleaning equipment to perform active cleaning according to the second target cleaning mode and the second target cleaning space parameter corresponding to the detection parameter.
In this step, unlike the above embodiment, in order to avoid that the target image module and the target voice module are occupied, normal operation of other smart home devices is affected. In this embodiment, the indoor space corresponding to the detection parameter uploaded by the target sensor is photographed based on the indoor target image module, and the second target cleaning mode is determined based on the target voice module when the dirt recognition result and the dirt space parameter reported by the target image module are not received.
The condition that the indoor dirty identification result and the dirty space parameter reported by the target image module are not received includes that the relevant dirty identification result and the dirty space parameter reported by the target image target are not received within a preset time range, and the condition that the relevant dirty identification result and the dirty space parameter reported by the target image target are received within the preset time range, but the dirty identification result is empty or dirty identification is unclear.
In practical application, under the condition that the related dirt recognition result and the dirt space parameter are not received by the target image target within the preset time range, the user voice can be monitored in real time based on the target voice module, and the cleaning equipment is controlled to perform active cleaning work under the condition that the second target cleaning mode corresponding to the cleaning equipment input by the user is monitored. And when the related dirt recognition result and the dirt space parameter are reported by the target image target received within the preset time range, but the dirt recognition result is empty or the dirt recognition is unclear, the user can be actively inquired about the cleaning requirement based on the target voice module, and whether the cleaning and the second target cleaning mode are needed or not is determined through voice interaction of the target voice module.
According to the digital twin-based equipment control method, the indoor target image module is firstly used for identification, and under the condition that the dirt identification result and the dirt space parameter reported by the indoor target image module are not received, the second target cleaning mode corresponding to the cleaning equipment input by the user is received based on the indoor target voice module, so that the cleaning equipment is used for actively cleaning under the condition that the normal work of other intelligent household equipment is prevented from being influenced.
Based on any of the above embodiments, step 300 further includes:
and receiving a voice command input by a user based on the indoor target voice module, analyzing the voice command, and determining a second target cleaning mode corresponding to the voice command.
In the step, when the second target cleaning mode is determined based on the indoor target voice module, the second target cleaning mode input by the user through the voice instruction can be directly received by monitoring the voice of the user in real time based on the target voice module.
Based on any of the above embodiments, step 300 further includes:
and sending a user cleaning request based on the indoor target voice module, receiving voice information input by the user cleaning request user, analyzing the voice information, and determining a second target cleaning mode corresponding to the voice information.
In this embodiment, a user cleaning request may be actively sent to actively ask the user for cleaning requirements, and whether cleaning and the second target cleaning mode are needed is determined through voice interaction of the target voice module, so that the flexibility of target voice module recognition is improved.
Based on any of the above embodiments, step 300 further includes:
determining a current position parameter of the cleaning equipment;
traversing each pre-stored cleaning track route based on the current position parameter and the first target cleaning space parameter to obtain a first cleaning track traversing result;
and when the first cleaning track traversing result shows that a first target cleaning track route is matched with the current position parameter and the first target cleaning space parameter, sending a cleaning instruction carrying the first target cleaning track route and the first target cleaning mode to the cleaning equipment.
Specifically, the pre-stored cleaning track route may be a cleaning track route stored in the cleaning apparatus, or may be a cleaning track route that is additionally set by the user himself.
Because the cleaning track route is a route formed by a plurality of track points, in the implementation, the current position parameter and the position difference between the first target cleaning space parameter and the position parameters of a plurality of track points in the pre-stored cleaning track route are traversed, when the position difference between the current position parameter and the first target cleaning space parameter is smaller than the preset position difference or the position difference between the current position parameter and the first target cleaning space parameter is smaller than the preset position difference, the cleaning track route corresponding to the target track point is selected as the first target cleaning track route, and a new cleaning track route can be regenerated according to the target track point, the current position parameter and the first target cleaning space parameter to be used as the first target cleaning track route.
In addition, in another embodiment, the current position parameter and the first target cleaning space parameter of the cleaning device may be issued to the cleaning device, and the cleaning device may perform processing according to the current position parameter and the first target cleaning space parameter by itself, which is not limited in this embodiment.
Based on any of the above embodiments, step 300 further includes:
determining a current position parameter of the cleaning equipment; traversing each pre-stored cleaning track route based on the current position parameter and the second target cleaning space parameter to obtain a second cleaning track traversing result;
and when the second cleaning track traversing result shows that a second target cleaning track route is matched with the current position parameter and the second target cleaning space parameter, sending a cleaning instruction carrying the second target cleaning track route and the second target cleaning mode to the cleaning equipment.
Specifically, the pre-stored cleaning track route may be a cleaning track route stored in the cleaning apparatus, or may be a cleaning track route that is additionally set by the user himself.
In this step, the processing procedure of the second target cleaning track route is consistent with that of the first target cleaning track route, and in this embodiment, the description is represented by the first target cleaning track route, which is not repeated here.
According to the digital twin-based equipment control method, all the prestored cleaning track routes are traversed based on the current position parameter and the first target cleaning space parameter (the second target cleaning space parameter), so that the determination of the target cleaning track route of the cleaning equipment is accelerated through the prestored cleaning track route, and the active cleaning speed of the cleaning equipment is accelerated.
Based on any of the above embodiments, the preset cleaning mode in the present application is obtained based on the following method:
determining the parameter fluctuation amplitude and the parameter type of the detection parameter;
and under the condition that the parameter fluctuation amplitude reaches the preset parameter fluctuation amplitude range corresponding to the parameter type, determining the preset cleaning mode corresponding to the detection parameter based on a mapping table of the sensing parameter corresponding to the parameter type and the preset cleaning mode.
Specifically, the parameter fluctuation range may be a fluctuation range with respect to the detected parameter detected at the previous time, or may be a fluctuation range with respect to a minimum parameter or a maximum parameter within a normal parameter range set by the user.
In practical application, because the sensor types of the smart home equipment are various, and the precision and the space height of each sensor are inconsistent, in order to ensure the accuracy of the detection result, in the implementation, the detection parameters collected by each type of sensor are preset and provided with the respective matched preset parameter fluctuation range and the mapping table of the sensing parameter-preset cleaning mode, so that the preset cleaning mode corresponding to each detection parameter can be accurately identified.
In addition, under the condition that the detection parameters uploaded by the target sensors in the same indoor space are multiple, and the preset cleaning modes determined based on the multiple detection parameters are different, the cleaning mode with the strongest cleaning strength in the preset cleaning modes is selected to control the cleaning mode to perform active cleaning. In addition, under the condition that detection parameters uploaded by target sensors in different indoor spaces exist, the cleaning equipment is sequentially controlled to conduct active cleaning according to the parameter sizes of the detection parameters, so that the flexibility of the cleaning equipment is improved, and the user experience is improved.
The device control device based on digital twin provided by the application is described below, and the cleaning device active cleaning device described below and the device control method based on digital twin described above can be referred to correspondingly. As shown in fig. 2, the apparatus includes:
an obtaining unit 210, configured to obtain a detection parameter uploaded by an indoor target sensor, where the target sensor is a sensor of the indoor installed smart home device;
a first control unit 220, configured to control the indoor cleaning device to perform an active cleaning operation based on the cleaning mode if the preset cleaning mode is identified based on the detection parameter;
The second control unit 230 is configured to control the cleaning device to perform an active cleaning operation based on the indoor target image module and/or the indoor target voice module if the preset cleaning mode is not identified based on the detection parameter;
the target image module is an image module of target intelligent household equipment which is located in the same indoor space as the target sensor;
the target voice module is a voice module of target intelligent household equipment which is located in the same indoor space as the target sensor.
According to the device control device based on digital twinning, through obtaining the detection parameters uploaded by the indoor target sensor, the target sensor is a sensor of the intelligent household device installed indoors, and under the condition that a preset cleaning mode is identified based on the detection parameters, the indoor cleaning device is controlled to conduct active cleaning work based on the cleaning mode; or under the condition that a preset cleaning mode is not recognized based on detection parameters, the cleaning equipment is controlled to perform active cleaning based on the indoor target image module and/or the target voice module, and as the target image module and the target voice module are modules of the target intelligent household equipment in the same indoor space as the target sensor, the cleaning equipment can be controlled to perform active cleaning according to the perception information of the three perception modules in the same indoor space under the condition that the instruction sent by a user is not received, the cleaning equipment does not need to perform passive cleaning according to the cleaning instruction issued by the user, the initiative of the cleaning equipment is improved, and the experience of the user is further improved.
Based on any one of the above embodiments, the second control unit 230 is further configured to determine a first target cleaning mode and a first target cleaning space parameter corresponding to the cleaning device based on a dirty identification result and a dirty space parameter reported by the indoor target image module, and control the cleaning device to perform an active cleaning operation according to the first target cleaning mode and the first target cleaning space parameter;
or, receiving a second target cleaning mode corresponding to the cleaning equipment and input by a user based on the indoor target voice module, and controlling the cleaning equipment to perform active cleaning according to the second target cleaning mode and a second target cleaning space parameter corresponding to the detection parameter.
Based on any one of the above embodiments, the second control unit 230 is further configured to receive, based on the indoor target voice module, a second target cleaning mode corresponding to the cleaning device input by the user, where the result of the dirty identification and the dirty space parameter reported by the indoor target image module are not received;
and controlling the cleaning equipment to perform active cleaning according to the second target cleaning mode and the second target cleaning space parameter corresponding to the detection parameter.
Based on any of the foregoing embodiments, the second control unit 230 is further configured to receive a voice command input by a user based on the indoor target voice module, analyze the voice command, and determine a second target cleaning mode corresponding to the voice command.
Based on any of the above embodiments, the second control unit 230 is further configured to send a user cleaning request based on the indoor target voice module, receive voice information input by the user cleaning request user, parse the voice information, and determine a second target cleaning mode corresponding to the voice information.
Based on any of the above embodiments, the second control unit 230 is further configured to determine a current position parameter of the cleaning apparatus;
traversing each pre-stored cleaning track route based on the current position parameter and the first target cleaning space parameter to obtain a first cleaning track traversing result;
transmitting a cleaning instruction carrying the first target cleaning track route and the first target cleaning mode to the cleaning equipment when the first cleaning track traversing result shows that a first target cleaning track route is matched with the current position parameter and the first target cleaning space parameter;
Based on any of the above embodiments, the second control unit 230 is further configured to determine a current position parameter of the cleaning apparatus; traversing each pre-stored cleaning track route based on the current position parameter and the second target cleaning space parameter to obtain a second cleaning track traversing result;
and when the second cleaning track traversing result shows that a second target cleaning track route is matched with the current position parameter and the second target cleaning space parameter, sending a cleaning instruction carrying the second target cleaning track route and the second target cleaning mode to the cleaning equipment.
Based on any of the above embodiments, the first control unit 220 is further configured to:
determining the parameter fluctuation amplitude and the parameter type of the detection parameter;
and under the condition that the parameter fluctuation amplitude reaches the preset parameter fluctuation amplitude range corresponding to the parameter type, determining the preset cleaning mode corresponding to the detection parameter based on a mapping table of the sensing parameter corresponding to the parameter type and the preset cleaning mode.
Based on any of the above embodiments, fig. 3 is a schematic structural diagram of a digital twin-based device control system provided in the present application, as shown in fig. 3, where the system includes: the cleaning device 310, the multi-modal sensing module 320 and the cloud brain module 330;
The multi-mode sensing module 320 includes an intelligent home device with a sensor, an intelligent home device with an image module, and an intelligent home device with a voice module;
the sensor comprises at least one of an odor sensor, a humidity sensor, a temperature sensor and a carbon monoxide sensor.
Specifically, the control logic of the digital twin-based device control system provided by the application is as follows:
the cloud brain module 330 acquires detection parameters through a target sensor in the indoor multi-mode sensing module 320, if the cloud brain module 330 recognizes a preset cleaning mode based on the detection parameters, the cleaning device 310 in the room is controlled to perform active cleaning work based on the cleaning mode, and if the cloud brain module 330 does not recognize the preset cleaning mode based on the detection parameters, the cleaning device 310 is controlled to perform active cleaning work based on a target image module in the indoor multi-mode sensing module 320 and/or a target voice module in the multi-mode sensing module 320;
the target image module is an image module of target intelligent household equipment which is located in the same indoor space as the target sensor;
the target voice module is a voice module of target intelligent household equipment which is located in the same indoor space as the target sensor.
According to the cleaning equipment active cleaning system provided by the embodiment of the application, the cleaning equipment 310, the multi-mode sensing module 320 and the cloud brain module 330 cooperate with each other to realize the cleaning equipment active cleaning system with higher precision, and because the multi-mode sensing module 320 in the system actively reports the space parameters and the detection parameters, the cleaning equipment 310 receives the instructions and then directly reaches the target space for sanitary cleaning according to the route planning, and the whole space is not required to cruise, so that electricity is saved
Based on any of the above embodiments, fig. 4 illustrates a physical schematic diagram of an electronic device, and as shown in fig. 4, the electronic device may include: processor 410, communication interface (Communications Interface) 420, memory 430 and communication bus 440, wherein processor 410, communication interface 420 and memory 430 communicate with each other via communication bus 440. The processor 410 may invoke logic instructions in the memory 430 to perform a digital twinning based device control method comprising: acquiring detection parameters uploaded by an indoor target sensor, wherein the target sensor is a sensor of intelligent household equipment installed indoors; if a preset cleaning mode is identified based on the detection parameters, controlling the indoor cleaning equipment to perform active cleaning work based on the cleaning mode; if the preset cleaning mode is not recognized based on the detection parameters, controlling the cleaning equipment to perform active cleaning work based on the indoor target image module and/or the indoor target voice module; the target image module is an image module of target intelligent household equipment which is located in the same indoor space as the target sensor; the target voice module is a voice module of target intelligent household equipment which is located in the same indoor space as the target sensor.
Further, the logic instructions in the memory 430 described above may be implemented in the form of software functional units and may be stored in a computer-readable storage medium when sold or used as a stand-alone product. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Based on any one of the embodiments, the application further provides an interaction method of the intelligent home equipment. The interaction method of the intelligent household equipment is widely applied to full-house intelligent digital control application scenes such as intelligent Home (Smart Home), intelligent Home, intelligent household equipment ecology, intelligent Home (Intelligence House) ecology and the like. Alternatively, in the present embodiment, the above-described interaction method of smart home devices may be applied to a hardware environment formed by the terminal device 501 and the server 502 as shown in fig. 5. As shown in fig. 5, a server 502 is connected to a terminal device 501 through a network, and may be used to provide services (such as application services and the like) for a terminal or a client installed on the terminal, a database may be set on the server or independent of the server, to provide data storage services for the server 502, and cloud computing and/or edge computing services may be configured on the server or independent of the server, to provide data operation services for the server 502.
The network may include, but is not limited to, at least one of: wired network, wireless network. The wired network may include, but is not limited to, at least one of: a wide area network, a metropolitan area network, a local area network, and the wireless network may include, but is not limited to, at least one of: WIFI (Wireless Fidelity ), bluetooth. The terminal device 501 may not be limited to a PC, a mobile phone, a tablet computer, an intelligent air conditioner, an intelligent smoke machine, an intelligent refrigerator, an intelligent oven, an intelligent cooking range, an intelligent washing machine, an intelligent water heater, an intelligent washing device, an intelligent dish washer, an intelligent projection device, an intelligent television, an intelligent clothes hanger, an intelligent curtain, an intelligent video, an intelligent socket, an intelligent sound box, an intelligent fresh air device, an intelligent kitchen and toilet device, an intelligent bathroom device, an intelligent sweeping robot, an intelligent window cleaning robot, an intelligent mopping robot, an intelligent air purifying device, an intelligent steam box, an intelligent microwave oven, an intelligent kitchen appliance, an intelligent purifier, an intelligent drinking fountain, an intelligent door lock, and the like.
In another aspect, the present application further provides a computer program product, where the computer program product includes a computer program, where the computer program can be stored on a computer readable storage medium, where the computer program, when executed by a processor, can perform a digital twin-based device control method provided by the above methods, where the method includes: acquiring detection parameters uploaded by an indoor target sensor, wherein the target sensor is a sensor of intelligent household equipment installed indoors; if a preset cleaning mode is identified based on the detection parameters, controlling the indoor cleaning equipment to perform active cleaning work based on the cleaning mode; if the preset cleaning mode is not identified based on the detection parameters, controlling the cleaning equipment to perform active cleaning work based on the indoor target image module and/or the indoor target voice module; the target image module is an image module of target intelligent household equipment which is located in the same indoor space as the target sensor; the target voice module is a voice module of target intelligent household equipment which is located in the same indoor space as the target sensor.
In still another aspect, the present application further provides a computer readable storage medium, where the computer readable storage medium includes a stored program, where the program when executed performs the method for controlling a digital twin-based device provided by the above methods, where the method includes: acquiring detection parameters uploaded by an indoor target sensor, wherein the target sensor is a sensor of intelligent household equipment installed indoors; if the preset cleaning mode is identified based on the detection parameters, controlling the indoor cleaning equipment to perform active cleaning work based on the cleaning mode; if the preset cleaning mode is not identified based on the detection parameters, controlling the cleaning equipment to perform active cleaning work based on the indoor target image module and/or the indoor target voice module; the target image module is an image module of target intelligent household equipment which is located in the same indoor space as the target sensor; the target voice module is a voice module of target intelligent household equipment which is located in the same indoor space as the target sensor.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and are not limiting thereof; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the corresponding technical solutions.

Claims (11)

1. A digital twinning-based device control method, comprising:
acquiring detection parameters uploaded by an indoor target sensor, wherein the target sensor is a sensor of intelligent household equipment installed indoors;
if a preset cleaning mode is identified based on the detection parameters, controlling the indoor cleaning equipment to perform active cleaning work based on the cleaning mode;
if the preset cleaning mode is not identified based on the detection parameters, controlling the cleaning equipment to perform active cleaning work based on the indoor target image module and/or the indoor target voice module;
the target image module is an image module of target intelligent household equipment which is located in the same indoor space as the target sensor;
the target voice module is a voice module of target intelligent household equipment which is located in the same indoor space as the target sensor.
2. The digital twin based device control method according to claim 1, wherein the controlling the cleaning device to perform the active cleaning operation based on the indoor target image module and/or the target voice module comprises:
determining a first target cleaning mode and a first target cleaning space parameter corresponding to the cleaning equipment based on a dirt recognition result and a dirt space parameter reported by the indoor target image module, and controlling the cleaning equipment to actively clean according to the first target cleaning mode and the first target cleaning space parameter;
Or, receiving a second target cleaning mode corresponding to the cleaning equipment and input by a user based on the indoor target voice module, and controlling the cleaning equipment to perform active cleaning according to the second target cleaning mode and a second target cleaning space parameter corresponding to the detection parameter.
3. The digital twin based device control method according to claim 1, wherein the controlling the cleaning device to perform the active cleaning operation based on the indoor target image module and/or the target voice module further comprises:
under the condition that the dirt recognition result and the dirt space parameter reported by the indoor target image module are not received, receiving a second target cleaning mode corresponding to the cleaning equipment and input by a user based on the indoor target voice module;
and controlling the cleaning equipment to perform active cleaning according to the second target cleaning mode and the second target cleaning space parameter corresponding to the detection parameter.
4. A digital twin based device controlling method according to claim 2 or 3, wherein the receiving, by the indoor based target voice module, a second target cleaning mode corresponding to the cleaning device input by a user, comprises:
And receiving a voice command input by a user based on the indoor target voice module, analyzing the voice command, and determining a second target cleaning mode corresponding to the voice command.
5. A digital twin based device controlling method according to claim 2 or 3, wherein the receiving, by the indoor based target voice module, a second target cleaning mode corresponding to the cleaning device input by a user, comprises:
and sending a user cleaning request based on the indoor target voice module, receiving voice information input by the user cleaning request user, analyzing the voice information, and determining a second target cleaning mode corresponding to the voice information.
6. A digital twinning-based apparatus control method according to claim 2 or 3, wherein the controlling the cleaning apparatus to perform an active cleaning operation includes:
determining a current position parameter of the cleaning equipment;
traversing each pre-stored cleaning track route based on the current position parameter and the first target cleaning space parameter to obtain a first cleaning track traversing result;
and when the first cleaning track traversing result shows that a first target cleaning track route is matched with the current position parameter and the first target cleaning space parameter, sending a cleaning instruction carrying the first target cleaning track route and the first target cleaning mode to the cleaning equipment.
7. A digital twinning-based apparatus control method according to claim 2 or 3, wherein the controlling the cleaning apparatus to perform an active cleaning operation includes:
determining a current position parameter of the cleaning equipment; traversing each pre-stored cleaning track route based on the current position parameter and the second target cleaning space parameter to obtain a second cleaning track traversing result;
and when the second cleaning track traversing result shows that a second target cleaning track route is matched with the current position parameter and the second target cleaning space parameter, sending a cleaning instruction carrying the second target cleaning track route and the second target cleaning mode to the cleaning equipment.
8. The digital twinning-based apparatus control method according to any one of claims 1 to 7, wherein the preset purge mode is acquired based on:
determining the parameter fluctuation amplitude and the parameter type of the detection parameter;
and under the condition that the parameter fluctuation amplitude reaches the preset parameter fluctuation amplitude range corresponding to the parameter type, determining the preset cleaning mode corresponding to the detection parameter based on a mapping table of the sensing parameter corresponding to the parameter type and the preset cleaning mode.
9. A digital twinning-based plant control system, comprising: cleaning equipment, a multi-mode sensing module and a cloud brain module;
the multi-mode sensing module comprises intelligent home equipment with a sensor, intelligent home equipment with an image module and intelligent home equipment with a voice module;
the sensor comprises at least one of an odor sensor, a humidity sensor, a temperature sensor and a carbon monoxide sensor.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a stored program, wherein the program when run performs the digital twin-based device control method of any one of claims 1 to 8.
11. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to execute the digital twinning-based device control method according to any one of claims 1 to 8 by means of the computer program.
CN202210771931.6A 2022-06-30 2022-06-30 Equipment control method, system, medium and device based on digital twin Pending CN117369292A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210771931.6A CN117369292A (en) 2022-06-30 2022-06-30 Equipment control method, system, medium and device based on digital twin

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210771931.6A CN117369292A (en) 2022-06-30 2022-06-30 Equipment control method, system, medium and device based on digital twin

Publications (1)

Publication Number Publication Date
CN117369292A true CN117369292A (en) 2024-01-09

Family

ID=89387972

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210771931.6A Pending CN117369292A (en) 2022-06-30 2022-06-30 Equipment control method, system, medium and device based on digital twin

Country Status (1)

Country Link
CN (1) CN117369292A (en)

Similar Documents

Publication Publication Date Title
US20210160326A1 (en) Utilizing context information of environment component regions for event/activity prediction
CN102901180B (en) A kind of method and system controlling air-conditioning
CN105411491A (en) Home intelligent cleaning system and method based on environment monitoring
CN106325250A (en) Electric device coordinated control method and electric device coordinated control system based on information detection
CN108398886B (en) Household appliance control method, household appliance and Internet of things gateway
CN103389710B (en) A kind of environment of internet of things control method based on context aware and equipment
CN106813357B (en) Intelligent air purifying method and device, cloud system
WO2022227533A1 (en) Cleaning control method and apparatus, and air conditioner
KR101759196B1 (en) System and method for controlling smart appliances based on semantic modeling engine
CN113110085A (en) Intelligent home management system based on big data
CN109739097A (en) A kind of smart home robot and application thereof based on embedded type WEB
WO2019199365A2 (en) Utilizing context information of environment component regions for event/activity prediction
CN208312636U (en) Central air-conditioning monitoring system
CN113932315A (en) System and method for purifying air in toilet and air conditioning equipment
CN108600062A (en) Control method and device, the system of household appliance
CN117369292A (en) Equipment control method, system, medium and device based on digital twin
CN114915514B (en) Method and device for processing intention, storage medium and electronic device
CN110017573A (en) A kind of automation HVAC system
CN110286603A (en) The sending method and device of instruction information based on smart home operating system
CN115494737A (en) Control method of intelligent household appliance, storage medium and electronic device
CN114543302A (en) Control method and control system of smart home, electronic device and storage medium
CN116339303A (en) Method and device for automatically identifying environmental parameters
AU2020205651B2 (en) Carbon monoxide purge system for a property
CN111306714A (en) Air conditioner and control method thereof
CN110830339A (en) Intelligent home service system based on home brain

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination