CN112153137A - Multi-device linkage method and system - Google Patents

Multi-device linkage method and system Download PDF

Info

Publication number
CN112153137A
CN112153137A CN202010993364.XA CN202010993364A CN112153137A CN 112153137 A CN112153137 A CN 112153137A CN 202010993364 A CN202010993364 A CN 202010993364A CN 112153137 A CN112153137 A CN 112153137A
Authority
CN
China
Prior art keywords
equipment
internet
things
operation instruction
linkage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010993364.XA
Other languages
Chinese (zh)
Other versions
CN112153137B (en
Inventor
于士鹏
李斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics China R&D Center
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics China R&D Center
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics China R&D Center, Samsung Electronics Co Ltd filed Critical Samsung Electronics China R&D Center
Priority to CN202010993364.XA priority Critical patent/CN112153137B/en
Publication of CN112153137A publication Critical patent/CN112153137A/en
Application granted granted Critical
Publication of CN112153137B publication Critical patent/CN112153137B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H04L67/125Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16YINFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y40/00IoT characterised by the purpose of the information processing
    • G16Y40/30Control
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The application discloses multi-device linkage method and system, wherein the method comprises the following steps: when a preset event occurs in the Internet of things, the main equipment in the Internet of things triggers corresponding equipment in the Internet of things to collect and report current environmental characteristics according to a scene recommendation condition in a scene recommendation model corresponding to the event which is locally stored; judging whether the scene recommendation condition is met currently or not according to the environmental characteristics; the scene recommendation model comprises a scene trigger event, a scene recommendation condition and a linkage operation instruction set of a scene; if yes, the main device triggers the user to select whether to execute a device linkage operation instruction in the scene recommendation model; when a user selects to execute the equipment linkage operation instruction, the main equipment triggers corresponding equipment in the Internet of things to execute the equipment linkage operation instruction according to the locally stored equipment capacity information of each piece of equipment in the Internet of things. By the method and the device, the real-time performance of multi-device linkage can be improved, and the user information safety risk is reduced.

Description

Multi-device linkage method and system
Technical Field
The application relates to the technical field of Internet of things, in particular to a multi-device linkage method and system.
Background
With the increasingly wide application of the technology of the internet of things, the cloud platform of the internet of things can realize the access, control and management of equipment. The equipment is connected to the Internet of things cloud platform, so that remote control and data acquisition of the equipment are realized, and equipment linkage is realized. The equipment linkage refers to that when one or more equipment states meet a certain condition, the operation of one or more other equipment is triggered.
The inventor discovers that in the process of implementing the invention: the existing equipment linkage scheme has the problems of poor real-time performance, high user information safety risk and the like, and the specific reason analysis is as follows:
in the existing equipment linkage scheme, data and user information of intelligent equipment are collected by a cloud platform in a unified mode, and equipment linkage decision is made according to the collected data information and a preset scene. Because the scheme needs to be controlled and decided in a centralized manner by the cloud platform, when the number of the devices managed by the cloud platform is large, the processing pressure of the cloud platform is high, and accordingly, the linkage processing time delay is also large, so that the linkage real-time performance is influenced. Moreover, the cloud platform needs to collect information of the user to complete the linkage decision, so that the privacy of the user cannot be sufficiently guaranteed.
Disclosure of Invention
In view of the above, the present invention provides a multi-device linkage method and system, which can improve the real-time performance of multi-device linkage and reduce the risk of user information security.
In order to achieve the above purpose, the embodiment of the present invention provides a technical solution: .
A multi-device linkage method, comprising:
when a preset event occurs in the Internet of things, the main equipment in the Internet of things triggers corresponding equipment in the Internet of things to collect and report the current environmental characteristics according to a scene recommendation condition in a scene recommendation model corresponding to the event which is locally stored; judging whether the scene recommendation condition is met currently or not according to the environmental characteristics; the scene recommendation model comprises a scene trigger event, a scene recommendation condition and a device linkage operation instruction of a scene;
if the scene recommendation condition is met currently, the main device triggers a user to select whether to execute a device linkage operation instruction of the scene recommendation model;
when the user selects to execute the equipment linkage operation instruction, the main equipment triggers corresponding equipment in the Internet of things to execute the equipment linkage operation instruction according to locally stored equipment capacity information of each piece of equipment in the Internet of things.
Preferably, the triggering, by the master device in the internet of things, the device in the internet of things to collect and report the corresponding environmental characteristics according to the locally stored scene recommendation condition in the scene recommendation model corresponding to the event includes:
the main equipment informs corresponding equipment in the Internet of things of sensing environment information according to condition parameters in the scene recommendation conditions;
and the corresponding equipment senses the current environment according to the notification, converts a sensing result into an environment characteristic vector and then sends the environment characteristic vector to the main equipment.
Preferably, the triggering the corresponding device in the internet of things to execute the device linkage operation instruction includes:
for each operation instruction in the equipment linkage operation instruction, the main equipment judges whether the equipment executing the operation instruction can analyze the operation instruction according to the locally stored equipment capacity information, and if so, the operation instruction is directly sent to corresponding instruction execution equipment for execution; otherwise, triggering the equipment capable of analyzing the operation instruction to analyze the operation instruction, and sending the analysis result to corresponding instruction execution equipment for execution.
Preferably, the method further comprises:
and other devices except the main device in the Internet of things send own device capability information to the main device in advance.
Preferably, the method further comprises:
each device in the Internet of things calculates the comprehensive device capacity of the device according to each device capacity of the device and a preset corresponding capacity weight;
all the devices in the Internet of things exchange respective device comprehensive capabilities with each other;
and each device determines the main device in the Internet of things according to the comprehensive device capacity of each device in the Internet of things.
Preferably, the determining the master device in the internet of things includes:
and selecting the equipment corresponding to the maximum value of the comprehensive capacity of the equipment in the Internet of things as the main equipment of the Internet of things.
Preferably, the method further comprises:
and each device selects a device corresponding to the second largest value of the comprehensive capability of the device in the Internet of things as a secondary main device of the Internet of things in advance according to the comprehensive capability of the device of each device in the Internet of things.
Preferably, the method further comprises:
the main equipment synchronizes the linkage configuration information stored locally to the auxiliary main equipment when the linkage configuration information is initialized locally or changed; the linkage configuration information includes: the scene recommendation mode and the equipment capability information of each equipment in the Internet of things;
and the auxiliary main equipment detects the state of the main equipment in real time, sets the auxiliary main equipment as the main equipment and informs other equipment in the Internet of things when the main equipment is in an abnormal state, and executes the function of the main equipment according to the current linkage configuration information.
Preferably, the method further comprises:
and reporting the respective equipment capability information to the main equipment by other equipment except the main equipment in the Internet of things in advance.
Preferably, the method further comprises:
the scene recommendation model is trained in advance by a cloud server and sent to the main device.
Preferably, after the execution of the device linkage operation instruction is completed, the method further comprises:
if the user selects to execute the equipment linkage operation instruction, the main equipment feeds the equipment linkage operation instruction selected to be executed by the user when the event occurs back to the cloud server;
if the user selects not to execute the equipment linkage operation instruction, the main equipment feeds back the equipment linkage operation instruction which is not selected by the user to be executed when the event occurs and corresponding subsequent operation of the user to the cloud server;
and the cloud server optimizes the equipment linkage operation instruction in the scene recommendation model corresponding to the event according to the feedback.
The utility model provides a multi-device linkage system, includes the equipment in high in the clouds server and the thing networking, wherein:
the device is used for triggering the corresponding device in the Internet of things to collect and report the current environmental characteristics according to the scene recommendation conditions in the scene recommendation model corresponding to the locally stored events when the device is used as the main device and the preset events occur in the Internet of things; judging whether the scene recommendation condition is met currently or not according to the environmental characteristics; the scene recommendation model comprises a scene trigger event, a scene recommendation condition and a device linkage operation instruction of a scene; if the scene recommendation condition is met currently, triggering a user to select whether to execute a device linkage operation instruction of the scene recommendation model; when the user selects to execute the equipment linkage operation instruction, triggering corresponding equipment in the Internet of things to execute the equipment linkage operation instruction according to locally stored equipment capacity information of each equipment in the Internet of things.
Preferably, the device is specifically configured to, when serving as the master device, trigger the device in the internet of things to acquire and report corresponding environmental features according to a scene recommendation condition in a scene recommendation model corresponding to the event stored locally, and includes:
and notifying corresponding equipment in the Internet of things to sense environment information according to the condition parameters in the scene recommendation condition, and receiving an environment feature vector reported by the corresponding equipment, wherein the environment feature vector is obtained by sensing the current environment according to the notification and performing vector conversion on a sensing result by the corresponding equipment.
Preferably, the device is specifically configured to, when the device is the master device, trigger a corresponding device in the internet of things to execute the device linkage operation instruction, and includes:
for each operation instruction in the equipment linkage operation instructions, judging whether equipment executing the operation instruction can analyze the operation instruction according to the locally stored equipment capacity information, and if so, directly sending the operation instruction to corresponding instruction execution equipment for execution; otherwise, triggering the equipment capable of analyzing the operation instruction to analyze the operation instruction, and sending the analysis result to corresponding instruction execution equipment for execution.
Preferably, the device is further configured to send device capability information of the device to the master device in the internet of things in advance when the device is used as another device in the internet of things except for the master device.
Preferably, the device is further configured to calculate the device comprehensive capability of the device in advance according to each device capability of the device and a preset corresponding capability weight; exchanging respective device comprehensive capabilities with other devices in the Internet of things; and determining the main equipment in the Internet of things according to the comprehensive equipment capacity of each piece of equipment in the Internet of things.
Preferably, the device, specifically configured to determine a master device in the internet of things, includes: and selecting the equipment corresponding to the maximum value of the comprehensive capacity of the equipment in the Internet of things as the main equipment of the Internet of things.
Preferably, the device is further configured to select, according to the device comprehensive capability of each device in the internet of things, a device corresponding to a next largest value of the device comprehensive capability in the internet of things as a secondary master device of the internet of things.
Preferably, the device is further configured to, when serving as the master device, synchronize the locally stored linkage configuration information to the secondary master device when linkage configuration information is locally initialized or when the local linkage configuration information is changed; the linkage configuration information includes: the scene recommendation mode and the equipment capability information of each equipment in the Internet of things; when the main equipment is in an abnormal state, the main equipment is set as the main equipment and is informed to other equipment in the Internet of things, and the function of the main equipment is executed according to the current linkage configuration information.
Preferably, the device is further configured to report respective device capability information to the master device in advance when the device is used as another device in the internet of things except for the master device.
Preferably, the scene recommendation model is pre-trained by a cloud server and sent to the master device.
Preferably, the device is further configured to, when serving as the master device, after the device linkage operation instruction is executed, if the user selects to execute the device linkage operation instruction, feed back the device linkage operation instruction, which is selected to be executed by the user when the event occurs, to the cloud server; if the user selects not to execute the equipment linkage operation instruction, feeding back the equipment linkage operation instruction which is not selected to be executed by the user when the event occurs and corresponding subsequent operation of the user to the cloud server;
and the cloud server is further used for optimizing the equipment linkage operation instruction in the scene recommendation model corresponding to the event according to the feedback.
According to the technical scheme, when a preset event occurs in a scene, the current device linkage operation is determined and executed through the main device based on the preset scene recommendation model and the environmental characteristics acquired by each device in the Internet of things, so that the device linkage operation decision is made locally by the main device and the execution of the operation is controlled, on one hand, the real-time performance of multi-device linkage can be effectively improved, and on the other hand, the user information acquired by the devices does not need to be uploaded to the cloud platform, so that the problem of user information safety risk caused by information transmission and centralized storage to the cloud platform can be effectively avoided, and the user information safety risk is reduced.
Drawings
FIG. 1 is a schematic flow chart of a multi-device linkage method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a multi-device linkage system according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
Fig. 1 is a schematic flow diagram of a method according to an embodiment of the present invention, and as shown in fig. 1, the method for implementing multi-device linkage mainly includes:
step 101, when a preset event occurs in the internet of things, triggering corresponding equipment in the internet of things to collect and report current environmental characteristics by main equipment in the internet of things according to a scene recommendation condition in a scene recommendation model corresponding to the event which is locally stored; and judging whether the scene recommendation condition is met currently or not according to the environmental characteristics, wherein the scene recommendation model comprises a scene trigger event, a scene recommendation condition and a device linkage operation instruction of a scene.
In this step, when a preset event occurs, the main device finds a scene recommendation model matched with the event according to a locally stored scene recommendation model, that is, finds a scene recommendation model using the event as a scene trigger event, and triggers corresponding devices in the internet of things to acquire current environmental characteristics according to scene recommendation conditions in the scene recommendation model, so as to determine whether the current scene recommendation conditions of the scene recommendation model are met, so that a device linkage operation instruction in the scene recommendation model can be executed in time when the current environment meets the scene recommendation conditions. Therefore, the main device in the Internet of things makes a device linkage operation decision locally and triggers the execution of the device linkage operation instruction, on one hand, the real-time performance of multi-device linkage can be effectively improved, linkage time delay is reduced, and on the other hand, each device does not need to upload user information acquired by the device to the cloud platform, so that the problem of user information safety risk caused by information transmission and centralized storage to the cloud server can be effectively avoided, and the user information safety can be effectively guaranteed.
Preferably, in this step, the master device in the internet of things may trigger the devices in the internet of things to collect and report corresponding environmental characteristics according to the locally stored scene recommendation conditions in the scene recommendation model corresponding to the event by using the following method:
the main equipment informs corresponding equipment in the Internet of things of sensing environment information according to condition parameters in the scene recommendation conditions; and the corresponding equipment senses the current environment according to the notification, converts a sensing result into an environment characteristic vector and then sends the environment characteristic vector to the main equipment.
In the above method, the specific method for converting the sensed environmental information into the environmental feature vector by each device is known by those skilled in the art, and is not described herein again.
In practical applications, the perception capabilities that different devices have are associated with the actual functionality of the device. Specific perceptibility may relate to the following:
auditory perception: and acquiring a voice instruction of the user through a microphone to finish semantic understanding.
Visual perception: and image information is acquired through the camera, and vision-related data processing is completed.
Device perception: the peripheral device information may be obtained through BLE, Wi-Fi, UWB, and other technologies, but is not limited thereto.
And (3) motion perception: and acquiring relevant information such as actions and gestures of the user through the equipment sensor.
Position sensing: the indoor and outdoor position information of the device can be acquired through GNSS, Wi-Fi, UWB, but is not limited thereto.
Preferably, in order to further improve the efficiency of multi-device linkage, the following method may be adopted to select a device with the strongest comprehensive capability from the internet as the master device in the internet of things:
and step x1, each device in the Internet of things calculates the comprehensive device capacity of the device according to each device capacity of the device and the preset corresponding capacity weight.
Preferably, the types of the device capabilities may specifically include service capabilities, operation capabilities, and power supply modes of the device.
And step x2, exchanging respective device comprehensive capabilities among all devices in the Internet of things.
Step x3, determining, by each device, a master device in the internet of things according to the device comprehensive capacity of each device in the internet of things.
Preferably, in the step x3, the device with the maximum device combination capability may be selected as the master device, that is, the device corresponding to the maximum device combination capability in the internet of things is selected as the master device of the internet of things.
Preferably, in order to reduce the computational overhead of the host device, the scene recommendation model may be pre-trained by the cloud server and sent to the host device. The specific training method is known to those skilled in the art and will not be described herein. Further, the scene recommendation model may further include an abstract definition of a scene, so as to effectively distinguish different scenes based on the abstract definition.
And 102, if the scene recommendation condition is met currently, triggering a user to select whether to execute the equipment linkage operation instruction of the scene recommendation model by the main equipment.
Here, when it is determined in step 101 that the scene recommendation condition of the scene corresponding to the event is currently satisfied, the user is prompted in this step to select whether to execute the corresponding device linkage operation instruction, so that when the user selects execution, the execution of the device linkage operation instruction is triggered in time to respond to the event detected in step 101.
103, when the user selects to execute the device linkage operation instruction, the main device triggers the corresponding device in the internet of things to execute the device linkage operation instruction according to the locally stored device capability information of each device in the internet of things.
Preferably, in order to reduce the linkage control delay to the maximum extent, the following method may be adopted to trigger the corresponding devices in the internet of things to execute the device linkage operation instructions:
for each operation instruction in the equipment linkage operation instruction, the main equipment judges whether the equipment executing the operation instruction can analyze the operation instruction according to the locally stored equipment capacity information, and if so, the operation instruction is directly sent to corresponding instruction execution equipment for execution; otherwise, triggering the equipment capable of analyzing the operation instruction to analyze the operation instruction, and sending the analysis result to corresponding instruction execution equipment for execution.
According to the method, the main device learns whether each instruction execution device corresponding to the device linkage operation instruction has corresponding instruction analysis capability or not according to the service capability in the device capability information of each device stored locally, when the device does not have the analysis capability, the corresponding linkage operation instruction is not sent to the device for execution, but the instruction is analyzed by the device with the analysis capability and then sent to the corresponding execution device for execution, so that smooth execution of the linkage operation instruction of each device can be ensured, and the problem of linkage instruction execution failure caused by the fact that the execution device cannot execute the instruction is avoided.
Preferably, in order to facilitate the master device to accurately make a device linkage operation decision, the other devices in the internet of things except the master device may send their own device capability information to the master device in advance. When the master device receives the device capability information of each device, the mapping relationship between the device capability and the devices can be established in a manner of generating a capability tree, so as to store the device capability information of all the devices.
Preferably, in order to improve the robustness of the coordinated control, a secondary master device may be selected from the internet of things, and when the master device operates abnormally, the secondary master device takes on the function of the master device to ensure the normal operation of the coordinated control, and specifically, the following method may be adopted to achieve this purpose:
the main equipment synchronizes the linkage configuration information stored locally to the auxiliary main equipment when the linkage configuration information is initialized locally or changed; the linkage configuration information includes: the scene recommendation mode and the equipment capability information of each equipment in the Internet of things;
and the auxiliary main equipment detects the state of the main equipment in real time, sets the auxiliary main equipment as the main equipment and informs other equipment in the Internet of things when the main equipment is in an abnormal state, and executes the function of the main equipment according to the current linkage configuration information.
Preferably, in order to improve the exception handling capability of the secondary master device, the following method may be adopted to select one secondary master device from the internet of things:
and each device in the Internet of things selects a device corresponding to the second largest value of the comprehensive capability of the device in the Internet of things as a secondary main device of the Internet of things according to the comprehensive capability of the device of each device in the network in advance.
Preferably, after the device linkage operation instruction is executed, whether the selection and subsequent operations of the user are executed according to the current device linkage operation instruction can be fed back to the cloud server, so that the cloud server can intelligently optimize the scene recommendation model according to the actual operations of the user, and the scene recommendation model is more matched with the actual needs of the user, and specifically, the following method can be adopted to achieve the purpose:
if the user selects to execute the equipment linkage operation instruction, the main equipment feeds the equipment linkage operation instruction selected to be executed by the user when the event occurs back to the cloud server;
if the user selects not to execute the equipment linkage operation instruction, the main equipment feeds back the equipment linkage operation instruction which is not selected by the user to be executed when the event occurs and corresponding subsequent operation of the user to the cloud server;
and the cloud server optimizes the equipment linkage operation instruction in the scene recommendation model corresponding to the event according to the feedback.
The optimization is to revise the device linkage operation instructions in the corresponding scene recommendation model according to the actual operation of the user, if the user selects to execute the device linkage operation instructions in the scene recommendation model, the device linkage operation instructions can be rewarded to strengthen the device linkage operation instructions, if the user does not select to execute the device linkage operation instructions in the scene recommendation model, the device linkage operation instructions can be punished, the operation of the user to the event actually selected and executed is recorded, and when the operation is accumulated to a certain degree, the device linkage operation instructions in the scene recommendation model are revised to the linkage operation currently and actually selected by the user. In particular, in practical applications, a suitable optimization strategy can be selected by those skilled in the art according to actual needs.
According to the technical scheme, the operation capability of the edge device is utilized, the main device in the Internet of things makes a device linkage operation decision locally and controls the execution of the operation, so that the real-time performance of multi-device linkage can be effectively improved, and the information safety risk of a user can be effectively reduced. The following further illustrates a specific implementation of the above method embodiment through a specific application scenario.
1. The intelligent devices (mobile phones, televisions, intelligent sound boxes, flat panels, refrigerators, air conditioners, watches, wireless earphones and the like) are interconnected through local routers, and the networking process is completed through manual registration or automatic matching discovery of users.
2. The intelligent devices exchange device capabilities with each other, and according to the device capabilities and the capability weights, a master device, an auxiliary master device and a slave device are selected, for example, a mobile phone is used as the master device, a sound box is used as the auxiliary master device, and the rest are the slave devices.
3. The slave device sends the device capability to the master device, and the master device establishes a mapping relation between the capability and the device in the form of a capability tree. The auxiliary main equipment is responsible for synchronizing the information of the main equipment, detecting the state of the main equipment in real time and bearing the responsibility of the main equipment when the main equipment is abnormal.
4. And synchronizing the scene recommendation model by the main equipment from the cloud server.
The scene recommendation model is defined and trained in the cloud server, the original model is composed of Trigger, Concept and Action, Trigger is an event triggering the scene recommendation model, Concept can be understood as a prerequisite condition of Action execution, Action is an executed operation, and State is abstract expression of environment and feature information converted into the operation.
5. When a device (which may be a master device, a slave master device, or a slave device) in the system receives a Trigger event, for example, a mobile phone receives an incoming call, the incoming call may be used as a Trigger event.
6. The mobile phone can judge the position information (living room), whether the Bluetooth headset is connected (not connected), the action of a user (ready for answering), the position information, the state of the Bluetooth headset and the return value of the gravity sensor can be used as a Concept, and when the preset condition of the model is achieved, the mobile phone is triggered to start to acquire the states of other intelligent devices in the living room. The operation of this scan is an Action.
7. If the smart television and the sound box are arranged in the living room at present, if the television is started up at present, live programs are played; the smart speaker is currently powered on and broadcasting is being performed. The television and the sound box process own information into a characteristic vector through the characteristic processing unit by the own environment sensing unit and transmit the characteristic vector to the mobile phone.
8. The mobile phone prompts a user whether to mute the television and the sound box or not according to the feature vectors returned by the peripheral equipment, which is a scene recommended by the system and provided with multiple equipment in cooperation.
9. And selecting by the user, uploading the selection result to the cloud server in combination with the environment characteristic vector returned by the peripheral equipment, and further optimizing the model. The user confirms that the result is positive; the user cancels, and the result is negative.
10. If the user confirms, a series of actions defined in advance in the scene, such as television mute and sound box mute, are used for searching the equipment capability tree, and if the mobile phone end has an IoT Control function, the two actions of television mute and sound box mute can be handed to the mobile phone end for processing; preferably, when the television and the loudspeaker box have the function of analyzing the Action, the Action can be distributed to the television and the loudspeaker box and processed by the television and the loudspeaker box.
11. The television and the sound box receive the Action distributed by the mobile phone and execute the mute operation through the Action execution unit
Corresponding to the above method embodiment, the present application further provides a multi-device linkage system, as shown in fig. 2, the system includes a cloud server and devices in the internet of things, wherein:
the device is used for triggering the corresponding device in the Internet of things to collect and report the current environmental characteristics according to the scene recommendation conditions in the scene recommendation model corresponding to the locally stored events when the device is used as the main device and the preset events occur in the Internet of things; judging whether the scene recommendation condition is met currently or not according to the environmental characteristics; the scene recommendation model comprises a scene trigger event, a scene recommendation condition and a device linkage operation instruction of a scene; if the scene recommendation condition is met currently, triggering a user to select whether to execute a device linkage operation instruction of the scene recommendation model; when the user selects to execute the equipment linkage operation instruction, triggering corresponding equipment in the Internet of things to execute the equipment linkage operation instruction according to locally stored equipment capacity information of each equipment in the Internet of things.
Preferably, the device is specifically configured to, when serving as the master device, trigger the device in the internet of things to acquire and report corresponding environmental features according to a scene recommendation condition in a scene recommendation model corresponding to the event stored locally, and includes:
and notifying corresponding equipment in the Internet of things to sense environment information according to the condition parameters in the scene recommendation condition, and receiving an environment feature vector reported by the corresponding equipment, wherein the environment feature vector is obtained by sensing the current environment according to the notification and performing vector conversion on a sensing result by the corresponding equipment.
Preferably, the device is specifically configured to, when the device is the master device, trigger a corresponding device in the internet of things to execute the device linkage operation instruction, and includes:
for each operation instruction in the equipment linkage operation instructions, judging whether equipment executing the operation instruction can analyze the operation instruction according to the locally stored equipment capacity information, and if so, directly sending the operation instruction to corresponding instruction execution equipment for execution; otherwise, triggering the equipment capable of analyzing the operation instruction to analyze the operation instruction, and sending the analysis result to corresponding instruction execution equipment for execution.
Preferably, the device is further configured to send device capability information of the device to the master device in the internet of things in advance when the device is used as another device in the internet of things except for the master device.
Preferably, the device is further configured to calculate the device comprehensive capability of the device in advance according to each device capability of the device and a preset corresponding capability weight; exchanging respective device comprehensive capabilities with other devices in the Internet of things; and determining the main equipment in the Internet of things according to the comprehensive equipment capacity of each piece of equipment in the Internet of things.
Preferably, the device, specifically configured to determine a master device in the internet of things, includes: and selecting the equipment corresponding to the maximum value of the comprehensive capacity of the equipment in the Internet of things as the main equipment of the Internet of things.
Preferably, the device is further configured to select, according to the device comprehensive capability of each device in the internet of things, a device corresponding to a next largest value of the device comprehensive capability in the internet of things as a secondary master device of the internet of things.
Preferably, the device is further configured to, when serving as the master device, synchronize the locally stored linkage configuration information to the secondary master device when linkage configuration information is locally initialized or when the local linkage configuration information is changed; the linkage configuration information includes: the scene recommendation mode and the equipment capability information of each equipment in the Internet of things; when the main equipment is in an abnormal state, the main equipment is set as the main equipment and is informed to other equipment in the Internet of things, and the function of the main equipment is executed according to the current linkage configuration information.
Preferably, the device is further configured to report respective device capability information to the master device in advance when the device is used as another device in the internet of things except for the master device.
Preferably, the scene recommendation model is pre-trained by a cloud server and sent to the master device.
Preferably, the device is further configured to, when serving as the master device, after the device linkage operation instruction is executed, if the user selects to execute the device linkage operation instruction, feed back the device linkage operation instruction, which is selected to be executed by the user when the event occurs, to the cloud server; if the user selects not to execute the equipment linkage operation instruction, feeding back the equipment linkage operation instruction which is not selected to be executed by the user when the event occurs and corresponding subsequent operation of the user to the cloud server;
and the cloud server is further used for optimizing the equipment linkage operation instruction in the scene recommendation model corresponding to the event according to the feedback.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.

Claims (12)

1. A multi-device linkage method, comprising:
when a preset event occurs in the Internet of things, the main equipment in the Internet of things triggers corresponding equipment in the Internet of things to collect and report the current environmental characteristics according to a scene recommendation condition in a scene recommendation model corresponding to the event which is locally stored; judging whether the scene recommendation condition is met currently or not according to the environmental characteristics; the scene recommendation model comprises a scene trigger event, a scene recommendation condition and a device linkage operation instruction of a scene;
if the scene recommendation condition is met currently, the main device triggers a user to select whether to execute a device linkage operation instruction of the scene recommendation model;
when the user selects to execute the equipment linkage operation instruction, the main equipment triggers corresponding equipment in the Internet of things to execute the equipment linkage operation instruction according to locally stored equipment capacity information of each piece of equipment in the Internet of things.
2. The method of claim 1, wherein the triggering, by the master device in the internet of things, the device in the internet of things to collect and report the corresponding environmental features according to the locally stored scene recommendation conditions in the scene recommendation model corresponding to the event comprises:
the main equipment informs corresponding equipment in the Internet of things of sensing environment information according to condition parameters in the scene recommendation conditions;
and the corresponding equipment senses the current environment according to the notification, converts a sensing result into an environment characteristic vector and then sends the environment characteristic vector to the main equipment.
3. The method of claim 1, wherein the triggering the respective device in the internet of things to execute the device linkage operation instruction comprises:
for each operation instruction in the equipment linkage operation instruction, the main equipment judges whether the equipment executing the operation instruction can analyze the operation instruction according to the locally stored equipment capacity information, and if so, the operation instruction is directly sent to corresponding instruction execution equipment for execution; otherwise, triggering the equipment capable of analyzing the operation instruction to analyze the operation instruction, and sending the analysis result to corresponding instruction execution equipment for execution.
4. The method of claim 1, wherein the method further comprises:
and other devices except the main device in the Internet of things send own device capability information to the main device in advance.
5. The method of claim 1, wherein the method further comprises:
each device in the Internet of things calculates the comprehensive device capacity of the device according to each device capacity of the device and a preset corresponding capacity weight;
all the devices in the Internet of things exchange respective device comprehensive capabilities with each other;
and each device determines the main device in the Internet of things according to the comprehensive device capacity of each device in the Internet of things.
6. The method of claim 5, wherein the determining the master device in the internet of things comprises:
and selecting the equipment corresponding to the maximum value of the comprehensive capacity of the equipment in the Internet of things as the main equipment of the Internet of things.
7. The method of claim 5, wherein the method further comprises:
and each device selects a device corresponding to the second largest value of the comprehensive capability of the device in the Internet of things as a secondary main device of the Internet of things in advance according to the comprehensive capability of the device of each device in the Internet of things.
8. The method of claim 7, wherein the method further comprises:
the main equipment synchronizes the linkage configuration information stored locally to the auxiliary main equipment when the linkage configuration information is initialized locally or changed; the linkage configuration information includes: the scene recommendation mode and the equipment capability information of each equipment in the Internet of things;
and the auxiliary main equipment detects the state of the main equipment in real time, sets the auxiliary main equipment as the main equipment and informs other equipment in the Internet of things when the main equipment is in an abnormal state, and executes the function of the main equipment according to the current linkage configuration information.
9. The method of claim 1, wherein the method further comprises:
and reporting the respective equipment capability information to the main equipment by other equipment except the main equipment in the Internet of things in advance.
10. The method of claim 1, wherein the method further comprises:
the scene recommendation model is trained in advance by a cloud server and sent to the main device.
11. The method of claim 10, wherein after the device linkage operation instruction execution is complete, the method further comprises:
if the user selects to execute the equipment linkage operation instruction, the main equipment feeds the equipment linkage operation instruction selected to be executed by the user when the event occurs back to the cloud server;
if the user selects not to execute the equipment linkage operation instruction, the main equipment feeds back the equipment linkage operation instruction which is not selected by the user to be executed when the event occurs and corresponding subsequent operation of the user to the cloud server;
and the cloud server optimizes the equipment linkage operation instruction in the scene recommendation model corresponding to the event according to the feedback.
12. The utility model provides a multi-device linkage system, its characterized in that, includes the equipment in high in the clouds server and the thing networking, wherein:
the device is used for triggering the corresponding device in the Internet of things to collect and report the current environmental characteristics according to the scene recommendation conditions in the scene recommendation model corresponding to the locally stored events when the device is used as the main device and the preset events occur in the Internet of things; judging whether the scene recommendation condition is met currently or not according to the environmental characteristics; the scene recommendation model comprises a scene trigger event, a scene recommendation condition and a device linkage operation instruction of a scene; if the scene recommendation condition is met currently, triggering a user to select whether to execute a device linkage operation instruction of the scene recommendation model; when the user selects to execute the equipment linkage operation instruction, triggering corresponding equipment in the Internet of things to execute the equipment linkage operation instruction according to locally stored equipment capacity information of each equipment in the Internet of things.
CN202010993364.XA 2020-09-21 2020-09-21 Multi-device linkage method and system Active CN112153137B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010993364.XA CN112153137B (en) 2020-09-21 2020-09-21 Multi-device linkage method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010993364.XA CN112153137B (en) 2020-09-21 2020-09-21 Multi-device linkage method and system

Publications (2)

Publication Number Publication Date
CN112153137A true CN112153137A (en) 2020-12-29
CN112153137B CN112153137B (en) 2023-04-07

Family

ID=73893408

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010993364.XA Active CN112153137B (en) 2020-09-21 2020-09-21 Multi-device linkage method and system

Country Status (1)

Country Link
CN (1) CN112153137B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113114779A (en) * 2021-04-23 2021-07-13 杭州萤石软件有限公司 Configuration method, terminal and system for linkage of Internet of things equipment
CN113485206A (en) * 2021-08-06 2021-10-08 时代云英(重庆)科技有限公司 Extensible Internet of things system and method
CN113507443A (en) * 2021-06-10 2021-10-15 广州大学 Internet of things access control method and device based on time capability tree
CN115314529A (en) * 2022-10-11 2022-11-08 之江实验室 Universal equipment linkage method and system
CN117812113A (en) * 2024-01-09 2024-04-02 中科物栖(南京)科技有限公司 Recommending method, recommending device, recommending equipment and recommending storage medium for Internet of things equipment

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104394045A (en) * 2014-10-29 2015-03-04 小米科技有限责任公司 Scene mode recommending method and device for an intelligent device
CN105182777A (en) * 2015-09-18 2015-12-23 小米科技有限责任公司 Equipment controlling method and apparatus
CN105785777A (en) * 2016-03-04 2016-07-20 橙朴(上海)智能科技有限公司 Intelligent home control system based on learning
CN106773772A (en) * 2017-02-10 2017-05-31 杭州极智科技有限公司 A kind of ZigBee intelligent domestic gateways scene inter-linked controlling method
CN108092862A (en) * 2017-12-15 2018-05-29 四川爱联科技有限公司 WiFi ad hoc network control systems based on Internet of Things
CN109936489A (en) * 2019-03-25 2019-06-25 美的智慧家居科技有限公司 The control method and system, gateway and storage medium of scene linkage
CN110825973A (en) * 2019-11-15 2020-02-21 珠海格力电器股份有限公司 Scene and linkage recommendation method and system, storage medium and network side equipment

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104394045A (en) * 2014-10-29 2015-03-04 小米科技有限责任公司 Scene mode recommending method and device for an intelligent device
CN105182777A (en) * 2015-09-18 2015-12-23 小米科技有限责任公司 Equipment controlling method and apparatus
CN105785777A (en) * 2016-03-04 2016-07-20 橙朴(上海)智能科技有限公司 Intelligent home control system based on learning
CN106773772A (en) * 2017-02-10 2017-05-31 杭州极智科技有限公司 A kind of ZigBee intelligent domestic gateways scene inter-linked controlling method
CN108092862A (en) * 2017-12-15 2018-05-29 四川爱联科技有限公司 WiFi ad hoc network control systems based on Internet of Things
CN109936489A (en) * 2019-03-25 2019-06-25 美的智慧家居科技有限公司 The control method and system, gateway and storage medium of scene linkage
CN110825973A (en) * 2019-11-15 2020-02-21 珠海格力电器股份有限公司 Scene and linkage recommendation method and system, storage medium and network side equipment

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113114779A (en) * 2021-04-23 2021-07-13 杭州萤石软件有限公司 Configuration method, terminal and system for linkage of Internet of things equipment
CN113507443A (en) * 2021-06-10 2021-10-15 广州大学 Internet of things access control method and device based on time capability tree
CN113507443B (en) * 2021-06-10 2022-03-25 广州大学 Internet of things access control method and device based on time capability tree and storage medium
CN113485206A (en) * 2021-08-06 2021-10-08 时代云英(重庆)科技有限公司 Extensible Internet of things system and method
CN115314529A (en) * 2022-10-11 2022-11-08 之江实验室 Universal equipment linkage method and system
CN117812113A (en) * 2024-01-09 2024-04-02 中科物栖(南京)科技有限公司 Recommending method, recommending device, recommending equipment and recommending storage medium for Internet of things equipment

Also Published As

Publication number Publication date
CN112153137B (en) 2023-04-07

Similar Documents

Publication Publication Date Title
CN112153137B (en) Multi-device linkage method and system
EP3340243A1 (en) Method for performing voice control on device with microphone array, and device thereof
CN104133459B (en) Method and system for controlling intelligent household device
CN109298694B (en) Garbage can robot scheduling method and device
CN103941686B (en) Sound control method and system
CN103544971B (en) Volume self-adaption control method and volume self-adaption control system
CN107040951B (en) Method for automatically selecting wireless network configuration mode of intelligent equipment
CN105405442B (en) voice recognition method, device and equipment
CN105511284A (en) Household appliance control method and device
CN106647295B (en) Smart home system and cooperative operation method thereof
US20210289300A1 (en) Source separation in hearing devices and related methods
CN103731562B (en) For the method and apparatus of smart machine Adaptive matching bluetooth equipment
CN111477230A (en) Intelligent sound box system, control method of intelligent sound box system and storage medium
CN111844039A (en) Wisdom space system based on robot control
CN105407445A (en) Connection method and first electronic device
CN107832192A (en) A kind of server start and stop intelligence control system
CN108762122B (en) Intelligent control box and control method thereof
CN109120298B (en) Earphone far-field interaction method, earphone far-field interaction accessory and wireless earphone
CN106791640A (en) A kind of family doorway environmental safety monitor and control method and system
CN112867141B (en) Positioning control method, bluetooth service node and electronic equipment
CN109784018B (en) Operation identification method and device and electronic equipment
CN105025356A (en) Audio playing system method and audio playing system of audio playing device
CN110784900B (en) Operator network service autonomous supervision switching system
KR20150123537A (en) System and method for providing service integrated energy storage control in home network
CN110853641A (en) Pickup system and using method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant