CN112261096B - Control method and device of Internet of things equipment, internet of things equipment and storage medium - Google Patents

Control method and device of Internet of things equipment, internet of things equipment and storage medium Download PDF

Info

Publication number
CN112261096B
CN112261096B CN202011086027.9A CN202011086027A CN112261096B CN 112261096 B CN112261096 B CN 112261096B CN 202011086027 A CN202011086027 A CN 202011086027A CN 112261096 B CN112261096 B CN 112261096B
Authority
CN
China
Prior art keywords
internet
room
things
information
things device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011086027.9A
Other languages
Chinese (zh)
Other versions
CN112261096A (en
Inventor
刘飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oppo Chongqing Intelligent Technology Co Ltd
Original Assignee
Oppo Chongqing Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo Chongqing Intelligent Technology Co Ltd filed Critical Oppo Chongqing Intelligent Technology Co Ltd
Priority to CN202011086027.9A priority Critical patent/CN112261096B/en
Publication of CN112261096A publication Critical patent/CN112261096A/en
Application granted granted Critical
Publication of CN112261096B publication Critical patent/CN112261096B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • H04L67/141Setup of application sessions
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Abstract

The application discloses a control method and device of Internet of things equipment, the Internet of things equipment and a storage medium, wherein the control method of the Internet of things equipment is applied to first Internet of things equipment, and the control method of the Internet of things equipment comprises the following steps: sending a control request to a management server for managing the Internet of things equipment, wherein the control request is used for requesting to control the second Internet of things equipment; receiving room distribution information returned by the management server based on the control request, wherein the room distribution information is used for the first Internet of things equipment to join a service room which is in network real-time communication with the second Internet of things equipment; establishing communication connection with the second networking equipment network in real time through a signaling server according to the room distribution information; and sending a control instruction for controlling the second networked device to the second networked device based on the communication connection. The method can realize real-time communication among the Internet of things devices.

Description

Control method and device of Internet of things equipment, internet of things equipment and storage medium
Technical Field
The application relates to the technical field of internet of things, in particular to a control method and device of internet of things equipment, the internet of things equipment and a storage medium.
Background
With the rapid progress of the technology level and the living standard, the technology of the internet of things is widely applied to various aspects in life. In the traditional internet of things technology, when remote interaction is performed among internet of things devices, the interaction is performed by taking a server as a relay, but the real-time performance of the interaction modes needs to be improved.
Disclosure of Invention
In view of the foregoing problems, the present application provides a method and an apparatus for controlling an internet of things device, and a storage medium.
In a first aspect, an embodiment of the present application provides a method for controlling an internet of things device, where the method is applied to a first internet of things device, and the method includes: sending a control request to a management server for managing the Internet of things equipment, wherein the control request is used for requesting to control the second Internet of things equipment; receiving room distribution information returned by the management server based on the control request, wherein the room distribution information is used for the first Internet of things equipment to join a service room which is in network real-time communication with the second Internet of things equipment; establishing communication connection with the second networking equipment network in real time through a signaling server according to the room distribution information; and sending a control instruction for controlling the second networked device to the second networked device based on the communication connection.
In a second aspect, an embodiment of the present application provides a control method for an internet of things device, which is applied to a management server for managing the internet of things device, and the method includes: receiving a control request sent by first Internet of things equipment and used for controlling second Internet of things equipment; responding to the control request, and allocating a service room for network real-time communication between the first internet of things device and the second internet of things device; generating room allocation information based on the service room; and sending the room distribution information to the first Internet of things equipment and the second Internet of things equipment, wherein the room distribution information is used for establishing communication connection of network real-time communication between the first Internet of things equipment and the second Internet of things equipment through a signaling server.
In a third aspect, an embodiment of the present application provides a control method for internet of things devices, which is applied to a control system for internet of things devices, where the system includes a signaling server, a plurality of internet of things devices, and a management server for managing the plurality of internet of things devices, a first internet of things device in the plurality of internet of things devices sends a control request to the management server, and the control request is used to control a second internet of things device in the plurality of internet of things devices; the management server returns room allocation information to the first internet of things device and the second internet of things device based on the control request, wherein the room allocation information is used for the first internet of things device to join a service room which is in network real-time communication with the second internet of things device; the first Internet of things device and the second Internet of things device establish communication connection of network real-time communication of the first Internet of things device and the second Internet of things device based on the room allocation information; and the first Internet of things device sends a control instruction for controlling the second Internet of things device to the second Internet of things device based on the communication connection.
In a fourth aspect, an embodiment of the present application provides a control device for an internet of things device, which is applied to a first internet of things device, the device includes: the device comprises a request sending module, an information receiving module, a connection establishing module and an instruction sending module, wherein the request sending module is used for sending a control request to a management server for managing the Internet of things equipment, and the control request is used for requesting to control the second Internet of things equipment; the information receiving module is used for receiving room distribution information returned by the management server based on the control request, wherein the room distribution information is used for the first internet of things equipment to join a service room which is in network real-time communication with the second internet of things equipment; the connection establishing module is used for establishing communication connection with the second networking equipment network in real time through a signaling server according to the room distribution information; the instruction sending module is used for sending a control instruction for controlling the second networked device to the second networked device based on the communication connection.
In a fifth aspect, an embodiment of the present application provides a control device for an internet of things device, which is applied to a management server for managing the internet of things device, and the device includes: the system comprises a request receiving module, a room distribution module, an information generating module and an information sending module, wherein the request receiving module is used for receiving a control request which is sent by first internet of things equipment and used for controlling second internet of things equipment; the room allocation module is used for responding to the control request and allocating service rooms for network real-time communication between the first Internet of things device and the second Internet of things device; the information generation module is used for generating room distribution information based on the service rooms; the information sending module is used for sending the room distribution information to the first internet of things device and the second internet of things device, and the room distribution information is used for the first internet of things device and the second internet of things device to establish communication connection of network real-time communication through a signaling server.
In a sixth aspect, an embodiment of the present application provides an internet of things device, including: one or more processors; a memory; one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of controlling an internet of things device provided by the first aspect.
In a seventh aspect, an embodiment of the present application provides a server, including: one or more processors; a memory; one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the control method of the internet of things device provided by the second aspect.
In an eighth aspect, an embodiment of the present application provides a computer-readable storage medium, where a program code is stored in the computer-readable storage medium, and the program code may be called by a processor to execute the method for controlling an internet of things device according to the first aspect or the second aspect.
According to the scheme, the first Internet of things equipment sends a control request to a management server for managing the Internet of things equipment, the control request is used for requesting to control the second Internet of things equipment, then room distribution information returned by the management server based on the control request is received, the room distribution information is used for enabling the first Internet of things equipment to join a service room which is in network real-time communication with the second Internet of things equipment, then according to the room distribution information, communication connection with the second Internet of things equipment in network real-time communication is established through a signaling server, and then a control instruction for controlling the second Internet of things equipment is sent to the second Internet of things equipment based on the communication connection, so that the communication connection between the Internet of things equipment through the establishment of the network real-time communication is realized, transmission of the control instruction is carried out, and real-time performance during control between the Internet of things equipment is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 shows a schematic diagram of an application scenario provided in an embodiment of the present application.
Fig. 2 shows a flowchart of a control method of an internet of things device according to an embodiment of the present application.
Fig. 3 shows an architecture schematic diagram of WebRTC of an internet of things device provided in an embodiment of the present application.
Fig. 4 is a flowchart illustrating a method for controlling an internet of things device according to another embodiment of the present application.
Fig. 5 is a flowchart illustrating step S250 in a method for controlling an internet of things device according to another embodiment of the present application.
Fig. 6 is a flowchart illustrating a method for controlling an internet of things device according to another embodiment of the present application.
Fig. 7 is a flowchart illustrating a method for controlling an internet of things device according to still another embodiment of the present application.
Fig. 8 is a flowchart illustrating a method for controlling an internet of things device according to still another embodiment of the present application.
Fig. 9 is a flowchart illustrating a method for controlling an internet of things device according to still another embodiment of the present application.
Fig. 10 shows a block diagram of a control device of an internet of things device according to an embodiment of the present application.
Fig. 11 shows a block diagram of a control device of an internet of things device according to another embodiment of the present application.
Fig. 12 is a block diagram of an internet of things device according to an embodiment of the present application for executing a method for controlling the internet of things device.
Fig. 13 is a block diagram of a management and control server for executing a control method of an internet of things device according to an embodiment of the present application.
Fig. 14 is a storage unit, according to an embodiment of the present application, configured to store or carry program codes for implementing a control method of an internet of things device according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
With the rapid progress of the technology level and the living standard, the Internet of Things (IOT) technology is widely applied to various aspects of life. For example, the smart home technology utilizes the internet of things technology and is widely used in home life, so-called smart home integrates facilities related to home life by using a house as a platform and utilizing a comprehensive wiring technology, a network communication technology, a security technology, an automatic control technology and an audio and video technology, and a high-efficiency management system of home facilities and home schedule transactions is constructed.
In the traditional internet of things technology, usually, the internet of things devices are communicated with each other in a short distance mode, but in the mode, when the large-volume transmission of audio and video data and the like among the internet of things devices is involved, the real-time performance can be problematic. Certainly, with the development of network technologies, the internet of things devices may also interact through the server as a relay, but the real-time performance of these interaction methods also needs to be improved.
In view of the above problems, the inventor provides a control method and device for internet of things devices, an electronic device, and a storage medium, which are provided by the embodiments of the present application, so that a communication connection between internet of things devices through establishing a network real-time communication can be realized, a control instruction can be transmitted, and real-time performance during control between internet of things devices can be improved. The specific control method of the internet of things device is described in detail in the following embodiments.
An application environment of the control method for the internet of things device provided by the embodiment of the application is introduced below.
Referring to fig. 1, fig. 1 shows a network structure diagram of an application scenario according to the embodiment of the present application, where the application scenario may include a control system 10 of an internet of things device, the control system 10 of the internet of things device may include a plurality of internet of things devices 100, a management server 200, and a signaling server 300, and the internet of things devices 100 may communicate with the management server and the signaling server, so that data interaction is completed. In addition, the management server 200 communicates with the signaling server. The internet of things device 100 may be an air conditioner, a lighting fixture, an intelligent lamp, a camera, an intelligent socket, a wireless switch, an intelligent curtain motor, an intelligent sound box, an intelligent refrigerator, a smart phone, a tablet computer, a notebook computer, a PC computer, or the like. The management server 200 serves as a server of the internet of things platform and can be used for managing the internet of things device 100; the signaling server 300 may be used to establish network real-time communication between the internet of things devices 100 to complete data interaction between the internet of things devices 100.
The WebRTC is an open source item pushed by google corporation, and aims to provide a simple JavaScript interface for a browser and a web application of a mobile phone, so that the browser and the web application have Real-Time Communications (RTC) Real-Time communication capability. The method means that a developer can realize a complex multimedia RTC function only by a simple JavaScript statement when developing a web application on a WebRTC browser, thereby greatly reducing the development difficulty and development cost, and organizations such as W3C and the like are making a WebRTC standard JavaScript API interface. In the whole WebRTC project technical architecture, the WebRTC bottom layer provides a core technology of audio and video multimedia, including functions of audio and video acquisition, encoding and decoding, network transmission, display rendering and the like, and simultaneously provides a Native C + + API interface for external application calling. The WebRTC standard JavaScript API interface provided by the browser is finally realized by calling a WebRTC Native C + + API interface inside.
Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a control method for an internet of things device according to an embodiment of the present application. In a specific embodiment, the control method of the internet of things device is applied to the control apparatus 400 of the internet of things device shown in fig. 10 and the internet of things device 100 (fig. 12) configured with the control apparatus 400 of the internet of things device. The specific process of this embodiment will be described below by taking the first internet of things device as an example, and it is understood that the first internet of things device applied in this embodiment may be an intelligent panel, an intelligent television, a notebook computer, an intelligent refrigerator, a smart phone, a tablet computer, and the like, and the first internet of things device may be any one of the control systems 10 of the internet of things devices shown in fig. 1, which is not limited herein. As will be described in detail below with respect to the flow shown in fig. 1, the method for controlling the internet of things device may specifically include the following steps:
step S110: and sending a control request to a management server for managing the Internet of things equipment, wherein the control request is used for requesting to control the second Internet of things equipment.
In the embodiment of the application, when the first internet of things device needs to control the second internet of things device, the first internet of things device can initiate a control request to the management server so as to request to control the second internet of things device, subsequently establish a communication connection with the second internet of things device for network real-time communication, and send an instruction to the second internet of things device by using the established communication connection, so that the second internet of things device is controlled, and the real-time performance of the control of the internet of things device is improved.
The network real-time communication is WebRTC. Typically, webRTC supports several common platforms, windows, linux, mac, android, and ios. At present, windows, linux and android platforms all provide browsers supporting WebRTC, and developers can develop RTC web development based on the browsers. Although Mac and ios do not provide a browser supporting WebRTC for a while, developers can develop RTC through a WebRTC Native C + + API. In the internet of things devices, the internet of things devices are mostly embedded systems, the embedded systems are limited by the configuration of the devices, and generally do not provide a browser of WebRTC, so that the WebRTC cannot be directly used.
In some embodiments, the internet of things device in the embodiment of the present application may be an embedded system, please refer to fig. 3, where fig. 3 illustrates an architecture diagram of a WebRTC of the internet of things device provided in the embodiment of the present application, and the architecture of the WebRTC mainly includes: the system comprises a hardware layer, an Internet of things embedded system layer, a WebRTC middleware layer and an application layer. Wherein, the hardware layer includes: a processor, a camera, a microphone, a network card and the like; the Internet of things embedded System layer comprises an Internet of things embedded System (IOT System) and an Internet of things hardware abstraction layer (IOT HAL); the WebRTC middleware layer comprises: a video engine, an audio engine, a data channel, a camera processing unit, a screen processing unit, and a real-time transport protocol (RTP/RTCP); the application layer comprises: internet of things applications (IOT APPs) and internet of things Software Development Kits (SDKs).
In the above WebRTC architecture, the core layer is a WebRTC middleware layer, which is a WebRTC core C + + library transplanted onto an IoT embedded operating system and performs deep customization based on an IoT full scene. In addition, in the related technology, a primary JS Web SDK of the WebRTC is usually adopted, but the performance of the SDK is contradicted, and in the above manner, a C/C + + SDK related to the IOT system is adopted for an IOT developer to perform application development of a real-time communication scene. In addition, in the embodiment, a standard SDP protocol is adopted for signaling handshake, and an RTP/RTCP protocol is adopted for data transmission, so that the method can be compatible with a server side of a WebRTC real-time communication system in a traditional Internet scene.
In this embodiment of the application, the first internet of things device and the second internet of things device may be any device in a control system of the above internet of things, that is, the internet of things devices include the above WebRTC architecture, so that the internet of things devices may interact with each other by using WebRTC to complete control between the internet of things devices.
Step S120: and receiving room allocation information returned by the management server based on the control request, wherein the room allocation information is used for the first Internet of things equipment to join a service room which is in network real-time communication with the second Internet of things equipment.
In this embodiment of the application, after the first internet of things device sends the control request to the management server, the management server may respond to the control request, manage and control communication between the first internet of things device and the second internet of things device, and allocate a WebRTC service room to the first internet of things device and the second internet of things device, so that the first internet of things device and the second internet of things device access to the WebRTC service room, and establish a WebRTC connection between the first internet of things device and the second internet of things device. Specifically, the management server may generate room allocation information according to the allocated rooms and send the room allocation information to the first internet of things device and the second internet of things device; accordingly, the first internet of things device and the second internet of things device can receive the room allocation information sent by the management server.
Step S130: and establishing communication connection with the second networking equipment network in real time through a signaling server according to the room distribution information.
In this embodiment of the application, the first internet of things device and the second internet of things device may receive room allocation information sent by the management server, and then the first internet of things device and the second internet of things device may establish, according to the received room allocation information, a WebRTC communication connection between the first internet of things device and the second internet of things device through the signaling server. The signaling server is used for interchanging SDP information between the first Internet of things device and the second Internet of things device, so that handshake connection between the first Internet of things device and the second Internet of things device is established, namely WebRTC communication connection is established.
Step S140: and sending a control instruction for controlling the second networked device to the second networked device based on the communication connection.
In this embodiment of the application, after the first internet of things device establishes the communication connection of the WebRTC with the second internet of things device, the first internet of things device may send a control instruction to the second internet of things device by using the communication connection, so as to complete control of a requirement of the second internet of things device, for example, control a display interface of the second internet of things device, for example, control a working state of the second internet of things device, and the like, which is not limited herein. Because the communication connection of the WebRTC established between the first internet of things device and the second internet of things device is a P2P (peer to peer) connection, the real-time performance of communication between the first internet of things device and the second internet of things device is ensured, and a real-time communication environment is provided for interaction between the internet of things devices.
In some embodiments, after the first internet-of-things device establishes the WebRTC communication connection with the second internet-of-things device, other interactions, such as transmission of video images, transmission of audio data, and the like, may also be completed based on the communication connection, which is not limited herein.
According to the control method of the IOT equipment, the first IOT equipment sends a control request to a management server for managing the IOT equipment, the control request is used for requesting to control the second IOT equipment, then room distribution information returned by the management server based on the control request is received, the room distribution information is used for enabling the first IOT equipment to join a service room which is in network real-time communication with the second IOT equipment, then communication connection with the second IOT equipment is established through a signaling server according to the room distribution information, and then a control instruction for controlling the second IOT equipment is sent to the second IOT equipment based on the communication connection, so that the communication connection of the IOT equipment through the network real-time communication is achieved, transmission of the control instruction is carried out, and real-time performance of control among the IOT equipment is improved.
Referring to fig. 4, fig. 4 is a schematic flowchart illustrating a control method for an internet of things device according to another embodiment of the present application. The control method of the internet of things device is applied to the first internet of things device, and will be described in detail with reference to the flow shown in fig. 4, where the control method of the internet of things device specifically includes the following steps:
step S210: and sending a control request to a management server for managing the Internet of things equipment, wherein the control request is used for requesting to control the second Internet of things equipment.
In the embodiment of the present application, step S210 can refer to the contents of the foregoing embodiments, and is not described herein again
Step S220: and receiving room allocation information returned by the management server based on the control request, wherein the room allocation information is used for the first internet of things device to join a service room which is in network real-time communication with the second internet of things device, and the room allocation information comprises room identification and authentication information.
In this embodiment of the application, after receiving the control request sent by the first internet of things device, the management server may allocate an RTC service room to the first internet of things device and the second internet of things device, and generate a room identifier (e.g., roomID) of the RTC service room. As a mode, the management server may interact with the signaling server, and obtain an idle RTC service room and a room identifier thereof from the RTC server; alternatively, the management server may generate a room identification that does not currently exist and then interact with the RTC server to request the creation of an RTC service room corresponding to the room identification.
In addition, in order to avoid that other devices join the service room in which the first internet of things device and the second internet of things device perform network real-time communication, the management server may further generate authentication information (for example, an authentication token), where the authentication information may correspond to the assigned room so as to be able to distinguish the authentication information of different rooms, thereby avoiding that other devices join the assigned service room. The management server may generate room allocation information according to the room identifier and the authentication information, and send the room allocation information to the first internet of things device and the second internet of things device, so that the first internet of things device and the second internet of things device join the corresponding service room, where the room allocation information may include the generated room identifier and the authentication information. Accordingly, the first internet of things device and the second internet of things device can receive the room allocation information. And the management server can send the room allocation information to the signaling server to synchronize the room allocation information with the signaling server, so that the signaling server can control the internet of things equipment to join the allocated rooms.
Step S230: and generating a room joining request carrying the room identifier and the authentication information, and sending the room joining request to the signaling server, wherein the room joining request is used for requesting to join a room in real-time network communication corresponding to the room identifier.
In this embodiment of the application, after receiving room allocation information carrying room identifiers and authentication information, the first internet of things device may generate a room join request according to the room allocation information, where the room allocation information may carry the room identifiers and the authentication information. After the room joining request is generated, the room joining request can be sent to the signaling server to request to join the service room in real-time network communication corresponding to the room identifier, so that the subsequent signaling server can manage the WebRTC communication connection between the internet of things devices in the service room.
In addition, in the process of establishing the WebRTC communication connection between the first internet-of-things device and the second internet-of-things device, the second internet-of-things device may also generate a room join request according to the received room allocation information and send the room join request to the signaling server, so as to join the room.
After receiving the room join request sent by the first internet of things device and the second internet of things device, the signaling server may authenticate the first internet of things device and the second internet of things device according to the room identifier and the authentication information carried in the room join request, so as to determine whether the signaling server can join the service room corresponding to the room identifier carried in the room join request. In some modes, the signaling server may determine, according to a received room join request sent by the first internet of things device, whether authentication information carried in the room join request is authentication information corresponding to the room identifier; if the authentication information carried in the room joining request is the authentication information corresponding to the room identifier, the signaling server can confirm that the authentication of the first internet of things device is successful; if the authentication information carried in the room joining request is not the authentication information corresponding to the room identifier, the signaling server may confirm that the authentication of the first internet of things device fails. Similarly, the signaling server may authenticate the room join request sent by the second networked device according to the method. And under the condition that the authentication is successful, the signaling server can enable the internet of things equipment to join the corresponding service room, and subsequently establish the communication connection of the WebRTC.
In the embodiment of the application, after authenticating the internet of things device sending the room join request, the signaling server may generate indication information according to an authentication result, and send the indication information to the internet of things device to indicate whether the internet of things device can establish WebRTC communication connection. In some embodiments, when the internet of things device is successfully authenticated, the signaling server may generate first indication information corresponding to the internet of things device, where the first indication information is used to indicate that the internet of things device is successfully authenticated; when the authentication of the internet of things device fails, the signaling server may generate third indication information corresponding to the internet of things device, and the first indication information is used for indicating that the authentication of the internet of things device fails.
Step S240: and receiving first indication information returned by the signaling server, wherein the first indication information is information which is sent to the first Internet of things equipment by the signaling server when the first Internet of things equipment is successfully authenticated according to the authentication information.
In the embodiment of the application, when receiving first indication information returned by a signaling server, a first internet of things device indicates that authentication of the first internet of things device is successful, and can establish WebRTC communication connection with a second internet of things device; when the first internet of things device receives the third indication information returned by the signaling server, the authentication of the second internet of things device is successful, and therefore the first internet of things device cannot establish the WebRTC communication connection with the second internet of things device.
Step S250: and responding to the first indication information, and establishing communication connection of network real-time communication with the second networking equipment based on an SDP protocol.
In this embodiment of the application, after receiving the first indication information, the first internet of things device indicates that the first internet of things device is successfully authenticated and has joined the corresponding RTC service room, and therefore, the first indication information can be responded, and a communication connection for network real-time communication is established with the second internet of things device based on an SDP protocol.
Similarly, the second internet-of-things device may receive the returned indication information after sending the room join request to the signaling server, and may determine whether to establish a communication connection with the network real-time communication between the first internet-of-things device according to the indication information. That is, when the second internet-of-things device receives the first indication information after requesting to join the service room of the network real-time communication, the communication connection with the first internet-of-things device in real-time communication may also be established based on the SDP protocol.
In some embodiments, referring to fig. 5, step S250 may include:
step S251: generating first SDP information based on an SDP protocol;
step S252: sending the first SDP information to the signaling server, wherein the signaling server is used for sending the first SDP information to the second networking equipment;
step S253: receiving second SDP information sent by the second networking equipment and returned by the signaling server, wherein the second SDP information is generated by the second networking equipment based on an SDP protocol;
step S254: and establishing communication connection with the second networking equipment network in real time according to the second SDP information.
In this embodiment, when the first internet of things device and the second internet of things device establish the communication connection of the WebRTC, SDP information may be exchanged based on an SDP protocol, so that a handshake connection between the two devices is established, that is, the communication connection of the WebRTC between the first internet of things device and the second internet of things device is established. The SDP information may include media information, transport protocol, and media stream transport information, where the media information includes media type, media format, and sampling rate to be exchanged; the media stream transmission information includes a network address, a transmission port, and the like.
Step S260: and sending a control instruction for controlling the second networked device to the second networked device based on the communication connection.
In the embodiment of the present application, step S260 may refer to the contents of the foregoing embodiments, which are not described herein again.
Step S270: when second indication information returned by the signaling server is received, the second indication information is accessed to a transfer server, and the second indication information is sent to the first Internet of things equipment and the second Internet of things equipment when the signaling server determines that the first Internet of things equipment and the second Internet of things equipment cannot establish communication connection of network real-time communication.
In this embodiment of the application, the first internet of things device and the second internet of things device may also have a situation where a communication connection of network real-time communication cannot be established, that is, a situation where a P2P connection cannot be directly formed. At this moment, the first internet of things device and the second internet of things device can be connected to the transfer server, and the transfer server can transfer the interactive information between the first internet of things device and the second internet of things device.
Step S280: and sending a control instruction for controlling the second networking equipment to the transfer server, wherein the transfer server is used for forwarding the control instruction to the second networking equipment.
In the embodiment of the application, under the condition that the first internet of things device and the second internet of things device cannot be directly connected, the first internet of things device can send a control instruction to the second internet of things device through relay so as to complete control over the second internet of things device.
According to the control method of the Internet of things equipment, the first Internet of things equipment sends the control request to the management server to request to control the second Internet of things equipment, after the management server returns the room identification and the authentication information, the first Internet of things equipment generates the room joining request according to the room identification and the authentication information and sends the room joining request to the signaling server, so that the signaling server can carry out authentication, and under the condition that the authentication is successful, the first Internet of things equipment can establish communication connection with the second Internet of things equipment in real time based on an SDP protocol, so that the phenomenon that other equipment joins in a service room and communication interference between the first Internet of things equipment and the second Internet of things equipment is caused is avoided. In addition, under the condition that the first internet of things device and the second internet of things device cannot be directly connected, the transfer server can be accessed, so that the control instruction is sent to the second internet of things device through the transfer server, and the control of the second internet of things device is completed.
Referring to fig. 6, fig. 6 is a schematic flowchart illustrating a control method for an internet of things device according to another embodiment of the present application. The control method of the internet of things device is applied to the first internet of things device, and will be described in detail with respect to the flow shown in fig. 6, where the control method of the internet of things device may specifically include the following steps:
step S310: and sending a control request to a management server for managing the Internet of things equipment, wherein the control request is used for requesting to control the second Internet of things equipment.
Step S320: and receiving room distribution information returned by the management server based on the control request, wherein the room distribution information is used for the first Internet of things equipment to join a service room which is in network real-time communication with the second Internet of things equipment.
Step S330: and establishing communication connection with the second networking equipment network in real time through a signaling server according to the room distribution information.
In the embodiment of the present application, steps S310 to S330 may refer to the contents of the foregoing embodiments, and are not described herein again.
Step S340: and receiving first screen flow data sent by the second networked device based on the communication connection, wherein the first screen flow data is screen flow data of a control interface corresponding to the second networked device.
In this embodiment of the application, in an actual control scenario for the second networking device, the second networking device may be a non-screen device, that is, an internet of things device not provided with a display screen. In this case, the second internet of things device may generate screen flow data of the control interface, and since the WebRTC communication connection is established between the first internet of things device and the second internet of things device, real-time transmission may be ensured, so that the generated screen flow data may be sent to the first internet of things device. Accordingly, the first internet of things device can receive the first screen flow data sent by the second internet of things device.
Step S350: and displaying the control interface based on the first screen flow data.
In an embodiment of the present application, the first internet of things device may include a display screen. After receiving the first screen flow data, the first internet of things device may output and display the first screen flow data based on the received first screen flow data, so as to display the control interface, so that the user performs a control operation according to the control interface corresponding to the second internet of things device. Because the second networking equipment generates the corresponding control interface and then transmits the control interface to the first networking equipment for display, the second networking equipment can have the personalized customizable interface, so that any screen equipment can display the control interface when controlling the second networking equipment, and the user experience is improved. In addition, a special application program is not required to be designed for displaying the control interface of the second internet of things device, and therefore the first internet of things device does not need to be provided with a corresponding application, and the display of the control interface can be achieved.
Step S360: and when detecting the control operation performed by the user based on the displayed control interface, generating a control instruction corresponding to the control operation according to the control operation.
In this embodiment of the application, after the first internet of things device displays the control interface, the operation in the control interface may be detected, for example, a click operation, a press operation, a slide operation, and the like in the control interface are detected. The operation in the control interface may be a corresponding operation in the control interface, and may also be another operation, which is not limited herein. When the first internet of things device detects a control operation in the control interface, a control instruction corresponding to the control operation can be generated to be sent to the second internet of things device, and the second internet of things device is correspondingly controlled.
Step S370: and sending the control instruction to the second networking equipment based on the communication connection.
In the embodiment of the present application, step S370 may refer to the contents of the foregoing embodiments, and is not described herein again.
According to the control method of the Internet of things equipment, the Internet of things equipment is in communication connection through network real-time communication, control instructions are transmitted, and real-time performance of control among the Internet of things equipment is improved. In addition, under the condition that the second networking device is a non-screen device, the second networking device sends screen flow data of the control interface to the first networking device, the first networking device outputs and displays the screen flow data, and the control interface corresponding to the second networking device can be displayed, so that any screen device can display the personalized control interface of the second networking device when controlling the second networking device, user experience is improved, and a special application program is not required to be designed for displaying the control interface of the second networking device.
Referring to fig. 7, fig. 7 is a schematic flowchart illustrating a control method for an internet of things device according to still another embodiment of the present application. The control method of the internet of things device is applied to the first internet of things device, and will be described in detail with reference to the flow shown in fig. 7, where the control method of the internet of things device specifically includes the following steps:
step S410: and sending a control request to a management server for managing the Internet of things equipment, wherein the control request is used for requesting to control the second Internet of things equipment.
Step S420: and receiving room distribution information returned by the management server based on the control request, wherein the room distribution information is used for the first Internet of things equipment to join a service room which is in network real-time communication with the second Internet of things equipment.
Step S430: and establishing communication connection with the second networking equipment network in real time through a signaling server according to the room distribution information.
Step S440: and sending a control instruction for controlling the second networked device to the second networked device based on the communication connection, wherein the control instruction is used for remotely controlling an interface displayed by the second networked device.
In the embodiment of the present application, steps S410 to S440 may refer to the contents of the foregoing embodiments, and are not described herein again.
Step S450: and receiving second screen flow data sent by the second networking equipment based on the communication connection, wherein the second screen flow data is screen flow data of a display interface displayed by the second networking equipment.
In the embodiment of the present application, the control instruction sent above may be a control instruction for controlling an interface displayed by the second networked device. In this scenario, because the first internet of things device and the second internet of things device establish a WebRTC communication connection, the second internet of things device can also send screen flow data of a display interface thereof to the first internet of things device, so that the first internet of things device displays the display interface of the second internet of things device, and remote control of the display interface is achieved.
Step S460: displaying the display interface based on the second screen flow data.
Step S470: and when detecting the interface operation performed by the user based on the displayed display interface, generating an interface control instruction corresponding to the interface operation according to the interface operation.
Step S480: and sending the interface control instruction to the second networking equipment based on the communication connection.
In the embodiment of the application, after the first internet of things device displays the display interface of the second internet of things device, the operation in the display interface can be detected, a corresponding interface control instruction is generated according to the detected interface operation, and the established WebRTC connection is used for sending the interface control instruction to the second internet of things device, so that the remote control of the display interface of the second internet of things device is realized.
According to the control method of the Internet of things equipment, the Internet of things equipment is in communication connection through network real-time communication, control instructions are transmitted, and real-time performance of control among the Internet of things equipment is improved. In addition, when the control instruction is used for controlling the display interface of the second internet-of-things device, the second internet-of-things device can transmit screen flow data of the display interface to the first internet-of-things device for display based on the established communication connection, and when the first internet-of-things device detects interface operation in the display interface, the interface control instruction can be sent to the second internet-of-things device, so that remote control of the display interface between the internet-of-things devices is completed.
Referring to fig. 8, fig. 8 is a schematic flowchart illustrating a control method for an internet of things device according to yet another embodiment of the present application. The control method of the internet of things device is applied to the management of the internet of things device, and will be described in detail with reference to the flow shown in fig. 8, and the control method of the internet of things device may specifically include the following steps:
step S510: and receiving a control request sent by the first Internet of things device and used for controlling the second Internet of things device.
Step S520: and responding to the control request, and allocating a service room for network real-time communication between the first Internet of things equipment and the second Internet of things equipment.
Step S530: room allocation information is generated based on the service rooms.
In this embodiment of the application, after receiving the control request sent by the first internet of things device, the management server may allocate RTC service rooms to the first internet of things device and the second internet of things device, and generate room allocation information.
In some implementations, a room identification (e.g., roomID) of the RTC service room. As a mode, the management server may interact with the signaling server, and obtain an idle RTC service room and a room identifier thereof from the RTC server; alternatively, the management server may generate a room identification that does not currently exist and then interact with the RTC server to request the creation of an RTC service room corresponding to the room identification.
In addition, in order to avoid that other devices join the service room in which the first internet of things device and the second internet of things device perform network real-time communication, the management server may further generate authentication information (for example, an authentication token), where the authentication information may correspond to the assigned room so as to be able to distinguish the authentication information of different rooms, thereby avoiding that other devices join the assigned service room.
Step S540: and sending the room allocation information to the first Internet of things equipment and the second Internet of things equipment, wherein the room allocation information is used for establishing communication connection of network real-time communication between the first Internet of things equipment and the second Internet of things equipment through a signaling server.
In some embodiments, the management server may generate room allocation information according to the room identifier and the authentication information, and send the room allocation information to the first internet of things device and the second internet of things device, so that the first internet of things device and the second internet of things device join the corresponding service room, where the room allocation information may include the generated room identifier and the authentication information. Correspondingly, the first internet of things device and the second internet of things device can receive the room allocation information, and communication connection of network real-time communication can be established subsequently through the signaling server according to the room allocation information.
Referring to fig. 9, fig. 9 is a schematic flowchart illustrating a control method for an internet of things device according to yet another embodiment of the present application. The control method of the Internet of things equipment is applied to a control system of the Internet of things equipment, and the system comprises a signaling server, a plurality of Internet of things equipment and a management server for managing the plurality of Internet of things equipment. As will be described in detail below with respect to the flow shown in fig. 9, the method for controlling the internet of things device may specifically include the following steps:
step S610: a first internet of things device in the plurality of internet of things devices sends a control request to the management server, and the control request is used for controlling a second internet of things device in the plurality of internet of things devices.
Step S620: and the management server returns room allocation information to the first Internet of things device and the second Internet of things device based on the control request, wherein the room allocation information is used for the first Internet of things device to join a service room which is in network real-time communication with the second Internet of things device.
Step S630: the first internet of things device and the second internet of things device establish communication connection of network real-time communication of the first internet of things device and the second internet of things device based on the room allocation information.
Step 640: and the first Internet of things device sends a control instruction for controlling the second Internet of things device to the second Internet of things device based on the communication connection.
In the embodiment of the present application, steps S610 to S640 may refer to the contents of the foregoing embodiments, and are not described herein again.
Referring to fig. 10, a block diagram of a control apparatus 400 of an internet of things device according to an embodiment of the present application is shown. The control device 400 of the internet of things device applies the first internet of things device, and the control device 400 of the internet of things device includes: a request sending module 410, an information receiving module 420, a connection establishing module 430 and an instruction sending module 440. The request sending module 410 is configured to send a control request to a management server that manages the internet of things device, where the control request is used to request to operate a second internet of things device; the information receiving module 420 is configured to receive room allocation information returned by the management server based on the control request, where the room allocation information is used for the first internet of things device to join a service room in network real-time communication with the second internet of things device; the connection establishing module 430 is configured to establish a communication connection with the second networked device through a signaling server according to the room allocation information; the instruction sending module 440 is configured to send a control instruction for controlling the second networked device to the second networked device based on the communication connection.
In some embodiments, the room assignment information includes room identification and authentication information. The connection establishing module 430 may specifically be configured to: generating a room joining request carrying the room identifier and the authentication information, and sending the room joining request to the signaling server, wherein the room joining request is used for requesting to join a room in network real-time communication corresponding to the room identifier; receiving first indication information returned by the signaling server, wherein the first indication information is information which is sent to the first Internet of things equipment by the signaling server when the first Internet of things equipment is successfully authenticated according to the authentication information; and responding to the first indication information, and establishing communication connection of network real-time communication with the second networking equipment based on an SDP protocol.
In this embodiment, the connection establishing module 430 establishes a communication connection for network real-time communication with the second networking device based on the SDP protocol, and may include: generating first SDP information based on an SDP protocol; sending the first SDP information to the signaling server, wherein the signaling server is used for sending the first SDP information to the second networking device; receiving second SDP information sent by the second networking equipment and returned by the signaling server, wherein the second SDP information is generated by the second networking equipment based on an SDP protocol; and establishing communication connection with the second networking equipment network in real time according to the second SDP information.
In some embodiments, the control device 400 of the internet of things device may further include: a transfer access module and an instruction transfer module. The transfer access module is used for accessing to a transfer server when receiving second indication information returned by the signaling server after the communication connection of network real-time communication is established between the SDP-based protocol and the second networking equipment, wherein the second indication information is sent to the first networking equipment and the second networking equipment by the signaling server when the signaling server determines that the communication connection of network real-time communication cannot be established between the first networking equipment and the second networking equipment; and sending a control instruction for controlling the second networked device to the transfer server, wherein the transfer server is used for forwarding the control instruction to the second networked device.
In some embodiments, the second networked device is not a screenless device. The control apparatus 400 of the internet of things device may further include: the device comprises a first screen flow receiving module and a first display module. The first screen flow receiving module is used for receiving first screen flow data sent by the second networked device based on the communication connection before the control instruction used for controlling the second networked device is sent to the second networked device based on the communication connection, wherein the first screen flow data is screen flow data of a control interface corresponding to the second networked device; the first display module is used for displaying the control interface based on the first screen flow data.
In this embodiment, the instruction sending module 440 may specifically be configured to: when control operation performed by a user based on the displayed control interface is detected, generating a control instruction corresponding to the control operation according to the control operation; and sending the control instruction to the second networking equipment based on the communication connection.
In some embodiments, the control instruction is used for remotely controlling an interface displayed by the second networked device. The control apparatus 400 of the internet of things device may further include: the device comprises a second screen flow receiving module, a second display module and an instruction generating module. The second screen flow receiving module is used for receiving second screen flow data sent by the second networked device based on the communication connection after the control instruction used for controlling the second networked device is sent to the second networked device based on the communication connection, wherein the second screen flow data is screen flow data of a display interface displayed by the second networked device; the second display module is used for displaying the display interface based on the second screen flow data; and the instruction generating module is used for generating an interface control instruction corresponding to the interface operation according to the interface operation when the interface operation performed by the user based on the displayed display interface is detected. The instruction sending module 440 is further configured to send the interface control instruction to the second networked device based on the communication connection.
Referring to fig. 11, a block diagram of a control apparatus 500 of an internet of things device according to another embodiment of the present application is shown. The control device 500 of the internet of things device applies the management server, and the control device 500 of the internet of things device includes: a request receiving module 510, a room assigning module 520, an information generating module 530, and an information transmitting module 540. The request receiving module 510 is configured to receive a control request sent by a first internet of things device and used for controlling a second internet of things device; the room allocation module 520 is configured to allocate a service room for the first internet of things device to perform network real-time communication with the second internet of things device in response to the control request; the information generating module 530 is configured to generate room allocation information based on the service room; the information sending module 540 is configured to send the room allocation information to the first internet of things device and the second internet of things device, where the room allocation information is used for the first internet of things device and the second internet of things device to establish communication connection of network real-time communication through a signaling server.
It can be clearly understood by those skilled in the art that, for convenience and simplicity of description, the specific working processes of the above-described devices and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, the coupling between the modules may be electrical, mechanical or other type of coupling.
In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.
To sum up, according to the scheme provided by the application, a first internet of things device sends a control request to a management server for managing the internet of things device, the control request is used for requesting to control a second internet of things device, then room distribution information returned by the management server based on the control request is received, the room distribution information is used for the first internet of things device to join a service room which is in network real-time communication with the second internet of things device, then according to the room distribution information, communication connection with the second internet of things device for network real-time communication is established through a signaling server, and then a control instruction for controlling the second internet of things device is sent to the second internet of things device based on the communication connection, so that the internet of things device is communicated through the established network real-time communication connection, control instruction transmission is carried out, and real-time performance during control between the internet of things devices is improved.
Please refer to fig. 12, which shows a block diagram of an internet of things device according to an embodiment of the present application. This internet of things device 100 can be air conditioner, lighting fixtures, intelligent lamp, camera, smart jack, wireless switch, intelligent (window) curtain motor, intelligent audio amplifier, intelligent refrigerator, smart mobile phone, panel computer, notebook computer, PC computer etc. can operate the internet of things device of application. The internet of things device 100 in the present application may include one or more of the following components: a processor 110, a memory 120, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by the one or more processors 110, the one or more programs configured to perform a method as described in the aforementioned method embodiments.
Processor 110 may include one or more processing cores. The processor 110 connects various parts throughout the internet of things device 100 using various interfaces and lines, performs various functions of the internet of things device 100 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 120, and calling data stored in the memory 120. Alternatively, the processor 110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 110 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 110, but may be implemented by a communication chip.
The Memory 120 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The data storage area may also store data created by the internet appliance 100 during use (e.g., phone book, audio and video data, chat log data), etc.
Referring to fig. 13, a block diagram of a management server according to an embodiment of the present application is shown. The management server 200 may be a conventional server, a cloud server, or the like capable of running an application. The management server 200 in the present application may include one or more of the following components: a processor 210, a memory 220, and one or more applications, wherein the one or more applications may be stored in the memory 220 and configured to be executed by the one or more processors 210, the one or more programs configured to perform the methods as described in the aforementioned method embodiments.
Processor 210 may include one or more processing cores. The processor 210 connects various parts within the entire management server 200 using various interfaces and lines, performs various functions of the management server 200 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 220, and calling data stored in the memory 220. Alternatively, the processor 210 may be implemented in hardware using at least one of Digital Signal Processing (DSP), field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 210 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 210, but may be implemented by a communication chip.
The Memory 220 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 220 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 220 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The storage data area may also store data created by the management server 200 in use (such as a phonebook, audio-video data, chat log data), and the like.
Referring to fig. 14, a block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. The computer-readable medium 800 has stored therein a program code that can be called by a processor to execute the method described in the above-described method embodiments.
The computer-readable storage medium 800 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 800 includes a non-volatile computer-readable storage medium. The computer readable storage medium 800 has storage space for program code 810 to perform any of the method steps of the method described above. The program code can be read from and written to one or more computer program products. The program code 810 may be compressed, for example, in a suitable form.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims (13)

1. A control method of Internet of things equipment is applied to first Internet of things equipment, and is characterized by comprising the following steps:
sending a control request to a management server for managing the Internet of things equipment, wherein the control request is used for requesting to control the second Internet of things equipment;
receiving room allocation information returned by the management server based on the control request, wherein the room allocation information is used for the first internet of things device to join a service room which is in network real-time communication with the second internet of things device, and the room allocation information comprises room identification and authentication information;
generating a room joining request carrying the room identifier and the authentication information, and sending the room joining request to a signaling server, wherein the room joining request is used for requesting to join a room in real-time network communication corresponding to the room identifier;
receiving first indication information returned by the signaling server, wherein the first indication information is information which is sent to the first Internet of things equipment by the signaling server when the first Internet of things equipment is successfully authenticated according to the authentication information;
responding to the first indication information, and establishing communication connection of network real-time communication with the second networking equipment based on an SDP protocol;
and sending a control instruction for controlling the second networked device to the second networked device based on the communication connection.
2. The method according to claim 1, wherein the establishing a communication connection for network real-time communication with the second networking device based on the SDP protocol comprises:
generating first SDP information based on an SDP protocol;
sending the first SDP information to the signaling server, wherein the signaling server is used for sending the first SDP information to the second networking equipment;
receiving second SDP information sent by the second networking equipment and returned by the signaling server, wherein the second SDP information is generated by the second networking equipment based on an SDP protocol;
and establishing communication connection with the second networking equipment network in real time according to the second SDP information.
3. The method according to claim 1, wherein after the communication connection for network real-time communication is established with the second networked device based on the SDP protocol, the method further comprises:
when second indication information returned by the signaling server is received, accessing the second indication information to a transfer server, wherein the second indication information is sent to the first internet of things device and the second internet of things device when the signaling server determines that the first internet of things device and the second internet of things device cannot establish communication connection of network real-time communication;
and sending a control instruction for controlling the second networked device to the transfer server, wherein the transfer server is used for forwarding the control instruction to the second networked device.
4. The method according to claim 1, wherein the second networked device is not a screenless device, and wherein before sending the control command for controlling the second networked device to the second networked device based on the communication connection, the method further comprises:
receiving first screen flow data sent by the second networking equipment based on the communication connection, wherein the first screen flow data is screen flow data of a control interface corresponding to the second networking equipment;
and displaying the control interface based on the first screen flow data.
5. The method according to claim 4, wherein the sending a control instruction for controlling the second networked device to the second networked device based on the communication connection comprises:
when control operation performed by a user based on the displayed control interface is detected, generating a control instruction corresponding to the control operation according to the control operation;
and sending the control instruction to the second networking equipment based on the communication connection.
6. The method according to claim 1, wherein the control instruction is used for remotely controlling an interface displayed by the second networked device, and after the control instruction for controlling the second networked device is sent to the second networked device based on the communication connection, the method further comprises:
receiving second screen flow data sent by the second networking equipment based on the communication connection, wherein the second screen flow data is screen flow data of a display interface displayed by the second networking equipment;
displaying the display interface based on the second screen flow data;
when interface operation performed by a user based on the displayed display interface is detected, generating an interface control instruction corresponding to the interface operation according to the interface operation;
and sending the interface control instruction to the second networking equipment based on the communication connection.
7. A control method of Internet of things equipment is applied to a management server for managing the Internet of things equipment, and comprises the following steps:
receiving a control request sent by first Internet of things equipment and used for controlling second Internet of things equipment;
responding to the control request, and allocating a service room for network real-time communication between the first Internet of things equipment and the second Internet of things equipment;
generating room allocation information based on the service room, the room allocation information including room identification and authentication information;
sending the room allocation information to the first internet of things device and the second internet of things device, wherein the room allocation information is used for establishing communication connection of network real-time communication between the first internet of things device and the second internet of things device through a signaling server, the first internet of things device is used for generating a room joining request carrying the room identifier and the authentication information, and sending the room joining request to the signaling server, and the room joining request is used for requesting to join a room in network real-time communication corresponding to the room identifier; receiving first indication information returned by the signaling server, wherein the first indication information is information which is sent to the first Internet of things equipment by the signaling server when the first Internet of things equipment is successfully authenticated according to the authentication information; and responding to the first indication information, and establishing communication connection of network real-time communication with the second networking equipment based on an SDP protocol.
8. A control method of Internet of things equipment is applied to a control system of the Internet of things equipment, the system comprises a signaling server, a plurality of Internet of things equipment and a management server for managing the plurality of Internet of things equipment, and the method comprises the following steps:
a first internet of things device in the plurality of internet of things devices sends a control request to the management server, wherein the control request is used for controlling a second internet of things device in the plurality of internet of things devices;
the management server returns room allocation information to the first internet of things device and the second internet of things device based on the control request, the room allocation information is used for the first internet of things device to join a service room which is in network real-time communication with the second internet of things device, and the room allocation information comprises room identification and authentication information;
the first internet of things device and the second internet of things device establish communication connection of network real-time communication of the first internet of things device and the second internet of things device based on the room allocation information, wherein the first internet of things device generates a room joining request carrying the room identification and the authentication information and sends the room joining request to the signaling server, and the room joining request is used for requesting to join a room in network real-time communication corresponding to the room identification; receiving first indication information returned by the signaling server, wherein the first indication information is information which is sent to the first Internet of things equipment by the signaling server when the first Internet of things equipment is successfully authenticated according to the authentication information; responding to the first indication information, and establishing communication connection of network real-time communication with the second networking equipment based on an SDP protocol;
and the first Internet of things device sends a control instruction for controlling the second Internet of things device to the second Internet of things device based on the communication connection.
9. The utility model provides a controlling means of thing networking equipment which characterized in that is applied to first thing networking equipment, the device includes: a request sending module, an information receiving module, a connection establishing module and an instruction sending module, wherein,
the request sending module is used for sending a control request to a management server for managing the Internet of things equipment, and the control request is used for requesting to control the second Internet of things equipment;
the information receiving module is used for receiving room distribution information returned by the management server based on the control request, the room distribution information is used for the first internet of things equipment to join a service room which is in network real-time communication with the second internet of things equipment, and the room distribution information comprises room identification and authentication information;
the connection establishing module is used for generating a room joining request carrying the room identifier and the authentication information, and sending the room joining request to a signaling server, wherein the room joining request is used for requesting to join a room in network real-time communication corresponding to the room identifier; receiving first indication information returned by the signaling server, wherein the first indication information is information which is sent to the first Internet of things equipment by the signaling server when the first Internet of things equipment is successfully authenticated according to the authentication information; responding to the first indication information, and establishing a communication connection of network real-time communication with the second networking equipment based on an SDP protocol;
the instruction sending module is used for sending a control instruction for controlling the second networked device to the second networked device based on the communication connection.
10. The utility model provides a controlling means of thing networking device which characterized in that is applied to the management server of management thing networking device, the device includes: a request receiving module, a room allocating module, an information generating module and an information transmitting module, wherein,
the request receiving module is used for receiving a control request which is sent by the first Internet of things device and used for controlling the second Internet of things device;
the room allocation module is used for responding to the control request and allocating service rooms for network real-time communication between the first Internet of things device and the second Internet of things device;
the information generation module is used for generating room distribution information based on the service room, and the room distribution information comprises room identification and authentication information;
the information sending module is used for sending the room allocation information to the first internet of things device and the second internet of things device, the room allocation information is used for the first internet of things device and the second internet of things device to establish communication connection of network real-time communication through a signaling server, the first internet of things device is used for generating a room joining request carrying the room identification and the authentication information, the room joining request is sent to the signaling server, and the room joining request is used for requesting to join a room in the network real-time communication corresponding to the room identification; receiving first indication information returned by the signaling server, wherein the first indication information is information which is sent to the first Internet of things equipment by the signaling server when the first Internet of things equipment is successfully authenticated according to the authentication information; and responding to the first indication information, and establishing communication connection of network real-time communication with the second networking equipment based on an SDP protocol.
11. An internet of things device, comprising:
one or more processors;
a memory;
one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of any of claims 1-6.
12. A server, comprising:
one or more processors;
a memory;
one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of claim 7.
13. A computer-readable storage medium, having stored thereon program code that can be invoked by a processor to perform the method according to any one of claims 1 to 7.
CN202011086027.9A 2020-10-12 2020-10-12 Control method and device of Internet of things equipment, internet of things equipment and storage medium Active CN112261096B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011086027.9A CN112261096B (en) 2020-10-12 2020-10-12 Control method and device of Internet of things equipment, internet of things equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011086027.9A CN112261096B (en) 2020-10-12 2020-10-12 Control method and device of Internet of things equipment, internet of things equipment and storage medium

Publications (2)

Publication Number Publication Date
CN112261096A CN112261096A (en) 2021-01-22
CN112261096B true CN112261096B (en) 2023-04-18

Family

ID=74242565

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011086027.9A Active CN112261096B (en) 2020-10-12 2020-10-12 Control method and device of Internet of things equipment, internet of things equipment and storage medium

Country Status (1)

Country Link
CN (1) CN112261096B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114257633A (en) * 2021-12-20 2022-03-29 北京深思数盾科技股份有限公司 Remote video intercom method and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108337279A (en) * 2017-01-20 2018-07-27 阿里巴巴集团控股有限公司 A kind of control method and device of smart machine
CN110677272A (en) * 2019-08-18 2020-01-10 朗德万斯公司 Method and system for forming a network of devices
CN110912789A (en) * 2019-12-27 2020-03-24 无锡青起长升智能科技有限公司 Intelligent household Internet of things communication method based on Alicloud IoT Hub platform
CN111447123A (en) * 2020-03-24 2020-07-24 北京金山云网络技术有限公司 Smart home configuration method and device, electronic equipment and medium
WO2020171824A1 (en) * 2019-02-22 2020-08-27 Mursion, Inc. Peer to peer communication system and method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9294337B2 (en) * 2014-03-26 2016-03-22 Sonus Networks, Inc. Methods and systems for integrating independent IMS and WebRTC networks

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108337279A (en) * 2017-01-20 2018-07-27 阿里巴巴集团控股有限公司 A kind of control method and device of smart machine
WO2020171824A1 (en) * 2019-02-22 2020-08-27 Mursion, Inc. Peer to peer communication system and method
CN110677272A (en) * 2019-08-18 2020-01-10 朗德万斯公司 Method and system for forming a network of devices
CN110912789A (en) * 2019-12-27 2020-03-24 无锡青起长升智能科技有限公司 Intelligent household Internet of things communication method based on Alicloud IoT Hub platform
CN111447123A (en) * 2020-03-24 2020-07-24 北京金山云网络技术有限公司 Smart home configuration method and device, electronic equipment and medium

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
基于WebRTC的局域网音视频客户端设计;朱明慧;《信息与电脑(理论版)》;20200825(第16期);全文 *
基于WebRTC的音视频通信的设计与实现;吴晨等;《有线电视技术》;20170815(第08期);全文 *

Also Published As

Publication number Publication date
CN112261096A (en) 2021-01-22

Similar Documents

Publication Publication Date Title
CN110622123B (en) Display method and device
WO2020223854A1 (en) Device network configuration method and apparatus, electronic device and storage medium
CN105335112B (en) Multi-screen display information processing and main control end content sending method and device
RU2630752C2 (en) Wireless communication device, information processing device and method of communication
US9270931B2 (en) Intercom system utilizing Wi-Fi
CN102595239B (en) Multi-screen interactive method, device and intelligent television for terminal system
EP4013003A1 (en) Communication protocol switching method, apparatus and system
CN103166941A (en) Data sharing method and device
CN103491122A (en) Multiple screen display interactive system and airsharing method
WO2022089271A1 (en) Wireless screen-casting method, mobile device, and computer-readable storage medium
US20180014063A1 (en) Method and Apparatus for Accessing a Terminal Device Camera to a Target Device
CN112261421B (en) Virtual reality display method and device, electronic equipment and storage medium
WO2016150191A1 (en) Data sharing method and device
CN112261096B (en) Control method and device of Internet of things equipment, internet of things equipment and storage medium
CN108494895B (en) Interactive intelligent panel, network domain conflict control method, device and medium
CN112770078A (en) Video conference terminal fusion method and device and readable storage medium
US11336731B1 (en) Methods and systems for identifying devices and positions of devices in an IoT environment
CN115883572A (en) Peripheral sharing method and device
CN114007202A (en) Method for establishing binding relationship and related equipment
CN108012167B (en) Projection service and request method and device
CN115150804B (en) Connection establishment method, storage medium and related equipment
CN115297356B (en) Equipment interaction method, system and device
WO2022161106A1 (en) Electronic device, data transmission method between electronic device and another electronic device, and medium
WO2024027713A1 (en) Scenario configuration method, electronic device and system
WO2016154788A1 (en) Mobile terminal, base station, system and method for operating application

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant