CN115643312A - Multi-protocol data acquisition and protocol conversion device based on cloud gateway - Google Patents
Multi-protocol data acquisition and protocol conversion device based on cloud gateway Download PDFInfo
- Publication number
- CN115643312A CN115643312A CN202211210615.8A CN202211210615A CN115643312A CN 115643312 A CN115643312 A CN 115643312A CN 202211210615 A CN202211210615 A CN 202211210615A CN 115643312 A CN115643312 A CN 115643312A
- Authority
- CN
- China
- Prior art keywords
- protocol
- data
- cloud gateway
- protocol conversion
- cloud
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a multi-protocol data acquisition and protocol conversion device based on a cloud gateway, which comprises terminal equipment, the cloud gateway and a cloud platform, wherein the cloud gateway is connected with the terminal equipment; the cloud gateway comprises a data interface, a protocol analysis unit, a protocol buffer area and a protocol conversion unit; the data interface receives an access signal of at least one terminal device, after the access is successful, the protocol analysis unit analyzes and reads the communication protocols of different terminal devices, and sequentially puts the communication protocol data of different terminal devices into the protocol buffer area to wait for protocol conversion; the protocol conversion unit converts the multi-protocol data into a standard data format in sequence; and finally, transmitting the standard data format to the cloud platform by using a communication technology. The device realizes the problems of data acquisition, protocol conversion and asynchronous processing of concurrent tasks between the cloud platform and different construction site terminal devices, and ensures the integrity, continuity and reliability of multi-protocol conversion data.
Description
Technical Field
The invention relates to the technical field of intelligent construction sites, in particular to a multi-protocol data acquisition and protocol conversion device based on a cloud gateway.
Background
Due to the management and control requirements of complex scenes, the construction site needs to cover various data information, such as real-name data of workers, attendance management data, various sensing data for monitoring the operation state of mechanical equipment, construction material management data for video acceptance automatic counting, construction environment noise monitoring data and the like. The problems of complex protocol, poor mutual compatibility and the like exist among different terminal equipment sensor systems, so that data on a construction site are difficult to acquire and upload uniformly. At present, different terminal devices in an intelligent construction site are generally accessed through the methods of ethernet, bus, wireless and the like, but different access methods and different terminal devices make transmission protocols complex and diverse, so that a communication interface protocol between a standard terminal device and a cloud platform is lacked.
Disclosure of Invention
In order to solve the problems that protocols between different industrial sensor systems and cloud platforms are complex and various, relevant communication interface protocol standards are lacked and the like in the prior art, the invention provides a multi-protocol data acquisition and protocol conversion device based on a cloud gateway based on an Internet of things cloud platform.
In order to achieve the purpose, the invention adopts the following technical scheme.
A multi-protocol data acquisition and protocol conversion device based on a cloud gateway comprises: the system comprises terminal equipment, a cloud gateway and a cloud platform;
the cloud gateway comprises a data interface, a protocol analysis unit, a protocol buffer area and a protocol conversion unit;
the data interface receives an access signal of at least one terminal device, and after the access is successful, the protocol analysis unit analyzes and reads the communication protocols of different terminal devices;
after the analysis and reading are successful, the protocol analysis unit sequentially puts the communication protocol data of different terminal equipment into the protocol buffer area to wait for protocol conversion;
the protocol conversion unit converts the multi-protocol data of the protocol buffer area into a standard data format in sequence;
and after the conversion is successful, transmitting the standard data format to the cloud platform by using a communication technology.
Preferably, the cloud gateway is built by Python and flash, and a B/S framework combining a Tornado Web server and a flash Web server is adopted.
Preferably, the cloud gateway also manages the distributed task queue by using a query and a memory database Redis.
As a further improvement of the present invention, the cloud gateway further comprises a data transmission failure detection mechanism for detecting the integrity of the data.
Preferably, the data transmission failure detection mechanism is provided with a data storage unit.
Preferably, the data transmission failure detection mechanism includes non-blocking communication and/or breakpoint transmission.
Preferably, the different terminal devices comprise a shield machine sensor, a license plate recognition sensor, a foundation pit monitoring sensor, a tower crane sensor, a video monitoring system, a deep foundation pit monitoring system, a labor management system, an external labor system, an external open data platform, a Bluetooth positioning system and an algorithm system.
Preferably, the data interface may be a canonical API interface.
Preferably, the standard data format may be a data format of a message queuing telemetry transmission protocol with an internet of things label.
Preferably, the communication technology comprises Wi-Fi, NB-IoT and Ethernet.
In summary, compared with the prior art, the invention provides a multi-protocol data acquisition and protocol conversion device based on a cloud gateway, which has the following beneficial effects: the device realizes data acquisition and protocol conversion between the cloud platform and different construction site terminal devices; meanwhile, aiming at the problem of reliable implementation in protocol conversion, a data transmission fault detection mechanism is provided to realize the breakpoint continuous transmission function of data, so that concurrent tasks can be rapidly processed to ensure the integrity, continuity and reliability of multi-protocol conversion data.
Drawings
Fig. 1 is a general architecture of a multi-protocol data acquisition and protocol conversion apparatus based on a cloud gateway according to the present invention.
Fig. 2 is a cloud gateway structure of a multi-protocol data acquisition and protocol conversion apparatus based on a cloud gateway according to the present invention.
Fig. 3 is a real-time transmission mechanism of a multi-protocol data acquisition and protocol conversion apparatus based on a cloud gateway according to the present invention.
Fig. 4 is a power-off continuous transmission flow of the multi-protocol data acquisition and protocol conversion device based on the cloud gateway.
Fig. 5 is a multi-machine access internet of things open service model of a multi-protocol data acquisition and protocol conversion device based on a cloud gateway.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
It is to be understood that in the description of the present invention, the terms "upper", "lower", "front", "rear", "left", "right", "top", "bottom", "inner", "outer", and the like indicate orientations or positional relationships based on those shown in the drawings, and are used only for convenience in describing the present invention and for simplicity in description, and do not indicate or imply that the device or element being referred to must have a specific orientation, be constructed in a specific orientation, and be operated, and thus, should not be construed as limiting the present invention.
Fig. 1 is a general architecture of a multi-protocol data acquisition and protocol conversion apparatus based on a cloud gateway according to the present invention, which may include a terminal device layer, an OT layer, an IT layer, and a cloud platform layer. The terminal equipment can be a shield machine, license plate recognition, foundation pit detection, a tower crane sensor, video monitoring and the like. The terminal equipment layer is connected with the OT layer through a standard API (application program interface), the OT layer collects and analyzes various communication protocols of the multiple equipment through the protocol collecting and analyzing unit, and a data source is provided for data and scene reference of the IT layer; the IT layer converts the multi-protocol data into a message queue telemetry transmission protocol (MQTT protocol) through a protocol conversion unit, thereby realizing the protocol unification of the multi-protocol data; and finally, transmitting the data to the cloud platform through Wi-Fi, NB-IoT and Ethernet.
In the aspect of protocol analysis and protocol conversion, complex equipment protocols are collected, analyzed and converted into a uniform standard data format; in the aspect of real-time reliability, a data caching unit is arranged to ensure that data is not lost, and meanwhile, the integrity, the continuity and the reliability of the data are ensured by using a non-blocking communication and power-off continuous transmission method.
The cloud gateway structure is mainly built by adopting Python and flash to realize multi-protocol data acquisition, analysis, conversion, transmission and breakpoint continuous transmission of the terminal equipment. More specifically, based on B/S architecture development of the combination of the Tornado Web server and the flash Web server, the concurrent processing capacity of the Tornado server is combined with the asynchronous characteristic and the expandability of the flash micro-architecture to realize the non-blocking performance; meanwhile, a Celery asynchronous task queue and a memory database Redis are adopted to manage a distributed task queue, protocol conversion of multi-protocol data is scheduled in real time, all time-consuming synchronous tasks such as complex business, logic processing, database operation, IO and the like are handed to a Celery Worker for processing, and after the asynchronous processing of the task queue is finished, the tasks are returned to Tornado and Celery in an interactive asynchronous mode, so that the whole multi-protocol data acquisition and protocol conversion task of the cloud gateway is completely asynchronous.
In order to explain the design structure of the cloud gateway more clearly, the following description will be made with reference to fig. 2.
Fig. 2 is a cloud gateway structure of a multi-protocol data acquisition and protocol conversion apparatus based on a cloud gateway according to the present invention. The cloud gateway structure comprises an MQTT Client layer, a data communication layer, a gateway configuration layer and a multi-protocol driver layer. The data communication layer comprises data analysis, gateway log and data synchronization; the gateway configuration layer is mainly used for configuring protocol parameters; the multi-protocol driver layer includes, but is not limited to, OPC UA, modbus, http. When the cloud application accesses the cloud gateway, the data communication layer receives the instruction and then performs data analysis, then the communication protocols of different terminal devices are transmitted to the gateway configuration layer, and the gateway configuration layer performs protocol parameter configuration; after the data is finished, a multi-protocol driver layer is triggered to start, multi-protocol data is converted into a data format of a message queue telemetering transmission protocol with Internet of things labels and unified into a standard data format; and finally, transmitting the data to the cloud platform through Wi-Fi, NB-IoT and Ethernet.
It is worth to be noted that the process is reversible, and the cloud platform can also transmit the unified standard data format to the cloud gateway, and then the cloud gateway converts the unified standard data format into the transmission protocols of different terminal devices, and finally feeds the transmission protocols back to the terminal devices.
In addition, the data communication layer is also provided with a gateway log and data synchronization unit, daily data of the gateway can be stored in real time, the running condition of the gateway can be monitored at any time, when the cloud gateway is abnormal, the gateway log can be fed back to the cloud application, faults can be found out quickly, the problem solving efficiency is improved, and meanwhile the real-time performance of the data is guaranteed.
For a more clear description of the real-time transmission of the cloud gateway, the description is further made with reference to fig. 3. Fig. 3 is a real-time transmission mechanism, and the cloud gateway of the present invention can analyze communication protocols of various access devices with different data types and different communication standards, access different terminal devices through a data interface, analyze and read different terminal device communication protocols through a protocol analysis unit, implement access of bottom device data, and place multi-protocol data in a protocol buffer area to wait for protocol conversion. When the multi-protocol data is put into the protocol buffer area, a series of analyzed execution units are formed to be sequentially arranged and wait, then the task queue 1, the task queue 2, the task queue 3 and the like are sequentially formed in sequence, and finally, the conversion is sequentially carried out according to the arrangement sequence, so that the integrity, the continuity and the reliability of the data are ensured. It should be noted that the real-time transmission mechanism is complied with whether the data is in the protocol parsing unit, the protocol buffer, the protocol conversion unit, or transmitted to the cloud.
As a further improvement of the present invention, the cloud gateway further comprises a data transmission failure detection mechanism for detecting the integrity of the data. The data transmission fault detection mechanism is provided with a data storage unit. As shown in fig. 4, in order to prevent false connection, the cloud gateway data may periodically send a heartbeat packet to the cloud and monitor the connection state, and if the data is abnormally uploaded, the cloud gateway may temporarily store the data, monitor the connection abnormality and reconnect, that is, if the connection is disconnected, the connection may be reestablished, and the data may be continuously transmitted to the cloud. If the data uploading is normal, the data can be transmitted to the cloud end in real time, and whether the cloud gateway has the collected data or not is judged: if the acquired data exist, the data temporarily stored by the cloud gateway can be automatically emptied after the uploading is finished; and if the collected data does not exist, continuously returning to the preliminary stage, and transmitting the data to the cloud again.
It should be noted that when the cloud gateway data transmission is abnormal and the fault data is disconnected, that is, after the cloud gateway monitors that the cloud channel on the node data is unexpectedly offline, the power failure is immediately adopted to continue transmitting, the data packet is stored in the gateway local database, and after the connection is recovered, the data packet in the data storage unit continues to be transmitted to the cloud data center. Therefore, even if the communication between the gateway and the cloud data center is abnormal, important data can not be lost. When the communication is recovered to normal, the data cached in the section can be transmitted to the upper equipment, so that the integrity, continuity and reliability of the data are ensured.
In order to clearly and completely describe the technical solution in the embodiment of the present invention, the following will be further explained with reference to fig. 5. As shown in fig. 5, the multi-protocol data acquisition and protocol conversion apparatus based on the cloud gateway provided by the present invention can analyze communication protocols of various access devices with different data types and different communication standards. Accessing different terminal devices through a data interface, analyzing and reading different terminal device communication protocols through a protocol analysis unit, realizing the access of bottom layer device data and putting multi-protocol data into a real-time transmission mechanism to wait for protocol conversion; the protocol conversion unit converts the multi-protocol data into a standard data format in sequence; and after the conversion is successful, transmitting the standard data format to the cloud platform by using a communication technology.
The terminal equipment is various, such as a shield machine sensor of a shield machine supplier system, license plate identification of the license plate supplier system, sensor data of an equipment supplier system (such as concrete, a gantry crane, electricity utilization equipment, dust raising equipment, a tower crane and a crawler crane), a foundation pit monitoring sensor, a deep foundation pit monitoring system, a labor management system, an external labor system, an externally-opened data platform and the like. It should be noted that the terminal device may also be a bluetooth positioning system or an algorithm system deployed in a project lan environment, etc. The Bluetooth positioning system comprises a basic service end and a position analysis server, data are transmitted between the UWB base station and the base station service end through a network cable, the basic service end receives position data transmitted by the base station, then the position analysis server analyzes the position number received by the service end to obtain the specific geographic position of the UWB beacon, and then the data are transmitted to the platform of the Internet of things. The algorithm system comprises an Al video algorithm Faraday flow server and an Al algorithm model. The Al algorithm model comprises a safety helmet, a reflective garment, a hole boundary crossing and the like, and mainly analyzes unsafe behaviors in the video stream. For example, the camera can collect video streams and transmit the video streams to the Al algorithm server through a network cable, or the camera and the video are transmitted to the video recorder through a local area network and then transmitted to the BIM management platform through the Haokangshi cloud CDN, the stream pulling and the transcoding.
When various terminal equipment systems are connected to the Internet of things cloud platform, relevant data of the terminal equipment are analyzed and converted into standard data formats, the standard data formats are transmitted to a central system of basic data services of the smart building site through the Internet of things cloud platform, and the central system of the smart building site is connected with a building and management platform database and a smart building site platform database.
On the one hand, data can be docked with a building and management platform database through a central system of the intelligent construction site through a building and management platform interface service, and equipment information and warning data are pushed. The BIM management platform is provided with a visual interface technology management module, a quality module, a progress module, a safety module, a smart decision module, an information module, an electronic sand table BIM/GIS model module and a smart construction site, and can clearly and directly carry out platform management, data query and display and the like. On the other hand, data can be transmitted to the intelligent construction site platform database through the intelligent construction site basic data service central system, and transmitted to the intelligent construction site level service processing system, and finally, the BIM is built and managed.
In a word, the cloud gateway based multi-protocol data acquisition and protocol conversion device provided by the invention is based on an internet of things cloud gateway architecture, a terminal equipment layer is connected with an OT layer through a standard API (application program interface), the OT layer acquires and analyzes various communication protocols of multiple devices through a protocol acquisition and analysis unit, and a data source is provided for data and scene reference of an IT layer; the IT layer converts the multi-protocol data into a message queue telemetry transmission protocol (MQTT protocol) through a protocol conversion unit, thereby realizing the protocol unification of the multi-protocol data; and finally, transmitting the data to the cloud platform through Wi-Fi, NB-IoT and Ethernet. And analyzing and reading different terminal equipment communication protocols through the protocol analysis unit, realizing the access of bottom equipment data and putting multi-protocol data into a one-step buffer area to wait for protocol conversion. The data breakpoint continuous transmission function is realized by designing a data transmission fault detection mechanism, so that the integrity, the continuity and the reliability of data are ensured.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered as the technical solutions and the inventive concepts of the present invention within the technical scope of the present invention.
Claims (10)
1. The utility model provides a multi-protocol data acquisition and protocol conversion device based on cloud gateway which characterized in that, the device includes: the system comprises terminal equipment, a cloud gateway and a cloud platform;
the cloud gateway comprises a data interface, a protocol analysis unit, a protocol buffer area and a protocol conversion unit;
the data interface receives an access signal of at least one terminal device, and after the access is successful, the protocol analysis unit analyzes and reads the communication protocols of different terminal devices;
after the analysis and reading are successful, the protocol analysis unit sequentially puts the communication protocol data of different terminal equipment into the protocol buffer area to wait for protocol conversion;
the protocol conversion unit converts the multi-protocol data of the protocol buffer area into a standard data format in sequence;
and after the conversion is successful, transmitting the standard data format to the cloud platform by using a communication technology.
2. The device of claim 1, wherein the cloud gateway is built by Python and Flask and adopts a B/S architecture combining a Tornado Web server and a Flask Web server.
3. The cloud gateway-based multi-protocol data acquisition and protocol conversion device of claims 1-2, wherein the cloud gateway also manages the distributed task queue using both Celery and Redis.
4. The cloud gateway-based multi-protocol data acquisition and protocol conversion apparatus of claim 1, wherein the cloud gateway further comprises a data transmission failure detection mechanism for detecting data integrity.
5. The cloud gateway-based multi-protocol data acquisition and protocol conversion device of claim 4, wherein the data transmission failure detection mechanism is provided with a data storage unit.
6. The cloud gateway-based multi-protocol data collection and protocol conversion apparatus of claim 4, wherein the data transmission failure detection mechanism comprises non-blocking communication and/or breakpoint resumption.
7. The cloud gateway-based multi-protocol data acquisition and protocol conversion device of claim 1, wherein the different terminal devices comprise a shield machine sensor, a license plate recognition, a foundation pit monitoring sensor, a tower crane sensor, a video monitor, a deep foundation pit monitoring system, a labor management system, an external labor system, an externally-open data platform, a Bluetooth positioning system and an algorithm system.
8. The cloud gateway-based multi-protocol data acquisition and protocol conversion device of claim 1, wherein the data interface is a canonical API interface.
9. The cloud gateway-based multi-protocol data acquisition and protocol conversion device of claim 1, wherein the standard data format is a data format of a message queuing telemetry transmission protocol with internet of things tagging.
10. The cloud gateway-based multi-protocol data acquisition and protocol conversion apparatus as claimed in claim 1, wherein the communication technologies include Wi-Fi, NB-IoT, and ethernet.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211210615.8A CN115643312A (en) | 2022-09-30 | 2022-09-30 | Multi-protocol data acquisition and protocol conversion device based on cloud gateway |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211210615.8A CN115643312A (en) | 2022-09-30 | 2022-09-30 | Multi-protocol data acquisition and protocol conversion device based on cloud gateway |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115643312A true CN115643312A (en) | 2023-01-24 |
Family
ID=84941339
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211210615.8A Pending CN115643312A (en) | 2022-09-30 | 2022-09-30 | Multi-protocol data acquisition and protocol conversion device based on cloud gateway |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115643312A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116709598A (en) * | 2023-06-05 | 2023-09-05 | 广州达谙信息科技有限公司 | Collect cloud limit end and cooperate integrative intelligent gateway system |
-
2022
- 2022-09-30 CN CN202211210615.8A patent/CN115643312A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116709598A (en) * | 2023-06-05 | 2023-09-05 | 广州达谙信息科技有限公司 | Collect cloud limit end and cooperate integrative intelligent gateway system |
| CN116709598B (en) * | 2023-06-05 | 2024-02-20 | 广州达谙信息科技有限公司 | Collect cloud limit end and cooperate integrative intelligent gateway system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109669406A (en) | A kind of remote online monitoring system and its workflow of industrial equipment | |
| CN210605801U (en) | Construction engineering project construction informatization supervision system | |
| CN110995859A (en) | Intelligent transformer substation supporting platform system based on ubiquitous Internet of things | |
| CN111062504A (en) | AR technology-based intelligent power distribution station operation and maintenance system and method | |
| CN104966330A (en) | Remote machine room intelligent inspection system based on cloud computer | |
| CN101976888A (en) | Main station system for transformer substation videos and environment monitoring | |
| CN106814671A (en) | Underground engineering operational management integrated monitoring apparatus | |
| CN108401257A (en) | A kind of railway base station Integrated Monitoring System | |
| CN104269919A (en) | Circuit breaker operating mechanism monitoring system and method | |
| CN115643312A (en) | Multi-protocol data acquisition and protocol conversion device based on cloud gateway | |
| CN109038813A (en) | Power transmission line intelligent managing and control system | |
| CN114827140A (en) | Real-time data centralized management and control system for wind tunnel site | |
| CN111031018B (en) | Transformer substation network security monitoring client system and implementation method thereof | |
| CN115047841A (en) | Wind turbine generator system remote fault diagnosis system based on cloud platform | |
| CN102355575A (en) | Distributed video monitoring device with pre-warning function | |
| CN112947364A (en) | System and method for early warning of equipment faults of power distribution station based on big data | |
| CN102035254A (en) | Video and environment monitoring district-level master station system of transformer substation | |
| Huang | Architecture of audio broadcasting coverage monitoring system based on internet of things | |
| CN115665682A (en) | Wireless data acquisition and video monitoring system and method based on 5G Internet of things | |
| CN213987210U (en) | Remote acquisition control system suitable for rural sewage treatment station | |
| CN113891269A (en) | Underground wireless network data real-time transmission system based on 4G, 5G, WIFI6 and UWB | |
| CN114401167A (en) | Data transmission method and device for edge gateway and cloud server | |
| CN209803613U (en) | Plastic mechanical equipment monitoring device and system | |
| CN110266558A (en) | A kind of lifting means monitoring of working condition Internet-based and intelligent diagnosing method | |
| CN113858194A (en) | A other robot that stands for job site auxiliary management |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |