CN114422555B - CIM platform based method for self-defined configuration of IoT data analysis - Google Patents
CIM platform based method for self-defined configuration of IoT data analysis Download PDFInfo
- Publication number
- CN114422555B CN114422555B CN202210310576.2A CN202210310576A CN114422555B CN 114422555 B CN114422555 B CN 114422555B CN 202210310576 A CN202210310576 A CN 202210310576A CN 114422555 B CN114422555 B CN 114422555B
- Authority
- CN
- China
- Prior art keywords
- data
- platform
- cim
- equipment
- metadata
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/22—Parsing or analysis of headers
Abstract
The invention discloses a method for self-defining configuration of IoT data analysis based on a CIM platform, which is applied to a CIM data analysis system, wherein the data analysis system comprises the CIM platform, an Internet of things equipment end and an adapter; the CIM platform is in communication connection with the IOT equipment end through the adapter, wherein a data analysis method completes conversion and warehousing from an equipment protocol to a platform protocol JSON format according to an SDK packet provided by the CIM platform, then an equipment data model is configured on the CIM platform, when the equipment is displayed, the display is realized through the reported data metadata and the configured data model assembly data, the quick access of the equipment is realized through an SDK mode, the equipment metadata persistence is completed only by processing conversion from an equipment private protocol to a CIM platform general model after the equipment is accessed, and the data display problem is not needed to be concerned in an access stage; the processing efficiency is improved, and the hardware development cost is reduced.
Description
Technical Field
The invention relates to the technical field of internet of things data processing, in particular to a method for self-defining configuration of IoT data analysis based on a CIM platform.
Background
The internet of things technology is an infrastructure for CIM platform internet of things equipment to collect urban environment data, the existing internet of things equipment lacks of a unified data protocol standard, and all manufacturers are self-defined protocols, so that data analysis is difficult after the equipment is accessed.
Most of the CIM platform access is the Internet of things equipment which needs low-power consumption environment acquisition, the equipment measurement and operation capacity is limited, only the self-determined private protocols of various manufacturers can be sent, most of the private protocol contents are transmitted in a hexadecimal character string mode, and intuitive high-level text formats such as json and the like are not supported; fields of the acquired content of the device, which need to be displayed under different scene applications of the CIM platform, may be different, and need to support a CIM platform manager to perform dynamic configuration display.
In order to solve the above problems, some solutions are as in chinese patent: CN113726762A discloses a method for analyzing protocols of an internet of things device based on configuration files, which uses a pre-positioned unified device gateway to access, and sequentially solves the problem of multiple self-defined protocols, but this method needs to preset the analysis protocols of different devices in the gateway device in advance, and the multiple protocol processing causes the pressure born by the gateway device to be too large, the hardware development cost is high, and it is necessary to introduce new configuration files into the gateway device again for each device accessed, and it is very inflexible to modify the protocols of the devices according to the development of services.
Disclosure of Invention
Aiming at the defects in the prior art, the invention provides the method for self-defining configuration of IoT data analysis based on the CIM platform, so as to efficiently solve the problem of processing of various proprietary protocols and improve the applicability of the method.
In order to achieve the above object, the present invention provides an IoT data parsing method capable of configuring by self-definition based on a CIM platform, wherein the parsing method is applied to a CIM data parsing system, and the CIM data parsing system includes a CIM platform, an internet of things device end and an adapter; the CIM platform is in communication connection with the Internet of things equipment end through the adapter, wherein the data analysis method comprises the following steps:
s1, configuring CIM platform data, defining a common standard message of a CIM platform system to be in a json format, and predefining three reserved fields, wherein the three reserved fields are 'properties' fields, 'events' fields and 'services' fields;
s2, data conversion, namely converting the data reported by the Internet of things equipment terminal into a standard message in the step S1 through an adapter; the CIM platform respectively analyzes metadata corresponding to three predefined reserved fields according to the received standard message data, and directly persists the metadata to a time sequence database;
s3, configuring an equipment data model, configuring the equipment data model on the CIM platform according to the required function point form, and storing the equipment data model into a service database;
and S4, displaying data, namely operating corresponding function buttons at the CIM platform end according to the function characteristics, matching the CIM platform according to the data configured by the user in the function point form, combining the metadata and the function points of the equipment data model after the matching is successful, and displaying the whole combined data.
According to the data analysis method, any development language can be selected for the adapter in development, the adapter with the JAVA language version can help an accessor to quickly realize equipment access, the metadata persistence of the equipment can be completed immediately after the equipment is accessed by processing the conversion from the equipment private protocol to the CIM platform general model, and the data display problem does not need to be concerned in the access stage; the processing efficiency is improved, the hardware development cost is reduced, and the user can dynamically manage the equipment metadata through the highly-customized data model configuration of the user; flexible management is realized, and applicability is improved.
According to an advantageous embodiment of the present invention, in step S1, a "properties" field is defined to be used for storing metadata that is normally collected and reported by the internet of things device; the 'events' field is used for storing event or action metadata generated by the equipment in the Internet of things; the fields of the services are used for storing the instructions actively issued by the CIM platform and corresponding metadata.
According to an advantageous embodiment of the present invention, the adapter includes an SDK provided by the CIM platform, and the SDK is packaged with a communication module on two sides, so that the CIM platform is communicatively connected with the end of the internet of things device through the communication module.
According to an advantageous embodiment of the present invention, the function point form in step S3 includes:
function name: specifying the name of the data value displayed on the platform;
identifier: matching with metadata key values needing matching;
function type: the method comprises the following steps of dividing the system into three types according to the definition of a system general message, wherein the three types are attribute, event and service;
the data type is as follows: a data type of the device metadata;
unit: defining unit symbols of data to be displayed on a CIM platform;
and (3) reading and writing types: whether the metadata corresponding to the identifier can be modified is defined for read-only and read-write respectively.
According to an advantageous embodiment of the present invention, the data presentation in step S4 includes a query function data presentation and an instruction function data presentation. The query function data display comprises attribute query and event query, and the CIM platform retrieves the equipment metadata meeting the query conditions from the time sequence database according to the conditions during query, and then queries corresponding equipment model data configured by a user from the service database; if the equipment does not configure the equipment model data, directly returning to prompt a user to configure the equipment data model, if the data model is configured, traversing the function points of the data model, and matching according to the identifier field value and the key value of the equipment metadata; when the instruction function data is displayed, the CIM platform issues an instruction function, the CIM platform firstly verifies whether the instruction issued by a user meets the definition according to the data model, if the instruction issued by the user passes the verification, the platform is assembled into a standard message and issued to the adapter, the adapter converts the standard message instruction into a private protocol of the internet of things equipment and issues the proprietary protocol to the equipment, the equipment replies a message to the adapter after performing instruction response, the adapter then forwards the message to the CIM platform, and the CIM platform displays the final equipment data model and the data after matching an identifier configured in the equipment data model with the issued message ID.
Drawings
In order to more clearly illustrate the detailed description of the invention or the technical solutions in the prior art, the drawings used in the detailed description or the prior art description will be briefly described below. Throughout the drawings, like elements or portions are generally identified by like reference numerals. In the drawings, elements or portions are not necessarily drawn to scale.
Fig. 1 is a system architecture diagram of steps of a data parsing method according to an embodiment of the present invention.
Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The following examples are only for illustrating the technical solutions of the present invention more clearly, and therefore are only examples, and the protection scope of the present invention is not limited thereby.
It is to be noted that, unless otherwise specified, technical or scientific terms used herein shall have the ordinary meaning as understood by those skilled in the art to which the invention pertains.
As shown in fig. 1, an embodiment of the present invention provides a method for configuring IoT data parsing in a customized manner based on a CIM platform, where the parsing method is applied to a CIM data parsing system, and the CIM data parsing system includes the CIM platform, an internet of things device end, and an adapter; the CIM platform is in communication connection with the Internet of things equipment end through the adapter, wherein the data analysis method comprises the following steps:
s1, configuring CIM platform data, firstly, defining a common message of the system to be in a json format by the CIM platform, and the first level comprises three reserved fields of 'properties', 'events' and 'services'. Wherein, the specified 'properties' field is used for storing metadata which is normally collected and reported by the internet of things equipment, such as index monitoring of temperature and humidity, PM2.5 content and the like; the 'events' field is used for storing event or action metadata generated by the equipment side of the Internet of things, such as event data of equipment alarm and the like; the 'services' field is used for storing the instruction actively issued by the platform and corresponding metadata, and if the platform issues a door opening instruction to the equipment to open a door lock, the set of processes of returning the information of successfully opening the door to the platform are collectively called services metadata;
s2, data conversion, when a new type of equipment needs to be accessed to the CIM platform, an SDK (software service package) provided by the platform is downloaded, the SDK encapsulates communication modules at two sides (including communication between the SDK and the CIM platform and communication between the SDK and the equipment), an accessor only needs to complete development of a conversion part from hexadecimal message data reported by the equipment to the standard universal message json according to an SDK example, so that development of an adapter can be completed, when the associated equipment reports data, the platform respectively analyzes metadata corresponding to three predefined reserved fields according to the received data, and directly persists the metadata to a time sequence database (such as tsdb, infiluxdb and the like);
s3, configuring the device data model, wherein the user needs to configure a function point form to be filled in by the device data model on the CIM platform, wherein the function point form comprises the following form items:
function name: specifying the name of the data value displayed on the platform;
identifier: matching with metadata key values needing matching;
function type: the method comprises the following steps of dividing the system into three types according to the definition of a system general message, wherein the three types are attribute, event and service;
data type: a data type of the device metadata;
unit: defining unit symbols of data to be displayed on a CIM platform, wherein the unit symbols are not required to be filled;
and (3) reading and writing types: the method comprises the following steps that two types are read-only and read-write respectively, and whether metadata corresponding to an identifier can be modified or not is defined;
the data model can completely display the equipment data in a user-defined mode;
s4, displaying data, namely operating corresponding function buttons at the CIM platform end according to the function characteristics, wherein the displaying of the data comprises displaying of query function data and displaying of instruction function data; a user clicks a button for issuing a query function (the query comprises attribute query and event query which respectively correspond to properties and events of a system general message) on a CIM platform, the CIM platform retrieves equipment metadata meeting query conditions according to a condition metadata persistence time sequence database, and then a service database is used for querying corresponding equipment model data configured by the user; if the device does not configure the device model data, the device directly returns a prompt that the user needs to configure the device data model, if the data model is configured, the function points of the data model are traversed, matching is carried out according to the field value of the identifier and the key value of the device metadata, the metadata and the function points of the device data model are combined together after matching is successful, the whole combined data is displayed to the user after traversing is completed, and the user can visually see the real data value reported by the device.
The method comprises the steps that a user clicks an instruction issuing function button (corresponding to services in a system general message) on a CIM platform, the CIM platform firstly verifies whether the instruction issued by the user meets the definition or not according to a data model, if the verification is passed, the platform is assembled into the general message and issued to an adapter, the adapter converts the general message instruction into a private protocol of an internet of things device and issues the private protocol to the device, the device replies a message to the adapter after performing instruction response, the adapter then forwards the message to the CIM platform, and the CIM platform displays a final data model and data after matching an identifier configured in the data model with an issued message ID.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the present invention, and they should be construed as being included in the following claims and description.
Claims (6)
1. A method for self-defining configuration of IoT data analysis based on a CIM platform is characterized by being applied to a CIM data analysis system, wherein the CIM data analysis system comprises the CIM platform, an Internet of things equipment end and an adapter; the CIM platform is in communication connection with the Internet of things equipment end through the adapter, wherein the data analysis method comprises the following steps:
s1, configuring CIM platform data, defining a common standard message of a CIM platform system to be in a json format, and predefining three reserved fields, wherein the three reserved fields are 'properties' fields, 'events' fields and 'services' fields;
s2, data conversion, which converts the data reported by the equipment end of internet of things into the standard message in step S1 through the adapter, and specifically includes: when a new type of equipment needs to be accessed to the CIM platform, an SDK provided by the platform is downloaded, the SDK encapsulates communication modules on two sides, and an access person only needs to complete the development of a conversion part from hexadecimal message data reported by the equipment to a standard general message json according to an SDK example; when the Internet of things equipment reports data, the platform analyzes the metadata corresponding to the three predefined reserved fields respectively according to the received data and directly persists the metadata into a time sequence database;
s3, configuring an equipment data model, configuring the equipment data model on the CIM platform according to the required function point form, and storing the equipment data model into a service database;
and S4, displaying data, namely operating corresponding function buttons at the CIM platform end according to the function characteristics, matching the CIM platform according to the data configured by the user in the function point form, combining the metadata and the function points of the equipment data model after the matching is successful, and displaying the whole combined data.
2. The method for IoT data parsing on a basis of CIM platform capable of being customized and configured as claimed in claim 1, wherein in step S1, a "properties" field is defined for storing metadata reported by normal collection of internet of things devices; the 'events' field is used for storing event or action metadata generated by the equipment in the Internet of things; the fields of 'services' are used for storing the commands actively issued by the CIM platform and corresponding metadata.
3. The method of claim 1, wherein the function point form in step S3 comprises:
function name: specifying the name of the data value displayed on the platform side;
identifier: matching with metadata key values needing matching;
function type: the method comprises the following steps of dividing the system into three types according to the definition of a system general message, wherein the three types are attribute, event and service;
data type: a data type of the device metadata;
unit: defining unit symbols of data to be displayed on a CIM platform;
and (3) reading and writing types: whether the metadata corresponding to the identifier can be modified is defined for read-only and read-write respectively.
4. The method of claim 3, wherein the data presentation in the step S4 comprises query function data presentation and command function data presentation.
5. The method of claim 4, wherein the query function data presentation comprises attribute query and event query, and when querying, the CIM platform retrieves the device metadata meeting query conditions from the timing database according to the conditions, and then queries the service database for the corresponding device model data configured by the user; if the device does not configure the device model data, the device model data is directly returned to prompt a user to configure the device data model, if the data model is configured, the function points of the data model are traversed, and matching is carried out according to the identifier field value and the key value of the device metadata.
6. The IoT data analysis method based on the CIM platform capable of being configured by self-definition is characterized in that when the instruction function data is displayed, the CIM platform issues an instruction function, the CIM platform firstly verifies whether the instruction issued by the user meets the definition according to the data model, if the verification is passed, the platform is assembled into a standard message and issued to an adapter, the adapter converts the standard message instruction into a private protocol of an internet of things device and issues the private protocol to the device, the device replies a message to the adapter after performing instruction response, the adapter then forwards the message to the CIM platform, and the CIM platform displays the final device data model and the data after matching the identifier configured in the device data model with the issued message ID.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210310576.2A CN114422555B (en) | 2022-03-28 | 2022-03-28 | CIM platform based method for self-defined configuration of IoT data analysis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210310576.2A CN114422555B (en) | 2022-03-28 | 2022-03-28 | CIM platform based method for self-defined configuration of IoT data analysis |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114422555A CN114422555A (en) | 2022-04-29 |
| CN114422555B true CN114422555B (en) | 2022-07-12 |
Family
ID=81263504
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210310576.2A Active CN114422555B (en) | 2022-03-28 | 2022-03-28 | CIM platform based method for self-defined configuration of IoT data analysis |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114422555B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115412620B (en) * | 2022-08-29 | 2024-01-09 | 广东电网有限责任公司东莞供电局 | Substation data analysis method based on communication protocol database system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017218437A1 (en) * | 2016-06-13 | 2017-12-21 | Neura, Inc. | Situation forecast mechanisms for internet of things integration platform |
| CN111815751A (en) * | 2020-07-13 | 2020-10-23 | 北京优锘科技有限公司 | Intelligent fire-fighting Internet of things visual management system and method |
| CN112333227A (en) * | 2020-09-11 | 2021-02-05 | 浙江工业大学 | Internet of things platform of mixed type protocol based on rule engine |
| CN112714193A (en) * | 2021-03-26 | 2021-04-27 | 深圳佳兆业科技集团有限公司 | Community data processing system, method, device and equipment based on Internet of things platform |
| CN114157692A (en) * | 2021-11-30 | 2022-03-08 | 广东电网有限责任公司广州供电局 | Multi-source polymorphic mass heterogeneous terminal universal access interconnection protocol conversion method and system |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111079383A (en) * | 2018-10-19 | 2020-04-28 | 北京奇虎科技有限公司 | Data interaction method, device and system for cloud platform and equipment of Internet of things |
| CN110941656A (en) * | 2019-09-23 | 2020-03-31 | 新奥数能科技有限公司 | Internet of things data access method and device based on universal energy CIM |
| CN110971614A (en) * | 2019-12-17 | 2020-04-07 | 软通动力信息技术（集团）有限公司 | Internet of things adaptation method and system, computer equipment and storage medium |
| CN111459889B (en) * | 2020-03-08 | 2023-06-16 | 中电海康集团有限公司 | Equipment data model generation method and device for Internet of things platform |
| CN113495915A (en) * | 2020-04-02 | 2021-10-12 | 中移物联网有限公司 | Information processing method and device of Internet of things equipment and cloud server |
| WO2022011563A1 (en) * | 2020-07-14 | 2022-01-20 | Oppo广东移动通信有限公司 | Internet of things configuration method and apparatus, computer device, and storage medium |
| CN112215452A (en) * | 2020-07-28 | 2021-01-12 | 智维云图(上海)智能科技有限公司 | Intelligent fire-fighting remote monitoring method and system and safety assessment method |
| CN112187632B (en) * | 2020-09-23 | 2022-09-02 | 大唐广电科技（武汉）有限公司 | Industrial equipment integration model and construction method, edge gateway device and industrial equipment integration system |
| CN113407157B (en) * | 2021-06-24 | 2023-06-16 | 青岛海尔科技有限公司 | Object model determining method and device, storage medium and electronic device |
| CN113805867B (en) * | 2021-08-24 | 2024-03-19 | 中通服咨询设计研究院有限公司 | Internet of things platform based on visual static script engine |
| CN113642920B (en) * | 2021-08-30 | 2023-10-31 | 南京数睿数据科技有限公司 | Quick construction method for digital application in industrial manufacturing field |
-
2022
- 2022-03-28 CN CN202210310576.2A patent/CN114422555B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017218437A1 (en) * | 2016-06-13 | 2017-12-21 | Neura, Inc. | Situation forecast mechanisms for internet of things integration platform |
| CN111815751A (en) * | 2020-07-13 | 2020-10-23 | 北京优锘科技有限公司 | Intelligent fire-fighting Internet of things visual management system and method |
| CN112333227A (en) * | 2020-09-11 | 2021-02-05 | 浙江工业大学 | Internet of things platform of mixed type protocol based on rule engine |
| CN112714193A (en) * | 2021-03-26 | 2021-04-27 | 深圳佳兆业科技集团有限公司 | Community data processing system, method, device and equipment based on Internet of things platform |
| CN114157692A (en) * | 2021-11-30 | 2022-03-08 | 广东电网有限责任公司广州供电局 | Multi-source polymorphic mass heterogeneous terminal universal access interconnection protocol conversion method and system |
Non-Patent Citations (1)
| Title |
|---|
| 面向物联网的海量高性能分布式系统架构及实现;田敬波;《电信技术》;20170725(第07期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114422555A (en) | 2022-04-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108667807B (en) | Protocol self-adaption method and system based on monitoring cloud platform and gateway | |
| CN110933146B (en) | Data conversion method and device and server | |
| US5828842A (en) | Method of creating information for executing network management operations from a simplified definition of an operation sequence and providing a network management operation sequence, used in the information | |
| US20090327511A1 (en) | Message conversion apparatus for integrated monitoring of industrial equipment | |
| US6405365B1 (en) | Computer program command generator and parser | |
| CN110912782B (en) | Data acquisition method, device and storage medium | |
| CN114422555B (en) | CIM platform based method for self-defined configuration of IoT data analysis | |
| CN109542786A (en) | Visual testing method and device | |
| CN113360519B (en) | Data processing method, device, equipment and storage medium | |
| CN113658591A (en) | Voice interaction adaptation system for smart home | |
| CN112055062B (en) | Data communication method, device, equipment and readable storage medium | |
| US20030135648A1 (en) | CIM to SNMP data mapper | |
| CN116069540A (en) | Acquisition, analysis and processing method and device for running state of software and hardware parts of system | |
| EP1127441B1 (en) | Enterprise communication protocol | |
| US6772417B1 (en) | Method for processing receiving message of monitor terminal in communication operating system | |
| CN114793191A (en) | Internet of things integration system and method based on domain model | |
| CN111723036B (en) | Data processing method, related device and computer storage medium | |
| KR20110048255A (en) | Method and apparatus for controling the controlled device using SMS message | |
| CN109613423A (en) | High-voltage circuitbreaker on-line monitoring and trouble analysis system based on vibration signal | |
| CN116743886A (en) | Industrial control equipment data acquisition system based on Internet of things | |
| CN112799859B (en) | Data interaction method of hybrid cloud | |
| CN110019281B (en) | Identification method and device for broadcasting and television equipment | |
| CN113674741A (en) | Method for configuring switch in intelligent interactive mode | |
| CN114356958A (en) | Equipment data query method and device, server and computer readable storage medium | |
| CN117114647A (en) | Method for constructing unified data platform of digital twin system of transformer substation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220825 Address after: 400000 1-2, building 24, No. 7, Jinchang Road, North New Area, Chongqing Patentee after: Chongqing SUDI Technology Co.,Ltd. Address before: 610000 No. 1610, floor 16, unit 1, building 1, No. 1700, north section of Tianfu Avenue, Chengdu hi tech Zone, Chengdu pilot Free Trade Zone, Sichuan Province Patentee before: Chengdu roushui Technology Co.,Ltd. |