CN105138546A - Dom4J based IMS information equipment ledger duplicate elimination method - Google Patents

Dom4J based IMS information equipment ledger duplicate elimination method Download PDF

Info

Publication number
CN105138546A
CN105138546A CN201510403124.9A CN201510403124A CN105138546A CN 105138546 A CN105138546 A CN 105138546A CN 201510403124 A CN201510403124 A CN 201510403124A CN 105138546 A CN105138546 A CN 105138546A
Authority
CN
China
Prior art keywords
equipment
database
file
data
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510403124.9A
Other languages
Chinese (zh)
Other versions
CN105138546B (en
Inventor
邹岳琳
王天军
马斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
State Grid Corp of China SGCC
Information and Telecommunication Branch of State Grid Xinjiang Electric Power Co Ltd
Original Assignee
State Grid Corp of China SGCC
Information and Telecommunication Branch of State Grid Xinjiang Electric Power Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by State Grid Corp of China SGCC, Information and Telecommunication Branch of State Grid Xinjiang Electric Power Co Ltd filed Critical State Grid Corp of China SGCC
Priority to CN201510403124.9A priority Critical patent/CN105138546B/en
Publication of CN105138546A publication Critical patent/CN105138546A/en
Application granted granted Critical
Publication of CN105138546B publication Critical patent/CN105138546B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/80Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
    • G06F16/84Mapping; Conversion
    • G06F16/86Mapping to a database

Abstract

The invention relates to the technical field of automatic duplicate elimination of equipment ledgers, in particular to a Dom4J based IMS information equipment ledger duplicate elimination method. The method involves a standard XML module, an analysis module, a database comparison module and a data output and import module, wherein the standard XML module establishes standardized equipment ledger data and stores equipment attribute values in a database; the analysis module analyzes the data in the XML module and determines equipment nodes; the database comparison module compares an imported equipment IP with an equipment IP in the database; and the data output and import module remains and outputs a final XML file for realizing duplicate elimination of the equipment ledgers in an IMS system. According to the method, the maintenance efficiency of the information equipment ledgers in the IMS system is improved, relatively large data documents can be quickly and effectively processed, the performance is excellent, the function is powerful, the preparation time before importing the equipment ledgers for the IMS system is effectively shortened, the duplicate elimination of the equipment ledgers is quickly realized, and the data processing reliability is high.

Description

IMS information equipment account based on Dom4J disappears weighing method
Technical field
the equipment account of the present invention relates to disappears heavy technical field automatically, is that a kind of IMS information equipment account based on Dom4J disappears weighing method.
Background technology
along with the strengthened research of IMS system in enterprise production and management process, in various information system, need the data grows such as production, project, equipment monitored many, also more and more higher to the promptness of these data, integrity demands.At present, the monitoring that the change that realize data can be timely, lasting, need the renewal that the energy of the data message in IMS system is reliable, timely and complete, the change of this demand just makes also to improve the requirement of IMS maintainer thereupon.Maintainer needs to safeguard equipment account information in time, accurately, and at present maintainer seriously lacks and specialized capability is on the low side, causes maintenance efficiency low.
need to be completed by our department maintainer because existing IMS system has a large amount of data, need the data volume of maintenance huge, the importing spended time of data is longer in addition, and IMS system itself is without the heavy function that disappears, even if exist in the data system repeating to import, be also considered to newly import data.Before account information imports to system, just need operation maintenance personnel manpower comparing pair, carry out disappearing heavily, this link occupies a large amount of time and efforts of operation maintenance personnel, causes in existing IMS system, and it is very low that equipment account imports efficiency.Usually the renewal of the equipment in other places is needed to expend one day even longer time, add operation cost.
at present, the manpower comparing adopted is imported to information account in IMS system and offsets weighing method, although can the importing of finishing equipment account, but but consume a large amount of time and efforts and accuracy rate is not enough, frequently change as run into equipment, the monitoring of alteration not only can not be provided in time, more may be huge because of operation/maintenance data amount, cause equipment account data inaccurate, the data of mistake are provided, affect the normal monitoring function of IMS system.In prior art, the normal parsing adopting traditional Dom tree to carry out XML file, if the data volume that process is larger, then can extend the setup time before to IMS system introducing equipment account, consume a large amount of time and efforts.
Summary of the invention
the invention provides a kind of IMS information equipment account based on Dom4J to disappear weighing method, overcome the deficiency of above-mentioned prior art, it effectively can solve IMS devices in system account and safeguard time and efforts without the defect and the existing heavy at substantial that manually disappears of looking into heavy function and the not high problem of the heavy accuracy rate that disappears, more efficiently solving existing manually disappearing heavily requires high to operation maintenance personnel specialty, the problem that operation maintenance personnel serious loss causes maintenance efficiency low.
technical scheme of the present invention is realized by following measures: a kind of IMS information equipment account based on Dom4J weighing method that disappears comprises the following steps:
step one: equipment account file to be updated is carried out pre-service, build standard x ML module, equipment account data is carried out standardization, convert standard x ML file layout to, the equipment account data of making has and the platform onrelevant used, with the language onrelevant used, the uncorrelated data interchange format of system with using, enters step 2 afterwards;
step 2: whether judgment device account file meets standard x ML file, if meet standard x ML file, then enters step 4, if do not meet standard x ML file, then enters step 3;
step 3: the equipment account not meeting standard x ML file is carried out standardization again, enters step 4 afterwards;
step 4: by Dom4J parses policy, standard x ML file is resolved in parsing module, the physical IP address of acquisition equipment, by the uniqueness of the physical IP address determination equipment of equipment, resolving the node and attribute that in the file obtained, record preservation needs, enter step 5 afterwards;
step 5: in database contrast module, the IP in the device IP of importing and database is analyzed, enters step 6 afterwards;
step 6: whether deposited in a database by comparative analysis judgment device IP, if exist, then deletes the facility information of importing, judges to terminate; If do not exist, then write by facility information and preserve in a database, in output database, non-existent equipment account XML file, enters step 7 afterwards;
step 7: directly import in IMS system through exporting the XML normative document importing data module output, the data deduplication realizing IMS equipment account is safeguarded.
here is the further optimization and/or improvements to foregoing invention technical scheme:
above-mentioned in step 3, equipment account data carries out again standardized process, and again being processed by Java language needs to import the equipment account data file in IMS system.
above-mentioned in step 5, device IP already present in the device IP of importing and database contrasts by database contrast module in the Business Logic of database model.
above-mentioned in step 6, export importing data module and in the data persistence layer of database model, facility information write non-existent in database is preserved and exported final XML file.
the present invention imports each node of file by analyzing device, adopts the mode of database contrast IP address to realize disappearing heavily, effectively solves the maintenance of IMS devices in system account without the defect looking into heavy function, improve the maintenance efficiency of IMS system information equipment account; Equipment account file adopts the parses policy of Dom4J, can process larger data document fast and effectively, excellent performance, powerful and easy to use, and effectively shorten the setup time before for IMS system introducing equipment account, data processing reliability is strong.The use of the inventive method decreases the workload of operation maintenance personnel and requires that degree is not high to the specialty of operation maintenance personnel, increase effectively the troop of operation maintenance personnel.
Accompanying drawing explanation
accompanying drawing 1 is the theory of constitution figure of preferred embodiment.
accompanying drawing 2 is the database model diagram of preferred embodiment.
accompanying drawing 3 is the workflow diagram of preferred embodiment.
coding in accompanying drawing is respectively: 1 is standard x ML module, and 2 is parsing module, and 3 is database contrast module, and 4 import data module for exporting, and 5 is Business Logic, and 6 is ensured sustained development layer.
Embodiment
the present invention by the restriction of following embodiment, can not determine concrete embodiment according to technical scheme of the present invention and actual conditions.
in the present invention, for convenience of description, the description of the relative position relation of each parts is all be described according to the Butut mode of Figure of description 1, as: the position relationship of forward and backward, upper and lower, left and right etc. determines according to the Butut direction of Figure of description.
below in conjunction with embodiment and accompanying drawing, the invention will be further described:
as shown in accompanying drawing 1,2,3, should to disappear weighing method based on IMS information equipment account of Dom4J, comprise the following steps:
step one: equipment account file to be updated is carried out pre-service, build standard x ML module 1, equipment account data is carried out standardization, convert standard x ML file layout to, the equipment account data of making has and the platform onrelevant used, with the language onrelevant used, the uncorrelated data interchange format of system with using, enters step 2 afterwards;
step 2: whether judgment device account file meets standard x ML file, if meet standard x ML file, then enters step 4, if do not meet standard x ML file, then enters step 3;
step 3: the equipment account not meeting standard x ML file is carried out standardization again, enters step 4 afterwards;
step 4: by Dom4J parses policy, standard x ML file is resolved in parsing module 2, the physical IP address of acquisition equipment, by the uniqueness of the physical IP address determination equipment of equipment, resolving the node and attribute that in the file obtained, record preservation needs, enter step 5 afterwards;
step 5: in database contrast module 3, the IP in the device IP of importing and database is analyzed, enters step 6 afterwards;
step 6: whether deposited in a database by comparative analysis judgment device IP, if exist, then deletes the facility information of importing, judges to terminate; If do not exist, then write by facility information and preserve in a database, in output database, non-existent equipment account XML file, enters step 7 afterwards;
step 7: directly import in IMS system through exporting the XML normative document importing data module 4 output, the data deduplication realizing IMS equipment account is safeguarded.
in use, the equipment account Information File Formats that operation maintenance personnel imports in IMS system is comparatively fixing, by the modification information of XML format file load bearing equipment account in standard x ML module 1; In XML file, every platform device node forms and has higher similarity, so resolved by device node in XML file in parsing module 2, and can equipment account information fast; The IP address distributed according to every platform facility information in database contrast module 3 is all unique address, existing device IP in this IP address and database is contrasted, determine whether facility information exists in Database Systems, write and preserve non-existent facility information in database, the facility information existed is deleted; Will there is not the importing of equipment account XML file in a database by exporting importing data module 4, thus equipment account will be reached the heavy object that disappears in IMS system.The present invention uses Dom4J method to resolve standardized XML file, sets mode, can process large document fast and effectively compared to traditional Dom; Compared to existing JDom disposal route, the method has much bigger dirigibility, excellent performance, powerful and very easily use, make greatly to shorten for setup time before IMS system introducing equipment account, and process reliability is high, decrease the workload of operation maintenance personnel, also not needing operation maintenance personnel to have very high professional standards can complete.
can according to actual needs, the above-mentioned IMS information equipment account based on the Dom4J weighing method that disappears is made further optimization and/or improvements:
as shown in accompanying drawing 1,2,3, in step 3, further equipment account data carries out again standardized process, and again being processed by Java language needs to import the equipment account data file in IMS system.Non-compliant XML file is processed by Java language, by to the information equipment account file processing imported in IMS system, whole nodes that carding equipment comprises, analytical equipment node forms Tree-structure Model, define the title of each node and correspondence thereof, physical address, logical address, facility level, rom version, operating system, the attributes such as hierarchical structure, associate PrimaryMACAddress and the UsingIPAddress node of this equipment in the structure shown here, obtain this attribute corresponding to two nodes, after acquisition device name, preserve its PRimaryMACAddress and UsingIPAddress property value in database.By Dom4J parses policy, the XML file of standard format is resolved, be different from the parsing of SAX based on flow of event, Dom4J adopts the parsing based on XML document tree construction, and in standard x ML module, each change is imported file and sees it is a document tree, wherein every platform equipment is all regarded as a tree, the title of equipment, rank, the information such as address all regard its node as, concrete numerical value is considered as its attribute, like this standard x ML file after process is just obtained fast to the attribute of its each node and node by Dom4J strategy, also the account information of the equipment that obtains just is equivalent to.
as shown in accompanying drawing 1,2,3, in step 5, device IP already present in the device IP of importing and database contrasts by further database contrast module in the Business Logic 5 of database model.
as shown in accompanying drawing 1,2,3, in step 6, further export importing data module and in the data persistence layer 6 of database model, facility information write non-existent in database is preserved and exported final XML file.
specific embodiment of the invention method is as follows:
first, account data XML standardization: each device node information in structure equipment account, with XML standardized way, needs to import the equipment account data file in IMS system by Java language process; XML is a kind of general data interchange format, has the feature of platform-neutral, language independence, system independence, providing great convenience to during equipment account data processing.
secondly, device node is resolved: facility information adopts Dom4J method to resolve after importing file standard, Dom4J method provides a kind of mode being visited equipment account XML document information by hierarchical object model, makes these sealing object models define a device attribute node tree according to the file structure of XML.The data volume that existing equipment account file comprises is comparatively large, equipment is more, and Dom4J method incorporates many functions exceeding basic XML document and represent, provides the disposal route based on event for large document.This analytic method obtains PrimaryMACAddress, UsingIPAddress of equipment, is determined the uniqueness of equipment, record node and the attribute of needs in the file analytically obtained by UsingIPAddress.
again, node UsingIPAddress attribute and database comparison: the equipment account data XML file after standardization, each node and attribute thereof is obtained after being resolved by Dom4J, with the uniqueness of UsingIPAddress nodal value determination equipment, by the IP database comparison that the UsingIPAddress nodal value and Hibernate of resolving acquisition are set up, at Hibernate enclosed inside by the operation of JDBC accessing database, mapping between the node object set up in responsible Java and relation data, provides the comparison function of IP value inquiry fast.
finally, by the IP address comparison of hold facility, if IP exists in a database, then leave out all information of this equipment, if IP address does not find in a database, then retained, export final XML normative document, this file layout meet IMS system requirements import file layout, can directly be imported, the equipment account of realization disappear weight object.
above technical characteristic constitutes embodiments of the invention, and it has stronger adaptability and implementation result, can increase and decrease non-essential technical characteristic according to actual needs, meet the demand of different situations.

Claims (5)

1. to disappear a weighing method based on the IMS information equipment account of Dom4J, it is characterized in that comprising the following steps:
Step one: equipment account file to be updated is carried out pre-service, build standard x ML module, equipment account data is carried out standardization, convert standard x ML file layout to, the equipment account data of making has and the platform onrelevant used, with the language onrelevant used, the uncorrelated data interchange format of system with using, enters step 2 afterwards;
Step 2: whether judgment device account file meets standard x ML file, if meet standard x ML file, then enters step 4, if do not meet standard x ML file, then enters step 3;
Step 3: the equipment account not meeting standard x ML file is carried out standardization again, enters step 4 afterwards;
Step 4: by Dom4J parses policy, standard x ML file is resolved in parsing module, the physical IP address of acquisition equipment, by the uniqueness of the physical IP address determination equipment of equipment, resolving the node and attribute that in the file obtained, record preservation needs, enter step 5 afterwards;
Step 5: in database contrast module, the IP in the device IP of importing and database is analyzed, enters step 6 afterwards;
Step 6: whether deposited in a database by comparative analysis judgment device IP, if exist, then deletes the facility information of importing, judges to terminate; If do not exist, then write by facility information and preserve in a database, in output database, non-existent equipment account XML file, enters step 7 afterwards;
Step 7: directly import in IMS system through exporting the XML normative document importing data module output, the data deduplication realizing IMS equipment account is safeguarded.
2. the IMS information equipment account based on Dom4J according to claim 1 disappears weighing method, it is characterized in that, in step 3, equipment account data carries out again standardized process, and again being processed by Java language needs to import the equipment account data file in IMS system.
3. the IMS information equipment account based on Dom4J according to claim 1 and 2 disappears weighing method, it is characterized in that, in step 5, device IP already present in the device IP of importing and database contrasts by database contrast module in the Business Logic of database model.
4. the IMS information equipment account based on Dom4J according to claim 1 and 2 disappears weighing method, it is characterized in that, in step 6, export importing data module and in the data persistence layer of database model, facility information write non-existent in database is preserved and exported final XML file.
5. the IMS information equipment account based on Dom4J according to claim 3 disappears weighing method, it is characterized in that, in step 6, export importing data module and in the data persistence layer of database model, facility information write non-existent in database is preserved and exported final XML file.
CN201510403124.9A 2015-07-10 2015-07-10 IMS information equipment accounts based on Dom4J disappear weighing method Active CN105138546B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510403124.9A CN105138546B (en) 2015-07-10 2015-07-10 IMS information equipment accounts based on Dom4J disappear weighing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510403124.9A CN105138546B (en) 2015-07-10 2015-07-10 IMS information equipment accounts based on Dom4J disappear weighing method

Publications (2)

Publication Number Publication Date
CN105138546A true CN105138546A (en) 2015-12-09
CN105138546B CN105138546B (en) 2018-11-06

Family

ID=54723896

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510403124.9A Active CN105138546B (en) 2015-07-10 2015-07-10 IMS information equipment accounts based on Dom4J disappear weighing method

Country Status (1)

Country Link
CN (1) CN105138546B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113077236A (en) * 2021-04-13 2021-07-06 国网新疆电力有限公司电力科学研究院 Multi-system electric secondary equipment standing book data association fusion method and device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101350869A (en) * 2007-07-19 2009-01-21 中国电信股份有限公司 Method and apparatus for removing repeat of telecom charging based on index and hash
CN101777056A (en) * 2009-12-31 2010-07-14 成都市华为赛门铁克科技有限公司 Data storage method and device
CN103970898A (en) * 2014-05-27 2014-08-06 重庆大学 Method and device for extracting information based on multistage rule base
CN103986600A (en) * 2014-05-14 2014-08-13 上海上讯信息技术股份有限公司 Enterprise-level network automatic finding and filtering method and system based on multiple protocols
CN104734347A (en) * 2015-02-13 2015-06-24 广东电网有限责任公司佛山供电局 Distribution network terminal online rate automatic statistical method based on DMS system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101350869A (en) * 2007-07-19 2009-01-21 中国电信股份有限公司 Method and apparatus for removing repeat of telecom charging based on index and hash
CN101777056A (en) * 2009-12-31 2010-07-14 成都市华为赛门铁克科技有限公司 Data storage method and device
CN103986600A (en) * 2014-05-14 2014-08-13 上海上讯信息技术股份有限公司 Enterprise-level network automatic finding and filtering method and system based on multiple protocols
CN103970898A (en) * 2014-05-27 2014-08-06 重庆大学 Method and device for extracting information based on multistage rule base
CN104734347A (en) * 2015-02-13 2015-06-24 广东电网有限责任公司佛山供电局 Distribution network terminal online rate automatic statistical method based on DMS system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113077236A (en) * 2021-04-13 2021-07-06 国网新疆电力有限公司电力科学研究院 Multi-system electric secondary equipment standing book data association fusion method and device

Also Published As

Publication number Publication date
CN105138546B (en) 2018-11-06

Similar Documents

Publication Publication Date Title
WO2018019175A1 (en) Global data standardized platform system based on xbrl, and construction method therefor
CN106815326B (en) System and method for detecting consistency of data table without main key
US8484255B2 (en) Automatic conversion of multidimentional schema entities
CN102932195B (en) A kind of business diagnosis method for supervising of protocal analysis Network Based and system
CN110990585B (en) Multi-source data and time sequence processing method and device for building industry knowledge graph
CN112711591B (en) Data blood margin determination method and device based on field level of knowledge graph
CN103473672A (en) System, method and platform for auditing metadata quality of enterprise-level data center
CN111460045A (en) Modeling method, model, computer device and storage medium for data warehouse construction
CN110781249A (en) Knowledge graph-based multi-source data fusion method and device for thermal power plant
CN102509001B (en) Method for automatically removing time sequence data outlier point
CN108090165A (en) A kind of acquisition methods of the collection of illustrative plates variation based on embedded chart database
CN106209431A (en) A kind of Approaches of Alarm Correlation and network management system
CN104915262A (en) Calibration system and method based on EXCEL data structure
CN114218218A (en) Data processing method, device and equipment based on data warehouse and storage medium
CN117056867B (en) Multi-source heterogeneous data fusion method and system for digital twin
CN113505048A (en) Unified monitoring platform based on application system portrait and implementation method
CN114880405A (en) Data lake-based data processing method and system
CN113626447B (en) Civil aviation data management platform and method
CN102073662A (en) Method and system for analyzing and creating XML (Extensible Markup Language) data
US20180225314A1 (en) Managing a single database management system
CN108073705B (en) Distributed mass data aggregation acquisition method
CN115982177B (en) Method, device, equipment and medium for data aggregation based on tree dimension
CN105138546A (en) Dom4J based IMS information equipment ledger duplicate elimination method
CN115270947A (en) Standardized energy efficiency service model construction method, system, terminal and storage medium
CN110955736B (en) Management model modeling method of basic data

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant