CN111708842B - Method and device for processing heterogeneous data of hot rolled plate - Google Patents

Method and device for processing heterogeneous data of hot rolled plate Download PDF

Info

Publication number
CN111708842B
CN111708842B CN202010528067.8A CN202010528067A CN111708842B CN 111708842 B CN111708842 B CN 111708842B CN 202010528067 A CN202010528067 A CN 202010528067A CN 111708842 B CN111708842 B CN 111708842B
Authority
CN
China
Prior art keywords
task
data
tasks
area
databases
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010528067.8A
Other languages
Chinese (zh)
Other versions
CN111708842A (en
Inventor
张雪荣
陈燕才
张鹏武
赵雪松
彭志华
涂威
徐伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan Iron and Steel Co Ltd
Original Assignee
Wuhan Iron and Steel Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan Iron and Steel Co Ltd filed Critical Wuhan Iron and Steel Co Ltd
Priority to CN202010528067.8A priority Critical patent/CN111708842B/en
Publication of CN111708842A publication Critical patent/CN111708842A/en
Application granted granted Critical
Publication of CN111708842B publication Critical patent/CN111708842B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases
    • G06F16/285Clustering or classification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/018Certifying business or products
    • G06Q30/0185Product, service or business identity fraud
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/04Manufacturing
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • General Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Human Resources & Organizations (AREA)
  • General Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Health & Medical Sciences (AREA)
  • Tourism & Hospitality (AREA)
  • Manufacturing & Machinery (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Finance (AREA)
  • Computing Systems (AREA)
  • Control Of Metal Rolling (AREA)
  • General Factory Administration (AREA)

Abstract

The invention relates to the technical field of hot rolling production lines, in particular to a method and a device for processing heterogeneous data of a hot rolled plate, wherein the method comprises the following steps: receiving an access request, wherein the access request comprises a primary task to be executed, and the primary task is related to the hot rolled plate heterogeneous data; based on the primary task, acquiring a plurality of secondary tasks of the primary task and a preset logic relationship and a time sequence relationship among the plurality of secondary tasks; decomposing each secondary task to obtain a plurality of tertiary tasks corresponding to each secondary task; acquiring process data of a steel area and a rolling area corresponding to each three-level task from a plurality of databases of different types; based on the working procedure data of the steel area and the rolling area, a plurality of three-level tasks, a plurality of two-level tasks and a preset logic relationship and a time sequence relationship among the two-level tasks, a target processing result is obtained and displayed, and the target processing result is a feedback result corresponding to the access request, so that the product quality of the hot rolling production line is improved.

Description

Method and device for processing heterogeneous data of hot rolled plate
Technical Field
The invention relates to the technical field of hot rolling production lines, in particular to a method and a device for processing heterogeneous data of a hot rolled plate.
Background
The existing overall production and marketing system for online running of hot rolled coils in domestic and foreign steel industry is biased to manage the quality results of products, and various process information, equipment information, instrument list and other information in the production process are distributed, heterogeneous and difficult to associate.
Real-time parameters of the hot rolled coil production process cannot be related to batch information, abnormal information of key process parameters or equipment parameters cannot be obtained, the reasons of unqualified products are difficult to analyze, the quality condition in the production process is predicted, sampling inspection can only be performed after the products are off line, and the quality cost is increased.
Therefore, how to monitor and analyze the heterogeneous data in the production process of the hot rolled coil in real time is a technical problem to be solved urgently at present.
Disclosure of Invention
The present invention has been made in view of the above problems, and has as its object to provide a method and apparatus for processing hot rolled sheet heterogeneous data which overcomes or at least partially solves the above problems.
In a first aspect, the present invention provides a method for processing heterogeneous data of a hot rolled sheet, applied to a data processing system, where a plurality of databases of different types are stored in the data processing system, the method comprising:
Receiving an access request, wherein the access request comprises a primary task to be executed, and the primary task is related to hot rolled plate heterogeneous data;
based on the primary task, acquiring a plurality of secondary tasks of the primary task and a preset logic relationship and a time sequence relationship among the plurality of secondary tasks;
decomposing each secondary task to obtain a plurality of tertiary tasks corresponding to each secondary task;
acquiring process data of a steel area and a rolling area corresponding to each tertiary task from the databases of various types;
and obtaining and displaying a target processing result based on the working procedure data of the steel area and the rolling area, the plurality of three-level tasks, the plurality of two-level tasks and a preset logic relationship and a time sequence relationship among the plurality of two-level tasks, wherein the target processing result is a feedback result corresponding to the access request.
Further, the obtaining a target processing result based on the process data of the steel zone and the rolling zone, the plurality of tertiary tasks, the plurality of secondary tasks, and a preset logic relationship and a timing relationship between the plurality of secondary tasks includes:
based on the working procedure data of the steel area and the rolling area, respectively processing each three-level task to obtain a first processing result;
Based on the first processing result, processing each secondary task respectively to obtain a second processing result;
and processing the primary task based on the second processing result and a preset logic relationship and a time sequence relationship among the plurality of secondary tasks to obtain the target processing result.
Further, the data processing system further includes an index list of the database, and before receiving the access request, the method further includes:
collecting process data of a steel area and a rolling area and storing the process data in the databases of various types;
and acquiring position information of the working procedure data of the steel area and the rolling area in the databases of different types respectively, and storing the position information in an index list of the database.
Further, the process data of the steel collecting area and the rolling area are collected and stored based on a hot rolled plate information data collecting network architecture system;
the hot rolled plate information data acquisition network architecture system comprises:
each controller of the steel area and the rolling area, a primary switch connected with each controller of the steel area and the rolling area, a net shutdown connected with the primary switch, a tertiary firewall connected with the net shutdown, a tertiary switch connected with the tertiary firewall, a core switch connected with the tertiary switch, and a plurality of databases of different types connected with the core switch.
Further, the process data of the steel area and the rolling area corresponding to each tertiary task are obtained from the databases of the plurality of different types, and the process data comprises:
determining the working procedure data of a steel area and a rolling area required by each tertiary task based on each tertiary task;
searching position information corresponding to the process data of the steel area and the rolling area required by each tertiary task from an index list of the database based on the process data of the steel area and the rolling area required by each tertiary task;
and acquiring the working procedure data of the steel area and the rolling area required by each tertiary task from the different types of databases based on the position information.
Further, the process data of the steel area and the rolling area corresponding to each tertiary task are obtained from the databases of the plurality of different types, and the process data comprises:
generating a plurality of different operation instructions for the plurality of different types of databases;
and sending the plurality of different operation instructions to the plurality of different types of databases to acquire the working procedure data of the steel area and the rolling area corresponding to each tertiary task from the plurality of different types of databases.
Further, the sending the plurality of different operation instructions to the plurality of different types of databases to obtain the working procedure data of the steel area and the rolling area corresponding to each tertiary task from the plurality of different types of databases includes:
issuing the plurality of different operational instructions to the plurality of different types of databases;
receiving data results returned by the databases of the different types;
converting the data result into an XML document;
and analyzing and obtaining the working procedure data of the steel area and the rolling area corresponding to each tertiary task based on the XML file.
In a second aspect, the present invention also provides a device for processing heterogeneous data of a hot rolled plate, including: in a data processing system having a plurality of different types of databases stored therein, said processing device comprising:
the receiving module is used for receiving an access request, wherein the access request comprises a primary task to be executed, and the primary task is related to the hot rolled plate heterogeneous data;
the first acquisition module is used for acquiring a plurality of secondary tasks of the primary task and a preset logic relationship and a time sequence relationship among the plurality of secondary tasks based on the primary task;
The first obtaining module is used for decomposing each secondary task to obtain a plurality of tertiary tasks corresponding to each secondary task;
the second acquisition module is used for acquiring process data of the steel area and the rolling area corresponding to each tertiary task from the databases of various different types;
the second obtaining module is used for obtaining a target processing result based on the working procedure data of the steel area and the rolling area, the plurality of three-level tasks, the plurality of second-level tasks and a preset logic relationship and a time sequence relationship among the plurality of second-level tasks, and displaying the target processing result, wherein the target processing result is a feedback result corresponding to the access request.
In a third aspect, the present invention also provides a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the above method steps when executing the program.
In a fourth aspect, the present invention also provides a computer readable storage medium having stored thereon a computer program which when executed by a processor performs the above-mentioned method steps.
One or more technical solutions in the embodiments of the present invention at least have the following technical effects or advantages:
The invention provides a processing method of hot rolled plate heterogeneous data, which is applied to a data processing system, wherein a plurality of databases of different types are stored in the data processing system, and the method comprises the following steps: receiving an access request, wherein the access request comprises a primary task to be executed, and the primary task is related to hot rolled plate heterogeneous data; based on the primary task, acquiring a plurality of secondary tasks of the primary task and a preset logic relationship and a time sequence relationship among the plurality of secondary tasks; decomposing each secondary task to obtain a plurality of tertiary tasks corresponding to each secondary task; acquiring process data of a steel area and a rolling area corresponding to each three-level task from a plurality of databases of different types; based on the working procedure data of the steel area and the rolling area, a plurality of three-level tasks, a plurality of two-level tasks and a preset relation and time sequence relation among the plurality of two-level tasks, a target processing result is obtained and displayed, and further the data isomerization problem of different working procedures and different platforms in the hot rolling production line is solved, data analysis and interaction can be carried out in the hot rolling production line in a cross-working procedure, cross-system and cross-platform mode, so that displayable prompts are provided for the follow-up of the hot rolling production line, early warning is carried out on abnormal conditions, the working procedure process can be searched and traced, defects of the working procedure can be effectively diagnosed and effectively evaluated, and the product quality of the hot rolling production line is improved.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also throughout the drawings, like reference numerals are used to designate like parts. In the drawings:
fig. 1 is a schematic flow chart of steps of a method for processing heterogeneous data of a hot rolled sheet according to an embodiment of the present invention;
FIG. 2 is a schematic diagram showing a network architecture of an acquisition system for acquiring process data of a steel section and a rolling section according to a first embodiment of the present invention;
FIG. 3 is a schematic diagram showing an implementation process of the IBA-PDA system for storing acquired data in a database according to the first embodiment of the present invention;
fig. 4 is a schematic diagram illustrating a process of implementing heterogeneous data collaborative processing by using an Agent-based three-layer collaborative model in accordance with a first embodiment of the present invention;
fig. 5 is a schematic structural diagram of a processing device for heterogeneous data of a hot rolled sheet according to the second embodiment of the present invention;
fig. 6 is a schematic diagram showing a configuration of a computer apparatus for realizing the processing of the hot rolled sheet heterogeneous data in the third embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
The existing hot rolling production line production site has heterogeneous data of system equipment such as L1 (basic computer used for monitoring running, roller way and equipment movement conditions), L2 (process computer used for tracking, receiving management information of an upper computer and feeding back and transmitting production data), MES (manufacturing enterprise production process execution management system), ERP (enterprise resource planning) and the like, wherein the heterogeneous data comprises information such as videos, pictures, acquisition points and the like, and the heterogeneous data is difficult to correlate in the existing situation.
Therefore, the invention provides a processing method of the hot rolled plate heterogeneous data, which can integrate distributed and heterogeneous data sources in the production process, further realize data processing of cross-process, cross-system and cross-platform, realize interaction of multi-process data of a steel area and a rolling area, monitor, analyze, trace and evaluate key processes of each production line in the production process of products in real time, further optimize the production process and continuously improve the quality of the products.
Example 1
The first embodiment of the invention provides a method for processing heterogeneous data of a hot rolled plate, which is applied to a data processing system, wherein a plurality of databases of different types are stored in the data processing system.
As shown in fig. 1, the method includes:
s101, receiving an access request, wherein the access request comprises a primary task to be executed, and the primary task is related to hot rolled plate heterogeneous data.
S102, acquiring a plurality of secondary tasks of the primary task and a preset logic relationship and a time sequence relationship among the plurality of secondary tasks based on the primary task.
S103, decomposing each secondary task to obtain a plurality of tertiary tasks corresponding to each secondary task.
S104, acquiring process data of the steel area and the rolling area corresponding to each three-level task from a plurality of different types of databases.
S105, obtaining a target processing result based on the process data of the steel area and the rolling area, the plurality of three-level tasks, the plurality of second-level tasks and the preset logic relationship and the time sequence relationship among the plurality of second-level tasks, and displaying the target processing result, wherein the target processing result is a feedback result corresponding to the access request.
The invention discloses a method for processing heterogeneous data of a hot rolled plate, which is a heterogeneous database coordination control system based on a three-layer cooperation model of an Agent (Agent) and constructed by adopting a federal structure in a CSCW system. The application layer accesses the underlying database through middleware. The middleware is a CSCW database middleware of federal structure. The middleware is used as the 'brain' of the coordination controller, and the multi-source heterogeneous data formed by each procedure of the hot rolling production line is uniformly converted into the data format of an XML document for storage and access by calling the index list of the database and simultaneously cooperating with the work of each module (a communication module, a transaction management module, a query processing module, an integrity constraint module and the like), so that the 'information island' problem of the heterogeneous data is solved.
The method for processing the hot rolled plate heterogeneous data in the invention is specifically a processing process executed by a middleware in the system.
First, the system further includes an index list of the database, and before S101, further includes:
collecting working procedure data of a steel area and a rolling area, and storing the working procedure data in a plurality of databases of different types;
and acquiring position information of process data of the steel area and the rolling area in the databases of the different types respectively, and storing the position information in an index list of the database.
As shown in fig. 2, the process data of the steel area and the rolling area needs to be collected, specifically, a gateway isolation technology is adopted to physically isolate the production system from the information system, and a data warehouse covering all process parameters and equipment operation parameters of the hot coil production line is built on the premise of ensuring the safety of the production system, wherein the data warehouse comprises various types of databases, including: oracle database, SQL Server database, sybase database.
Wherein the production system comprises controllers for the steel section and the rolling section.
The steel area comprises working procedure data of a steelmaking converter, an LF furnace, continuous casting and the like, and is specifically connected with a desulfurization PLC, a converter PLC, a refining PLC and a continuous casting PLC, and then the acquisition and storage of the working procedure data and equipment parameter information are realized by configuring information of different PLC, IO point register addresses, acquisition radio frequencies and the like.
The rolling area comprises working procedure data of rough rolling, finish rolling, coiling, leveling and the like, and is specifically connected with a heating furnace PLC, a rough rolling PDA server, a finish rolling coiling PDA server and a PDA data file transmission program client.
The system comprises a desulfurization PLC, a converter PLC, a refining PLC, a continuous casting PLC, a heating furnace PLC, a rough rolling PDA server, a finish rolling coiling PDA server and a PDA data file transmission program client, wherein the client is respectively connected to a core switch through a primary switch, a net shutdown, a tertiary firewall and a tertiary access switch, the core switch is connected with a database server, a plurality of different types of databases are stored in the database server, and the core switch is particularly connected with the database server (a plurality of different types of databases are arranged inside), a document server and an MES system (manufacturing process execution management system of a manufacturing enterprise). The production line of the rolling area is also connected with an MES interface machine through a primary switch, and the MES interface machine is connected with a tertiary firewall.
As shown in FIG. 3, the IBA-PDA system (a system for collecting and analyzing data based on a PC) generates a complete offline file data packet after a steel coil is offline for a period of time, a file transmission client program can detect that a generated file exists, the generated file can not be read according to a time sequence and can not influence the operation of the IBA-PDA system, the file is transmitted from an IBA-PDA system server to a designated analysis server through a designated port, and the file analysis can extract data corresponding to data points of the IBA-PDA system according to a file formulating format and write the data into a data warehouse, namely a plurality of databases of different types. These processes take a short time.
And the large instrument data such as the table inspection and the plate shape instrument are collected through specific interfaces, relevant data such as steel coil defects, flatness, convexity and the like are directly transmitted into various databases of different types, the information of the MES is obtained by adopting a materialized view technology, the information of the MES database is synchronized in a middle database, the interface performance is improved, and the load of a source database server is reduced.
By adopting the hot rolled plate information data acquisition network architecture system, the process data of the steel area and the rolling area are acquired and stored.
After the process data of the steel area and the rolling area are acquired, the position information of the process data of the steel area and the rolling area in various databases of different types is acquired, and the position information is stored in an index list of the databases, so that the quick search is facilitated.
Next, S101 is performed, and an access request is received, wherein the access request includes a primary task to be performed, and the primary task is related to the hot rolled sheet heterogeneous data. I.e. receiving an access request entered on the operation interface.
The primary task may be "query the yield of a certain steel grade" or "see if a certain rolling mill needs to be scheduled for maintenance" or the like.
Next, the primary task is decomposed, including:
s102, based on the primary task, obtaining a plurality of secondary tasks of the primary task and a preset logic relationship and a time sequence relationship among the plurality of secondary tasks.
When the primary task is "inquiring the yield of a certain steel grade", the plurality of secondary tasks of the primary task comprise: "yield of steelmaking region", "yield of steel rolling region", "yield of finishing region", and the like.
The preset logical relationship here is that the yield of a certain steel grade = "yield of steel-making region" × "yield of steel-rolling region" × "yield of finishing region" × …. The preset logic relationship is the product relationship among a plurality of secondary tasks, and the time sequence relationship is the time for acquiring the yield.
S103, decomposing each secondary task to obtain a plurality of tertiary tasks corresponding to each secondary task.
For each secondary task, the secondary task is decomposed into a plurality of tertiary tasks, for example, the secondary task is the yield of a steel-making area, and in particular, the secondary task is decomposed into a plurality of factors affecting the yield of the steel-making area, and the factors are a plurality of tertiary tasks corresponding to each secondary task to be acquired. For example, the three-stage tasks obtained are "burning loss of the heating furnace", "amount of waste generated", and the like.
After obtaining the plurality of tertiary tasks corresponding to each secondary task, S104 is performed to obtain process data of the steel zone and the rolling zone corresponding to each tertiary task from a plurality of different types of databases.
Based on the above-mentioned three-stage tasks, the process data of the steel zone and the rolling zone corresponding to each three-stage task, that is, the burning loss data of the heating furnace contained in the process data of the rolling zone, the generated waste amount data, and the like are directly obtained from various databases of different types.
The step S104 specifically includes:
determining the working procedure data of a steel area and a rolling area required by each three-level task based on each three-level task;
searching corresponding position information from an index list of a database based on process data of a steel area and a rolling area required by each three-level task;
based on the positional information, process data of the steel section and the rolling section required for each tertiary task is acquired from a plurality of different types of databases.
After each tertiary task is obtained, since the plurality of tertiary tasks are factor tasks corresponding to each secondary task, when each secondary task needs to be processed, there is a case of multithreading.
And in the process step of determining the working procedure data of the steel area and the rolling area required by each tertiary task, searching the position information of the corresponding data from an index list of a database, namely searching the stored position information through a catalog in the index list.
And then, according to the searched stored position information, quickly searching the corresponding working procedure data of the steel area and the rolling area from a plurality of databases of different types.
The above is a processing procedure described for "inquiring the yield of a certain steel grade" for a primary task, and when the primary task is "checking whether a certain rolling mill needs to be overhauled", a plurality of secondary tasks of the primary task can be obtained according to the above S102 to S104, and the plurality of secondary tasks are considered to include "rolling mill bearing failure", "gear failure", and the like. The preset logic relationship is "vibration value exceeds standard, namely fault" or "temperature exceeds standard, namely fault", and for the second-stage task of "rolling mill bearing fault", the second-stage task can be decomposed into a plurality of third-stage tasks of "vibration value", "temperature", "lubricant" and the like, the third-stage tasks can affect the "rolling mill bearing fault", and finally, the process data of the steel area and the rolling area corresponding to each third-stage task, namely, specific data of "vibration value", "temperature", "lubricant" and the like, are obtained from various databases of different types.
In acquiring process data of a steel zone and a rolling zone corresponding to each tertiary task from a plurality of different types of databases, comprising:
Generating a plurality of different operation instructions aiming at a plurality of different types of databases;
and sending a plurality of different operation instructions to a plurality of different types of databases so as to acquire the working procedure data of the steel area and the rolling area corresponding to each three-level task from the plurality of different types of databases.
Before issuing the plurality of different operation instructions to the plurality of different types of databases, the method further comprises:
the plurality of different operation instructions are converted into a resolvable instruction format adapted to the corresponding database so that the corresponding database can resolve the operation instructions.
In the invention, the middleware for data processing has the function of data conversion and comprises an interface, a wrapper and a parser, wherein the middleware is outwards presented as a unified interface, and when the interface receives access acquisition requests for multiple databases of different types (namely, different operation instructions are sent to the multiple databases of different types), the wrapper converts the access acquisition requests into XML documents, and then the parser converts the XML documents into a language format which can be parsed by the corresponding databases (namely, the multiple different operation instructions are converted into a command format which can be parsed and is suitable for the corresponding databases).
After the process data of the steel area and the rolling area are obtained, S105 is executed, a target processing result is obtained and displayed based on the process data of the steel area and the rolling area, the plurality of tertiary tasks, the plurality of secondary tasks and the preset logic relationship and the time sequence relationship among the plurality of secondary tasks, and the target processing result is a feedback result corresponding to the access request.
The target processing result is a feedback result corresponding to the access request.
S105 includes:
based on the working procedure data of the steel area and the rolling area, respectively processing each three-level task to obtain a first processing result;
based on the first processing result, each secondary task is processed respectively, and a second processing result is obtained;
and processing the first-level task based on the second processing result and a preset logic relationship and a time sequence relationship among the plurality of second-level tasks to obtain a target processing result.
According to the embodiment, when the plurality of three-stage tasks affecting the material forming of the steel rolling area are obtained as the burning loss condition of the heating furnace and the generated waste amount, the burning loss condition of the heating furnace and the generated waste amount are respectively analyzed, analysis results are integrated, the material forming rate of the steel rolling area is determined, and the result of the material forming rate of the steel rolling area corresponds to the second processing result. The results of "the yield of the steelmaking region", the results of "the yield of the finishing region", and the like are also obtained in order.
Multiplying the result of the yield of the steelmaking area, the result of the yield of the steel rolling area and the result of the yield of the finishing area, thereby obtaining the yield of a certain steel grade, namely obtaining a target processing result which is a feedback result corresponding to the access request. The target processing result can be returned for display.
S105 includes:
sending a plurality of different operation instructions to a plurality of different types of databases; receiving data results returned by a plurality of databases of different types; converting the data result into an XML document; and analyzing and obtaining the working procedure data of the steel area and the rolling area corresponding to each tertiary task based on the XML file.
According to the middleware, the function of converting the data is achieved, when a plurality of databases of different types return data results, the wrapper converts the returned data results into XML documents, then the XML documents are analyzed by the analyzer, and process data of the steel area and the rolling area corresponding to each three-level task are obtained and displayed and output.
The processes of S102 to S104 are specifically processes of a group cooperative work to complete a common task, i.e. heterogeneous data cooperative processing in a computer-supported environment, as shown in fig. 4.
The heterogeneous data collaborative processing includes the connection and information transmission between databases, format conversion of transmission information, planning, analysis and management of tasks, etc.
Specifically, the heterogeneous data cooperative processing process is based on a three-layer cooperative model of agents (agents) to realize cooperative control, an autonomous entity of the cooperative control process is determined to be the agents, the cooperative control process is regarded as an activity sequence of mutual cooperation of a plurality of agents, and the cooperative control process is described by describing actions, behaviors and interrelationships of the agents.
The core of the heterogeneous data collaborative process is a task management and monitoring Agent401, which has functions of task assignment, task confirmation, task query, result return and the like. The task management and monitoring Agent is equivalent to a cooperative task engine, divides a primary task into a plurality of secondary tasks according to a certain rule, establishes a preset logic relationship and a time sequence relationship among the plurality of secondary tasks, and then distributes the secondary tasks to the task cooperative agents 402 for execution in a classified manner.
The task management and monitoring Agent401 also stores a corresponding fault recovery mechanism, and instructions of each task in the whole coordination control process, such as information of decomposing a first-level task into each task step, sequencing of task steps, and the like, and information of each task cooperation Agent402 and information storage Agent403, fault detection and processing information.
Each task collaboration Agent402 is configured to complete a specific task (a specific task allocated by a task management and monitoring Agent), and each task collaboration Agent402 is configured to cooperate with each other, to resolve a conflict occurring in task collaboration, and to integrate information. Specifically, each task collaboration Agent402 decomposes a specified task into multiple tertiary tasks according to rules of information stored by itself, and assigns other task collaboration agents 402 to assist in completing the specified task. The task collaboration Agent402 requests information necessary for execution from the information access Agent 403.
The task collaboration Agent402 stores the domain to which the task belongs, completes the operation executed by the task, collects the operation executed by the task, and the correspondence between the task collaboration Agent402 and the information access Agent403, and the task collaboration Agent402 and other task collaboration agents 402 cooperate with each other, and resolves the information such as conflict and information fusion policy.
The information access agents 403 are started based on the starting of the upper task cooperation agents 402, and each information access Agent403 cooperates with each other to provide the upper task cooperation Agent402 with requested information, wherein the requested information is from data with different functions, and the information access agents 403 store classified data, wherein all information of databases associated with the information access agents 403, strategies of database access, conflict resolution and information fusion, protocols cooperated with other information access agents 403 and the like are specifically stored.
One or more technical solutions in the embodiments of the present invention at least have the following technical effects or advantages:
the invention provides a processing method of hot rolled plate heterogeneous data, which is applied to a data processing system, wherein a plurality of databases of different types are stored in the data processing system, and the method comprises the following steps: receiving an access request, wherein the access request comprises a primary task to be executed, and the primary task is related to hot rolled plate heterogeneous data; based on the primary task, acquiring a plurality of secondary tasks of the primary task and a preset logic relationship and a time sequence relationship among the plurality of secondary tasks; decomposing each secondary task to obtain a plurality of tertiary tasks corresponding to each secondary task; acquiring process data of a steel area and a rolling area corresponding to each three-level task from a plurality of databases of different types; based on the working procedure data of the steel area and the rolling area, a plurality of three-level tasks, a plurality of two-level tasks and a preset relation and time sequence relation among the plurality of two-level tasks, a target processing result is obtained and displayed, and further the data isomerization problem of different working procedures and different platforms in the hot rolling production line is solved, data analysis and interaction can be carried out in the hot rolling production line in a cross-working procedure, cross-system and cross-platform mode, so that displayable prompts are provided for the follow-up of the hot rolling production line, early warning is carried out on abnormal conditions, the working procedure process can be searched and traced, defects of the working procedure can be effectively diagnosed and effectively evaluated, and the product quality of the hot rolling production line is improved.
Example two
Based on the same inventive concept, the invention provides a processing device for hot rolled plate heterogeneous data, comprising: in a data processing system having a plurality of different types of databases stored therein, the processing apparatus comprising:
a receiving module 501, configured to receive an access request, where the access request includes a first-level task to be executed, and the first-level task is considered to be related to hot rolled plate heterogeneous data;
the first obtaining module 502 is configured to obtain, based on the primary task, a plurality of secondary tasks of the primary task, and a preset logic relationship and a timing relationship between the plurality of secondary tasks;
a first obtaining module 503, configured to decompose each secondary task to obtain a plurality of tertiary tasks corresponding to each secondary task;
a second obtaining module 504, configured to obtain process data of the steel area and the rolling area corresponding to each tertiary task from the multiple databases of different types;
and a second obtaining module 505, configured to obtain a target processing result based on the process data of the steel area and the rolling area, the plurality of tertiary tasks, the plurality of secondary tasks, and a preset logic relationship and a time sequence relationship between the plurality of secondary tasks, and display the target processing result, where the target processing result is a feedback result corresponding to the access request.
In an alternative embodiment, the second obtaining module 505 includes:
the first obtaining unit is used for respectively processing each three-level task based on the working procedure data of the steel area and the rolling area to obtain a first processing result;
the second obtaining unit is used for respectively processing each secondary task based on the first processing result to obtain a second processing result;
and the third obtaining unit is used for processing the primary task based on the second processing result and the preset logic relationship and time sequence relationship among the plurality of secondary tasks to obtain the target processing result.
In an alternative embodiment, the data processing system further includes an index list of the database, and the processing device further includes:
the acquisition module is used for acquiring process data of the steel area and the rolling area and storing the process data in the databases of the different types;
and the third acquisition module is used for acquiring the position information of the working procedure data of the steel area and the rolling area in the databases of the different types respectively and storing the position information in an index list of the database.
In an alternative embodiment, the second obtaining module 504 includes:
The determining unit is used for determining the working procedure data of the steel area and the rolling area required by each tertiary task based on each tertiary task;
the searching unit is used for searching position information corresponding to the working procedure data of the steel area and the rolling area required by each tertiary task from the index list of the database based on the working procedure data of the steel area and the rolling area required by each tertiary task;
and the first acquisition unit is used for acquiring the working procedure data of the steel area and the rolling area required by each tertiary task from the different types of databases based on the position information.
In an alternative embodiment, the second obtaining module 504 includes:
the generating unit is used for generating a plurality of different operation instructions aiming at the plurality of different types of databases;
and the second acquisition unit is used for sending the plurality of different operation instructions to the plurality of different types of databases so as to acquire the working procedure data of the steel area and the rolling area corresponding to each three-level task from the plurality of different types of databases.
In an alternative embodiment, the second obtaining unit includes:
an issuing unit configured to issue the plurality of different operation instructions to the plurality of different types of databases;
The receiving unit is used for receiving data results returned by the databases of the plurality of different types after sending the operation instructions of the plurality of different types to the databases of the plurality of different types;
a conversion unit for converting the data result into an XML document;
and the analysis unit is used for analyzing and obtaining the working procedure data of the steel area and the rolling area corresponding to each tertiary task based on the XML document.
Example III
Based on the same inventive concept, the third embodiment of the present invention also provides a computer device, as shown in fig. 6, including a memory 604, a processor 602, and a computer program stored on the memory 604 and executable on the processor 602, wherein the processor 602 implements the steps of any one of the above-mentioned methods for processing heterogeneous data of a hot rolled sheet when executing the program.
Where in FIG. 6, a bus architecture (represented by bus 600), the bus 600 may comprise any number of interconnected buses and bridges, with the bus 600 linking together various circuits, including one or more processors, as represented by processor 602, and memory, as represented by memory 304. Bus 600 may also link together various other circuits such as peripheral devices, voltage regulators, power management circuits, etc., as are well known in the art and, therefore, will not be described further herein. The bus interface 606 provides an interface between the bus 600 and the receiver 601 and transmitter 603. The receiver 601 and the transmitter 603 may be the same element, i.e. a transceiver, providing a means for communicating with various other apparatus over a transmission medium. The processor 602 is responsible for managing the bus 600 and general processing, while the memory 604 may be used to store data used by the processor 602 in performing operations.
Example IV
Based on the same inventive concept, the fourth embodiment of the present invention also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of any of the aforementioned methods for processing hot rolled sheet heterogeneous data.
The algorithms and displays presented herein are not inherently related to any particular computer, virtual system, or other apparatus. Various general-purpose systems may also be used with the teachings herein. The required structure for a construction of such a system is apparent from the description above. In addition, the present invention is not directed to any particular programming language. It will be appreciated that the teachings of the present invention described herein may be implemented in a variety of programming languages, and the above description of specific languages is provided for disclosure of enablement and best mode of the present invention.
In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be construed as reflecting the intention that: i.e., the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules in the apparatus of the embodiments may be adaptively changed and disposed in one or more apparatuses different from the embodiments. The modules or units or components of the embodiments may be combined into one module or unit or component and, furthermore, they may be divided into a plurality of sub-modules or sub-units or sub-components. Any combination of all features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or units of any method or apparatus so disclosed, may be used in combination, except insofar as at least some of such features and/or processes or units are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings), may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments herein include some features but not others included in other embodiments, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments can be used in any combination.
Various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that the microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components in the processing apparatus, computer device of the hot rolled sheet heterogeneous data according to an embodiment of the invention. The present invention can also be implemented as an apparatus or device program (e.g., a computer program and a computer program product) for performing a portion or all of the methods described herein. Such a program embodying the present invention may be stored on a computer readable medium, or may have the form of one or more signals. Such signals may be downloaded from an internet website, provided on a carrier signal, or provided in any other form.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, third, etc. do not denote any order. These words may be interpreted as names.

Claims (8)

1. A method for processing heterogeneous data of a hot rolled plate, which is applied to a data processing system, wherein a plurality of databases of different types are stored in the data processing system, and the method is characterized by comprising the following steps:
receiving an access request, wherein the access request comprises a primary task to be executed, and the primary task is related to hot rolled plate heterogeneous data;
Based on the primary task, acquiring a plurality of secondary tasks of the primary task and a preset logic relationship and a time sequence relationship among the plurality of secondary tasks;
decomposing each secondary task to obtain a plurality of tertiary tasks corresponding to each secondary task;
generating a plurality of different operation instructions for the plurality of different types of databases;
issuing the plurality of different operational instructions to the plurality of different types of databases;
receiving data results returned by the databases of the different types;
converting the data result into an XML document;
analyzing and obtaining working procedure data of a steel area and a rolling area corresponding to each three-level task based on the XML document;
and obtaining and displaying a target processing result based on the working procedure data of the steel area and the rolling area, the plurality of three-level tasks, the plurality of two-level tasks and a preset logic relationship and a time sequence relationship among the plurality of two-level tasks, wherein the target processing result is a feedback result corresponding to the access request.
2. The method of claim 1, wherein the obtaining the target process result based on the process data of the steel and mill sections, the plurality of tertiary tasks, the plurality of secondary tasks, and a preset logical relationship and timing relationship between the plurality of secondary tasks comprises:
Based on the working procedure data of the steel area and the rolling area, respectively processing each three-level task to obtain a first processing result;
based on the first processing result, processing each secondary task respectively to obtain a second processing result;
and processing the primary task based on the second processing result and a preset logic relationship and a time sequence relationship among the plurality of secondary tasks to obtain the target processing result.
3. The method of claim 1, further comprising an index list of a database in the data processing system, prior to receiving the access request, further comprising:
collecting process data of a steel area and a rolling area and storing the process data in the databases of various types;
and acquiring position information of the working procedure data of the steel area and the rolling area in the databases of different types respectively, and storing the position information in an index list of the database.
4. The method of claim 3, wherein the process data of the steel and rolling sections are collected and stored based on a hot rolled sheet information data collection network architecture system;
the hot rolled plate information data acquisition network architecture system comprises:
Each controller of the steel area and the rolling area, a first-level switch connected with each controller of the steel area and the rolling area, a net shutdown connected with the first-level switch, a tertiary firewall connected with the net shutdown, a tertiary switch connected with the tertiary firewall, a core switch connected with the tertiary switch, and a database server connected with the core switch, wherein various databases of different types are stored in the database server.
5. A method according to claim 3, wherein said retrieving process data for the steel and mill sections corresponding to each of said tertiary tasks from said plurality of different types of databases comprises:
determining the working procedure data of a steel area and a rolling area required by each tertiary task based on each tertiary task;
searching position information corresponding to the process data of the steel area and the rolling area required by each tertiary task from an index list of the database based on the process data of the steel area and the rolling area required by each tertiary task;
and acquiring the working procedure data of the steel area and the rolling area required by each tertiary task from the different types of databases based on the position information.
6. A processing apparatus for hot rolled sheet heterogeneous data, comprising: in a data processing system having a plurality of different types of databases stored therein, the processing apparatus comprising:
the receiving module is used for receiving an access request, wherein the access request comprises a primary task to be executed, and the primary task is related to the hot rolled plate heterogeneous data;
the first acquisition module is used for acquiring a plurality of secondary tasks of the primary task and a preset logic relationship and a time sequence relationship among the plurality of secondary tasks based on the primary task;
the first obtaining module is used for decomposing each secondary task to obtain a plurality of tertiary tasks corresponding to each secondary task;
a second acquisition module, configured to:
generating a plurality of different operation instructions for the plurality of different types of databases;
issuing the plurality of different operational instructions to the plurality of different types of databases;
receiving data results returned by the databases of the different types;
converting the data result into an XML document;
analyzing and obtaining working procedure data of a steel area and a rolling area corresponding to each three-level task based on the XML document;
The second obtaining module is used for obtaining a target processing result based on the working procedure data of the steel area and the rolling area, the plurality of three-level tasks, the plurality of second-level tasks and a preset logic relationship and a time sequence relationship among the plurality of second-level tasks, and displaying the target processing result, wherein the target processing result is a feedback result corresponding to the access request.
7. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any of claims 1-5 when the program is executed.
8. A computer readable storage medium having stored thereon a computer program, characterized in that the program when executed by a processor realizes the steps of the method according to any of claims 1-5.
CN202010528067.8A 2020-06-10 2020-06-10 Method and device for processing heterogeneous data of hot rolled plate Active CN111708842B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010528067.8A CN111708842B (en) 2020-06-10 2020-06-10 Method and device for processing heterogeneous data of hot rolled plate

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010528067.8A CN111708842B (en) 2020-06-10 2020-06-10 Method and device for processing heterogeneous data of hot rolled plate

Publications (2)

Publication Number Publication Date
CN111708842A CN111708842A (en) 2020-09-25
CN111708842B true CN111708842B (en) 2023-05-23

Family

ID=72539543

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010528067.8A Active CN111708842B (en) 2020-06-10 2020-06-10 Method and device for processing heterogeneous data of hot rolled plate

Country Status (1)

Country Link
CN (1) CN111708842B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113094348B (en) * 2021-03-19 2024-02-23 北京达佳互联信息技术有限公司 Log management method and device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103942234A (en) * 2013-01-21 2014-07-23 中国电信股份有限公司 Method for operating multiple heterogeneous databases, middleware device and system
WO2016155007A1 (en) * 2015-04-03 2016-10-06 Yahoo! Inc. Method and system for monitoring data quality and dependency
CN109828790A (en) * 2019-01-31 2019-05-31 上海赜睿信息科技有限公司 A kind of data processing method and system based on Shen prestige isomery many-core processor
CN109885388A (en) * 2019-01-31 2019-06-14 上海赜睿信息科技有限公司 A kind of data processing method and device suitable for heterogeneous system
CN111090687A (en) * 2019-12-24 2020-05-01 腾讯科技(深圳)有限公司 Data processing method, device and system and computer readable storage medium
CN111258744A (en) * 2018-11-30 2020-06-09 中兴通讯股份有限公司 Task processing method based on heterogeneous computation and software and hardware framework system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103942234A (en) * 2013-01-21 2014-07-23 中国电信股份有限公司 Method for operating multiple heterogeneous databases, middleware device and system
WO2016155007A1 (en) * 2015-04-03 2016-10-06 Yahoo! Inc. Method and system for monitoring data quality and dependency
CN111258744A (en) * 2018-11-30 2020-06-09 中兴通讯股份有限公司 Task processing method based on heterogeneous computation and software and hardware framework system
CN109828790A (en) * 2019-01-31 2019-05-31 上海赜睿信息科技有限公司 A kind of data processing method and system based on Shen prestige isomery many-core processor
CN109885388A (en) * 2019-01-31 2019-06-14 上海赜睿信息科技有限公司 A kind of data processing method and device suitable for heterogeneous system
CN111090687A (en) * 2019-12-24 2020-05-01 腾讯科技(深圳)有限公司 Data processing method, device and system and computer readable storage medium

Also Published As

Publication number Publication date
CN111708842A (en) 2020-09-25

Similar Documents

Publication Publication Date Title
Javaid et al. Upgrading the manufacturing sector via applications of Industrial Internet of Things (IIoT)
Badea et al. Big data in the aerospace industry
US20110166912A1 (en) Plant analysis system
Psarommatis et al. Envisioning maintenance 5.0: Insights from a systematic literature review of Industry 4.0 and a proposed framework
Forcina et al. Enabling technology for maintenance in a smart factory: A literature review
Helper et al. Who profits from industry 4.0? theory and evidence from the automotive industry
Schreiber et al. Integrated production and maintenance planning for cyber-physical production systems
CN111708842B (en) Method and device for processing heterogeneous data of hot rolled plate
Piechnicki et al. Data fusion framework for decision-making support in reliability-centered maintenance
Tugengol’d et al. Autonomous maintenance of digital equipment
CN113808294A (en) Two-dimensional code scanning inspection method and system, computer equipment and storage medium thereof
Zhuang et al. Digital twin-based quality management method for the assembly process of aerospace products with the Grey-Markov Model and Apriori Algorithm
CN114995302A (en) Intelligent control method and system
Kong et al. A study on a general cyber machine tools monitoring system in smart factories
CN117408561A (en) Residential engineering construction supervision method and device and electronic equipment
Kurmanov Various production planning models for manufacturing execution systems
JPH10207900A (en) Book/facility data management system based on virtual facility
KR102126923B1 (en) Smart factory system based on health test room for operating personnel
Jònsson et al. Systematic lead time analysis
CN116993529A (en) Enterprise management informatization construction data statistics intelligent analysis system
Marconi et al. An interactive resource value mapping tool to support the reduction of inefficiencies in smart manufacturing processes
Aksyonov et al. Development of an automated system for analysis, modeling, and decision-making for metallurgical enterprise
Terblanche Swanepoel Decision support system: real‐time control of manufacturing processes
Torre et al. Action research of lean 4.0 application to the maintenance of hydraulic systems in steel industry
Sokolov et al. Combined models and algorithms on modern proactive intellectual scheduling under Industry 4.0 environment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant