CN109884262A - A kind of data collection system and method based on detecting instrument - Google Patents
A kind of data collection system and method based on detecting instrument Download PDFInfo
- Publication number
- CN109884262A CN109884262A CN201711277316.5A CN201711277316A CN109884262A CN 109884262 A CN109884262 A CN 109884262A CN 201711277316 A CN201711277316 A CN 201711277316A CN 109884262 A CN109884262 A CN 109884262A
- Authority
- CN
- China
- Prior art keywords
- detecting instrument
- collection system
- data collection
- original document
- harvester
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a kind of data collection system and method based on detecting instrument.The data collection system, comprising: at least one front end processor and at least one harvester；Wherein, the front end processor has double netcard, and wherein Intranet network interface card is used to download the original document of the detecting instrument, and outer net network interface card is used to for the original document to be sent at least one described harvester；The harvester obtains and parses the original document, obtains the normative document for the reference format for having unified, the normative document is associated summarize with format encapsulate, to form final examining report.The present invention combines computer industry and food service industry, incorporate internet+theory, the automatic data acquisition of data progress that Application Software Program generates equipment greatly improves the formation efficiency of report, and avoid artificial error rate.
Description
Technical field
The present invention relates to data acquisition and processing technology fields more particularly to a kind of data based on detecting instrument to acquire system
System and method.
Background technique
Food safety has become the emphasis and hot spot of equipment common people concern instantly, and food inspection industry also just becomes mesh
The food safety detection that previous hot topic industry, either state food drug detection unit or each food generate producer is all wide
It is concerned, and detect finish output examining report then become one piece of very big part of workload.
Make a copy of by hand as shown in Figure 1, all reports of detecting instrument output at present require laboratory testing personnel,
Collection result is made a copy of from equipment detecting instrument, and is written in report, Limis (plant laboratory information is finally uploaded
Management system).Limis is made of computer hardware and application software, can be completed the collection of laboratory data and information, be divided
Analysis, report and management.Limis be based on computer LAN, specifically for a laboratory integrated environment and design, be one
It include the high-efficient integrated system including signal collecting device, data communication software, database management language.In being with laboratory
The heart, by the operation flow in laboratory, environment, personnel, instrument and equipment, mark object standard liquid, chemical reagent, standard method, books and reference materials,
File record, research and development management, project management, customer account management etc. factor organically combine.
However, this process takes time and effort and be easy error, report output, which takes long time, also becomes major testing agency
A pain spot.
Summary of the invention
It leans on for the present examining report of solution and artificially makes a copy of by hand substantially, it is very time-consuming and laborious, and the problem that error rate is high,
The purpose of the present invention is what is be achieved through the following technical solutions.
Invention applies data acquisition, data mining and clouds, by cloud, so that acquisition platform is flat as cloud
Platform, the detection data in the laboratory that a set of acquisition system supports acquisition all carry out laboratory testing equipment data on platform
Interface program adaptation.The output interface of laboratory testing equipment is various at present, and the present invention is carried out all kinds of by high abstraction
The adaptation of interface, such as the acquisition of excel file, the acquisition of word document, the acquisition of txt file, the data acquired are logical
Cross template generation report.
Specifically, according to an aspect of the invention, there is provided a kind of data collection system based on detecting instrument, packet
It includes:
At least one front end processor and at least one harvester；Wherein,
The front end processor has double netcard, and wherein Intranet network interface card is used to download the original document of the detecting instrument, outer net
Network interface card is used to for the original document to be sent at least one described harvester；
The harvester obtains and parses the original document, obtains the normative document for the reference format for having unified, will
The normative document is associated to summarize and encapsulate with format, to form final examining report.
Preferably, there are two the front end processors, including a main front end processor and a standby front end processor.
Preferably, the harvester is located at cloud.
Preferably, it is described the normative document is associated summarize with format encapsulation include:
The data of the normative document are associated merging, using the feature field of data after merging as incidence relation；
It is packaged described by associated normative document according to predetermined format.
Preferably, the front end processor every the set time downloaded from the detecting instrument and send newly-increased original document to
Harvester, and the harvester obtains every the set time and parses the newly-increased original document.
Preferably, the front end processor filters unwanted original document by configuring regular expression, only takes needs
Original document.
It is furthermore preferred that the regular expression is filename rule.
Preferably, the data collection system further comprises at least one management control machine, the pipe for acquisition tasks
Reason, control and scheduling.
It is furthermore preferred that there are two the management control machines, including a main management control machine and a standby management control machine.
According to another aspect of the present invention, a kind of collecting method based on detecting instrument is additionally provided, comprising:
Download and send the original document of the detecting instrument；
The original document is obtained and parsed, the normative document for the reference format for having unified is obtained, by the standard text
Part is associated to summarize and encapsulate with format, to form final examining report.
The present invention has the advantages that the present invention combines computer industry and food service industry, incorporate internet+reason
It reads, Application Software Program carries out automatic data acquisition to the data that equipment generates, the formation efficiency of report is greatly improved, with
And avoid artificial error rate.
Detailed description of the invention
By reading the detailed description of following detailed description, various other advantages and benefits are common for this field
Technical staff will become clear.Attached drawing is only used for showing the purpose of specific embodiment, and is not considered as to the present invention
Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:
Fig. 1 shows the flow chart of the existing report out of detection industry in the prior art.
Fig. 2 shows the first preferred implementations of the data collection system based on detecting instrument of embodiment according to the present invention
Example structural schematic diagram.
Fig. 3 shows the file name information result schematic diagram that front end processor locally saves original document at it.
Fig. 4 shows the process of analysis figure of the excel file of embodiment according to the present invention.
Fig. 5 shows the Analytic principle figure of the excel file of embodiment according to the present invention.
Fig. 6 shows the second preferred implementation of the data collection system based on detecting instrument of embodiment according to the present invention
Example structural schematic diagram.
Specific embodiment
The illustrative embodiments of the disclosure are more fully described below with reference to accompanying drawings.Although showing this public affairs in attached drawing
The illustrative embodiments opened, it being understood, however, that may be realized in various forms the disclosure without the reality that should be illustrated here
The mode of applying is limited.It is to be able to thoroughly understand the disclosure on the contrary, providing these embodiments, and can be by this public affairs
The range opened is fully disclosed to those skilled in the art.
The generating process of existing examining report is, after detection device has detected, lab assistant reads acquisition by hand and sets
Standby data, data are filled up in report template, are presently mainly copied by pen and are manually entered with computer, and report amount is very
Greatly, personnel's craft typing portion report averagely gets off to need half an hour, and is easy error, this results in report not arrive slowly
In the hand of client, and after malfunctioning client perceptibility it is excessively poor, and the present invention is by capture program automatic data collection, Yi Fenbao
Announcement can control in 5 minutes, and directly avoid mistake.Introduce realization principle of the invention in detail below and realize process,
Effect.
Fig. 2 shows the structural schematic diagrams of the data collection system based on detecting instrument of embodiment according to the present invention.
As shown, the detecting instrument is located on multiple workbench, which includes: at least one front end processor and at least
One harvester.
At least one front end processor, the front end processor have double netcard, and wherein Intranet network interface card is for downloading the original of workbench
File, outer net network interface card are used to file being uploaded to harvester.Since workbench is in intranet environment, can not directly with outer Netcom
Letter, it is therefore desirable to which the front end processor for possessing double netcard by one is by the network link of workbench and harvester, the Intranet of front end processor
Network interface card is responsible for downloading original document on workbench, and outer net network interface card is responsible for for file being uploaded to the harvester in cloud.In the excellent of Fig. 2
It selects in embodiment, including two front end processors, one main one is standby, can prevent from influencing entire system when one of front end processor delay machine in this way
The work of system.There is a detecting instrument on each workbench, for detecting food quality, and export related detection data.
Between the detecting instrument of different workbench, these data often use different data formats, such as excel file,
Word document, txt file, pdf file etc. format.
According to a preferred embodiment of the present invention, in order to guarantee the timeliness of data, every five minutes of front end processor is from work
Platform moves newly-increased file to harvester, and harvester locally carries out the acquisition and parsing of newly-increased file for every five minutes in harvester.
Front end processor is supported to be scanned on the table with the configurable period, can be by newly-increased file acquisition after finding newly-increased file
And it is uploaded to cloud harvester, front end processor filters unwanted file by configuring regular expression, only takes the correlation of needs
File.So-called configuration regular expression can exactly obtain the associated documents of needs by fixed filename rule.Example
Such as, when front end processor extracts the initial data of the detecting instrument output on workbench, the entitled xls, pdf of extraction document suffix,
The file of the formats such as jpg, txt, xml.
According to a preferred embodiment of the present invention, as shown in figure 3, front end processor locally saves the original document at it
File name information, including file directory and title, file size, file generated time, after thering is newly-increased file to upload, meeting
The file name information of newly-increased file is saved in front end processor.After finding newly-increased file every time, by the detector for comparing workbench
File directory and front end processor file in device, judge whether newly-increased file meets above-mentioned filename rule, and record and meet rule
File catalogue and title, size and generate the time.
According to a preferred embodiment of the present invention, as shown in Fig. 2, the harvester obtains and parses the original text
Part exports the normative document with unified reference format, and the normative document of the parsing is packaged into message and is sent to
Limis cloud.Harvester is by after finding newly-increased file, passing through capture program on the newly-increased file of configurable intermittent scanning
Acquisition file is obtained, classification adaptation parsing is carried out according to different file types, resolution rules are classified according to file format,
For example, including the parsing of word, excel, txt, xml, csv class file, according to file format selection pair after acquisition file
The resolution logic answered reads by program and parses the content of needs after selection, regardless of input is what kind of file, output
All it is reference format, the differentiation of the different detecting instruments from different manufacturers is masked.
Harvester exports the file after parsing for after reference format, subsequent such normative document to be inserted into data
Be associated in library summarize, calculate, format encapsulation, to form final examining report.For example, by the number of the normative document
Merge according to being associated, using the feature field of data after merging as incidence relation.For example, by an examining report institute
The data needed may be from different files, it is sometimes desirable to and the data of multiple files are associated and merge into a table,
In certain one or more columns per page as incidence relation；Or the data correlation of multiple files is formed into array, by certain of the array
A field is as incidence relation.Some data may be calculated, such as rounding up for decimal place, the calculating etc. of formula.
Then normative document is further carried out predetermined format encapsulation by harvester, such as is packaged according to the template of examining report, shape
At final examining report.It should be noted that predetermined format can be the format of examining report needs, it is also possible to according to need
Seek customized format.
As shown in figure 4, by taking the parsing of excel file as an example, the step of illustrating collecting method of the present invention: obtain
Excel file；Parsing excel simultaneously divides sheet pages of output；By sheet pages by data loading；Obtain the data that report needs；It will
Each sheet page data summarizes association；Data after summarizing are encapsulated as reporting format.
As shown in figure 5, illustrating the course of work of data collection system of the present invention: wherein by taking the parsing of excel file as an example
The acquisition of file, the parsing of file are respectively included, data correlation summarizes and (calculated if necessary), and encapsulation template (close by data
And generate report).In this process, excel file is due to there are multiple sheet pages, needing to parse one sheet pages
One file needs multiple parsing modules, and multiple files of parsing finally need to be aggregated into a file, is merged into a text
After part by the Document encapsulation of current reference format be report template needed for format.
Fig. 6 shows the second preferred implementation of the data collection system based on detecting instrument of embodiment according to the present invention
Example structural schematic diagram.Compared with first preferred embodiment, the second preferred embodiment is further provided with two pipes in the cloud Limis
Control machine is managed, one main one is standby.Management control machine is responsible for the management, control and scheduling of acquisition tasks, and harvester is responsible for specific file
It obtains and parsing work, management control machine is divided into main control and standby control, realize management control High Availabitity.
By the introduction of above-mentioned two preferred embodiment, the present invention realizes being capable of automatic periodic polling downloading detection device
The file of generation；The file that real-time capture and detection apparatus generates, is adapted to multiple interfaces；The defeated of data is carried out according to template style
Out.To completely disengage manual operation, all being obtained by programming automation, real-time is high, and it is high-efficient, and avoid malfunctioning.
More than, illustrative specific embodiment only of the invention, but scope of protection of the present invention is not limited thereto, appoints
In the technical scope disclosed by the present invention, any changes or substitutions that can be easily thought of, all by what those familiar with the art
It is covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be subject to the protection scope in claims.
Claims (10)
1. a kind of data collection system based on detecting instrument characterized by comprising
At least one front end processor and at least one harvester；Wherein,
The front end processor has double netcard, and wherein Intranet network interface card is used to download the original document of the detecting instrument, outer net network interface card
For the original document to be sent at least one described harvester；
The harvester obtains and parses the original document, obtains the normative document for the reference format for having unified, will be described
Normative document is associated to summarize and encapsulate with format, to form final examining report.
2. the data collection system according to claim 1 based on detecting instrument, which is characterized in that
There are two the front end processors, including a main front end processor and a standby front end processor.
3. the data collection system according to claim 1 based on detecting instrument, which is characterized in that
The harvester is located at cloud.
4. the data collection system according to claim 1 based on detecting instrument, which is characterized in that
It is described the normative document is associated summarize with format encapsulation include:
The data of the normative document are associated merging, using the feature field of data after merging as incidence relation；
It is packaged described by associated normative document according to predetermined format.
5. the data collection system according to claim 1 based on detecting instrument, which is characterized in that
The front end processor is downloaded from the detecting instrument every the set time and sends newly-increased original document to harvester, and institute
Harvester is stated to obtain every the set time and parse the newly-increased original document；
The original document has different data formats.
6. the data collection system according to claim 1 based on detecting instrument, which is characterized in that
The front end processor filters unwanted original document by configuring regular expression, only takes the original document of needs.
7. the data collection system according to claim 6 based on detecting instrument, which is characterized in that
The regular expression is filename rule.
8. the data collection system according to claim 1 based on detecting instrument, which is characterized in that
The data collection system further comprises at least one management control machine, management, control and tune for acquisition tasks
Degree.
9. the data collection system according to claim 8 based on detecting instrument, which is characterized in that
There are two the management control machines, including a main management control machine and a standby management control machine.
10. a kind of collecting method based on detecting instrument characterized by comprising
Download and send the original document of the detecting instrument；
Obtain and parse the original document, obtain the normative document for the reference format for having unified, by the normative document into
Row association summarizes to be encapsulated with format, to form final examining report.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711277316.5A CN109884262A (en) | 2017-12-06 | 2017-12-06 | A kind of data collection system and method based on detecting instrument |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711277316.5A CN109884262A (en) | 2017-12-06 | 2017-12-06 | A kind of data collection system and method based on detecting instrument |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109884262A true CN109884262A (en) | 2019-06-14 |
Family
ID=66923964
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711277316.5A Pending CN109884262A (en) | 2017-12-06 | 2017-12-06 | A kind of data collection system and method based on detecting instrument |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109884262A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111309791A (en) * | 2019-12-13 | 2020-06-19 | 成都材智科技有限公司 | Automatic data acquisition method for detection instrument |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101083607A (en) * | 2006-05-30 | 2007-12-05 | 倪海生 | Internet accessing server for inside and outside network isolation and its processing method |
| CN101533390A (en) * | 2009-04-10 | 2009-09-16 | 耐普罗机械（天津）有限公司 | Method for automatically generating measurement report by computer video measurement machine |
| JPWO2010109999A1 (en) * | 2009-03-26 | 2012-09-27 | コニカミノルタエムジー株式会社 | Report generation management device and program |
| CN103136654A (en) * | 2011-11-25 | 2013-06-05 | 鸿富锦精密工业（深圳）有限公司 | Method and system for outputting measuring report |
| CN105933139A (en) * | 2016-03-30 | 2016-09-07 | 广东凯通软件开发有限公司 | Data processing method and device |
| CN106484803A (en) * | 2016-09-22 | 2017-03-08 | 北京润科通用技术有限公司 | A kind of data analysing method and system |
| CN206531533U (en) * | 2017-01-24 | 2017-09-29 | 闽江学院 | A kind of long-range water environment data acquisition and processing unit based on C/S model |
-
2017
- 2017-12-06 CN CN201711277316.5A patent/CN109884262A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101083607A (en) * | 2006-05-30 | 2007-12-05 | 倪海生 | Internet accessing server for inside and outside network isolation and its processing method |
| JPWO2010109999A1 (en) * | 2009-03-26 | 2012-09-27 | コニカミノルタエムジー株式会社 | Report generation management device and program |
| CN101533390A (en) * | 2009-04-10 | 2009-09-16 | 耐普罗机械（天津）有限公司 | Method for automatically generating measurement report by computer video measurement machine |
| CN103136654A (en) * | 2011-11-25 | 2013-06-05 | 鸿富锦精密工业（深圳）有限公司 | Method and system for outputting measuring report |
| CN105933139A (en) * | 2016-03-30 | 2016-09-07 | 广东凯通软件开发有限公司 | Data processing method and device |
| CN106484803A (en) * | 2016-09-22 | 2017-03-08 | 北京润科通用技术有限公司 | A kind of data analysing method and system |
| CN206531533U (en) * | 2017-01-24 | 2017-09-29 | 闽江学院 | A kind of long-range water environment data acquisition and processing unit based on C/S model |
Non-Patent Citations (1)
| Title |
|---|
| 赵军平，任连仲: "《区域卫生信息系统设计与应用》", 31 March 2012, 人民军医出版社 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111309791A (en) * | 2019-12-13 | 2020-06-19 | 成都材智科技有限公司 | Automatic data acquisition method for detection instrument |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109933752B (en) | Method and device for exporting electronic document | |
| AU2009238294B2 (en) | Data transformation based on a technical design document | |
| CN110162544B (en) | Heterogeneous data source data acquisition method and device | |
| US20100011337A1 (en) | Open application lifecycle management framework domain model | |
| CN106919612B (en) | Processing method and device for online structured query language script | |
| CN106550038B (en) | Data configuration diagnosis system and method of digital control system | |
| WO2016007178A1 (en) | System and method for providing contextual analytics data | |
| CN116226159A (en) | Metadata blood-edge relationship analysis method, system, equipment and storage medium | |
| Magagna et al. | Data provenance | |
| CN109862074B (en) | Data acquisition method and device, readable medium and electronic equipment | |
| US20180121526A1 (en) | Method, apparatus, and computer-readable medium for non-structured data profiling | |
| CN109884262A (en) | A kind of data collection system and method based on detecting instrument | |
| KR100284580B1 (en) | Web document automatic generating device and method | |
| CN111858236B (en) | Knowledge graph monitoring method and device, computer equipment and storage medium | |
| CN111984826A (en) | XML-based data automatic storage method, system, device and storage medium | |
| CN109542890B (en) | Data modification method, device, computer equipment and storage medium | |
| US20210012060A1 (en) | Structured document conversion and display system and method | |
| US20230113187A1 (en) | Analytics workflow integrated with logic control | |
| CN112947939B (en) | Data reporting method, device, equipment and storage medium | |
| CN114115831A (en) | Data processing method, device, equipment and storage medium | |
| US20130159327A1 (en) | Apparatus and method for visualizing data | |
| CN110737636B (en) | Data import method, device and equipment | |
| Quix et al. | Modelling national research information contexts based on CERIF | |
| CN102310950B (en) | Experiment intelligent interpretation system and method | |
| CN110019109B (en) | Method and apparatus for processing data warehouse data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190614 |