CN110297861A - A kind of distributed intelligence database data acquisition method based on super market checkout system - Google Patents
A kind of distributed intelligence database data acquisition method based on super market checkout system Download PDFInfo
- Publication number
- CN110297861A CN110297861A CN201910529094.4A CN201910529094A CN110297861A CN 110297861 A CN110297861 A CN 110297861A CN 201910529094 A CN201910529094 A CN 201910529094A CN 110297861 A CN110297861 A CN 110297861A
- Authority
- CN
- China
- Prior art keywords
- data
- database
- acquisition
- super market
- market checkout
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/602—Providing cryptographic facilities or services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/08—Payment architectures
- G06Q20/20—Point-of-sale [POS] network systems
Abstract
The invention discloses a kind of distributed intelligence database data acquisition method based on super market checkout system.This method is related to database structure data acquisition plan under informatization more particularly to a kind of Windows operating system.The data acquisition modes, just for, data structure different still business model identical database progress intelligent acquisition and data cleansing similar in this business model of super market checkout.The program includes the operations such as data base authority acquisition, database identification, tables of data identification, data field identification, data cleansing, data preparation, data transmission and data centralized storage.This acquisition method is unique in that, for the database of complicated sorts of systems used in super market checkout process, only need database owner that our acquisition two-stage system file is installed on the server in data, the intelligent data acquisition to local data base can be completed in acquisition system, and is converted to that value density is high, the consistent data of data structure are transferred to data analytics server.In this way, traditional industries big data analysis tool is completely solved in the short slab in data collection layer face, it realizes the overall productivity for greatly improving big data analysis system for disparate databases, the automatic metadata acquisition process of different data structure and realizes efficiency.
Description
Technical field
The present invention relates to field of computer technology, specifically a kind of branch affixes one's name to database data acquisition method.
Background technique
Supermarket's retail trade digitization, intelligence have been a kind of inexorable trends, and the sector is in effort in the past 20 years
Informatization has been carried out substantially, there is certain basis for IT application.And it is produced during informationization a large amount of
The data that value density is high, data volume is big, these data are the most important infrastructure of industry digitization.
And in entire supermarket's industry intelligent Process, influence that maximum, hold back most serious is exactly data on the process
Collecting part.Since programming language is based substantially on English, serious, the low original of Software Industry spread of education degree is isolated in computer technology
Cause, domestic overwhelming majority traditional industries practitioner do not have the ability that data are docked to BI platform, and which results in the entire country
Digitization difficulty is very big, it is desirable to data are collected into Data Analysis Platform very expensive, greatly delayed domestic data into
Journey.
The method for solving the problems, such as this in entire supermarket industry now is artificial export database data, by data according to BI work
The data demand of tool carries out active process, imported into BI tool and is analyzed after processing.Whole process exists as following drawbacks:
1. excessively rely on it is artificial participate in, efficiency of greatly having delayed and improve cost
2. data handling procedure the degree of automation is low, it is easy error, it is difficult to meet industrialization demand
3. data transmission procedure relies on external equipment or delivery means, troublesome in poeration and dangerous
Summary of the invention
The present invention provides a kind of easy to operate, transmission safety, in addition to peace for supermarket's retail trade system aiming at the above deficiency
The outer collecting method woth no need to manually participate in of dress.
The technical solution used to solve the technical problems of the present invention is that: one kind realizing supermarket based on intelligent recognition algorithm automatically
The method of cash register system automatic data collection.This method, which is contained, generates the executable text of suitable binary system according to supermarket information
Part, automatic identification local data base, reading database structure and field, intelligent decision meet the required data of Data Analysis Platform
Data clear in structure, in database data carry out data preparation and according to set rule by encryption be automatically transferred to number
According to analysis platform.
It is of the present invention that suitable binary executable is generated according to supermarket information, it is super for generating an acquisition
The binary executable of city's cash register system information.
For supermarket's data acquire, no matter how many supermarkets, it is only necessary to service of goods provide website on typing supermarket base
This information, server can generate corresponding binary executable according to supermarket's essential information, if supermarket does not know that oneself takes
Business device operating system digit information, then default and generate 32 binary executables, if computer is specifically installed in user's typing
Operating system digit then generates the binary executable of corresponding digit according to actual number of bits.
The binary executable has only to be placed on client server, clicks start.bat or double-click
Executable file operation, after operation, this document can execute subsequent acquisition, arrangement and transmission work automatically.
The automatic identification local data base, the super market checkout system of mainstream on the market, is based in server-side at present
.Net it develops, the database SQL Server database that database uses Microsoft to research and develop.Under this market environment, institute of the present invention
The sampling instrument stated, can be by the administrator right of Windows, the main product database logarithm based on super market checkout system
It is identified according to library, if client uses non-mainstream brand product, carries out intelligence database identification.
The reading database structure and field, it is clear that intelligent decision meets the required data structure of Data Analysis Platform
Data, the sampling instrument can carry out business matching to database table and field, on the matched basis of business in conjunction with cash register business
Upper progress database relation chain arrangement identifies core database table and core field, it is organized into benchmark service table, and should
Product essential information and database corresponding relationship are added in sampling instrument, and future encounters same brand product and data Al Kut
Sign, can directly extract data.
It is described in database data carry out data preparation and according to set rule by encryption be automatically transferred to number
It, can be according to the demand of data analytics server, by all types data after the sampling instrument identification database according to analysis platform
Library standard finally pools standard data structure.And one of the core function of the sampling instrument is exactly data preparation.Data sheet
After ground arranges, the structural data of standard is subjected to local cipher, encrypted transmission is carried out based on HTTPS agreement after encryption,
By this way, text encryption and transmission encryption dual safety guarantee have been carried out to data, has ensure that data from the manufacturing side everywhere
Reason end is perfectly safe.
Using technical solution of the present invention, asking for supermarket's industry data distributed capture difficulty can be solved to a certain extent
Topic.
Detailed description of the invention
The following further describes the present invention with reference to the drawings.
Fig. 1 is a kind of functional block diagram of distributed intelligence database acquisition method based on super market checkout system.
Specific embodiment
The present invention will be further explained below with reference to the attached drawings and specific examples.
Distributed intelligence database acquisition method based on super market checkout system of the invention, based on offer sampling instrument
In line platform, typing acquires the essential information of supermarket, passes through platform compiled online, two based on the research and development of golang language of downloading
Binary data gripping tool, cash register system name of product version and database information used in intelligent recognition computer, for non-
Mainstream cash register system, intelligent recognition database table, incidence relation and critical field establish the non-mainstream cash register system title and version
The corresponding relationship of this and database purchase rule encrypts after data preparation is become standard retail data format, and leads to
The included web server of golang compiling binary executable is crossed, is taken by the analysis that https agreement is transferred to formulation
Business device.
Embodiment 1:
It by Supermarket management person or related personnel, opens the tool of invention and compiles platform automatically, by supermarket's essential information, example
As supermarket's title, owned enterprise, geographical location, cash register system title and version (inessential), server operating system digit are (non-
It is necessary) etc. data inputs into compiling platform, compiling platform is according to the information of offer, binary system required for compiling acquisition data
File.
Related personnel generates the compiling, with the binary file downloading of supermarket's name nominating or copies to cash register system
On the server of installation, binary file or matched start.bat autoexec are double-clicked, it is authorized by data owner
Afterwards, start to execute binary file, binary file is run on that server at once.
Binary file can detect the SQL Server database of the machine installation, find the database where cash register system,
Name of product, version and database table structure are read in verification.
If relevant information can correspond to, directly database data is arranged, and the section of interpretation of records data
Point arranges database analysis effective information, is organized into the data structure of data analysis service needs, and analysis to be uploaded is waited to take
Business.
If relevant information can not be read, further reading database details, the general industry based on cash register system are needed
Effective analysis data are marked for data type required for being engaged in, specific field information in combined data library, will after label
The data structure that the analysis service of data constituent needs etc. is to be uploaded.Meanwhile on this basis, by all numbers of the database
According to structure and sample data, name of product and version, the backup of database core information tissue, wait to be uploaded.
The data organized are encrypted, Analysis server are uploaded to by https agreement again after encryption, into clothes
The tool stores data into the database of Analysis server after business device, and waiting for server carries out data analysis.
All supermarket personnel can readily realize the present invention with the above specific embodiments,.Supermarket's line operation
Person user does not need any big data relevant knowledge, so that it may complete a link the most troublesome in big data analysis --- number
According to acquisition link, greatly promoted so that the digitization of traditional industries be allowed to upgrade efficiency.
Claims (5)
1. a kind of distribution type data collection method based on super market checkout system, including a set of database intelligent recognition algorithm, one
The standard Structured processing method of sets of data and it is a set of be based on golang language development, using the web server of language itself, lead to
Cross the method that https agreement carries out data transmission.It is characterized in that, the acquisition method can be adapted to all Windows operations system
The database acquisition of super market checkout system under system is without depending on other manual interventions.
2. piece in a set of database intelligent recognition algorithm described in claim 1, it is characterised in that traditional database table and field
Identification generally rely only on manual identified, and data characteristics and core business of the algorithm based on super market checkout system are special
The mode that sign is able to rely on machine learning is identified.
3. a set of data standard structuring processing method according to claim 1, it is characterized in that identification local database table
After field, this method can be required according to the data characteristics of data processing server, and local data is processed into required format
It is synchronous that data are carried out again.
4. a set of data transmission method based on web server based on golang language according to claim 1.It should
Method is based on a binary system installation file, can flexibly be mounted on server, which is characterized in that the system can not only
It identifies, processing local data, combines data transfer task, transmit whole encryption, it is convenient and safe efficient.
5. binary system installation file according to claim 4, be one can be supplied to the downloading of client's compiled online can
File is executed, this document can be mounted on local by client, and data can be completed in the service of execution can only collecting work.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910529094.4A CN110297861A (en) | 2019-06-19 | 2019-06-19 | A kind of distributed intelligence database data acquisition method based on super market checkout system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910529094.4A CN110297861A (en) | 2019-06-19 | 2019-06-19 | A kind of distributed intelligence database data acquisition method based on super market checkout system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110297861A true CN110297861A (en) | 2019-10-01 |
Family
ID=68028213
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910529094.4A Pending CN110297861A (en) | 2019-06-19 | 2019-06-19 | A kind of distributed intelligence database data acquisition method based on super market checkout system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110297861A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101136690A (en) * | 2006-11-23 | 2008-03-05 | 中兴通讯股份有限公司 | System and method for synchronizing operation maintenance center and base station configuration data |
| CN105262825A (en) * | 2015-10-29 | 2016-01-20 | 曲阜师范大学 | SPICE cloud desktop transporting and displaying method and system on the basis of H.265 algorithm |
| CN105550209A (en) * | 2015-12-02 | 2016-05-04 | 新浪网技术(中国)有限公司 | Resource processing method and device |
| CN105718537A (en) * | 2016-01-18 | 2016-06-29 | 标新科技（北京）有限公司 | Agricultural product supply chain whole-course data conversion method using logistics data as core |
| CN105760498A (en) * | 2016-02-22 | 2016-07-13 | 浪潮通用软件有限公司 | Achievement method of XML data and relational database matching |
| CN106649455A (en) * | 2016-09-24 | 2017-05-10 | 孙燕群 | Big data development standardized systematic classification and command set system |
| CN108932434A (en) * | 2018-06-20 | 2018-12-04 | 中国农业银行股份有限公司 | A kind of data ciphering method and device based on machine learning techniques |
| CN109658197A (en) * | 2018-12-24 | 2019-04-19 | 北交金科金融信息服务有限公司 | A kind of method for pushing and system |
-
2019
- 2019-06-19 CN CN201910529094.4A patent/CN110297861A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101136690A (en) * | 2006-11-23 | 2008-03-05 | 中兴通讯股份有限公司 | System and method for synchronizing operation maintenance center and base station configuration data |
| CN105262825A (en) * | 2015-10-29 | 2016-01-20 | 曲阜师范大学 | SPICE cloud desktop transporting and displaying method and system on the basis of H.265 algorithm |
| CN105550209A (en) * | 2015-12-02 | 2016-05-04 | 新浪网技术(中国)有限公司 | Resource processing method and device |
| CN105718537A (en) * | 2016-01-18 | 2016-06-29 | 标新科技（北京）有限公司 | Agricultural product supply chain whole-course data conversion method using logistics data as core |
| CN105760498A (en) * | 2016-02-22 | 2016-07-13 | 浪潮通用软件有限公司 | Achievement method of XML data and relational database matching |
| CN106649455A (en) * | 2016-09-24 | 2017-05-10 | 孙燕群 | Big data development standardized systematic classification and command set system |
| CN108932434A (en) * | 2018-06-20 | 2018-12-04 | 中国农业银行股份有限公司 | A kind of data ciphering method and device based on machine learning techniques |
| CN109658197A (en) * | 2018-12-24 | 2019-04-19 | 北交金科金融信息服务有限公司 | A kind of method for pushing and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20160078100A1 (en) | Generating data pattern information | |
| CN102713791A (en) | Collecting community feedback for collaborative document development | |
| EP2201449A2 (en) | A system, method and graphical user interface for workflow generation, deployment and/or execution | |
| EP2201450A2 (en) | A system, method and graphical user interface for workflow generation, deployment and/or execution | |
| CN111916161A (en) | Method and device for collecting and converting multiple data sources in clinical test process | |
| GB2503893A (en) | Selecting data from a database using data representing a sequence of operations | |
| CN107025601A (en) | Verification of data method, device and equipment | |
| CN104766240A (en) | Electronic banking data processing system and method | |
| US11308102B2 (en) | Data catalog automatic generation system and data catalog automatic generation method | |
| CN107748748A (en) | Water conservancy and hydropower technical standard text retrieval system | |
| CN112037865B (en) | Species science name determining method, device, electronic equipment and storage medium | |
| CN110297861A (en) | A kind of distributed intelligence database data acquisition method based on super market checkout system | |
| CN112735571A (en) | Medical health data uploading management platform | |
| US20130290065A1 (en) | Method and System to Analyze Processes | |
| US20150073857A1 (en) | Mobile terminal management server and mobile terminal management program | |
| WO2017156624A1 (en) | Method and system for persisting data | |
| Moly et al. | An advanced ETL technique for error free data in data warehousing environment | |
| CN112101718A (en) | Multi-user cooperation structured data processing method and device based on Internet | |
| CN106610964A (en) | Abnormal reimbursement data analysis method and server | |
| CN111368090A (en) | Project knowledge tree construction and retrieval method | |
| Sanca et al. | Context-Enhanced Relational Operators with Vector Embeddings | |
| KR20110106602A (en) | Patent claim diet system | |
| Kimball et al. | A Method and Tool for Automated Induction of Relations from Quantitative Performance Logs | |
| Meagher et al. | Turned loose in the OPAC: URL selection, addition, and management process | |
| Schmidt et al. | Etl tool evaluation—a criteria framework |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20191001 |