CN105468698A - Real-time processing method of mass orders - Google Patents
Real-time processing method of mass orders Download PDFInfo
- Publication number
- CN105468698A CN105468698A CN201510794194.1A CN201510794194A CN105468698A CN 105468698 A CN105468698 A CN 105468698A CN 201510794194 A CN201510794194 A CN 201510794194A CN 105468698 A CN105468698 A CN 105468698A
- Authority
- CN
- China
- Prior art keywords
- real
- processing method
- order
- time processing
- magnanimity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 22
- 238000007621 cluster analysis Methods 0.000 claims abstract description 6
- 238000000034 method Methods 0.000 claims description 20
- 230000008569 process Effects 0.000 claims description 16
- 238000004140 cleaning Methods 0.000 claims description 3
- 230000013011 mating Effects 0.000 claims description 3
- 238000012545 processing Methods 0.000 abstract description 10
- 238000003860 storage Methods 0.000 abstract description 5
- 238000009826 distribution Methods 0.000 abstract description 4
- 238000007781 pre-processing Methods 0.000 abstract 1
- 230000007261 regionalization Effects 0.000 abstract 1
- 230000008901 benefit Effects 0.000 description 4
- 238000007405 data analysis Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000002203 pretreatment Methods 0.000 description 1
- 238000010223 real-time analysis Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/335—Filtering based on additional data, e.g. user or group profiles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/35—Clustering; Classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0633—Lists, e.g. purchase orders, compilation or processing
- G06Q30/0635—Processing of requisition or of purchase orders
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Development Economics (AREA)
- Finance (AREA)
- Accounting & Taxation (AREA)
- Human Resources & Organizations (AREA)
- Entrepreneurship & Innovation (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a real-time processing method of mass orders. The real-time processing method comprises the following steps: order preprocessing: processing an order set generated by an electronic commerce server in real time to form a corresponding key-value pair form, and carrying out distributed storage in a file block form; the warehouse arrival of the order: compiling a cluster analysis code for a distributed storage file block to be calculated to realize task distribution and result clustering; and putting ordered package sin a car for express delivery: forming the key-value pair form for a clustering result, sending distribution requirements to corresponding branch warehouses, and distributing to corresponding couriers according to distribution destinations. The real-time processing method of the mass orders can carry out branch warehouse orientated clustering processing on the mass orders of all electric commerce on the basis of a MapReduce frame of a parallel processing model so as to realize real-time regionalization processing.
Description
Technical field
The present invention relates to e-commerce field, and in particular to a kind of magnanimity order real-time processing method.
Background technology
Ecommerce typically refers in the commerce and trade activity widely of all parts of the world, under the network environment that the Internet is open, based on browser/server application mode, both parties do not carry out various commercial activity with meeting, realize online transaction between the shopping online of consumer, trade company and online pay by mails and various commercial activity, transaction, finance activities and relevant integrated service activity a kind of novel commercial operation pattern.
At numerous areas such as scientific research, Computer Simulation, internet, applications, especially Web2.0 rise with expand on a large scale, ecommerce comes into the work of numerous people gradually with life, and the data volume simultaneously produced because of online transaction increases with index speed.In order to these large data resources of analysis and treament effectively, effective data analysis technique must be relied on, and when sight is turned to traditional relational by people, find the development that traditional relation data administrative skill (parallel database) have passed through 40 years nearly, in extendability, encounter huge obstacle, the task of large data analysis cannot be competent at.And be that the large data processing technique of representative is a dark horse, with the advantage of its good extendability, fault-tolerance and massively parallel processing with MapReduce.
The present invention, on the basis of fully investigating current main-stream B2C electricity business and shopping platform, utilizes MapReduce parallel processing technique and in conjunction with the unique advantage of HDFS in distributed storage, proposes the real-time processing method towards magnanimity order.
Summary of the invention
The present invention proposes a kind of magnanimity order real-time processing method, based on parallel process model MapReduce framework, and the clustering processing can carrying out towards point warehouse to the magnanimity order of all electric business, thus realize real-time regionization process.
In order to achieve the above object, the present invention proposes a kind of magnanimity order real-time processing method, comprises the following steps:
Order pre-service, the order set comprised electric business's server generates in real time processes, and forms corresponding key-be worth right form, and carries out distributed store with the form of blocks of files;
Order, to storehouse, to the blocks of files establishment cluster analysis code to be calculated of described distributed store, realizes task matching and result cluster;
Express delivery is got on the bus, and forms key-be worth right form, and dispensing demand is dealt into corresponding point of storehouse to cluster result, and provides to corresponding courier according to dispensing destination.
Further, the described order set generated in real time electric business's server is carried out process and is comprised cleaning, denoising, filter operation.
Further, described blocks of files distributed store is in Hadoop platform.
Further, the amount of capacity of described blocks of files is for being less than 64MB.
Further, the key that described order pre-service is formed-being worth form is < O/No., dispensing address > formula key-it is right to be worth.
Further, described task matching is Map operation, calculated address and each point of warehouse distance.
Further, described result cluster is Reduce operation, mates certain point of storehouse.
Further, described express delivery is got on the bus and is formed key-be worth right form for carry out secondary cluster according to specific address to cluster result, thus realizes mating of kinds of goods and express delivery station or courier.
The magnanimity order real-time processing method that the present invention proposes, based on parallel process model MapReduce framework, the clustering processing can carrying out towards point warehouse to the magnanimity order of all electric business, thus realize real-time regionization and process.Compared with prior art, the present invention has the following advantages: (1) Based on Distributed storage system Hadoop and distributed computing model MapReduce, can obtain considerable Real time Efficiency with less cost; (2) order processing problem simplifies layer by layer, from point warehouse to receiving station or quick member, can accelerate order dealing process.
Accompanying drawing explanation
Figure 1 shows that the magnanimity order real-time processing method process flow diagram of present pre-ferred embodiments.
Embodiment
Provide the specific embodiment of the present invention below in conjunction with accompanying drawing, but the invention is not restricted to following embodiment.According to the following describes and claims, advantages and features of the invention will be clearer.It should be noted that, accompanying drawing all adopts the form that simplifies very much and all uses non-ratio accurately, only for object that is convenient, the aid illustration embodiment of the present invention lucidly.
Please refer to Fig. 1, Figure 1 shows that the magnanimity order real-time processing method process flow diagram of present pre-ferred embodiments.The present invention proposes a kind of magnanimity order real-time processing method, comprises the following steps:
Step S100: order pre-service, the order set comprised electric business's server generates in real time processes, and forms corresponding key-be worth right form, and carries out distributed store with the form of blocks of files;
Step S200: order, to storehouse, to the blocks of files establishment cluster analysis code to be calculated of described distributed store, realizes task matching and result cluster;
Step S300: express delivery is got on the bus, forms key-be worth right form to cluster result, and dispensing demand is dealt into corresponding point of storehouse, and provides to corresponding courier according to dispensing destination.
According to present pre-ferred embodiments, in order pre-treatment step, the described order set generated in real time electric business's server is carried out process and is comprised cleaning, denoising, filter operation, object removes those invalid orders, simultaneously in order to File cutting and distribution process are carried out in further MapReduce operation.
For given one group of magnanimity order (often store and store with large files form), utilize the attribute of wherein most critical, such as O/No., dispensing address (prefecture-level), because which form < O/No., dispensing address > formula key-it is right to be worth, and carry out distributed store with the form of blocks of files.Further, described blocks of files in Hadoop platform to be less than the blocks of files distributed store of 64MB.
Described order according to pre-processed results to storehouse step, is worked out corresponding procedure function, is realized cluster.With the structuring in problem of implementation territory, to the convergence of the mapping of back end, result set and reduction etc., described task matching is Map operation, calculated address and each point of warehouse distance, and described result cluster is that Reduce operates, and mates certain point of storehouse.Order is carry out Classifying Sum to multiple distributed document towards point warehouse to storehouse, to accelerate order dealing process, allows client receive kinds of goods early.
Get on the bus in step in described express delivery, key-be worth right form for carry out secondary cluster according to specific address is formed to cluster result, thus realize mating of kinds of goods and express delivery station or courier.
The magnanimity order real-time processing method that the present invention proposes, by integration and the cluster analysis of Based on Distributed storage platform Hadoop, can carry out real-time analysis process to mass data amount, cost is cheap group system.Carry out cluster analysis based on Parallel Programming Models MapReduce, according to the rule of " memory priority is in calculating ", efficiency obtains and highly ensures.
Although the present invention with preferred embodiment disclose as above, so itself and be not used to limit the present invention.Persond having ordinary knowledge in the technical field of the present invention, without departing from the spirit and scope of the present invention, when being used for a variety of modifications and variations.Therefore, protection scope of the present invention is when being as the criterion depending on those as defined in claim.
Claims (8)
1. a magnanimity order real-time processing method, is characterized in that, comprises the following steps:
Order pre-service, the order set comprised electric business's server generates in real time processes, and forms corresponding key-be worth right form, and carries out distributed store with the form of blocks of files;
Order, to storehouse, to the blocks of files establishment cluster analysis code to be calculated of described distributed store, realizes task matching and result cluster;
Express delivery is got on the bus, and forms key-be worth right form, and dispensing demand is dealt into corresponding point of storehouse to cluster result, and provides to corresponding courier according to dispensing destination.
2. magnanimity order real-time processing method according to claim 1, is characterized in that, the described order set generated in real time electric business's server is carried out process and comprised cleaning, denoising, filter operation.
3. magnanimity order real-time processing method according to claim 1, is characterized in that, described blocks of files distributed store is in Hadoop platform.
4. magnanimity order real-time processing method according to claim 1, is characterized in that, the amount of capacity of described blocks of files is for being less than 64MB.
5. magnanimity order real-time processing method according to claim 1, is characterized in that, the key that described order pre-service is formed-being worth form is < O/No., dispensing address > formula key-it is right to be worth.
6. magnanimity order real-time processing method according to claim 1, is characterized in that, described task matching is Map operation, calculated address and each point of warehouse distance.
7. magnanimity order real-time processing method according to claim 1, is characterized in that, described result cluster is Reduce operation, mates certain point of storehouse.
8. magnanimity order real-time processing method according to claim 1, is characterized in that, described express delivery is got on the bus and formed key-be worth right form for carry out secondary cluster according to specific address to cluster result, thus realizes mating of kinds of goods and express delivery station or courier.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510794194.1A CN105468698A (en) | 2015-11-18 | 2015-11-18 | Real-time processing method of mass orders |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510794194.1A CN105468698A (en) | 2015-11-18 | 2015-11-18 | Real-time processing method of mass orders |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105468698A true CN105468698A (en) | 2016-04-06 |
Family
ID=55606399
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510794194.1A Pending CN105468698A (en) | 2015-11-18 | 2015-11-18 | Real-time processing method of mass orders |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105468698A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106384219A (en) * | 2016-10-13 | 2017-02-08 | 北京京东尚科信息技术有限公司 | Warehouse partition assisted analysis method and device |
| CN107392452A (en) * | 2017-07-11 | 2017-11-24 | 四川昆朋金软科技有限公司 | A kind of inspection work order active allocating method based on Kmeans clusters |
| WO2021147353A1 (en) * | 2020-01-21 | 2021-07-29 | 北京三快在线科技有限公司 | Order dispatch |
| CN113902331A (en) * | 2021-10-27 | 2022-01-07 | 上海腾道信息技术有限公司 | International trade data management system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101673361A (en) * | 2008-09-12 | 2010-03-17 | 北京正辰科技发展有限责任公司 | Technical architecture for order distribution system |
| US20120124584A1 (en) * | 2010-11-12 | 2012-05-17 | Oracle International Corporation | Event-Based Orchestration in Distributed Order Orchestration System |
| CN103838863A (en) * | 2014-03-14 | 2014-06-04 | 内蒙古科技大学 | Big-data clustering algorithm based on cloud computing platform |
| CN104331792A (en) * | 2014-10-23 | 2015-02-04 | 张勇平 | Logistics distribution cloud management system |
| CN104899721A (en) * | 2015-06-24 | 2015-09-09 | 程强 | Logistics network construction method and logistics distribution system |
-
2015
- 2015-11-18 CN CN201510794194.1A patent/CN105468698A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101673361A (en) * | 2008-09-12 | 2010-03-17 | 北京正辰科技发展有限责任公司 | Technical architecture for order distribution system |
| US20120124584A1 (en) * | 2010-11-12 | 2012-05-17 | Oracle International Corporation | Event-Based Orchestration in Distributed Order Orchestration System |
| CN103838863A (en) * | 2014-03-14 | 2014-06-04 | 内蒙古科技大学 | Big-data clustering algorithm based on cloud computing platform |
| CN104331792A (en) * | 2014-10-23 | 2015-02-04 | 张勇平 | Logistics distribution cloud management system |
| CN104899721A (en) * | 2015-06-24 | 2015-09-09 | 程强 | Logistics network construction method and logistics distribution system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106384219A (en) * | 2016-10-13 | 2017-02-08 | 北京京东尚科信息技术有限公司 | Warehouse partition assisted analysis method and device |
| CN106384219B (en) * | 2016-10-13 | 2021-09-07 | 北京京东振世信息技术有限公司 | Storage sub-warehouse auxiliary analysis method and device |
| CN107392452A (en) * | 2017-07-11 | 2017-11-24 | 四川昆朋金软科技有限公司 | A kind of inspection work order active allocating method based on Kmeans clusters |
| WO2021147353A1 (en) * | 2020-01-21 | 2021-07-29 | 北京三快在线科技有限公司 | Order dispatch |
| CN113902331A (en) * | 2021-10-27 | 2022-01-07 | 上海腾道信息技术有限公司 | International trade data management system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Simeone et al. | Intelligent cloud manufacturing platform for efficient resource sharing in smart manufacturing networks | |
| CN106296059B (en) | Method and equipment for determining delivery network points | |
| CN105468698A (en) | Real-time processing method of mass orders | |
| CN110348771B (en) | Method and device for order grouping of orders | |
| US20210136122A1 (en) | Crowdsourced innovation laboratory and process implementation system | |
| US20180165184A1 (en) | Production-like testing and complex business to business auditing system | |
| CN105447741A (en) | Electronic transaction online service platform | |
| CN105260874A (en) | Structurally-improved logistics distribution cloud management system | |
| CN112016919A (en) | Data processing method and device for calculating settlement amount | |
| US20240211883A1 (en) | Routing business documents based on events | |
| CN107133233B (en) | Processing method and device for configuration data query | |
| CN110781250A (en) | BI decision management system and method based on big data | |
| CN112418258A (en) | Feature discretization method and device | |
| CN109902847B (en) | Method and device for predicting amount of orders in branch warehouse | |
| US11488232B2 (en) | Document evaluation, alerting and validation system | |
| CN113706064A (en) | Order processing method and device | |
| CN112784212A (en) | Method and device for optimizing inventory | |
| CN106203861A (en) | A kind of finishing based on distributed system management cloud system | |
| Wang et al. | CPSP: A cloud-based production service platform supporting co-manufacturing of cross-enterprise | |
| CN106203826B (en) | Data processing system and method for maritime service B2B | |
| CN103198378A (en) | Information handling system and information handling method | |
| Bajaj et al. | A comparative analysis of cloud based services platform | |
| CN111179076A (en) | IT system intelligent management method, IT system intelligent management device and computer readable storage medium | |
| CN106204228A (en) | A kind of finishing management cloud system with message caching and autonomous retransmission function | |
| CN104881491A (en) | Software development system based on big data platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160406 |
|
| WD01 | Invention patent application deemed withdrawn after publication |