CN108572877A - A kind of concurrent message processing method of feature based grouping - Google Patents
A kind of concurrent message processing method of feature based grouping Download PDFInfo
- Publication number
- CN108572877A CN108572877A CN201810441011.1A CN201810441011A CN108572877A CN 108572877 A CN108572877 A CN 108572877A CN 201810441011 A CN201810441011 A CN 201810441011A CN 108572877 A CN108572877 A CN 108572877A
- Authority
- CN
- China
- Prior art keywords
- message
- processing
- retries
- marketing
- mistake
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 15
- 238000012545 processing Methods 0.000 claims abstract description 36
- 238000000034 method Methods 0.000 claims abstract description 6
- 230000007613 environmental effect Effects 0.000 claims description 9
- 238000012795 verification Methods 0.000 claims description 6
- 238000004458 analytical method Methods 0.000 claims description 3
- 239000000284 extract Substances 0.000 claims description 3
- 230000008569 process Effects 0.000 claims description 3
- 238000012958 reprocessing Methods 0.000 claims description 3
- 230000000694 effects Effects 0.000 claims description 2
- 238000005457 optimization Methods 0.000 abstract description 2
- 238000009510 drug design Methods 0.000 abstract 1
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 230000002860 competitive effect Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0605—Supply or demand aggregation
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- Development Economics (AREA)
- General Business, Economics & Management (AREA)
- Strategic Management (AREA)
- Marketing (AREA)
- Economics (AREA)
- General Engineering & Computer Science (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The present invention relates to field of computer, disclose a kind of concurrent message processing method of feature based grouping, it is designed by optimization order, classification processing is carried out according to the characteristic information, type, improve Message Processing speed, and corresponding mistake is set for different messages and retries step, while ensureing that data are successfully processed publication, ensures the real effectiveness of message；By the message treatment method of rational design, there is higher autgmentability, the message receive, handle, issuing can be more, are not limited to shopping, commercial matters information, it is only necessary to match corresponding the characteristic information and processing method.
Description
Technical field
The present invention relates to field of computer, especially a kind of concurrent message processing method of feature based grouping.
Background technology
It is increasingly competitive in the product of e-commerce field, it is also more and more in the software systems of utilization, for not
With the software between business nature, strong solution coupling, weak rigidity are required at the beginning of design, this is to the data transfer between software systems
Bring certain complexity and uncertain factor.Way for the most of companies of solution of problems is at artificial investigation
Reason, simple investigates from daily record mass data, this is greatly to spend human and material resources people's steak of resource to look into mode, even if row
It finds problem out, can not also handle at once, specific script is needed to execute.
Invention content
The purpose of the present invention is to provide a kind of concurrent message processing methods of feature based grouping, and grouping point may be implemented
Hair, efficient, more message are concurrent, mistake repeatedly retries and manual intervention error message mechanism.
To realize above-mentioned technical purpose and the technique effect, the invention discloses a kind of feature based grouping and
Sending message processing method includes following steps：
Message sink：Message is received by socket long connections or api interface, wherein it includes order messages, TMC battalion to receive message
Sell message, user applies for task message；
Message is grouped：Setting message needs the attribute field being grouped and its queued name；
Message verifies：Verification message state, and untreated, reprocessing message is included into queue, other status messages are skipped
Verification；
Distribution distribution：Message uses multichannel asynchronous queue, is sent to according to packet parameters different in different messages different
In the asynchronous queue of channel；
Message Processing：It is handled according to type of message, the processing for order messages includes parsing message content, extracts order
The message content of information, Bidder Information, and database is preserved, the processing for TMC marketing messages includes parsing message content, is carried
Take marketing nodal information, marketing effectiveness data, billing data of marketing message content, and update the data library, for marketing analysis,
Bill is analyzed, and is applied for that the processing of task message is parsing message content for user, is handled according to application content；
News release：Treated message is issued by news release component.
Wherein, message packet parameters include environmental parameter, Taobao's shop title and type of message in message grouping.
Wherein, packet parameters specifically include：
Environmental parameter：Expected processing time, the message complexity of message are grouped message according to environmental parameter, for a long time
CPU type message enter high configuration packet queue, I/O type message enters hyperdisk packet queue；
Taobao's shop title：Shop is grouped in advance, balanced grouping is carried out according to size of message；
Type of message：Order messages enter order processing flow queue, and TMC marketing messages carry out marketing process flow queue, appoint
Business message enters task processing queue.
Preferably, further include that Message Processing mistake retries step, Message Processing mistake retries step according to messaging service class
Its wrong number of retries of type and function setting.
Wherein, Message Processing mistake retries in step, 5 is set as order class message mistake number of retries, for TMC
Marketing effectiveness data-message mistake number of retries in marketing message is set as 3, marketing billing data message mistake number of retries
It is set as 0.
Wherein, Message Processing mistake retries in step, for being more than number of retries still failure news, carries out manual intervention
It handles again.
The invention has the advantages that：
1. the present invention is designed by optimization order, classification processing is carried out according to the characteristic information, type, improves Message Processing speed,
And corresponding mistake is set for different messages and retries step, while ensureing that data are successfully processed publication, ensures message
Real effectiveness.
2. by the message treatment method rationally designed, there is higher autgmentability, the message receive, handle, issuing
Can be more, it is not limited to shopping, commercial matters information, it is only necessary to match corresponding the characteristic information and processing method.
Description of the drawings
Fig. 1 is the flow diagram of the present invention.
Specific implementation mode
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to embodiments, to the present invention
It is further elaborated.
Embodiment 1
Include following steps as shown in Figure 1, the invention discloses a kind of concurrent message processing method of feature based grouping：
Message sink：Message is received by socket long connections or api interface, wherein it includes order messages, TMC battalion to receive message
Sell message, user applies for task message；
Message is grouped：Setting message needs the attribute field being grouped and its queued name；
Message verifies：Verification message state, and untreated, reprocessing message is included into queue, other status messages are skipped
Verification；
Distribution distribution：Message uses multichannel asynchronous queue, is sent to according to packet parameters different in different messages different
In the asynchronous queue of channel；
Message Processing：It is handled according to type of message, the processing for order messages includes parsing message content, extracts order
The message content of information, Bidder Information, and database is preserved, the processing for TMC marketing messages includes parsing message content, is carried
Take marketing nodal information, marketing effectiveness data, billing data of marketing message content, and update the data library, for marketing analysis,
Bill is analyzed, and is applied for that the processing of task message is parsing message content for user, is handled according to application content；
News release：Treated message is issued by news release component.
Message packet parameters include environmental parameter, Taobao's shop title and type of message in message grouping, are specifically included：
Environmental parameter：Expected processing time, the message complexity of message are grouped message according to environmental parameter, for a long time
CPU type message enter high configuration packet queue, I/O type message enters hyperdisk packet queue；
Taobao's shop title：Shop is grouped in advance, balanced grouping is carried out according to size of message；
Type of message：Order messages enter order processing flow queue, and TMC marketing messages carry out marketing process flow queue, appoint
Business message enters task processing queue.
When Message Processing fails, carries out Message Processing mistake and retry step, according to message traffic type and function setting
Its wrong number of retries, wherein Message Processing mistake retries in step, and 5 are set as order class message mistake number of retries,
3, marketing billing data message mistake weight is set as the marketing effectiveness data-message mistake number of retries in TMC marketing messages
Examination number is set as 0, and for being more than number of retries still failure news, carries out manual intervention and handle again.
The reason of wherein marketing billing data message mistake number of retries is set as 0 is, repeatedly retransmits marketing account
Forms data may cause bill inaccurate, cause bill to calculate difficult.
The foregoing is only a preferred embodiment of the present invention, but scope of protection of the present invention is not limited thereto,
Any one skilled in the art in the technical scope disclosed by the present invention, the change or replacement that can be readily occurred in,
It should be covered by the protection scope of the present invention.
Claims (6)
1. a kind of concurrent message processing method of feature based grouping, which is characterized in that include following steps：
Message sink：Message is received by socket long connections or api interface, wherein it includes order messages, TMC battalion to receive message
Sell message, user applies for task message；
Message is grouped：Setting message needs the attribute field being grouped and its queued name；
Message verifies：Verification message state, and untreated, reprocessing message is included into queue, other status messages are skipped
Verification；
Distribution distribution：Message uses multichannel asynchronous queue, is sent to according to packet parameters different in different messages different
In the asynchronous queue of channel；
Message Processing：It is handled according to type of message, the processing for order messages includes parsing message content, extracts order
The message content of information, Bidder Information, and database is preserved, the processing for TMC marketing messages includes parsing message content, is carried
Take marketing nodal information, marketing effectiveness data, billing data of marketing message content, and update the data library, for marketing analysis,
Bill is analyzed, and is applied for that the processing of task message is parsing message content for user, is handled according to application content；
News release：Treated message is issued by news release component.
2. a kind of concurrent message processing method of feature based grouping as described in claim 1, it is characterised in that：Described disappears
Message packet parameters include environmental parameter, Taobao's shop title and type of message in breath grouping.
3. a kind of concurrent message processing method of feature based grouping as claimed in claim 2, it is characterised in that：Described disappears
Breath packet parameters specifically include：
Environmental parameter：Expected processing time, the message complexity of message are grouped message according to environmental parameter, for a long time
CPU type message enter high configuration packet queue, I/O type message enters hyperdisk packet queue；
Taobao's shop title：Shop is grouped in advance, balanced grouping is carried out according to size of message；
Type of message：Order messages enter order processing flow queue, and TMC marketing messages carry out marketing process flow queue, appoint
Business message enters task processing queue.
4. a kind of concurrent message processing method of feature based grouping as claimed in claim 3, it is characterised in that：Further include disappearing
Breath processing mistake retries step, and the Message Processing mistake retries step according to message traffic type and function setting its mistake
Number of retries.
5. a kind of concurrent message processing method of feature based grouping as claimed in claim 4, it is characterised in that：Described disappears
Breath processing mistake retries in step, 5 is set as order class message mistake number of retries, for the battalion in TMC marketing messages
Pin effect data message mistake number of retries is set as 3, marketing billing data message mistake number of retries and is set as 0.
6. a kind of concurrent message processing method of feature based grouping as claimed in claim 5, it is characterised in that：Described disappears
Breath processing mistake retries in step, for being more than number of retries still failure news, carries out manual intervention and handles again.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810441011.1A CN108572877A (en) | 2018-05-10 | 2018-05-10 | A kind of concurrent message processing method of feature based grouping |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810441011.1A CN108572877A (en) | 2018-05-10 | 2018-05-10 | A kind of concurrent message processing method of feature based grouping |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108572877A true CN108572877A (en) | 2018-09-25 |
Family
ID=63572486
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810441011.1A Pending CN108572877A (en) | 2018-05-10 | 2018-05-10 | A kind of concurrent message processing method of feature based grouping |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108572877A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110258638A1 (en) * | 2010-04-20 | 2011-10-20 | Davies Paul J | Distributed processing of binary objects via message queues including a failover safeguard |
| CN102685236A (en) * | 2012-05-15 | 2012-09-19 | 苏州阔地网络科技有限公司 | Message processing method and system |
| CN102685235A (en) * | 2012-05-15 | 2012-09-19 | 苏州阔地网络科技有限公司 | Message dispatching method and system |
| CN105701257A (en) * | 2016-03-31 | 2016-06-22 | 北京奇虎科技有限公司 | Data processing method and device |
| CN107153527A (en) * | 2017-05-17 | 2017-09-12 | 北京环境特性研究所 | A kind of parallel radar data processing method based on message queue |
| CN107231294A (en) * | 2017-05-24 | 2017-10-03 | 北京潘达互娱科技有限公司 | Message treatment method and device |
| CN107332787A (en) * | 2017-06-29 | 2017-11-07 | 北京奇艺世纪科技有限公司 | A kind of message distributing method and device |
-
2018
- 2018-05-10 CN CN201810441011.1A patent/CN108572877A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110258638A1 (en) * | 2010-04-20 | 2011-10-20 | Davies Paul J | Distributed processing of binary objects via message queues including a failover safeguard |
| CN102685236A (en) * | 2012-05-15 | 2012-09-19 | 苏州阔地网络科技有限公司 | Message processing method and system |
| CN102685235A (en) * | 2012-05-15 | 2012-09-19 | 苏州阔地网络科技有限公司 | Message dispatching method and system |
| CN105701257A (en) * | 2016-03-31 | 2016-06-22 | 北京奇虎科技有限公司 | Data processing method and device |
| CN107153527A (en) * | 2017-05-17 | 2017-09-12 | 北京环境特性研究所 | A kind of parallel radar data processing method based on message queue |
| CN107231294A (en) * | 2017-05-24 | 2017-10-03 | 北京潘达互娱科技有限公司 | Message treatment method and device |
| CN107332787A (en) * | 2017-06-29 | 2017-11-07 | 北京奇艺世纪科技有限公司 | A kind of message distributing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10452843B2 (en) | Self-adaptive application programming interface level security monitoring | |
| CN108462758B (en) | Bank-enterprise direct connection communication method, device, equipment and computer readable storage medium | |
| US10956596B2 (en) | System and method for automatically securing sensitive data in public cloud using a serverless architecture | |
| JP4988766B2 (en) | Message hub device, program, and method | |
| WO2020238677A1 (en) | Data processing method and apparatus, and computer readable storage medium | |
| US20170075790A1 (en) | Integrating quality analysis with a code review tool | |
| US20200412675A1 (en) | Network based data traffic latency reduction | |
| CN110298662B (en) | Automatic detection method and device for transaction repeated submission | |
| CN110719215B (en) | Flow information acquisition method and device of virtual network | |
| US20210136121A1 (en) | System and method for creation and implementation of data processing workflows using a distributed computational graph | |
| WO2020155508A1 (en) | Suspicious user screening method and apparatus, computer device and storage medium | |
| US20110060789A1 (en) | File transfer security system and method | |
| CN103269384A (en) | Rich client abnormality processing method, processing device and processing system | |
| US10775751B2 (en) | Automatic generation of regular expression based on log line data | |
| CN107229656A (en) | Full dose data export method, apparatus and system | |
| CN110795305A (en) | System, apparatus and method for processing and managing WEB traffic data | |
| CN110737645B (en) | Data migration method and system among different systems and related equipment | |
| CN112286815A (en) | Interface test script generation method and related equipment thereof | |
| US20190104139A1 (en) | Generation of malware traffic signatures using natural language processing by a neural network | |
| EP3553689B1 (en) | System and method for automatically securing sensitive data in public cloud using a serverless architecture | |
| CN103399968A (en) | Microblog information acquisition method and microblog information acquisition system | |
| CN115426299B (en) | Method and device for identifying characteristic-free data, computer equipment and storage medium | |
| CN108572877A (en) | A kind of concurrent message processing method of feature based grouping | |
| WO2022111209A1 (en) | Data acquisition method and apparatus, data acquisition device and readable storage medium | |
| US11582326B1 (en) | Scalable messaging framework for providing machine learning services across multiple availability zones |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| CB02 | Change of applicant information |
Address after: 361101 1-3F, Zone D, innovation building, software park, Xiamen Torch High tech Zone, Xiamen City, Fujian Province Applicant after: Xiamen Nanxun Co.,Ltd. Address before: 361008 Fujian province Xiamen software park two sunrise Road No. 22 unit 401 Applicant before: XIAMEN NASCENT SOFTWARE TECHNOLOGY CO.,LTD. |
|
| CB02 | Change of applicant information | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180925 |
|
| RJ01 | Rejection of invention patent application after publication |