CN105989065A - Flash shot data processing method and system - Google Patents
Flash shot data processing method and system Download PDFInfo
- Publication number
- CN105989065A CN105989065A CN201510067871.XA CN201510067871A CN105989065A CN 105989065 A CN105989065 A CN 105989065A CN 201510067871 A CN201510067871 A CN 201510067871A CN 105989065 A CN105989065 A CN 105989065A
- Authority
- CN
- China
- Prior art keywords
- data
- server
- user
- push server
- redis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a flash shot data processing method which comprises the following steps: S101, calling user requested data from a database by a middle-ground server according to a received user flash shot data request, and transmitting to a Redis push server; S102, pushing the user requested data to a push server by the Redis push server; S103, transmitting the user requested data to a user by a push server. The invention further discloses a flash shot data processing system which comprises a middle-ground server, a Redis push server and a push server. By adopting the flash shot data processing and the flash shot data processing system, a server can operate stably in flash shooting, moreover the hardware cost is low, and the utilization rate of the whole system is high.
Description
Technical field
The present invention relates to communication technical field, dodge beat of data processing method and system it particularly relates to a kind of.
Background technology
Along with the development of ecommerce, various net purchase forms emerge in an endless stream.Wherein, a kind of once release, the extensive concern of user is just received with " dodge clap " shopping mode of price auction in the short time.Dodging the Main Patterns clapped is: the commodity that advance notice timing in advance is attended to auction, and during to the scheduled time, has net purchase buyer to bid and buys.Therefore, at short notice, the visit capacity of server is huge, and server will undertake immense pressure.Therefore, how to ensure stablizing of server, have become as an important technological problems.Prior art is for solving this problem, and the method generally used is by putting into hardware cost, increases disposal ability.But on the one hand, the method needs cost to put into, on the other hand, dodges to clap and only produces huge visit capacity when fixed point, and at ordinary times, and visit capacity is stable and limited, and therefore, by hardware increase disposal ability, utilization rate (benefit cost ratio) is relatively low.
Summary of the invention
Technical problem:The technical problem to be solved is: providing one to dodge beat of data processing method and system, the method and system ensure that when carrying out dodging bat activity, stable operation, the utilization rate of whole system is high.
Technical scheme:For solving above-mentioned technical problem, the technical solution used in the present invention is:
A kind of sudden strain of a muscle beat of data processing method, this processing method comprises the following steps:
In S101, station server dodges beat of data request, calling and obtaining user demand data from data base according to the user received, and is sent to Redis push server;
S102 Redis push server by user's request data-pushing to push server;
User's request data are sent to user by S103 push server.
Further, described sudden strain of a muscle beat of data processing method, also include
The request of sudden strain of a muscle beat of data is sent to Front End Server by browser by S1001;
The sudden strain of a muscle beat of data of reception is asked to merge by S1002 Front End Server, is sent to middle station server.
Further, the process of described step S103 is: user's request data are sent to browser by push server, and the user's request data display that browser is obtained is to user.
A kind of dodging beat of data processing system, this system includes middle station server, Redis push server and push server, wherein,
Middle station server, for dodging beat of data request, calling and obtaining user demand data from data base according to the user received, and is sent to Redis push server;
Redis push server, the user's request data that station server sends in receiving, and by user's request data-pushing to push server;
User's request data for receiving the user's request data that Redis push server pushes, and are sent to user by push server.
Further, described sudden strain of a muscle beat of data processing system, it is characterised in that also include:
Front End Server, the sudden strain of a muscle beat of data sent by browser for receiving user is asked and is merged, and is sent to middle station server.
Further, described Front End Server includes combining unit and the first transmitting element,
Combining unit, for receiving the sudden strain of a muscle beat of data request that user sends, and merges the request of sudden strain of a muscle beat of data, is sent to the first transmitting element;
First transmitting element, the sudden strain of a muscle beat of data request after merging disposably is sent to middle station server.
Further, described middle station server includes search unit and the second transmitting element,
Search unit, for the sudden strain of a muscle beat of data request sent according to the first transmitting element, searches the data corresponding with dodging beat of data request from data base, and is sent to the second transmitting element;
Second transmitting element, for the data searched by search unit, is disposably sent to Redis push server.
Further, described Redis push server includes signal generating unit and the 3rd transmitting element,
Signal generating unit, for receiving the data that the second transmitting element sends, and by data genaration message, is sent to the 3rd transmitting element;
3rd transmitting element, for being sent to push server by message.
Further, described sudden strain of a muscle beat of data processing system, also include:
Redis master server, for dodging the caching clapping main system;
Background server, safeguards dodging bat management system for operation personnel;
Terracotta server, is used for Row control, the JOB round dodging in bat activity, and distributed thread pond is arranged.
Beneficial effect:The present invention arranges Redis push server and push server, utilizes Redis push server by user's request data active push to push server, then by push server, user's request data are sent to user.So, user avoids the need for reading sudden strain of a muscle beat of data in Redis push server every time, brings huge operating pressure to Redis push server.The present invention, by increasing push server, by there is data interaction between push server and browser, alleviates the access pressure of Redis push server significantly.Whole system stable operation.Meanwhile, in dodging bat activity, only there is substantial amounts of data access in server within the set time, and usually, visit capacity is little, and the pressure of server is little.The present invention does not alleviate server access pressure only by increase hardware mode, but by arranging push server, improves the request disposal ability of system.The utilization rate of whole system is high.
Accompanying drawing explanation
Fig. 1 is the FB(flow block) of the embodiment of the present invention 1.
Fig. 2 is the FB(flow block) of the embodiment of the present invention 2.
Fig. 3 is a kind of network topological diagram of the embodiment of the present invention 3.
Fig. 4 is the another kind of network topological diagram of the embodiment of the present invention 3.
Fig. 5 is a kind of structured flowchart of the embodiment of the present invention 3.
Detailed description of the invention
Below in conjunction with the accompanying drawings and embodiment, technical scheme is described in detail.
Embodiment 1
Dodge beat of data processing method as it is shown in figure 1, a kind of, comprise the following steps:
In S101, station server dodges beat of data request, calling and obtaining user demand data from data base according to the user received, and is sent to Redis push server;
S102 Redis push server by user's request data-pushing to push server;
User's request data are sent to user by S103 push server.
In existing sudden strain of a muscle bat activity, when there is a need to the sudden strain of a muscle beat of data pushed, then directly sudden strain of a muscle beat of data being put in Redis push server, WEB pushes poll when, in Redis push server, reading sudden strain of a muscle beat of data every time.This can produce substantial amounts of LAN input and output IO, and the pressure of Redis push server is huge, Redis push server fluctuation of service.Redis be one increase income, support network, can based on internal memory also can the storage data base of persistence, support numerous types of data, there is the strongest data management function.In dodging bat activity, needing the data volume pushed the least in Redis push server, total amount of data may be less than 30M.Simultaneously in network flash bat activity, at short notice, the visit capacity of server is huge, and only produces huge visit capacity within the fixed point time, and at ordinary times, visit capacity is stably limited.The method of the present embodiment, by arranging Redis push server and push server, utilizes Redis push server by user's request data active push to push server, then by push server, user's request data is sent to user.So, user avoids the need for reading sudden strain of a muscle beat of data in Redis push server every time.The present invention uses Redis publish/subscribe and buffering instrument that JCS(JCS is a kind of combined type, target buffer to internal memory, hard disk can be had the expired setting of buffer object time.The distributed architecture with buffering can also be built by JCS, to realize high performance application) method of local cache, when there is a need to the sudden strain of a muscle beat of data pushed, Redis push server is by sudden strain of a muscle beat of data active push to be pushed to push server, by data interaction occurs between push server and browser, it is provided that dodge beat of data to user.
In push server, JCS local cache is used to process the functions such as caching expired, life cycle algorithm, Cache Statistics.Redis push server is by sudden strain of a muscle beat of data active push to be pushed to the JCS local cache of push server.The JCS local cache of push server stores the sudden strain of a muscle beat of data that Redis push server pushes.
In the above-mentioned methods, request of data be dodge user in bat activity it should be understood that sudden strain of a muscle clap information, including present price, server time, historical price, guarantee fund freeze in number, auction round, acceptance of the bid promptings, goods to auction attribute, hot list of getting the bid, popularity list any one or combine.
Described step S101 also includes: middle station server utilize MySQL(correspondence Chinese: Relational DBMS) server will dodge clap during produce data be saved permanently to hard disk.
As preferably, the process of described step S103 is: user's request data are sent to browser by push server, and the user's request data display that browser is obtained is to user.Short polling mode is used to carry out data interaction between push server and browser.So, user avoids the need for reading sudden strain of a muscle beat of data in Redis push server every time.The present embodiment, by user's request data are sent to push server by Redis push server, by using short polling mode to carry out data interaction between push server and browser, provides a user with demand data.This is avoided user and is directly read the pressure dodging beat of data and bring server by browser in Redis push server.
As preferably, in described step S101, middle station server real-time update is positioned at the database information in middle station server.Dodging the information in bat activity, such as present price, historical price, guarantee fund freeze number etc., change constantly.For ensureing to dodge in bat activity, user can obtain real time information, middle station server needs the database information that real-time update is positioned in middle station server, up-to-date information passes to Redis push server, is more actively promoted to push server by Redis push server.
In existing sudden strain of a muscle bat activity, when there is a need to the sudden strain of a muscle beat of data pushed, then directly putting in Redis push server by sudden strain of a muscle beat of data, WEB pushes poll when, browser reads sudden strain of a muscle beat of data in Redis push server every time.So, the pressure of Redis push server is huge, Redis push server fluctuation of service.The present invention, by arranging push server, utilizes Redis push server by user's request data active push to push server, then by push server, user's request data is sent to user.So, user avoids the need for reading sudden strain of a muscle beat of data in Redis push server every time, brings huge pressure to Redis push server.The present invention uses Redis publish/subscribe and the method for JCS local cache, when there is a need to the sudden strain of a muscle beat of data pushed, Redis push server is by sudden strain of a muscle beat of data active push to be pushed to push server, by data interaction occurs between push server and browser, it is provided that dodge beat of data to user.During whole, server stable operation.Meanwhile, the method using the present invention, it is not necessary to put into too much hardware, to alleviate the pressure of server.
Embodiment 2
Dodge beat of data processing method as in figure 2 it is shown, a kind of, comprise the following steps:
The request of sudden strain of a muscle beat of data is sent to Front End Server by browser by S1001;
The sudden strain of a muscle beat of data of reception is asked to merge by S1002 Front End Server, is sent to middle station server;
In S101, station server dodges beat of data request, calling and obtaining user demand data from data base according to the user received, and is sent to Redis push server;
S102 Redis push server by user's request data-pushing to push server;
User's request data are sent to user by S103 push server.
The present embodiment 2 part same as in Example 1 is, by arranging Redis push server and push server, utilize Redis push server by user's request data active push to push server, then by push server, user's request data are sent to user.So, user avoids the need for reading sudden strain of a muscle beat of data in Redis push server every time.The present embodiment 2 difference from Example 1 is, in the present embodiment 2, and Front End Server, the user data requests received, carry out merging treatment, unification is sent to middle station server.
After middle station server receives the request after merging, search from data base respectively with merge after the corresponding data of each request of data, and all data are disposably sent to Redis push server.The data genaration message that Redis push server is received, issues push server.Message is fed back to all browsers sending request by push server, shows user.So, each user can obtain oneself required data.
In existing sudden strain of a muscle bat activity, when there is a need to the sudden strain of a muscle beat of data pushed, then directly putting in Redis push server by sudden strain of a muscle beat of data, WEB pushes poll when, browser reads sudden strain of a muscle beat of data in Redis push server every time.In the present embodiment, user can be asked to merge by Front End Server, it is sent to middle station server, by middle station server, each user's request data are disposably sent to Redis push server, then desired data in the request after being merged by Redis push server, generate message, issue push server, push server message is returned the browser page of all transmission requests.So convenient extension, reduces network I/O, substantially increases data-handling efficiency.
The request of each user is separate.If carrying out search and the transmission of data respectively, time cost certainly will be increased.The present embodiment, by request of data being merged, finally by data genaration message, is disposably sent to user, substantially increases data transmission efficiency.
Embodiment 3
Beat of data processing system is dodged as it is shown on figure 3, a kind of, including middle station server, Redis push server and push server,
Middle station server, for dodging beat of data request, calling and obtaining user demand data from data base according to the user received, and is sent to Redis push server;
Redis push server, the user's request data that station server sends in receiving, and by user's request data-pushing to push server;
User's request data for receiving the user's request data that Redis push server pushes, and are sent to user by push server.
In existing sudden strain of a muscle shooting system, when there is a need to the sudden strain of a muscle beat of data pushed, then directly sudden strain of a muscle beat of data being put in Redis push server, WEB pushes poll when, in Redis push server, reading sudden strain of a muscle beat of data every time.This can produce substantial amounts of LAN input and output IO, and the pressure of Redis push server is huge, Redis push server fluctuation of service.In dodging bat activity, needing the data volume pushed the least in Redis push server, total amount of data may be less than 30M.The system of the present invention, by arranging middle station server, Redis push server and push server, utilizes Redis push server by user's request data active push to push server, then by push server, user's request data is sent to user.So, user avoids the need for reading sudden strain of a muscle beat of data in Redis push server every time.
In push server, JCS local cache is used to process the functions such as caching expired, life cycle algorithm, Cache Statistics.Redis push server is by sudden strain of a muscle beat of data active push to be pushed to the JCS local cache of push server.The JCS local cache of push server stores the sudden strain of a muscle beat of data that Redis push server actively sends.Issuing when, issue (publish) function in Redis push server is responsible for being pushed in Redis push server sudden strain of a muscle beat of data, Redis push server again by data active push to push server.SET module in Redis push server, is responsible in data persistence to Redis push server.When push server is restarted when, data can be reacquired from Redis push server, and then realize data recovery.
The publish/subscribe (pub/sub) of Redis server uses sentinel technology to achieve failover control.Sentinel technology can be when breaking down, it is achieved master-slave swap.The present invention is provided with 2 Redis servers, respectively Redis push server and Redis master server.When a wherein Redis server is delayed machine, and system can subscribe on another Redis server automatically.Although sentinel technology is prior art, but the present invention is used in sudden strain of a muscle bat activity and is belonged to first.Use sentinel technology, it is ensured that in dodging bat activity, when a Redis server fail, another Redis server potentially acts as Redis push server, beat of data active push will be dodged in time to push server.
As preferably, when middle station server calls Redis push server, use the mechanism of linear communication Pipeline(Redis instruction batch processing) mode, realize issuing when, set instruction and the merging of publish instruction, disposably it is transferred in Redis push server, reduces the number of times established the link, improve efficiency of transmission.
Subscribing to when, it is serial (i.e. using regular expressions to subscribe to channel) owing to subscribing to passage.Therefore, the JBOSS of subscription have employed 3 passages, respectively present price passage, auction round passage and other service channels.So ensure core business (referring to present price and auction round) operating smoothness.Simultaneously when subscribing to data arrival when, business logic processing can be put in the middle of the thread pool being positioned in push server.That is: the master pattern of NIO.3 threads are responsible for receiving data, and 32 threads are responsible for processing service logic.Front End Server, middle station server, background server, push server and Fair services device all have employed JBOSS application server.JCS local cache is arranged in JBOSS.
Push server can use independent domain name, to distinguish the domain name of main system.So can reduce the interference of cookie, only be suitable for CDN(correspondence English: Content Delivery Network, corresponding Chinese: i.e. content distributing network) acceleration mechanism, inapplicable CDN caches.English by the JSONP(correspondence of push server: JSON with Padding) cross-domain request obtains data.JSON(correspondence is English: JavaScript
Object Notation, is the data interchange format of a kind of lightweight) message makes every effort to simplify, and in the case of more than one hundred million visit capacities, field name uses a letter, irredundant useless field.Push server possesses the mechanism preventing JOB superposition from performing simultaneously.If one time poll has exceeded 1 second, then secondary poll will be abandoned automatically, directly arrive last end of polling(EOP).So can well adaptation network environment.Push server is furnished with global counter simultaneously, by the way of delivery, decides whether request message, it may be assumed that on-demand request, effectively reduces server operation.
As shown in Figure 4, described sudden strain of a muscle beat of data processing system, also include Front End Server, the sudden strain of a muscle beat of data sent by browser for receiving user is asked and is merged, and is sent to middle station server.Front End Server shows WEB page, uses to Internet user, calls for middle station server.
User is asked to merge by Front End Server, it is sent to middle station server, by middle station server, each user's request data are disposably sent to Redis push server, desired data in request after being merged by Redis push server, generate message, issue push server, push server message is returned the browser page of all transmission requests.So convenient extension, reduces network input and output IO.Meanwhile, this method can be used in big sale platform.
As shown in Figure 4, described sudden strain of a muscle beat of data processing system, also include MySQL server, the data produced during dodging bat are saved permanently to hard disk.MySQL server ensure that dodging the various data produced in bat activity will not lose, and at other server fail or when restarting, still is able to obtain data by hard disk.
As shown in Figure 4, described sudden strain of a muscle beat of data processing system, also include Redis master server, for dodging the caching clapping main system;Background server, safeguards, for operation personnel's routine use and system journal, abnormality processing dodging bat management system for operation personnel;The famous Java cluster platform of increasing income that Terracotta(Terracotta is developed by Terracotta company of the U.S.) server, it is used for Row control, the JOB round dodging in bat activity, distributed thread pond is arranged.Such as, Terracotta server, for Distributed Job Scheduling, User Activity is rejected, and movable registration terminates, and goods to auction are rejected, and generates auction order, it is ensured that gold exceeds the time limit the business such as fine and confiscation.Described sudden strain of a muscle beat of data processing system, it is also possible to include Fair services device, for dodging the data in beat of data storehouse to MySQL server synchronized update.
Middle station server carries out the additions and deletions of data and looks into and change operation MySQL server.Background server carries out the additions and deletions of data and looks into and change operation MySQL server.Middle station server carries out the execution of Distributed Job Scheduling to Terracotta server.Background server carries out the additions and deletions of Distributed Job Scheduling and looks into and change Terracotta server.
Beat of data efficiency of transmission is dodged, as it is shown in figure 5, in described sudden strain of a muscle beat of data processing system, Front End Server includes combining unit and the first transmitting element for improving.Combining unit, for receiving the sudden strain of a muscle beat of data request that user sends, and merges the request of sudden strain of a muscle beat of data, is sent to the first transmitting element.First transmitting element, the sudden strain of a muscle beat of data request after merging disposably is sent to middle station server.Middle station server includes search unit and the second transmitting element.Search unit, for the sudden strain of a muscle beat of data request sent according to the first transmitting element, searches the data corresponding with dodging beat of data request from data base, and is sent to the second transmitting element.Second transmitting element, for the data searched by search unit, is disposably sent to Redis push server.Redis push server includes signal generating unit and the 3rd transmitting element.Signal generating unit, for receiving the data that the second transmitting element sends, and by data genaration message, is sent to the 3rd transmitting element.3rd transmitting element, for being sent to push server by message.
Front End Server is provided with combining unit.The user data requests that combining unit is received, has carried out merging treatment, and the user data requests unification after then being merged by the first transmitting element is sent to middle station server.After in middle station server, search unit receives the request of data after merging, search from data base with merge after the corresponding data of each request of data, and all data passed through the second transmitting element be disposably sent to Redis push server.The data genaration message that signal generating unit in Redis push server is received, is sent to push server by the 3rd transmitting element.Message is fed back to all browsers sending request by push server, shows user.So, in a certain amount of time, the request of data that user sends, after the combining unit of Front End Server merges, middle station server carry out data process, Redis push server generate message, be sent to push server.In the process, the process that data process is to synchronize, and sending also is to synchronize.This avoids single request, individually scans for, more individually sends the poor efficiency that the data brought process.
The user's request data display that push server is obtained by browser is to user.Short polling mode is used to carry out data interaction between push server and browser.So, user avoids the need for reading sudden strain of a muscle beat of data in Redis push server every time.The present invention, by user's request data are sent to push server by Redis push server, by using short polling mode to carry out data interaction between push server and browser, provides a user with demand data.This is avoided user and is directly read the pressure dodging beat of data and bring server by browser in Redis push server.
Middle station server, is additionally operable to the database information that real-time update is positioned in middle station server.Dodging the information in bat activity, such as present price, historical price, guarantee fund freeze number etc., change constantly.For ensureing to dodge in bat activity, user can obtain real time information, middle station server needs the database information that real-time update is positioned in middle station server, up-to-date information passes to Redis push server, is more actively promoted to push server by Redis push server.Above-mentioned information is in push server, and only server time is that JBOSS is local is accessing time point generation.Use NTP(Network Time Protocol, NTP) the sync server time.Other information, both from the publish/subscribe pattern of Redis.
In said system, request of data be dodge user in bat activity it should be understood that sudden strain of a muscle clap information, including present price, server time, historical price, guarantee fund freeze in number, auction round, acceptance of the bid promptings, goods to auction attribute, hot list of getting the bid, popularity list any one or combine.
Prior art, by putting into hardware cost, increases the disposal ability of server.Owing to, in dodging bat activity, only there is substantial amounts of data access in server within the set time, and usually, visit capacity is little, and the pressure of server is little.So, being put into by hardware, alleviate the pressure of server, utilization rate is low.The present invention uses Redis publish/subscribe+JCS local cache, by Redis server active push more new data to push server, interacts between browser and server by the way of short poll meanwhile.By in the unified JCS pushing data into push server JBOSS of the publish/subscribe function of Redis push server.Therefore, the request disposal ability of server system is greatly improved.Meanwhile, the method using the present invention is limited on hardware puts into, but well solves in sudden strain of a muscle bat activity, the huge access pressure that server faces.The utilization rate of whole system is high.
Those skilled in the art should know, it is achieved the method for above-described embodiment or system, can be realized by computer program instructions.This computer program instructions is loaded in programmable data processing device, such as computer, thus performs corresponding instruction in programmable data processing device, the function that the method or system for realizing above-described embodiment realizes.
Those skilled in the art, according to above-described embodiment, can carry out the technological improvement of non-creativeness, without deviating from the spirit of the present invention to the application.These improvement still should be regarded as within the application scope of the claims.
Claims (10)
1. one kind is dodged beat of data processing method, it is characterised in that this processing method comprises the following steps:
In S101, station server dodges beat of data request, calling and obtaining user demand data from data base according to the user received, and is sent to Redis push server;
S102 Redis push server by user's request data-pushing to push server;
User's request data are sent to user by S103 push server.
2. according to the sudden strain of a muscle beat of data processing method described in claim 1, it is characterised in that also include
The request of sudden strain of a muscle beat of data is sent to Front End Server by browser by S1001;
The sudden strain of a muscle beat of data of reception is asked to merge by S1002 Front End Server, is sent to middle station server.
3. according to the sudden strain of a muscle beat of data processing method described in claim 1 or 2, it is characterised in that the process of described step S103 is: user's request data are sent to browser by push server, and the user's request data display that browser is obtained is to user.
4. according to the sudden strain of a muscle beat of data processing method described in claim 1, it is characterized in that, dodge beat of data request include server time, present price, historical price, guarantee fund freeze in number, auction round, acceptance of the bid promptings, goods to auction attribute, hot list of getting the bid, popularity list any one or combine.
5. one kind is dodged beat of data processing system, it is characterised in that this system includes middle station server, Redis push server and push server, wherein,
Middle station server, for dodging beat of data request, calling and obtaining user demand data from data base according to the user received, and is sent to Redis push server;
Redis push server, the user's request data that station server sends in receiving, and by user's request data-pushing to push server;
User's request data for receiving the user's request data that Redis push server pushes, and are sent to user by push server.
6. according to the sudden strain of a muscle beat of data processing system described in claim 5, it is characterised in that also include:
Front End Server, the sudden strain of a muscle beat of data sent by browser for receiving user is asked and is merged, and is sent to middle station server.
7. according to the sudden strain of a muscle beat of data processing system described in claim 6, it is characterised in that described Front End Server includes combining unit and the first transmitting element,
Combining unit, for receiving the sudden strain of a muscle beat of data request that user sends, and merges the request of sudden strain of a muscle beat of data, is sent to the first transmitting element;
First transmitting element, the sudden strain of a muscle beat of data request after merging disposably is sent to middle station server.
8. according to the sudden strain of a muscle beat of data processing system described in claim 7, it is characterised in that described middle station server includes search unit and the second transmitting element,
Search unit, for the sudden strain of a muscle beat of data request sent according to the first transmitting element, searches the data corresponding with dodging beat of data request from data base, and is sent to the second transmitting element;
Second transmitting element, for the data searched by search unit, is disposably sent to Redis push server.
9. according to the sudden strain of a muscle beat of data processing method described in claim 8, it is characterised in that described Redis push server includes signal generating unit and the 3rd transmitting element,
Signal generating unit, for receiving the data that the second transmitting element sends, and by data genaration message, is sent to the 3rd transmitting element;
3rd transmitting element, for being sent to push server by message.
10. according to the sudden strain of a muscle beat of data processing system in any of the one of claim 5 to 9, it is characterised in that also include:
Redis master server, for dodging the caching clapping main system;
Background server, safeguards dodging bat management system for operation personnel;
Terracotta server, is used for Row control, the JOB round dodging in bat activity, and distributed thread pond is arranged.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510067871.XA CN105989065B (en) | 2015-02-09 | 2015-02-09 | Flash data processing method and system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510067871.XA CN105989065B (en) | 2015-02-09 | 2015-02-09 | Flash data processing method and system |
Publications (2)
Publication Number | Publication Date |
---|---|
CN105989065A true CN105989065A (en) | 2016-10-05 |
CN105989065B CN105989065B (en) | 2020-03-24 |
Family
ID=57041606
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510067871.XA Active CN105989065B (en) | 2015-02-09 | 2015-02-09 | Flash data processing method and system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105989065B (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107105064A (en) * | 2017-06-02 | 2017-08-29 | 上海艾融软件股份有限公司 | The method for pushing and system of a kind of Transaction Information |
CN107423132A (en) * | 2017-04-20 | 2017-12-01 | 山东开创云软件有限公司 | A kind of large-scale concurrent optimized treatment method for auction platform |
CN107578327A (en) * | 2017-08-17 | 2018-01-12 | 中国工商银行股份有限公司 | Method, equipment and the system that information pushes in a kind of link of bidding |
CN108733704A (en) * | 2017-04-20 | 2018-11-02 | 北京京东尚科信息技术有限公司 | Multiple database data processing method, device and storage medium and electronic equipment |
CN110971643A (en) * | 2018-09-30 | 2020-04-07 | 北京国双科技有限公司 | Message pushing method and device, storage medium and processor |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102223381A (en) * | 2011-07-07 | 2011-10-19 | 莫雅静 | Message pushing method, server, client terminal and system |
CN102571877A (en) * | 2010-12-31 | 2012-07-11 | 上海博泰悦臻电子设备制造有限公司 | Vehicle-mounted information synchronization service system and method |
CN103108002A (en) * | 2011-11-10 | 2013-05-15 | 阿里巴巴集团控股有限公司 | Method, system and device for data pushing |
CN103167017A (en) * | 2013-01-09 | 2013-06-19 | 北京奇虎科技有限公司 | Method, device and system for Web polling |
-
2015
- 2015-02-09 CN CN201510067871.XA patent/CN105989065B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102571877A (en) * | 2010-12-31 | 2012-07-11 | 上海博泰悦臻电子设备制造有限公司 | Vehicle-mounted information synchronization service system and method |
CN102223381A (en) * | 2011-07-07 | 2011-10-19 | 莫雅静 | Message pushing method, server, client terminal and system |
CN103108002A (en) * | 2011-11-10 | 2013-05-15 | 阿里巴巴集团控股有限公司 | Method, system and device for data pushing |
CN103167017A (en) * | 2013-01-09 | 2013-06-19 | 北京奇虎科技有限公司 | Method, device and system for Web polling |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107423132A (en) * | 2017-04-20 | 2017-12-01 | 山东开创云软件有限公司 | A kind of large-scale concurrent optimized treatment method for auction platform |
CN108733704A (en) * | 2017-04-20 | 2018-11-02 | 北京京东尚科信息技术有限公司 | Multiple database data processing method, device and storage medium and electronic equipment |
CN108733704B (en) * | 2017-04-20 | 2020-11-20 | 北京京东尚科信息技术有限公司 | Multi-database data processing method and device, storage medium and electronic equipment |
CN107105064A (en) * | 2017-06-02 | 2017-08-29 | 上海艾融软件股份有限公司 | The method for pushing and system of a kind of Transaction Information |
CN107578327A (en) * | 2017-08-17 | 2018-01-12 | 中国工商银行股份有限公司 | Method, equipment and the system that information pushes in a kind of link of bidding |
CN107578327B (en) * | 2017-08-17 | 2020-10-16 | 中国工商银行股份有限公司 | Method, device and system for information push in bidding link |
CN110971643A (en) * | 2018-09-30 | 2020-04-07 | 北京国双科技有限公司 | Message pushing method and device, storage medium and processor |
CN110971643B (en) * | 2018-09-30 | 2022-07-29 | 北京国双科技有限公司 | Message pushing method and device, storage medium and processor |
Also Published As
Publication number | Publication date |
---|---|
CN105989065B (en) | 2020-03-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11481657B2 (en) | Content recommendation method, apparatus and system | |
EP2834755B1 (en) | Platform for continuous graph update and computation | |
Brito et al. | Scalable and low-latency data processing with stream mapreduce | |
CN105989065A (en) | Flash shot data processing method and system | |
CN106919654A (en) | A kind of implementation method of the High Availabitity MySQL database based on Nginx | |
JP2016500454A (en) | System wide query optimization | |
Turk et al. | Temporal workload-aware replicated partitioning for social networks | |
Hsu et al. | Causal consistency algorithms for partially replicated and fully replicated systems | |
US8868525B2 (en) | Distributed information synchronization | |
Qian et al. | Adjusting matching algorithm to adapt to workload fluctuations in content-based publish/subscribe systems | |
CN104636395A (en) | Count processing method and device | |
Jin et al. | Cost-effective data placement in edge storage systems with erasure code | |
CN107562803B (en) | Data supply system and method and terminal | |
Xia et al. | A partial replication approach for anywhere anytime mobile commenting | |
Zhang et al. | Quegel: A general-purpose system for querying big graphs | |
EP2025133B1 (en) | Repository synchronization in a ranked repository cluster | |
CN109947736A (en) | The method and system calculated in real time | |
CN110196680A (en) | Data processing method, device and storage medium | |
Grewal et al. | {RecService}: Distributed {Real-Time} Graph Processing at Twitter | |
CN103577424B (en) | The realization method and system of distributed data base view | |
US11514030B2 (en) | Automated materialized view table generation and maintenance | |
CN108228644A (en) | For method and device derived from report | |
Qian et al. | Fat Topic: Improving Latency in Content-Based Publish/Subscribe Systems on Apache Kafka | |
CN105046564A (en) | Stock speculation social intercourse system | |
Qureshi et al. | IPC: Resource and network cost-aware distributed stream scheduling on skewed streams |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20210508 Address after: 210042 no.1-9 Suning Avenue, Xuanwu District, Nanjing City, Jiangsu Province (Jiangsu Province) Patentee after: NANJING SUNING ELECTRONIC INFORMATION TECHNOLOGY Co.,Ltd. Address before: No.1-1 Suning Avenue, Xuzhuang Software Park, Xuanwu District, Nanjing, Jiangsu Province, 210042 Patentee before: Suning Cloud Computing Co.,Ltd. |