CN105989065A - Flash shot data processing method and system - Google Patents

Flash shot data processing method and system Download PDF

Info

Publication number
CN105989065A
CN105989065A CN201510067871.XA CN201510067871A CN105989065A CN 105989065 A CN105989065 A CN 105989065A CN 201510067871 A CN201510067871 A CN 201510067871A CN 105989065 A CN105989065 A CN 105989065A
Authority
CN
China
Prior art keywords
data
server
user
push server
redis
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510067871.XA
Other languages
Chinese (zh)
Other versions
CN105989065B (en
Inventor
朴海林
杨杰
华静
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NANJING SUNING ELECTRONIC INFORMATION TECHNOLOGY Co.,Ltd.
Original Assignee
Suning Commerce Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suning Commerce Group Co Ltd filed Critical Suning Commerce Group Co Ltd
Priority to CN201510067871.XA priority Critical patent/CN105989065B/en
Publication of CN105989065A publication Critical patent/CN105989065A/en
Application granted granted Critical
Publication of CN105989065B publication Critical patent/CN105989065B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention discloses a flash shot data processing method which comprises the following steps: S101, calling user requested data from a database by a middle-ground server according to a received user flash shot data request, and transmitting to a Redis push server; S102, pushing the user requested data to a push server by the Redis push server; S103, transmitting the user requested data to a user by a push server. The invention further discloses a flash shot data processing system which comprises a middle-ground server, a Redis push server and a push server. By adopting the flash shot data processing and the flash shot data processing system, a server can operate stably in flash shooting, moreover the hardware cost is low, and the utilization rate of the whole system is high.

Description

A kind of sudden strain of a muscle beat of data processing method and system
Technical field
The present invention relates to communication technical field, dodge beat of data processing method and system it particularly relates to a kind of.
Background technology
Along with the development of ecommerce, various net purchase forms emerge in an endless stream.Wherein, a kind of once release, the extensive concern of user is just received with " dodge clap " shopping mode of price auction in the short time.Dodging the Main Patterns clapped is: the commodity that advance notice timing in advance is attended to auction, and during to the scheduled time, has net purchase buyer to bid and buys.Therefore, at short notice, the visit capacity of server is huge, and server will undertake immense pressure.Therefore, how to ensure stablizing of server, have become as an important technological problems.Prior art is for solving this problem, and the method generally used is by putting into hardware cost, increases disposal ability.But on the one hand, the method needs cost to put into, on the other hand, dodges to clap and only produces huge visit capacity when fixed point, and at ordinary times, and visit capacity is stable and limited, and therefore, by hardware increase disposal ability, utilization rate (benefit cost ratio) is relatively low.
Summary of the invention
Technical problem:The technical problem to be solved is: providing one to dodge beat of data processing method and system, the method and system ensure that when carrying out dodging bat activity, stable operation, the utilization rate of whole system is high.
Technical scheme:For solving above-mentioned technical problem, the technical solution used in the present invention is:
A kind of sudden strain of a muscle beat of data processing method, this processing method comprises the following steps:
In S101, station server dodges beat of data request, calling and obtaining user demand data from data base according to the user received, and is sent to Redis push server;
S102 Redis push server by user's request data-pushing to push server;
User's request data are sent to user by S103 push server.
Further, described sudden strain of a muscle beat of data processing method, also include
The request of sudden strain of a muscle beat of data is sent to Front End Server by browser by S1001;
The sudden strain of a muscle beat of data of reception is asked to merge by S1002 Front End Server, is sent to middle station server.
Further, the process of described step S103 is: user's request data are sent to browser by push server, and the user's request data display that browser is obtained is to user.
A kind of dodging beat of data processing system, this system includes middle station server, Redis push server and push server, wherein,
Middle station server, for dodging beat of data request, calling and obtaining user demand data from data base according to the user received, and is sent to Redis push server;
Redis push server, the user's request data that station server sends in receiving, and by user's request data-pushing to push server;
User's request data for receiving the user's request data that Redis push server pushes, and are sent to user by push server.
Further, described sudden strain of a muscle beat of data processing system, it is characterised in that also include:
Front End Server, the sudden strain of a muscle beat of data sent by browser for receiving user is asked and is merged, and is sent to middle station server.
Further, described Front End Server includes combining unit and the first transmitting element,
Combining unit, for receiving the sudden strain of a muscle beat of data request that user sends, and merges the request of sudden strain of a muscle beat of data, is sent to the first transmitting element;
First transmitting element, the sudden strain of a muscle beat of data request after merging disposably is sent to middle station server.
Further, described middle station server includes search unit and the second transmitting element,
Search unit, for the sudden strain of a muscle beat of data request sent according to the first transmitting element, searches the data corresponding with dodging beat of data request from data base, and is sent to the second transmitting element;
Second transmitting element, for the data searched by search unit, is disposably sent to Redis push server.
Further, described Redis push server includes signal generating unit and the 3rd transmitting element,
Signal generating unit, for receiving the data that the second transmitting element sends, and by data genaration message, is sent to the 3rd transmitting element;
3rd transmitting element, for being sent to push server by message.
Further, described sudden strain of a muscle beat of data processing system, also include:
Redis master server, for dodging the caching clapping main system;
Background server, safeguards dodging bat management system for operation personnel;
Terracotta server, is used for Row control, the JOB round dodging in bat activity, and distributed thread pond is arranged.
Beneficial effect:The present invention arranges Redis push server and push server, utilizes Redis push server by user's request data active push to push server, then by push server, user's request data are sent to user.So, user avoids the need for reading sudden strain of a muscle beat of data in Redis push server every time, brings huge operating pressure to Redis push server.The present invention, by increasing push server, by there is data interaction between push server and browser, alleviates the access pressure of Redis push server significantly.Whole system stable operation.Meanwhile, in dodging bat activity, only there is substantial amounts of data access in server within the set time, and usually, visit capacity is little, and the pressure of server is little.The present invention does not alleviate server access pressure only by increase hardware mode, but by arranging push server, improves the request disposal ability of system.The utilization rate of whole system is high.
Accompanying drawing explanation
Fig. 1 is the FB(flow block) of the embodiment of the present invention 1.
Fig. 2 is the FB(flow block) of the embodiment of the present invention 2.
Fig. 3 is a kind of network topological diagram of the embodiment of the present invention 3.
Fig. 4 is the another kind of network topological diagram of the embodiment of the present invention 3.
Fig. 5 is a kind of structured flowchart of the embodiment of the present invention 3.
Detailed description of the invention
Below in conjunction with the accompanying drawings and embodiment, technical scheme is described in detail.
Embodiment 1
Dodge beat of data processing method as it is shown in figure 1, a kind of, comprise the following steps:
In S101, station server dodges beat of data request, calling and obtaining user demand data from data base according to the user received, and is sent to Redis push server;
S102 Redis push server by user's request data-pushing to push server;
User's request data are sent to user by S103 push server.
In existing sudden strain of a muscle bat activity, when there is a need to the sudden strain of a muscle beat of data pushed, then directly sudden strain of a muscle beat of data being put in Redis push server, WEB pushes poll when, in Redis push server, reading sudden strain of a muscle beat of data every time.This can produce substantial amounts of LAN input and output IO, and the pressure of Redis push server is huge, Redis push server fluctuation of service.Redis be one increase income, support network, can based on internal memory also can the storage data base of persistence, support numerous types of data, there is the strongest data management function.In dodging bat activity, needing the data volume pushed the least in Redis push server, total amount of data may be less than 30M.Simultaneously in network flash bat activity, at short notice, the visit capacity of server is huge, and only produces huge visit capacity within the fixed point time, and at ordinary times, visit capacity is stably limited.The method of the present embodiment, by arranging Redis push server and push server, utilizes Redis push server by user's request data active push to push server, then by push server, user's request data is sent to user.So, user avoids the need for reading sudden strain of a muscle beat of data in Redis push server every time.The present invention uses Redis publish/subscribe and buffering instrument that JCS(JCS is a kind of combined type, target buffer to internal memory, hard disk can be had the expired setting of buffer object time.The distributed architecture with buffering can also be built by JCS, to realize high performance application) method of local cache, when there is a need to the sudden strain of a muscle beat of data pushed, Redis push server is by sudden strain of a muscle beat of data active push to be pushed to push server, by data interaction occurs between push server and browser, it is provided that dodge beat of data to user.
In push server, JCS local cache is used to process the functions such as caching expired, life cycle algorithm, Cache Statistics.Redis push server is by sudden strain of a muscle beat of data active push to be pushed to the JCS local cache of push server.The JCS local cache of push server stores the sudden strain of a muscle beat of data that Redis push server pushes.
In the above-mentioned methods, request of data be dodge user in bat activity it should be understood that sudden strain of a muscle clap information, including present price, server time, historical price, guarantee fund freeze in number, auction round, acceptance of the bid promptings, goods to auction attribute, hot list of getting the bid, popularity list any one or combine.
Described step S101 also includes: middle station server utilize MySQL(correspondence Chinese: Relational DBMS) server will dodge clap during produce data be saved permanently to hard disk.
As preferably, the process of described step S103 is: user's request data are sent to browser by push server, and the user's request data display that browser is obtained is to user.Short polling mode is used to carry out data interaction between push server and browser.So, user avoids the need for reading sudden strain of a muscle beat of data in Redis push server every time.The present embodiment, by user's request data are sent to push server by Redis push server, by using short polling mode to carry out data interaction between push server and browser, provides a user with demand data.This is avoided user and is directly read the pressure dodging beat of data and bring server by browser in Redis push server.
As preferably, in described step S101, middle station server real-time update is positioned at the database information in middle station server.Dodging the information in bat activity, such as present price, historical price, guarantee fund freeze number etc., change constantly.For ensureing to dodge in bat activity, user can obtain real time information, middle station server needs the database information that real-time update is positioned in middle station server, up-to-date information passes to Redis push server, is more actively promoted to push server by Redis push server.
In existing sudden strain of a muscle bat activity, when there is a need to the sudden strain of a muscle beat of data pushed, then directly putting in Redis push server by sudden strain of a muscle beat of data, WEB pushes poll when, browser reads sudden strain of a muscle beat of data in Redis push server every time.So, the pressure of Redis push server is huge, Redis push server fluctuation of service.The present invention, by arranging push server, utilizes Redis push server by user's request data active push to push server, then by push server, user's request data is sent to user.So, user avoids the need for reading sudden strain of a muscle beat of data in Redis push server every time, brings huge pressure to Redis push server.The present invention uses Redis publish/subscribe and the method for JCS local cache, when there is a need to the sudden strain of a muscle beat of data pushed, Redis push server is by sudden strain of a muscle beat of data active push to be pushed to push server, by data interaction occurs between push server and browser, it is provided that dodge beat of data to user.During whole, server stable operation.Meanwhile, the method using the present invention, it is not necessary to put into too much hardware, to alleviate the pressure of server.
Embodiment 2
Dodge beat of data processing method as in figure 2 it is shown, a kind of, comprise the following steps:
The request of sudden strain of a muscle beat of data is sent to Front End Server by browser by S1001;
The sudden strain of a muscle beat of data of reception is asked to merge by S1002 Front End Server, is sent to middle station server;
In S101, station server dodges beat of data request, calling and obtaining user demand data from data base according to the user received, and is sent to Redis push server;
S102 Redis push server by user's request data-pushing to push server;
User's request data are sent to user by S103 push server.
The present embodiment 2 part same as in Example 1 is, by arranging Redis push server and push server, utilize Redis push server by user's request data active push to push server, then by push server, user's request data are sent to user.So, user avoids the need for reading sudden strain of a muscle beat of data in Redis push server every time.The present embodiment 2 difference from Example 1 is, in the present embodiment 2, and Front End Server, the user data requests received, carry out merging treatment, unification is sent to middle station server.
After middle station server receives the request after merging, search from data base respectively with merge after the corresponding data of each request of data, and all data are disposably sent to Redis push server.The data genaration message that Redis push server is received, issues push server.Message is fed back to all browsers sending request by push server, shows user.So, each user can obtain oneself required data.
In existing sudden strain of a muscle bat activity, when there is a need to the sudden strain of a muscle beat of data pushed, then directly putting in Redis push server by sudden strain of a muscle beat of data, WEB pushes poll when, browser reads sudden strain of a muscle beat of data in Redis push server every time.In the present embodiment, user can be asked to merge by Front End Server, it is sent to middle station server, by middle station server, each user's request data are disposably sent to Redis push server, then desired data in the request after being merged by Redis push server, generate message, issue push server, push server message is returned the browser page of all transmission requests.So convenient extension, reduces network I/O, substantially increases data-handling efficiency.
The request of each user is separate.If carrying out search and the transmission of data respectively, time cost certainly will be increased.The present embodiment, by request of data being merged, finally by data genaration message, is disposably sent to user, substantially increases data transmission efficiency.
Embodiment 3
Beat of data processing system is dodged as it is shown on figure 3, a kind of, including middle station server, Redis push server and push server,
Middle station server, for dodging beat of data request, calling and obtaining user demand data from data base according to the user received, and is sent to Redis push server;
Redis push server, the user's request data that station server sends in receiving, and by user's request data-pushing to push server;
User's request data for receiving the user's request data that Redis push server pushes, and are sent to user by push server.
In existing sudden strain of a muscle shooting system, when there is a need to the sudden strain of a muscle beat of data pushed, then directly sudden strain of a muscle beat of data being put in Redis push server, WEB pushes poll when, in Redis push server, reading sudden strain of a muscle beat of data every time.This can produce substantial amounts of LAN input and output IO, and the pressure of Redis push server is huge, Redis push server fluctuation of service.In dodging bat activity, needing the data volume pushed the least in Redis push server, total amount of data may be less than 30M.The system of the present invention, by arranging middle station server, Redis push server and push server, utilizes Redis push server by user's request data active push to push server, then by push server, user's request data is sent to user.So, user avoids the need for reading sudden strain of a muscle beat of data in Redis push server every time.
In push server, JCS local cache is used to process the functions such as caching expired, life cycle algorithm, Cache Statistics.Redis push server is by sudden strain of a muscle beat of data active push to be pushed to the JCS local cache of push server.The JCS local cache of push server stores the sudden strain of a muscle beat of data that Redis push server actively sends.Issuing when, issue (publish) function in Redis push server is responsible for being pushed in Redis push server sudden strain of a muscle beat of data, Redis push server again by data active push to push server.SET module in Redis push server, is responsible in data persistence to Redis push server.When push server is restarted when, data can be reacquired from Redis push server, and then realize data recovery.
The publish/subscribe (pub/sub) of Redis server uses sentinel technology to achieve failover control.Sentinel technology can be when breaking down, it is achieved master-slave swap.The present invention is provided with 2 Redis servers, respectively Redis push server and Redis master server.When a wherein Redis server is delayed machine, and system can subscribe on another Redis server automatically.Although sentinel technology is prior art, but the present invention is used in sudden strain of a muscle bat activity and is belonged to first.Use sentinel technology, it is ensured that in dodging bat activity, when a Redis server fail, another Redis server potentially acts as Redis push server, beat of data active push will be dodged in time to push server.
As preferably, when middle station server calls Redis push server, use the mechanism of linear communication Pipeline(Redis instruction batch processing) mode, realize issuing when, set instruction and the merging of publish instruction, disposably it is transferred in Redis push server, reduces the number of times established the link, improve efficiency of transmission.
Subscribing to when, it is serial (i.e. using regular expressions to subscribe to channel) owing to subscribing to passage.Therefore, the JBOSS of subscription have employed 3 passages, respectively present price passage, auction round passage and other service channels.So ensure core business (referring to present price and auction round) operating smoothness.Simultaneously when subscribing to data arrival when, business logic processing can be put in the middle of the thread pool being positioned in push server.That is: the master pattern of NIO.3 threads are responsible for receiving data, and 32 threads are responsible for processing service logic.Front End Server, middle station server, background server, push server and Fair services device all have employed JBOSS application server.JCS local cache is arranged in JBOSS.
Push server can use independent domain name, to distinguish the domain name of main system.So can reduce the interference of cookie, only be suitable for CDN(correspondence English: Content Delivery Network, corresponding Chinese: i.e. content distributing network) acceleration mechanism, inapplicable CDN caches.English by the JSONP(correspondence of push server: JSON with Padding) cross-domain request obtains data.JSON(correspondence is English: JavaScript Object Notation, is the data interchange format of a kind of lightweight) message makes every effort to simplify, and in the case of more than one hundred million visit capacities, field name uses a letter, irredundant useless field.Push server possesses the mechanism preventing JOB superposition from performing simultaneously.If one time poll has exceeded 1 second, then secondary poll will be abandoned automatically, directly arrive last end of polling(EOP).So can well adaptation network environment.Push server is furnished with global counter simultaneously, by the way of delivery, decides whether request message, it may be assumed that on-demand request, effectively reduces server operation.
As shown in Figure 4, described sudden strain of a muscle beat of data processing system, also include Front End Server, the sudden strain of a muscle beat of data sent by browser for receiving user is asked and is merged, and is sent to middle station server.Front End Server shows WEB page, uses to Internet user, calls for middle station server.
User is asked to merge by Front End Server, it is sent to middle station server, by middle station server, each user's request data are disposably sent to Redis push server, desired data in request after being merged by Redis push server, generate message, issue push server, push server message is returned the browser page of all transmission requests.So convenient extension, reduces network input and output IO.Meanwhile, this method can be used in big sale platform.
As shown in Figure 4, described sudden strain of a muscle beat of data processing system, also include MySQL server, the data produced during dodging bat are saved permanently to hard disk.MySQL server ensure that dodging the various data produced in bat activity will not lose, and at other server fail or when restarting, still is able to obtain data by hard disk.
As shown in Figure 4, described sudden strain of a muscle beat of data processing system, also include Redis master server, for dodging the caching clapping main system;Background server, safeguards, for operation personnel's routine use and system journal, abnormality processing dodging bat management system for operation personnel;The famous Java cluster platform of increasing income that Terracotta(Terracotta is developed by Terracotta company of the U.S.) server, it is used for Row control, the JOB round dodging in bat activity, distributed thread pond is arranged.Such as, Terracotta server, for Distributed Job Scheduling, User Activity is rejected, and movable registration terminates, and goods to auction are rejected, and generates auction order, it is ensured that gold exceeds the time limit the business such as fine and confiscation.Described sudden strain of a muscle beat of data processing system, it is also possible to include Fair services device, for dodging the data in beat of data storehouse to MySQL server synchronized update.
Middle station server carries out the additions and deletions of data and looks into and change operation MySQL server.Background server carries out the additions and deletions of data and looks into and change operation MySQL server.Middle station server carries out the execution of Distributed Job Scheduling to Terracotta server.Background server carries out the additions and deletions of Distributed Job Scheduling and looks into and change Terracotta server.
Beat of data efficiency of transmission is dodged, as it is shown in figure 5, in described sudden strain of a muscle beat of data processing system, Front End Server includes combining unit and the first transmitting element for improving.Combining unit, for receiving the sudden strain of a muscle beat of data request that user sends, and merges the request of sudden strain of a muscle beat of data, is sent to the first transmitting element.First transmitting element, the sudden strain of a muscle beat of data request after merging disposably is sent to middle station server.Middle station server includes search unit and the second transmitting element.Search unit, for the sudden strain of a muscle beat of data request sent according to the first transmitting element, searches the data corresponding with dodging beat of data request from data base, and is sent to the second transmitting element.Second transmitting element, for the data searched by search unit, is disposably sent to Redis push server.Redis push server includes signal generating unit and the 3rd transmitting element.Signal generating unit, for receiving the data that the second transmitting element sends, and by data genaration message, is sent to the 3rd transmitting element.3rd transmitting element, for being sent to push server by message.
Front End Server is provided with combining unit.The user data requests that combining unit is received, has carried out merging treatment, and the user data requests unification after then being merged by the first transmitting element is sent to middle station server.After in middle station server, search unit receives the request of data after merging, search from data base with merge after the corresponding data of each request of data, and all data passed through the second transmitting element be disposably sent to Redis push server.The data genaration message that signal generating unit in Redis push server is received, is sent to push server by the 3rd transmitting element.Message is fed back to all browsers sending request by push server, shows user.So, in a certain amount of time, the request of data that user sends, after the combining unit of Front End Server merges, middle station server carry out data process, Redis push server generate message, be sent to push server.In the process, the process that data process is to synchronize, and sending also is to synchronize.This avoids single request, individually scans for, more individually sends the poor efficiency that the data brought process.
The user's request data display that push server is obtained by browser is to user.Short polling mode is used to carry out data interaction between push server and browser.So, user avoids the need for reading sudden strain of a muscle beat of data in Redis push server every time.The present invention, by user's request data are sent to push server by Redis push server, by using short polling mode to carry out data interaction between push server and browser, provides a user with demand data.This is avoided user and is directly read the pressure dodging beat of data and bring server by browser in Redis push server.
Middle station server, is additionally operable to the database information that real-time update is positioned in middle station server.Dodging the information in bat activity, such as present price, historical price, guarantee fund freeze number etc., change constantly.For ensureing to dodge in bat activity, user can obtain real time information, middle station server needs the database information that real-time update is positioned in middle station server, up-to-date information passes to Redis push server, is more actively promoted to push server by Redis push server.Above-mentioned information is in push server, and only server time is that JBOSS is local is accessing time point generation.Use NTP(Network Time Protocol, NTP) the sync server time.Other information, both from the publish/subscribe pattern of Redis.
In said system, request of data be dodge user in bat activity it should be understood that sudden strain of a muscle clap information, including present price, server time, historical price, guarantee fund freeze in number, auction round, acceptance of the bid promptings, goods to auction attribute, hot list of getting the bid, popularity list any one or combine.
Prior art, by putting into hardware cost, increases the disposal ability of server.Owing to, in dodging bat activity, only there is substantial amounts of data access in server within the set time, and usually, visit capacity is little, and the pressure of server is little.So, being put into by hardware, alleviate the pressure of server, utilization rate is low.The present invention uses Redis publish/subscribe+JCS local cache, by Redis server active push more new data to push server, interacts between browser and server by the way of short poll meanwhile.By in the unified JCS pushing data into push server JBOSS of the publish/subscribe function of Redis push server.Therefore, the request disposal ability of server system is greatly improved.Meanwhile, the method using the present invention is limited on hardware puts into, but well solves in sudden strain of a muscle bat activity, the huge access pressure that server faces.The utilization rate of whole system is high.
Those skilled in the art should know, it is achieved the method for above-described embodiment or system, can be realized by computer program instructions.This computer program instructions is loaded in programmable data processing device, such as computer, thus performs corresponding instruction in programmable data processing device, the function that the method or system for realizing above-described embodiment realizes.
Those skilled in the art, according to above-described embodiment, can carry out the technological improvement of non-creativeness, without deviating from the spirit of the present invention to the application.These improvement still should be regarded as within the application scope of the claims.

Claims (10)

1. one kind is dodged beat of data processing method, it is characterised in that this processing method comprises the following steps:
In S101, station server dodges beat of data request, calling and obtaining user demand data from data base according to the user received, and is sent to Redis push server;
S102 Redis push server by user's request data-pushing to push server;
User's request data are sent to user by S103 push server.
2. according to the sudden strain of a muscle beat of data processing method described in claim 1, it is characterised in that also include
The request of sudden strain of a muscle beat of data is sent to Front End Server by browser by S1001;
The sudden strain of a muscle beat of data of reception is asked to merge by S1002 Front End Server, is sent to middle station server.
3. according to the sudden strain of a muscle beat of data processing method described in claim 1 or 2, it is characterised in that the process of described step S103 is: user's request data are sent to browser by push server, and the user's request data display that browser is obtained is to user.
4. according to the sudden strain of a muscle beat of data processing method described in claim 1, it is characterized in that, dodge beat of data request include server time, present price, historical price, guarantee fund freeze in number, auction round, acceptance of the bid promptings, goods to auction attribute, hot list of getting the bid, popularity list any one or combine.
5. one kind is dodged beat of data processing system, it is characterised in that this system includes middle station server, Redis push server and push server, wherein,
Middle station server, for dodging beat of data request, calling and obtaining user demand data from data base according to the user received, and is sent to Redis push server;
Redis push server, the user's request data that station server sends in receiving, and by user's request data-pushing to push server;
User's request data for receiving the user's request data that Redis push server pushes, and are sent to user by push server.
6. according to the sudden strain of a muscle beat of data processing system described in claim 5, it is characterised in that also include:
Front End Server, the sudden strain of a muscle beat of data sent by browser for receiving user is asked and is merged, and is sent to middle station server.
7. according to the sudden strain of a muscle beat of data processing system described in claim 6, it is characterised in that described Front End Server includes combining unit and the first transmitting element,
Combining unit, for receiving the sudden strain of a muscle beat of data request that user sends, and merges the request of sudden strain of a muscle beat of data, is sent to the first transmitting element;
First transmitting element, the sudden strain of a muscle beat of data request after merging disposably is sent to middle station server.
8. according to the sudden strain of a muscle beat of data processing system described in claim 7, it is characterised in that described middle station server includes search unit and the second transmitting element,
Search unit, for the sudden strain of a muscle beat of data request sent according to the first transmitting element, searches the data corresponding with dodging beat of data request from data base, and is sent to the second transmitting element;
Second transmitting element, for the data searched by search unit, is disposably sent to Redis push server.
9. according to the sudden strain of a muscle beat of data processing method described in claim 8, it is characterised in that described Redis push server includes signal generating unit and the 3rd transmitting element,
Signal generating unit, for receiving the data that the second transmitting element sends, and by data genaration message, is sent to the 3rd transmitting element;
3rd transmitting element, for being sent to push server by message.
10. according to the sudden strain of a muscle beat of data processing system in any of the one of claim 5 to 9, it is characterised in that also include:
Redis master server, for dodging the caching clapping main system;
Background server, safeguards dodging bat management system for operation personnel;
Terracotta server, is used for Row control, the JOB round dodging in bat activity, and distributed thread pond is arranged.
CN201510067871.XA 2015-02-09 2015-02-09 Flash data processing method and system Active CN105989065B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510067871.XA CN105989065B (en) 2015-02-09 2015-02-09 Flash data processing method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510067871.XA CN105989065B (en) 2015-02-09 2015-02-09 Flash data processing method and system

Publications (2)

Publication Number Publication Date
CN105989065A true CN105989065A (en) 2016-10-05
CN105989065B CN105989065B (en) 2020-03-24

Family

ID=57041606

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510067871.XA Active CN105989065B (en) 2015-02-09 2015-02-09 Flash data processing method and system

Country Status (1)

Country Link
CN (1) CN105989065B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107105064A (en) * 2017-06-02 2017-08-29 上海艾融软件股份有限公司 The method for pushing and system of a kind of Transaction Information
CN107423132A (en) * 2017-04-20 2017-12-01 山东开创云软件有限公司 A kind of large-scale concurrent optimized treatment method for auction platform
CN107578327A (en) * 2017-08-17 2018-01-12 中国工商银行股份有限公司 Method, equipment and the system that information pushes in a kind of link of bidding
CN108733704A (en) * 2017-04-20 2018-11-02 北京京东尚科信息技术有限公司 Multiple database data processing method, device and storage medium and electronic equipment
CN110971643A (en) * 2018-09-30 2020-04-07 北京国双科技有限公司 Message pushing method and device, storage medium and processor

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102223381A (en) * 2011-07-07 2011-10-19 莫雅静 Message pushing method, server, client terminal and system
CN102571877A (en) * 2010-12-31 2012-07-11 上海博泰悦臻电子设备制造有限公司 Vehicle-mounted information synchronization service system and method
CN103108002A (en) * 2011-11-10 2013-05-15 阿里巴巴集团控股有限公司 Method, system and device for data pushing
CN103167017A (en) * 2013-01-09 2013-06-19 北京奇虎科技有限公司 Method, device and system for Web polling

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102571877A (en) * 2010-12-31 2012-07-11 上海博泰悦臻电子设备制造有限公司 Vehicle-mounted information synchronization service system and method
CN102223381A (en) * 2011-07-07 2011-10-19 莫雅静 Message pushing method, server, client terminal and system
CN103108002A (en) * 2011-11-10 2013-05-15 阿里巴巴集团控股有限公司 Method, system and device for data pushing
CN103167017A (en) * 2013-01-09 2013-06-19 北京奇虎科技有限公司 Method, device and system for Web polling

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107423132A (en) * 2017-04-20 2017-12-01 山东开创云软件有限公司 A kind of large-scale concurrent optimized treatment method for auction platform
CN108733704A (en) * 2017-04-20 2018-11-02 北京京东尚科信息技术有限公司 Multiple database data processing method, device and storage medium and electronic equipment
CN108733704B (en) * 2017-04-20 2020-11-20 北京京东尚科信息技术有限公司 Multi-database data processing method and device, storage medium and electronic equipment
CN107105064A (en) * 2017-06-02 2017-08-29 上海艾融软件股份有限公司 The method for pushing and system of a kind of Transaction Information
CN107578327A (en) * 2017-08-17 2018-01-12 中国工商银行股份有限公司 Method, equipment and the system that information pushes in a kind of link of bidding
CN107578327B (en) * 2017-08-17 2020-10-16 中国工商银行股份有限公司 Method, device and system for information push in bidding link
CN110971643A (en) * 2018-09-30 2020-04-07 北京国双科技有限公司 Message pushing method and device, storage medium and processor
CN110971643B (en) * 2018-09-30 2022-07-29 北京国双科技有限公司 Message pushing method and device, storage medium and processor

Also Published As

Publication number Publication date
CN105989065B (en) 2020-03-24

Similar Documents

Publication Publication Date Title
US11481657B2 (en) Content recommendation method, apparatus and system
EP2834755B1 (en) Platform for continuous graph update and computation
Brito et al. Scalable and low-latency data processing with stream mapreduce
CN105989065A (en) Flash shot data processing method and system
CN106919654A (en) A kind of implementation method of the High Availabitity MySQL database based on Nginx
JP2016500454A (en) System wide query optimization
Turk et al. Temporal workload-aware replicated partitioning for social networks
Hsu et al. Causal consistency algorithms for partially replicated and fully replicated systems
US8868525B2 (en) Distributed information synchronization
Qian et al. Adjusting matching algorithm to adapt to workload fluctuations in content-based publish/subscribe systems
CN104636395A (en) Count processing method and device
Jin et al. Cost-effective data placement in edge storage systems with erasure code
CN107562803B (en) Data supply system and method and terminal
Xia et al. A partial replication approach for anywhere anytime mobile commenting
Zhang et al. Quegel: A general-purpose system for querying big graphs
EP2025133B1 (en) Repository synchronization in a ranked repository cluster
CN109947736A (en) The method and system calculated in real time
CN110196680A (en) Data processing method, device and storage medium
Grewal et al. {RecService}: Distributed {Real-Time} Graph Processing at Twitter
CN103577424B (en) The realization method and system of distributed data base view
US11514030B2 (en) Automated materialized view table generation and maintenance
CN108228644A (en) For method and device derived from report
Qian et al. Fat Topic: Improving Latency in Content-Based Publish/Subscribe Systems on Apache Kafka
CN105046564A (en) Stock speculation social intercourse system
Qureshi et al. IPC: Resource and network cost-aware distributed stream scheduling on skewed streams

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20210508

Address after: 210042 no.1-9 Suning Avenue, Xuanwu District, Nanjing City, Jiangsu Province (Jiangsu Province)

Patentee after: NANJING SUNING ELECTRONIC INFORMATION TECHNOLOGY Co.,Ltd.

Address before: No.1-1 Suning Avenue, Xuzhuang Software Park, Xuanwu District, Nanjing, Jiangsu Province, 210042

Patentee before: Suning Cloud Computing Co.,Ltd.