CN103095819A - Data information pushing method and data information pushing system - Google Patents
Data information pushing method and data information pushing system Download PDFInfo
- Publication number
- CN103095819A CN103095819A CN2013100012678A CN201310001267A CN103095819A CN 103095819 A CN103095819 A CN 103095819A CN 2013100012678 A CN2013100012678 A CN 2013100012678A CN 201310001267 A CN201310001267 A CN 201310001267A CN 103095819 A CN103095819 A CN 103095819A
- Authority
- CN
- China
- Prior art keywords
- data information
- http
- client
- pushing
- push request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 75
- 238000004806 packaging method and process Methods 0.000 claims abstract description 8
- 238000012545 processing Methods 0.000 claims description 30
- 238000012795 verification Methods 0.000 claims description 19
- 230000005540 biological transmission Effects 0.000 claims description 18
- 230000008569 process Effects 0.000 claims description 18
- 238000005516 engineering process Methods 0.000 claims description 11
- 238000012546 transfer Methods 0.000 claims description 9
- 230000004044 response Effects 0.000 claims description 7
- 230000006870 function Effects 0.000 claims description 5
- 238000004891 communication Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 5
- 239000000872 buffer Substances 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000003780 insertion Methods 0.000 description 2
- 230000037431 insertion Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 229920000642 polymer Polymers 0.000 description 1
Images
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a data information pushing method and a data information pushing system. The data information pushing method includes the steps of receiving data information which is arranged according to releasing time sequence, storing the data information collected from an external information source in real time, receiving a hyper text transport protocol (HTTP) pushing request from a client, searching the stored data information, obtaining the data information corresponding to the HTTP pushing request, packaging, and pushing the data information to the client through HTTP long connection. The data information pushing method can improve pushing efficiency of the data information.
Description
Technical Field
The present invention relates to computer communication technologies, and in particular, to a method and a system for pushing data information.
Background
With the rapid development and popularization of communication technology, especially the application of web2.0 network technology, social platforms become a main data information communication mode, and various applications based on the social platforms are developed vigorously. Because the social platform has huge user groups and frequent use frequency, a large amount of data can be generated in a short time, so that various applications can acquire required data information through the social platform, for example, microblogs are used, more than 1 hundred million registered users are provided, and the click rate per day exceeds 4 hundred million, so that massive data information is provided. Therefore, the data information service based on the social platform requires that data information required by user personalization can be pushed to the client where the user is located under the condition of high concurrency, so that the business experience of the user is effectively improved.
The data information pushing technology is a new technology which reduces overload caused by centralized transmission of data information by adopting a certain technical standard or protocol and regularly transmitting data information customized by a user or recommended by an operator. The push technology can search and filter data information according to the personalized requirements of the user, and automatically transmit the filtered data information to the user, so that the user is assisted to efficiently explore valuable data information, and the time of the user for network search can be effectively reduced.
The existing method for pushing data information mainly comprises the following steps: data information push based on Application Programming Interface (API), data information push based on hypertext Transfer Protocol (HTTP), and data information push based on message mechanism, wherein,
the data information pushing method based on the API comprises the steps that the server provides the API called by the data information, and the client side calls the API provided by the server, so that the data information in the server is obtained. The data information is easily pushed through an API (application programming interface) interface, but the pushing rate is low, real-time pushing is difficult to realize under the pushing pressure of mass data information generated by social application with high updating frequency, the data information pushing instantaneity is poor, and the pushing efficiency is low.
The data information pushing method based on the HTTP interface comprises the steps that a server provides data information service in an HTTP mode, a client side initiates an HTTP pushing request to the server and establishes connection with the server, the server processes the HTTP pushing request through the established connection and returns an HTTP pushing request response to the client side, and the HTTP pushing request response carries data information corresponding to the HTTP pushing request of the client side. The scheme is based on a synchronous communication mode, is easy and quick to realize, and ensures the reliability of transmission; however, the HTTP-based data information pushing method belongs to a synchronous communication mode, and under a condition that a large amount of data information needs to be pushed in a short time, since a client cannot sense a change of data information in an information source (server), the client needs to continuously send an HTTP push request to the server to acquire real-time data information, the client needs to continuously send an HTTP push request according to actual needs of the client to inquire whether the server has updated data information to be transmitted, and the server establishes a connection according to each HTTP push request, pushes data information, and disconnects the connection after the data information is pushed. Therefore, the time required by the client to acquire the data information is long, and the network resource is consumed due to frequent sending of the HTTP pushing request, so that network congestion is easily caused, the utilization efficiency of the network resource is not high, the real-time performance of data information pushing is not high, and the pushing efficiency is low.
The server packages the stored related data information into a message according to a preset message format, the message is placed in a message queue and sent to the client through the message queue, and the client realizes the communication with the server (information source) by receiving the message in the message queue. The method realizes asynchronous communication, is suitable for sending a large amount of messages in a short time, and can meet the transmission requirement of mass data information, but the data pushing method based on the message mechanism is easy to lose messages under the condition of network congestion, and has lower data information pushing efficiency; in addition, according to the data information pushing method based on the message mechanism, the message queue can only realize rough ordering, and cannot provide continuous and ordered data information service for the user.
Disclosure of Invention
The embodiment of the invention provides a method for pushing data information, which improves the efficiency of pushing data information.
The embodiment of the invention also provides a data information pushing system, which improves the data information pushing efficiency.
To achieve the above object, an embodiment of the present invention provides a method for pushing data information, including:
receiving and storing data information arranged according to the release time sequence, wherein the data information is collected from an external information source in real time;
the method comprises the steps of receiving a hypertext transfer protocol (HTTP) push request of a client, inquiring stored data information, obtaining data information corresponding to the HTTP push request, packaging, and pushing to the client through HTTP long connection.
Wherein the storing comprises:
storing the data information arranged according to the release time sequence into a database;
and the database sequentially writes the stored data information which is arranged according to the release time sequence into a memory which adopts a data structure of a skip list to store the data information.
Wherein, prior to said storing, the method further comprises:
and classifying the data information arranged according to the release time sequence according to the data information attribute.
Wherein after the step of classifying and before the step of storing, the method further comprises:
and receiving the classified data information, and converting the data information into a data format supported by the client.
The querying stored data information and the obtaining data information corresponding to the HTTP push request include:
inquiring whether data information corresponding to the HTTP push request is stored in a memory according to the HTTP push request of the client;
if so, pushing the data information obtained by the query to the client;
and if the data information corresponding to the HTTP push request is not inquired, the data information is pushed to the client, and if the data information corresponding to the HTTP push request is not inquired, the push request failure information is returned to the client.
The client communicates with the server through the HTTP long connection technology.
Wherein the method further comprises:
the client receives the pushed and packaged data information through HTTP long connection;
and after the JavaScript response processing function of the client processes the data information, sending the HTTP push request again, and reestablishing the TCP connection.
Wherein, after the client receives the pushed encapsulated data information, the method further comprises:
recording the position parameter information of the finally received data information, and carrying the position parameter information when the HTTP push request is initiated next time;
the querying stored data information and the obtaining data information corresponding to the HTTP push request include:
according to the position parameters carried in the HTTP push request, inquiring whether the position corresponding to the position parameters exists in the memory, if so, reading the data information behind the data information of the position corresponding to the position parameters and pushing to the client, and if not, reading the data information behind the data information of the position corresponding to the position parameters from the database module and pushing to the client.
Wherein the HTTP push request further carries an application identification parameter for authenticating a user, and the method further comprises:
analyzing an HTTP push request sent by a client, acquiring application identification parameters carried in the HTTP push request, carrying out validity verification on a user requesting to push, determining that the user passes the validity verification, and triggering to establish an HTTP long connection.
The HTTP push request further carries a transmission parameter and/or a data information attribute parameter.
A data push system, the system comprising: a data information collector, a data information pusher and a client, wherein,
the data information collector is used for collecting data information issued in real time from an external information source, arranging the data information according to the time sequence of issuing the data information and outputting the data information to the data information pusher;
the data information pusher is used for receiving a hypertext transfer protocol (HTTP) push request of the client, inquiring the stored data information through parameters carried in the HTTP push request, acquiring data information corresponding to the HTTP push request, packaging the data information, and pushing the data information to the client through HTTP long connection;
and the client is used for sending an HTTP pushing request to the data information pusher, receiving the encapsulated data information pushed by the data information pusher through HTTP long connection, and processing the encapsulated data information.
Preferably, the data information collector comprises: a data information collection module and a message queue module, wherein,
the data information collection module is used for collecting data information issued in real time from an external information source and outputting the data information to the message queue module;
and the message queue module is used for arranging the received data information according to the time sequence of data information release and outputting the data information to the data information pusher.
Preferably, the data information pusher includes: an HTTP long connection module, a memory module, a database module and a push request processing module, wherein,
the HTTP long connection module is used for receiving an HTTP push request of the client and establishing HTTP long connection with the client;
the database module is used for receiving the data information output by the message queue module, storing the data information and outputting the data information to the memory module so as to update the content in the content module in real time;
the memory module is used for storing the data information output by the database module by adopting a first-in first-out strategy and realizing quick positioning by using a skiplist;
the push request processing module is used for inquiring the memory module according to the HTTP push request of the client, and pushing the inquired data information to the client if the data information corresponding to the HTTP push request is inquired; and if the data information corresponding to the HTTP pushing request is not acquired, querying the database module, if the data information corresponding to the HTTP pushing request is queried, pushing the data information to the client, and if the data information corresponding to the HTTP pushing request is not queried, returning pushing request failure information to the client.
Preferably, the data information pusher further comprises:
and the classification module is used for receiving the data information output by the message queue module, classifying according to the data information attribute and outputting the classified data information to the database module.
Preferably, the data information pusher further comprises:
and the queue processor is used for receiving the classified data information output by the classification module, converting the classified data information into a data format supported by the client, and outputting the data to the database module by using the message queue.
Preferably, the HTTP push request carries an application identification parameter for authenticating a user, and the data information pusher further includes:
and the permission verification module is used for analyzing the received HTTP push request, acquiring the application identification parameters carried in the HTTP push request, verifying the validity of the user requesting to push, determining that the user passes the validity verification, and triggering the push request processing module to process the user.
Preferably, the first and second liquid crystal films are made of a polymer,
the client is further used for recording the position parameter information of the finally received data information after receiving the encapsulated data information pushed by the data information pusher, and carrying the position parameter in the next HTTP pushing request;
the push request processing module is further used for inquiring whether a position corresponding to the position parameter exists in the memory module according to the position parameter carried in the HTTP push request, if so, reading data information behind the data information of the position corresponding to the position parameter and pushing the data information to the client, and if not, reading the data information behind the data information of the position corresponding to the position parameter from the database module and pushing the data information to the client.
According to the technical scheme, the method for pushing the data information and the data information pushing system provided by the embodiment of the invention receive and store the data information which is arranged according to the release time sequence, and the data information is collected from an external information source in real time; receiving a hypertext transfer protocol (HTTP) push request of a client, inquiring stored data information through HTTP long connection, acquiring data information corresponding to the HTTP push request, packaging and pushing to the client. Therefore, the client side and the data information pusher always keep TCP connection by establishing the HTTP long connection, and when the data information pusher acquires the data information updated in real time, the data information updated in real time is returned to the client side without continuously refreshing and sending HTTP pushing requests by the client side, so that the time required for establishing a new connection for each HTTP pushing request is saved, the bandwidth is saved, and the pushing efficiency of the data information is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It is to be understood that the drawings in the following description are merely exemplary of the invention and that other embodiments and drawings may be devised by those skilled in the art based on the exemplary embodiments shown in the drawings.
Fig. 1 is a schematic structural diagram of a data push system according to an embodiment of the present invention.
Fig. 2 is a schematic structural diagram of a data information presenter according to an embodiment of the present invention.
Fig. 3 is another schematic structural diagram of a data pushing system according to an embodiment of the present invention.
Fig. 4 is a flowchart illustrating a method for pushing data information according to an embodiment of the present invention.
Detailed Description
The technical solutions of the embodiments of the present invention will be described clearly and completely with reference to the accompanying drawings, and it is to be understood that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The existing method for pushing data information has the technical problem of low data information pushing efficiency no matter data information pushing based on an application programming interface, data information pushing based on a hypertext transfer protocol interface or data information pushing based on a message mechanism.
Aiming at the current development situation of the Internet, the embodiment of the invention aims to provide a method and a system for pushing data information in various social applications, a server 'push' mode based on HTTP long connection is adopted, a message mechanism is combined, a client (a data information consumer) does not need to frequently send HTTP pushing requests to the server, and the server actively and asynchronously sends the data information to the client when the data information changes, so that the client can timely acquire and present updated data information to a user, the method and the system can adapt to real-time pushing of mass data information of the social applications, and can timely push the mass data information to the client under the condition of high updating frequency. The method can be applied to systems such as a monitoring system, an instant communication system, an instant quotation system and the like which need to transmit data information with background change to a client in real time without continuously refreshing the client and sending HTTP push requests to acquire the changed data information.
In the embodiment of the invention, the HTTP long connection is different from the existing method that when the HTTP push request is initiated or the HTTP push request response is carried out each time, a TCP connection needs to be established, the HTTP long connection can process a plurality of HTTP push requests and HTTP push request responses by utilizing the same TCP connection, so the HTTP long connection is also called HTTP keep-alive or HTTP connection is reused, the HTTP long connection is used, and the HTTP long connection is established, opened and closed through fewer TCP connections, so that the network flow can be reduced, the resource consumption for establishing the TCP connection can be effectively reduced, the processing time of the HTTP push request/response is shortened, and the data information push performance is improved; further, the long-time TCP connection can enable the server to have enough time, so that the congestion condition of the network can be judged.
In the embodiment of the invention, the server based on the HTTP long connection mode adopts the Comet technology to push the data information. Comet is a technology used for web, which enables a server to transmit updated data information to a client in real time without the client frequently issuing HTTP push requests. Therefore, based on the HTTP long connection, the Comet technology is adopted, the client keeps TCP connection after being connected to the server, and when the server acquires the data information updated in real time, the data information updated in real time is returned to the client. Comet applications include: long polling based Comet applications and Streaming (Streaming) based Comet applications, wherein,
based on the Comet application of long polling, the method is based on a shunt multiplexing (BAYEUX) protocol, after a client sends an HTTP push request, a TCP connection is kept open between the client and a server until the client receives data information pushed by the server, or the TCP connection is overtime. Specifically, during the period of keeping the TCP connection open, if there is no data information to be pushed, the server will block all HTTP push requests; if the data information needs to be transmitted, the server closes the TCP connection after pushing the data information, and the client sends an HTTP pushing request to reestablish the connection after processing the received data information.
In practical applications, in the process from the time when the client processes the received data information to the time when the TCP connection is reestablished, the server may receive new data information, during which the server stores the received data information until the TCP connection is reestablished by the client, and after the TCP connection is established, the server pushes the stored new data information to the client.
Streaming-based Comet applications require the client and server to maintain a long connection without closing the TCP connection after the data information transfer is completed until a data information transfer error occurs or the TCP connection is reestablished. In large-scale applications, the server needs to provide push services to a large number of clients simultaneously, which requires the clients to maintain a large number of connections, which causes a large resource consumption and server overload.
Fig. 1 is a schematic structural diagram of a data push system according to an embodiment of the present invention. Referring to fig. 1, the system includes: a data information collector, a data information pusher and a client, wherein,
the data information collector is used for collecting data information issued in real time from an external information source, arranging the data information according to the time sequence of issuing the data information and outputting the data information to the data information pusher;
in the embodiment of the present invention, the data information collector is configured to monitor an external information source, for example, an external monitoring system, an instant messaging system, an instant quotation system, and the like, and when it is monitored that data information stored in the information source is updated, collect the updated data information.
In the embodiment of the present invention, the data information collector includes: a data information collection module, and a message queue module (not shown), wherein,
the data information collection module is used for collecting data information issued in real time from an external information source and outputting the data information to the message queue module;
and the message queue module is used for outputting the received data information to the data information pusher according to the receiving time sequence.
The data information pusher is used for receiving an HTTP pushing request of the client, inquiring the stored data information through parameters carried in the HTTP pushing request, acquiring data information corresponding to the parameters carried in the HTTP pushing request, packaging the data information, and pushing the data information to the client through HTTP long connection;
in the embodiment of the invention, the data information pusher is responsible for processing the HTTP push request of the client, and responds to the HTTP push request of the user in a Comet mode, namely when the client sends the HTTP push request and requests the data information pusher to push, the stored continuously updated latest data information is inquired through HTTP long connection, the data information corresponding to the HTTP push request is obtained, and the data information is packaged into a corresponding data packet according to the format required by the client and returned to the client. When the client processes the received data information and reestablishes the connection, the data information pusher may have new data information arriving, and the data information may be stored by the data information pusher all the time.
Fig. 2 is a schematic structural diagram of a data information presenter according to an embodiment of the present invention. Referring to fig. 2, the data information pusher includes: an HTTP long connection module, a memory module, a Database (DB) module and a push request processing module, wherein,
the HTTP long connection module is used for receiving an HTTP push request of the client and establishing HTTP long connection with the client;
in the embodiment of the present invention, the detailed process for establishing the HTTP long connection may specifically refer to related technical documents, and is not described herein again.
And after the HTTP long connection module establishes the HTTP long connection, the HTTP long connection module outputs the received HTTP push request to the push request processing module.
The database module is used for receiving the data information output by the message queue module, arranging and storing the received data information according to the time sequence of data information release, and outputting the data information to the memory module to update the content in the content module in real time;
the memory module is used for storing the data information output by the database module by adopting a first-in first-out strategy;
in the embodiment of the invention, the memory module can further adopt a data structure of a skip list (skip) to store data information, and the skip list is used for realizing quick positioning.
And the push request processing module is used for inquiring the data information stored in the memory module according to the HTTP push request of the client, acquiring the data information corresponding to the HTTP push request and pushing the data information to the client.
In the embodiment of the invention, if the pushing request processing module queries in the memory module and does not acquire the data information corresponding to the HTTP pushing request, the database module is queried, if the data information corresponding to the HTTP pushing request is queried, the data information is pushed to the client, and if the data information corresponding to the HTTP pushing request is not queried, pushing request failure information is returned to the client.
In practical applications, the push request processing module may use a Jetty server to implement a push function of HTTP long connection:
for the long polling mode: the method can realize long polling through the continuity function of Jetty, when receiving HTTP push request, Jetty packages various connection information (configuration information required by connection) into a continuity object, returns the continuity object by calling the suspend method of the continuity object, returns the current thread to the thread pool, and when the thread has data information to be transmitted, calls the resume method, calls the servlet sending the push request for processing, thereby carrying out next polling.
In the embodiment of the present invention, an example code for invoking long polling by Jetty is as follows:
the Jetty server continuously reads the latest data information from the database module through the daemon process, loads the latest data information into the memory module, and updates the cached data when the data information in the memory module exceeds a certain threshold value.
In the embodiment of the invention, the data information in the memory is maintained by using the skip which is a data structure similar to a binary tree, so that the better random reading performance can be ensured, and the cost for performing insertion and deletion operations is lower compared with that of the binary tree.
The skiplist is implemented by a courtskiplistmap of jdk current. The method comprises the steps that a skiplist reads data information with a preset threshold value from a database every time, a mapping (map) is formed by taking an identifier (id) of a first piece of data information as a key value (key), and the mapping (map) is stored in the skiplist. When the data information stored in the skiplist reaches another preset threshold value, a part of the data information stored firstly is cleared.
And when the Jetty responds to the push request, calling a related method through the servlet, and loading data information from the cliplist of the memory.
For a detailed description of the Jetty server, reference may be made in detail to the related art documents.
Preferably, the data information pusher may further include:
and the classification module is used for receiving the data information output by the message queue module, classifying according to the data information attribute and outputting the classified data information to the database module.
In the embodiment of the present invention, the data information attribute may be divided according to different application services, for example, for microblog data information, the data information attribute may include: sending a microblog, forwarding the microblog, paying attention to a friend, sending a private message, commenting the microblog and the like.
In practical applications, the data information pusher may further include:
and the queue processor is used for receiving the classified data information output by the classification module, converting the classified data information into a data format supported by the client, and outputting the data to the database module by using the message queue.
In the embodiment of the invention, the queue processor receives the classified data information output by the classification module, packages the classified data information according to the data format supported by the client, and sequentially outputs the data information to the database module for storage.
Preferably, the data format is pb (protocol buffers) format. The PB is a binary data interactive format, and compared with text data, the PB data occupies a smaller space, so that the PB data is beneficial to saving storage space and reducing resource consumption in a network transmission process.
In practical application, the queue handler may write the encapsulated data information into the database module in a batch operation manner. For example, in a Structured Query Language (SQL) statement, the insertion of 50 lines of data information is performed. Therefore, the performance of the database can be improved in a batch operation mode, and the latest updated data information on the information source can be ensured to be inserted into the DB of the data information pusher in real time.
And the client is used for sending an HTTP pushing request to the data information pusher, receiving the encapsulated data information pushed by the data information pusher through HTTP long connection, and processing the encapsulated data information.
In the embodiment of the invention, the client is responsible for sending an HTTP pushing request to the server according to the self condition, receiving data information pushed by the server in an HTTP long connection mode, and storing the data information into a preset storage disk for corresponding processing. For example, data information is read from a storage disk, analyzed, and the analyzed data information is displayed.
Preferably, the client can call the XMLHTTPRequest object to send an HTTP push request to establish a TCP connection, and the TCP connection is still kept in an open state after being sent, so that the client can continue to send the HTTP push request through the same connection and keep the TCP connection, time required for establishing a new connection for each HTTP push request is saved, data information push efficiency is improved, and bandwidth is saved. And the client updates the display of the HTML page according to the data information returned by the data information pusher.
Meanwhile, after the client processes the data information pushed by the data information pusher, the client sends out the HTTP pushing request again, and the TCP connection is reestablished.
Preferably, the HTTP push request carries an application identification (appid) parameter for authenticating the user, and the data information pusher may further include:
and the permission verification module is used for analyzing the received HTTP push request, acquiring the application identification parameters carried in the HTTP push request, verifying the validity of the user requesting to push, determining that the user passes the validity verification, and triggering the push request processing module to process the user.
In the embodiment of the invention, the authority verification module is used for verifying whether a user requesting to push is legal or not, if the user passes the validity verification, the authority of acquiring the data push service is indicated to the user, and if the user does not pass the validity verification, the authority of acquiring the data push service is not indicated to the user, a null value is returned, and the service push request is rejected.
In practical application, after receiving the encapsulated data information pushed by the data information pusher, the client may further be configured to record location (loc) parameter information of the finally received data information, so that the HTTP push request may also carry the location (loc) parameter, the push request processing module is further configured to query whether a location corresponding to the loc parameter exists in the memory module according to the loc parameter carried in the HTTP push request, and if the location exists, read data information subsequent to the data information at the location corresponding to the loc parameter, and push the data information to the client, and if the location does not exist, read data information subsequent to the data information at the location corresponding to the loc parameter from the database module, and push the data information to the client.
In the embodiment of the present invention, when an exception occurs in a push process, for example, a data information push is suspended due to a power failure, a network outage, a server failure, and the like, a client records a location parameter of read data information, that is, a loc parameter, and carries the location parameter in a next HTTP push request, so as to identify a start location of reading the data information.
As described above, the memory stores data information by using a data structure of a skip list, each stored data information is identified by corresponding location parameters, for example, 2000 pieces of data information are initially stored in the skip list, the corresponding location parameters may be set to 0 to 1999 (identification values), the database module writes the data information in batches, and if each batch is 2000 pieces, after one update of the skip list, the corresponding location parameters are 2000 to 3999, and the identification values may not be recycled. The push request processing module inquires whether a position corresponding to the loc parameter exists in a skip list of the memory according to the loc parameter carried in the HTTP push request, if so, reads data information behind the data information of the position corresponding to the loc parameter and pushes the data information to the client, and if not, reads the data information behind the data information of the position corresponding to the loc parameter from the database module and pushes the data information to the client. Therefore, the client can acquire the required data information from the skip list by recording the loc parameter of the received data information, so that random reading and writing of the skip list are realized, and the transmission quantity of the data information is effectively reduced.
Preferably, the HTTP push request may further carry a transmission parameter and/or a data information attribute parameter, so that the push request processing module performs corresponding processing according to the transmission parameter and/or the data information attribute parameter, wherein,
the transmission parameters include: a PB parameter and a JavaScript object Notation (JSON) parameter, where JSON and PB are different values of the same parameter. The parameter types include fomat, loc, filter, etc. Preferably, the data information attribute parameter is set by a filter parameter.
Fig. 3 is another schematic structural diagram of a data pushing system according to an embodiment of the present invention. Referring to fig. 3, the system includes: the system comprises a data source, a data information collector, a queue processor, a database, a Jetty server and a client, wherein the data information collector comprises a message queue, and the queue processor, the database and the Jetty server form a data information pusher.
The data information collector collects data information from a data source, the data information is processed through a message queue and output to the queue processor, the data information is written into the database after being processed by the queue processor, the database loads the latest data information into the memory, the Jetty server receives the HTTP push request, the memory and the database are sequentially inquired, the data information corresponding to the HTTP push request is obtained, and the data information is pushed to the client.
The following describes in detail a data information processing flow of a data information collector, a data information pusher, and a client in a data information push system, taking the data push system as a microblog data information push system as an example. Wherein,
the data information collector is a microblog master station, and the microblog master station is used for packaging various updated data information into messages according to the time sequence of the data information when the data information is determined to be updated, and sending the packaged messages to the data information pusher through excitation.
And the data information pusher is used for responding to the HTTP pushing request of the user in a Comet mode, and continuously reading the tail end of the skip list (skip list) from the memory so as to return the latest data information to the user.
In the embodiment of the invention, after a classification module in a data information pusher receives a message containing data information, the message is classified according to the data information attribute and classified into microblog sending information, microblog forwarding information, friend information, private information and the like;
the queue handler parses the classified messages, packages the parsed messages in a data format supported by the client, for example, packages the sorted and classified data information in a pb (protocol buffers) format, and inserts 50 rows of data information into the database module in a batch operation manner, for example, in one SQL statement. In this way, it can be ensured that the data information obtained by the user is ordered.
The user sends an HTTP push request to request data information push through the client, the data information pusher responds to the HTTP push request of the user in a Comet mode, and the latest data information is returned to the user by continuously reading the tail of a skip list (skip list) from a memory. In particular, the present invention relates to a method for producing,
after an authority verification module of the data information pusher receives the HTTP pushing request, the HTTP pushing request is analyzed, parameters carried in the HTTP pushing request are obtained, whether a user requesting to push is legal or not is verified according to the obtained application identification (api) parameters, if the user passes the validity verification, the user is indicated to have the authority of obtaining the data pushing service, if the user does not pass the validity verification, the user is indicated to not have the authority of obtaining the data pushing service, the authority verification module returns a null value, and the service pushing request is rejected.
In the embodiment of the present invention, when an exception occurs in a push process, for example, when data information push is suspended due to a power failure, a network outage, a server failure, and the like, a client may further record a location parameter of read data information, that is, a loc parameter, which is carried in a next HTTP push request, and is used to identify a start location of reading data information, where the loc parameter value is defaulted to be-1, that is, the data information is read from the initial location in the memory. If the value is other value, after the TCP connection is recovered next time, reading from the position where the other value is recorded is defaulted, and certainly, in practical application, the data information in the memory may be updated in the process of recovering the TCP connection, so that the position where the other value is recorded cannot be queried in the memory, and the database module may be searched, thereby obtaining the data information after the data information where the position parameter of the other value is recorded.
In practical applications, a user may also control a requested data information transmission format by setting a transmission parameter of the data information, that is, a transmission format (format), and since different clients require parameters of different formats, the client specifies the required data information transmission format when sending the HTTP push request. In the embodiment of the invention, two formats of a PB (Java server Object) and a JavaScript Object Notation (JSON, JavaScript Object Notation) of a lightweight data exchange format are supported. If the data information transmission format set by the client is not JSON, the user can select the format for pushing the microblog data information through the filter parameter, namely setting the attribute parameter of the data information. The format of the filter parameter is "type, event", for example, "filter = comment, add", which means that only a message of which type (type) is comment (comment) and event (event) is add is acquired.
In practical applications, type and event can also support wildcards, so that by setting the format of the filter parameter to "filter = comment", all messages with type as comment can be acquired.
And after the data information pusher analyzes and confirms the parameters, reading the data information according to the setting in the filter parameter, firstly loading the data information from the memory during reading, and reading the database to acquire the read data information when the data information needing to be read does not exist in the memory. In practice, the data information presenter may be arranged to be disconnected every 10 minutes.
In the embodiment of the invention, the push function of the HTTP long connection can be realized by using a Jetty server. If the user does not specify the position parameter for reading the data information, reading the last key of the skiplist by default, namely the latest 2000 pieces of data information, if the user specifies the position parameter for reading the data information, searching in the skiplist, if the reading position is found, pushing the data information to the client side to which the user belongs from the specified position, and if the reading position is not found in the skiplist, loading from a database. Therefore, the user can be guaranteed to always acquire complete data information.
And the client requests the data information pusher for the data information with the format corresponding to the type of the client according to the type of the client when sending the pushing request.
In the embodiment of the invention, the client side requests the latest data information by default, and the client side program receives the data information pushed by the data information pusher through the data receiving module and sends the data information to the appointed position of the client side through the sending module so that the client side reads the corresponding data information.
In the embodiment of the invention, the database can adopt an open source tool relational database (Mysql), the application server can adopt an open source tool Jetty server, the data serialization tool can adopt an open source tool Protocol buffer (Protocol Buffers), and the message queue can adopt an open source tool persistent message queue Memcacheq.
As can be seen from the above, the data information pushing method provided in the embodiment of the present invention can solve the problem of pushing massive data information without increasing or slightly increasing the cost of related hardware, and can ensure real-time and reliable data information pushing in social platform applications with large data information scale and high updating speed. The system constructed by the embodiment of the invention provides the information push service in a large-scale data platform and achieves good effect.
Fig. 4 is a flowchart illustrating a method for pushing data information according to an embodiment of the present invention. Referring to fig. 4, the process includes:
in this step, the storing includes:
storing the data information arranged according to the release time sequence into a database;
and the database sequentially writes the stored data information which is arranged according to the release time sequence into a memory which adopts a data structure of a skip list to store the data information.
Preferably, before the storing, the method further comprises:
and classifying the data information arranged according to the release time sequence according to the data information attribute.
In this step, the data information attribute may be divided according to different application services, for example, for microblog data information, the data information attribute may include: sending a microblog, forwarding the microblog, paying attention to a friend, sending a private message, commenting the microblog and the like.
In practical applications, after the step of classifying and before the step of storing, the method may further include:
and receiving the classified data information, and converting the data information into a data format supported by the client.
In this step, the classified data information is encapsulated according to the data format supported by the client and sequentially output to the database.
Preferably, the data format is the PB format.
In this step, querying the stored data information, and acquiring the data information corresponding to the HTTP push request includes:
inquiring whether data information corresponding to the HTTP push request is stored in a memory according to the HTTP push request of the client;
if so, pushing the data information obtained by the query to the client;
and if the data information corresponding to the HTTP push request is not inquired, the data information is pushed to the client, and if the data information corresponding to the HTTP push request is not inquired, the push request failure information is returned to the client.
The method further comprises the following steps:
the client receives the pushed and packaged data information through HTTP long connection;
and after the client processes the data information, sending the HTTP pushing request again, and reestablishing the TCP connection.
In practical applications, after the client receives the pushed encapsulated data information, the method may further include:
recording the position parameter information of the finally received data information, and carrying the position parameter information when the HTTP push request is initiated next time;
the querying stored data information and the obtaining data information corresponding to the HTTP push request include:
according to the loc parameter carried in the HTTP push request, inquiring whether a position corresponding to the loc parameter exists in the memory, if so, reading data information behind the data information of the position corresponding to the loc parameter and pushing the data information to the client, and if not, reading the data information behind the data information of the position corresponding to the loc parameter from the database module and pushing the data information to the client.
Preferably, the HTTP push request further carries an application identification parameter for authenticating the user, and the method further includes:
analyzing an HTTP push request sent by a client, acquiring application identification parameters carried in the HTTP push request, carrying out validity verification on a user requesting to push, determining that the user passes the validity verification, and triggering to establish an HTTP long connection.
Preferably, the HTTP push request may further carry a transmission parameter and/or a data information attribute parameter, so that the push request processing module performs corresponding processing according to the transmission parameter and/or the data information attribute parameter, wherein,
the transmission parameters include: PB parameter and JavaScript object Notation (JSON) parameter. Preferably, the data information attribute parameter is set by a filter parameter.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention also encompasses these modifications and variations.
Claims (17)
1. A method of pushing data information, comprising:
receiving and storing data information arranged according to the release time sequence, wherein the data information is collected from an external information source in real time;
the method comprises the steps of receiving a hypertext transfer protocol (HTTP) push request of a client, inquiring stored data information, obtaining data information corresponding to the HTTP push request, packaging, and pushing to the client through HTTP long connection.
2. The method of claim 1, wherein the storing comprises:
storing the data information arranged according to the release time sequence into a database;
and the database sequentially writes the stored data information which is arranged according to the release time sequence into a memory which adopts a data structure of a skip list to store the data information.
3. The method of claim 2, wherein prior to said storing, the method further comprises:
and classifying the data information arranged according to the release time sequence according to the data information attribute.
4. The method of claim 3, wherein after the step of classifying and before the step of storing, the method further comprises:
and receiving the classified data information, and converting the data information into a data format supported by the client.
5. The method of claim 4, wherein the querying stored data information and obtaining data information corresponding to an HTTP push request comprises:
inquiring whether data information corresponding to the HTTP push request is stored in a memory according to the HTTP push request of the client;
if so, pushing the data information obtained by the query to the client;
and if the data information corresponding to the HTTP push request is not inquired, the data information is pushed to the client, and if the data information corresponding to the HTTP push request is not inquired, the push request failure information is returned to the client.
6. The method of claim 5, wherein the client communicates with the server over HTTP long connection technology.
7. The method of any of claims 1 to 6, wherein the method further comprises:
the client receives the pushed and packaged data information through HTTP long connection;
and after the JavaScript response processing function of the client processes the data information, sending the HTTP push request again, and reestablishing the TCP connection.
8. The method of claim 7, wherein after the client receives the pushed encapsulated data information, the method further comprises:
recording the position parameter information of the finally received data information, and carrying the position parameter information when the HTTP push request is initiated next time;
the querying stored data information and the obtaining data information corresponding to the HTTP push request include:
according to the position parameters carried in the HTTP push request, inquiring whether the position corresponding to the position parameters exists in the memory, if so, reading the data information behind the data information of the position corresponding to the position parameters and pushing to the client, and if not, reading the data information behind the data information of the position corresponding to the position parameters from the database module and pushing to the client.
9. The method of claim 8, wherein the HTTP push request further carries an application identification parameter for authenticating a user, the method further comprising:
analyzing an HTTP push request sent by a client, acquiring application identification parameters carried in the HTTP push request, carrying out validity verification on a user requesting to push, determining that the user passes the validity verification, and triggering to establish an HTTP long connection.
10. The method according to claim 9, wherein the HTTP push request further carries a transmission parameter and/or a data information attribute parameter.
11. A data push system, the system comprising: a data information collector, a data information pusher and a client, wherein,
the data information collector is used for collecting data information issued in real time from an external information source, arranging the data information according to the time sequence of issuing the data information and outputting the data information to the data information pusher;
the data information pusher is used for receiving a hypertext transfer protocol (HTTP) push request of the client, inquiring the stored data information through parameters carried in the HTTP push request, acquiring data information corresponding to the parameters carried in the HTTP push request, packaging the data information, and pushing the data information to the client through HTTP long connection;
and the client is used for sending an HTTP pushing request to the data information pusher, receiving the encapsulated data information pushed by the data information pusher through HTTP long connection, and processing the encapsulated data information.
12. The system of claim 11, wherein the data information collector comprises: a data information collection module and a message queue module, wherein,
the data information collection module is used for collecting data information issued in real time from an external information source and outputting the data information to the message queue module;
and the message queue module is used for arranging the received data information according to the time sequence of data information release and outputting the data information to the data information pusher.
13. The system of claim 12, wherein the data information pusher comprises: an HTTP long connection module, a memory module, a database module and a push request processing module, wherein,
the HTTP long connection module is used for receiving an HTTP push request of the client and establishing HTTP long connection with the client;
the database module is used for receiving the data information output by the message queue module, storing the data information and outputting the data information to the memory module so as to update the content in the content module in real time;
the memory module is used for storing the data information output by the database module by adopting a first-in first-out strategy and realizing quick positioning by using a skiplist;
the push request processing module is used for inquiring the memory module according to the HTTP push request of the client, and pushing the inquired data information to the client if the data information corresponding to the HTTP push request is inquired; and if the data information corresponding to the HTTP pushing request is not acquired, querying the database module, if the data information corresponding to the HTTP pushing request is queried, pushing the data information to the client, and if the data information corresponding to the HTTP pushing request is not queried, returning pushing request failure information to the client.
14. The system of claim 13, wherein the data information pusher further comprises:
and the classification module is used for receiving the data information output by the message queue module, classifying according to the data information attribute and outputting the classified data information to the database module.
15. The system of claim 14, wherein the data information pusher further comprises:
and the queue processor is used for receiving the classified data information output by the classification module, converting the classified data information into a data format supported by the client, and outputting the data to the database module by using the message queue.
16. The system according to any one of claims 13 to 15, wherein the HTTP push request carries an application identification parameter for authenticating a user, and the data information pusher further comprises:
and the permission verification module is used for analyzing the received HTTP push request, acquiring the application identification parameters carried in the HTTP push request, verifying the validity of the user requesting to push, determining that the user passes the validity verification, and triggering the push request processing module to process the user.
17. The system according to any one of claims 13 to 15,
the client is further used for recording the position parameter information of the finally received data information after receiving the encapsulated data information pushed by the data information pusher, and carrying the position parameter in the next HTTP pushing request;
the push request processing module is further used for inquiring whether a position corresponding to the position parameter exists in the memory module according to the position parameter carried in the HTTP push request, if so, reading data information behind the data information of the position corresponding to the position parameter and pushing the data information to the client, and if not, reading the data information behind the data information of the position corresponding to the position parameter from the database module and pushing the data information to the client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013100012678A CN103095819A (en) | 2013-01-04 | 2013-01-04 | Data information pushing method and data information pushing system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013100012678A CN103095819A (en) | 2013-01-04 | 2013-01-04 | Data information pushing method and data information pushing system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103095819A true CN103095819A (en) | 2013-05-08 |
Family
ID=48207942
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2013100012678A Pending CN103095819A (en) | 2013-01-04 | 2013-01-04 | Data information pushing method and data information pushing system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103095819A (en) |
Cited By (33)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103647768A (en) * | 2013-12-06 | 2014-03-19 | 北京奇虎科技有限公司 | Game client and realization method thereof |
| CN103780692A (en) * | 2014-01-13 | 2014-05-07 | 中国科学院计算技术研究所 | Data access method and system for key value storage |
| CN103944923A (en) * | 2014-05-14 | 2014-07-23 | 沈文策 | Network information processing system and method |
| CN103944979A (en) * | 2014-04-09 | 2014-07-23 | Tcl集团股份有限公司 | Method, device and system for message pushing |
| CN104023072A (en) * | 2014-06-13 | 2014-09-03 | 中国民航信息网络股份有限公司 | Device and method for pushing data |
| CN104243598A (en) * | 2014-09-25 | 2014-12-24 | 海信集团有限公司 | Information recommendation method and device |
| CN104317922A (en) * | 2014-10-29 | 2015-01-28 | 中国农业银行股份有限公司 | Data push system and method |
| CN104346362A (en) * | 2013-07-29 | 2015-02-11 | 腾讯科技（深圳）有限公司 | Method and device for finding target objects on basis of attribute values |
| CN104394212A (en) * | 2014-11-23 | 2015-03-04 | 国云科技股份有限公司 | Real-time message pushing method for website |
| CN104580294A (en) * | 2013-10-16 | 2015-04-29 | 博雅网络游戏开发（深圳）有限公司 | Method and device for displaying server information |
| CN104683325A (en) * | 2014-12-01 | 2015-06-03 | 苏州朗米尔照明科技有限公司 | Method for performing personalized information push on basis of comet connections |
| CN105339915A (en) * | 2013-06-28 | 2016-02-17 | 日本电气株式会社 | Push-type information transmission device, push-type information transmission method, and program |
| CN105376209A (en) * | 2014-09-02 | 2016-03-02 | 松下电器产业株式会社 | Network agent equipment, building monitoring system and method thereof |
| CN106973109A (en) * | 2017-03-31 | 2017-07-21 | 努比亚技术有限公司 | Broadcast message pushes control method and device |
| CN107066551A (en) * | 2017-03-23 | 2017-08-18 | 中国科学院计算技术研究所 | The line and column storage method and system of a kind of tree shaped data |
| WO2017167020A1 (en) * | 2016-03-28 | 2017-10-05 | 阿里巴巴集团控股有限公司 | Configuration information push method and device |
| CN107360082A (en) * | 2017-07-28 | 2017-11-17 | 郑州云海信息技术有限公司 | A kind of publish/subscribe method and device |
| CN107562415A (en) * | 2017-08-18 | 2018-01-09 | 武汉斗鱼网络科技有限公司 | A kind of paster functional framework implementation method and equipment |
| CN108111634A (en) * | 2018-02-28 | 2018-06-01 | 北京焦点新干线信息技术有限公司 | A kind of instant data transmission method and system based on websocket protocol Yu http agreements |
| CN108337280A (en) * | 2017-01-20 | 2018-07-27 | 贵州白山云科技有限公司 | A kind of resource regeneration method and device |
| CN109033289A (en) * | 2018-07-13 | 2018-12-18 | 天津瑞能电气有限公司 | A kind of banking procedure of the high frequency real time data for micro-capacitance sensor |
| CN109144735A (en) * | 2018-09-29 | 2019-01-04 | 百度在线网络技术（北京）有限公司 | Method and apparatus for handling data |
| CN109213778A (en) * | 2017-07-07 | 2019-01-15 | 北方工业大学 | Streaming data sliding window aggregation query method |
| CN109547511A (en) * | 2017-09-22 | 2019-03-29 | 中国移动通信集团浙江有限公司 | A kind of real-time method for pushing of WEB message, server, client and system |
| CN109951810A (en) * | 2019-02-21 | 2019-06-28 | 深圳供电局有限公司 | Method and system for paying attention to power failure event |
| CN110932924A (en) * | 2019-10-28 | 2020-03-27 | 深圳市钱海网络技术有限公司 | Message pushing method and device for communication between APP and server |
| CN111555955A (en) * | 2020-03-26 | 2020-08-18 | 福州慧校通教育信息技术有限公司 | Method, device, equipment and medium for implementing message center |
| CN112463251A (en) * | 2020-12-03 | 2021-03-09 | 中国建设银行股份有限公司 | Method and device for configuring hot publishing by uliweb framework |
| CN112507193A (en) * | 2020-10-30 | 2021-03-16 | 长沙市到家悠享网络科技有限公司 | Data updating method, device, equipment and storage medium |
| CN112532681A (en) * | 2020-10-16 | 2021-03-19 | 深圳市科漫达智能管理科技有限公司 | Parking lot software data exception handling method and device |
| CN113836153A (en) * | 2021-08-16 | 2021-12-24 | 紫光云(南京)数字技术有限公司 | Method and system for instantly updating enterprise address book at mobile terminal |
| CN114938367A (en) * | 2022-06-17 | 2022-08-23 | 中国平安人寿保险股份有限公司 | Batch job processing method, system, device and medium |
| CN116737839A (en) * | 2023-08-10 | 2023-09-12 | 中国电子投资控股有限公司 | Product synchronization method under network limitation condition |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1713574A (en) * | 2004-06-25 | 2005-12-28 | 深圳市傲天通信有限公司 | Delivering system of webpage information of internet |
| CN101426181A (en) * | 2008-11-12 | 2009-05-06 | 中国移动通信集团广东有限公司 | Intelligent multimedia information mobile phone viewing system having instant interaction and implementation method |
| CN101599982A (en) * | 2008-06-06 | 2009-12-09 | 广东宇天信通通信科技有限公司 | Cellphone information browsing apparatus, system and implementation method |
| CN102035868A (en) * | 2009-09-28 | 2011-04-27 | 上海智臻网络科技有限公司 | Method and device for implementing webpage automatic customer service |
| CN102404698A (en) * | 2010-09-15 | 2012-04-04 | 中国移动通信集团公司 | Wireless mail pushing method, device and system |
| CN102413436A (en) * | 2011-09-14 | 2012-04-11 | 华为技术有限公司 | Method and system for transmitting information, and browser on mobile terminal |
| CN102843406A (en) * | 2011-06-24 | 2012-12-26 | 深圳深讯和科技有限公司 | Method and system of data interaction |
-
2013
- 2013-01-04 CN CN2013100012678A patent/CN103095819A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1713574A (en) * | 2004-06-25 | 2005-12-28 | 深圳市傲天通信有限公司 | Delivering system of webpage information of internet |
| CN101599982A (en) * | 2008-06-06 | 2009-12-09 | 广东宇天信通通信科技有限公司 | Cellphone information browsing apparatus, system and implementation method |
| CN101426181A (en) * | 2008-11-12 | 2009-05-06 | 中国移动通信集团广东有限公司 | Intelligent multimedia information mobile phone viewing system having instant interaction and implementation method |
| CN102035868A (en) * | 2009-09-28 | 2011-04-27 | 上海智臻网络科技有限公司 | Method and device for implementing webpage automatic customer service |
| CN102404698A (en) * | 2010-09-15 | 2012-04-04 | 中国移动通信集团公司 | Wireless mail pushing method, device and system |
| CN102843406A (en) * | 2011-06-24 | 2012-12-26 | 深圳深讯和科技有限公司 | Method and system of data interaction |
| CN102413436A (en) * | 2011-09-14 | 2012-04-11 | 华为技术有限公司 | Method and system for transmitting information, and browser on mobile terminal |
Cited By (50)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10122812B2 (en) | 2013-06-28 | 2018-11-06 | Nec Corporation | Push-type information transmission device, push-type information transmission method, and program |
| CN105339915B (en) * | 2013-06-28 | 2018-08-24 | 日本电气株式会社 | Push-type information transmitting apparatus, push-type method for sending information and program |
| CN105339915A (en) * | 2013-06-28 | 2016-02-17 | 日本电气株式会社 | Push-type information transmission device, push-type information transmission method, and program |
| CN104346362B (en) * | 2013-07-29 | 2019-03-26 | 腾讯科技（深圳）有限公司 | A kind of method and apparatus that target object is searched based on attribute value |
| CN104346362A (en) * | 2013-07-29 | 2015-02-11 | 腾讯科技（深圳）有限公司 | Method and device for finding target objects on basis of attribute values |
| CN104580294A (en) * | 2013-10-16 | 2015-04-29 | 博雅网络游戏开发（深圳）有限公司 | Method and device for displaying server information |
| CN104580294B (en) * | 2013-10-16 | 2017-12-01 | 深圳市东方博雅科技有限公司 | Show the method and device of server info |
| CN103647768A (en) * | 2013-12-06 | 2014-03-19 | 北京奇虎科技有限公司 | Game client and realization method thereof |
| CN103780692B (en) * | 2014-01-13 | 2017-01-11 | 中国科学院计算技术研究所 | Data access method and system for key value storage |
| CN103780692A (en) * | 2014-01-13 | 2014-05-07 | 中国科学院计算技术研究所 | Data access method and system for key value storage |
| CN103944979A (en) * | 2014-04-09 | 2014-07-23 | Tcl集团股份有限公司 | Method, device and system for message pushing |
| CN103944923A (en) * | 2014-05-14 | 2014-07-23 | 沈文策 | Network information processing system and method |
| CN104023072A (en) * | 2014-06-13 | 2014-09-03 | 中国民航信息网络股份有限公司 | Device and method for pushing data |
| CN105376209A (en) * | 2014-09-02 | 2016-03-02 | 松下电器产业株式会社 | Network agent equipment, building monitoring system and method thereof |
| CN104243598A (en) * | 2014-09-25 | 2014-12-24 | 海信集团有限公司 | Information recommendation method and device |
| CN104243598B (en) * | 2014-09-25 | 2017-07-25 | 海信集团有限公司 | A kind of information recommendation method and device |
| CN104317922A (en) * | 2014-10-29 | 2015-01-28 | 中国农业银行股份有限公司 | Data push system and method |
| CN104394212A (en) * | 2014-11-23 | 2015-03-04 | 国云科技股份有限公司 | Real-time message pushing method for website |
| CN104683325A (en) * | 2014-12-01 | 2015-06-03 | 苏州朗米尔照明科技有限公司 | Method for performing personalized information push on basis of comet connections |
| CN107241204A (en) * | 2016-03-28 | 2017-10-10 | 阿里巴巴集团控股有限公司 | Configuration information method for pushing and device |
| WO2017167020A1 (en) * | 2016-03-28 | 2017-10-05 | 阿里巴巴集团控股有限公司 | Configuration information push method and device |
| CN108337280A (en) * | 2017-01-20 | 2018-07-27 | 贵州白山云科技有限公司 | A kind of resource regeneration method and device |
| CN108337280B (en) * | 2017-01-20 | 2019-12-20 | 北京数安鑫云信息技术有限公司 | Resource updating method and device |
| CN107066551A (en) * | 2017-03-23 | 2017-08-18 | 中国科学院计算技术研究所 | The line and column storage method and system of a kind of tree shaped data |
| CN107066551B (en) * | 2017-03-23 | 2020-04-03 | 中国科学院计算技术研究所 | Row-type and column-type storage method and system for tree-shaped data |
| CN106973109B (en) * | 2017-03-31 | 2020-06-09 | 南京秦淮紫云创益企业服务有限公司 | Broadcast message push control method and device |
| CN106973109A (en) * | 2017-03-31 | 2017-07-21 | 努比亚技术有限公司 | Broadcast message pushes control method and device |
| CN109213778B (en) * | 2017-07-07 | 2023-07-18 | 北方工业大学 | Stream data sliding window gathering query method |
| CN109213778A (en) * | 2017-07-07 | 2019-01-15 | 北方工业大学 | Streaming data sliding window aggregation query method |
| CN107360082A (en) * | 2017-07-28 | 2017-11-17 | 郑州云海信息技术有限公司 | A kind of publish/subscribe method and device |
| CN107360082B (en) * | 2017-07-28 | 2020-08-25 | 苏州浪潮智能科技有限公司 | Publishing/subscribing method and device |
| CN107562415A (en) * | 2017-08-18 | 2018-01-09 | 武汉斗鱼网络科技有限公司 | A kind of paster functional framework implementation method and equipment |
| CN109547511B (en) * | 2017-09-22 | 2022-02-22 | 中国移动通信集团浙江有限公司 | WEB message real-time pushing method, server, client and system |
| CN109547511A (en) * | 2017-09-22 | 2019-03-29 | 中国移动通信集团浙江有限公司 | A kind of real-time method for pushing of WEB message, server, client and system |
| CN108111634A (en) * | 2018-02-28 | 2018-06-01 | 北京焦点新干线信息技术有限公司 | A kind of instant data transmission method and system based on websocket protocol Yu http agreements |
| CN108111634B (en) * | 2018-02-28 | 2020-11-20 | 北京焦点新干线信息技术有限公司 | Instant data transmission method and system based on websocket protocol and http protocol |
| CN109033289A (en) * | 2018-07-13 | 2018-12-18 | 天津瑞能电气有限公司 | A kind of banking procedure of the high frequency real time data for micro-capacitance sensor |
| CN109144735A (en) * | 2018-09-29 | 2019-01-04 | 百度在线网络技术（北京）有限公司 | Method and apparatus for handling data |
| CN109951810A (en) * | 2019-02-21 | 2019-06-28 | 深圳供电局有限公司 | Method and system for paying attention to power failure event |
| CN109951810B (en) * | 2019-02-21 | 2022-05-13 | 深圳供电局有限公司 | Method and system for paying attention to power failure event |
| CN110932924A (en) * | 2019-10-28 | 2020-03-27 | 深圳市钱海网络技术有限公司 | Message pushing method and device for communication between APP and server |
| CN111555955B (en) * | 2020-03-26 | 2022-08-05 | 福州慧校通教育信息技术有限公司 | Method, device, equipment and medium for implementing message center |
| CN111555955A (en) * | 2020-03-26 | 2020-08-18 | 福州慧校通教育信息技术有限公司 | Method, device, equipment and medium for implementing message center |
| CN112532681A (en) * | 2020-10-16 | 2021-03-19 | 深圳市科漫达智能管理科技有限公司 | Parking lot software data exception handling method and device |
| CN112507193A (en) * | 2020-10-30 | 2021-03-16 | 长沙市到家悠享网络科技有限公司 | Data updating method, device, equipment and storage medium |
| CN112463251A (en) * | 2020-12-03 | 2021-03-09 | 中国建设银行股份有限公司 | Method and device for configuring hot publishing by uliweb framework |
| CN113836153A (en) * | 2021-08-16 | 2021-12-24 | 紫光云(南京)数字技术有限公司 | Method and system for instantly updating enterprise address book at mobile terminal |
| CN114938367A (en) * | 2022-06-17 | 2022-08-23 | 中国平安人寿保险股份有限公司 | Batch job processing method, system, device and medium |
| CN114938367B (en) * | 2022-06-17 | 2023-09-22 | 中国平安人寿保险股份有限公司 | Batch job processing method, system, equipment and medium |
| CN116737839A (en) * | 2023-08-10 | 2023-09-12 | 中国电子投资控股有限公司 | Product synchronization method under network limitation condition |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103095819A (en) | Data information pushing method and data information pushing system | |
| CN110147398B (en) | Data processing method, device, medium and electronic equipment | |
| CN111787066B (en) | Internet of things data platform based on big data and AI | |
| CN109684358B (en) | Data query method and device | |
| CN103024014B (en) | By the method and system of the mass data distribution processor of message queue | |
| CN112507029B (en) | Data processing system and data real-time processing method | |
| WO2016177285A1 (en) | Data pushing method and device | |
| CN113254466B (en) | Data processing method and device, electronic equipment and storage medium | |
| CN110837423B (en) | Method and device for automatically guiding data acquisition of transport vehicle | |
| KR20140072044A (en) | Distributing multi-source push notifications to multiple targets | |
| CN103064731A (en) | Device and method for improving message queue system performance | |
| CN112162965B (en) | Log data processing method, device, computer equipment and storage medium | |
| WO2007115477A1 (en) | Data synchronization method und system | |
| CN104765840A (en) | Big data distributed storage method and device | |
| US20150256504A1 (en) | Distributed synchronization data in a message management service | |
| CN104794190A (en) | Method and device for effectively storing big data | |
| CN111813573B (en) | Communication method of management platform and robot software and related equipment thereof | |
| CN111641700B (en) | Ceph object-based management and retrieval implementation method for storage metadata | |
| Bhimani et al. | Message delivery guarantee and status update of clients based on IOT-AMQP | |
| CN104750855A (en) | Method and device for optimizing big data storage | |
| CN107451301B (en) | Processing method, device, equipment and storage medium for real-time delivery bill mail | |
| EP3803616A1 (en) | Change notifications for object storage | |
| CN110798495B (en) | Method and server for end-to-end message push in cluster architecture mode | |
| CN104142941A (en) | Mass positioning data storing method | |
| CN108183966A (en) | A kind of cloud stocking system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20130508 |