CN105100271A - System for publishing distributed flexible extension information and control method thereof - Google Patents

System for publishing distributed flexible extension information and control method thereof Download PDF

Info

Publication number
CN105100271A
CN105100271A CN201510545644.3A CN201510545644A CN105100271A CN 105100271 A CN105100271 A CN 105100271A CN 201510545644 A CN201510545644 A CN 201510545644A CN 105100271 A CN105100271 A CN 105100271A
Authority
CN
China
Prior art keywords
message
cluster
kafka
module
virtual machine
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510545644.3A
Other languages
Chinese (zh)
Inventor
张枭翼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Zhixing Software Development Co Ltd
Original Assignee
Nanjing Zhixing Software Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Zhixing Software Development Co Ltd filed Critical Nanjing Zhixing Software Development Co Ltd
Priority to CN201510545644.3A priority Critical patent/CN105100271A/en
Publication of CN105100271A publication Critical patent/CN105100271A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004Server selection for load balancing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/06Management of faults, events, alarms or notifications
    • H04L41/0654Management of faults, events, alarms or notifications using network fault recovery
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1031Controlling of the operation of servers by a load balancer, e.g. adding or removing servers that serve requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1034Reaction to server failures by a load balancer

Abstract

The invention discloses a system for publishing distributed flexible extension information. The system comprises a flexible deployment module, a message pre-processing cluster, a Kafka cluster and a message distributing cluster; the message pre-processing cluster is used for sending a request sent by a user to an idle node in the cluster to process, and sending a Kafka message to the Kafka cluster; the Kafka cluster is used for receiving the Kafka message and publishing the received Kafka message on a corresponding node in the message distributing cluster; the message distributing cluster is used for sending the message to a corresponding terminal through a corresponding sending tool according to the type of the message; and the flexible deployment module is used for monitoring the working conditions of various nodes in the message pre-processing cluster, the Kafka cluster and the message distributing cluster, increasing or replacing a new node according to the working conditions of various nodes, and simultaneously giving an alarm to the user, wherein each node is a virtual machine. The invention further provides a control method of the system for publishing the distributed flexible extension information. According to the invention, the capacity of a server can be rapidly expanded; and furthermore, information can be transmitted to a client side in time effectively.

Description

A kind of distributed elastic easily extensible information issuing system and control method thereof
Technical field
The invention belongs to computer communication field, particularly a kind of distributed elastic easily extensible information issuing system and control method thereof.
Background technology
Present stage has had a lot such as, in computer or the mode at mobile terminal transmission of information, note, mobile phone application internal information, Email, phone, or the chat software etc. on computer.The function that these softwares current provide is interpersonal transmission of information mainly.After these functions and application occur, the interface that some companies start to provide batch to release news or instrument.Such as people utilize short message interface can Batch sending note, utilize email interface can Batch sending Email.Instantly these application are confined to sole user or minute quantity user sends, and in time having user in enormous quantities to send information in enormous quantities, information delivery server cannot bear sending request of magnanimity, can only expand capacity by the mode increasing server temporarily.And once server fail, whole system will stay cool.If server only has one, then cannot serve more user, reach the bottleneck of service.Have user in enormous quantities in this service, or when user grows at top speed, service is difficult to guarantee information can be delivered to client timely, the process expanding server capacity is too slow.
Summary of the invention
Goal of the invention: the object of the invention is to for the deficiencies in the prior art, provides one to be applicable to user in enormous quantities, can communicate information to a kind of distributed elastic easily extensible information issuing system of client in time.
Technical scheme: the invention provides a kind of distributed elastic easily extensible information issuing system, comprises elasticity deployment module, message preliminary treatment cluster, Kafka cluster and message distribution cluster; The request that described message preliminary treatment cluster is used for user being sent is sent to node idle in cluster and processes, and sends Kafka message to Kafka cluster; Described Kafka cluster is for receiving Kafka message and by node corresponding in message distribution cluster for the Kafka news release that receives; Described message distribution cluster is sent to corresponding terminal according to the type of message by corresponding transmission instrument message; Described elasticity deployment module is used for the working condition of each node in monitoring message preliminary treatment cluster, Kafka cluster and message distribution cluster, and according to the node that the working condition of each node increases or more renews, give the alarm to user, wherein each node is a virtual machine simultaneously.
Further, described message preliminary treatment cluster comprises a message pretreatment module load-balanced server and multiple message pretreatment module of expanding, this module can increase according to increasing of request amount, described each message pretreatment module of expanding is deployed on a virtual machine, message pretreatment module load-balanced server is for searching the message expanded pretreatment module idle in cluster, and the user received is asked to be sent to expand message pretreatment module, described message pretreatment module of expanding is anticipated the user's request received, and issue Kafka message according to the request of user, described Kafka cluster comprises a Kafka cluster load balance server and multiplely expands Kafka node, expanded Kafka node idle in described Kafka cluster load balance whois lookup cluster, and the Kafka message received is sent to idle expanded Kafka node, the described Kafka of expansion node generates Hash codes according to the Kafka message content received, and the Hash codes of generation and Kafka message are sent to message distribution cluster, described message distribution cluster comprises load-balanced server and multiplely expands message distribution module, load-balanced server is responsible for receiving the request from Kafka node, and according to the message distribution the expanded module loading condition in message distribution cluster, dispense request, if find the module of low load, information by by priority allocation in the module of low load, described message distribution module of expanding sends information according to the type of the message received by corresponding transmission instrument.
Further, the virtual machine in described message preliminary treatment cluster, Kafka cluster and message distribution cluster belongs to a private network, and each cluster is mutually by Http protocol access.
Present invention also offers a kind of control method of distributed elastic easily extensible information issuing system, comprise the following steps:
Step 1: multiple virtual machine is set in information delivery server, and multiple virtual machine is assigned in message preliminary treatment cluster, Kafka cluster and message distribution cluster; Wherein, the message distribution the expanded module in the message the expanded pretreatment module in message preliminary treatment cluster, the Kafka node in Kafka cluster and message distribution cluster is deployed in different virtual machines respectively;
Step 2: message pretreatment module load-balanced server receives the request that user sends, searches the idle message expanded pretreatment module, and asks that the user received shift the message the expanded pretreatment module being sent to the free time;
Step 3: message pretreatment module can be expanded the user's request received is processed, and issue Kafka message to Kafka cluster;
Step 4:Kafka cluster generates into Hash according to the content of the message received, by the mode of Hash delivery by news release to expanding in message distribution module accordingly;
Step 5: message distribution module can be expanded and by corresponding transmission instrument, information is sent to terminal according to the type of the message received.
Further, each virtual machine is equipped with the interface of elasticity deployment module, the interface of described elasticity deployment module is used for monitoring the working condition of each virtual machine; Described elasticity deployment module, by the interface on all virtual machines of time interval poll of setting, obtains the loading condition of all virtual machines, if load number exceedes user limit numeral, the reminding user that will give the alarm increases virtual machine; If user sets automatically add virtual machine, elasticity deployment module then distributes new virtual machine automatically in corresponding cluster; If elasticity disposes certain virtual machine of module accesses, but does not respond, then this virtual machine is considered as the machine of delaying by elasticity deployment module, and disposes new virtual machine, and is deployed on new virtual machine by corresponding program division.
Further, in described step 2, message pretreatment module load-balanced server searches the idle message expanded pretreatment module by the algorithm of poll.
Further, in described step 3, Kafka message comprises the type of message being about to be published, and comprises the main contents of message, and publisher's information.
Operation principle: after request is sent to message pretreatment module load-balanced server, message pretreatment module load-balanced server can judge the loading condition of each virtual machine in cluster, according to loading condition, request is transferred on the less virtual machine of load, thus uniform dispense request, request can not be caused all to be sent to a station server and to cause requested many, thus machine of delaying.When the request being sent to message pretreatment module load-balanced server is on the increase time, from message preliminary treatment cluster, the virtual machine in Kafka cluster or message distribution cluster or overloaded cpu occurs, or internal memory overload; When CPU and memory usage exceed certain percentage time, elasticity deployment module will give a warning.According to the setting of user, elasticity deployment module can the new virtual machine of automatic deployment in corresponding cluster, and dispose corresponding module, thus share the request from user.Ensure that whole service can not be stagnated.Node in all clusters of elasticity deployment module meeting poll, when certain virtual machine because time other faults cause not responding, elasticity deployment module can issue alarm in time, set according to user, elasticity deployment module can the new virtual machine of automatic deployment in corresponding cluster, and dispose the module of response, remove out of order virtual machine simultaneously.Thus whole message distribution services can keep normal operation.
Beneficial effect: compared with prior art, the present invention can not only adapt to user in enormous quantities, and be adapted to the situation of user's rapid growth, and can expand the capacity of server fast, effective guarantee information is delivered to client timely.Use convenient.
Accompanying drawing explanation
Fig. 1 is structural representation of the present invention;
Fig. 2 is flow chart of the present invention;
Embodiment
Below in conjunction with accompanying drawing and instantiation, the present invention is specifically described.
As shown in Figure 1, distributed elastic easily extensible information issuing system provided by the invention, comprises elasticity deployment module, message preliminary treatment cluster, Kafka cluster and message distribution cluster.All comprise multiple virtual machine in message preliminary treatment cluster, Kafka cluster and message distribution cluster, each virtual machine is provided with the access interface of elasticity deployment module.Virtual machine in the present invention sets up a kind of environment between computer platform and terminal use, provides a holonomic system platform that can run complete operating system.
Wherein, the request that message preliminary treatment cluster is used for user being sent is sent to node idle in cluster and processes, process comprises renewal in a database or adds message, data structure in database can according to the demand designed, designed of developer, such as information can comprise and accepts user name, accept the phone number of user, email address etc., and send Kafka message to Kafka cluster, wherein, Kafka message comprises the type of message being about to be published, as note, micro-letter, mail etc., and comprise the main contents of message, and publisher's information, as publisher's name, publisher's account (mail, phone, micro-signal etc.).Message preliminary treatment cluster comprises a message pretreatment module load-balanced server and multiplely expands message pretreatment module, and can expand message pretreatment module can increase according to increasing of request amount; Each message pretreatment module of expanding is deployed on a virtual machine, message pretreatment module load-balanced server is for searching the message expanded pretreatment module idle in cluster, and the user received is asked to be sent to expand message pretreatment module, message pretreatment module can be expanded anticipate the user's request received, and issue Kafka message to Kafka cluster according to the request of user.
Kafka cluster is for receiving Kafka message and by node corresponding in message distribution cluster for the Kafka news release that receives.Kafka cluster comprises a Kafka cluster load balance server and multiplely expands Kafka node, and can expand Kafka node can increase according to increasing of request amount; The each Kafka of expansion node is deployed on a virtual machine, expanded Kafka node idle in Kafka cluster load balance whois lookup cluster, and the Kafka message received is sent to idle expanded Kafka node, Kafka node can be expanded and become Hash according to the message content received, by the mode of Hash delivery by news release to expanding in message distribution module accordingly.Wherein hash algorithm is as follows: number can to each message distribution module of expanding here, one total i is individual can expand message distribution module, Kafka message is character string type, if the character string of the Kafka message received is s, obtained the Hash codes h (s) of this character string by the mode of sum of products; Sum of products algorithm is as follows: wherein s [j] represents the certificate ASCII character that in character string, a jth character is corresponding, and n represents the total length of character string s.After obtaining h (s), h (s) and Kafka message are passed in the load balancing service of message distribution cluster, and h (s) obtains k to i delivery, and k is exactly the numbering of the message distribution the expanded module of corresponding receipt message.
Message distribution cluster sends information according to the type of message by corresponding transmission instrument.Message distribution cluster comprises multiplely expands message distribution module, and each message distribution module of expanding is deployed on a virtual machine, can expand message distribution module and send information according to the type of the message received by corresponding transmission instrument.Transmission instrument comprises note cat, smtp server, software interface etc.Described message distribution cluster comprises load-balanced server and multiplely expands message distribution module, and can expand message distribution module can increase according to increasing of request amount; Load-balanced server is responsible for receiving from the request can expanding Kafka node, and according to the module loading condition in message distribution cluster, dispense request, if the module finding low load, information will by priority allocation in this module.
Elasticity deployment module is used for the working condition of each virtual machine in monitoring message preliminary treatment cluster, Kafka cluster and message distribution cluster, and the node that the working condition having more each node increases or more renews, give the alarm to user simultaneously.
As shown in Figure 2, the control method of distributed elastic easily extensible information issuing system provided by the invention, comprises the following steps:
Step 1: multiple virtual machine is set in information delivery server, and multiple virtual machine is assigned in message preliminary treatment cluster, Kafka cluster and message distribution cluster; Wherein, the message distribution the expanded module in the message the expanded pretreatment module in message preliminary treatment cluster, the Kafka node in Kafka cluster and message distribution cluster is deployed in different virtual machines respectively;
Step 2: user's request is in the mode of Restful service, message pretreatment module load-balanced server is sent to by Http agreement, message pretreatment module load-balanced server receives the request that user sends, search the idle message expanded pretreatment module, and ask that the user received shift the message the expanded pretreatment module being sent to the free time; Wherein, message pretreatment module load-balanced server searches the idle message expanded pretreatment module by the algorithm of poll.Here user can comprise messages in batch and issue request, and bulk mail issues request or request etc. is issued in other batch communications.
Step 3: message pretreatment module can be expanded the user's request received is processed, and issue Kafka message to Kafka cluster; Wherein, Kafka message comprises the type of message being about to be published, and comprises the main contents of message, and the information in user's request.
Step 4:Kafka cluster generates Hash codes according to the content of the message received, by the mode of Hash delivery by news release to expanding in message distribution module accordingly;
Step 5: message distribution module can be expanded and by corresponding transmission instrument, information is sent to terminal according to the type of the message received.
Wherein, each virtual machine is equipped with the interface of elasticity deployment module, the interface of elasticity deployment module is used for monitoring the working condition of each virtual machine; Elasticity deployment module is by the interface on all virtual machines of time interval poll of setting, obtain the loading condition of all virtual machines, wherein individual, the time interval is between 0 ~ 60 second, if load number exceedes user limit numeral, the reminding user that will give the alarm increases virtual machine; If user sets automatically add virtual machine, elasticity deployment module then distributes new virtual machine automatically in corresponding cluster; If elasticity disposes certain virtual machine of module accesses, but does not respond, then this virtual machine is considered as the machine of delaying by elasticity deployment module, and disposes new virtual machine, and is deployed on new virtual machine by corresponding program division.
Present stage, most information publishing tool was all on physically based deformation computer server, but not on empty machine machine, was not easy expansion.Can process bottleneck from the request of user probably about 100 ten thousand-3 hundred ten thousand every days, the acceptable batch request of the present invention, through pilot production, about 700,000,000-10 hundred million every days simultaneously.The delay sending message is substantially identical.

Claims (7)

1. a distributed elastic easily extensible information issuing system, is characterized in that: comprise elasticity deployment module, message preliminary treatment cluster, Kafka cluster and message distribution cluster; The request that described message preliminary treatment cluster is used for user being sent is sent to node idle in cluster and processes, and sends Kafka message to Kafka cluster; Described Kafka cluster is for receiving Kafka message and by node corresponding in message distribution cluster for the Kafka news release that receives; Described message distribution cluster sends a message to corresponding terminal according to the type of message by corresponding transmission instrument; Described elasticity deployment module is used for the working condition of each node in monitoring message preliminary treatment cluster, Kafka cluster and message distribution cluster, and according to the node that the working condition of each node increases or more renews, give the alarm to user, wherein each node is a virtual machine simultaneously.
2. distributed elastic easily extensible information issuing system according to claim 1, it is characterized in that: described message preliminary treatment cluster comprises a message pretreatment module load-balanced server and multiplely expands message pretreatment module, this module can increase according to increasing of request amount, described each message pretreatment module of expanding is deployed on a virtual machine, message pretreatment module load-balanced server is for searching the message expanded pretreatment module idle in cluster, and the user received is asked to be sent to expand message pretreatment module, described message pretreatment module of expanding is anticipated the user's request received, and issue Kafka message according to the request of user, described Kafka cluster comprises a Kafka cluster load balance server and multiplely expands Kafka node, expanded Kafka node idle in described Kafka cluster load balance whois lookup cluster, and the Kafka message received is sent to idle expanded Kafka node, the described Kafka of expansion node generates Hash codes according to the Kafka message content received, and the Hash codes of generation and Kafka message are sent to message distribution cluster, described message distribution cluster comprises load-balanced server and multiplely expands message distribution module, load-balanced server is responsible for receiving the request from Kafka node, and according to the message distribution the expanded module loading condition in message distribution cluster, dispense request, if find the module of low load, information by by priority allocation in the module of low load, described message distribution module of expanding sends information according to the type of the message received by corresponding transmission instrument.
3. distributed elastic easily extensible information issuing system according to claim 1, it is characterized in that: the virtual machine in described message preliminary treatment cluster, Kafka cluster and message distribution cluster belongs to a private network, and each cluster is mutually by Http protocol access.
4. a control method for distributed elastic easily extensible information issuing system, is characterized in that: comprise the following steps:
Step 1: multiple virtual machine is set in information delivery server, and multiple virtual machine is assigned in message preliminary treatment cluster, Kafka cluster and message distribution cluster; Wherein, the message distribution the expanded module in the message the expanded pretreatment module in message preliminary treatment cluster, the Kafka node in Kafka cluster and message distribution cluster is deployed in different virtual machines respectively;
Step 2: message pretreatment module load-balanced server receives the request that user sends, searches the idle message expanded pretreatment module, and asks that the user received shift the message the expanded pretreatment module being sent to the free time;
Step 3: message pretreatment module can be expanded the user's request received is processed, and issue Kafka message to Kafka cluster;
Step 4:Kafka cluster generates Hash codes according to the content of the message received, by the mode of Hash delivery by news release to expanding in message distribution module accordingly;
Step 5: message distribution module can be expanded and by corresponding transmission instrument, information is sent to terminal according to the type of the message received.
5. the control method of distributed elastic easily extensible information issuing system according to claim 4, it is characterized in that: the interface being equipped with elasticity deployment module on each virtual machine, the interface of described elasticity deployment module is used for monitoring the working condition of each virtual machine; Described elasticity deployment module, by the interface on all virtual machines of time interval poll of setting, obtains the loading condition of all virtual machines, if load number exceedes user limit numeral, the reminding user that will give the alarm increases virtual machine; If user sets automatically add virtual machine, elasticity deployment module then distributes new virtual machine automatically in corresponding cluster; If elasticity disposes certain virtual machine of module accesses, but does not respond, then this virtual machine is considered as the machine of delaying by elasticity deployment module, and disposes new virtual machine, and is deployed on new virtual machine by corresponding program division.
6. the control method of distributed elastic easily extensible information issuing system according to claim 4, is characterized in that: in described step 2, message pretreatment module load-balanced server searches the idle message expanded pretreatment module by the algorithm of poll.
7. the control method of distributed elastic easily extensible information issuing system according to claim 4, it is characterized in that: in described step 3, Kafka message comprises the type of message being about to be published, and comprise the main contents of message, and the information in user's request.
CN201510545644.3A 2015-08-31 2015-08-31 System for publishing distributed flexible extension information and control method thereof Pending CN105100271A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510545644.3A CN105100271A (en) 2015-08-31 2015-08-31 System for publishing distributed flexible extension information and control method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510545644.3A CN105100271A (en) 2015-08-31 2015-08-31 System for publishing distributed flexible extension information and control method thereof

Publications (1)

Publication Number Publication Date
CN105100271A true CN105100271A (en) 2015-11-25

Family

ID=54579786

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510545644.3A Pending CN105100271A (en) 2015-08-31 2015-08-31 System for publishing distributed flexible extension information and control method thereof

Country Status (1)

Country Link
CN (1) CN105100271A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110716813A (en) * 2019-09-17 2020-01-21 贝壳技术有限公司 Data stream processing method and device, readable storage medium and processor
CN111049899A (en) * 2019-12-11 2020-04-21 贝壳技术有限公司 kafka message storage system, method, apparatus, and computer-readable storage medium
CN111130851A (en) * 2019-12-03 2020-05-08 紫光云(南京)数字技术有限公司 Method for visually deploying and managing kafka cluster

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103353852A (en) * 2013-06-07 2013-10-16 曲阜师范大学 Method for constructing IaaS of virtualized WebService
CN103428008A (en) * 2013-08-28 2013-12-04 浙江大学 Big data distribution strategy oriented to multiple user groups
CN104468629A (en) * 2014-12-30 2015-03-25 北京奇虎科技有限公司 Method and device for transmitting information in batches
CN104468841A (en) * 2014-12-30 2015-03-25 北京奇虎科技有限公司 Method and device for transmitting information in batches
CN104796349A (en) * 2015-04-29 2015-07-22 云南电网有限责任公司 Automatic transverse load and longitudinal load balancing method based on virtualization technology

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103353852A (en) * 2013-06-07 2013-10-16 曲阜师范大学 Method for constructing IaaS of virtualized WebService
CN103428008A (en) * 2013-08-28 2013-12-04 浙江大学 Big data distribution strategy oriented to multiple user groups
CN104468629A (en) * 2014-12-30 2015-03-25 北京奇虎科技有限公司 Method and device for transmitting information in batches
CN104468841A (en) * 2014-12-30 2015-03-25 北京奇虎科技有限公司 Method and device for transmitting information in batches
CN104796349A (en) * 2015-04-29 2015-07-22 云南电网有限责任公司 Automatic transverse load and longitudinal load balancing method based on virtualization technology

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110716813A (en) * 2019-09-17 2020-01-21 贝壳技术有限公司 Data stream processing method and device, readable storage medium and processor
CN111130851A (en) * 2019-12-03 2020-05-08 紫光云(南京)数字技术有限公司 Method for visually deploying and managing kafka cluster
CN111049899A (en) * 2019-12-11 2020-04-21 贝壳技术有限公司 kafka message storage system, method, apparatus, and computer-readable storage medium
CN111049899B (en) * 2019-12-11 2021-01-05 贝壳找房(北京)科技有限公司 kafka message storage system, method, apparatus, and computer-readable storage medium

Similar Documents

Publication Publication Date Title
WO2020133967A1 (en) Method for scheduling shared computing resources, shared computing system, server, and storage medium
CN101677324B (en) Business management method, terminal, network system and related equipment
CN103516744A (en) A data processing method, an application server and an application server cluster
CN102065110A (en) On-line updating method and system for client side software on basis of P2SP (Peer to Server and to Peer)
CN101951411A (en) Cloud scheduling system and method and multistage cloud scheduling system
CN110808922A (en) Message processing method and device, storage medium and electronic equipment
CN112202918B (en) Load scheduling method, device, equipment and storage medium for long connection communication
CN110888735A (en) Distributed message distribution method and device based on consistent hash and scheduling node
CN103108051A (en) Synchronous file sharing method from cloud server
CN114024972B (en) Long connection communication method, system, device, equipment and storage medium
CN107689878A (en) TCP length connection SiteServer LBSs based on name scheduling
CN103024085A (en) System and method for processing P2P (peer-to-peer) node request
CN105100271A (en) System for publishing distributed flexible extension information and control method thereof
CN100505662C (en) Method for setting point-to-point data channel
CN103986783A (en) Cloud computing system
CN114710571B (en) Data packet processing system
CN103248636A (en) Offline download system and method
CN113806177A (en) Cluster monitoring method and device, electronic equipment and storage medium
CN108632078B (en) Configuration acquisition method
CN102209049B (en) Instant messaging system and method for user information processing
CN114490100A (en) Message queue telemetry transmission load balancing method and device and server
CN104852964A (en) Multifunctional server scheduling method
CN112866985A (en) Flow control method, resource downloading method, device, equipment and storage medium
CN102546734B (en) Data information processing system and method
CN111711675A (en) Solution for concurrent message transmission in local area network

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
AD01 Patent right deemed abandoned
AD01 Patent right deemed abandoned

Effective date of abandoning: 20190104