CN105320515A - Configuration method, device and system in flow computing system - Google Patents
Configuration method, device and system in flow computing system Download PDFInfo
- Publication number
- CN105320515A CN105320515A CN201410374527.0A CN201410374527A CN105320515A CN 105320515 A CN105320515 A CN 105320515A CN 201410374527 A CN201410374527 A CN 201410374527A CN 105320515 A CN105320515 A CN 105320515A
- Authority
- CN
- China
- Prior art keywords
- configuration
- configuration information
- information
- center
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the invention discloses a configuration method, device and system in a flow computing system. The configuration method provided by the embodiment of the invention comprises the following steps: acquiring requirement information of each function process and acquiring configuration information from a configuration center through a uniform interface according to the requirement information; uploading the configuration information to a shared memory; when determining that one function process needs to acquire the configuration information, providing the corresponding configuration information to the function process from the shared memory. With the adoption of the scheme, time of acquiring the configuration information and delaying can be reduced, and the coupling degree of the function processes and a configuration center is reduced; the configuration method is simple to realize and has a relatively good configuration effect.
Description
Technical field
The present invention relates to communication technical field, be specifically related to collocation method, device and system in a kind of stream calculation system.
Background technology
Stream calculation system, the data referred to for convection current (stream) form carry out the real-time distributed system calculated, existing scheme is when convection current computing system is configured, generally configuration information can be kept at the configuration center of zookeeper (a reliable coherent system for large-scale distributed system) and so on, then, when function process needs configuration information, be configured from configuration center download configuration information, or, also can be subscribed to respectively to configuration center by each function process, send to each function process to be configured configuration information by configuration center timing.
To in the research and practice process of prior art, the present inventor finds, in existing scheme, if all obtain configuration information by network from configuration center by function process at every turn, then configuration information can produce larger delay, if and adopt subscribing manner, need again to consider and considerably increase the degree of coupling of function process and configuration center by the detailed problem of a lot of configuration, realize comparatively complicated, therefore, existing scheme not only realizes comparatively complicated, and allocative effect is not good.
Summary of the invention
The embodiment of the present invention provides collocation method, device and system in a kind of stream calculation system, can avoid the delay of configuration information, and reduces the degree of coupling between function process and configuration center, not only realizes simple, and substantially improves allocative effect.
A collocation method in stream calculation system, comprising:
Obtain the demand information of each function process;
Configuration information is obtained by unified interface from configuration center according to described demand information;
Described configuration information is synchronized to shared drive;
When determining that function process needs to obtain configuration information, the configuration information in shared drive is sent to described function process, to be configured.
An inking device in stream calculation system, comprising:
Requirement Acquisition unit, for obtaining the demand information of each function process;
Information acquisition unit, for obtaining configuration information by unified interface from configuration center according to described demand information;
Lock unit, for being synchronized to shared drive by described configuration information;
Dispensing unit, during for determining that function process needs to obtain configuration information, sends to described function process by the configuration information in shared drive, to be configured.
A kind of stream calculation system, comprises the inking device in any one stream calculation system that the embodiment of the present invention provides.
A kind of stream calculation system, comprise at least one server, described server comprises common communication module, shared drive and function scheduler module, wherein:
Common communication module, for obtaining the demand information of each function process, obtains configuration information according to described demand information from configuration center, and this configuration information is synchronized to shared drive;
Shared drive, for receiving the configuration information of common communication module write, preserves described configuration information, when receiving the read requests that function scheduler module sends, the configuration information corresponding to described read requests is supplied to function scheduler module;
Function scheduler module, for demand information is sent to common communication module, when determining to need configuration information, reads corresponding configuration information from shared drive.
The embodiment of the present invention adopts the demand information obtaining each function process, configuration information is obtained by unified interface from configuration center according to this demand information, then this configuration information is synchronized to shared drive, when determining that function process obtains configuration information at needs, from shared drive, corresponding configuration information is supplied to this function process, due in this scenario, function process directly can get configuration information from shared drive, therefore, for prior art needs obtain from configuration center, function process is without the need to communicating with configuration center by network, greatly reduce the time and delay that obtain configuration information, and, owing to being obtain configuration information by unified interface unification to configuration center, so, also without the need to arranging the communication between each function process and configuration center one by one, greatly reduce the degree of coupling of function process and configuration center, not only realize simple, and substantially improve allocative effect.
Accompanying drawing explanation
In order to be illustrated more clearly in the technical scheme in the embodiment of the present invention, below the accompanying drawing used required in describing embodiment is briefly described, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those skilled in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is the process flow diagram that the embodiment of the present invention provides the collocation method in stream calculation system;
Fig. 2 a is the network architecture diagram of the collocation method in the stream calculation system that provides of the embodiment of the present invention;
Fig. 2 b is the scene schematic diagram of data syn-chronization in the collocation method in the stream calculation system that provides of the embodiment of the present invention;
Fig. 2 c is another process flow diagram of collocation method in the stream calculation system that provides of the embodiment of the present invention;
Fig. 3 is the structural representation of the inking device in the stream calculation system that provides of the embodiment of the present invention;
Fig. 4 is the structural representation of the server that the embodiment of the present invention provides;
Fig. 5 is the structural representation of the server in the stream calculation system that provides of the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those skilled in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
The embodiment of the present invention provides collocation method, device and system in a kind of stream calculation system.Below be described in detail respectively.
Embodiment one,
The angle of the inking device from stream calculation system is described by the present embodiment, and the inking device of this stream calculation system specifically can be in the server integrated.
Collocation method in a kind of stream calculation system, comprise: the demand information obtaining each function process, configuration information is obtained by unified interface from configuration center according to this demand information, this configuration information is synchronized to shared drive, when determining that function process needs to obtain configuration information, configuration information in shared drive is sent to this function process, to be configured.
As shown in Figure 1, the idiographic flow of the collocation method in this stream calculation system can be as follows:
101, the demand information of each function process is obtained.
Wherein, the information such as the type of the configuration information obtained needed for the instruction of this demand information and content.
It should be noted that, in stream calculation system, multiple server can be comprised, and multiple function process in each server, can be comprised.
102, configuration information is obtained by unified interface from configuration center according to this demand information.
Wherein, this unified interface can be connected with function process, is mainly used in communicating with configuration center, and this unified interface can be arranged according to the demand of practical application in advance with being coupled of configuration center, does not repeat them here.
Wherein, the type of configuration center can have multiple, such as, is specifically as follows the configuration center of zookeeper (a reliable coherent system for large-scale distributed system) etc. and so on.
Such as, if configuration center comprises main equipment and from equipment, then step 102 (namely obtaining configuration information by this unified interface from configuration center according to this demand information) can be following any one or various ways:
(1) configuration request message is sent to configuration center from equipment by unified interface according to this demand information, main equipment should be sent to obtain corresponding configuration information this configuration request message from equipment, received the configuration information returned from equipment.
(2) send configuration request message by unified interface to the main equipment of configuration center according to this demand information, receive the configuration information that main equipment returns according to this configuration request message.
103, this configuration information is synchronized to shared drive.
When 104, determining that function process needs to obtain configuration information, the corresponding configuration information in shared drive is sent to this function process, to be configured.Such as, specifically can be as follows:
The configuration information request of access that receiving function process sends, reads corresponding configuration information according to the access of this configuration information, the configuration information read is sent to this function process in shared drive.
In addition, it should be noted that, the configuration information preserved in configuration center, can manually manually arrange and upgrade, such as, write configuration center by operation maintenance personnel by instrument (such as client), also configuration information and renewal can be generated voluntarily by internal system, after such as being generated by server, send to configuration center, the collocation method namely in this stream calculation system can also comprise:
According to preset strategy generating configuration data, carry the configuration information update request of configuration data to configuration center by the transmission of unified interface, make this configuration center according to this configuration data Reconfigurations information.
Such as, or comprise main equipment for this configuration center and from equipment, then after according to preset strategy generating configuration data, can by unified interface send carry configuration data configuration information update request to configuration center from equipment, main equipment should be sent to upgrade corresponding configuration information this configuration information update request from equipment; And/or, carry the configuration information update request of configuration data to the main equipment of configuration center by the transmission of unified interface, so that this main equipment upgrades corresponding configuration information according to this configuration data, etc.
As from the foregoing, the present embodiment adopts the demand information obtaining each function process, configuration information is obtained by unified interface from configuration center according to this demand information, then this configuration information is synchronized to shared drive, when determining that function process obtains configuration information at needs, from shared drive, corresponding configuration information is supplied to this function process, due in this scenario, function process directly can get configuration information from shared drive, therefore, for prior art needs obtain from configuration center, function process is without the need to communicating with configuration center by network, greatly reduce the time and delay that obtain configuration information, and, owing to being obtain configuration information by unified interface unification to configuration center, so, also without the need to arranging the communication between each function process and configuration center one by one, greatly reduce the degree of coupling of function process and configuration center, not only realize simple, and substantially improve allocative effect.
Embodiment two,
According to the method described by embodiment one, below citing is described in further detail.
In the present embodiment, be described so that the inking device in this stream calculation system is specifically integrated in the server, wherein, for convenience, in the present embodiment, " unified interface " alleged by the embodiment of the present invention be called common communication module.
See Fig. 2 a, this figure is the network architecture diagram of the collocation method in this stream calculation system.As known in Fig. 2 a, stream calculation system can comprise multiple server, such as server 1, server 2 ... server n, etc., include common communication module, shared drive and function process in each server, specifically can be as follows:
(1) stream calculation system;
1, common communication module;
Common communication module, is mainly used in the demand information obtaining each function process, obtains configuration information according to this demand information from configuration center, and this configuration information is synchronized to shared drive, that is, configuration information is write shared drive.
2, shared drive;
Shared drive, be mainly used in accepting synchronous about configuration information of common communication module, namely receive the configuration information of common communication module write, and preserve this configuration information, when receiving the read requests of function process, corresponding configuration information is supplied to function process.
3, function process;
Function process, for the demand information of self is sent to common communication module, and when determining to need configuration information, reads corresponding configuration information from shared drive.Wherein, function process is when sending demand information to common communication module, various ways can be had, such as, directly by the application programming interface (API, ApplicationProgrammingInterface) of configuration information, demand information can be sent to common communication module, also demand information can be carried in other order, send to communication module by configuration information API, do not repeat them here.
(2) configuration center;
Configuration center, for receiving the configuration request message that common communication module sends, returns corresponding configuration information to common communication module according to this configuration request message.
Wherein, as shown in Figure 2 b, this configuration center can comprise main equipment (Leader) and from equipment (Follower), wherein, all can the request that sends of reception server or data from equipment and main equipment, such as, configuration request message or the configuration data of the transmission of common communication module can be received, etc., but, from equipment after receiving these requests or configuration data, these requests or configuration data is needed to send to main equipment, after being made decisions by main equipment, by decision-making, such as corresponding configuration information is returned to from equipment, and by sending to the common communication module of server from equipment, certainly, if certain server directly communicates with main equipment, then now directly decision-making is sent to server by main equipment.It should be noted that, each has the right to make ballot to the decision-making of main equipment from equipment, and voting mechanism see prior art, can not repeat them here.
Wherein, the configuration information preserved in configuration center, can manually manually arrange and upgrade, such as, by operation maintenance personnel by instrument, such as client write configuration center, also can generate configuration information and renewal by internal system voluntarily, after such as being generated by server, send to configuration center by common communication module.
Based on the above-mentioned network architecture, below will perform flow process to it and be described in detail, as shown in Figure 2 c, the collocation method in a kind of stream calculation system, idiographic flow can be as follows:
201, the common communication module of server obtains the demand information of each function process.
Wherein, the information such as the type of the configuration information obtained needed for the instruction of this demand information and content.
It should be noted that, in stream calculation system, multiple server can be comprised, and multiple function process in each server, can be comprised.
202, the common communication module of server is according to this demand information to configuration center, and such as zookeeper sends configuration request message.
Such as, common communication module specifically can send configuration request message to configuration center from equipment according to this demand information, then from equipment, this configuration request message is sent to main equipment by this, or, also can according to the main equipment transmission configuration request message of this demand information directly to configuration center.
203, configuration center is after receiving this configuration request message, searches corresponding configuration information according to this configuration request message, and configuration information is sent to the common communication module of server.
Such as, if in step 202., common communication module mainly with from equipment carries out communicating, then after main equipment finds corresponding configuration information, this configuration information is transmitted to from equipment, from equipment, this configuration information is sent the common communication module of server by this; And if in step 202., common communication module carries out communicating with main equipment, then now directly by main equipment, the configuration information found directly can be sent to the common communication module of server, not repeat them here.
204, after the common communication module of server receives configuration information, this configuration information is synchronized to shared drive, by this configuration information write shared drive.
205, when the function process in serving needs to obtain configuration information, this function process sends configuration information request of access to shared drive, to read corresponding configuration information from shared drive by configuration information API.
206, configuration information is sent to this function process by shared drive.
207, this function process is configured according to this configuration information.
As from the foregoing, the present embodiment adopts the demand information by common communication module receiving function process, then configuration information is obtained according to this demand information from configuration center, and this configuration information is synchronized to shared drive, when function process needs to obtain configuration information, directly from shared drive, read corresponding configuration information by function process and be configured, due in this scenario, function process directly can get configuration information from shared drive, therefore, for prior art needs obtain from configuration center, function process is without the need to communicating with configuration center by network, greatly reduce the time and delay that obtain configuration information, and, owing to being obtain configuration information by unified interface unification to configuration center, so, also without the need to arranging the communication between each function process and configuration center one by one, greatly reduce the degree of coupling of function process and configuration center, not only realize simple, and substantially improve allocative effect.
Embodiment three,
In order to realize above method better, the embodiment of the present invention also provides the inking device in a kind of stream calculation system, as shown in Figure 3, the inking device in this stream calculation system can comprise Requirement Acquisition unit 301, information acquisition unit 302, lock unit 303 and dispensing unit 304, as follows:
Requirement Acquisition unit 301, for obtaining the demand information of each function process.
Wherein, the information such as the type of the configuration information obtained needed for the instruction of this demand information and content.
Information acquisition unit 302, for obtaining configuration information by unified interface from configuration center according to described demand information.
Wherein, this unified interface can be connected with function process, is mainly used in communicating with configuration center, and this unified interface can be arranged according to the demand of practical application in advance with being coupled of configuration center, does not repeat them here.
Lock unit 303, for being synchronized to shared drive by this configuration information.
Dispensing unit 304, during for determining that function process needs to obtain configuration information, sends to this function process, to be configured by the configuration information in shared drive.Such as, specifically can be as follows:
Dispensing unit 304, specifically may be used for the configuration information request of access that receiving function process sends, and reads corresponding configuration information, the configuration information read is sent to this function process according to the access of this configuration information in shared drive.
Wherein, the type of configuration center can have multiple, such as, is specifically as follows the configuration center of zookeeper (a reliable coherent system for large-scale distributed system) etc. and so on.
Such as, if configuration center comprises main equipment and from equipment, then:
Information acquisition unit 302, specifically may be used for sending configuration request message to configuration center from equipment by unified interface according to this demand information, main equipment should be sent to obtain corresponding configuration information described configuration request message from equipment, received the configuration information returned from equipment; And/or,
Information acquisition unit 302, specifically may be used for according to this demand information by the main equipment transmission configuration request message of unified interface to configuration center, the configuration information that reception main equipment returns according to this configuration request message.
In addition, it should be noted that, the configuration information preserved in configuration center, can manually manually arrange and upgrade, such as, configuration center is write by instrument (such as client) by operation maintenance personnel, also can generate configuration information and renewal voluntarily by internal system, after such as being generated by server, send to configuration center, namely the inking device in this stream calculation system can also comprise generation unit and updating block, as follows:
Generation unit, may be used for according to preset strategy generating configuration data;
Updating block, may be used for sending carry configuration data configuration information update request to configuration center, make this configuration center according to this configuration data Reconfigurations information.
Such as, also comprise main equipment for this configuration center and from equipment, then specifically can be as follows:
Updating block, specifically may be used for sending carry configuration data configuration information update request to configuration center from equipment so that main equipment should be sent to upgrade corresponding configuration information this configuration information update request from equipment; And/or,
Updating block, specifically may be used for carrying the configuration information update request of configuration data to the main equipment of configuration center, so that this main equipment upgrades corresponding configuration information according to this configuration data by the transmission of unified interface.
The inking device of this stream calculation system specifically can be in the server integrated.
During concrete enforcement, above unit can realize as independently entity, and can carry out combination in any yet, realize as same or several entities, the concrete enforcement of above unit see embodiment above, can not repeat them here.
As from the foregoing, the Requirement Acquisition unit 301 of the present embodiment can obtain the demand information of each function process, then configuration information is obtained by unified interface from configuration center according to this demand information by information acquisition unit 302, then by lock unit 303, this configuration information is synchronized to shared drive, when determining that function process obtains configuration information at needs, from shared drive, corresponding configuration information is supplied to this function process, to be configured by dispensing unit 304, due in this scenario, function process directly can get configuration information from shared drive, therefore, for prior art needs obtain from configuration center, function process is without the need to communicating with configuration center by network, greatly reduce the time and delay that obtain configuration information, and, owing to being obtain configuration information by unified interface unification to configuration center, so, also without the need to arranging the communication between each function process and configuration center one by one, greatly reduce the degree of coupling of function process and configuration center, not only realize simple, and substantially improve allocative effect.
Embodiment four,
Accordingly, the embodiment of the present invention also provides a kind of stream calculation system, can comprise the inking device in any one stream calculation system that the embodiment of the present invention provides, such as, and can be as follows:
Inking device in stream calculation system, may be used for the demand information obtaining each function process, configuration information is obtained by unified interface from configuration center according to this demand information, this configuration information is synchronized to shared drive, when determining that function process needs to obtain configuration information, configuration information in shared drive is sent to this function process, to be configured.
Wherein, this unified interface can be connected with function process, is mainly used in communicating with configuration center, and this unified interface can be arranged according to the demand of practical application in advance with being coupled of configuration center, does not repeat them here.
Wherein, the type of configuration center can have multiple, such as, is specifically as follows the configuration center of zookeeper (a reliable coherent system for large-scale distributed system) etc. and so on.
Such as, if configuration center comprises main equipment and from equipment, inking device then in this stream calculation system specifically can send configuration request message to configuration center from equipment by unified interface according to this demand information, main equipment should be sent to obtain corresponding configuration information this configuration request message from equipment, received the configuration information returned from equipment.And/or the inking device in this stream calculation system specifically according to this demand information by the main equipment transmission configuration request message of unified interface to configuration center, can receive the configuration information that main equipment returns according to this configuration request message.
In addition, it should be noted that, the configuration information preserved in configuration center, can manually manually arrange and upgrade, such as, write configuration center by operation maintenance personnel by instrument (such as client), also configuration information and renewal can be generated voluntarily by internal system, after such as being generated by server, send to configuration center, the inking device namely in this stream calculation system can also perform following operation:
According to preset strategy generating configuration data, carry the configuration information update request of configuration data to configuration center by the transmission of unified interface, make this configuration center according to this configuration data Reconfigurations information.
Such as, also comprise main equipment for this configuration center and from equipment, then after according to preset strategy generating configuration data, can by unified interface send carry configuration data configuration information update request to configuration center from equipment, main equipment should be sent to upgrade corresponding configuration information this configuration information update request from equipment; And/or, carry the configuration information update request of configuration data to the main equipment of configuration center by the transmission of unified interface, so that this main equipment upgrades corresponding configuration information according to this configuration data, etc.
The concrete enforcement of each operation see embodiment above, can not repeat them here above.
It should be noted that, the inking device in above-mentioned stream calculation system specifically can be in the server integrated, and stream calculation system can comprise multiple server, in addition, also may comprise other equipment, does not repeat them here.
Because this stream calculation system can comprise the inking device in any one stream calculation system that the embodiment of the present invention provides, therefore, can realize the beneficial effect achieved by inking device in any one stream calculation system that the embodiment of the present invention provides, preceding embodiment, does not repeat them here.
Embodiment five,
The embodiment of the present invention also provides a kind of server, wherein can the inking device of integrated stream calculation system, as shown in Figure 4, it illustrates the structural representation of the server involved by the embodiment of the present invention, specifically:
This server can comprise processor 401, the storer 402 of one or more computer-readable recording mediums, the radio frequency (RadioFrequency that more than or processes core, RF) circuit 403, wireless communication module are as parts such as bluetooth module and/or Wireless Fidelity (WiFi, WirelessFidelity) module 404 etc. (for WIFI module 404 in Fig. 4), power supply 405, sensor 406, input block 407 and display units 408.It will be understood by those skilled in the art that the server architecture shown in Fig. 4 does not form the restriction to server, the parts more more or less than diagram can be comprised, or combine some parts, or different parts are arranged.Wherein:
Processor 401 is control centers of this server, utilize the various piece of various interface and the whole server of connection, software program in storer 402 and/or module is stored in by running or performing, and call the data be stored in storer 402, perform various function and the process data of server, thus integral monitoring is carried out to server.Optionally, processor 401 can comprise one or more process core; Preferably, processor 401 accessible site application processor and modem processor, wherein, application processor mainly processes operating system, user interface and application program etc., and modem processor mainly processes radio communication.Be understandable that, above-mentioned modem processor also can not be integrated in processor 401.
Storer 402 can be used for storing software program and module, and processor 401 is stored in software program and the module of storer 402 by running, thus performs the application of various function and data processing.Storer 402 mainly can comprise storage program district and store data field, and wherein, storage program district can store operating system, application program (such as sound-playing function, image player function etc.) etc. needed at least one function; Store data field and can store the data etc. created according to the use of server.In addition, storer 402 can comprise high-speed random access memory, can also comprise nonvolatile memory, such as at least one disk memory, flush memory device or other volatile solid-state parts.Correspondingly, storer 402 can also comprise Memory Controller, to provide the access of processor 401 pairs of storeies 402.
RF circuit 403 can be used in the process of receiving and sending messages, the reception of signal and transmission, especially, after being received by the downlink information of base station, transfers to more than one or one processor 401 to process; In addition, base station is sent to by relating to up data.Usually, RF circuit 403 includes but not limited to antenna, at least one amplifier, tuner, one or more oscillator, subscriber identity module (SIM) card, transceiver, coupling mechanism, low noise amplifier (LNA, LowNoiseAmplifier), diplexer etc.In addition, RF circuit 403 can also by radio communication and network and other devices communicatings.Described radio communication can use arbitrary communication standard or agreement, include but not limited to global system for mobile communications (GSM, GlobalSystemofMobilecommunication), general packet radio service (GPRS, GeneralPacketRadioService), CDMA (CDMA, CodeDivisionMultipleAccess), Wideband Code Division Multiple Access (WCDMA) (WCDMA, WidebandCodeDivisionMultipleAccess), Long Term Evolution (LTE, LongTermEvolution), Email, Short Message Service (SMS, ShortMessagingService) etc.
WiFi belongs to short range wireless transmission technology, and server is sent and received e-mail by WiFi module 404 and accessed streaming video etc., and it can provide wireless broadband internet access.Although Fig. 4 shows WiFi module 404, be understandable that, it does not belong to must forming of server, can omit in the scope of essence not changing invention as required completely.
Server also comprises the power supply 405 (such as battery) of powering to all parts, preferably, power supply can be connected with processor 401 logic by power-supply management system, thus realizes the functions such as management charging, electric discharge and power managed by power-supply management system.Power supply 405 can also comprise one or more direct current or AC power, recharging system, power failure detection circuit, power supply changeover device or the random component such as inverter, power supply status indicator.
This server also can comprise at least one sensor 406, such as optical sensor, motion sensor and other sensors.This server is other sensors such as configurable gyroscope, barometer, hygrometer, thermometer, infrared ray sensor also, do not repeat them here.
This server also can comprise input block 407, and this input block 407 can be used for the numeral or the character information that receive input, and produces and to arrange with user and function controls relevant keyboard, mouse, control lever, optics or trace ball signal and inputs.Particularly, in a specific embodiment, input block 407 can comprise Touch sensitive surface and other input equipments.Touch sensitive surface, also referred to as touch display screen or Trackpad, user can be collected or neighbouring touch operation (such as user uses any applicable object or the operations of annex on Touch sensitive surface or near Touch sensitive surface such as finger, stylus) thereon, and drive corresponding coupling arrangement according to the formula preset.Optionally, Touch sensitive surface can comprise touch detecting apparatus and touch controller two parts.Wherein, touch detecting apparatus detects the touch orientation of user, and detects the signal that touch operation brings, and sends signal to touch controller; Touch controller receives touch information from touch detecting apparatus, and converts it to contact coordinate, then gives processor 401, and the order that energy receiving processor 401 is sent also is performed.In addition, the polytypes such as resistance-type, condenser type, infrared ray and surface acoustic wave can be adopted to realize Touch sensitive surface.Except Touch sensitive surface, input block 407 can also comprise other input equipments.Particularly, other input equipments can include but not limited to one or more in physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, control lever etc.
This server also can comprise display unit 408, this display unit 408 can be used for the various graphical user interface showing information or the information being supplied to user and the server inputted by user, and these graphical user interface can be made up of figure, text, icon, video and its combination in any.Display unit 408 can comprise display panel, optionally, the form such as liquid crystal display (LCD, LiquidCrystalDisplay), Organic Light Emitting Diode (OLED, OrganicLight-EmittingDiode) can be adopted to configure display panel.Further, Touch sensitive surface can cover display panel, when Touch sensitive surface detects thereon or after neighbouring touch operation, sends processor 401 to determine the type of touch event, provide corresponding vision to export with preprocessor 401 on a display panel according to the type of touch event.Although in the diagram, Touch sensitive surface and display panel be as two independently parts realize inputting and input function, in certain embodiments, can by Touch sensitive surface and display panel integrated and realize input and output function.
Although not shown, server can also comprise camera, bluetooth module etc., does not repeat them here.Specifically in the present embodiment, processor 401 in server can according to following instruction, executable file corresponding for the process of one or more application program is loaded in storer 402, and the application program be stored in storer 402 is run by processor 401, thus realize various function, as follows:
Obtain the demand information of each function process, configuration information is obtained by unified interface from configuration center according to this demand information, this configuration information is synchronized to shared drive, when determining that function process needs to obtain configuration information, configuration information in shared drive is sent to this function process, to be configured.
Wherein, this unified interface can be connected with function process, is mainly used in communicating with configuration center, and this unified interface can be arranged according to the demand of practical application in advance with being coupled of configuration center, does not repeat them here.
Wherein, the type of configuration center can have multiple, such as, is specifically as follows the configuration center of zookeeper (a reliable coherent system for large-scale distributed system) etc. and so on.
Such as, if configuration center comprises main equipment and from equipment, then specifically can send configuration request message to configuration center from equipment by unified interface according to this demand information, main equipment should be sent to obtain corresponding configuration information this configuration request message from equipment, received the configuration information returned from equipment.And/or, specifically according to this demand information by the main equipment transmission configuration request message of unified interface to configuration center, the configuration information that main equipment returns according to this configuration request message can be received.
In addition, it should be noted that, the configuration information preserved in configuration center, can manually manually arrange and upgrade, such as, write configuration center by operation maintenance personnel by instrument (such as client), also configuration information and renewal can be generated voluntarily by internal system, after such as being generated by server, send to configuration center, namely this server can also perform following operation:
According to preset strategy generating configuration data, carry the configuration information update request of configuration data to configuration center by the transmission of unified interface, make this configuration center according to this configuration data Reconfigurations information.
Such as, or comprise main equipment for this configuration center and from equipment, then after according to preset strategy generating configuration data, can by unified interface send carry configuration data configuration information update request to configuration center from equipment, main equipment should be sent to upgrade corresponding configuration information this configuration information update request from equipment; And/or, carry the configuration information update request of configuration data to the main equipment of configuration center by the transmission of unified interface, so that this main equipment upgrades corresponding configuration information according to this configuration data, etc.
The concrete enforcement of each operation see embodiment above, can not repeat them here above.
As from the foregoing, the server of the present embodiment can by the demand information of common communication module receiving function process, then configuration information is obtained according to this demand information from configuration center, and this configuration information is synchronized to shared drive, when function process needs to obtain configuration information, directly from shared drive, read corresponding configuration information by function process and be configured, due in this scenario, function process directly can get configuration information from shared drive, therefore, for prior art needs obtain from configuration center, function process is without the need to communicating with configuration center by network, greatly reduce the time and delay that obtain configuration information, and, owing to being obtain configuration information by unified interface unification to configuration center, so, also without the need to arranging the communication between each function process and configuration center one by one, greatly reduce the degree of coupling of function process and configuration center, not only realize simple, and substantially improve allocative effect.
Embodiment six,
In addition, the embodiment of the present invention also provides a kind of stream calculation system, comprises at least one server, and wherein, as shown in Figure 5, this server can comprise the modules 503 such as common communication module 501, shared drive 502 and function scheduler module, wherein:
Common communication module 501, for obtaining the demand information of each function scheduler module 503, obtains configuration information according to this demand information from configuration center, and this configuration information is synchronized to shared drive;
Shared drive 502, for receiving the configuration information that common communication module 501 writes, preserving this configuration information, when receiving the read requests that function scheduler module 503 sends, the configuration information corresponding to this read requests being supplied to function scheduler module 503;
Function scheduler module 503, for demand information is sent to common communication module 501, when determining to need configuration information, reads corresponding configuration information from shared drive 502.
Wherein, the type of configuration center can have multiple, such as, is specifically as follows the configuration center of zookeeper (a reliable coherent system for large-scale distributed system) etc. and so on.
Such as, if configuration center comprises main equipment and from equipment, then:
Common communication module 501, specifically may be used for sending configuration request message to configuration center from equipment according to this demand information, main equipment should be sent to obtain corresponding configuration information this configuration request message from equipment, received the configuration information returned from equipment; And/or,
Common communication module 501, specifically may be used for, according to the main equipment transmission configuration request message of this demand information to configuration center, receiving the configuration information that main equipment returns according to this configuration request message.
In addition, it should be noted that, the configuration information preserved in configuration center, can manually manually arrange and upgrade, such as, configuration center is write by instrument (such as client) by operation maintenance personnel, also can generate configuration information and renewal voluntarily by internal system, after such as being generated by server, send to configuration center, namely this server can also comprise configuration module, as follows:
Configuration module, for according to preset strategy generating configuration data, sends to common communication module 501 by this configuration data;
Common communication module 501, can also be used for sending carry this configuration data configuration information update request to configuration center, make described configuration center according to described configuration data Reconfigurations information.Such as, or comprise main equipment for this configuration center and from equipment, then:
Common communication module 501, specifically may be used for sending carry this configuration data configuration information update request to configuration center from equipment so that main equipment should be sent to upgrade corresponding configuration information described configuration information update request from equipment; And/or,
Described common communication module, carries the configuration information update request of this configuration data to the main equipment of configuration center, so that this main equipment upgrades corresponding configuration information according to this configuration data specifically for transmission.
The concrete enforcement of above modules see embodiment above, can not repeat them here.
As from the foregoing, the server of the present embodiment can by the demand information of common communication module 501 receiving function process, then configuration information is obtained according to this demand information from configuration center, and this configuration information is synchronized to shared drive 502, when function scheduler module 503 needs to obtain configuration information, directly from shared drive 502, read corresponding configuration information by function scheduler module 503 and be configured, due in this scenario, function scheduler module 503 directly can get configuration information from shared drive 502, therefore, for prior art needs obtain from configuration center, function scheduler module 503 is without the need to communicating with configuration center by network, greatly reduce the time and delay that obtain configuration information, and, owing to being obtain configuration information by unified interface (i.e. common communication module 501)-unification to configuration center, so, also without the need to arranging the communication between each function process in function scheduler module 503 and configuration center one by one, greatly reduce the degree of coupling of function process and configuration center, not only realize simple, and substantially improve allocative effect.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment is that the hardware that can carry out instruction relevant by program has come, this program can be stored in a computer-readable recording medium, storage medium can comprise: ROM (read-only memory) (ROM, ReadOnlyMemory), random access memory (RAM, RandomAccessMemory), disk or CD etc.
Collocation method, device and system in a kind of stream calculation system provided the embodiment of the present invention are above described in detail, apply specific case herein to set forth principle of the present invention and embodiment, the explanation of above embodiment just understands method of the present invention and core concept thereof for helping; Meanwhile, for those skilled in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (14)
1. the collocation method in stream calculation system, is characterized in that, comprising:
Obtain the demand information of each function process;
Configuration information is obtained by unified interface from configuration center according to described demand information;
Described configuration information is synchronized to shared drive;
When determining that function process needs to obtain configuration information, the configuration information in shared drive is sent to described function process, to be configured.
2. method according to claim 1, is characterized in that, described configuration center comprises main equipment and from equipment, then describedly obtain configuration information by unified interface from configuration center according to described demand information, comprising:
Configuration request message is sent to configuration center from equipment by unified interface according to described demand information, send to main equipment to obtain corresponding configuration information described configuration request message so that described from equipment, receive the configuration information returned from equipment; And/or,
According to described demand information by the main equipment transmission configuration request message of unified interface to configuration center, receive the configuration information that main equipment returns according to described configuration request message.
3. method according to claim 1 and 2, is characterized in that, also comprises:
According to preset strategy generating configuration data;
Carry the configuration information update request of configuration data to configuration center by the transmission of unified interface, make described configuration center according to described configuration data Reconfigurations information.
4. method according to claim 3, it is characterized in that, described configuration center comprises main equipment and from equipment, the configuration information update request of configuration data is carried to configuration center by the transmission of unified interface then, make described configuration center according to described configuration data Reconfigurations information, comprising:
By unified interface send carry configuration data configuration information update request to configuration center from equipment send to main equipment to upgrade corresponding configuration information described configuration information update request so that described from equipment; And/or,
The configuration information update request of configuration data is carried to the main equipment of configuration center, so that described main equipment upgrades corresponding configuration information according to described configuration data by the transmission of unified interface.
5. method according to claim 1 and 2, is characterized in that, described determine function process need obtain configuration information time, the configuration information in shared drive is sent to described function process, to be configured, comprising:
The configuration information request of access that receiving function process sends;
In shared drive, corresponding configuration information is read according to described configuration information access;
The configuration information read is sent to function process.
6. the inking device in stream calculation system, is characterized in that, comprising:
Requirement Acquisition unit, for obtaining the demand information of each function process;
Information acquisition unit, for obtaining configuration information by unified interface from configuration center according to described demand information;
Lock unit, for being synchronized to shared drive by described configuration information;
Dispensing unit, during for determining that function process needs to obtain configuration information, sends to described function process by the configuration information in shared drive, to be configured.
7. inking device according to claim 6, is characterized in that,
Described information acquisition unit, specifically for sending configuration request message to configuration center from equipment by unified interface according to described demand information, send to main equipment to obtain corresponding configuration information described configuration request message so that described from equipment, receive the configuration information returned from equipment; And/or
Described information acquisition unit, specifically for sending configuration request message by unified interface to the main equipment of configuration center according to described demand information, receives the configuration information that main equipment returns according to described configuration request message.
8. the inking device according to claim 6 or 7, is characterized in that, also comprises generation unit and updating block;
Described generation unit, for according to preset strategy generating configuration data;
Described updating block, for send carry configuration data configuration information update request to configuration center, make described configuration center according to described configuration data Reconfigurations information.
9. inking device according to claim 8, is characterized in that, described configuration center comprises main equipment and from equipment, then:
Described updating block, specifically for send carry configuration data configuration information update request to configuration center from equipment send to main equipment to upgrade corresponding configuration information described configuration information update request so that described from equipment; And/or,
Described updating block, specifically for carrying the configuration information update request of configuration data to the main equipment of configuration center, so that described main equipment upgrades corresponding configuration information according to described configuration data by the transmission of unified interface.
10. a stream calculation system, is characterized in that, comprises the inking device in the stream calculation system described in any one of claim 6 to 9.
11. 1 kinds of stream calculation systems, is characterized in that, comprise at least one server, and described server comprises common communication module, shared drive and function scheduler module, wherein:
Common communication module, for obtaining the demand information of each function scheduler module, obtains configuration information according to described demand information from configuration center, and described configuration information is synchronized to shared drive;
Shared drive, for receiving the configuration information of common communication module write, preserves described configuration information, when receiving the read requests that function scheduler module sends, the configuration information corresponding to described read requests is supplied to function scheduler module;
Function scheduler module, for demand information is sent to common communication module, when determining to need configuration information, reads corresponding configuration information from shared drive.
12. stream calculation systems according to claim 11, is characterized in that,
Described common communication module, specifically for sending configuration request message to configuration center from equipment according to described demand information, send to main equipment to obtain corresponding configuration information described configuration request message so that described from equipment, receive the configuration information returned from equipment; And/or,
Described common communication module, specifically for according to the main equipment transmission configuration request message of described demand information to configuration center, receives the configuration information that main equipment returns according to described configuration request message.
13. stream calculation systems according to claim 11 or 12, it is characterized in that, described server also comprises configuration module;
Configuration module, for according to preset strategy generating configuration data, sends to described common communication module by described configuration data;
Described common communication module, also for send carry described configuration data configuration information update request to configuration center, make described configuration center according to described configuration data Reconfigurations information.
14. stream calculation systems according to claim 13, is characterized in that,
Described common communication module, specifically for send carry described configuration data configuration information update request to configuration center from equipment send to main equipment to upgrade corresponding configuration information described configuration information update request so that described from equipment; And/or,
Described common communication module, carries the configuration information update request of described configuration data to the main equipment of configuration center, so that described main equipment upgrades corresponding configuration information according to described configuration data specifically for transmission.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410374527.0A CN105320515A (en) | 2014-07-31 | 2014-07-31 | Configuration method, device and system in flow computing system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410374527.0A CN105320515A (en) | 2014-07-31 | 2014-07-31 | Configuration method, device and system in flow computing system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105320515A true CN105320515A (en) | 2016-02-10 |
Family
ID=55247947
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410374527.0A Pending CN105320515A (en) | 2014-07-31 | 2014-07-31 | Configuration method, device and system in flow computing system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105320515A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106878376A (en) * | 2016-12-23 | 2017-06-20 | 微梦创科网络科技（中国）有限公司 | A kind of configuring management method and system |
| CN107247578A (en) * | 2017-06-12 | 2017-10-13 | 北京奇虎科技有限公司 | Configuration parameter storage method and device |
| CN107688472A (en) * | 2016-08-03 | 2018-02-13 | 展讯通信（深圳）有限公司 | The method, device and mobile terminal of preset application |
| CN109669879A (en) * | 2017-10-17 | 2019-04-23 | 展讯通信（上海）有限公司 | Configure the method and device of DMA controller |
| CN109886050A (en) * | 2019-01-23 | 2019-06-14 | 金蝶蝶金云计算有限公司 | Card information acquisition method, device, computer equipment and storage medium |
| CN111290744A (en) * | 2020-01-22 | 2020-06-16 | 北京百度网讯科技有限公司 | Stream computing job processing method, stream computing system and electronic device |
| CN113485850A (en) * | 2021-04-25 | 2021-10-08 | 北京思特奇信息技术股份有限公司 | Service configuration method and configuration system of distributed file system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130117225A1 (en) * | 2011-11-03 | 2013-05-09 | Michael W. Dalton | Distributed storage medium management for heterogeneous storage media in high availability clusters |
| CN103500111A (en) * | 2013-10-11 | 2014-01-08 | 北京奇虎科技有限公司 | Information configuration method and device based on zookeeper |
| CN103905537A (en) * | 2014-03-20 | 2014-07-02 | 冶金自动化研究设计院 | System for managing industry real-time data storage in distributed environment |
-
2014
- 2014-07-31 CN CN201410374527.0A patent/CN105320515A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130117225A1 (en) * | 2011-11-03 | 2013-05-09 | Michael W. Dalton | Distributed storage medium management for heterogeneous storage media in high availability clusters |
| CN103500111A (en) * | 2013-10-11 | 2014-01-08 | 北京奇虎科技有限公司 | Information configuration method and device based on zookeeper |
| CN103905537A (en) * | 2014-03-20 | 2014-07-02 | 冶金自动化研究设计院 | System for managing industry real-time data storage in distributed environment |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107688472A (en) * | 2016-08-03 | 2018-02-13 | 展讯通信（深圳）有限公司 | The method, device and mobile terminal of preset application |
| CN106878376A (en) * | 2016-12-23 | 2017-06-20 | 微梦创科网络科技（中国）有限公司 | A kind of configuring management method and system |
| CN107247578A (en) * | 2017-06-12 | 2017-10-13 | 北京奇虎科技有限公司 | Configuration parameter storage method and device |
| CN109669879A (en) * | 2017-10-17 | 2019-04-23 | 展讯通信（上海）有限公司 | Configure the method and device of DMA controller |
| CN109886050A (en) * | 2019-01-23 | 2019-06-14 | 金蝶蝶金云计算有限公司 | Card information acquisition method, device, computer equipment and storage medium |
| CN111290744A (en) * | 2020-01-22 | 2020-06-16 | 北京百度网讯科技有限公司 | Stream computing job processing method, stream computing system and electronic device |
| CN111290744B (en) * | 2020-01-22 | 2023-07-21 | 北京百度网讯科技有限公司 | Stream type computing job processing method, stream type computing system and electronic equipment |
| CN113485850A (en) * | 2021-04-25 | 2021-10-08 | 北京思特奇信息技术股份有限公司 | Service configuration method and configuration system of distributed file system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105320515A (en) | Configuration method, device and system in flow computing system | |
| CN104142862B (en) | The overload protection method of server and device | |
| CN105119806B (en) | message updating method and device | |
| CN105005909A (en) | Method and device for predicting lost users | |
| CN104765591A (en) | Method and system for updating software configuration parameter, and terminal server | |
| CN104965721A (en) | Method and apparatus for updating an application | |
| CN103294515A (en) | Method, device and system for acquiring application programs | |
| CN104376353A (en) | Two-dimension code generating method, terminal and server and two-dimension code reading method, terminal and server | |
| CN104598263A (en) | Application program operation method and configuration file generating method and device | |
| CN104820665A (en) | Method, terminal and server for exhibiting recommendation information | |
| CN103179026B (en) | Communication means in user interactive system, system and server and client side | |
| CN104426844A (en) | Safety authentication method, server and safety authentication system | |
| CN104657203A (en) | Task execution method, device and system | |
| CN104679381A (en) | Method and device for switching chat box | |
| CN105320693A (en) | Information querying method and terminal | |
| CN104573437A (en) | Information authentication method, device and terminal | |
| CN105530222A (en) | Method for establishing connection among terminals, and device and system | |
| CN105302804A (en) | Service bill display method, terminal, and server | |
| CN108270839B (en) | Access frequency control system and method | |
| CN105303591A (en) | Method for superposing place information in puzzle, terminal and server | |
| CN104391629A (en) | Method for sending message in orientation manner, method for displaying message, server and terminal | |
| CN104780234A (en) | Method, device and system for inquiring Internet protocol (IP) address location | |
| CN104239005A (en) | Graph alignment method and device | |
| CN105306244B (en) | Router management method, system and equipment | |
| CN105025064B (en) | Download the method, apparatus and system of file |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160210 |
|
| RJ01 | Rejection of invention patent application after publication |