CN101373474A - Magnanimity data real time processing structure and real time processing platform following with necessaries for the same - Google Patents

Magnanimity data real time processing structure and real time processing platform following with necessaries for the same Download PDF

Info

Publication number
CN101373474A
CN101373474A CNA2008101195285A CN200810119528A CN101373474A CN 101373474 A CN101373474 A CN 101373474A CN A2008101195285 A CNA2008101195285 A CN A2008101195285A CN 200810119528 A CN200810119528 A CN 200810119528A CN 101373474 A CN101373474 A CN 101373474A
Authority
CN
China
Prior art keywords
real
service
application
time information
processing platform
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2008101195285A
Other languages
Chinese (zh)
Other versions
CN100594498C (en
Inventor
李朝铭
王高洪
徐恪宁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Kaituo Tianji Information Technology Co Ltd
Original Assignee
Beijing Kaituo Tianji Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Kaituo Tianji Information Technology Co Ltd filed Critical Beijing Kaituo Tianji Information Technology Co Ltd
Priority to CN200810119528A priority Critical patent/CN100594498C/en
Publication of CN101373474A publication Critical patent/CN101373474A/en
Application granted granted Critical
Publication of CN100594498C publication Critical patent/CN100594498C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Stored Programmes (AREA)

Abstract

The invention provides a mass data real-time processing framework, which comprises at least one client, an application middleware server, at least one platform for processing real-time information as needed and a corresponding operation system. The client is used for displaying the human-computer interface of application services, receiving the relevant data of application services input by a user and sending the data to the application middleware server, and displaying processed results; the application middleware server is connected with each client, and is used for receiving relevant data of the application services sent by the client, and calling the application services in the platform for processing real time information as needed, as well as receiving the processed results transmitted by the platform for processing real-time information as needed, which generates the display interface according to the processed results and transmits the display interface to the corresponding client; the platform for processing real-time information as needed is connected with the application middleware server, and is used for completing the business logical processing of the application services called by the application middleware server, and returning the processed results to the application middleware server.

Description

Mass data handle framework in real time and be used for this framework in real time with the need processing platform
Technical field
The present invention relates to a kind of Computer Applied Technology, specifically the present invention relates to a kind of mass data and handle framework in real time.
Background technology
On the development history of computer software, technology such as calculating that large scale computer is the center, C/S (client/server) framework, B/S framework, multilayer distributed processing framework, Web Service calculating, grid computing have appearred in application model in succession, and these technology at present in different scenes still and depositing.Large scale computer is that calculating, the client/server framework at center mainly is present in the application of previous structure, main software architecture mostly is B/S framework, multilayer distributed processing framework and Web Service mode at present, support these frameworks and be unable to do without middleware Technology, middleware (Middleware) is the software that is between operating system and the application program, and also the someone thinks that it should belong to a part in the operating system.People in use between during part, one group of middleware integrates often, constitute a platform (comprising development platform and operation platform), but in this group middleware, must need a communication middleware, be middleware=platform+communication, this definition also defines only to be useful in the distributed system and just can be called middleware, can also make a distinction it and support programs and utility software simultaneously.Enterprise's middleware commonly used comprises message-oriented middleware, transaction middleware, Application Middleware (or claiming application server) etc., middleware use and the operating system of bottom, database between, the difficulty and the cost of application and development have been reduced, improved tempo of development, made the developer can be absorbed in professional exploitation.
Fig. 1 shows a kind of traditional three-tier architecture (hereinafter referred framework 1), and client is meant man machine operation interface, for example graphic user interface GUI; Transaction middleware is meant the software of Tuxedo, Cics and so on, mainly is responsible for business logic processing; Database, for example relational databases such as oracle, Sqlserver, mysql also can be memory database, are responsible for data access, and the partial service logic also may realize by storing process, the function of database; Operating system (Operating System is called for short OS) is a kind of special program that is used for control computer hardware.It is the system software of computing machine bottom, is in charge of, the software and hardware resources of scheduling, command computer makes its co-ordination.In framework 1, when the new function of increase causes that the client operation interface changes, must upgrade client-side program, cause maintenance to strengthen.Because client may run on the operating system of dissimilar operating systems or different editions, the exploitation aspect may need multiple code to adapt to different demands.In framework 1, service logic is moved on the middleware server in middle layer, and service logic includes access of database, when data volume or portfolio acquire a certain degree, database just can become performance bottleneck, and this bottleneck mainly is magnetic disc i/o and network I/O.This kind framework has overcome the deficiency of traditional C/S framework, but its shortcoming is an operation interface when changing, and the client maintenance amount is bigger; Because can there be performance bottleneck in network I/O and magnetic disc i/o, this framework does not have the processing capability in real time of mass data when data volume is big for transaction middleware and relational database part.
Fig. 2 shows B/S framework commonly used (hereinafter referred framework 2), and B/S (Browser/Server) structure is browser and server architecture.It is the rise along with the Internet technology, to a kind of variation or the improved structure of C/S structure.In framework 2, client is meant the program of operation in browser (Browser), as sina website, bank net program; Application Middleware (or claiming application server) is meant the mainly responsible business logic processing of software of Weblogic, Tomcat .NETFramework and so on; Database, for example the relational database of oracle, Sql server, mysql and so on also can be memory database, is responsible for data access, and the partial service logic also may realize by storing process, the function of database.Under this structure, user interface is to realize by WWW browser (Browser), and few business transaction logic realizes that at front end (Browser) the main business logic realizes at server end (Server), forms so-called three layers of 3-tier structure.So just simplify client computer load greatly, alleviated the cost and the workload of system maintenance and upgrading, reduced user's overall cost (TCO).See that with present technology LAN (Local Area Network) is set up the network application of B/S structure, and by database application under the Internet/Intranet pattern, be easy to relatively hold, cost also is lower.It is the disposable exploitation that puts in place, can realize different personnel, from different places, with different access waies, such as LAN, and WAN, visit such as Internet/Intranet and operate common database; It is protected data platform and management access authority effectively, and server database is also very safe.Particularly after the so cross-platform language of JAVA occurred, B/S framework management software was convenient, fast especially, efficient.Yet under the B/S framework, user interface main business logic realizes that at server (Server) end few partial service logic realizes that at front end (Browser) application server service data load is heavier.In service end, service logic includes access of database, and when data volume or portfolio acquired a certain degree, database just can become performance bottleneck, and this bottleneck mainly is magnetic disc i/o and network I/O.On the other hand, under the B/S framework, the development language that service end is used mostly is the language of classes such as java, jsp, asp, C#, PHP, the program that this speech like sound compiles out is with respect to C/C++, efficient obviously will be hanged down, when data volume was big, very high to the requirement meeting of resource, there was bottleneck in aspect of performance.Therefore this framework should not be handled mass data, the especially demanding mass data processing of real-time.
Fig. 3 shows the Technical Architecture (hereinafter referred framework 3) that a kind of big data quantity is handled, and in framework 3, client is carried out in Browser, and it has inherited some advantages of framework 2, has therefore avoided the difficult defective of safeguarding of framework 1 client.In framework 3, the service logic relevant operation in Application Middleware (or claiming application server) with the interface presentation layer, and the service logic in relatively more expensive source is carried out in the high transaction middleware of performance, the transaction middleware service logic carries out desired parameters and execution result is mutual by middle Application Middleware and client, and this mode is handled the performance deficiency when having overcome framework 2 Application Middleware mass data processing.Because in framework 3, service logic includes access of database in the transaction middleware, and when data volume or portfolio acquired a certain degree, database still can become performance bottleneck, and this bottleneck mainly is magnetic disc i/o and network I/O.Though framework 3 can be avoided the shortcoming of framework 1 and framework 2, reach 1,000,000 application for the per minute trading volume, the performance of relational database and transaction middleware is still bottleneck, needs bigger hardware investment to improve performance.
Fig. 4 shows the Technical Architecture (hereinafter referred framework 4) that another kind of big data quantity is handled, framework 4 is the distributed processing powers by message-oriented middleware and transaction middleware, business logic processing is distributed on the multiple servers finishes, thereby promoted the bulk treatment ability.As in telecommunication charging system, pre-service in will chargeing, wholesale price, deduct fees, processes such as warehouse-in are distributed to different nodes (server) and go up processing, perhaps carry out distributed treatment etc. by districts and cities, Coordination Treatment by message-oriented middleware and message-oriented middleware, the overall performance and the real-time of system all are improved, call the higher handling capacity of acquisition by the remote service that increases more hardware and introduce between message-oriented middleware or transaction middleware, present enterprise application software system generally all be unable to do without database and carries out information processing, in mass data (need handle p.s. thousands of even reach hundreds thousand of records) disposal system, can there be bottleneck in performance of database, and the scheme of therefore general employing framework 4 and the server of One's name is legion are handled.Because in framework 4, service logic includes access of database in the transaction middleware, and when data volume or portfolio acquired a certain degree, database still can become performance bottleneck, and this bottleneck mainly is magnetic disc i/o and network I/O.Even the use memory database is between process, internetwork expense still can be very big, has performance bottleneck.The shortcoming of framework 4 is that the performance bottleneck of relational database and transaction middleware is still unresolved, and system's investment is high, and maintenance is more.
Therefore, be desirable to provide a kind of have the mass data processing capability in real time, system's small investment, framework that maintenance is little.
Summary of the invention
The present invention is for one of solving the problems of the technologies described above, propose a kind of mass data and handled framework in real time, described framework comprise at least one client, Application Middleware server, at least one real-time information with the need processing platform and with described each in real time with the corresponding operating system of need processing platform, described at least one client be used for display application service man-machine interface, receive user's input application service relevant data and send to described Application Middleware server, and display process result; Described Application Middleware server is connected with each client, be used to receive the relevant data of the application service that sends by described client, call described at least one real-time information with the application service in the need processing platform, the result that reception is transmitted with the need processing platform by corresponding real-time information generates display interface and sends corresponding client to according to result; Described each real-time information is connected with described Application Middleware server with the need processing platform, is used to finish the business logic processing by the application service of described Application Middleware server calls, and result is returned to described Application Middleware server.
According to another aspect of the present invention, also provide a kind of mass data that is used for to handle the real-time information of framework in real time with the need processing platform, described framework comprises at least one client, the Application Middleware server, at least one real-time information is with the need processing platform, the relational database that is associated with the need processing platform with described each real-time information and with described each in real time with the corresponding operating system of need processing platform, wherein, described real-time information comprises with the need processing platform: information service bus, at least one application component storehouse, the transaction middleware engine, message-oriented middleware engine and memory database engine; Wherein said application component storehouse is used for storage and manages described application service; Described transaction middleware engine is used to call and carries out described application service, and the connection pool of foundation and described relational database, and management is connected with relational database; The message-oriented middleware engine is used for managing message queues and provides data to application service, the message queue that described message-oriented middleware engine also is used to dispose the service of triggering triggers the execution related service automatically when message arrives, its execution result can be write in other message queue in the message-oriented middleware engine; The memory database engine is used for storing real-time information with dictionary data and certain applications tables such as the user name/password of need processing platform, table, system service name, application component library name, application service name, queue name, transaction informations, the memory database engine writes disk with the data in the main memory database table, the data of acting when being engaged in processing and system exception of going forward side by side are recovered, and application service can be inquired about, upgrade, add or delete in the process of implementation the data in the memory database engine.
Description of drawings
In order more completely to understand the present invention and advantage thereof, the specific embodiment of the present invention is described now in conjunction with the accompanying drawings, reference marker identical in the accompanying drawing is represented similar implication, wherein:
Fig. 1 shows a kind of synoptic diagram of traditional three-tier architecture;
Fig. 2 shows the synoptic diagram of traditional B/S framework;
Fig. 3 shows the synoptic diagram of the Technical Architecture that a kind of traditional big data quantity handles;
Fig. 4 shows the synoptic diagram of the Technical Architecture of the traditional big data quantity processing of another kind;
Fig. 5 shows the synoptic diagram that mass data is according to an embodiment of the invention handled framework in real time;
Fig. 6 shows according to mass data of the present invention and handles real-time information in the framework in real time with the synoptic diagram of need processing platform;
Fig. 7 shows real-time information shown in Figure 6 schematic diagram with the need processing platform;
Fig. 8 shows real-time information shown in Figure 6 distributed treatment figure with the need processing platform.
Embodiment
Fig. 5 shows the synoptic diagram that mass data is according to an embodiment of the invention handled framework in real time.Mass data shown in Figure 5 is handled framework in real time and is comprised at least one client, for example 1000,1100, ..., 1n00, Application Middleware server 2000, at least one real-time information are with the need processing platform, for example 3000,3100, ..., 3n00 and with described each in real time with the corresponding operating system 4000 of need processing platform ..., 4n00, described at least one client be used for display application service man-machine interface, receive user's input application service relevant data and send to described Application Middleware server, and display process result; Described Application Middleware server is connected with each client, be used to receive the relevant data of the application service that sends by described client, call described at least one real-time information with the application service in the need processing platform, receive the result that corresponding real-time information transmits with the need processing platform, generate display interface and send corresponding client to according to result; Described each real-time information is connected with described Application Middleware server with the need processing platform, is used to finish the business logic processing by the application service of described Application Middleware server calls, and result is returned to described Application Middleware server.Wherein, described real-time information has replaced transaction middleware, message-oriented middleware and part relations database function in the framework 4 with the need processing platform.
In this framework, the user of application service---user imports the URL address and passes through client-side program in browser, for example 1000, use application service, client-side program 1000 connects by network and Application Middleware server 2000, Application Middleware server 2000 is presented at man-machine interface in the client-side program 1000, the user selects needed function and imports related data on man-machine interface, Application Middleware server 2000 obtains user's input and selected function, further call real-time information with the application service on the need processing platform 3000, application service is sent back to Application Middleware server 2000 with result after real-time information is finished the business logic processing of relatively taking resource on need processing platform 3000, Application Middleware server 2000 generates respective page according to the result of returning, and required final structure is presented at client-side program 1000.Real-time information operates on the operating system 4000 with need processing platform 3000, also will visit the relational database 5000 based on disk sometimes, and certainly, relational database 5000 is not both optionally according to using in this framework.The present invention has kept in framework 2, framework 3 and the framework 4 advantages such as client easy care, and the handling property of rear end also is increased dramatically, and the cost of hardware is lower simultaneously, can the satisfying magnanimity data in real time handle and professional flexible and changeable demand.The present invention can make the number of servers that needs under the equal data volume reduce at double or handle the data of several times under the suitable situation of server configures, even the data volume or the new business that are difficult to finish in the unit interval before can handling.
Fig. 6 shows according to mass data of the present invention and handles real-time information in the framework in real time with the synoptic diagram of need processing platform.Described real-time information comprises with the need processing platform: information service bus 3010, at least one application component storehouse 3050, transaction middleware engine 3 020, message-oriented middleware engine 3 040 and memory database engine 3 030.Application Middleware server 2000 is to call real-time information with the application service on the need processing platform 3000 by information service bus 3010.Application component storehouse 3050 is used for storage and management application service, and it is scheduled by transaction middleware engine 3 020 and carries out; Transaction middleware engine 3 020 is finished the scheduling and the execution of service, and when relation of inclusion database 5000, described transaction middleware engine 3 020 is the opening relationships database connection pool also, and management is connected with relational database 5000.Message-oriented middleware engine 3 040 is used for managing message queues and provides data to application service, application service can be obtained data from the message queue of message-oriented middleware engine 3 040 management, the message queue (be called for short and trigger formation) that message-oriented middleware engine 3 040 also is used to dispose the service of triggering triggers the execution related service automatically when message arrives, the result of its execution also can write in other message queue in the message-oriented middleware engine 3 040.Memory database engine 3 030 is used for storing real-time information with dictionary data and certain applications tables such as the user name/password of need processing platform, table, system service name, application component library name, application service name, queue name, transaction informations, memory database engine 3 030 writes disk with the data in the main memory database table, for example take cache or batch fashion to write disk, the data of acting when being engaged in processing and system exception of going forward side by side are recovered, and application service can be inquired about, upgrade, add or delete in the process of implementation the data in the memory database engine 3 030.
Information service bus 3010, transaction middleware engine 3 020, memory database engine 3 030, message-oriented middleware engine 3 040, application component storehouse 3050 and inner application service assembly thereof are positioned at real-time information with the need processing platform 3000 same process spaces, they adopt the multithreading parallel running, inner communication efficiency height can make full use of the bandwidth of CPU, internal memory and system bus.For those data of seldom visiting, as daily record and historical data etc., then can be in relational database (5000) based on disk by transaction middleware engine (3020) access.In other words, real-time information can make full use of the resource of server with need processing platform 3000, the restraining factors of its performance are the bandwidth of CPU, internal memory and system bus, and these are parts the fastest in the server, and framework 1-framework 4 commonly used now, its performance bottleneck mainly is magnetic disc i/o and network I/O, the performance of disk and network and quick parts ratio such as CPU, internal memory and system bus, and performance is obviously slow a lot.
The present invention organically integrates transaction middleware engine 3 020, memory database engine 3 030, message-oriented middleware engine 3 040, application component storehouse 3050 and information service bus 3010 technology, has constituted real-time information jointly with the need processing platform.Various assemblies in the real-time information processing platform, comprise between application component and the system component and carry out mutual communication by information service bus or message queue, this communication is to carry out in the same process space and internal memory, keep data sync by the Line Procedure Mutually-exclusive lock, this communication mode wants much efficient with respect to efficient between the process between traditional transaction middleware and database, transaction middleware and the message-oriented middleware, between network, and overall performance has the raising more than 10 times.Message can directly trigger a service; Memory database can be directly used in service; The result person that can return to the service call of service can be written in memory database or the relational database, also can be written in the message queue.Various assemblies in the platform can highly concurrently carry out, and make full use of the arithmetic capability of many CPU multiple-core server.
Fig. 7 shows real-time information shown in Figure 6 schematic diagram with the need processing platform.As shown in Figure 7 each application component in the platform with the service form be present in the application component storehouse, with the service form to the outside, for example more the Application Middleware server of front end or other software systems provide service.More specifically, the application component storehouse is actually a dynamic link libraries, and application component or title serviced component are the functions with particular form.For example, for the C/C++ language, application component has a service entrance parameter, a service export parameter and a service export parameter length parameter, and the rreturn value of function is an integer, and 0 represents successfully, and negative value is represented an error code.Very convenient application developer's design of this mode and exploitation.An application component storehouse 3050 can comprise one or more application components 3060,3061 ..., real-time information can articulate a plurality of application components storehouse 3050,3051 with need processing platform 3000 ..., 305n.The generating mode of the carrier dynamic link libraries in application component storehouse 3050 is relevant with different operating system and compiler, as compile needs-shared parameter with gcc on operating system on the linux.
For the processing that single real-time information can't be finished with the need processing platform, can be undertaken by distributed treatment.As shown in Figure 8, real-time information is with calling by remote service between the need processing platform or the message queue messenger service communicates, thereby reaches bigger treatment capacity.Call by remote service between platform or the message queue messenger service communicates, thereby reach bigger treatment capacity.For avoiding the I/O bottleneck problem between a plurality of platforms, big service logic can being divided into one by one, sub-logic adopt big data block mode to communicate between platform, so overall efficiency can be very high in the platform inter-process.And in framework 3 and framework 4, many service needed and relational database real-time Communication for Power, big data block communication mode often can not use.
Framework of the present invention is applicable to linux, Unix and windows platform.And both be applicable to and embedded system also be applicable to non-embedded system.
The reason that framework 5 mass data processing abilities are increased dramatically is, replaced traditional transaction middleware and message-oriented middleware with real-time information with need processing platform (3000) in the framework 5, the part of functions of relational database also is transferred in the memory database of real-time information with the need processing platform.Mutual and application component between application component and memory database alternately, the visit of application component and message-oriented middleware all finishes with need processing platform inside in real-time information, with respect between general process, machinery compartment visit, avoided many unnecessary I/O expenses, so performance is largely increased.
Use processing power in the framework unit interval of the present invention that the lifting of several times or ten times can be arranged, and data volume is big more, effect is obvious more.And the processing capability in real time of this framework is very strong, and service generally can be finished at Millisecond even tens of microsecond level.In addition, because machine quantity reduces at double, both can utilize cheap pc server, also can be with high-end unix server, the middleware expense of the costliness that can omit in addition, the expense that reduces even remove from relational database, so the real-time cost of this framework is very low.
The above only is a preferred implementation of the present invention, should be pointed out that for those skilled in the art, can also make various improvement, replacement and variation.These improve, replace and change under the prerequisite that does not break away from by the scope of subsidiary claim and equivalent technologies thereof, also should be considered as protection scope of the present invention.

Claims (10)

1. a mass data is handled framework in real time, it is characterized in that, described framework comprise at least one client, Application Middleware server, at least one real-time information with the need processing platform and with described each in real time with the corresponding operating system of need processing platform,
Described at least one client be used for display application service man-machine interface, receive user's input application service relevant data and send to described Application Middleware server, and display process result;
Described Application Middleware server is connected with each client, be used to receive the relevant data of the application service that sends by described client, call described at least one real-time information with the application service in the need processing platform, the result that reception is transmitted with the need processing platform by corresponding real-time information generates display interface and sends corresponding client to according to result;
Described each real-time information is connected with described Application Middleware server with the need processing platform, is used to finish the business logic processing by the application service of described Application Middleware server calls, and result is returned to described Application Middleware server.
2. framework according to claim 1 is characterized in that, described real-time information comprises with the need processing platform: information service bus, at least one application component storehouse, transaction middleware engine, message-oriented middleware engine and memory database engine; Wherein
Described application component storehouse is used for storage and manages described application service;
Described transaction middleware engine is used to call and carries out described application service;
The message-oriented middleware engine is used for managing message queues and provides data to application service, the message queue that described message-oriented middleware engine also is used to dispose the service of triggering triggers the execution related service automatically when message arrives, its execution result can be write in other message queue in the message-oriented middleware engine;
The memory database engine is used for storing real-time information with dictionary data and certain applications tables such as the user name/password of need processing platform, table, system service name, application component library name, application service name, queue name, transaction informations, the memory database engine writes disk with the data in the main memory database table, the data of acting when being engaged in processing and system exception of going forward side by side are recovered, and application service can be inquired about, upgrade, add or delete in the process of implementation the data in the memory database engine.
3. framework according to claim 2, it is characterized in that, described framework also comprises the relational database that is associated with the need processing platform with described each real-time information, and described transaction middleware engine also is used to set up the connection pool with described relational database, and management is connected with relational database.
4. framework according to claim 3, it is characterized in that, described real-time information intercoms in the same process space and same internal memory by described information service bus and message queue mutually with each assembly in the need processing platform, and keeps data sync by the Line Procedure Mutually-exclusive lock.
5. framework according to claim 4 is characterized in that, calls with message queue by remote service between the required processing platform of described real-time information to communicate, and distributed treatment is carried out in the service of using.
6. according to any described framework among the claim 3-5, it is characterized in that, described real-time information with the need processing platform in, application service can be used memory database, the execution result of application service can return to the user or be written to memory database or relational database in or write in the message queue.
7. one kind is used for mass data and handles the real-time information of framework in real time with the need processing platform, described framework comprise relational database that at least one client, Application Middleware server, at least one real-time information are associated with the need processing platform with the need processing platform, with described each real-time information and with described each in real time with the corresponding operating system of need processing platform, wherein, described real-time information comprises with the need processing platform: information service bus, at least one application component storehouse, transaction middleware engine, message-oriented middleware engine and memory database engine; Wherein
Described application component storehouse is used for storage and manages described application service;
Described transaction middleware engine is used to call and carries out described application service, and the connection pool of foundation and described relational database, and management is connected with relational database;
The message-oriented middleware engine is used for managing message queues and provides data to application service, the message queue that described message-oriented middleware engine also is used to dispose the service of triggering triggers the execution related service automatically when message arrives, its execution result can be write in other message queue in the message-oriented middleware engine;
The memory database engine is used for storing real-time information with dictionary data and certain applications tables such as the user name/password of need processing platform, table, system service name, application component library name, application service name, queue name, transaction informations, the memory database engine writes disk with the data in the main memory database table, the data of acting when being engaged in processing and system exception of going forward side by side are recovered, and application service can be inquired about, upgrade, add or delete in the process of implementation the data in the memory database engine.
8. real-time information according to claim 7 is with the need processing platform, it is characterized in that, described real-time information intercoms in the same process space and same internal memory by described information service bus and message queue mutually with each assembly in the need processing platform, and keeps data sync by the Line Procedure Mutually-exclusive lock.
9. real-time information according to claim 8 is characterized in that with the need processing platform, calls with message queue by remote service between the required processing platform of described real-time information to communicate, and distributed treatment is carried out in the service of using.
According to any described real-time information among the claim 7-9 with the need processing platform, it is characterized in that, described real-time information with the need processing platform in, application service can be used memory database, the execution result of application service can return to the user or be written to memory database or relational database in or write in the message queue.
CN200810119528A 2008-09-02 2008-09-02 Mass data real time processing structure and real time need-based processing platform used for the structure Expired - Fee Related CN100594498C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN200810119528A CN100594498C (en) 2008-09-02 2008-09-02 Mass data real time processing structure and real time need-based processing platform used for the structure

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200810119528A CN100594498C (en) 2008-09-02 2008-09-02 Mass data real time processing structure and real time need-based processing platform used for the structure

Publications (2)

Publication Number Publication Date
CN101373474A true CN101373474A (en) 2009-02-25
CN100594498C CN100594498C (en) 2010-03-17

Family

ID=40447642

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200810119528A Expired - Fee Related CN100594498C (en) 2008-09-02 2008-09-02 Mass data real time processing structure and real time need-based processing platform used for the structure

Country Status (1)

Country Link
CN (1) CN100594498C (en)

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102118452A (en) * 2011-04-18 2011-07-06 北京神州数码思特奇信息技术股份有限公司 Three-layer server architecture applied in B/S (browser/server) structure
CN103514261A (en) * 2013-08-13 2014-01-15 江苏华大天益电力科技有限公司 Data asynchronization storage and access mechanism applied to industrial control system
CN105005507A (en) * 2015-06-25 2015-10-28 黎亮 Combinative middleware system based on market
CN105426371A (en) * 2014-09-17 2016-03-23 上海三明泰格信息技术有限公司 Database system
CN105677312A (en) * 2014-11-21 2016-06-15 北京神州泰岳软件股份有限公司 Business presenting method, device and system
CN105868554A (en) * 2016-03-28 2016-08-17 朱洲森 Relay calculation method based on big data complex operation
CN106293670A (en) * 2015-06-03 2017-01-04 阿里巴巴集团控股有限公司 A kind of event-handling method, equipment and a kind of server
CN106330688A (en) * 2016-10-21 2017-01-11 上海览海在线健康管理有限公司 Method and system for sending medical message based on random message queue
CN106919666A (en) * 2017-02-17 2017-07-04 武汉逸居思宏科技有限公司 A kind of Embedded Main Memory Database of object-oriented
CN107302596A (en) * 2017-08-09 2017-10-27 广东电网有限责任公司应急抢修中心 A kind of power emergency commander repairing platform
CN107305508A (en) * 2016-04-18 2017-10-31 中芯国际集成电路制造(上海)有限公司 Manufacturing execution system and its operating method
CN108595282A (en) * 2018-05-02 2018-09-28 广州市巨硅信息科技有限公司 A kind of implementation method of high concurrent message queue
CN108885627A (en) * 2016-01-11 2018-11-23 甲骨文美国公司 Inquiry, that is, service system of query result data is provided to Terminal Server Client
CN109558417A (en) * 2018-11-28 2019-04-02 亚信科技(南京)有限公司 A kind of data processing method and platform
CN109783534A (en) * 2018-12-25 2019-05-21 浙江口碑网络技术有限公司 The processing method and processing device of statistical data evaluates the processing method and processing device of data
CN109862059A (en) * 2017-11-30 2019-06-07 北京京东尚科信息技术有限公司 Information processing method, system, electronic equipment and computer-readable medium
CN110674436A (en) * 2018-06-15 2020-01-10 视联动力信息技术股份有限公司 Data processing method and device based on browser
CN110825359A (en) * 2020-01-13 2020-02-21 华信永道(北京)科技股份有限公司 Transaction scheduling engine and construction and scheduling method, system, device and medium thereof
CN110852778A (en) * 2019-09-30 2020-02-28 口口相传(北京)网络技术有限公司 Data processing method and device for business object
CN110909079A (en) * 2019-11-20 2020-03-24 南方电网数字电网研究院有限公司 Data exchange synchronization method, system, device, server and storage medium
CN112436997A (en) * 2020-11-10 2021-03-02 杭州米络星科技(集团)有限公司 Chat room message distribution method, message distribution system and electronic equipment

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106775989B (en) * 2016-12-31 2019-07-02 北京神州绿盟信息安全科技股份有限公司 A kind of job control method and device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7016977B1 (en) * 1999-11-05 2006-03-21 International Business Machines Corporation Method and system for multilingual web server
JP2001331362A (en) * 2000-03-17 2001-11-30 Sony Corp File conversion method, data converter and file display system

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102118452A (en) * 2011-04-18 2011-07-06 北京神州数码思特奇信息技术股份有限公司 Three-layer server architecture applied in B/S (browser/server) structure
CN102118452B (en) * 2011-04-18 2016-01-06 北京思特奇信息技术股份有限公司 A kind of three stratum server frameworks being applied to B/S structure
CN103514261A (en) * 2013-08-13 2014-01-15 江苏华大天益电力科技有限公司 Data asynchronization storage and access mechanism applied to industrial control system
CN105426371A (en) * 2014-09-17 2016-03-23 上海三明泰格信息技术有限公司 Database system
CN105677312A (en) * 2014-11-21 2016-06-15 北京神州泰岳软件股份有限公司 Business presenting method, device and system
CN106293670B (en) * 2015-06-03 2020-03-20 阿里巴巴集团控股有限公司 Event processing method and device and server
CN106293670A (en) * 2015-06-03 2017-01-04 阿里巴巴集团控股有限公司 A kind of event-handling method, equipment and a kind of server
CN105005507A (en) * 2015-06-25 2015-10-28 黎亮 Combinative middleware system based on market
CN108885627A (en) * 2016-01-11 2018-11-23 甲骨文美国公司 Inquiry, that is, service system of query result data is provided to Terminal Server Client
US11775492B2 (en) 2016-01-11 2023-10-03 Oracle International Corporation Query-as-a-service system that provides query-result data to remote clients
CN108885627B (en) * 2016-01-11 2022-04-05 甲骨文美国公司 Query-as-a-service system providing query result data to remote client
CN105868554A (en) * 2016-03-28 2016-08-17 朱洲森 Relay calculation method based on big data complex operation
CN105868554B (en) * 2016-03-28 2018-03-27 朱洲森 A kind of relay drainage method based on big data complex calculation
CN107305508B (en) * 2016-04-18 2020-08-28 中芯国际集成电路制造(上海)有限公司 Manufacturing execution system and method of operating the same
CN107305508A (en) * 2016-04-18 2017-10-31 中芯国际集成电路制造(上海)有限公司 Manufacturing execution system and its operating method
CN106330688A (en) * 2016-10-21 2017-01-11 上海览海在线健康管理有限公司 Method and system for sending medical message based on random message queue
CN106919666A (en) * 2017-02-17 2017-07-04 武汉逸居思宏科技有限公司 A kind of Embedded Main Memory Database of object-oriented
CN107302596A (en) * 2017-08-09 2017-10-27 广东电网有限责任公司应急抢修中心 A kind of power emergency commander repairing platform
CN109862059A (en) * 2017-11-30 2019-06-07 北京京东尚科信息技术有限公司 Information processing method, system, electronic equipment and computer-readable medium
CN108595282A (en) * 2018-05-02 2018-09-28 广州市巨硅信息科技有限公司 A kind of implementation method of high concurrent message queue
CN110674436A (en) * 2018-06-15 2020-01-10 视联动力信息技术股份有限公司 Data processing method and device based on browser
CN109558417A (en) * 2018-11-28 2019-04-02 亚信科技(南京)有限公司 A kind of data processing method and platform
CN109558417B (en) * 2018-11-28 2023-08-08 亚信科技(南京)有限公司 Data processing method and system
CN109783534A (en) * 2018-12-25 2019-05-21 浙江口碑网络技术有限公司 The processing method and processing device of statistical data evaluates the processing method and processing device of data
CN110852778B (en) * 2019-09-30 2021-03-26 口口相传(北京)网络技术有限公司 Data processing method and device for business object
CN110852778A (en) * 2019-09-30 2020-02-28 口口相传(北京)网络技术有限公司 Data processing method and device for business object
CN110909079A (en) * 2019-11-20 2020-03-24 南方电网数字电网研究院有限公司 Data exchange synchronization method, system, device, server and storage medium
CN110825359B (en) * 2020-01-13 2020-05-08 华信永道(北京)科技股份有限公司 Transaction scheduling engine and construction and scheduling method, system, device and medium thereof
CN110825359A (en) * 2020-01-13 2020-02-21 华信永道(北京)科技股份有限公司 Transaction scheduling engine and construction and scheduling method, system, device and medium thereof
CN112436997A (en) * 2020-11-10 2021-03-02 杭州米络星科技(集团)有限公司 Chat room message distribution method, message distribution system and electronic equipment

Also Published As

Publication number Publication date
CN100594498C (en) 2010-03-17

Similar Documents

Publication Publication Date Title
CN100594498C (en) Mass data real time processing structure and real time need-based processing platform used for the structure
Gu et al. SHadoop: Improving MapReduce performance by optimizing job execution mechanism in Hadoop clusters
JP6223569B2 (en) Computer apparatus, method and apparatus for scheduling business flows
Karmani et al. Actor frameworks for the JVM platform: a comparative analysis
US8032890B2 (en) Resources managing in isolated plurality of applications context using data slots to access application global data and specification of resources lifetime to access resources
US7958077B2 (en) Rules engine for enterprise system
CN103930875A (en) Software virtual machine for acceleration of transactional data processing
CN104160381A (en) Managing tenant-specific data sets in a multi-tenant environment
CN102103518A (en) System for managing resources in virtual environment and implementation method thereof
EP1966719A1 (en) Multiple concurrent workflow persistence schemes
US9311144B1 (en) Processing virtual transactions of a workflow in atomic manner in a workflow management computer system
CN109067841A (en) Service current-limiting method, system, server and storage medium based on ZooKeeper
WO2019047441A1 (en) Communication optimization method and system
JP2011003200A (en) Method and system for managing long running transaction
Schmutz et al. Service-oriented architecture: an integration blueprint: a real-world SOA strategy for the integration of heterogeneous enterprise systems: successfully implement your own enterprise integration architecture using the trivadis integration architecture blueprint
WO2013153027A1 (en) Method and system for streaming processing in a map and reduce distributed computing platform
CN101789944B (en) Development system of communication protocol stack of multifunctional energy meter
US20210365457A1 (en) Graph database and methods with improved functionality
US20120005519A1 (en) System and method for providing collaborative master data processes
CN112104504B (en) Transaction management framework for large-scale resource access, design method and cloud platform
Avellino et al. The EU DataGrid Workload Management System: towards the second major release
CN111353766A (en) Service process processing system and method of distributed service system
US8375353B2 (en) Enabling the use of process flow applications within an information management system (IMS)
Laing et al. Transaction Management Support in the VMS Operating System Kernel
Filho et al. A fully distributed architecture for large scale workflow enactment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20100317

Termination date: 20180902

CF01 Termination of patent right due to non-payment of annual fee