CN106980509B - Computing method and device for computing bus - Google Patents
Computing method and device for computing bus Download PDFInfo
- Publication number
- CN106980509B CN106980509B CN201710217651.XA CN201710217651A CN106980509B CN 106980509 B CN106980509 B CN 106980509B CN 201710217651 A CN201710217651 A CN 201710217651A CN 106980509 B CN106980509 B CN 106980509B
- Authority
- CN
- China
- Prior art keywords
- calculation
- computing
- component
- bus
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Stored Programmes (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a computing method and a device for a computing bus, which relate to the technical field of big data, and the method comprises the following steps: receiving calculation request information sent by a calculation requester; analyzing the calculation request information to obtain a calculation flow; searching a plurality of corresponding computing components according to the computing process, and calling the plurality of corresponding computing components; analyzing the parameters of each computing component respectively, and packaging the analyzed parameters to obtain a plurality of computing instructions; executing a plurality of calculation instructions to obtain a plurality of calculation results; and performing fusion calculation on the plurality of calculation results to obtain a fusion calculation result. The invention can fully multiplex the computing components of various big data computing frameworks for computing, and can also be integrated together for fusion computing, thereby being beneficial to the development of big data application.
Description
Technical Field
The invention relates to the technical field of big data calculation, in particular to a calculation method and a calculation device for a calculation bus.
Background
The current big data computing framework can be named as five-flower eight door, including Hdfs (Hadoop Distributed File System), HBase (Hadoop Database System), Hive, Spark, Impala, Storm, Cassandra and so on, and the application of big data often mixes various big data computing frameworks, even needs to cooperate with traditional relational databases such as oracle, mysql and so on, has extremely high requirements on big data developers, brings great challenges to the implementation and application of big data, how can effectively integrate and arrange programs of various computing frameworks, and shield the complexity of the big data computing framework at the bottom, becoming a key problem for implementing big data application. Therefore, the existing big data computing framework has high development difficulty and is independent from each other and difficult to integrate together to fuse and compute, so that the development of big data application is difficult.
Disclosure of Invention
In view of this, the present invention is directed to a computing method and apparatus for computing a bus, which can call computing components of various big data computing frameworks to perform computation, and can integrate them together to perform fusion computation, thereby facilitating development of big data applications.
In a first aspect, an embodiment of the present invention provides a computing method for computing a bus, where the method includes:
receiving calculation request information sent by a calculation requester;
analyzing the calculation request information to obtain a calculation flow;
searching a plurality of corresponding computing components according to the computing process, and calling the plurality of corresponding computing components;
analyzing the parameters of each computing assembly respectively, and packaging the analyzed parameters to obtain a plurality of computing instructions;
executing a plurality of calculation instructions to obtain a plurality of calculation results;
and performing fusion calculation on the calculation results to obtain a fusion calculation result.
With reference to the first aspect, an embodiment of the present invention provides a first possible implementation manner of the first aspect, where the calculation request information includes a protocol packet header and a protocol packet body, and the analyzing the calculation request information to obtain a calculation flow includes:
analyzing the protocol packet header to obtain identity information of the calculation requester, and performing identity authentication on the identity information;
acquiring authority information of the calculation requester according to the identity information, and performing authority authentication on the authority information;
and if the authority authentication is passed, analyzing the protocol packet body to obtain the calculation flow.
With reference to the first aspect, an embodiment of the present invention provides a second possible implementation manner of the first aspect, where the searching for a corresponding computing component according to the computing process and invoking the corresponding computing component includes:
judging whether the corresponding computing component is registered or not, and if so, judging whether the metadata information of the corresponding computing component is correct or not;
if the calculation is correct, selecting a calculation server from the calculation bus server cluster, and sending the metadata information of the corresponding calculation component to the calculation server;
and calling the corresponding computing component according to the metadata information.
With reference to the first aspect, an embodiment of the present invention provides a third possible implementation manner of the first aspect, where the computing component includes a first computing component, a second computing component, and a third computing component, where the first computing component and the second computing component respectively correspond to a first computing result and a second computing result, and the performing fusion computation on the multiple computing results to obtain a fusion computing result includes:
sending the first calculation result to a second calculation component so that the second calculation component obtains the second calculation result until all the calculation components finish calculating to obtain the fusion calculation result;
alternatively, the first and second electrodes may be,
and combining the first calculation result and the second calculation result to obtain a third calculation result, and sending the third calculation result to the third calculation component so that the third calculation component obtains a fourth calculation result until all the calculation components finish calculating to obtain the fusion calculation result.
With reference to the first aspect, an embodiment of the present invention provides a fourth possible implementation manner of the first aspect, where the method further includes:
executing a plurality of calculation instructions to obtain a plurality of calculation logs;
and saving the calculation log.
In a second aspect, an embodiment of the present invention further provides a computing apparatus for computing a bus, where the apparatus includes:
the computing bus receiving module is used for receiving computing request information sent by a computing request party;
the calculation bus analysis module is used for analyzing the calculation request information to obtain a calculation flow;
the calculation bus calling module is used for searching a plurality of corresponding calculation components according to the calculation flow and calling the plurality of corresponding calculation components;
the calculation component analysis module is used for analyzing the parameters of each calculation component and packaging the analyzed parameters into calculation instructions to obtain a plurality of calculation instructions;
the calculation engine execution module is used for executing a plurality of calculation instructions to obtain a plurality of calculation results;
and the calculation bus fusion calculation module is used for performing fusion calculation on the calculation results to obtain a fusion calculation result.
With reference to the second aspect, an embodiment of the present invention provides a first possible implementation manner of the second aspect, where the computation request information includes a protocol packet header and a protocol packet body, and the computation bus parsing module includes:
the identity authentication module is used for analyzing the protocol packet header to obtain the identity information of the calculation requester and performing identity authentication on the identity information;
the authority authentication module is used for acquiring the authority information of the calculation requester according to the identity information and performing authority authentication on the authority information;
and the analysis module is used for analyzing the protocol packet body under the condition that the authority authentication passes to obtain the calculation flow.
With reference to the second aspect, an embodiment of the present invention provides a second possible implementation manner of the second aspect, where the computing bus calling module includes:
the judging module is used for judging whether the corresponding computing component is registered or not, and if the corresponding computing component is registered, judging whether the metadata information of the corresponding computing component is correct or not;
the selection module is used for selecting a computing server from a computing bus server cluster under the condition that the metadata information of the corresponding computing component is correct, and sending the metadata information of the corresponding computing component to the computing server;
and the calling module is used for calling the corresponding computing component according to the metadata information.
With reference to the second aspect, an embodiment of the present invention provides a third possible implementation manner of the second aspect, where the computing components include a first computing component, a second computing component, and a third computing component, where the first computing component and the second computing component respectively correspond to a first computing result and a second computing result, and the computing bus fusion computing module includes:
the first fusion calculation module is used for sending the first calculation result to a second calculation component so that the second calculation component obtains the second calculation result until all the calculation components are calculated to obtain the fusion calculation result;
alternatively, the first and second electrodes may be,
and the second fusion calculation module is used for combining the first calculation result and the second calculation result to obtain a third calculation result and sending the third calculation result to the third calculation component so that the third calculation component obtains a fourth calculation result until all the calculation components are calculated to obtain the fusion calculation result.
With reference to the third possible implementation manner of the second aspect, an embodiment of the present invention provides a fourth possible implementation manner of the second aspect, where the apparatus further includes:
the calculation engine execution submodule is used for executing the plurality of calculation instructions to obtain a plurality of calculation logs;
and the calculation bus storage module is used for storing the calculation log.
The embodiment of the invention provides a computing method and a device for a computing bus, which receive computing request information sent by a computing request party; analyzing the calculation request information to obtain a calculation flow; searching a plurality of corresponding computing components according to the computing process, and calling the plurality of corresponding computing components; analyzing the parameters of each computing component respectively, and packaging the analyzed parameters to obtain a plurality of computing instructions; executing a plurality of calculation instructions to obtain a plurality of calculation results; and performing fusion calculation on the plurality of calculation results to obtain a fusion calculation result. Therefore, the computing components of various big data computing frameworks can be called to carry out computation and can be integrated together to carry out fusion computation, thereby being beneficial to the development of big data application.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a flowchart of a computing method for computing a bus according to an embodiment of the present invention;
fig. 2 is a flowchart of step S102 of a method for calculating a bus according to an embodiment of the present invention;
fig. 3 is a flowchart of step S103 of the method for calculating a bus according to the first embodiment of the present invention;
FIG. 4 is a diagram of a computing bus according to a second embodiment of the present invention;
fig. 5 is a signaling diagram of a computing method for computing a bus according to a second embodiment of the present invention;
FIG. 6 is a schematic structural diagram of a computing device for computing a bus according to a second embodiment of the present invention;
fig. 7 is a schematic structural diagram of a computing bus parsing module according to a second embodiment of the present invention;
fig. 8 is a schematic structural diagram of a calculation bus call module according to a second embodiment of the present invention.
Icon:
10-a computing bus receiving module; 20-calculating bus analysis module; 30-a calculation bus calling module; 40-a compute component parsing module; 50-a compute engine execution module; 60-a calculation bus fusion calculation module; 21-identity authentication module; 22-a rights authentication module; 23-an analysis module; 31-a judgment module; 32-a selection module; 33-Call Module.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The current big data computing framework can be named as five-flower eight door, including Hdfs, HBase, Hive, Spark, Impala, Storm, Cassandra and the like, and the application of big data often mixes various big data computing frameworks, even needs to work cooperatively with traditional relational databases such as oracle, mysql and the like, has extremely high requirements on big data developers, brings great challenges to the implementation and application of big data, can effectively integrate and arrange programs of various computing frameworks, shields the complexity of the big data computing framework at the bottom layer, and becomes a key problem for implementing big data application. Therefore, the existing big data computing framework has high development difficulty and is independent from each other and difficult to integrate together to fuse and compute, so that the development of big data application is difficult. Based on this, the computing method and the computing device for the computing bus provided by the embodiment of the invention can call computing components of various big data computing frameworks to perform computing, and can be integrated together to perform fusion computing, thereby being beneficial to the development of big data application.
For the understanding of the present embodiment, the method for computing the bus according to the embodiment of the present invention will be described in detail first,
the first embodiment is as follows:
fig. 1 is a flowchart of a computing method for computing a bus according to an embodiment of the present invention.
Referring to fig. 1, a calculation method of a calculation bus includes:
step S101, receiving calculation request information sent by a calculation requester;
here, as shown in fig. 4, the computation bus receives a computation request sent by a computation requester, and here, the computation bus adopts a Master-Slave distributed cluster computation framework, which guarantees the reliability and stability of the computation bus and improves the high concurrent processing capability of the computation bus.
The calculation request party is a request party needing to use calculation service, and initiates calculation request information to the calculation bus according to a calculation protocol specified by the calculation bus, wherein the calculation request information comprises data mining calculation, real-time query calculation, statistical analysis calculation, ETL (Extraction-Transformation-Loading) calculation and the like.
Step S102, analyzing the calculation request information to obtain a calculation flow;
specifically, the calculation request information is a protocol packet encapsulated according to a calculation protocol specified by the calculation bus, that is, the calculation flow is arranged according to a calculation flow arrangement protocol of the calculation bus, after the arrangement is completed, a protocol packet is formed and sent to the calculation bus, the protocol packet includes a packet header and a packet body, the packet header is identity information, the packet body is calculation flow information, and the calculation flow can be obtained by analyzing the protocol packet.
Further, as shown in fig. 2, step S102 can be implemented by the following steps:
step S201, analyzing the protocol packet header to obtain the identity information of the calculation requester, and performing identity authentication on the identity information;
step S202, acquiring authority information of a calculation requester according to the identity information, and performing authority authentication on the authority information;
and step S203, if the authority authentication is passed, analyzing the protocol packet body to obtain a calculation flow.
Step S103, searching a plurality of corresponding computing components according to the computing process, and calling the plurality of corresponding computing components;
specifically, the computing components are reusable general-purpose computing components, such as a data extraction component, a data conversion component, a data loading data component, a data query component, a statistical analysis component, a data mining component, and the like, the computing components can call a computing engine to complete computing tasks, after the computing components are developed, the computing components need to be registered in a computing bus, and the computing bus performs layout of computing processes by using the registered computing components to complete computing logic development of big data applications.
Further, as shown in fig. 3, step S103 may be implemented by the following steps:
step S301, judging whether the corresponding computing component is registered, and if so, judging whether the metadata information of the corresponding computing component is correct;
step S302, if the result is correct, selecting a computing server from a computing bus server cluster, and sending the metadata information of the corresponding computing component to the computing server;
step S303, calling the corresponding computing component according to the metadata information.
Step S104, analyzing the parameters of each computing assembly respectively, and packaging the analyzed parameters to obtain a plurality of computing instructions;
step S105, executing a plurality of calculation instructions to obtain a plurality of calculation results;
here, the computation component may call a computation engine according to the computation requirement to run a specific computation instruction, and feed back the computation result to the computation component, where the computation engine specifically includes a computation engine such as Hadoop, Spark, Impala, Storm, rhadop, message queue, memory grid, and a relational database Oracle, Mysql, and specifically refer to fig. 4.
And S106, performing fusion calculation on the plurality of calculation results to obtain a fusion calculation result.
It should be noted that, after receiving the computation request, the computation bus performs security authentication on the identity and the authority of the computation requester, analyzes the computation protocol to obtain a computation flow, and searches for the computation components corresponding to the computation flow, so as to sequentially or concurrently call each computation component according to the sequence of the computation flow to perform computation, and return the final result of fusion computation and the computation log to the computation requester.
Further, the calculation components include a first calculation component, a second calculation component and a third calculation component, the first calculation component and the second calculation component respectively correspond to the first calculation result and the second calculation result, and the step S106 includes:
sending the first calculation result to a second calculation component to enable the second calculation component to obtain a second calculation result until all calculation components are calculated to obtain a fusion calculation result;
alternatively, the first and second electrodes may be,
and combining the first calculation result and the second calculation result to obtain a third calculation result, and sending the third calculation result to a third calculation component so that the third calculation component obtains a fourth calculation result until all calculation components finish calculating to obtain a fusion calculation result.
Specifically, the number of computing components is large, the computation of each computing component may be serial or parallel, if the computation is serial, the computation result of the previous computing component is submitted to the next computing component for the next computation, and if the computation result is parallel, the computation results of the parallel computing components are merged and then submitted to the next computing component for the next computation.
According to an exemplary embodiment of the invention, the method further comprises:
executing a plurality of calculation instructions to obtain a plurality of calculation logs;
and saving the calculation log.
Here, the computation bus stores the computation log obtained by computation, and the computation log is sent to the computation requester only when the computation requester requests to view the computation log.
As shown in fig. 5, the key steps of the specific flow of the computing method for computing the bus are as follows:
(1) the calculation requester encapsulates the calculation request into a protocol packet according to a calculation protocol specified by the calculation bus to initiate a calculation request;
(2) the computing bus receives the computing request, analyzes the identity information of the computing requester, performs security authentication on the identity information and the authority information after analysis, returns failure information to the computing requester when authentication fails, further analyzes the requested computing flow when authentication succeeds, and calls the computing components in sequence or in parallel according to the sequence of the computing flow after the analysis succeeds.
(3) In the calling process of the computing component, the computing bus needs to search the component, whether the component is registered or not and whether the metadata information of the component is correct or not, and after the component is successfully searched, a server with the most idle resources in a computing bus server cluster is searched, and the metadata of the computing component is sent to the server so that the server calls the computing component;
(4) after receiving a call instruction of a computing bus, a computing component initializes the component environment, analyzes input and output parameters of the component, packages the analyzed input and output parameters into a computing instruction of a computing engine, and sends the computing instruction to the computing engine for execution;
(5) the calculation engine executes the calculation instruction and returns the calculation result and the calculation log to the calculation component;
(6) the computing module receives a computing result and a computing log returned by the computing engine, packages the computing result and returns the packaged computing result and log to the computing bus;
(7) and the computing bus calls the computing components in sequence or in parallel according to the sequence of the computing process until the process execution is finished. The calling process of each computing component is the same as the steps (3) - (6) of the above steps. After the flow execution is finished, the calculation bus encapsulates the result of the flow fusion calculation and returns the encapsulated result to the calculation requester;
(8) and the calculation requester receives the final calculation result returned by the calculation bus and analyzes the final calculation result.
The computing method of the computing bus provided by the embodiment of the invention adopts the distributed computing framework, can register the computing components of various big data computing frameworks to the computing bus, does not need to consider the specific bottom computing framework, can realize the computing logic of big data application only by using the computing bus and using various computing components to arrange and call the computing process, effectively lightens the technical complexity of big data application development, can fully utilize the advantages of various computing frameworks, can fully reuse the computing components of various computing frameworks, can also be integrated together for fusion computing, and reduces the development difficulty of big data application.
The embodiment of the invention provides a computing method of a computing bus, which comprises the steps of receiving computing request information sent by a computing request party; analyzing the calculation request information to obtain a calculation flow; searching a plurality of corresponding computing components according to the computing process, and calling the plurality of corresponding computing components; analyzing the parameters of each computing component respectively, and packaging the analyzed parameters to obtain a plurality of computing instructions; executing a plurality of calculation instructions to obtain a plurality of calculation results; and performing fusion calculation on the plurality of calculation results to obtain a fusion calculation result. Therefore, the computing components of various big data computing frameworks can be called to carry out computation and can be integrated together to carry out fusion computation, thereby being beneficial to the development of big data application.
Example two:
fig. 6 is a schematic structural diagram of a computing device for computing a bus according to a second embodiment of the present invention.
Referring to fig. 6, a computing device that computes a bus includes:
a calculation bus receiving module 10, configured to receive calculation request information sent by a calculation requester;
the calculation bus analysis module 20 is used for analyzing the calculation request information to obtain a calculation flow;
the calculation bus calling module 30 is configured to search a plurality of corresponding calculation components according to a calculation flow, and call the plurality of corresponding calculation components;
the calculation component analysis module 40 is used for analyzing the parameters of each calculation component and packaging the analyzed parameters into calculation instructions to obtain a plurality of calculation instructions;
a calculation engine executing module 50, configured to execute a plurality of calculation instructions to obtain a plurality of calculation results;
and the calculation bus fusion calculation module 60 is configured to perform fusion calculation on the multiple calculation results to obtain a fusion calculation result.
Further, the calculation request information includes a protocol packet header and a protocol packet body, as shown in fig. 7, the calculation bus parsing module 20 includes:
the identity authentication module 21 is configured to analyze the protocol packet header to obtain identity information of the calculation requester, and perform identity authentication on the identity information;
the authority authentication module 22 is used for acquiring the authority information of the calculation requester according to the identity information and performing authority authentication on the authority information;
and the analysis module 23 is configured to analyze the protocol packet body to obtain a calculation flow when the authority authentication passes.
Further, as shown in fig. 8, the calculation bus calling module 30 includes:
a judging module 31, configured to judge whether a corresponding computing component is registered, and if so, judge whether metadata information of the corresponding computing component is correct;
the selection module 32 is configured to select a computing server from the computing bus server cluster under the condition that the metadata information of the corresponding computing component is correct, and send the metadata information of the corresponding computing component to the computing server;
and the calling module 33 is configured to call the corresponding computing component according to the metadata information.
Further, the calculation component comprises a first calculation component, a second calculation component and a third calculation component, the first calculation component and the second calculation component respectively correspond to the first calculation result and the second calculation result, and the calculation bus fusion calculation module comprises:
the first fusion calculation module (not shown) is used for sending the first calculation result to the second calculation component so that the second calculation component obtains a second calculation result until all the calculation components are calculated to obtain a fusion calculation result;
alternatively, the first and second electrodes may be,
and a second fusion calculation module (not shown) for combining the first calculation result and the second calculation result to obtain a third calculation result, and sending the third calculation result to the third calculation component, so that the third calculation component obtains a fourth calculation result until all calculation components are calculated, and obtaining a fusion calculation result.
Further, the apparatus further comprises:
a computation engine execution submodule (not shown) for executing a plurality of computation instructions to obtain a plurality of computation logs;
and a computation bus saving module (not shown) for saving the computation log.
The computing device for computing the bus according to the embodiment of the present invention has the same technical features as the computing method for computing the bus according to the embodiment of the present invention, so that the same technical problems can be solved, and the same technical effects can be achieved.
The computing device for computing the bus provided by the embodiment of the invention comprises: the computing bus receiving module is used for receiving computing request information sent by a computing request party; the calculation bus analysis module is used for analyzing the calculation request information to obtain a calculation flow; the computing bus calling module is used for searching a plurality of corresponding computing components according to the computing process and calling the plurality of corresponding computing components; the calculation component analysis module is used for analyzing the parameters of each calculation component and packaging the analyzed parameters into calculation instructions to obtain a plurality of calculation instructions; the calculation engine execution module is used for executing a plurality of calculation instructions to obtain a plurality of calculation results; and the calculation bus fusion calculation module is used for performing fusion calculation on the plurality of calculation results to obtain a fusion calculation result. The computing components of various big data computing frameworks are called to carry out computing, and can be integrated together to carry out fusion computing, so that the development of big data application is facilitated.
The computer program product provided in the embodiment of the present invention includes a computer-readable storage medium storing a program code, where instructions included in the program code may be used to execute the method described in the foregoing method embodiment, and specific implementation may refer to the method embodiment, which is not described herein again.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In addition, in the description of the embodiments of the present invention, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present invention, which are used for illustrating the technical solutions of the present invention and not for limiting the same, and the protection scope of the present invention is not limited thereto, although the present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present invention, and they should be construed as being included therein. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (8)
1. A computing method for computing a bus, the method comprising:
receiving calculation request information sent by a calculation requester;
analyzing the calculation request information to obtain a calculation flow;
searching a plurality of corresponding computing components according to the computing process, and calling the plurality of corresponding computing components;
analyzing the parameters of each computing assembly respectively, and packaging the analyzed parameters to obtain a plurality of computing instructions;
executing a plurality of calculation instructions to obtain a plurality of calculation results;
performing fusion calculation on the calculation results to obtain fusion calculation results;
the calculation request information comprises a protocol packet header and a protocol packet body, and the analysis of the calculation request information to obtain the calculation flow comprises the following steps:
analyzing the protocol packet header to obtain identity information of the calculation requester, and performing identity authentication on the identity information;
acquiring authority information of the calculation requester according to the identity information, and performing authority authentication on the authority information;
and if the authority authentication is passed, analyzing the protocol packet body to obtain the calculation flow.
2. The computing method of the computing bus according to claim 1, wherein the searching for the corresponding computing component according to the computing process and invoking the corresponding computing component comprises:
judging whether the corresponding computing component is registered or not, and if so, judging whether the metadata information of the corresponding computing component is correct or not;
if the calculation is correct, selecting a calculation server from the calculation bus server cluster, and sending the metadata information of the corresponding calculation component to the calculation server;
and calling the corresponding computing component according to the metadata information.
3. The computing method of the computing bus according to claim 1, wherein the computing components include a first computing component, a second computing component, and a third computing component, the first computing component and the second computing component respectively correspond to a first computing result and a second computing result, and the performing the fusion computation on the plurality of computing results to obtain the fusion computing result includes:
sending the first calculation result to a second calculation component so that the second calculation component obtains the second calculation result until all the calculation components finish calculating to obtain the fusion calculation result;
alternatively, the first and second electrodes may be,
and combining the first calculation result and the second calculation result to obtain a third calculation result, and sending the third calculation result to the third calculation component so that the third calculation component obtains a fourth calculation result until all the calculation components finish calculating to obtain the fusion calculation result.
4. The method of computing a computing bus of claim 1, further comprising:
executing a plurality of calculation instructions to obtain a plurality of calculation logs;
and saving the calculation log.
5. A computing device that computes a bus, the device comprising:
the computing bus receiving module is used for receiving computing request information sent by a computing request party;
the calculation bus analysis module is used for analyzing the calculation request information to obtain a calculation flow;
the calculation bus calling module is used for searching a plurality of corresponding calculation components according to the calculation flow and calling the plurality of corresponding calculation components;
the calculation component analysis module is used for analyzing the parameters of each calculation component and packaging the analyzed parameters into calculation instructions to obtain a plurality of calculation instructions;
the calculation engine execution module is used for executing a plurality of calculation instructions to obtain a plurality of calculation results;
the calculation bus fusion calculation module is used for carrying out fusion calculation on a plurality of calculation results to obtain fusion calculation results;
the calculation request information comprises a protocol packet header and a protocol packet body, and the calculation bus analysis module comprises:
the identity authentication module is used for analyzing the protocol packet header to obtain the identity information of the calculation requester and performing identity authentication on the identity information;
the authority authentication module is used for acquiring the authority information of the calculation requester according to the identity information and performing authority authentication on the authority information;
and the analysis module is used for analyzing the protocol packet body under the condition that the authority authentication passes to obtain the calculation flow.
6. The computing device of claim 5, wherein the computing bus call module comprises:
the judging module is used for judging whether the corresponding computing component is registered or not, and if the corresponding computing component is registered, judging whether the metadata information of the corresponding computing component is correct or not;
the selection module is used for selecting a computing server from a computing bus server cluster under the condition that the metadata information of the corresponding computing component is correct, and sending the metadata information of the corresponding computing component to the computing server;
and the calling module is used for calling the corresponding computing component according to the metadata information.
7. The computing device of claim 5, wherein the computing components comprise a first computing component, a second computing component, and a third computing component, the first computing component and the second computing component respectively corresponding to a first computing result and a second computing result, and the computing bus fusion computing module comprises:
the first fusion calculation module is used for sending the first calculation result to a second calculation component so that the second calculation component obtains the second calculation result until all the calculation components are calculated to obtain the fusion calculation result;
alternatively, the first and second electrodes may be,
and the second fusion calculation module is used for combining the first calculation result and the second calculation result to obtain a third calculation result and sending the third calculation result to the third calculation component so that the third calculation component obtains a fourth calculation result until all the calculation components are calculated to obtain the fusion calculation result.
8. The computing device of a computing bus of claim 5, wherein the device further comprises:
the calculation engine execution submodule is used for executing the plurality of calculation instructions to obtain a plurality of calculation logs;
and the calculation bus storage module is used for storing the calculation log.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710217651.XA CN106980509B (en) | 2017-04-05 | 2017-04-05 | Computing method and device for computing bus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710217651.XA CN106980509B (en) | 2017-04-05 | 2017-04-05 | Computing method and device for computing bus |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106980509A CN106980509A (en) | 2017-07-25 |
| CN106980509B true CN106980509B (en) | 2021-01-19 |
Family
ID=59345486
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710217651.XA Active CN106980509B (en) | 2017-04-05 | 2017-04-05 | Computing method and device for computing bus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106980509B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110377428A (en) * | 2019-07-23 | 2019-10-25 | 上海盈至自动化科技有限公司 | A kind of collecting and distributing type data analysis and Control system |
| CN113064920A (en) * | 2021-02-26 | 2021-07-02 | 苏宁金融科技(南京)有限公司 | Real-time computing method and device based on Flink, computer equipment and storage medium |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9152457B2 (en) * | 2009-06-05 | 2015-10-06 | International Business Machines Corporation | Processing request management |
| CN102377824A (en) * | 2011-10-19 | 2012-03-14 | 江西省南城县网信电子有限公司 | Cloud computing-based spatial information service system |
| US9509571B1 (en) * | 2012-07-25 | 2016-11-29 | NetSuite Inc. | First-class component extensions for multi-tenant environments |
| CN104166701B (en) * | 2014-08-04 | 2018-07-31 | 深圳先进技术研究院 | machine learning method and system |
| CN106161520A (en) * | 2015-04-02 | 2016-11-23 | 朗新科技股份有限公司 | Big market demand platform and exchange method based on it |
| CN104834561B (en) * | 2015-04-29 | 2018-01-19 | 华为技术有限公司 | A kind of data processing method and device |
| US10360086B2 (en) * | 2015-08-28 | 2019-07-23 | Vmware, Inc. | Fair decentralized throttling in distributed cloud-based systems |
| CN105045607B (en) * | 2015-09-02 | 2019-03-29 | 广东创我科技发展有限公司 | A method of realizing a variety of big data Computational frame unified interfaces |
| CN105760221B (en) * | 2016-02-02 | 2018-12-07 | 中博信息技术研究院有限公司 | The task of distributed computing framework sends system |
-
2017
- 2017-04-05 CN CN201710217651.XA patent/CN106980509B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN106980509A (en) | 2017-07-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11514191B2 (en) | Weighted source data secured on blockchains | |
| US10609035B2 (en) | Access guards for multi-tenant logging | |
| CN111258725B (en) | Data processing method, device, equipment and medium based on block chain | |
| CN105574082A (en) | Storm based stream processing method and system | |
| CN111258867B (en) | Public cloud dial testing method and device | |
| CN106980509B (en) | Computing method and device for computing bus | |
| CN111709023A (en) | Application isolation method and system based on trusted operating system | |
| CN112559285A (en) | Distributed service architecture-based micro-service monitoring method and related device | |
| CN106210159B (en) | Domain name resolution method and device | |
| CA3180833A1 (en) | Flink sql statement verification method and device, computer equipment and storage medium | |
| Zhang et al. | Research on Lightweight Blockchain Technology Based on Edge Computing | |
| CN108763053A (en) | Bury the generation method and terminal device of a title | |
| CN106649352B (en) | Data processing method and device | |
| CN109348304B (en) | Bullet screen data verification method and device and terminal | |
| CN113220646A (en) | Data analysis method and device, computer equipment and storage medium | |
| CN109284278B (en) | Calculation logic migration method based on data analysis technology and terminal equipment | |
| CN112181816A (en) | Interface testing method and device based on scene, computer equipment and medium | |
| CN111221847A (en) | Monitoring data storage method and device and computer readable storage medium | |
| CN113268487B (en) | Data statistical method, device and computer readable storage medium | |
| CN109413504B (en) | Bullet screen checking method, device, terminal and storage medium based on character string replacement | |
| CN113760372B (en) | Binary data packet analysis method and system | |
| CN110287265B (en) | Login request processing method and device, server and readable storage medium | |
| CN115033397A (en) | Interface calling method, device, equipment and storage medium | |
| CN115795425A (en) | Permission verification method and device for data processing task | |
| CN117834405A (en) | Data processing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |