CN110008042A - A kind of algorithm Cascading Methods and system based on container - Google Patents
A kind of algorithm Cascading Methods and system based on container Download PDFInfo
- Publication number
- CN110008042A CN110008042A CN201910247933.3A CN201910247933A CN110008042A CN 110008042 A CN110008042 A CN 110008042A CN 201910247933 A CN201910247933 A CN 201910247933A CN 110008042 A CN110008042 A CN 110008042A
- Authority
- CN
- China
- Prior art keywords
- algorithm
- data
- container
- demand
- currently performed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/543—User-generated data transfer, e.g. clipboards, dynamic data exchange [DDE], object linking and embedding [OLE]
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The present invention provides a kind of algorithm Cascading Methods and system based on container this method comprises: the algorithm for obtaining user's input cascades demand, and cascade demand according to algorithm and obtain multiple algorithm containers for being deployed with algorithm corresponding with algorithm cascade demand；Sequence is executed according to what algorithm cascaded that demand determines each algorithm container；The data demand of each algorithm container is obtained according to execution sequence；According to the data demand of currently performed algorithm container, the data that currently performed algorithm container exports are converted to the input data for meeting the data demand of next pending algorithm container.By implementing the present invention, pass through the execution sequence and the corresponding data demand of each algorithm container according to algorithm container, data type conversion is carried out to the output data of algorithm container, be converted to the input data for meeting algorithm input demand, so that data can satisfy the format needs between algorithms of different, ensure that data are transmitted between algorithm, realizes the cascade of algorithm.
Description
Technical field
The present invention relates to field of computer technology, and in particular to a kind of algorithm Cascading Methods and system based on container.
Background technique
In the primary stage of software development, almost all of application program is all that the form stacked with protocol stack is opened
Hair, and be deployed on single proprietary server.Application program comprising middleware, running environment and operating system is to be based on
What a series of protocol stacks defined were developed, deployment way is that application program configures single professional server, that is,
It is unable to operate normally departing from the running environment whole system of origin.With the development of computational science, this mode is more next
It is not able to satisfy increasingly complicated internet environment and product demand more.
As the appearance of container technique solves this problem, container assembles application program just as container, it is
A kind of virtualization technology based on operating system, operates in the user's space on operating system, and all containers all share one
A system kernel, even public library.Container engine provides the isolation of process-level, allows each container as operating in individually
On system, but many underlying resources can be shared.It is convenient that the appearance of container is provided to the deployment of algorithm, previous clothes
Business device disposes a kind of algorithm, can dispose hundreds and thousands of kinds of algorithm containers on a present high-performance server.But it is actual
In business scenario, an algorithm not can solve all problems in business scenario, during assembly algorithm is formed and is applied,
It needs algorithm carrying out cascade work.Currently, in the prior art when needing polyalgorithm to be cooperated, it is unstable
Mode ensure that data are transmitted between algorithm, algorithm after causing the output format of previous algorithm not to be able to satisfy
The demand of the format of input, so that algorithm cascade operation is difficult to realize.
Summary of the invention
In view of this, the embodiment of the invention provides a kind of algorithm Cascading Methods and system based on container, existing to solve
There is mode really stable in technology to ensure that data are transmitted between algorithm, leads to the output format of previous algorithm not
After being able to satisfy the problem of the format needs of the input of algorithm.
According in a first aspect, the embodiment of the invention provides a kind of algorithm Cascading Methods based on container, comprising: obtain and use
The algorithm of family input cascades demand, and cascades demand according to the algorithm and obtain multiple be deployed with and algorithm cascade demand phase
The algorithm container of corresponding algorithm；Sequence is executed according to what the algorithm cascaded that demand determines each algorithm container；According to described
Execution sequence obtains the data demand of each algorithm container；It is wanted according to the data of the currently performed algorithm container
It asks, the data of the currently performed algorithm container output is converted to the institute for meeting next pending algorithm container
State the input data of data demand.
Optionally, the data demand according to the currently performed algorithm container, will be described currently performed
The data of the algorithm container output are converted to the input number for meeting the data demand of next pending algorithm container
According to, comprising: according to the data demand of preset data transformation rule and the currently performed algorithm container to the algorithm
The data of container output carry out Data Format Transform, generate intermediate conversion data；The intermediate conversion data are converted into satisfaction
The input data of the data demand of next pending algorithm container.
Optionally, the data demand includes: data output format information and data entry format requirement.
Optionally, described according to preset data transformation rule and the data demand of the currently performed algorithm container
Data Format Transform is carried out to the data of algorithm container output, generates intermediate conversion data, comprising: obtain currently performed
The data output format information of the algorithm container；Believed according to the preset data transformation rule and the data output format
Breath, determines the intermediate conversion data format of the currently performed algorithm container output data；According to the intermediate conversion
Data format carries out Data Format Transform to the currently performed algorithm container output data, generates the intermediate conversion
Data.
Optionally, described that the intermediate conversion data are converted to the data demand for meeting next algorithm container
Input data, comprising: obtain the number of next pending algorithm container of the currently performed algorithm container
It is required according to input format；According to the data entry requirement, the intermediate conversion data are converted to and meet the data input
The input data of call format.
According to second aspect, the algorithm cascade system based on container that the embodiment of the invention also provides a kind of, comprising: obtain
Module, the algorithm for obtaining user's input cascades demand, and cascades demand according to the algorithm and obtain multiple be deployed with and institute
State the algorithm container of the algorithm cascade corresponding algorithm of demand；Execution sequence determining module, for cascading demand according to the algorithm
Determine each algorithm container executes sequence；Data demand obtains module, each described for being obtained according to the execution sequence
The data demand of algorithm container；Data conversion module, for the data demand according to the currently performed algorithm container,
The data of the currently performed algorithm container output are converted to and are met described in next pending algorithm container
The input data of data demand.
Optionally, the data conversion module includes: the first conversion module, for according to preset data transformation rule and working as
The data demand of the algorithm container of preceding execution carries out Data Format Transform to the data that the algorithm container exports, raw
At intermediate conversion data；Second conversion module meets next pending calculation for being converted to the intermediate conversion data
The input data of the data demand of method container.
Optionally, the data demand includes: data output format information and data entry format requirement.
It is described computer-readable the embodiment of the invention provides a kind of computer readable storage medium according to the third aspect
Storage medium stores computer instruction, the computer instruction for make the computer execute the first first aspect or its
Algorithm Cascading Methods based on container described in a kind of optional embodiment of anticipating.
According to fourth aspect, the embodiment of the invention provides a kind of electronic equipment, comprising: memory and processor, it is described
Connection is communicated with each other between memory and the processor, computer instruction is stored in the memory, and the processor is logical
Cross and execute the computer instruction, thereby executing described in first aspect or its any one optional embodiment based on appearance
The algorithm Cascading Methods of device.
Technical solution of the present invention has the advantages that
Algorithm Cascading Methods provided in an embodiment of the present invention based on container cascade need by the algorithm inputted according to user
It asks, obtains the sequence that executes of corresponding algorithm container and each algorithm container, and then each algorithm is obtained according to execution sequence and is held
The data demand of device, and the current data for executing the output of algorithm container are converted to according to data demand and meet next pending calculation
The input data of the data demand of method container.To by corresponding according to the execution sequence of algorithm container and each algorithm container
Data demand carries out data type conversion to the output data of algorithm container, is converted to the input number for meeting algorithm input demand
According to so that data can satisfy the format needs between algorithms of different, it is ensured that data are transmitted between algorithm, are realized
The cascade of algorithm.
Detailed description of the invention
It, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical solution in the prior art
Embodiment or attached drawing needed to be used in the description of the prior art be briefly described, it should be apparent that, it is described below
Attached drawing is some embodiments of the present invention, for those of ordinary skill in the art, before not making the creative labor
It puts, is also possible to obtain other drawings based on these drawings.
Fig. 1 is the flow chart of the algorithm Cascading Methods based on container in the embodiment of the present invention；
Fig. 2 is another flow chart of the algorithm Cascading Methods based on container in the embodiment of the present invention；
Fig. 3 is in the embodiment of the present invention according to preset data transformation rule and the data demand of currently performed algorithm container
Data Format Transform is carried out to the data of algorithm container output, generates the specific flow chart of intermediate conversion data；
Fig. 4 is that intermediate conversion data are converted to the data demand for meeting next algorithm container in the embodiment of the present invention
Input data specific flow chart；
Fig. 5 is the structural schematic diagram of the algorithm cascade system based on container in the embodiment of the present invention；
Fig. 6 is another structural schematic diagram of the algorithm cascade system based on container in the embodiment of the present invention；
Fig. 7 is the structural schematic diagram of electronic equipment in the embodiment of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those skilled in the art are not having
Every other embodiment obtained under the premise of creative work is made, shall fall within the protection scope of the present invention.
Embodiment 1
The algorithm Cascading Methods based on container that the embodiment of the invention provides a kind of, as shown in Figure 1, should the calculation based on container
Method Cascading Methods include:
Step S1: obtain user input algorithm cascade demand, and according to algorithm cascade demand obtain it is multiple be deployed with
The algorithm container of the algorithm cascade corresponding algorithm of demand.In practical applications, algorithm single in different business scenarios is simultaneously
It not can solve all problems, such as monitored for intelligent transportation bayonet, video is needed to take out frame algorithm, video decoding algorithm, rail
Mark tracing algorithm, face recognition algorithms, the collaborative work of vehicle identification algorithm scheduling algorithm are just able to satisfy business need, that is, needing will be upper
The algorithm stated is cascaded according to certain execution sequence, and it is user according to actual business scenario that the algorithm above, which cascades demand,
Selection needs information, each algorithms such as the execution of cascade algorithm and these algorithms sequence to be deployed in a corresponding container
In the middle, application program is bundled among each individual environment, encapsulation technology opens each process isolation, interrupted program it
Between dependence and connection relationship, it is this dismantling recombinant process, allow the coupling between each algorithm to be preferably minimized, to keep away
Exempt from interfering with each other between algorithm process, leads to CPU usage the problems such as some algorithm generates endless loop or deadlock
Height, service can not also be provided by avoiding result in other algorithms, or the problem of cause system integrally to be collapsed.
Step S2: sequence is executed according to what algorithm cascaded that demand determines each algorithm container.In practical applications, according to reality
It needs to execute according to the algorithm cascade demand sequence of user setting between the demand polyalgorithm of business scenario, passes through polyalgorithm
Joint realizes the business need of user.
Step S3: the data demand of each algorithm container is obtained according to execution sequence.In practical applications, the data demand packet
It includes: data output format information and data entry format requirement.After a certain algorithm is deployed in corresponding container, the algorithm container
Data input and data output format be fixed format, for the ease of the cascade between algorithms of different, so that between algorithms of different
Inputoutput data may be matched, and need to obtain the data demand of each algorithm container.
Step S4: according to the data demand of currently performed algorithm container, the number that currently performed algorithm container is exported
According to being converted to the input data for meeting the data demand of next pending algorithm container.In practical applications, according to algorithm container
Between execution sequence the data between algorithms of different container are formatted so that currently execute algorithm container output data
The input data that can be used as next pending algorithm container, to realize the cascade of algorithms of different.
S1 to step S4 through the above steps, the algorithm Cascading Methods provided in an embodiment of the present invention based on container are led to
It crosses and demand is cascaded according to the algorithm of user's input, obtain corresponding algorithm container and each algorithm container executes sequence, in turn
The data demand of each algorithm container is obtained according to execution sequence, and executes what algorithm container exported for current according to data demand
Data are converted to the input data for meeting the data demand of next pending algorithm container.To pass through holding according to algorithm container
Row sequence and the corresponding data demand of each algorithm container carry out data type conversion, conversion to the output data of algorithm container
To meet the input data that algorithm inputs demand, so that data can satisfy the format needs between algorithms of different, it is ensured that
Data are transmitted between algorithm, realize the cascade of algorithm.
Below in conjunction with specific application example, the algorithm Cascading Methods provided in an embodiment of the present invention based on container are carried out
Detailed introduction.
In an alternative embodiment, as shown in Fig. 2, above-mentioned step S4, according to the data of currently performed algorithm container
It is required that the data that currently performed algorithm container exports to be converted to the defeated of the data demand for meeting next pending algorithm container
Enter data, specifically include:
Step S41: according to the data demand of preset data transformation rule and currently performed algorithm container to algorithm container
The data of output carry out Data Format Transform, generate intermediate conversion data.In practical applications, it is disposed in single algorithm container
Algorithm output data may simultaneously be used as other polyalgorithms input.
Step S42: intermediate conversion data are converted to the input number for meeting the data demand of next pending algorithm container
According to.In practical applications, by the way that the current output data for executing algorithm is converted to common intermediate conversion data, and in container
The call method of corresponding intermediate conversion data is encapsulated in the system that cluster is constituted, and can be directly converted to intermediate conversion data full
The input data of the data demand of one pending algorithm container of foot, so as to enormously simplify the operation of algorithm producer.
Specifically, in an alternative embodiment, as shown in figure 3, above-mentioned step S41, according to preset data transformation rule
And the data demand of currently performed algorithm container carries out Data Format Transform to the data that algorithm container exports, and generates intermediate turn
Data are changed, are specifically included:
Step S411: the data output format information of currently performed algorithm container is obtained.Specifically, in practical application
In, the input/output format of each algorithm container is in Deployment Algorithm, it has been specified that the good algorithm fixed input and output
Format.
Step S412: according to preset data transformation rule and data output format information, determine that currently performed algorithm holds
The intermediate conversion data format of device output data.In practical applications, which can be according to actual needs
It is configured, such as: the output of the algorithm can be converted into intermediate conversion data, be inputted further according to required for other algorithms
The data type of data is directly converted by intermediate conversion data, can be that certain is several by the export-restriction of all algorithms specifically
Fixed intermediate data patterns, specified output is mysql, ES, file system, kafka, udp, s3 in embodiments of the present invention
These types encapsulates the usage mode (by API, environmental variance) of intermediate data patterns, to simplify algorithm producer's
Work.In the case where the input and output of upstream and downstream algorithm are different intermediate data patterns or format, in practical applications may be used
To use logstash to realize the conversion between intermediate data patterns, the filter side of customized logstash can also be passed through
Method, realizes the conversion of data format, to be conducive to the modularization of algorithm, pluggable, simplifies the mistake for being assemblied into bigger application
Journey.
Step S413: data format is carried out to currently performed algorithm container output data according to intermediate conversion data format
Conversion generates intermediate conversion data.In practical applications, it after the data format for determining above-mentioned intermediate change data, can incite somebody to action
Currently performed algorithm container output data is converted to specified intermediate conversion data, answers for other subsequent pending algorithm containers
Basis is provided with the data, to realize that algorithm level connection creates conditions.
In an alternative embodiment, as shown in figure 4, above-mentioned step S42: intermediate conversion data are converted to meet it is next
The input data of the data demand of pending algorithm container, specifically includes:
Step S421: the data entry format for obtaining next pending algorithm container of currently performed algorithm container is wanted
It asks.Body, in practical applications, the input/output format of each algorithm container is in Deployment Algorithm, it has been specified that the good algorithm
The format of fixed input and output.
Step S422: according to data entry requirement, intermediate conversion data is converted to and meet data entry format requirement
Input data.In practical applications, above-mentioned intermediate conversion data are common intermediate data translation type, can be used
Logstash tool realizes the data conversion of different type intermediate conversion data as data pipe, and then extends algorithm
Splicing possibility, for algorithm transaction provide most basic premise；It is solved between algorithm container using above-mentioned data pipe
Data format mismatch problem, facilitate the modularization, pluggable of algorithm, simplify the process for being assemblied into bigger application.
S1 to step S4 through the above steps, the algorithm Cascading Methods provided in an embodiment of the present invention based on container are led to
It crosses and demand is cascaded according to the algorithm of user's input, obtain corresponding algorithm container and each algorithm container executes sequence, in turn
The data demand of each algorithm container is obtained according to execution sequence, and executes what algorithm container exported for current according to data demand
Data are converted to the input data for meeting the data demand of next pending algorithm container.To pass through holding according to algorithm container
Row sequence and the corresponding data demand of each algorithm container carry out data type conversion, conversion to the output data of algorithm container
To meet the input data that algorithm inputs demand, so that data can satisfy the format needs between algorithms of different, it is ensured that
Data are transmitted between algorithm, realize the cascade of algorithm, by that can standardize each calculation using intermediate conversion data
The input and output of method container form unified standard for algorithm trade market, are the basic guarantees of formation algorithm transaction ecology；And
It realizes different input and output intermediate conversion data and format is converted mutually, difference ensure that the algorithms of different manufacturers can be with
Independent assortment promotes the production of algoritic module metaplasia, pluggable combination etc..
Embodiment 2
The algorithm cascade system based on container that the embodiment of the invention provides a kind of, as shown in figure 5, should the calculation based on container
Method cascade system includes:
Module 1 is obtained, the algorithm for obtaining user's input cascades demand, and cascades demand according to algorithm and obtain multiple portions
There is the algorithm container of algorithm corresponding with algorithm cascade demand in administration.Detailed content referring to 1 step S1 of embodiment associated description.
Execution sequence determining module 2 executes sequence for cascade that demand determines each algorithm container according to algorithm.In in detail
Hold the associated description referring to 1 step S2 of embodiment.
Data demand obtains module 3, for obtaining the data demand of each algorithm container according to execution sequence.Detailed content ginseng
See the associated description of 1 step S3 of embodiment.
Data conversion module 4 holds currently performed algorithm for the data demand according to currently performed algorithm container
The data of device output are converted to the input data for meeting the data demand of next pending algorithm container.Detailed content is referring to implementation
The associated description of 1 step S4 of example.
By the cooperative cooperating of above-mentioned each component part, the algorithm level connection provided in an embodiment of the present invention based on container
System cascades demand by the algorithm that inputs according to user, and obtain corresponding algorithm container and each algorithm container executes sequence,
And then the data demand of each algorithm container is obtained according to execution sequence, and it is defeated according to data demand will currently to execute algorithm container
Data out are converted to the input data for meeting the data demand of next pending algorithm container.To by according to algorithm container
Execution sequence and the corresponding data demand of each algorithm container, data type conversion is carried out to the output data of algorithm container,
The input data for meeting algorithm input demand is converted to, so that data can satisfy the format needs between algorithms of different,
Ensure that data are transmitted between algorithm, realizes the cascade of algorithm.
Below in conjunction with specific application example, the algorithm cascade system provided in an embodiment of the present invention based on container is carried out
Detailed introduction.
In an alternative embodiment, as shown in fig. 6, above-mentioned data conversion module 4 specifically includes:
First conversion module 41, for the data demand according to preset data transformation rule and currently performed algorithm container
Data Format Transform is carried out to the data of algorithm container output, generates intermediate conversion data.Detailed content is referring to 1 step of embodiment
The associated description of S41.
Second conversion module 42 meets the data of next pending algorithm container and wants for being converted to intermediate conversion data
The input data asked.Detailed content referring to 1 step S42 of embodiment associated description.
Specifically, in one embodiment, above-mentioned data demand includes: data output format information and data entry format
It is required that.
By the cooperative cooperating of above-mentioned each component part, the algorithm level connection provided in an embodiment of the present invention based on container
System cascades demand by the algorithm that inputs according to user, and obtain corresponding algorithm container and each algorithm container executes sequence,
And then the data demand of each algorithm container is obtained according to execution sequence, and it is defeated according to data demand will currently to execute algorithm container
Data out are converted to the input data for meeting the data demand of next pending algorithm container.To by according to algorithm container
Execution sequence and the corresponding data demand of each algorithm container, data type conversion is carried out to the output data of algorithm container,
The input data for meeting algorithm input demand is converted to, so that data can satisfy the format needs between algorithms of different,
Ensure that data are transmitted between algorithm, realize the cascade of algorithm, by that can be standardized respectively using intermediate conversion data
The input and output of a algorithm container form unified standard for algorithm trade market, are the basic guarantors of formation algorithm transaction ecology
Barrier；And realizing different input and output intermediate conversion data and format is converted mutually, difference ensure that the calculations of different manufacturers
Method can be freely combined, and promote the production of algoritic module metaplasia, pluggable combination etc..
Embodiment 3
The embodiment of the present invention provides a kind of non-transient computer storage medium, which is stored with computer
The algorithm cascade side based on container in above-mentioned any means embodiment can be performed in executable instruction, the computer executable instructions
Method, wherein above-mentioned storage medium can be magnetic disk, CD, read-only memory (Read-Only Memory, ROM), random
Storage memory (Random Access Memory, RAM), flash memory (Flash Memory), hard disk (Hard Disk
Drive, abbreviation: HDD) or solid state hard disk (Solid-State Drive, SSD) etc.；The storage medium can also include above-mentioned
The combination of the memory of type.
It is that can lead to it will be understood by those skilled in the art that realizing all or part of the process in above-described embodiment method
Computer program is crossed to instruct relevant hardware come what is completed, program can be stored in a computer-readable storage medium, should
Program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, storage medium can for magnetic disk, CD, only
Read storage memory (ROM) or random access memory (RAM) etc..
Embodiment 4
The embodiment of the present invention provides a kind of computer equipment, and structural schematic diagram is as shown in fig. 7, the computer equipment packet
It includes: one or more processors 410 and memory 420, in Fig. 7 by taking a processor 410 as an example.
Above-mentioned computer equipment can also include: input unit 430 and output device 440.
Processor 410, memory 420, input unit 430 and output device 440 can pass through bus or other modes
It connects, in Fig. 7 for being connected by bus.
Processor 410 can be central processing unit (Central Processing Unit, CPU).Processor 410 may be used also
Think other general processors, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit
(Application Specific Integrated Circuit, ASIC), field programmable gate array (Field-
Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic,
The combination of the chips such as discrete hardware components or above-mentioned all kinds of chips.General processor can be microprocessor or the processing
Device is also possible to any conventional processor etc..
Memory 420 is used as a kind of non-transient computer readable storage medium, can be used for storing non-transient software program, non-
Transient computer executable program and module, such as the corresponding journey of algorithm Cascading Methods based on container in the embodiment of the present application
Sequence instruction/module, non-transient software program, instruction and the module that processor 410 is stored in memory 420 by operation,
Thereby executing the various function application and data processing of server, that is, realize the algorithm based on container of above method embodiment
Cascading Methods.
Memory 420 may include storing program area and storage data area, wherein storing program area can store operation system
Application program required for system, at least one function；Storage data area can be stored according to the algorithm Cascading Methods based on container
Processing unit uses created data etc..It, can be in addition, memory 420 may include high-speed random access memory
Including non-transient memory, a for example, at least disk memory, flush memory device or other non-transient solid-state memories.
In some embodiments, it includes the memory remotely located relative to processor 410 that memory 420 is optional, these long-range storages
Device can pass through network connection to the algorithm cascade unit based on container.The example of above-mentioned network include but is not limited to internet,
Intranet, local area network, mobile radio communication and combinations thereof.
Input unit 430 can receive the number or character information of input, and generates to cascade with the algorithm based on container and grasp
The related user setting of the processing unit of work and the related key signals input of function control.Output device 440 may include display
The display equipment such as screen.
One or more module is stored in memory 420, when being executed by one or more processor 410, is held
Row method as Figure 1-Figure 4.
Method provided by the embodiment of the present invention can be performed in the said goods, has the corresponding functional module of execution method and has
Beneficial effect.The not technical detail of detailed description in embodiments of the present invention, for details, reference can be made to embodiments as Figure 1-Figure 4
In associated description.
Obviously, the above embodiments are merely examples for clarifying the description, and does not limit the embodiments.It is right
For those of ordinary skill in the art, can also make on the basis of the above description it is other it is various forms of variation or
It changes.There is no necessity and possibility to exhaust all the enbodiments.And it is extended from this it is obvious variation or
It changes still within the protection scope of the invention.
Claims (10)
1. a kind of algorithm Cascading Methods based on container characterized by comprising
The algorithm for obtaining user's input cascades demand, and cascades demand according to the algorithm and obtain multiple be deployed with and the algorithm
The algorithm container of the corresponding algorithm of cascade demand；
Sequence is executed according to what the algorithm cascaded that demand determines each algorithm container；
The data demand of each algorithm container is obtained according to the execution sequence；
According to the data demand of the currently performed algorithm container, the currently performed algorithm container is exported
Data be converted to the input data for meeting the data demand of next pending algorithm container.
2. the algorithm Cascading Methods according to claim 1 based on container, which is characterized in that described according to currently performed
The data demand of the algorithm container is converted to the data of the currently performed algorithm container output under satisfaction
The input data of the data demand of the one pending algorithm container, comprising:
According to the data demand of preset data transformation rule and the currently performed algorithm container to the algorithm container
The data of output carry out Data Format Transform, generate intermediate conversion data；
The intermediate conversion data are converted to the input number for meeting the data demand of next pending algorithm container
According to.
3. the algorithm Cascading Methods according to claim 2 based on container, which is characterized in that the data demand includes:
Data output format information and data entry format requirement.
4. the algorithm Cascading Methods according to claim 3 based on container, which is characterized in that described to be turned according to preset data
The data demand for changing rule and the currently performed algorithm container carries out data to the data that the algorithm container exports
Format conversion, generates intermediate conversion data, comprising:
Obtain the data output format information of the currently performed algorithm container；
According to the preset data transformation rule and the data output format information, the currently performed algorithm is determined
The intermediate conversion data format of container output data；
Data format is carried out to the currently performed algorithm container output data according to the intermediate conversion data format
Conversion, generates the intermediate conversion data.
5. the algorithm Cascading Methods according to claim 3 based on container, which is characterized in that described by the intermediate conversion
Data are converted to the input data for meeting the data demand of next algorithm container, comprising:
The data entry format for obtaining next pending algorithm container of the currently performed algorithm container is wanted
It asks；
According to the data entry requirement, the intermediate conversion data are converted to and meet the defeated of the data entry format requirement
Enter data.
6. a kind of algorithm cascade system based on container characterized by comprising
It obtains module (1), the algorithm for obtaining user's input cascades demand, and multiple according to algorithm cascade demand acquisition
It is deployed with the algorithm container of algorithm corresponding with algorithm cascade demand；
Execution sequence determining module (2) executes sequence for cascade that demand determines each algorithm container according to the algorithm；
Data demand obtains module (3), for obtaining the data demand of each algorithm container according to the execution sequence；
Data conversion module (4) is currently held for the data demand according to the currently performed algorithm container by described
The data of capable algorithm container output are converted to the defeated of the data demand for meeting next pending algorithm container
Enter data.
7. the algorithm cascade system according to claim 6 based on container, which is characterized in that the data conversion module
(4) include:
First conversion module (41), for the number according to preset data transformation rule and the currently performed algorithm container
According to the data progress Data Format Transform exported to the algorithm container is required, intermediate conversion data are generated；
Second conversion module (42) meets next pending algorithm container for being converted to the intermediate conversion data
The input data of the data demand.
8. the algorithm cascade system according to claim 7 based on container, which is characterized in that the data demand includes:
Data output format information and data entry format requirement.
9. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has computer to refer to
It enables, the computer instruction is for making the computer perform claim require the algorithm based on container described in 1-5 any one
Cascading Methods.
10. a kind of electronic equipment characterized by comprising
Memory and processor communicate with each other connection, are stored in the memory between the memory and the processor
Computer instruction, the processor is by executing the computer instruction, thereby executing described in claim 1-5 any one
The algorithm Cascading Methods based on container.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910247933.3A CN110008042A (en) | 2019-03-28 | 2019-03-28 | A kind of algorithm Cascading Methods and system based on container |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910247933.3A CN110008042A (en) | 2019-03-28 | 2019-03-28 | A kind of algorithm Cascading Methods and system based on container |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110008042A true CN110008042A (en) | 2019-07-12 |
Family
ID=67168833
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910247933.3A Pending CN110008042A (en) | 2019-03-28 | 2019-03-28 | A kind of algorithm Cascading Methods and system based on container |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110008042A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110928528A (en) * | 2019-10-23 | 2020-03-27 | 深圳市华讯方舟太赫兹科技有限公司 | Development method of algorithm model, terminal device and computer storage medium |
| CN115495225A (en) * | 2022-11-21 | 2022-12-20 | 福瑞泰克智能系统有限公司 | Data processing method and device, storage medium and electronic device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040249644A1 (en) * | 2003-06-06 | 2004-12-09 | International Business Machines Corporation | Method and structure for near real-time dynamic ETL (extraction, transformation, loading) processing |
| CN1890643A (en) * | 2003-12-02 | 2007-01-03 | 甲骨文国际公司 | Complex computation across heterogenous computer systems |
| CN202068449U (en) * | 2011-05-20 | 2011-12-07 | 广东商学院 | Data exchange platform used for multistage data exchange |
| CN106528224A (en) * | 2016-11-03 | 2017-03-22 | 腾讯科技（深圳）有限公司 | Content updating method and system for Docker container, and server |
| CN107784039A (en) * | 2016-08-31 | 2018-03-09 | 阿里巴巴集团控股有限公司 | A kind of data load method, apparatus and system |
| CN108446396A (en) * | 2018-03-26 | 2018-08-24 | 电子科技大学 | A kind of electric power data processing method based on modified CIM model |
| CN109359146A (en) * | 2018-09-16 | 2019-02-19 | 安徽三实软件科技有限公司 | A kind of automating ETL data processing tools and its application method |
-
2019
- 2019-03-28 CN CN201910247933.3A patent/CN110008042A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040249644A1 (en) * | 2003-06-06 | 2004-12-09 | International Business Machines Corporation | Method and structure for near real-time dynamic ETL (extraction, transformation, loading) processing |
| CN1890643A (en) * | 2003-12-02 | 2007-01-03 | 甲骨文国际公司 | Complex computation across heterogenous computer systems |
| CN202068449U (en) * | 2011-05-20 | 2011-12-07 | 广东商学院 | Data exchange platform used for multistage data exchange |
| CN107784039A (en) * | 2016-08-31 | 2018-03-09 | 阿里巴巴集团控股有限公司 | A kind of data load method, apparatus and system |
| CN106528224A (en) * | 2016-11-03 | 2017-03-22 | 腾讯科技（深圳）有限公司 | Content updating method and system for Docker container, and server |
| CN108446396A (en) * | 2018-03-26 | 2018-08-24 | 电子科技大学 | A kind of electric power data processing method based on modified CIM model |
| CN109359146A (en) * | 2018-09-16 | 2019-02-19 | 安徽三实软件科技有限公司 | A kind of automating ETL data processing tools and its application method |
Non-Patent Citations (2)
| Title |
|---|
| TONG WU: "ETL Function Realization of Data Warehouse System Based on SSIS Platform", 《2010 2ND INTERNATIONAL WORKSHOP ON DATABASE TECHNOLOGY AND APPLICATIONS》 * |
| 葛贤军等: "基于CEP引擎的配电网运行监控信号大数据ETL方法", 《电工电能新技术》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110928528A (en) * | 2019-10-23 | 2020-03-27 | 深圳市华讯方舟太赫兹科技有限公司 | Development method of algorithm model, terminal device and computer storage medium |
| CN115495225A (en) * | 2022-11-21 | 2022-12-20 | 福瑞泰克智能系统有限公司 | Data processing method and device, storage medium and electronic device |
| CN115495225B (en) * | 2022-11-21 | 2023-03-10 | 福瑞泰克智能系统有限公司 | Data processing method and device, storage medium and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109324791B (en) | Financial self-service terminal business process development method and device and terminal equipment | |
| CN109324787A (en) | A kind of business software development approach, device and terminal device | |
| US10355941B2 (en) | Sensor data handling for cloud-platform infrastructure layouts | |
| CN108108199A (en) | Multiple operating system starts method and device on a kind of multi-core CPU | |
| CN112738060B (en) | Method and device for processing micro-service data, micro-service processing platform and medium | |
| US20120150792A1 (en) | Data extraction framework | |
| CN110008042A (en) | A kind of algorithm Cascading Methods and system based on container | |
| CN109614147A (en) | A kind of PHY register reading/writing method and device | |
| CN112764736B (en) | Web end flow chart modeling method, device and system | |
| WO2023065847A1 (en) | Computational logic processing method, electronic device, and readable storage medium | |
| CN111831542B (en) | API application debugging method and device and storage medium | |
| CN103605527A (en) | System and method for realizing cloud computing application interface integration and unified style display | |
| CN110119282A (en) | A kind of internet-of-things terminal and system based on general-purpose built-in type computer | |
| CN115392501A (en) | Data acquisition method and device, electronic equipment and storage medium | |
| US9229980B2 (en) | Composition model for cloud-hosted serving applications | |
| CN106815128A (en) | Log-output method and device, electronic equipment | |
| CN110312990A (en) | Configuration method and system | |
| CN103809938A (en) | Python function operation information automatic recording method and system | |
| CN113407214B (en) | Reconfigurable multithreading parallel upper computer system based on can communication | |
| CN109241351A (en) | A kind of multi-source heterogeneous data preparation method of board production | |
| CN114116181B (en) | Distributed data analysis task scheduling system and method | |
| CN111061507A (en) | Operation method, operation device, computer equipment and storage medium | |
| Shinagawa et al. | An automated optical on-wafer probing system for ultra-high-speed ICs | |
| CN113703999B (en) | Interaction method and tool for Web terminal and iOS terminal | |
| CN114201253B (en) | Label page calling method, device, electronic equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190712 |