CN110502761A - A kind of transcription platform and its load regulation method - Google Patents
A kind of transcription platform and its load regulation method Download PDFInfo
- Publication number
- CN110502761A CN110502761A CN201910797805.6A CN201910797805A CN110502761A CN 110502761 A CN110502761 A CN 110502761A CN 201910797805 A CN201910797805 A CN 201910797805A CN 110502761 A CN110502761 A CN 110502761A
- Authority
- CN
- China
- Prior art keywords
- translation engine
- registration center
- service
- management backstage
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/505—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Machine Translation (AREA)
- Information Transfer Between Computers (AREA)
Abstract
It includes management backstage and registration center that the application, which provides a kind of transcription platform and its load regulation method, transcription platform,；It instructs the described method includes: the management backstage sends heartbeat inspection via the registration center to multiple services, to monitor the load of each service, wherein each at least one corresponding translation engine of the service；If the load of the service is less than first threshold, the management backstage generates the halt instruction of at least one translation engine and is sent to corresponding translation engine via the registration center；If the load of the service is more than or equal to second threshold, the management backstage generates the enabled instruction of at least one translation engine and is sent to corresponding translation engine via the registration center, to realize the dynamic increase and decrease of each service capacity, to realize the dynamic adjustment of service ability, the wasting of resources is reduced.
Description
Technical field
This application involves Internet technical field, in particular to a kind of transcription platform and its load regulation method, calculating are set
Standby and computer readable storage medium.
Background technique
By the function services of machine translation, become the service that can be called, being interpreted as can be by url (Uniform
Resource Locator, uniform resource locator) call by location translation service.
The current deployment way of translation engine: entire cluster has more machines, and a machine has multiple cards, and every card division administration is more
A engine；, by writing the relevant parameter script of frame model, external service would generally be carried out in automation publishing tool
Publication.
For different services, often difference is very big in different times for the concurrent quantity of highest/lowest service, and different
The case where using also avoiding the peak hour.In actual production environment, if all services are all drawn according to its maximum concurrent demand to determine
The quantity held up will cause a large amount of wasting of resources during idle time.
Summary of the invention
In view of this, the embodiment of the present application provides a kind of transcription platform and its load regulation method, calculates equipment and meter
Calculation machine readable storage medium storing program for executing, to solve technological deficiency existing in the prior art.
The embodiment of the present application provides a kind of load regulation method of transcription platform, and the transcription platform includes management backstage
And registration center；The described method includes:
The management backstage sends heartbeat inspection via the registration center and instructs to multiple services, each described to monitor
The load of service, wherein each at least one corresponding translation engine of the service；
If the load of the service is less than first threshold, the management backstage generates stopping at least one translation engine
It only instructs and is sent to corresponding translation engine via the registration center；
If the load of the service is more than or equal to second threshold, the management backstage generates at least one described translation engine
Enabled instruction and be sent to corresponding translation engine via the registration center.
Optionally, the transcription platform further includes Enabler Proxy；
The management backstage sends heartbeat inspection via the registration center and instructs to multiple services, each described to monitor
The load of service, comprising:
The management backstage sends heartbeat inspection via the registration center and instructs to the Enabler Proxy；
The Enabler Proxy sends the heartbeat inspection instruction to multiple services respectively, and the service received is returned
The load response information returned is back to the management backstage via the registration center.
Optionally, the management backstage generates the halt instruction of at least one translation engine and via in the registration
The heart is sent to corresponding translation engine, comprising:
The halt instruction of at least one translation engine of generation is sent to the registration center by the management backstage；
The halt instruction of at least one translation engine is sent to pair by the registration center via the Enabler Proxy
At least one translation engine answered.
Optionally, the management backstage generates the enabled instruction of at least one translation engine and via in the registration
The heart is sent to corresponding translation engine, comprising:
The enabled instruction of at least one translation engine of generation is sent to the registration center by the management backstage；
The enabled instruction of at least one translation engine is sent to pair by the registration center via the Enabler Proxy
At least one translation engine answered.
Optionally, the registration center is also stored with translation engine service list, wherein the translation engine service list
The translation engine being had been turned on including at least one；
The method also includes:
In the case of receiving the halt instruction of at least one translation engine, the registration center is by the stopping
At least one corresponding translation engine is instructed to delete in the translation engine service list；
In the case of receiving the enabled instruction of at least one translation engine, the registration center is by the starting
At least one corresponding translation engine is instructed to add in the translation engine service list.
Optionally, the load regulation method further include:
The management backstage inputs instruction based on the received and generates operational order, wherein the operational order includes translation
Instruction and modification instruction are deleted in the increase instruction of engine；
The registration center receives the operational order, and according to the operational order and updates the translation engine service
Translation engine state in list；
The operational order is sent to corresponding translation engine via the Enabler Proxy by the registration center, and by institute
The operating result for stating Enabler Proxy return is sent to the management backstage.
Optionally, described load includes:
At least one of complications and the frequency of failure statistics of the service interface；And
The processor utilization rate for servicing corresponding machine, video memory are calculated in power utilization rate and video memory utilization rate at least
It is a kind of.
The embodiment of the present application provides a kind of transcription platform, and transcription platform includes management backstage and registration center；
The management backstage sends heartbeat inspection via the registration center and instructs to multiple services, each described to monitor
The load of service, wherein each at least one corresponding translation engine of the service；
If the load of the service is less than threshold value, the stopping that the management backstage generates at least one translation engine refers to
It enables and is sent to corresponding translation engine via the registration center；
If the load of the service is more than or equal to threshold value, the management backstage generates opening at least one translation engine
It is dynamic to instruct and be sent to corresponding translation engine via the registration center.
Optionally, the transcription platform further includes Enabler Proxy；
The management backstage sends heartbeat inspection via the registration center and instructs to multiple services, each described to monitor
The load of service, comprising:
The management backstage sends heartbeat inspection via the registration center and instructs to the Enabler Proxy；
The Enabler Proxy sends the heartbeat inspection instruction to multiple services respectively, and the service received is returned
The load response information returned is back to the management backstage via the registration center.
The embodiment of the present application provides a kind of calculating equipment, including memory, processor and storage are on a memory and can
The computer instruction run on a processor, the processor realize load regulation method as described above when executing described instruction
The step of.
The embodiment of the present application provides a kind of computer readable storage medium, is stored with computer instruction, the instruction quilt
The step of processor realizes load regulation method as described above when executing.
The load regulation method of transcription platform provided by the present application sends heartbeat inspection via registration center by management backstage
Instruction is looked into multiple services, to monitor the load of each service, and in the case where the load of service is less than first threshold, management
The halt instruction of the translation engine of generation is sent to corresponding translation engine via registration center by backstage, to stop corresponding turning over
Translate engine；In the case where the load of service is more than or equal to second threshold, management backstage refers to the starting of the translation engine of generation
It enables and is sent to corresponding translation engine via registration center, to start corresponding translation engine, to realize each service capacity
Dynamic increase and decrease, thus realize service ability dynamic adjustment, reduce the wasting of resources.
In addition, in the process of running, the halt instruction of the translation engine of generation or enabled instruction are sent out by management backstage
It send to registration center, to stop or start corresponding translation engine, further realizes the dynamic increase and decrease of service capacity.
Detailed description of the invention
Fig. 1 is the configuration diagram of the transcription platform of one embodiment of the application；
Fig. 2 is the schematic diagram of the translation engine template of one embodiment of the application；
Fig. 3 is a kind of flow diagram of the load regulation method of transcription platform of one embodiment of the application；
Fig. 4 is a kind of flow diagram of the load regulation method of transcription platform of another embodiment of the application；
Fig. 5 is a kind of flow diagram of the load regulation method of transcription platform of another embodiment of the application；
Fig. 6 is the structural schematic diagram of the calculating equipment of another embodiment of the application.
Specific embodiment
Many details are explained in the following description in order to fully understand the application.But the application can be with
Much it is different from other way described herein to implement, those skilled in the art can be without prejudice to the application intension the case where
Under do similar popularization, therefore the application is not limited by following public specific implementation.
The term used in this specification one or more embodiment be only merely for for the purpose of describing particular embodiments,
It is not intended to be limiting this specification one or more embodiment.In this specification one or more embodiment and appended claims
The "an" of singular used in book, " described " and "the" are also intended to including most forms, unless context is clearly
Indicate other meanings.It is also understood that term "and/or" used in this specification one or more embodiment refers to and includes
One or more associated any or all of project listed may combine.
It will be appreciated that though may be retouched using term first, second etc. in this specification one or more embodiment
Various information are stated, but these information should not necessarily be limited by these terms.These terms are only used to for same type of information being distinguished from each other
It opens.For example, first can also be referred to as second, class in the case where not departing from this specification one or more scope of embodiments
As, second can also be referred to as first.Depending on context, word as used in this " if " can be construed to
" ... when " or " when ... " or " in response to determination ".
Firstly, the vocabulary of terms being related to one or more embodiments of the invention explains.
Machine translation: by inputting a source language sentence to machine, machine returns to the sentence of one or more object languages
Son, this process are just machine translation.
Translation engine: by the function services of machine translation, become the service that can be called.It is interpreted as that url can be passed through
(Uniform Resource Locator, uniform resource locator) call by location translation.
Transcription platform: translation engine and the management platform externally serviced.
Isomorphism engine: referring to using identical translation framework, but since model parameter is inconsistent, causes each engine real
Example requires to be run using different parameters.
Heterogeneous engine: referring to translation engine made of writing using different frames, for example, with tensorflow or
pytorch。
Docker engine: be one open source application container engine, allow developer can be packaged they application and according to
Rely packet into a transplantable container, is then published on the Linux machine of any prevalence, also may be implemented to virtualize.Hold
Device is not have any interface between each other using sandbox mechanism completely.
In this application, it provides a kind of load regulation method of transcription platform and device, calculates equipment and computer can
Storage medium is read, is described in detail one by one in the following embodiments.
Firstly, the transcription platform to the embodiment of the present application is introduced.Referring to Fig. 1, transcription platform includes:
Management backstage --- the management work of all translation engines, including translation engine newly-built, model parameter additions and deletions change,
The starting of translation engine stops and the user interface of the functions such as the publication of translation engine.By the interface for being presented in display equipment
And it operates.
Registration center --- execute actually patrolling for the translation engine administration order that the user that management backstage sends over issues
Collect layer.Realize increase, modification, the deletion of translation engine, the publication or cancellation publication of starting, stopping and the service of engine etc..
Enabler Proxy --- such as docker Enabler Proxy runs on machine, is responsible for receiving and be initiated by management backstage user,
The order of the practical operations MT engine such as starting, stopping of the engine that registration center forwards.
External interface --- available engine or service are obtained by registration center, then are called.
Translation engine --- it runs in the GPU of clustered machine, the sentence to be translated received is translated, obtain pair
The translation sentence answered.
Wherein, the management platform of the present embodiment generates translation engine mould by abstract engine translation flow and engine parameters
Plate solves isomorphism, heterogeneous engine compatibling problem, reaches the simplification of engine management, service management.
Engine translation flow integrally divides three parts: pretreatment, translation and post-processing；First initial data is located in advance
Reason is input to model after then segmenting and is translated, and is then post-processed according to the result that model exports, for example sub- word closes
And/process symbol etc. post-processes.This is also the principle of abstraction of engine translation flow.
Engine translation flow after abstract might not can cover whole models, but can be by way of extension
To support newly added model.
For pretreatment and post-processing, many pretreated modes, such as jieba points are had been realized in transcription platform
Word, pku participle, sentencepiece participle etc..Model newly added for one, if newly proposing new segmentation methods, that
As long as this new participle mode is added in platform, then it can be also loaded with by platform.
The schematic diagram of translation engine template is referring to fig. 2.One basic translation flow template is provided, is drawn with taking out translation
Hold up the basic procedure of work.It goes to realize when each different translation engine access platforms realized, be united so as to reach by platform
The requirement of one management.Wherein, referring to fig. 2, " pretreatment parameter " is used to for pretreated parameter being added in platform, such as segments
Mode.
" post-treatment parameters " are used to for the parameter of post-processing being added in platform, such as sub- word merges mode or process symbol
Mode.
" model command line parameter " is for the parameter of model itself to be added in platform.For this part, translation engine
Template does not need to parse, but leaves each model for and go self to parse when realizing translation engine template.
" docker destination path " refers to that catalogue is tied to host directory location in container；
" docker mirror image title " refers to the environment mirror that program relies on.
Docker mirror image is the environment of runtime engine, is the equal of inactive virtual machine, after actuation can be " docker
Destination path " is mounted to the corresponding host's source path of host --- exactly running the tangible machine of virtual machine ---, is used to altogether
Enjoy program or model data.
Specifically, the engine translation flow in the present embodiment includes:
1) sentence pre-processes: the pretreatment of the standards such as amendment of [universal method] such as some punctuates.
2) model correlation pre-processes: [model ad hoc approach] such as participle etc..
3) model translation: [model ad hoc approach] translates pretreated sentence.
4) model processing after correlation [model ad hoc approach].
5) sentence post-processes: the standards post-processings such as the amendment of [universal method] such as punctuate, space are deleted.
Wherein, universal method refers to the method that the general parameter of translation flow template is realized, model ad hoc approach refers to
It is the method that the parameter of each different translation engine itself is realized.
Therefore, a basic service moulding plate [pseudocode] can be defined:
String translate(org_sentence):
Prerocessed=pre_process (org_sentence) # universal preprocessing
The pretreatment of preprocessed=model_preprocess (preprocessed) # model correlation, such as participle
Translated=model_translation (preprocessed) # model translation
Postprocessed=model_postprocess (translated) # model processing after correlation
The general post-processing of final=post_process (postprocessed) #
Return final# returns to last translation
Wherein, universal preprocessing and general post-processing are realized via the base class of translation service engine.And model is specific
Pretreatment, translation, post-processing, then by realizing the translation engine concrete kind self-actualization of the template, thus realize translation draw
The standardization for the service held up and it is Templated simultaneously, also do the relevant specific implementation of particular model to each translation engine.
In this way, which be simply present in project one of different translation engines realizes the son of translation engine template
Class reaches unitem and supports all translation engines, is also achieved that the compatibility of heterogeneous engine.
Referring to fig. 2, for the general parameter of translation engine template, translation engine template will do it parsing；Translation is drawn
The different parameters of itself are held up, translation engine template will not parse the parameter of these models itself, but leave each model for
It goes self to parse these parameters when realizing translation engine template, so that the parameter for realizing isomorphism engine and heterogeneous engine is simultaneous
Hold.
By further be abstracted engine parameters, by the IP of service, port, operation GPU, engine framework used, model name,
The information such as language, pretreatment parameter, post-treatment parameters, frame model relevant parameter, engine status are defined as engine service parameter,
Realize that management backstage carries out the hair of increase, the deletion, modification, the starting of translation engine, stopping and service of translation engine with this
The operation such as cloth or cancellation publication, to simplify the management of translation engine and the management serviced.
The embodiment of the present application discloses a kind of load regulation method of transcription platform, referring to Fig. 3, comprising:
301, the management backstage sends heartbeat inspection via the registration center and instructs to multiple services, each to monitor
The load of the service, wherein each at least one corresponding translation engine of the service.
In the present embodiment, multiple translation engines are grouped, every group of correspondence one service.The principle of grouping can be root
It is grouped according to attributes such as engine industry/engine types.Each GPU for servicing corresponding translation engine and running on a machine
In.
Wherein, load may include a variety of:
At least one of complications and the frequency of failure statistics of the service interface；And
The processor utilization rate for servicing corresponding machine, video memory are calculated in power utilization rate and video memory utilization rate at least
It is a kind of.
Specifically, step 301 includes:
S3011, management backstage send heartbeat inspection via the registration center and instruct to the Enabler Proxy.
S3012, Enabler Proxy send the heartbeat inspection instruction, and the service that will be received to multiple services respectively
The load response information of return is back to the management backstage via the registration center.
If 302, the load of the service is less than first threshold, the management backstage generates at least one described translation engine
Halt instruction and be sent to corresponding translation engine via the registration center.
Wherein, first threshold can be arranged according to actual needs, such as be set as 30%.For such situation, the clothes
The load of business is lower/and amount of access is less, it should be stopped.
Specifically, registration center is also stored with translation engine service list, wherein the translation engine service list includes
At least one translation engine having been turned on；
In the case of receiving the halt instruction of at least one translation engine, the registration center is by the stopping
At least one corresponding translation engine is instructed to delete in the translation engine service list, external interface is again to registration center
The translation engine list that please be look for novelty, to provide the load of service again for external service.
Specifically, management backstage generates the halt instruction of at least one translation engine and sends out via the registration center
It send to corresponding translation engine, comprising:
The halt instruction of at least one translation engine of generation is sent in the registration by S3021, management backstage
The heart.
The halt instruction of at least one translation engine is sent to by S3022, registration center via the Enabler Proxy
At least one corresponding translation engine.
If 303, the load of the service is more than or equal to second threshold, the management backstage generates at least one described translation
The enabled instruction of engine is simultaneously sent to corresponding translation engine via the registration center.
Wherein, second threshold can be arranged according to actual needs, such as be set as 80%.For such situation, the clothes
The load of business is higher/and amount of access is larger, and it should be the service and increases translation engine newly.
Specifically, registration center is also stored with translation engine service list, wherein the translation engine service list includes
At least one translation engine having been turned on.
In the case of receiving the enabled instruction of at least one translation engine, the registration center is by the starting
At least one corresponding translation engine is instructed to add in the translation engine service list.
Specifically, step 303 includes:
The enabled instruction of at least one translation engine of generation is sent in the registration by S3031, management backstage
The heart.
The enabled instruction of at least one translation engine is sent to by S3032, registration center via the Enabler Proxy
At least one corresponding translation engine.
The load regulation method of transcription platform provided by the present application sends heartbeat inspection via registration center by management backstage
Instruction is looked into multiple services, to monitor the load of each service, and in the case where the load of service is less than first threshold, management
The halt instruction of the translation engine of generation is sent to corresponding translation engine via registration center by backstage, to stop corresponding turning over
Translate engine；In the case where the load of service is more than or equal to second threshold, management backstage refers to the starting of the translation engine of generation
It enables and is sent to corresponding translation engine via registration center, to start corresponding translation engine, to realize each service capacity
Dynamic increase and decrease, thus realize service ability dynamic adjustment, reduce the wasting of resources.
The embodiment of the present application also discloses a kind of load regulation method of transcription platform, referring to fig. 4, the method includes under
State step 401~406:
401, management backstage sends heartbeat inspection via the registration center and instructs to multiple services, each described to monitor
The load of service, wherein each at least one corresponding translation engine of the service.
If 402, the load of the service is less than first threshold, the management backstage generates at least one described translation engine
Halt instruction and be sent to corresponding translation engine via the registration center.
If 403, the load of the service is more than or equal to second threshold, the management backstage generates at least one described translation
The enabled instruction of engine is simultaneously sent to corresponding translation engine via the registration center.
Identical as the step 301 of previous embodiment~303 for step 401~403, the method for the present embodiment is just no longer
It repeats.
404, management backstage inputs instruction based on the received and generates operational order, wherein the operational order includes translation
Instruction and modification instruction are deleted in the increase instruction of engine.
Wherein, operational order can click generation in the interface of display equipment according to user.
Specifically, in the interface of management backstage, translation engine and corresponding operation button are shown.
Following table 1 shows the list items at the interface of a management backstage.
Table 1
Wherein, " editor ", " deletion ", " newly-increased ", " starting/stopping ", " test ", " publication/cancellation publication " etc. are with behaviour
It is presented in interface as button, so that user clicks.
405, registration center receives the operational order, and according to the operational order and updates the translation engine service
Translation engine state in list.
406, the operational order is sent to corresponding translation engine via the Enabler Proxy by registration center, and by institute
The operating result for stating Enabler Proxy return is sent to the management backstage.
Increase, deletion and modification for translation engine, its essence is modification data base entries, are not related to Enabler Proxy.
It should be noted that different from starting/stopping, increase, deletion and modification for translation engine need to stop in the translation engine
It just may be implemented in the case where only running.When the translation engine is not out of service, cannot operate on it.
The load regulation method of transcription platform provided by the present application removes logical via the registration center by management backstage
Cross the Enabler Proxy send heartbeat inspection instruct to the machine for running multiple translation engines with monitor each service load it
Outside, increase instruction, the deletion that translation engine can also be generated by management backstage instruct and modification instructs, and actively realization is to translation
The adjustment of engine, further realizes the increase and decrease of each service capacity, to realize the dynamic adjustment of service ability, reduces resource wave
Take.
In addition, in the process of running, the halt instruction of the translation engine of generation or enabled instruction are sent out by management backstage
It send to registration center, to stop or start corresponding translation engine, further realizes the dynamic increase and decrease of service capacity.
Referring to Fig. 5, another embodiment of the application discloses a kind of load regulation method of transcription platform, in translation engine
Adjustment in the case where generation halt instruction or enabled instruction to translation engine, comprising:
501, the first input instructs the halt instruction or enabled instruction for generating translation engine to management backstage based on the received, so
Step 506 is executed afterwards.
502, multiple translation engines are grouped, every group of correspondence one service.
503, management backstage is instructed via the registration center by Enabler Proxy transmission heartbeat inspection more to running
The machine of a translation engine, to monitor the load of each service.
If 504, the load of the service is less than first threshold, the management backstage generates at least one described translation engine
Halt instruction and be sent to corresponding translation engine via the registration center, execute step 506.
If 505, the load of the service is more than or equal to second threshold, management backstage generates at least one described translation engine
Enabled instruction and be sent to corresponding translation engine via the registration center, execute step 506.
Wherein, load includes:
At least one of complications and the frequency of failure statistics of the service interface；And
The processor utilization rate for servicing corresponding machine, video memory are calculated in power utilization rate and video memory utilization rate at least
It is a kind of.
Specifically, for loading the less service of lower/amount of access, translation engine list of the management backstage from registration center
It is middle to delete corresponding data, the translation engine list that external interface look for novelty to registration center again.
For loading the more service of higher/amount of access, management backstage starts new translation engine, updates registration center,
The translation engine list that external interface please look for novelty to registration center again.
506, registration center searches the translation engine of load according to the halt instruction or enabled instruction of translation engine, and to institute
It states translation engine to be operated, and the operating result that will acquire is sent to management backstage.
507, management backstage reacquires the data of translation engine, more new user interface according to the operating result.
The load regulation method of transcription platform provided by the present application sends heartbeat inspection via registration center by management backstage
Instruction is looked into multiple services, to monitor the load of each service, and in the case where the load of service is less than first threshold, management
The halt instruction of the translation engine of generation is sent to corresponding translation engine via registration center by backstage, to stop corresponding turning over
Translate engine；In the case where the load of service is more than or equal to second threshold, management backstage refers to the starting of the translation engine of generation
It enables and is sent to corresponding translation engine via registration center, to start corresponding translation engine, to realize each service capacity
Dynamic increase and decrease, thus realize service ability dynamic adjustment, reduce the wasting of resources.
In addition, in the process of running, the halt instruction of the translation engine of generation or enabled instruction are sent out by management backstage
It send to registration center, to stop or start corresponding translation engine, further realizes the dynamic increase and decrease of service capacity.
One embodiment of the application also provides a kind of calculating equipment, is stored with computer instruction, which is held by processor
The step of load regulation method of transcription platform as previously described is realized when row.
Fig. 6 is to show the structural block diagram of the calculating equipment 600 according to one embodiment of this specification.The calculating equipment 600
Component include but is not limited to memory 610 and processor 620.Processor 620 is connected with memory 610 by bus 630,
Database 650 is for saving data.
Calculating equipment 600 further includes access device 640, access device 640 enable calculate equipment 600 via one or
Multiple networks 660 communicate.The example of these networks includes public switched telephone network (PSTN), local area network (LAN), wide area network
(WAN), the combination of the communication network of personal area network (PAN) or such as internet.Access device 640 may include wired or wireless
One or more of any kind of network interface (for example, network interface card (NIC)), such as IEEE802.11 wireless local area
Net (WLAN) wireless interface, worldwide interoperability for microwave accesses (Wi-MAX) interface, Ethernet interface, universal serial bus (USB) connect
Mouth, cellular network interface, blue tooth interface, near-field communication (NFC) interface, etc..
In one embodiment of this specification, other unshowned portions in the above-mentioned component and Fig. 6 of equipment 600 are calculated
Part can also be connected to each other, such as pass through bus.It should be appreciated that calculating device structure block diagram shown in fig. 6 merely for the sake of
Exemplary purpose, rather than the limitation to this specification range.Those skilled in the art can according to need, and increases or replaces it
His component.
Calculating equipment 600 can be any kind of static or mobile computing device, including mobile computer or mobile meter
Calculate equipment (for example, tablet computer, personal digital assistant, laptop computer, notebook computer, net book etc.), movement
Phone (for example, smart phone), wearable calculating equipment (for example, smartwatch, intelligent glasses etc.) or other kinds of shifting
Dynamic equipment, or the static calculating equipment of such as desktop computer or PC.Calculating equipment 600 can also be mobile or state type
Server.
A kind of exemplary scheme of above-mentioned calculating equipment for the present embodiment.It should be noted that the skill of the calculating equipment
The technical solution of art scheme and the load regulation method of above-mentioned transcription platform belongs to same design, calculates the technical solution of equipment
The detail content being not described in detail may refer to the description of the technical solution of the load regulation method of above-mentioned transcription platform.
One embodiment of the application also provides a kind of computer readable storage medium, is stored with computer instruction, the instruction
The step of load regulation method of transcription platform as previously described is realized when being executed by processor.
A kind of exemplary scheme of above-mentioned computer readable storage medium for the present embodiment.It should be noted that this is deposited
The technical solution of the technical solution of storage media and the load regulation method of above-mentioned transcription platform belongs to same design, storage medium
The detail content that is not described in detail of technical solution, may refer to the technical solution of the load regulation method of above-mentioned transcription platform
Description.
The computer instruction includes computer program code, the computer program code can for source code form,
Object identification code form, executable file or certain intermediate forms etc..The computer-readable medium may include: that can carry institute
State any entity or device, recording medium, USB flash disk, mobile hard disk, magnetic disk, CD, the computer storage of computer program code
Device, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory),
Electric carrier signal, telecommunication signal and software distribution medium etc..It should be noted that the computer-readable medium include it is interior
Increase and decrease appropriate can be carried out according to the requirement made laws in jurisdiction with patent practice by holding, such as in certain jurisdictions of courts
Area does not include electric carrier signal and telecommunication signal according to legislation and patent practice, computer-readable medium.
It should be noted that for the various method embodiments described above, describing for simplicity, therefore, it is stated as a series of
Combination of actions, but those skilled in the art should understand that, the application is not limited by the described action sequence because
According to the application, certain steps can use other sequences or carry out simultaneously.Secondly, those skilled in the art should also know
It knows, the embodiments described in the specification are all preferred embodiments, and related actions and modules might not all be this Shen
It please be necessary.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment
Point, it may refer to the associated description of other embodiments.
The application preferred embodiment disclosed above is only intended to help to illustrate the application.There is no detailed for alternative embodiment
All details are described, are not limited the invention to the specific embodiments described.Obviously, according to the content of this specification,
It can make many modifications and variations.These embodiments are chosen and specifically described to this specification, is in order to preferably explain the application
Principle and practical application, so that skilled artisan be enable to better understand and utilize the application.The application is only
It is limited by claims and its full scope and equivalent.
Claims (11)
1. a kind of load regulation method of transcription platform, which is characterized in that the transcription platform includes in management backstage and registration
The heart；
The described method includes:
The management backstage sends heartbeat inspection via the registration center and instructs to multiple services, to monitor each service
Load, wherein at least one corresponding translation engine of each service；
If the load of the service is less than first threshold, the stopping that the management backstage generates at least one translation engine refers to
It enables and is sent to corresponding translation engine via the registration center；
If the load of the service is more than or equal to second threshold, the management backstage generates opening at least one translation engine
It is dynamic to instruct and be sent to corresponding translation engine via the registration center.
2. the load regulation method of transcription platform as described in claim 1, which is characterized in that the transcription platform further includes drawing
Hold up agency；
The management backstage sends heartbeat inspection via the registration center and instructs to multiple services, to monitor each service
Load, comprising:
The management backstage sends heartbeat inspection via the registration center and instructs to the Enabler Proxy；
The Enabler Proxy sends the heartbeat inspection instruction to multiple services respectively, and the service received is returned
Load response information is back to the management backstage via the registration center.
3. the load regulation method of transcription platform as claimed in claim 2, which is characterized in that the management backstage generates at least
The halt instruction of one translation engine is simultaneously sent to corresponding translation engine via the registration center, comprising:
The halt instruction of at least one translation engine of generation is sent to the registration center by the management backstage；
The halt instruction of at least one translation engine is sent to corresponding by the registration center via the Enabler Proxy
At least one translation engine.
4. the load regulation method of transcription platform as claimed in claim 2, which is characterized in that the management backstage generates at least
The enabled instruction of one translation engine is simultaneously sent to corresponding translation engine via the registration center, comprising:
The enabled instruction of at least one translation engine of generation is sent to the registration center by the management backstage；
The enabled instruction of at least one translation engine is sent to corresponding by the registration center via the Enabler Proxy
At least one translation engine.
5. the load regulation method of transcription platform as claimed in claim 2, which is characterized in that the registration center is also stored with
Translation engine service list, wherein the translation engine service list includes the translation engine that at least one has been turned on；
The method also includes:
In the case of receiving the halt instruction of at least one translation engine, the registration center is by the halt instruction
At least one corresponding translation engine is deleted in the translation engine service list；
In the case of receiving the enabled instruction of at least one translation engine, the registration center is by the enabled instruction
At least one corresponding translation engine is added in the translation engine service list.
6. the load regulation method of transcription platform as claimed in claim 2, which is characterized in that the method also includes:
The management backstage inputs instruction based on the received and generates operational order, wherein the operational order includes translation engine
Increase instruction, delete instruction and modification instruction；
The registration center receives the operational order, and according to the operational order and updates the translation engine service list
In translation engine state；
The operational order is sent to corresponding translation engine via the Enabler Proxy by the registration center, and is drawn described
It holds up the operating result that agency returns and is sent to the management backstage.
7. the load regulation method of transcription platform as described in claim 1, which is characterized in that the load includes:
At least one of complications and the frequency of failure statistics of the service interface；And
At least one in the processor utilization rate for servicing corresponding machine, video memory calculation power utilization rate and video memory utilization rate
Kind.
8. a kind of transcription platform, which is characterized in that the transcription platform includes management backstage and registration center；
The management backstage sends heartbeat inspection via the registration center and instructs to multiple services, to monitor each service
Load, wherein at least one corresponding translation engine of each service；
If the load of the service is less than threshold value, the management backstage generates the halt instruction of at least one translation engine simultaneously
Corresponding translation engine is sent to via the registration center；
If the load of the service is more than or equal to threshold value, the starting that the management backstage generates at least one translation engine refers to
It enables and is sent to corresponding translation engine via the registration center.
9. transcription platform as claimed in claim 8, which is characterized in that the transcription platform further includes Enabler Proxy；
The management backstage sends heartbeat inspection via the registration center and instructs to multiple services, to monitor each service
Load, comprising:
The management backstage sends heartbeat inspection via the registration center and instructs to the Enabler Proxy；
The Enabler Proxy sends the heartbeat inspection instruction to multiple services respectively, and the service received is returned
Load response information is back to the management backstage via the registration center.
10. a kind of calculating equipment including memory, processor and stores the calculating that can be run on a memory and on a processor
Machine instruction, which is characterized in that the processor realizes the step of claim 1-7 any one the method when executing described instruction
Suddenly.
11. a kind of computer readable storage medium, is stored with computer instruction, which is characterized in that the instruction is held by processor
The step of claim 1-7 any one the method is realized when row.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910797805.6A CN110502761B (en) | 2019-08-27 | 2019-08-27 | Translation platform and load adjustment method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910797805.6A CN110502761B (en) | 2019-08-27 | 2019-08-27 | Translation platform and load adjustment method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110502761A true CN110502761A (en) | 2019-11-26 |
| CN110502761B CN110502761B (en) | 2023-09-19 |
Family
ID=68590028
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910797805.6A Active CN110502761B (en) | 2019-08-27 | 2019-08-27 | Translation platform and load adjustment method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110502761B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112818710A (en) * | 2021-02-05 | 2021-05-18 | 中译语通科技股份有限公司 | Method and device for processing asynchronous network machine translation request |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102394807A (en) * | 2011-08-23 | 2012-03-28 | 北京京北方信息技术有限公司 | System and method for decentralized scheduling of autonomous flow engine load balancing clusters |
| CN102722795A (en) * | 2012-06-06 | 2012-10-10 | 复旦大学 | Service management method of business operation support system based on service-oriented architecture (SOA) |
| CN103051564A (en) * | 2013-01-07 | 2013-04-17 | 杭州华三通信技术有限公司 | Dynamic resource allocation method and device |
| CN103559093A (en) * | 2013-11-15 | 2014-02-05 | 北京中指实证数据信息技术有限公司 | Resource allocation method and device for servers |
| CN103944940A (en) * | 2013-01-21 | 2014-07-23 | 华耀(中国)科技有限公司 | Equipment and method for dynamically configuring proxy server |
| CN106331065A (en) * | 2016-08-15 | 2017-01-11 | 众安在线财产保险股份有限公司 | Proxy application for host system with service container and system |
| CN106408272A (en) * | 2016-10-26 | 2017-02-15 | 金航数码科技有限责任公司 | Distributed deployment based cross-system process engine collaboration system and method |
| CN106453125A (en) * | 2016-11-04 | 2017-02-22 | 中国电子科技集团公司第二十八研究所 | Load balancing system for remote service calling based on real-time load rate |
| CN106603594A (en) * | 2015-10-15 | 2017-04-26 | 中国电信股份有限公司 | Distributed service management method and system |
| WO2018095138A1 (en) * | 2016-11-25 | 2018-05-31 | 华为技术有限公司 | Container deployment method, communication method between services and related devices |
| CN108712464A (en) * | 2018-04-13 | 2018-10-26 | 中国科学院信息工程研究所 | A kind of implementation method towards cluster micro services High Availabitity |
| CN109246246A (en) * | 2018-10-31 | 2019-01-18 | 成都知道创宇信息技术有限公司 | A kind of full-automatic service discovery SiteServer LBS of centralization |
-
2019
- 2019-08-27 CN CN201910797805.6A patent/CN110502761B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102394807A (en) * | 2011-08-23 | 2012-03-28 | 北京京北方信息技术有限公司 | System and method for decentralized scheduling of autonomous flow engine load balancing clusters |
| CN102722795A (en) * | 2012-06-06 | 2012-10-10 | 复旦大学 | Service management method of business operation support system based on service-oriented architecture (SOA) |
| CN103051564A (en) * | 2013-01-07 | 2013-04-17 | 杭州华三通信技术有限公司 | Dynamic resource allocation method and device |
| CN103944940A (en) * | 2013-01-21 | 2014-07-23 | 华耀(中国)科技有限公司 | Equipment and method for dynamically configuring proxy server |
| CN103559093A (en) * | 2013-11-15 | 2014-02-05 | 北京中指实证数据信息技术有限公司 | Resource allocation method and device for servers |
| CN106603594A (en) * | 2015-10-15 | 2017-04-26 | 中国电信股份有限公司 | Distributed service management method and system |
| CN106331065A (en) * | 2016-08-15 | 2017-01-11 | 众安在线财产保险股份有限公司 | Proxy application for host system with service container and system |
| CN106408272A (en) * | 2016-10-26 | 2017-02-15 | 金航数码科技有限责任公司 | Distributed deployment based cross-system process engine collaboration system and method |
| CN106453125A (en) * | 2016-11-04 | 2017-02-22 | 中国电子科技集团公司第二十八研究所 | Load balancing system for remote service calling based on real-time load rate |
| WO2018095138A1 (en) * | 2016-11-25 | 2018-05-31 | 华为技术有限公司 | Container deployment method, communication method between services and related devices |
| CN108712464A (en) * | 2018-04-13 | 2018-10-26 | 中国科学院信息工程研究所 | A kind of implementation method towards cluster micro services High Availabitity |
| CN109246246A (en) * | 2018-10-31 | 2019-01-18 | 成都知道创宇信息技术有限公司 | A kind of full-automatic service discovery SiteServer LBS of centralization |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112818710A (en) * | 2021-02-05 | 2021-05-18 | 中译语通科技股份有限公司 | Method and device for processing asynchronous network machine translation request |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110502761B (en) | 2023-09-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110365751B (en) | Service processing method, device and equipment of gateway system | |
| CN103297381B (en) | Service access method based on plugin and system thereof | |
| JP5046161B2 (en) | Application partitioning for network edge computing | |
| CN106874259B (en) | A kind of semantic analysis method and device, equipment based on state machine | |
| US20070197260A1 (en) | Interface for mobile devices and methods | |
| CN109445784A (en) | Processing method, device, storage medium and the electronic equipment of structured data | |
| US11334332B2 (en) | Facilitating cloud native edge computing via behavioral intelligence | |
| CN107766431B (en) | Parameterization removing function method and system based on grammar parsing | |
| CN109740765A (en) | A kind of machine learning system building method based on Amazon server | |
| CN111324343A (en) | Code generation method and device | |
| CN102193806B (en) | Upgrade the method and apparatus of animation | |
| CN102841782B (en) | global variable management method and device | |
| CN112243016B (en) | Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method | |
| CN110502761A (en) | A kind of transcription platform and its load regulation method | |
| CN107807831A (en) | Business in application program performs method, apparatus, terminal and storage medium | |
| CN109597825A (en) | Regulation engine call method, device, equipment and computer readable storage medium | |
| CN114489614A (en) | Customized UI solution method for SAAS platform | |
| CN106371931A (en) | Web framework-based high-performance geocomputation service system | |
| Pan et al. | Component-based mobile web application of cross-platform | |
| CN105677418B (en) | The method and system of multiple and different voice protocols are realized in access device | |
| CN110502762A (en) | A kind of transcription platform and its management method | |
| CN114153547B (en) | Management page display method and device | |
| CN108769249A (en) | The high extended network framework and implementation method of iOS high-performance, server and medium | |
| WO2012058871A1 (en) | Method and system for customer service automation | |
| CN110971665A (en) | Management method, system, equipment and storage medium for interfacing multi-type storage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |