CN115269564B - Centralized creative migration method for large-scale system - Google Patents
Centralized creative migration method for large-scale system Download PDFInfo
- Publication number
- CN115269564B CN115269564B CN202211186943.9A CN202211186943A CN115269564B CN 115269564 B CN115269564 B CN 115269564B CN 202211186943 A CN202211186943 A CN 202211186943A CN 115269564 B CN115269564 B CN 115269564B
- Authority
- CN
- China
- Prior art keywords
- softno
- sysno
- resource
- migration
- resources
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5083—Techniques for rebalancing the load in a distributed system
- G06F9/5088—Techniques for rebalancing the load in a distributed system involving task migration
Abstract
The invention relates to a centralized and creative migration method for a large-scale system, which comprises the following steps: acquiring related parameters of a non-trusted environment; counting the information and creation resource condition; determining a resource conversion coefficient based on the prior knowledge and a benchmark test; calculating required resources according to the relevant parameters of the non-trusted environment and the resource conversion coefficient; distributing operation resources according to the required resources and the information-created resources; migrating based on the operating resources; the method also includes adjusting the conversion factor based on the test and operating conditions. The invention can realize the effective utilization of resources while orderly transferring the production system.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a centralized creative migration method for a large-scale system.
Background
With the great development of enterprises, when the existing database cannot meet the requirements of business development, the requirement of database migration exists, namely, data is transferred from the original database to a new database. Because the original database and the new database have different resources, the resources of the target database need to be dynamically evaluated to realize the orderly and efficient migration.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a centralized and creative migration method for a large-scale system, which can realize the effective utilization of resources while orderly migrating a production system.
The technical scheme adopted by the invention for solving the technical problems is as follows: a centralized and creative migration method for a large-scale system is provided, which comprises the following steps:
(1) Acquiring relevant parameters of a non-trusted environment;
(2) Counting the information and creation resource condition;
(3) Determining a resource conversion coefficient based on the prior knowledge and a benchmark test;
(4) Calculating required resources according to the relevant parameters of the non-trusted environment and the resource conversion coefficient;
(5) Distributing operation resources according to the required resources and the information-created resources;
(6) And migrating based on the running resources.
In the step (3), when the migration in a certain migration direction is started, PCPUDefault is adopted [softno] = max (a priori knowledge, benchmark value) determines the resource conversion factor for the migration direction; when single system migration in a certain migration direction is started, PCPU is adopted [softno,sysno] ＝PCPUDefault [softno] And as a conversion coefficient of the single system migration direction, wherein sysno represents a production system, and softno represents the migration direction of the base software in the non-trusted environment to the base software in the trusted environment.
In evaluating the development resources, the step (4) adopts TotalDevCpuCore [softno,sysno] ＝PCPU [softno,sysno] ·CPUCORE [softno,sysno] The resource required by/4 calculation, wherein, totalDevcCpuCore [softno,sysno] Indicating required development resources, CPUCORE [softno,sysno] Representing the number of CPU cores of the non-trusted environment.
In evaluating the performance test resources, the step (4) adopts TotalTestCpuCore [softno,sysno] ＝PCPU [softno,sysno] ·CPUCORE [softno,sysno] 2 resources required for the computation, wherein TotalTestCpuCore [softno,sysno] Indicating the required performance test resource, CPUCORE [softno,sysno] Representing the number of CPU cores of the non-trusted environment.
In evaluating the production resources, the step (4) adopts TotalProdCpuCore [softno,sysno] ＝PCPU [softno,sysno] ·CPUCORE [softno,sysno] Computing the required resource, wherein TotalProdCpuCore [softno,sysno] Indicating the required production resource, CPUCORE [softno,sysno] Representing the number of CPU cores of the non-trusted environment.
The step (5) is specifically as follows: judging whether the information creating resource condition meets the required resource, if so, directly distributing the operating resource, and if not, adopting
Calculating a rank value, wherein SourceRank [softno,sysno] Indicating a rank value, the smaller the value, the earlier the resource is allocated, k is 0 or 1, k =0 indicating that no blocking problem exists, k =1 indicating that a blocking problem exists, and the expected year of production is encoded in a 6-bit digital format of yyymm.
The step (6) further includes adjusting the resource conversion coefficient according to the migration condition, specifically: judging whether the single migration direction of the single system completes the migration or not, if so, adopting PCPU [softno,sysno] = production of CPU core number of trusted environment/CPU core number of untrusted environment after expansion/contraction, recalculation of the conversion factor of single system in single migration direction, using
Adjusting resource conversion coefficient, wherein PCPUDefault' [softno] Represents the adjusted resource reduction factor, PMigrate [softno,sysno] Indicating that the migration is complete, the completion is 1, the completion is not 0, and n indicates the number of production systems.
The centralized creative migration method for the large-scale system further comprises the steps of judging required resources according to the pressure measurement condition and adopting PCPU (physical control Unit) [softno,sysno] = number of CPU cores required for pressure measurement of trusted environment/number of CPU cores in non-trusted environment, recalculating the conversion factor for single system in single migration direction; the method also comprises a step of judging whether the capacity needs to be expanded or reduced according to the running condition, and PCPU is adopted after the capacity is expanded or reduced [softno,sysno] And = (= the number of CPU cores in the trusted environment/the number of CPU cores in the non-trusted environment after production and capacity expansion, recalculating the conversion coefficient of the single system in the single migration direction.
Advantageous effects
Due to the adoption of the technical scheme, compared with the prior art, the invention has the following advantages and positive effects: the invention can be used for promoting the migration implementation based on the resource availability, ensures that each system can be rapidly migrated and on-line, continuously optimizes the resource conversion coefficient along with the continuous migration of the system, ensures that the resource evaluation is more accurate, and can be used for preparing related resources in advance along with the continuous adjustment of the conversion coefficient and the measurement and calculation of the resource master disk are more accurate.
Drawings
FIG. 1 is a general flow diagram of migration in accordance with an embodiment of the present invention;
FIG. 2 is a flowchart of development resource evaluation and application in an embodiment of the present invention;
FIG. 3 is a flowchart of performance test resource evaluation and application in an embodiment of the present invention;
FIG. 4 is a flow chart of a process for evaluating and applying for production resources according to an embodiment of the present invention;
FIG. 5 is a flow chart of capacity expansion/reduction according to an embodiment of the present invention;
FIG. 6 is a flow chart of adjusting resource reduction factors in an embodiment of the present invention.
Detailed Description
The invention will be further illustrated with reference to the following specific examples. It should be understood that these examples are for illustrative purposes only and are not intended to limit the scope of the present invention. Further, it should be understood that various changes or modifications of the present invention may be made by those skilled in the art after reading the teaching of the present invention, and such equivalents may fall within the scope of the present invention as defined in the appended claims.
The embodiment of the invention relates to a centralized and creative migration method for a large-scale system, which comprises the following steps as shown in figure 1: acquiring relevant parameters of a non-trusted environment; counting the information and creation resource condition; determining a resource conversion coefficient based on the prior knowledge and a benchmark test; calculating required resources according to the relevant parameters of the non-trusted environment and the resource conversion coefficient; allocating operating resources according to the required resources and the information-created resources; and migrating based on the running resources. When obtaining the relevant parameters of the non-trusted environment, it is necessary to obtain the production resources and the use conditions of various to-be-migrated production systems, including the key indexes (including numerical values, average usage rates, and maximum usage rates) of the CPU core number, the memory capacity, and the data capacity. When the condition of creating resources by credit is counted, the key indexes of the CPU core number, the memory capacity and the data capacity need to be counted.
In the embodiment, the production credit and creation resource pool and the pressure measurement credit and creation resource pool are planned according to the grade and the category of the production system and the machine room to which the production system belongs.
As shown in fig. 2, when evaluating development resources, equation 1 is used: totaldevcpucre [softno,sysno] ＝PCPU [softno,sysno] ·CPUCORE [softno,sysno] The resource required by/4 calculation, wherein, totalDevcCpuCore [softno,sysno] Representing required development resources, PCPU [softno,sysno] ＝PCPUDefault [softno] Reduced coefficient, PCPUDefault, representing a single migration direction of a single system [softno] = max (a priori knowledge, benchmark value) represents a resource conversion factor for a single migration direction. CPUCORE [softno,sysno] The CPU core number of the non-trusted environment is represented, sysno represents a production system, each production system can be numbered from 1 to n, for example, a core business system is set to be 1, a customer management system is set to be 2, and a training management system is set to be 3, softno represents the migration direction of basic software in the non-trusted environment to new basic software of the trusted environment, each migration direction of original basic software and trusted basic software is numbered from 1 to m, for example, an original database A is migrated to a trusted database B, the number is 1, and an original database C is migrated to a trusted database B, the number is 2. All production systems are numbered 1 to n. And if the requirements of certain product development resources are met, the development stage is started.
As shown in fig. 3, when evaluating the performance test resource, equation 2 is used: totalTestCpuCore [softno,sysno] ＝PCPU [softno,sysno] ·CPUCORE [softno,sysno] 2 resources required for the computation, wherein TotalTestCpuCore [softno,sysno] Indicating the required performance test resource, CPUCORE [softno,sysno] Representing the number of CPU cores of the non-trusted environment. Meet a certain productAnd (4) entering a pressure measurement stage when the pressure measurement resource requirement is met, and continuously repeating the development and pressure measurement stages until the performance requirement is met.
As shown in fig. 4, when evaluating production resources, equation 3 is used: totalproddcupCore [softno,sysno] ＝PCPU [softno,sysno] ·CPUCORE [softno,sysno] Computing the required resource, wherein TotalProdCpuCore [softno,sysno] Indicating the required production resource, CPUCORE [softno,sysno] Representing the number of CPU cores of the non-trusted environment. And if the requirements of certain product production resources and data migration resources are met, entering a production migration stage.
As shown in fig. 2 to fig. 4, in this embodiment, when allocating an operating resource according to the required resource and the created resource condition, it is determined whether the created resource condition satisfies the required resource, if so, the operating resource is directly allocated, and if not, formula 5 is adopted:
calculating a rank value, wherein SourceRank [softno,sysno] The grade value is represented, the resource is allocated earlier as the value is smaller, k is 0 or 1,k =0, the interdiction problem does not exist, k =1 represents the interdiction problem exists, and the estimated year and month of production is coded by a 6-bit digital format of YYYYMM. Wherein, the migration priority is respectively as follows according to the high-to-low arrangement: first-run projects, full originations, key systems, general systems, and other systems.
As shown in fig. 5, the present embodiment further includes a step of determining whether capacity expansion or capacity reduction is required according to the operation condition, specifically: acquiring the information of the operating resources and the load information of the trusted environment, calculating the required resources according to the production operating condition, acquiring the information of the resource pool, judging whether the resource pool needs capacity expansion or capacity reduction, and if so, performing capacity expansion or capacity reduction on the production resources.
As shown in fig. 6, the required resource is determined according to the pressure measurement condition, and formula 6 is adopted: PCPU [softno,sysno] And (4) recalculating the conversion coefficient of the single system in the single migration direction by using the number of CPU cores required by the pressure measurement of the trusted environment/the number of CPU cores in the non-trusted environment.
According to the adjustment conversion coefficient of the expansion or contraction condition after the migration, the method specifically comprises the following steps: judging whether the single migration direction of the single system completes the migration and the expansion and contraction of the capacity, if so, adopting PCPU [softno,sysno] = number of CPU cores in trusted environment/number of CPU cores in untrusted environment after production expansion/reduction, recalculating the conversion factor for single system in single migration direction, and using formula 4:
adjusting resource conversion coefficient, wherein PCPUDefault' [softno] Represents the adjusted resource reduction factor, PMigrate [softno,sysno] This indicates the migration completion case, where completion is 1 and not 0.
The invention can be used for promoting the migration implementation based on the resource availability, ensures that each system can be rapidly migrated and brought online, continuously optimizes the resource conversion coefficient along with the continuous migration of the system, ensures that the resource evaluation is more accurate, and can more accurately measure and calculate the resource master along with the continuous adjustment of the conversion coefficient, thereby preparing the related resources in advance.
Claims (6)
1. A centralized and creative migration method for a large-scale system is characterized by comprising the following steps:
(1) Acquiring relevant parameters of a non-trusted environment;
(2) Counting the information and creation resource condition;
(3) Determining a resource conversion coefficient based on the prior knowledge and a benchmark test; when the migration in a certain migration direction is started, PCPUDefault is adopted [softno] = max (a priori knowledge, benchmark value) determines the resource conversion factor for the migration direction; when starting single system migration in a certain migration direction, adopting PCPU [softno,sysno] ＝PCPUDefault [softno] The conversion coefficient is used for the single system migration direction, wherein sysno represents a production system, and softno represents the migration direction of the base software in the non-trusted environment to the base software in the trusted environment;
(4) Calculating required resources according to the relevant parameters of the non-trusted environment and the resource conversion coefficient;
(5) Distributing operation resources according to the required resources and the information-created resources;
(6) Migrating based on the running resources, and adjusting a resource conversion coefficient according to the migration condition, specifically: judging whether the single migration direction of the single system completes the migration or not, and if so, adopting PCPU (physical control Unit) [softno,sysno] = production of CPU core number of trusted environment/CPU core number of untrusted environment after expansion/contraction, recalculation of the conversion factor of single system in single migration direction, using
Adjusting resource conversion coefficient, wherein PCPUDefault' [softno] Represents the adjusted resource reduction factor, PMigrate [softno,sysno] Indicating that the migration is complete, completion is 1, not completed is 0, n indicates the number of production systems.
2. The centralized creative migration method for large-scale systems of claim 1, wherein the step (4) employs totaldevcpcucre in evaluating development resources [softno,sysno] ＝PCPU [softno,sysno] ·CPUCORE [softno,sysno] The resource required by/4 calculation, wherein, totalDevcCpuCore [softno,sysno] Indicating required development resources, CPUCORE [softno,sysno] Representing the number of CPU cores of the non-trusted environment.
3. The centralized creative migration method for large-scale systems of claim 1, wherein the step (4) adopts TotalTestCpuCore in evaluating performance test resources [softno,sysno] ＝PCPU [softno,sysno] ·CPUCORE [softno,sysno] 2 resources required for the computation, wherein TotalTestCpuCore [softno,sysno] Indicating the required performance test resource, CPUCORE [softno,sysno] Representing the number of CPU cores of the non-trusted environment.
4. For large scale systems according to claim 1The centralized creative migration method is characterized in that the step (4) adopts TotalProdCpuCore when the production resources are evaluated [softno,sysno] ＝PCPU [softno,sysno] ·CPUCORE [softno,sysno] Calculating the required resource, wherein, totalProdCpuCore [softno,sysno] Indicating the required production resource, CPUCORE [softno,sysno] Representing the number of CPU cores of the non-trusted environment.
5. The centralized and creative migration method for large-scale systems according to claim 1, wherein the step (5) is specifically as follows: judging whether the information creating resource condition meets the required resource, if so, directly distributing the running resource, and if not, adopting the Source rank [softno,sysno] = migration priority 1000000000+ k + 100000000+ estimated production year and month + PCPU [softno,sysno] Calculating grade value, wherein, sourceRank [softno,sysno] Indicating a rank value, the smaller the value, the earlier the resource is allocated, k is 0 or 1, k =0 indicating that no blocking problem exists, k =1 indicating that a blocking problem exists, and the expected year of production is encoded in a 6-bit digital format of yyymm.
6. The centralized and creative migration method for large-scale systems of claim 1, further comprising determining required resources according to pressure measurement conditions, and employing PCPU [softno,sysno] = number of CPU cores needed by pressure measurement of trusted environment/number of CPU cores of non-trusted environment, and recalculating conversion factor of single system in single migration direction; the method also comprises a step of judging whether the capacity expansion or the capacity reduction is needed according to the operation condition, and PCPU is adopted after the capacity expansion or the capacity reduction [softno,sysno] And = (= the number of CPU cores in the trusted environment/the number of CPU cores in the non-trusted environment after production and capacity expansion, recalculating the conversion coefficient of the single system in the single migration direction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211186943.9A CN115269564B (en) | 2022-09-28 | 2022-09-28 | Centralized creative migration method for large-scale system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211186943.9A CN115269564B (en) | 2022-09-28 | 2022-09-28 | Centralized creative migration method for large-scale system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115269564A CN115269564A (en) | 2022-11-01 |
| CN115269564B true CN115269564B (en) | 2022-12-27 |
Family
ID=83756236
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211186943.9A Active CN115269564B (en) | 2022-09-28 | 2022-09-28 | Centralized creative migration method for large-scale system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115269564B (en) |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9098214B1 (en) * | 2010-12-28 | 2015-08-04 | Amazon Technologies, Inc. | Managing virtual machine migration |
| CN107239341B (en) * | 2017-05-27 | 2020-09-18 | 苏州浪潮智能科技有限公司 | Resource conversion method and system and virtual machine resource scheduling system |
| CN110389838B (en) * | 2019-07-24 | 2021-06-25 | 北京邮电大学 | Real-time scheduling and online migration control method suitable for virtual resources |
| CN111897654B (en) * | 2020-07-31 | 2023-08-15 | 腾讯科技（深圳）有限公司 | Method and device for migrating application to cloud platform, electronic equipment and storage medium |
-
2022
- 2022-09-28 CN CN202211186943.9A patent/CN115269564B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN115269564A (en) | 2022-11-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8578023B2 (en) | Computer resource utilization modeling for multiple workloads | |
| CN106959894B (en) | Resource allocation method and device | |
| JP5754824B2 (en) | Data conversion method and data transformer | |
| CN102411616B (en) | Method and system for storing data and data management method | |
| US8719417B1 (en) | Resource allocation in distributed systems | |
| CN104462432A (en) | Self-adaptive distributed computing method | |
| US11368518B2 (en) | Facilitating management of communications systems | |
| CN110737727B (en) | Data processing method and system | |
| CN115269564B (en) | Centralized creative migration method for large-scale system | |
| CN111858735A (en) | Data import method and device, electronic equipment and storage medium | |
| CN112632052B (en) | Heterogeneous data sharing method and intelligent sharing system | |
| CN106575296B (en) | Dynamic N-dimensional cube for hosted analytics | |
| CN104573127B (en) | Assess the method and system of data variance | |
| CN108536525B (en) | Host machine scheduling method and device | |
| CN111160614B (en) | Training method and device of resource transfer prediction model and computing equipment | |
| CN112949697A (en) | Method and device for confirming pipeline abnormity and computer readable storage medium | |
| US11797543B2 (en) | System and method for cascade elimination of candidates in spatial relation operations | |
| US8589560B1 (en) | Assembling detailed user replica placement views in distributed computing environment | |
| CN115759742A (en) | Enterprise risk assessment method and device, computer equipment and storage medium | |
| CN113010489A (en) | Data migration method and system | |
| US20190243856A1 (en) | Computer-implemented method of processing data in a hierarchal data structure and data processing device or system for the same | |
| CN112488141A (en) | Method and device for determining application range of Internet of things card and computer readable storage medium | |
| CN111104569A (en) | Region segmentation method and device for database table and storage medium | |
| CN116340295B (en) | Data migration method and device based on multi-type data sources | |
| Lee Cesario et al. | A computer method for loading model networks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |