CN115269564A - Centralized creative migration method for large-scale system - Google Patents

Centralized creative migration method for large-scale system Download PDF

Info

Publication number
CN115269564A
CN115269564A CN202211186943.9A CN202211186943A CN115269564A CN 115269564 A CN115269564 A CN 115269564A CN 202211186943 A CN202211186943 A CN 202211186943A CN 115269564 A CN115269564 A CN 115269564A
Authority
CN
China
Prior art keywords
migration
resources
resource
centralized
creative
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202211186943.9A
Other languages
Chinese (zh)
Other versions
CN115269564B (en
Inventor
沈信禕
肖良华
李放
卢强
施睿
陈天鑫
邢迎新
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Data Center of China Life Insurance Co Ltd
Original Assignee
Shanghai Data Center of China Life Insurance Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Data Center of China Life Insurance Co Ltd filed Critical Shanghai Data Center of China Life Insurance Co Ltd
Priority to CN202211186943.9A priority Critical patent/CN115269564B/en
Publication of CN115269564A publication Critical patent/CN115269564A/en
Application granted granted Critical
Publication of CN115269564B publication Critical patent/CN115269564B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21—Design, administration or maintenance of databases
    • G06F16/214—Database migration support
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083—Techniques for rebalancing the load in a distributed system
    • G06F9/5088—Techniques for rebalancing the load in a distributed system involving task migration

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention relates to a centralized creative migration method for a large-scale system, which comprises the following steps of: acquiring relevant parameters of a non-trusted environment; counting the information and creation resource condition; determining a resource conversion coefficient based on the prior knowledge and a benchmark test; calculating required resources according to the relevant parameters of the non-trusted environment and the resource conversion coefficient; allocating operating resources according to the required resources and the information-created resources; migrating based on the operating resources; the method also includes adjusting the conversion factor based on the test and operating conditions. The invention can realize the effective utilization of resources while orderly transferring the production system.

Description

Centralized creative migration method for large-scale system
Technical Field
The invention relates to the technical field of computers, in particular to a centralized and creative migration method for a large-scale system.
Background
With the great development of enterprises, when the existing database cannot meet the requirement of business development, the requirement of database migration exists, namely, data is transferred from the original database to a new database. Because the resources of the original database and the new database are different, the resources of the target database need to be dynamically evaluated, and the ordered and efficient migration can be realized.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a centralized and creative migration method for a large-scale system, which can realize the effective utilization of resources while orderly migrating a production system.
The technical scheme adopted by the invention for solving the technical problems is as follows: a centralized and creative migration method for a large-scale system is provided, which comprises the following steps:
(1) Acquiring relevant parameters of a non-trusted environment;
(2) Counting the information and creation resource condition;
(3) Determining a resource conversion coefficient based on the prior knowledge and a benchmark test;
(4) Calculating required resources according to the relevant parameters of the non-trusted environment and the resource conversion coefficient;
(5) Distributing operation resources according to the required resources and the information-created resources;
(6) And migrating based on the running resources.
In the step (3), when the migration in a certain migration direction is started, the method adopts
Figure 447254DEST_PATH_IMAGE002
Determining a resource conversion coefficient of the migration direction; when starting single system migration in a certain migration direction, adopt
Figure 555893DEST_PATH_IMAGE004
As the single system migration partyA forward conversion factor, wherein,
Figure 227046DEST_PATH_IMAGE006
a production system is shown in the form of a system,
Figure 275905DEST_PATH_IMAGE008
indicating the migration direction of the base software in the non-trusted environment to the base software of the trusted environment.
When evaluating the development resources, the step (4) adopts
Figure 598170DEST_PATH_IMAGE010
The required resources are calculated, wherein,
Figure 628443DEST_PATH_IMAGE012
the required development resources are represented and,
Figure 537625DEST_PATH_IMAGE014
representing the number of CPU cores of the non-trusted environment.
When evaluating the performance test resources, the step (4) adopts
Figure 311546DEST_PATH_IMAGE016
The required resources are calculated, wherein,
Figure 550635DEST_PATH_IMAGE018
indicating the required performance test resources and,
Figure 502541DEST_PATH_IMAGE020
representing the number of CPU cores of the non-trusted environment.
When evaluating the production resources, the step (4) adopts
Figure 148286DEST_PATH_IMAGE022
The required resources are calculated, wherein,
Figure 709587DEST_PATH_IMAGE024
which is indicative of the required production resources that are,
Figure 632543DEST_PATH_IMAGE026
representing the number of CPU cores of the non-trusted environment.
The step (5) is specifically as follows: judging whether the information creating resource condition meets the required resource, if so, directly distributing the operating resource, and if not, adopting
Figure 129253DEST_PATH_IMAGE028
A rank value is calculated, wherein,
Figure 262294DEST_PATH_IMAGE030
indicating a rank value, the smaller the value is, the earlier the resource is allocated,
Figure 627285DEST_PATH_IMAGE032
is a number of 0 or 1, and,
Figure 529382DEST_PATH_IMAGE032
=0 indicates that there is no blocking problem,
Figure 823091DEST_PATH_IMAGE032
=1 indicates that there is a blockade problem and year of commissioning is expected to be encoded in the 6-bit digital format of YYYYMM.
The step (6) further includes adjusting the resource conversion coefficient according to the migration condition, specifically: judging whether the single migration direction of the single system completes the migration or not, if so, adopting
Figure 177849DEST_PATH_IMAGE034
Recalculating the conversion coefficient of single system and single migration direction, and adopting
Figure 408848DEST_PATH_IMAGE036
Adjusting a resource conversion factor, wherein,
Figure 916184DEST_PATH_IMAGE038
the adjusted resource conversion factor is represented,
Figure DEST_PATH_IMAGE040
this indicates that the migration is completed, and the completion is 1 but not 0.
The centralized creative migration method for the large-scale system further comprises the steps of judging required resources according to the pressure measurement condition, and adopting
Figure 3963DEST_PATH_IMAGE042
Recalculating the conversion coefficient of the single system in the single migration direction; the method also comprises the step of judging whether the capacity expansion or the capacity reduction is needed according to the operation condition, and adopting the method after the capacity expansion or the capacity reduction
Figure 862329DEST_PATH_IMAGE044
And recalculating the conversion coefficient of the single system and the single migration direction.
Advantageous effects
Due to the adoption of the technical scheme, compared with the prior art, the invention has the following advantages and positive effects: the invention can be used for promoting the migration implementation based on the resource availability, ensures that each system can be rapidly migrated online, continuously optimizes the resource conversion coefficient along with the continuous migration of the system, ensures that the resource evaluation is more accurate, measures and calculates the resource master disk more accurately along with the continuous adjustment of the conversion coefficient, and can prepare related resources in advance.
Drawings
FIG. 1 is a general flow diagram of migration in accordance with an embodiment of the present invention;
FIG. 2 is a flowchart of development resource evaluation and application in an embodiment of the present invention;
FIG. 3 is a flowchart of performance testing resource evaluation and application in an embodiment of the present invention;
FIG. 4 is a flow chart of a process for evaluating and applying for production resources according to an embodiment of the present invention;
FIG. 5 is a flow chart of capacity expansion/contraction according to an embodiment of the present invention;
fig. 6 is a flowchart of adjusting resource conversion factors according to an embodiment of the present invention.
Detailed Description
The invention will be further illustrated with reference to the following specific examples. It should be understood that these examples are for illustrative purposes only and are not intended to limit the scope of the present invention. Further, it should be understood that various changes or modifications of the present invention may be made by those skilled in the art after reading the teaching of the present invention, and such equivalents may fall within the scope of the present invention as defined in the appended claims.
The embodiment of the invention relates to a centralized and creative migration method for a large-scale system, which comprises the following steps as shown in figure 1: acquiring related parameters of a non-trusted environment; counting the information and creation resource condition; determining a resource conversion coefficient based on the prior knowledge and a benchmark test; calculating required resources according to the relevant parameters of the non-trusted environment and the resource conversion coefficient; allocating operating resources according to the required resources and the information-created resources; and migrating based on the running resources. When obtaining the relevant parameters of the non-trusted environment, it is necessary to obtain the production resources and the use conditions of various to-be-migrated production systems, including the key indexes (including numerical values, average usage rates, and maximum usage rates) of the CPU core number, the memory capacity, and the data capacity. When the condition of the trusted resources is counted, key indexes of the number of CPU cores, the memory capacity and the data capacity need to be counted.
In the embodiment, the production credit and creation resource pool and the pressure measurement credit and creation resource pool are planned according to the grade and the category of the production system and the machine room to which the production system belongs.
As shown in fig. 2, when evaluating development resources, equation 1 is used:
Figure 319855DEST_PATH_IMAGE010
the required resources are calculated, wherein,
Figure 180232DEST_PATH_IMAGE012
the required development resources are represented and,
Figure 330591DEST_PATH_IMAGE004
a reduced coefficient representing a single migration direction of a single system,
Figure 410674DEST_PATH_IMAGE002
resource book representing single migration directionAnd calculating the coefficient.
Figure 671891DEST_PATH_IMAGE014
Represents the number of CPU cores of the non-trusted environment,
Figure 386775DEST_PATH_IMAGE006
indicating production systems, each of which may be numbered 1 to n, such as a core business system set to 1, a customer management system set to 2, and a training management system set to 3,
Figure 708035DEST_PATH_IMAGE008
the migration direction of the basic software in the non-trusted environment to the new basic software in the trusted environment is represented, and the number of each migration direction of the original basic software and the trusted basic software is 1-m, for example, the original database A is migrated to the trusted database B, the number is 1, and the original database C is migrated to the trusted database B, and the number is 2. All production systems are numbered 1 to n. And if the requirements of certain product development resources are met, entering a development stage.
As shown in fig. 3, when evaluating the performance test resource, equation 2 is adopted:
Figure 275413DEST_PATH_IMAGE016
the required resources are calculated, wherein,
Figure 74742DEST_PATH_IMAGE018
indicating the required performance test resources that are to be tested,
Figure 909712DEST_PATH_IMAGE020
representing the number of CPU cores of the non-trusted environment. And if the requirement of certain product pressure measurement resource is met, entering a pressure measurement stage, and continuously repeating the development and pressure measurement stages until the performance requirement is met.
As shown in fig. 4, when evaluating production resources, equation 3 is used:
Figure 401873DEST_PATH_IMAGE022
the required resources are calculated, wherein,
Figure 190969DEST_PATH_IMAGE024
the representation of the production resources required is presented,
Figure 793988DEST_PATH_IMAGE026
representing the number of CPU cores of the non-trusted environment. And if the requirements of certain product production resources and data migration resources are met, entering a production migration stage.
As shown in fig. 2 to fig. 4, in this embodiment, when allocating an operating resource according to the required resource and the created resource condition, it is determined whether the created resource condition satisfies the required resource, if so, the operating resource is directly allocated, and if not, formula 5 is adopted:
Figure 834798DEST_PATH_IMAGE028
a rank value is calculated, wherein,
Figure 356915DEST_PATH_IMAGE030
indicating a rank value, the smaller the value is, the earlier the resource is allocated,
Figure 23520DEST_PATH_IMAGE032
is a number of 0 or 1, and,
Figure 476236DEST_PATH_IMAGE032
=0 indicates that there is no blocking problem,
Figure 849579DEST_PATH_IMAGE032
=1 indicates that there is a blockade problem and year on stream is expected to be encoded using the 6-bit digital format of YYYYMM. Wherein, the migration priorities are respectively as follows according to high-to-low arrangement: first-run projects, full trust, focus systems, general systems, and other systems.
As shown in fig. 5, the present embodiment further includes a step of determining whether capacity expansion or capacity reduction is required according to the operation condition, specifically: acquiring the information of the operation resources of the trusted environment and the load information, calculating the required resources according to the production operation condition, acquiring the information of the resource pool, judging whether the resource pool needs capacity expansion or capacity contraction, and if so, performing capacity expansion or capacity contraction on the production resources.
As shown in fig. 6, the required resource is determined according to the pressure measurement condition, and formula 6 is adopted:
Figure 729548DEST_PATH_IMAGE042
and recalculating the conversion coefficient of the single system and the single migration direction.
According to the adjustment conversion coefficient of the expansion or contraction condition after the migration, the method specifically comprises the following steps: judging whether the single migration direction of the single system completes the migration and the expansion and contraction of the capacity, if so, adopting
Figure 945766DEST_PATH_IMAGE034
Recalculating the conversion coefficient of the single system in the single migration direction, and adopting a formula 4:
Figure 77539DEST_PATH_IMAGE036
and adjusting the resource conversion coefficient, wherein,
Figure 305389DEST_PATH_IMAGE038
the adjusted resource conversion factor is represented,
Figure 559522DEST_PATH_IMAGE040
this indicates the migration completion case, where completion is 1 and not 0.
The invention can be used for promoting the migration implementation based on the resource availability, ensures that each system can be rapidly migrated and on-line, continuously optimizes the resource conversion coefficient along with the continuous migration of the system, ensures that the resource evaluation is more accurate, measures and calculates the resource master disk more accurately along with the continuous adjustment of the conversion coefficient, and can prepare related resources in advance.

Claims (8)

1. A centralized and creative migration method for a large-scale system is characterized by comprising the following steps:
(1) Acquiring relevant parameters of a non-trusted environment;
(2) Counting the information and creation resource condition;
(3) Determining a resource conversion coefficient based on the prior knowledge and a benchmark test;
(4) Calculating required resources according to the relevant parameters of the non-trusted environment and the resource conversion coefficient;
(5) Allocating operating resources according to the required resources and the information-created resources;
(6) And migrating based on the running resources.
2. The centralized and creative migration method for large-scale systems of claim 1, wherein in the step (3), when the migration in a migration direction is started, the method employs
Figure 323218DEST_PATH_IMAGE001
Determining a resource conversion coefficient of the migration direction; when single system migration in a certain migration direction is started, the method adopts
Figure 336174DEST_PATH_IMAGE002
As a conversion factor of the single system migration direction, wherein,
Figure 405630DEST_PATH_IMAGE004
it is shown that the production system is,
Figure 695797DEST_PATH_IMAGE005
indicating the migration direction of the base software in the non-trusted environment to the base software of the trusted environment.
3. The centralized and creative migration method for large-scale systems of claim 2, wherein said step (4) is implemented when evaluating development resources
Figure 825296DEST_PATH_IMAGE006
The required resources are calculated, wherein,
Figure 200913DEST_PATH_IMAGE007
the development resources that are required are represented,
Figure 808481DEST_PATH_IMAGE008
representing the number of CPU cores of the non-trusted environment.
4. The centralized and creative migration method for large-scale systems of claim 2, wherein the step (4) adopts the method of evaluating performance testing resources
Figure 218734DEST_PATH_IMAGE009
The required resources are calculated, wherein,
Figure 519134DEST_PATH_IMAGE010
indicating the required performance test resources and,
Figure 382048DEST_PATH_IMAGE011
representing the number of CPU cores of the non-trusted environment.
5. The centralized and creative migration method for large-scale systems of claim 2, wherein the step (4) adopts when evaluating production resources
Figure 793306DEST_PATH_IMAGE012
The required resources are calculated, wherein,
Figure 792486DEST_PATH_IMAGE013
the representation of the production resources required is presented,
Figure 263788DEST_PATH_IMAGE014
representing the number of CPU cores of the non-trusted environment.
6. The centralized and creative migration method for large-scale systems according to claim 1, wherein the step (5) is specifically as follows: judging whether the information creating resource condition meets the required resource, if so, directly distributing the operationLine resources, if not, adopt
Figure 800948DEST_PATH_IMAGE016
A rank value is calculated, wherein,
Figure 766630DEST_PATH_IMAGE017
indicating a rank value, the smaller the value is, the earlier the resource is allocated,
Figure 135164DEST_PATH_IMAGE018
is a number of 0 or 1, and,
Figure 262520DEST_PATH_IMAGE018
=0 indicates that there is no blocking problem,
Figure 349293DEST_PATH_IMAGE018
=1 indicates that there is a blockade problem and year of commissioning is expected to be encoded in the 6-bit digital format of YYYYMM.
7. The centralized creative migration method for large-scale systems according to claim 1, wherein the step (6) further comprises adjusting resource conversion factors according to migration conditions, specifically: judging whether the single migration direction of the single system completes the migration or not, if so, adopting
Figure 40038DEST_PATH_IMAGE019
Recalculating the conversion coefficient of single system and single migration direction, and adopting
Figure 279389DEST_PATH_IMAGE020
And adjusting the resource conversion coefficient, wherein,
Figure 826914DEST_PATH_IMAGE021
the adjusted resource conversion factor is represented,
Figure 151716DEST_PATH_IMAGE022
this indicates that the migration is complete, 1 is complete, and 0 is not complete.
8. The centralized and creative migration method for large-scale systems of claim 1, further comprising determining required resources according to pressure measurement conditions, employing
Figure DEST_PATH_IMAGE023
Recalculating the conversion coefficient of the single system in the single migration direction; the method also comprises the step of judging whether the capacity expansion or the capacity reduction is needed according to the operation condition, and adopting the method after the capacity expansion or the capacity reduction
Figure 646151DEST_PATH_IMAGE024
And recalculating the conversion coefficient of the single system and the single migration direction.
CN202211186943.9A 2022-09-28 2022-09-28 Centralized creative migration method for large-scale system Active CN115269564B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211186943.9A CN115269564B (en) 2022-09-28 2022-09-28 Centralized creative migration method for large-scale system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211186943.9A CN115269564B (en) 2022-09-28 2022-09-28 Centralized creative migration method for large-scale system

Publications (2)

Publication Number Publication Date
CN115269564A true CN115269564A (en) 2022-11-01
CN115269564B CN115269564B (en) 2022-12-27

Family

ID=83756236

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211186943.9A Active CN115269564B (en) 2022-09-28 2022-09-28 Centralized creative migration method for large-scale system

Country Status (1)

Country Link
CN (1) CN115269564B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9098214B1 (en) * 2010-12-28 2015-08-04 Amazon Technologies, Inc. Managing virtual machine migration
CN107239341A (en) * 2017-05-27 2017-10-10 郑州云海信息技术有限公司 A kind of resource translation method, system and resources of virtual machine scheduling system
CN110389838A (en) * 2019-07-24 2019-10-29 北京邮电大学 A kind of Real-Time Scheduling suitable for virtual resource and online migration management-control method
CN111897654A (en) * 2020-07-31 2020-11-06 腾讯科技（深圳）有限公司 Method and device for migrating application to cloud platform, electronic equipment and storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9098214B1 (en) * 2010-12-28 2015-08-04 Amazon Technologies, Inc. Managing virtual machine migration
CN107239341A (en) * 2017-05-27 2017-10-10 郑州云海信息技术有限公司 A kind of resource translation method, system and resources of virtual machine scheduling system
CN110389838A (en) * 2019-07-24 2019-10-29 北京邮电大学 A kind of Real-Time Scheduling suitable for virtual resource and online migration management-control method
CN111897654A (en) * 2020-07-31 2020-11-06 腾讯科技（深圳）有限公司 Method and device for migrating application to cloud platform, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN115269564B (en) 2022-12-27

Similar Documents

Publication Publication Date Title
CN108090225B (en) Database instance running method, device and system and computer readable storage medium
WO2012131927A1 (en) Computer system and data management method
CN106959894B (en) Resource allocation method and device
CN111352712B (en) Cloud computing task tracking processing method and device, cloud computing system and server
US8719417B1 (en) Resource allocation in distributed systems
CN112668968A (en) Storage management modeling method and system based on domain-driven design
CN103714004A (en) JVM online memory leak analysis method and system
JP2018515844A (en) Data processing method and system
CN110737727B (en) Data processing method and system
CN111966707A (en) Query statement generation method and device, electronic equipment and computer readable medium
CN111143070A (en) Resource scheduling method and device
CN115269564B (en) Centralized creative migration method for large-scale system
CN108536525B (en) Host machine scheduling method and device
CN105027088A (en) System analysis device and system analysis method
CN111984677B (en) Resource data checking method, device, computer equipment and storage medium
CN113377488A (en) Method, system and equipment for resource migration
CN116820767A (en) Cloud resource management method and device, electronic equipment and storage medium
CN111182006B (en) Method and device for mapping physical cluster into cloud computing resource
CN111160614A (en) Training method and device of resource transfer prediction model and computing equipment
US8589560B1 (en) Assembling detailed user replica placement views in distributed computing environment
CN115618825A (en) Financial statement merging method and device, computer readable medium and terminal equipment
CN115759742A (en) Enterprise risk assessment method and device, computer equipment and storage medium
CN113010489A (en) Data migration method and system
CN112965665B (en) GP database data storage method based on SAS and SSD
US20190243856A1 (en) Computer-implemented method of processing data in a hierarchal data structure and data processing device or system for the same

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant