CN117149661B - Method, apparatus, device and computer readable medium for monitoring business system - Google Patents
Method, apparatus, device and computer readable medium for monitoring business system Download PDFInfo
- Publication number
- CN117149661B CN117149661B CN202311405922.6A CN202311405922A CN117149661B CN 117149661 B CN117149661 B CN 117149661B CN 202311405922 A CN202311405922 A CN 202311405922A CN 117149661 B CN117149661 B CN 117149661B
- Authority
- CN
- China
- Prior art keywords
- service system
- service
- parameters
- business
- white list
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 50
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000004519 manufacturing process Methods 0.000 claims abstract description 129
- 238000011156 evaluation Methods 0.000 claims abstract description 57
- 238000013508 migration Methods 0.000 claims abstract description 53
- 230000005012 migration Effects 0.000 claims abstract description 53
- 238000012360 testing method Methods 0.000 claims abstract description 45
- 238000002360 preparation method Methods 0.000 claims description 93
- 230000008520 organization Effects 0.000 claims description 22
- 238000003860 storage Methods 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 13
- 238000005516 engineering process Methods 0.000 claims description 11
- 230000006870 function Effects 0.000 claims description 9
- 238000005553 drilling Methods 0.000 description 18
- 238000010586 diagram Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 230000007246 mechanism Effects 0.000 description 6
- 238000012423 maintenance Methods 0.000 description 5
- 238000007726 management method Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 238000012795 verification Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012552 review Methods 0.000 description 3
- 238000013077 scoring method Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000008713 feedback mechanism Effects 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000012797 qualification Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000013515 script Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3664—Environments for testing or debugging software
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Abstract
The invention discloses a method, a device, equipment and a computer readable medium for monitoring a service system, and relates to the technical field of big data. One embodiment of the method comprises the following steps: determining that the service system enters into a production running state according to data migration of the service system, general ledger initialization of the service system, white list test business of the service system and service test operation of the service system; acquiring and evaluating parameters of the service system in the service system according to the identification of the production running state; and monitoring the service system according to the parameters of the service system and the evaluation results based on the parameters so as to determine to implement the production exercise of the service system. According to the embodiment, the production exercise of the business system can be monitored in time.
Description
Technical Field
The present invention relates to the field of big data technologies, and in particular, to a method, an apparatus, a device, and a computer readable medium for monitoring a service system.
Background
The bank core business system is a very complex system engineering, the number of the related business systems is large, the relation between the business systems is tight, and the switching of new business systems and old business systems is required to be completed within a limited time window.
Before the core system of banking business is put into production, multiple rounds of production exercises are generally performed to verify whether a production scheme is reasonable, whether production time sequences are accurate, whether dependency relations of all business systems are missed or not, and the like.
In the process of implementing the present invention, the inventor finds that at least the following problems exist in the prior art: the production exercise of the business system cannot be monitored in time.
Disclosure of Invention
In view of this, the embodiments of the present invention provide a method, apparatus, device, and computer readable medium for monitoring a service system, which can monitor a production exercise of the service system in time.
To achieve the above object, according to one aspect of the embodiments of the present invention, there is provided a method for monitoring a service system, including:
determining that the service system enters into a production running state according to data migration of the service system, general ledger initialization of the service system, white list test business of the service system and service test operation of the service system;
acquiring and evaluating parameters of the service system in the service system according to the identification of the production running state;
and monitoring the service system according to the parameters of the service system and the evaluation results based on the parameters so as to determine to implement the production exercise of the service system.
The determining that the service system enters into the production exercise state according to the data migration of the service system, the general ledger initialization of the service system, the white list test business of the service system and the service test operation of the service system comprises the following steps:
triggering the operation of general ledger initialization of the service system according to the success rate of data migration of the service system;
after the general ledger initialization operation of the service system is completed, executing the white list trial business based on the white list of the service system;
the white list of the service system relates to the trial operation of all the services of the service system after the system passes through the trial industry of the white list, and after the trial operation of all the services is successful, the service system is determined to enter a production running state.
The operation of triggering the initialization of the general ledger of the business system according to the success rate of the data migration of the business system comprises the following steps of
And if the success rate of data migration of the service system is greater than a migration threshold, triggering the parameter setting of general ledger initialization of the service system based on the successfully migrated data.
The white list of the service system relates to that after the system passes through the trial business of the white list, all service trial operations of the service system are opened, and after the service trial operations are successful, the service system is determined to enter a production running state, and the method comprises the following steps:
The white list of the service system relates to a white list service case of the system, and if the passing rate reaches a passing threshold, the trial business passing through the white list is determined;
and opening all service commissioning of the service system, wherein if the operation success rate of all commissioning cases is greater than an operation threshold, the commissioning of all services is successful so as to determine that the service system enters a production commissioning state.
The step of acquiring and evaluating parameters of the service system in the service system according to the identification of the production exercise state comprises the following steps:
traversing a database in the service system according to the identification of the production running state to acquire parameters of the service system, wherein the parameters of the service system comprise organization architecture parameters, scheme preparation parameters, technology preparation parameters, service preparation parameters and environment preparation parameters.
The technical preparation parameters comprise data migration parameters and general ledger initialization parameters;
the service preparation parameters comprise a white list test business parameter and a service system test operation parameter.
The monitoring the service system according to the parameters of the service system and the evaluation results based on the parameters to determine to implement the production exercise of the service system comprises:
Displaying parameters of the service system and receiving an evaluation result of the parameters;
and determining the maturity of the production running exercise of the service system based on the evaluation result of the parameters, and monitoring the service system based on the maturity to determine the production running exercise of the service system.
According to a second aspect of an embodiment of the present invention, there is provided an apparatus for monitoring a service system, including:
the state module is used for determining that the service system enters a production running state according to data migration of the service system, general ledger initialization of the service system, white list test business of the service system and service test operation of the service system, and sending an identification of the production running state;
the acquisition module is used for receiving the identifier of the production running state, acquiring and evaluating the parameters of the service system from the service system according to the identifier of the production running state, and sending the parameters of the service system;
and the monitoring module is used for receiving the parameters of the service system, and monitoring the service system according to the parameters of the service system and the evaluation result based on the parameters so as to determine to implement the production exercise of the service system.
According to a third aspect of an embodiment of the present invention, there is provided an electronic device for monitoring a service system, including:
one or more processors;
storage means for storing one or more programs,
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the methods as described above.
According to a fourth aspect of embodiments of the present invention, there is provided a computer readable medium having stored thereon a computer program which when executed by a processor implements a method as described above.
According to a fifth aspect of embodiments of the present invention, there is provided a computer program product comprising a computer program which, when executed by a processor, implements a method as provided by embodiments of the present invention.
One embodiment of the above invention has the following advantages or benefits: determining that the service system enters into a production running state according to data migration of the service system, general ledger initialization of the service system, white list test business of the service system and service test operation of the service system; acquiring and evaluating parameters of the service system in the service system according to the identification of the production running state; and monitoring the service system according to the parameters of the service system and the evaluation results based on the parameters so as to determine to implement the production exercise of the service system. The parameter evaluation service system based on the service system can monitor the production exercise of the service system in time.
Further effects of the above-described non-conventional alternatives are described below in connection with the embodiments.
Drawings
The drawings are included to provide a better understanding of the invention and are not to be construed as unduly limiting the invention. Wherein:
FIG. 1 is a schematic flow diagram of a method of monitoring a business system according to an embodiment of the present invention;
FIG. 2 is a flow chart of determining that a business system enters a put-to-put drill state according to an embodiment of the present invention;
FIG. 3 is a schematic flow chart of determining that the service system enters a commissioning exercise state after all service commissioning is successful according to an embodiment of the present invention;
FIG. 4 is a flow chart of determining to implement a commissioning maneuver of a business system according to an embodiment of the present invention;
fig. 5 is a schematic diagram of the main structure of an apparatus for monitoring a service system according to an embodiment of the present invention;
FIG. 6 is an exemplary system architecture diagram in which embodiments of the present invention may be applied;
fig. 7 is a schematic diagram of a computer system suitable for use in implementing an embodiment of the invention.
Detailed Description
Exemplary embodiments of the present invention will now be described with reference to the accompanying drawings, in which various details of the embodiments of the present invention are included to facilitate understanding, and are to be considered merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness. The data acquisition, storage, use, processing and the like in the technical scheme meet the relevant regulations of national laws and regulations.
Before each exercise of the banking core business system, there are a plurality of problems in terms of whether each exercise preparation work is ready or not, and the like, and the problems are as follows:
each scheme is prepared inadequately and mainly comprises an exercise overall scheme and a switching scheme of each application service system. The drilling overall scheme is an overall scheme for producing drilling, dividing each item of drilling preparation, and forming a complete drilling preparation item list and a solution of the item.
Before the large-scale banking core business system is put into production, if the whole scheme lacks planning and design, all matters related to the running exercise are not finished, and part matters are likely to be missed in the exercise, and only the exercise can be made up for by the other exercise.
The switching scheme of each application service system is that a single application service system participates in all operation, and comprises a plurality of steps of application deployment, starting verification, green light test, data migration and the like. If the switching scheme is incomplete or has errors, installation or configuration problems of the system can occur, and in severe cases, the whole exercise can fail.
The construction of the production organization is unclear, responsibility division is disordered, the issuing and feedback mechanisms of each production instruction during production are not clear, the response and processing mechanisms of the problems during production are not perfect, one of the main purposes of production exercise is to reduce the problems of formal production, and if the problems during production exercise cannot be effectively solved, the problems can occur again during production or new problems can be generated.
The version of the application business system participating in the production exercise is frequently changed, the version participating in the exercise is possibly inconsistent with the version of the test environment, or the application business system can obtain different results from the test environment in the exercise environment due to different application configurations in different environments, so that the problem is not solved but the defect is overcome in the actual exercise process, and the production exercise is changed into one-time version test.
The business department has insufficient participation, banking staff often participate in the production before the production is put into operation, and after the production starts, the business staff is unfamiliar with a new system due to insufficient operation experience, and needs more time to adapt than technical staff, so that the business case is slowly executed, and the progress of the production is influenced.
In summary, for the production exercise of the large-scale banking core business system, the real-time monitoring is difficult. Therefore, the technical problem that the production exercise of the service system cannot be monitored in time exists.
In order to solve the problem that the production exercise of the service system cannot be monitored in time, the following technical scheme in the embodiment of the invention can be adopted.
Referring to fig. 1, fig. 1 is a schematic flow chart of a method for monitoring a service system according to an embodiment of the present invention, wherein the service system is monitored based on parameters of the service system to determine to implement a production exercise of the service system. As shown in fig. 1 and 100, the method specifically comprises the following steps:
S101, determining that the service system enters into a production running state according to data migration of the service system, general ledger initialization of the service system, white list test business of the service system and service test operation of the service system.
In an embodiment of the invention, the business system is a system responsible for the core business of the bank. For the service system, the premise of evaluating the service system is that the service system enters a production exercise state, namely, the premise of the service system in technical production exercise.
Specifically, the service system can be determined to enter a production running state according to data migration of the service system, general ledger initialization of the service system, white list test business of the service system and service test operation of the service system.
The business system is determined to be technically capable of performing production exercises from the following four aspects: data migration of a service system, general ledger initialization of the service system, white list trial business of the service system and service trial operation of the service system.
Referring to fig. 2 and 200, fig. 2 is a schematic flow chart of determining that a service system enters a commissioning exercise state according to an embodiment of the present invention. The method specifically comprises the following steps:
s201, triggering the operation of general ledger initialization of the service system according to the success rate of data migration of the service system.
The data migration of the business system comprises data migration, data conversion, data embedding and data checking. For the service system, it is required to ensure that the stock service data to be migrated in the old system is correctly and completely migrated into the new system, and ensure the integrity, correctness, consistency and availability of the stock service data after the migration after the new system is put into production online.
Before and after data migration, the success rate of checking the data migration of the business report forms in the old system and the new system needs to meet the migration threshold value to indicate that the data difference is acceptable.
In one embodiment of the invention, if the success rate of data migration of the service system is greater than the migration threshold, the parameter setting of general ledger initialization of the service system is triggered based on the successfully migrated data. The migration threshold may be preset based on the actual application scenario. As one example, in a financial business system, the migration threshold is set to 95%.
S202, after the general ledger initialization operation of the business system is completed, executing white list trial business based on the white list of the business system.
The general ledger initialization is based on the general ledger period initial data of new system data structure, new system function and accounting rule, and ensures the same general ledger number with the old system. The triggering conditions for the operation of the general ledger initialization of the business system are: success rate of data migration of the business system. It can be understood that if the success rate of data migration of the service system is greater than the migration threshold, the operation of general ledger initialization of the service system is triggered.
S203, after the system passes through the trial business of the white list, opening all the business trial operations of the business system, and after all the business trial operations are successful, determining that the business system enters into a production running state.
The white list test industry is used for trial of appointed personnel and/or systems in a manner of white name single management, drainage and the like, and other clients and systems are not affected due to problems. The white list of the service system relates to the operation of opening all the services of the service system after the system passes through the trial business of the white list, and determining that the service system enters into the production exercise state after all the service trial operations are successful.
Referring to fig. 3, 300, fig. 3 is a schematic flow chart of determining that the service system enters into a production running state after all service commissioning is successful according to an embodiment of the present invention. The method specifically comprises the following steps:
s301, a white list of a service system relates to a white list service case of the system, and if the passing rate reaches a passing threshold value, the trial business passing through the white list is determined.
In one embodiment of the invention, the white list business case of a specific customer account number and a specific channel is indicated that the white list business case has the condition of executing in the exercise environment if the passing rate reaches the passing threshold. That is, the white list of the service system relates to the white list service case of the system, and if the passing rate reaches the passing threshold, the trial business passing through the white list is determined. As one example, the pass threshold is 99%.
S302, opening all the service trial runs of the service system, and if the running success rate of all the trial run cases is greater than the running threshold, then all the service trial runs are successful so as to determine that the service system enters into a production running state.
The service test operation refers to the service verification of the service system after the new service system is started and before the formal external business, and is the last detection checkpoint before the formal operation of the service system. The white list of the service system relates to the test operation of all the services of the open service system after the system passes through the test industry of the white list.
And if the running success rate of all the trial running cases is greater than the running threshold, then all the service trial running is successful so as to determine that the service system enters into a production running state. As one example, the operating threshold is 99%.
In the embodiment of fig. 2, technical preparation of a business system is monitored to determine that the business system is entering a put-to-operate exercise state based on data migration of the business system, general ledger initialization of the business system, white list trial business of the business system, and business trial run of the business system.
S102, acquiring parameters of the evaluation service system in the service system according to the identification of the production exercise state.
In the embodiment of the invention, the business system needs to be exercised for a plurality of times before being put into production. Parameters of the evaluation business system can be obtained from the business system according to the identifiers of the production exercise states. As one example, the identification of the on-production drill state includes 001 and 002. Wherein 001 represents determining that the business system enters into the production exercise state on 1 month and 1 day. 002 represents determining that the business system enters into the on-production exercise state on day 2 and day 1.
The identification of the on-stream exercise status includes not only the status of the investment exercise but also the time to enter the on-stream exercise. At different points in time, the parameters of the business system are different. Therefore, parameters of the evaluation business system can be acquired from the business system according to the identification of the production exercise state.
In one embodiment of the present invention, parameters of the business system may be obtained in the following manner. According to the identification of the production running state, traversing a database in a service system to obtain parameters of the service system, wherein the parameters of the service system comprise organization architecture parameters, scheme preparation parameters, technology preparation parameters, service preparation parameters and environment preparation parameters.
Before production exercise, the preparation work comprises very complicated content, and is important for exercise evaluation. In an embodiment of the invention, the evaluation result is determined based on parameters of the service system. Specifically, the parameters of the business system include an organization architecture parameter, a solution preparation parameter, a technology preparation parameter, a business preparation parameter, and an environment preparation parameter.
The organization architecture parameters are parameters to which the organization architecture relates. The organization structure comprises an organization structure for production exercise, and whether personnel responsibility division and flow mechanisms are clear or not. The flow mechanism comprises an instruction issuing and feedback mechanism, a problem response and processing mechanism and a case execution and tracking mechanism.
The above-described organizational architecture content may be characterized in a parametric fashion. As one example, the organizational architecture parameters include the number of component architecture levels, the number of organizational architecture personnel, and the number of nodes of the organizational architecture flow mechanism.
The scenario preparation parameter is a parameter to which scenario preparation relates. The solution preparation includes whether the commissioning exercise solution, the core business system switching solution and the data migration solution have passed the review. As one example, the scenario preparation parameters include the number of scenarios, the extent to which the scenario is completed, and whether the manner passes the review.
The technical preparation parameters are parameters to which technical preparation relates. The technical preparation parameters comprise data migration parameters, application system deployment completion rate, version consistency rate, execution success rate of data cleaning scripts before and after drilling, data readiness rate required to be migrated during drilling and general ledger initialization parameters.
In one embodiment of the invention, the technical preparation parameters include data migration parameters and general ledger initialization parameters. This embodies the effects of data migration and general ledger initialization from a technical perspective.
The service preparation parameters comprise white list trial business parameters, service system trial operation parameters, general ledger initialization total score consistency rate, service case test environment passing rate, coverage rate of each field of service verification cases, proportion of service personnel exercise participation, training participation rate before exercise of service operators participating in the exercise and examination passing rate.
In one embodiment of the invention, the business preparation parameters include a whitelist commissioning parameter and a business system commissioning parameter. The influence of the white list test business and the test operation of the business system on business preparation is reflected.
The environment preparation parameter is a parameter related to environment preparation. The environment preparation comprises the conditions of infrastructure environment preparation, the exercise participation proportion of operation and maintenance personnel, the coverage of an exercise scene rate, the qualification rate of an exercise site, the readiness of comprehensive guarantee and the like. As one example, the environment preparation parameters include infrastructure environment preparation duty, operation and maintenance personnel exercise participation proportion, operation and maintenance tool coverage exercise scene rate, exercise site qualification rate, and comprehensive guarantee completion rate.
In an embodiment of the present invention, the evaluation result of the parameters is determined for the organization architecture parameters, the solution preparation parameters, the technology preparation parameters, the service preparation parameters, and the environment preparation parameters.
As one example, the evaluation result for the organization architecture parameter may be determined based on the evaluation. As one example, by review, the evaluation result is scored as 80 points; if the condition passes the evaluation, the evaluation result is scored as 60 to 80 points; and if the evaluation result does not pass the evaluation, the evaluation result is less than 60 minutes.
The evaluation result for the recipe preparation parameter may be determined based on the evaluation. As one example, the assessment is fed back through an investigation table, scoring according to the satisfaction of the participating production participants. The evaluation result passes 60 to 100 points; the evaluation result was not passed by less than 60 minutes.
The evaluation result may be determined for the technical preparation parameters based on the weight of each technical preparation parameter and the value of the technical preparation parameter.
The evaluation result may be determined for the service preparation parameters based on the weight of each service preparation parameter and the value of the service preparation parameter.
The evaluation result may be determined for the environment preparation parameters based on the weight of each environment preparation parameter and the value of the environment preparation parameter.
Up to this point, the parameters of the service system and the evaluation results of the parameters of the service system can be determined.
And S103, monitoring the service system according to the parameters of the service system and the evaluation result based on the parameters so as to determine to implement the production exercise of the service system.
After the parameters of the service system and the evaluation results based on the parameters are determined, the service system can be monitored according to the parameters of the service system and the evaluation results based on the parameters to determine to implement the production exercise of the service system.
Specifically, the business system is monitored based on the parameters of the business system and based on the evaluation results of the parameters to determine whether the production exercise of the business system can be performed.
Referring to fig. 4 and 400, fig. 4 is a schematic flow chart of determining to implement a commissioning exercise of a business system according to an embodiment of the present invention. The method specifically comprises the following steps:
s401, displaying parameters of the service system and receiving evaluation results of the parameters.
In the embodiment of the invention, the maturity of the production exercise of the business system can be determined by adopting an expert evaluation mode. Specifically, parameters of the service system are displayed, and an evaluation result of the parameters is received.
The parameters of the business system represent the readiness of the business system in terms of organization architecture, solution readiness, technology readiness, business readiness, and environment readiness. The result of the evaluation of the parameters is the readiness of the quantized traffic parameters.
S402, determining the maturity of the production exercise of the business system based on the evaluation result of the parameters, and monitoring the business system based on the maturity to determine the production exercise of the implementation business system.
The parameters of the business system include an organization architecture parameter, a solution preparation parameter, a technology preparation parameter, a business preparation parameter, and an environment preparation parameter. And determining the maturity of the production exercise of the business system based on the evaluation result of the parameters. Specifically, an expert scoring method is adopted to determine the maturity of the production exercise of the business system based on the evaluation result of the parameters.
In the professional field of financial industry, especially bank production, on one hand, business specialists with abundant industry experience are needed, and on the other hand, technical specialists in various technical fields are needed, so that the specialist scoring method is more applicable.
As one example, the scoring process is anonymous and independent of each other, filled out by a questionnaire sent to the relevant expert. All expert opinions are directly fed back to the evaluation group, opinion retrieval and arrangement cannot be unified, opinion solicitation and feedback are repeated, and finally, expert opinions which tend to be consistent are analyzed to obtain accurate results. The expert opinion has certain relative authority, the judgment of the weight is relatively accurate, the deviation between the evaluation result of the production exercise maturity and the actual value is smaller, and the expert scoring method can effectively solve the quantitative problem of the qualitative method.
In an embodiment of the invention, the maturity of the on-stream exercise includes the following five stages: first-order: primary, secondary: propulsion stage, tertiary: upgrading and four stages: optimization stage, five stages: leading the grade.
First-order: the content of the exercise preparation work is not clear to the exercise scheme, the work items to be completed are not completed, clear exercise targets and plans are not formulated, and the exercise work is not recommended to be carried out.
And (2) second-stage: the exercise preparation work is basically clear of the contents of an exercise scheme, and an organization structure is formulated and completed, but the technical preparation is insufficient, the version verification work cannot be effectively carried out, and the exercise work is not suggested to be carried out.
Three stages: the drilling preparation work is basically clear to the content of the drilling scheme, the organization architecture is formulated and completed, the technical preparation work is also basically completed, but the business matters are not completed, no complete drilling personnel are arranged, only the drilling work aiming at the technology is recommended to be carried out, and the business personnel do not participate.
Four stages: the exercise preparation work is basically clear to the content of the exercise scheme, the organization architecture is formulated and completed, the technical preparation and business preparation work is basically completed, and the production place and operation and maintenance personnel are arranged in place. But some critical technical indicators are not up to standard on critical paths. This level allows the exercise to be performed, but is ready for critical issues.
Five stages: the drilling preparation work is basically clear of the content of the drilling scheme, the organization architecture is formulated and completed, the technical preparation and business preparation work is completed, and the important item indexes reach the standards, and the production place and operation and maintenance personnel are arranged in place. The level of exercise preparation work can control key links, can achieve the purpose of exercise, forms benign circulation and can develop exercise work.
In the embodiment of the invention, the business system is monitored based on the maturity of the on-stream exercise, and the on-stream exercise of the business system can be determined under the condition that the maturity is four or five.
In addition, reasonable improvement suggestions can be given for indexes of unsatisfied conditions in the process of monitoring the service system.
As an example, the scoring results for the final five dimensions of a round of production runs are as follows: organization architecture: 80 minutes, scheme preparation: 80 minutes, technical preparation: 95 minutes; service preparation: 65 minutes; preparing environment: 75 minutes. The following conclusions can be drawn by expert scoring:
the architecture of the round of drilling preparation work organization is formulated and completed, the content of the drilling scheme is basically clear, the technical preparation work is also basically completed, but the business matters are not completely completed, drilling personnel are not arranged and have not completed yet, only the drilling work aiming at the technology is recommended to be carried out, and the business personnel do not participate. The overall rating is three-level. And if the maturity of the monitoring service system is 3 levels, determining that the production exercise of the service system is not implemented.
In the embodiment of the invention, the business system is determined to enter into a production running state according to the data migration of the business system, the general ledger initialization of the business system, the white list test business of the business system and the business test operation of the business system; acquiring and evaluating parameters of the service system in the service system according to the identification of the production running state; and monitoring the service system according to the parameters of the service system and the evaluation results based on the parameters so as to determine to implement the production exercise of the service system. The parameter evaluation service system based on the service system can monitor the production exercise of the service system in time.
In addition, the banking system is put into production and is disassembled into the plurality of pieces which can directly or indirectly obtain the data, so that the data is more clear, specific and visual in presentation, the evaluation method is more persuasive, expert opinions are integrated, the judgment is more accurate, the deviation between the result and the actual value is smaller, and the method has guiding significance.
In addition, according to the maturity of the production exercise, analysis suggestions are given, and scientific, reasonable and systematic improvement direction suggestions are provided in a targeted manner; the related personnel can better improve the maturity of related production exercise, and the exercise effect is practically improved.
Referring to fig. 5, namely 500, fig. 5 is a main structural schematic diagram of an apparatus for monitoring a service system according to an embodiment of the present invention, the apparatus for monitoring a service system may implement a method for monitoring a service system, and as shown in fig. 5, the apparatus for monitoring a service system specifically includes:
the state module 501 is configured to determine that a service system enters a production running state according to data migration of the service system, general ledger initialization of the service system, white list test business of the service system and service test operation of the service system, and send an identifier of the production running state;
the obtaining module 502 is configured to receive the identifier of the on-production drilling state, obtain, according to the identifier of the on-production drilling state, parameters of the service system in the service system, and send the parameters of the service system;
and the monitoring module 503 is configured to receive the parameters of the service system, and monitor the service system according to the parameters of the service system and the evaluation result based on the parameters, so as to determine to implement the production exercise of the service system.
In one embodiment of the present invention, the status module 501 is specifically configured to trigger an operation of initializing a general ledger of the service system according to a success rate of data migration of the service system;
After the general ledger initialization operation of the service system is completed, executing the white list trial business based on the white list of the service system;
the white list of the service system relates to the trial operation of all the services of the service system after the system passes through the trial industry of the white list, and after the trial operation of all the services is successful, the service system is determined to enter a production running state.
In one embodiment of the present invention, the status module 501, specifically for the service system, triggers the parameter setting of the general ledger initialization of the service system based on the successfully migrated data if the success rate of data migration is greater than the migration threshold.
In one embodiment of the present invention, the status module 501 is specifically configured to determine, when the passing rate reaches the passing threshold, that the white list of the service system relates to a white list service case of the system, and determine that the white list passes through the camping industry;
and opening all service commissioning of the service system, wherein if the operation success rate of all commissioning cases is greater than an operation threshold, the commissioning of all services is successful so as to determine that the service system enters a production commissioning state.
In one embodiment of the present invention, the obtaining module 502 is specifically configured to traverse a database in the service system according to the identifier of the production exercise state to obtain parameters of the service system, where the parameters of the service system include an organization architecture parameter, a solution preparation parameter, a technology preparation parameter, a service preparation parameter, and an environment preparation parameter.
In one embodiment of the invention, the technical preparation parameters include data migration parameters and general ledger initialization parameters;
the service preparation parameters comprise a white list test business parameter and a service system test operation parameter.
In one embodiment of the present invention, the monitoring module 503 is specifically configured to display parameters of the service system, and receive an evaluation result of the parameters;
and determining the maturity of the production running exercise of the service system based on the evaluation result of the parameters, and monitoring the service system based on the maturity to determine the production running exercise of the service system.
Fig. 6 illustrates an exemplary system architecture 600 of a method of monitoring a business system or an apparatus of monitoring a business system to which embodiments of the present invention may be applied.
As shown in fig. 6, the system architecture 600 may include terminal devices 601, 602, 603, a network 604, and a server 605. The network 604 is used as a medium to provide communication links between the terminal devices 601, 602, 603 and the server 605. The network 604 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
A user may interact with the server 605 via the network 604 using the terminal devices 601, 602, 603 to receive or send messages, etc. Various communication client applications such as shopping class applications, web browser applications, search class applications, instant messaging tools, mailbox clients, social platform software, etc. (by way of example only) may be installed on the terminal devices 601, 602, 603.
The terminal devices 601, 602, 603 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smartphones, tablets, laptop and desktop computers, and the like.
The server 605 may be a server providing various services, such as a background management server (by way of example only) providing support for shopping-type websites browsed by users using terminal devices 601, 602, 603. The background management server may analyze and process the received data such as the product information query request, and feedback the processing result (e.g., the target push information, the product information—only an example) to the terminal device.
It should be noted that, the method for monitoring a service system according to the embodiment of the present invention is generally executed by the server 605, and accordingly, the device for monitoring the service system is generally disposed in the server 605.
It should be understood that the number of terminal devices, networks and servers in fig. 6 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
The computer program product of the embodiment of the invention comprises a computer program, and the program is executed by a processor to realize the method for monitoring the service system provided by the embodiment of the invention.
Referring now to FIG. 7, there is illustrated a schematic diagram of a computer system 700 suitable for use in implementing an embodiment of the present invention. The terminal device shown in fig. 7 is only an example, and should not impose any limitation on the functions and the scope of use of the embodiment of the present invention.
As shown in fig. 7, the computer system 700 includes a Central Processing Unit (CPU) 701, which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 702 or a program loaded from a storage section 708 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the system 700 are also stored. The CPU 701, ROM 702, and RAM 703 are connected to each other through a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.
The following components are connected to the I/O interface 705: an input section 706 including a keyboard, a mouse, and the like; an output portion 707 including a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, a speaker, and the like; a storage section 708 including a hard disk or the like; and a communication section 709 including a network interface card such as a LAN card, a modem, or the like. The communication section 709 performs communication processing via a network such as the internet. The drive 710 is also connected to the I/O interface 705 as needed. A removable medium 711 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 710 as necessary, so that a computer program read therefrom is mounted into the storage section 708 as necessary.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication portion 709, and/or installed from the removable medium 711. The above-described functions defined in the system of the present invention are performed when the computer program is executed by a Central Processing Unit (CPU) 701.
The computer readable medium shown in the present invention may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules involved in the embodiments of the present invention may be implemented in software or in hardware. The described modules may also be provided in a processor, for example, as: a processor includes a status module, an acquisition module, and a monitoring module. The names of these modules do not constitute a limitation on the module itself in a certain case, for example, the status module may also be described as "determining that a service system enters into a put-to-put-into-exercise state according to data migration of the service system, general ledger initialization of the service system, white list trial operation of the service system, and service trial operation of the service system" and transmitting an identification of the put-to-put-into-exercise state ".
As another aspect, the present invention also provides a computer-readable medium that may be contained in the apparatus described in the above embodiments; or may be present alone without being fitted into the device. The computer readable medium carries one or more programs which, when executed by a device, cause the device to include:
determining that the service system enters into a production running state according to data migration of the service system, general ledger initialization of the service system, white list test business of the service system and service test operation of the service system;
acquiring and evaluating parameters of the service system in the service system according to the identification of the production running state;
and monitoring the service system according to the parameters of the service system and the evaluation results based on the parameters so as to determine to implement the production exercise of the service system.
According to the technical scheme of the embodiment of the invention, the business system is determined to enter into a production running state according to data migration of the business system, general ledger initialization of the business system, white list test business of the business system and business test operation of the business system; acquiring and evaluating parameters of the service system in the service system according to the identification of the production running state; and monitoring the service system according to the parameters of the service system and the evaluation results based on the parameters so as to determine to implement the production exercise of the service system. The parameter evaluation service system based on the service system can monitor the production exercise of the service system in time.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives can occur depending upon design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.
In the technical scheme of the invention, the aspects of acquisition, analysis, use, transmission, storage and the like of the related user personal information all meet the requirements of related laws and regulations, are used for legal and reasonable purposes, are not shared, leaked or sold outside the aspects of legal use and the like, and are subjected to supervision and management of a supervision department. Necessary measures should be taken for the personal information of the user to prevent illegal access to such personal information data, ensure that personnel having access to the personal information data comply with the regulations of the relevant laws and regulations, and ensure the personal information of the user. Once these user personal information data are no longer needed, the risk should be minimized by limiting or even prohibiting the data collection and/or deletion.
User privacy is protected, when applicable, by de-identifying the data, including in some related applications, such as by removing a particular identifier (e.g., date of birth, etc.), controlling the amount or specificity of stored data (e.g., collecting location data at a city level rather than at a specific address level), controlling how the data is stored, and/or other methods.
Claims (7)
1. A method of monitoring a business system, comprising:
determining that the service system enters into a production running state according to data migration of the service system, general ledger initialization of the service system, white list test business of the service system and service test operation of the service system; the general ledger initialization is based on general ledger period initial data of a new system data structure, new system functions and accounting rules, and ensures that the general ledger number of the new system is consistent with that of an old system; the service system is a system responsible for the core service of the bank;
acquiring and evaluating parameters of the service system in the service system according to the identification of the production running state;
monitoring the service system according to the parameters of the service system and the evaluation results based on the parameters to determine to implement the production exercise of the service system, wherein the parameters of the service system embody the preparation conditions of the service system in organization architecture, scheme preparation, technical preparation, service preparation and environment preparation;
The determining that the service system enters into the production exercise state according to the data migration of the service system, the general ledger initialization of the service system, the white list test business of the service system and the service test operation of the service system comprises the following steps:
triggering the operation of general ledger initialization of the service system according to the success rate of data migration of the service system;
after the general ledger initialization operation of the service system is completed, executing the white list trial business based on the white list of the service system;
the white list of the service system relates to the trial operation of all the services of the service system after the system passes through the trial industry of the white list, and after the trial operation of all the services is successful, the service system is determined to enter a production running state;
the operation of triggering the initialization of the general ledger of the business system according to the success rate of the data migration of the business system comprises the following steps:
if the success rate of data migration of the service system is greater than a migration threshold, triggering the parameter setting of general ledger initialization of the service system based on the successfully migrated data;
the white list of the service system relates to that after the system passes through the trial business of the white list, all service trial operations of the service system are opened, and after the service trial operations are successful, the service system is determined to enter a production running state, and the method comprises the following steps:
The white list of the service system relates to a white list service case of the system, and if the passing rate reaches a passing threshold, the trial business passing through the white list is determined;
and opening all service commissioning of the service system, wherein if the operation success rate of all commissioning cases is greater than an operation threshold, the commissioning of all services is successful so as to determine that the service system enters a production commissioning state.
2. The method for monitoring a service system according to claim 1, wherein the step of obtaining parameters for evaluating the service system in the service system according to the identification of the on-production exercise state comprises:
traversing a database in the service system according to the identification of the production running state to acquire parameters of the service system, wherein the parameters of the service system comprise organization architecture parameters, scheme preparation parameters, technology preparation parameters, service preparation parameters and environment preparation parameters.
3. The method of monitoring a business system according to claim 2, wherein the technical preparation parameters include data migration parameters and general ledger initialization parameters;
the service preparation parameters comprise a white list test business parameter and a service system test operation parameter.
4. The method for monitoring a business system according to claim 1, wherein monitoring the business system according to the parameters of the business system and the evaluation results based on the parameters to determine to implement the production exercise of the business system comprises:
displaying parameters of the service system and receiving an evaluation result of the parameters;
and determining the maturity of the production running exercise of the service system based on the evaluation result of the parameters, and monitoring the service system based on the maturity to determine the production running exercise of the service system.
5. An apparatus for monitoring a business system, comprising:
the state module is used for determining that the service system enters a production running state according to data migration of the service system, general ledger initialization of the service system, white list test business of the service system and service test operation of the service system, and sending an identification of the production running state; the general ledger initialization is based on general ledger period initial data of a new system data structure, new system functions and accounting rules, and ensures that the general ledger number of the new system is consistent with that of an old system; the service system is a system responsible for the core service of the bank;
Triggering the operation of initializing the general ledger of the business system according to the success rate of data migration of the business system;
after the general ledger initialization operation of the service system is completed, executing the white list trial business based on the white list of the service system;
the white list of the service system relates to the trial operation of all the services of the service system after the system passes through the trial industry of the white list, and after the trial operation of all the services is successful, the service system is determined to enter a production running state;
if the success rate of data migration of the service system is greater than a migration threshold, triggering parameter setting of general ledger initialization of the service system based on successfully migrated data;
the white list of the service system relates to a white list service case of the system, and if the passing rate reaches a passing threshold value, the trial business passing through the white list is determined;
opening all service commissioning of the service system, and if the operation success rate of all commissioning cases is greater than an operation threshold, successfully commissioning all the services to determine that the service system enters a production commissioning state;
the acquisition module is used for receiving the identifier of the production running state, acquiring and evaluating the parameters of the service system from the service system according to the identifier of the production running state, and sending the parameters of the service system;
The monitoring module is used for receiving the parameters of the service system, monitoring the service system according to the parameters of the service system and the evaluation result based on the parameters so as to determine to implement the production exercise of the service system, wherein the parameters of the service system embody the preparation conditions of the service system in organization architecture, scheme preparation, technical preparation, service preparation and environment preparation.
6. An electronic device for monitoring a business system, comprising:
one or more processors;
storage means for storing one or more programs,
when executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1-4.
7. A computer readable medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to any of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311405922.6A CN117149661B (en) | 2023-10-27 | 2023-10-27 | Method, apparatus, device and computer readable medium for monitoring business system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311405922.6A CN117149661B (en) | 2023-10-27 | 2023-10-27 | Method, apparatus, device and computer readable medium for monitoring business system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117149661A CN117149661A (en) | 2023-12-01 |
| CN117149661B true CN117149661B (en) | 2024-02-09 |
Family
ID=88902969
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311405922.6A Active CN117149661B (en) | 2023-10-27 | 2023-10-27 | Method, apparatus, device and computer readable medium for monitoring business system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117149661B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112488534A (en) * | 2020-12-03 | 2021-03-12 | 福建省农村信用社联合社 | Risk early warning method, system, equipment and medium before bank software is online |
| CN112581099A (en) * | 2020-12-25 | 2021-03-30 | 中国建设银行股份有限公司 | Production scheme obtaining method and device and electronic equipment |
| CN113344708A (en) * | 2021-05-31 | 2021-09-03 | 中国工商银行股份有限公司 | Large-scale system production and exercise application evaluation method and system |
| CN114003475A (en) * | 2021-10-20 | 2022-02-01 | 中国电子产品可靠性与环境试验研究所（（工业和信息化部电子第五研究所）（中国赛宝实验室）） | Software product maturity evaluation method and device, computer equipment and storage medium |
| CN114219321A (en) * | 2021-12-17 | 2022-03-22 | 中国建设银行股份有限公司 | Information system production preparation method and device |
| CN114637674A (en) * | 2022-03-18 | 2022-06-17 | 中国建设银行股份有限公司 | Application evaluation method and device, electronic equipment and computer storage medium |
| CN114978923A (en) * | 2022-04-21 | 2022-08-30 | 京东科技信息技术有限公司 | Fault drilling method, device and system |
| CN115599694A (en) * | 2022-11-03 | 2023-01-13 | 上海友道智途科技有限公司（Cn） | Integrated test method for automatic driving software version |
| CN116455918A (en) * | 2023-06-16 | 2023-07-18 | 北京江融信科技有限公司 | Method and system for verifying trial operation of new credit card core system |
| CN116596475A (en) * | 2023-05-24 | 2023-08-15 | 北银金融科技有限责任公司 | Bank production command system based on workflow |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU6498100A (en) * | 1999-07-30 | 2001-02-19 | Ac Properties B.V. | A system, method and article of manufacture for maintaining data in an e-commerce based technical architecture |
| US11775901B2 (en) * | 2020-03-30 | 2023-10-03 | International Business Machines Corporation | Real time testing and monitoring for business process management systems |
| US11934288B2 (en) * | 2020-11-17 | 2024-03-19 | Cognizant Technology Solutions India Pvt. Ltd. | System and method for assessing performance of software release |
| CN113391794A (en) * | 2021-07-08 | 2021-09-14 | 上海浦东发展银行股份有限公司 | System and method for developing collaboration service |
| US11726782B2 (en) * | 2021-07-30 | 2023-08-15 | Fmr Llc | Assessing and auditing release readiness for a software application |
| CN114138308A (en) * | 2021-12-08 | 2022-03-04 | 兴业银行股份有限公司 | Gray scale distribution system, method and medium |
-
2023
- 2023-10-27 CN CN202311405922.6A patent/CN117149661B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112488534A (en) * | 2020-12-03 | 2021-03-12 | 福建省农村信用社联合社 | Risk early warning method, system, equipment and medium before bank software is online |
| CN112581099A (en) * | 2020-12-25 | 2021-03-30 | 中国建设银行股份有限公司 | Production scheme obtaining method and device and electronic equipment |
| CN113344708A (en) * | 2021-05-31 | 2021-09-03 | 中国工商银行股份有限公司 | Large-scale system production and exercise application evaluation method and system |
| CN114003475A (en) * | 2021-10-20 | 2022-02-01 | 中国电子产品可靠性与环境试验研究所（（工业和信息化部电子第五研究所）（中国赛宝实验室）） | Software product maturity evaluation method and device, computer equipment and storage medium |
| CN114219321A (en) * | 2021-12-17 | 2022-03-22 | 中国建设银行股份有限公司 | Information system production preparation method and device |
| CN114637674A (en) * | 2022-03-18 | 2022-06-17 | 中国建设银行股份有限公司 | Application evaluation method and device, electronic equipment and computer storage medium |
| CN114978923A (en) * | 2022-04-21 | 2022-08-30 | 京东科技信息技术有限公司 | Fault drilling method, device and system |
| CN115599694A (en) * | 2022-11-03 | 2023-01-13 | 上海友道智途科技有限公司（Cn） | Integrated test method for automatic driving software version |
| CN116596475A (en) * | 2023-05-24 | 2023-08-15 | 北银金融科技有限责任公司 | Bank production command system based on workflow |
| CN116455918A (en) * | 2023-06-16 | 2023-07-18 | 北京江融信科技有限公司 | Method and system for verifying trial operation of new credit card core system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117149661A (en) | 2023-12-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11487539B2 (en) | Systems and methods for automating and monitoring software development operations | |
| US8630886B2 (en) | Method and system for providing enhanced trouble ticket status content | |
| Ibrahim et al. | Quantitative comparison of project performance between project delivery systems | |
| Bird | Sociotechnical coordination and collaboration in open source software | |
| CN109800387A (en) | A method of generating test report | |
| CN104598218B (en) | For merging and reusing the method and system of gateway information | |
| US20170300844A1 (en) | System and method for the monitoring and guiding of projects | |
| Zou et al. | BIM-based risk management: challenges and opportunities | |
| CN111124917A (en) | Public test case management and control method, device, equipment and storage medium | |
| US10949333B1 (en) | Application maturity console | |
| CN111563673A (en) | Computer technology digitization degree evaluation method and device | |
| CN117149661B (en) | Method, apparatus, device and computer readable medium for monitoring business system | |
| Bridges et al. | Key issues with implementing LOPA | |
| CN117252420A (en) | Job risk assessment method, device, equipment and storage medium | |
| CN112015715A (en) | Industrial Internet data management service testing method and system | |
| CN110210192A (en) | Approaches to IM, device, equipment and readable storage medium storing program for executing | |
| CN115422202A (en) | Service model generation method, service data query method, device and equipment | |
| CN114936796A (en) | Project evaluation method and device, electronic equipment and computer readable medium | |
| JP5569438B2 (en) | Fuzzy description automatic detection apparatus and method | |
| KR101808953B1 (en) | Quality assurance server through plurality of end user and method of application program | |
| CN112306850A (en) | Test case generation method and device and storage medium | |
| Jeroncic | Improved utilization of self-inspection programs within the GMP environment-A quality risk management approach | |
| Baseer et al. | Quantitative Validation of Poka-Yoke Approach for HQLS Using Regression Coefficient and Analysis of Variance | |
| CN111352975B (en) | Data quality management method, client, server and system | |
| US20230046771A1 (en) | Automated collaboration analytics |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |