CN116910077A - Method, system, terminal equipment and computer storage medium for issuing data object - Google Patents

Method, system, terminal equipment and computer storage medium for issuing data object Download PDF

Info

Publication number
CN116910077A
CN116910077A CN202310937455.5A CN202310937455A CN116910077A CN 116910077 A CN116910077 A CN 116910077A CN 202310937455 A CN202310937455 A CN 202310937455A CN 116910077 A CN116910077 A CN 116910077A
Authority
CN
China
Prior art keywords
data
release
data object
target
scheme
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310937455.5A
Other languages
Chinese (zh)
Inventor
张景瑜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Merchants Bank Co Ltd
Original Assignee
China Merchants Bank Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Merchants Bank Co Ltd filed Critical China Merchants Bank Co Ltd
Priority to CN202310937455.5A priority Critical patent/CN116910077A/en
Publication of CN116910077A publication Critical patent/CN116910077A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • G06F9/546—Message passing systems or structures, e.g. queues
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30—Computing systems specially adapted for manufacturing

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The application discloses a data object publishing method, a system, terminal equipment and a computer readable storage medium, which relate to the technical field of data processing and comprise the following steps: acquiring a data object and generating a target release scheme based on the data type of the data object; determining a release object relation and a release time window corresponding to the data object based on the target release scheme, and generating a release task according to the release object relation and the release time window; and adding the release task to a target release queue for data release. The application can achieve the technical effect of improving the data release efficiency of the data release system.

Description

Method, system, terminal equipment and computer storage medium for issuing data object
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a method, a system, a terminal device, and a computer readable storage medium for publishing a data object.
Background
In the related art, in the process of publishing the data objects, the data publishing system performs data publishing operation in a unified publishing mode, however, because the requirements of different users on the data objects are inconsistent, in the process of publishing the data objects by the data publishing system, the users are required to perform risk analysis on the data objects by themselves based on the requirements of the users so as to ensure the quality of the data objects.
Thus, once the data distribution system distributes a large number of data objects at the same time, it is difficult for a user to perform risk analysis on the data objects, so that the data distribution efficiency of the data distribution system is reduced, and the quality of the distributed data objects is poor.
Disclosure of Invention
The application mainly aims to provide a data object publishing method, a system, terminal equipment and a computer readable storage medium, aiming at improving the data publishing efficiency of a data publishing system and further improving the quality of the data object.
In order to achieve the above object, the present application provides a method for publishing a data object, including:
acquiring a data object and generating a target release scheme based on the data type of the data object;
determining a release object relation and a release time window corresponding to the data object based on the target release scheme, and generating a release task according to the release object relation and the release time window;
and adding the release task to a target release queue for data release.
Further, the data types include: newly issued data and data to be updated;
the step of generating a target release scheme based on the data type of the data object includes:
If the data type of the data object is the newly released data, determining a production schedule corresponding to the data object, and generating a target release scheme based on the production schedule;
and if the data type of the data object is the data to be updated, determining the change content corresponding to the data object, and generating the target release scheme based on the change content.
Further, before the step of acquiring the data object, the method further comprises:
acquiring standard operation resources and a data release plan;
a plurality of initial issue queues are created, and load capacity is respectively configured for the plurality of initial issue queues based on the standard operation resources and the data issue plan to generate a plurality of target issue queues.
Further, before the step of determining the release object relationship and the release time window corresponding to the data object based on the target release scheme, the method further includes:
judging whether special characters are contained in the data object or not;
if the data object contains the special character, generating modification prompt information based on the special character;
and sending the modification prompt information to a user terminal generating the data object.
Further, the step of determining whether the data object contains a special character includes:
scanning the data object to obtain each coding character, and determining the coding rule corresponding to each coding character;
inquiring a preset standard rule database based on each coding rule to judge whether each coding rule contains an abnormal coding rule or not;
if judging that each coding rule contains the abnormal coding rule, determining that the data object contains special characters;
and if the abnormal coding rules are not contained in the coding rules, determining that the special characters are not contained in the data object.
Further, after the step of adding the publishing task to a target publishing queue for data publishing, the method further comprises:
generating an operation log corresponding to the release task, and judging whether the data object is successfully released or not based on the operation log;
and if the data object is judged to be unsuccessfully issued, acquiring a real-time adjustment scheme, and executing retry operation or rollback operation based on the real-time adjustment scheme.
Further, the real-time adjustment scheme includes a first adjustment scheme and a second adjustment scheme;
The step of performing a retry operation or a rollback operation based on the real-time adjustment scheme includes:
if the real-time adjustment scheme is the first adjustment scheme, adding the issuing task to the target issuing queue to execute retry operation;
or alternatively, the process may be performed,
and if the real-time adjustment scheme is the second adjustment scheme, acquiring a rollback range corresponding to the second adjustment scheme, acquiring a target script file in the data object based on the rollback range, and adding the target script file to the target issue queue to execute rollback operation.
In addition, to achieve the above object, the present application further provides a system for publishing a data object, the system comprising:
the scheme deployment module is used for acquiring a data object and generating a target release scheme based on the data type of the data object;
the task arrangement module is used for determining a release object relation and a release time window corresponding to the data object based on the target release scheme, and generating a release task according to the release object relation and the release time window;
and the data release module is used for adding the release task to a target release queue to release the data.
In addition, to achieve the above object, the present application also provides a terminal device including: the data object issuing method comprises the steps of a memory, a processor and a data object issuing program which is stored in the memory and can run on the processor, wherein the data object issuing program is executed by the processor to realize the data object issuing method.
In addition, in order to achieve the above object, the present application also provides a computer-readable storage medium having stored thereon a distribution program of a data object, which when executed by a processor, implements the steps of the data object distribution method as described above.
The method, the system, the terminal equipment and the computer readable storage medium for publishing the data object provided by the embodiment of the application generate a target publishing scheme by acquiring the data object and based on the data type of the data object; determining a release object relation and a release time window corresponding to the data object based on the target release scheme, and generating a release task according to the release object relation and the release time window; and adding the release task to a target release queue for data release.
In this embodiment, the terminal device first obtains a data object to be published, determines a data type corresponding to the data object, generates a corresponding target publishing scheme based on the data type, then determines a publishing object relationship corresponding to the data object based on the target publishing scheme, determines a publishing time window capable of publishing the data object based on the target publishing scheme, and finally generates a publishing task based on the publishing object relationship and the publishing time window, and adds the publishing task to a target publishing queue to perform data publishing operation.
In this way, by means of enabling the data release system to generate different release schemes for different data objects, the application solves the technical problems that when the data release system performs large-batch data release operation according to a unified release form in the current data release process, users are difficult to perform risk analysis for the data objects, so that the data release efficiency of the data release system is reduced, and the quality of the released data objects is poor, thereby achieving the technical effect of improving the data release efficiency of the data release system and further improving the quality of the data objects.
Drawings
Fig. 1 is a schematic structural diagram of a terminal device of a hardware running environment according to an embodiment of the present application;
FIG. 2 is a flowchart illustrating a first embodiment of a method for publishing a data object according to the present application;
FIG. 3 is a flowchart illustrating a second embodiment of a method for publishing a data object according to the present application;
FIG. 4 is a flowchart illustrating a third embodiment of a method for publishing a data object according to the present application;
FIG. 5 is a flowchart illustrating a fourth embodiment of a method for publishing a data object according to the present application;
FIG. 6 is a schematic diagram illustrating a flow chart of creating a release queue according to an embodiment of a method for releasing a data object of the present application;
FIG. 7 is a schematic diagram illustrating a failure adjustment flow according to an embodiment of a method for publishing a data object of the present application;
FIG. 8 is a schematic diagram of functional modules involved in an embodiment of a data object publishing system of the present application.
The achievement of the objects, functional features and advantages of the present application will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.
Referring to fig. 1, fig. 1 is a schematic diagram of a terminal device structure of a hardware running environment according to an embodiment of the present application.
It should be noted that, the terminal device in the embodiment of the present application may be a device for executing the publishing method of the data object in the present application, and the terminal device may specifically be a terminal device that includes a data publishing system inside and is capable of generating different publishing tasks based on the data type of the data object through the data publishing system.
As shown in fig. 1, the terminal device may include: a processor 1001, such as a central processing unit (Central Processing Unit, CPU), a communication bus 1002, a user interface 1003, a network interface 1004, a memory 1005. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a WIreless interface (e.g., a WIreless-FIdelity (WI-FI) interface). The Memory 1005 may be a high-speed random access Memory (Random Access Memory, RAM) Memory or a stable nonvolatile Memory (NVM), such as a disk Memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
It will be appreciated by those skilled in the art that the structure shown in fig. 1 does not constitute a limitation of the terminal device, and may include more or less components than illustrated, or may combine certain components, or may be arranged in different components.
As shown in fig. 1, an operating system, a data storage module, a network communication module, a user interface module, and a distribution program of data objects may be included in the memory 1005 as one type of storage medium.
In the terminal device shown in fig. 1, the network interface 1004 is mainly used for data communication with other devices; the user interface 1003 is mainly used for data interaction with a user; the processor 1001, the memory 1005 in the terminal device of the present application may be provided in the terminal device, which calls the distribution program of the data object stored in the memory 1005 through the processor 1001 and performs the following operations:
acquiring a data object and generating a target release scheme based on the data type of the data object;
determining a release object relation and a release time window corresponding to the data object based on the target release scheme, and generating a release task according to the release object relation and the release time window;
And adding the release task to a target release queue for data release.
Further, the data types include: newly issued data and data to be updated; the processor 1001 calls a publisher of the data object stored in the memory 1005, and also performs the following operations:
if the data type of the data object is the newly released data, determining a production schedule corresponding to the data object, and generating a target release scheme based on the production schedule;
and if the data type of the data object is the data to be updated, determining the change content corresponding to the data object, and generating the target release scheme based on the change content.
Further, the processor 1001 calls a release program of the data object stored in the memory 1005, and also performs the following operations:
acquiring standard operation resources and a data release plan;
a plurality of initial issue queues are created, and load capacity is respectively configured for the plurality of initial issue queues based on the standard operation resources and the data issue plan to generate a plurality of target issue queues.
Further, the processor 1001 calls a release program of the data object stored in the memory 1005, and also performs the following operations:
Judging whether special characters are contained in the data object or not;
if the data object contains the special character, generating modification prompt information based on the special character;
and sending the modification prompt information to a user terminal generating the data object.
Further, the processor 1001 calls a release program of the data object stored in the memory 1005, and also performs the following operations:
scanning the data object to obtain each coding character, and determining the coding rule corresponding to each coding character;
inquiring a preset standard rule database based on each coding rule to judge whether each coding rule contains an abnormal coding rule or not;
if judging that each coding rule contains the abnormal coding rule, determining that the data object contains special characters;
and if the abnormal coding rules are not contained in the coding rules, determining that the special characters are not contained in the data object.
Further, the processor 1001 calls a release program of the data object stored in the memory 1005, and also performs the following operations:
generating an operation log corresponding to the release task, and judging whether the data object is successfully released or not based on the operation log;
And if the data object is judged to be unsuccessfully issued, acquiring a real-time adjustment scheme, and executing retry operation or rollback operation based on the real-time adjustment scheme.
Further, the real-time adjustment scheme includes a first adjustment scheme and a second adjustment scheme; the processor 1001 calls a publisher of the data object stored in the memory 1005, and also performs the following operations:
if the real-time adjustment scheme is the first adjustment scheme, adding the issuing task to the target issuing queue to execute retry operation;
or alternatively, the process may be performed,
and if the real-time adjustment scheme is the second adjustment scheme, acquiring a rollback range corresponding to the second adjustment scheme, acquiring a target script file in the data object based on the rollback range, and adding the target script file to the target issue queue to execute rollback operation.
Based on the terminal equipment, the overall conception of the data object publishing method is provided.
In the current data release system, data release operation is often carried out in a unified release mode in the process of releasing the data objects, however, because the requirements of different users on the data objects are inconsistent, in the process of releasing the data objects by the data release system, the users are required to carry out risk analysis on the data objects by themselves based on the requirements of the users so as to ensure the quality of the data objects. Once the data distribution system distributes a large number of data objects at the same time, a user is difficult to analyze risk of the data objects, so that the data distribution efficiency of the data distribution system is reduced, and the quality of the distributed data objects is poor.
In view of the above phenomena, the present application proposes a method for publishing a data object, where the method for publishing a data object includes: acquiring a data object and generating a target release scheme based on the data type of the data object; determining a release object relation and a release time window corresponding to the data object based on the target release scheme, and generating a release task according to the release object relation and the release time window; and adding the release task to a target release queue for data release.
In this way, by means of enabling the data release system to generate different release schemes for different data objects, the application solves the technical problems that when the data release system performs large-batch data release operation according to a unified release form in the current data release process, users are difficult to perform risk analysis for the data objects, so that the data release efficiency of the data release system is reduced, and the quality of the released data objects is poor, thereby achieving the technical effect of improving the data release efficiency of the data release system and further improving the quality of the data objects.
Based on the above-mentioned overall conception of the terminal device and the method for publishing the data object of the present application, various embodiments of the method for publishing the data object of the present application are further presented.
Referring to fig. 2, fig. 2 is a flowchart illustrating a first embodiment of a method for publishing a data object according to the present application.
It should be understood that although a logical order is depicted in the flowchart, in some cases the method of publishing data objects of the present application may of course perform the steps shown or described in a different order than that which is depicted.
As shown in fig. 2, in this embodiment, the method for publishing a data object of the present application may include the following steps:
step S10: acquiring a data object and generating a target release scheme based on the data type of the data object;
in this embodiment, when a user needs to publish a data object, the data object may be edited by the user terminal, and input into the terminal device, so that when the data object is obtained, the terminal device inputs the data object into the internally configured data publish system, and the data publish system reads the data object through the internally configured scheme deployment module to determine a data type corresponding to the data object, and generates a target publish scheme corresponding to the data object based on the data type.
For example, when a user needs to publish a data code to a data platform, the data code is first determined to be a data object, and the data object is sent to a terminal device capable of data publish, the terminal device inputs the data object to an internally configured data publish system when acquiring the data object, the internally configured scheme deployment module is called by the data publish system to determine a data type corresponding to the data object, and a target publish scheme corresponding to the data object is determined based on the data type.
Further, the data types include: newly issued data and data to be updated; in a possible embodiment, the step of generating the target publication schema based on the data type of the data object in the step S10 may specifically include:
step S101: if the data type of the data object is the newly released data, determining a production schedule corresponding to the data object, and generating a target release scheme based on the production schedule;
in this embodiment, the data publishing system invokes an internally configured scheme deployment module to read a data object and determine a data type corresponding to the data object, and when the data publishing system determines that the data type corresponding to the data object is new published data through the scheme deployment module, the data publishing system further determines a usage scenario of the data object through the scheme deployment module and determines the usage scenario as a production schedule corresponding to the data object, and the data publishing system invokes the scheme deployment module to determine configuration information corresponding to the data object based on the production schedule and generate a target publishing scheme based on the configuration information.
Step S102: if the data type of the data object is the data to be updated, determining the change content corresponding to the data object, and generating the target release scheme based on the change content;
In this embodiment, when the data distribution system determines that the data type corresponding to the data object is data to be updated through the scheme deployment module, the data distribution system calls the scheme deployment module to further determine a version difference corresponding to the data object, and determines version change content corresponding to the data object based on the version difference, so that the data distribution system calls the scheme deployment module to generate a target distribution scheme corresponding to the data object based on the version change content.
For example, the data publishing system invokes the scheme deployment module to read the acquired data object and determine the data type corresponding to the data object, then, if the data type corresponding to the data object is determined to be newly released data by the scheme deployment module, the data publishing system determines that the data type corresponding to the data object is newly released data, the data publishing system invokes the scheme deployment module to further determine a usage scenario corresponding to the data object, thereby determining a production rule corresponding to the data object, and determining configuration information such as configuration data, risk detection data, code release time, code running time and the like corresponding to the data object based on the production rule, and the data publishing system invokes the scheme deployment module to generate a refinement processing policy based on each configuration information and generate a corresponding target release scheme based on the refinement processing policy;
And if the data is determined to be the descriptive content change data, the management type content change data or the model newly added list change data by the scheme deployment module, the data release system determines the data type corresponding to the data object to be updated, the data release system calls the scheme deployment module to compare the data object with the target data with deployment relation of the data object so as to determine version difference, and determines version change content based on the version difference, then the data release system calls the scheme deployment module to grade the version change content so as to obtain a change content grade, the data release system determines the update degree based on the change content grade, and generates a target release scheme with the smallest triggering variation and the fastest execution speed in the release execution process based on the change content grade.
Step S20: determining a release object relation and a release time window corresponding to the data object based on the target release scheme, and generating a release task according to the release object relation and the release time window;
in this embodiment, the data publishing system reads the generated target publishing scheme through the internally configured task orchestration module, so as to determine, based on the target publishing scheme, that the data needs to deploy the target data of the data object, so as to determine a publishing object relationship corresponding to the data object, and at the same time, the data publishing system reads the target publishing scheme through the task orchestration module, so as to determine a publishing time window corresponding to the data object, and generates a publishing task corresponding to the data object based on the publishing object relationship and the publishing time window.
For example, the data publishing system reads the generated target publishing scheme through an internally configured task orchestration module, so that the target data of the data object needs to be deployed based on the target publishing scheme to determine the publishing object relation corresponding to the data object, the data publishing system further calls the task orchestration module to generate a dependency graph based on the publishing object relation, and the data object with consistent publishing object relation in the plurality of data objects is serialized based on the dependency graph, meanwhile, the data publishing system calls the task orchestration module to read the target publishing scheme to determine a publishing time window capable of publishing the data object, and then the data publishing system calls the task orchestration module to process the serialized data object based on the publishing time window to generate the publishing task.
Step S30: adding the release task to a target release queue to release data;
in this embodiment, the data issuing system calls the internally configured data issuing module to add the generated issuing task to the target issuing queue, and the data issuing system sequentially processes the issuing tasks contained in the target issuing queue to issue data.
In this embodiment, when a user needs to publish a data object, the data object may be edited by a user terminal, and the data object is input to a terminal device, so that when the data object is acquired, the terminal device inputs the data object to an internally configured data publish system, the data publish system reads the data object through an internally configured scheme deployment module to determine a data type corresponding to the data object, and generates a target publish scheme corresponding to the data object based on the data type, then the data publish system reads the generated target publish scheme through an internally configured task orchestration module, so that the target data of the data object needs to be deployed based on the target publish scheme to determine a publish object relationship corresponding to the data object, and meanwhile, the data publish system reads the target publish scheme through a task orchestration module to determine a publish time window corresponding to the data object, generates a publish task corresponding to the data object based on the publish object relationship and the publish time window, and finally, the data publish system calls the internally configured data publish module to add the generated publish task to a target publish queue, and the data publish system sequentially processes the publish task included in the target publish queue to publish the data.
In this way, by means of enabling the data release system to generate different release schemes for different data objects, the application solves the technical problems that when the data release system performs large-batch data release operation according to a unified release form in the current data release process, users are difficult to perform risk analysis for the data objects, so that the data release efficiency of the data release system is reduced, and the quality of the released data objects is poor, thereby achieving the technical effect of improving the data release efficiency of the data release system and further improving the quality of the data objects.
Further, based on the first embodiment of the publishing method of the data object of the present application described above, a second embodiment of the publishing method of the data object of the present application is presented herein.
Referring to fig. 3, fig. 3 is a flowchart illustrating a second embodiment of a method for publishing a data object according to the present application. As shown in fig. 3, before the step S10, the method for publishing a data object of the present application may further include the steps of:
step A10: acquiring standard operation resources and a data release plan;
in this embodiment, the data distribution system first obtains standard operation resources of the terminal device, and reads a storage module configured in the terminal device to obtain a preset data distribution plan.
Step A20: creating a plurality of initial release queues, and respectively configuring load capacity for the plurality of initial release queues based on the standard operation resources and the data release plan to generate a plurality of target release queues;
in this embodiment, the data distribution system creates a plurality of initial distribution queues, and determines load capacities corresponding to the plurality of initial distribution queues respectively based on the obtained standard operation resources and the data distribution plan, so that the data distribution system distributes the load capacities to the plurality of initial distribution queues respectively to generate a plurality of target distribution queues.
For example, referring to fig. 6, fig. 6 is a schematic diagram of a release queue creation flow according to an embodiment of a data object release method of the present application, as shown in fig. 6, a data release system first creates a plurality of initial release queues and obtains standard operation resources corresponding to a terminal device, and meanwhile, the data release system reads a storage module configured in the terminal device to obtain a preset data release plan corresponding to a current day, and then, the data release system determines load capacities corresponding to the plurality of initial release queues respectively based on the data release plan and the standard operation resources, and configures the load capacities corresponding to the plurality of initial release queues respectively, so as to generate a plurality of target release queues, and finally, the data release system starts a queue management process and automatically polls the plurality of target release queues to execute release tasks contained in the target release queues when performing data release tasks.
In this embodiment, the data release system first obtains standard operation resources of the terminal device, reads a storage module configured in the terminal device to obtain a preset data release plan, then creates a plurality of initial release queues, and determines load capacities corresponding to the plurality of initial release queues respectively based on the obtained standard operation resources and the data release plan, and the data release system allocates the load capacities to the plurality of initial release queues respectively to generate a plurality of target release queues.
Therefore, in the running process of the data release system, the release queue can be more reasonably constructed based on the running resources of the terminal equipment and the data release plan, so that the efficiency of data release is improved.
Further, based on the first embodiment and/or the second embodiment of the publishing method of the data object of the present application, a third embodiment of the publishing method of the data object of the present application is provided herein.
Referring to fig. 4, fig. 4 is a flowchart illustrating a third embodiment of a method for publishing a data object according to the present application. As shown in fig. 4, before the step S20, the method for publishing a data object of the present application may further include the steps of:
Step B10: judging whether special characters are contained in the data object or not;
in this embodiment, before the data issuing system reads the target issuing scheme, the obtained data object is first input into the issuing specification checking module configured in the terminal device, so that the issuing specification checking module is invoked to scan the data object to determine whether the data object contains a special character.
Step B20: if the data object contains the special character, generating modification prompt information based on the special character;
in this embodiment, if the data publishing system invokes the publish specification check module to determine that the data object includes a special character, a modification hint message is generated based on the special character.
Step B30: transmitting the modification prompt information to a user terminal generating the data object;
in this embodiment, the data distribution system transmits the generated modification prompt information to the user terminal that sent the data object.
For example, before the data issuing system reads the target issuing scheme, the data issuing system firstly inputs the acquired data object into the issuing specification checking module configured by the terminal device, so as to call the issuing specification checking module to scan the input data object to determine whether the data object contains special characters, then, if the data issuing system calls the issuing specification checking module to determine that the data object contains the special characters, the data issuing system generates modification prompt information based on the special characters, and finally, the data issuing system sends the modification prompt information to a user terminal sending the data object, so that a user can modify the data object based on the modification prompt information through the user terminal to modify the special characters contained in the data object.
Further, in a possible embodiment, the step B10 may specifically include:
step B101: scanning the data object to obtain each coding character, and determining the coding rule corresponding to each coding character;
in this embodiment, the data distribution system invokes the distribution specification inspection module to scan the acquired data object, thereby identifying each coding character contained in the data object, and determining the coding rule corresponding to each coding character.
Step B102: inquiring a preset standard rule database based on each coding rule to judge whether each coding rule contains an abnormal coding rule or not;
in this embodiment, the data distribution system reads the storage module to obtain a standard rule database containing a plurality of standard coding rules, and invokes a distribution specification checking module to query the standard rule database based on each obtained coding rule, so as to determine whether each coding rule contains an abnormal coding rule inconsistent with each standard coding rule.
Step B103: if judging that each coding rule contains the abnormal coding rule, determining that the data object contains special characters;
In this embodiment, if the issuing rule checking module is called by the data issuing system to determine that each encoding rule includes an abnormal encoding rule inconsistent with each standard encoding rule, the encoding character corresponding to the abnormal encoding rule in the data object is determined to be a special character.
Step B104: if the abnormal coding rules are not contained in the coding rules, determining that the special characters are not contained in the data object;
in this embodiment, if the issuing rule checking module is called by the data issuing system to determine that each encoding rule does not include the abnormal encoding rule, the data issuing system determines that the data object does not include a special character.
For example, the data issuing system firstly invokes the issuing rule detection module to scan the obtained data object so as to obtain all the coding characters contained in the data, and determines the coding rules corresponding to the coding characters respectively through the issuing rule detection module, meanwhile, the data issuing system reads the storage module so as to obtain a standard rule database which is stored in advance by a technician and contains the standard coding rules, and invokes the issuing rule detection module to inquire the standard rule database based on the obtained coding rules, so that the coding rules are respectively compared with the standard coding rules contained in the standard rule database to obtain comparison results, and whether abnormal coding rules which are inconsistent with the standard coding rules exist in the coding rules is judged based on the comparison results;
And if the data release system judges that the coding rules do not contain the abnormal coding rules consistent with the standard coding rules through the release rule checking module, the data release system determines the coding characters corresponding to the abnormal coding rules in the data object as special characters, and if the data release system judges that the coding rules do not contain the abnormal coding rules through the release rule checking module, the data release system determines that the coding characters in the data object conform to the standard coding rules, and further determines that the data object does not contain the special characters.
In this embodiment, before the data issuing system reads the target issuing scheme, the obtained data object is first input into the issuing specification checking module configured in the terminal device, so as to invoke the issuing specification checking module to scan the data object to determine whether the data object contains a special character, then, if the issuing specification checking module is invoked to determine that the data object contains a special character, the data issuing system generates a modification prompt message based on the special character, and finally, the data issuing system sends the generated modification prompt message to the user terminal that sends the data object.
Therefore, before the target release scheme is generated, the data release system can accurately judge whether the data object contains special characters such as error characters and messy codes, and timely generate modification prompt information for reference of a user when the data object is determined to contain the special characters, so that the data release efficiency is improved.
Further, based on the above embodiments of the method for publishing a data object of the present application, a fourth embodiment of the method for publishing a data object of the present application is presented herein.
Referring to fig. 5, fig. 5 is a flowchart illustrating a fourth embodiment of a method for publishing a data object according to the present application. As shown in fig. 5, after the above step S30, the publishing method of the data object of the present application may further include the steps of:
step C10: generating an operation log corresponding to the release task, and judging whether the data object is successfully released or not based on the operation log;
in this embodiment, in the process of data release, the data release system invokes the data release module to record an operation log in the data release process, and determines whether the release of the data object is completed successfully based on the operation log.
Step C20: if the data object is judged to be unsuccessfully issued, acquiring a real-time adjustment scheme, and executing retry operation or rollback operation based on the real-time adjustment scheme;
in this embodiment, if the data distribution system calls the data distribution module to determine that the data object is not successfully distributed, the data distribution system generates an adjustment option and sends the adjustment option to the user terminal to determine a real-time adjustment scheme selected by the user, and the data distribution system calls the data distribution module to execute a retry operation or a rollback operation based on the real-time adjustment scheme.
For example, in the process of data release, the data release system calls a data release module to record data release operation so as to obtain an operation log, judges whether a data object is successfully released based on the operation log, then, if the data release module is called to judge that the data object is not successfully released, the data release system adds a failure mark to a release task corresponding to the data object, records the failure log, thereby generating an adjustment option based on the failure log, the data release system sends the adjustment option to a user terminal, determines a real-time adjustment scheme selected by a user based on the adjustment option, and finally, the data release system calls the data release module to execute retry operation or rollback operation based on the real-time adjustment scheme.
Further, the real-time adjustment scheme includes a first adjustment scheme and a second adjustment scheme, and in a possible embodiment, the step of performing a retry operation or a rollback operation based on the real-time adjustment scheme in the step C20 may specifically include:
step C201: if the real-time adjustment scheme is the first adjustment scheme, adding the issuing task to the target issuing queue to execute retry operation;
In this embodiment, if the data issuing module is called to determine that the real-time adjustment scheme selected by the user is the first adjustment scheme, the data issuing system re-adds the failed issuing task to the target issuing queue, and continues to execute the data issuing operation on the issuing task included in the target issuing queue to complete the retry operation.
Step C201: if the real-time adjustment scheme is the second adjustment scheme, acquiring a rollback range corresponding to the second adjustment scheme, acquiring a target script file in the data object based on the rollback range, and adding the target script file to the target issue queue to execute rollback operation;
in this embodiment, if the data issuing system invokes the data issuing module to determine that the real-time adjustment scheme selected by the user is the second adjustment scheme, the data issuing system further determines a rollback range corresponding to the second adjustment scheme, determines a target script file in the data object based on the rollback range, and invokes the data issuing module to re-add the target script file into the target issuing queue to execute the rollback operation, and further, after the rollback operation is completed, the data issuing system adds an end mark to the issuing task corresponding to the data object.
For example, referring to fig. 7, fig. 7 is a schematic diagram of a failure adjustment flow related to an embodiment of a data object publishing method of the present application, as shown in fig. 7, when a data publishing system executes a data publishing task, a data publishing module is called to read an operation log to determine whether data is successfully published, then if the data publishing system is called to call the data publishing module to determine that the data is not successfully published, an adjustment option including a first adjustment scheme and a second adjustment scheme is generated, a user selects the first adjustment scheme or the second adjustment scheme through the adjustment option, and then if the data publishing module is called to determine that a real-time adjustment scheme selected by the user is the first adjustment scheme, the user selects to execute a retry operation, so that the publishing task with failed publishing is added to a corresponding target publishing queue again, and then the data publishing operation is executed on the publishing task included in the target publishing queue to complete the retry operation;
or alternatively, the process may be performed,
and if the data release system calls the data release module to determine that the real-time adjustment scheme selected by the user is the second adjustment scheme, determining that the user selects to execute the rollback operation, further determining that the rollback range selected by the user is the whole rollback according to batches or is an object with rollback failure only, then, calling the data release module by the data release system to generate a rollback task based on the rollback range selected by the user, determining an undo script corresponding to the rollback task in the data object, adding the undo script into the rollback task, finally, calling the data release module by the data release system to add the rollback task into a target release queue, executing the rollback task contained in the target release queue to complete the rollback operation, and further adding an end mark to the rollback task after the rollback operation is completed.
It should be noted that, in this embodiment and another embodiment, when the data publishing system completes the rollback operation, if the user needs to reissue the data object that has performed the rollback task, the user needs to reissue the data publishing operation through the data publishing system to publish the data object.
In this embodiment, in the process of data distribution, the data distribution system invokes the data distribution module to record an operation log of the data distribution process, and determines whether the data object is successfully distributed based on the operation log, after that, if the data distribution system invokes the data distribution module to determine that the data object is not successfully distributed, the data distribution system generates an adjustment option, and sends the adjustment option to the user terminal, so as to determine a real-time adjustment scheme selected by the user, and the data distribution system invokes the data distribution module to execute a retry operation or a rollback operation based on the real-time adjustment scheme.
Therefore, when the data release system is performing data release operation, if the release task fails, the user can determine the reason of the task failure based on the operation log and execute corresponding retry operation or rollback operation, so that the data release efficiency is improved.
In addition, in order to achieve the above objective, the present application further provides a system for publishing a data object, please refer to fig. 8, fig. 8 is a schematic diagram of functional modules related to an embodiment of the system for publishing a data object of the present application, as shown in fig. 8, the system includes:
the scheme deployment module 10 is used for acquiring a data object and generating a target release scheme based on the data type of the data object;
the task orchestration module 20 is configured to determine a release object relationship and a release time window corresponding to the data object based on the target release scheme, and generate a release task according to the release object relationship and the release time window;
and the data release module 30 is used for adding the release task to a target release queue for data release.
Further, the data types include: newly issued data and data to be updated; scheme deployment module 10, comprising:
the first generation unit is used for determining a production schedule corresponding to the data object if the data type of the data object is the newly released data, and generating a target release scheme based on the production schedule;
and the second generation unit is used for determining the change content corresponding to the data object if the data type of the data object is the data to be updated, and generating the target release scheme based on the change content.
Further, the solution deployment module 10 further includes:
the plan acquisition unit is used for acquiring standard operation resources and a data release plan;
and the queue construction unit is used for creating a plurality of initial release queues and respectively configuring load capacity for the plurality of initial release queues based on the standard operation resources and the data release plan so as to generate a plurality of target release queues.
Further, the task orchestration module 20 includes:
a character detection unit for judging whether the data object contains special characters or not;
the prompt generation unit is used for generating modification prompt information based on the special characters if the special characters are judged to be contained in the data object;
and the prompt sending unit is used for sending the modification prompt information to the user terminal generating the data object.
Further, the character detection unit includes:
the data scanning subunit is used for scanning the data object to obtain each coding character and determining the coding rule corresponding to each coding character;
the rule query subunit is used for querying a preset standard rule database based on each coding rule so as to judge whether each coding rule contains an abnormal coding rule or not;
A first judging subunit, configured to determine that the data object contains a special character if it is judged that each of the encoding rules contains the abnormal encoding rule;
and the second judging subunit is used for determining that the special character is not contained in the data object if judging that the abnormal coding rule is not contained in each coding rule.
Further, the real-time adjustment scheme includes a first adjustment scheme and a second adjustment scheme; the data distribution module 30 includes:
the result judging unit is used for generating an operation log corresponding to the issuing task and judging whether the data object is successfully issued or not based on the operation log;
and the adjustment execution unit is used for acquiring a real-time adjustment scheme if the data object is judged to be unsuccessfully issued, and executing retry operation or rollback operation based on the real-time adjustment scheme.
Further, the adjusting execution unit includes:
a retry execution subunit, configured to add the issue task to the target issue queue to execute a retry operation if the real-time adjustment scheme is the first adjustment scheme;
and the rollback execution subunit is used for acquiring a rollback range corresponding to the second adjustment scheme if the real-time adjustment scheme is the second adjustment scheme, acquiring a target script file in the data object based on the rollback range, and adding the target script file to the target issue queue to execute rollback operation.
In addition, the application also provides a terminal device, the terminal device is provided with a release program of the data object which can run on a processor, and the terminal device realizes the steps of the data object release method according to any one of the embodiments when executing the release program of the data object.
The specific embodiment of the terminal device of the present application is basically the same as each embodiment of the method for publishing the data object described above, and will not be described herein.
Furthermore, the present application provides a computer readable storage medium, on which a data object publishing program is stored, which when executed by a processor, implements the steps of the data object publishing method according to any one of the above embodiments.
The specific embodiments of the computer readable storage medium of the present application are substantially the same as the embodiments of the method for publishing data objects described above, and will not be described herein.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present application are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present application.
The foregoing description is only of the preferred embodiments of the present application, and is not intended to limit the scope of the application, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.

Claims (10)

1. A method for publishing a data object, the method comprising:
acquiring a data object and generating a target release scheme based on the data type of the data object;
determining a release object relation and a release time window corresponding to the data object based on the target release scheme, and generating a release task according to the release object relation and the release time window;
and adding the release task to a target release queue for data release.
2. The method of claim 1, wherein the data type comprises: newly issued data and data to be updated;
the step of generating a target release scheme based on the data type of the data object includes:
if the data type of the data object is the newly released data, determining a production schedule corresponding to the data object, and generating a target release scheme based on the production schedule;
and if the data type of the data object is the data to be updated, determining the change content corresponding to the data object, and generating the target release scheme based on the change content.
3. The method of publishing a data object of claim 1, wherein prior to the step of retrieving a data object, the method further comprises:
Acquiring standard operation resources and a data release plan;
a plurality of initial issue queues are created, and load capacity is respectively configured for the plurality of initial issue queues based on the standard operation resources and the data issue plan to generate a plurality of target issue queues.
4. The method of publishing a data object of claim 1, wherein prior to the step of determining a publication object relationship and a publication time window corresponding to the data object based on the target publication schema, the method further comprises:
judging whether special characters are contained in the data object or not;
if the data object contains the special character, generating modification prompt information based on the special character;
and sending the modification prompt information to a user terminal generating the data object.
5. The method of claim 4, wherein the step of determining whether the special character is contained in the data object comprises:
scanning the data object to obtain each coding character, and determining the coding rule corresponding to each coding character;
inquiring a preset standard rule database based on each coding rule to judge whether each coding rule contains an abnormal coding rule or not;
If judging that each coding rule contains the abnormal coding rule, determining that the data object contains special characters;
and if the abnormal coding rules are not contained in the coding rules, determining that the special characters are not contained in the data object.
6. The method of publishing a data object of claim 1, wherein after the step of adding the publishing task to a target publish queue for data publication, the method further comprises:
generating an operation log corresponding to the release task, and judging whether the data object is successfully released or not based on the operation log;
and if the data object is judged to be unsuccessfully issued, acquiring a real-time adjustment scheme, and executing retry operation or rollback operation based on the real-time adjustment scheme.
7. The method of claim 6, wherein the real-time adjustment scheme comprises a first adjustment scheme and a second adjustment scheme;
the step of performing a retry operation or a rollback operation based on the real-time adjustment scheme includes:
if the real-time adjustment scheme is the first adjustment scheme, adding the issuing task to the target issuing queue to execute retry operation;
Or alternatively, the process may be performed,
and if the real-time adjustment scheme is the second adjustment scheme, acquiring a rollback range corresponding to the second adjustment scheme, acquiring a target script file in the data object based on the rollback range, and adding the target script file to the target issue queue to execute rollback operation.
8. A system for publishing data objects, the system comprising:
the scheme deployment module is used for acquiring a data object and generating a target release scheme based on the data type of the data object;
the task arrangement module is used for determining a release object relation and a release time window corresponding to the data object based on the target release scheme, and generating a release task according to the release object relation and the release time window;
and the data release module is used for adding the release task to a target release queue to release the data.
9. A terminal device, characterized in that the terminal device comprises: memory, a processor and a distribution program for data objects stored on the memory and executable on the processor, which distribution program for data objects, when executed by the processor, implements the steps of the method for distribution of data objects according to any of claims 1 to 7.
10. A computer-readable storage medium, on which a distribution program of data objects is stored, which, when executed by a processor, implements the steps of the data object distribution method according to any of claims 1 to 7.
CN202310937455.5A 2023-07-27 2023-07-27 Method, system, terminal equipment and computer storage medium for issuing data object Pending CN116910077A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310937455.5A CN116910077A (en) 2023-07-27 2023-07-27 Method, system, terminal equipment and computer storage medium for issuing data object

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310937455.5A CN116910077A (en) 2023-07-27 2023-07-27 Method, system, terminal equipment and computer storage medium for issuing data object

Publications (1)

Publication Number Publication Date
CN116910077A true CN116910077A (en) 2023-10-20

Family

ID=88364593

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310937455.5A Pending CN116910077A (en) 2023-07-27 2023-07-27 Method, system, terminal equipment and computer storage medium for issuing data object

Country Status (1)

Country Link
CN (1) CN116910077A (en)

Similar Documents

Publication Publication Date Title
US20060190569A1 (en) Facilitating mobile device awareness of the availability of new or updated server-side applications
US20170123777A1 (en) Deploying applications on application platforms
CN111026670B (en) Test case generation method, test case generation device and storage medium
CN110717739B (en) Workflow publishing method, device, equipment and computer readable storage medium
CN111309593A (en) JSON interface verification method, device and equipment and computer readable storage medium
CN114546592A (en) Model deployment evaluation method, server, electronic device and storage medium
CN110609755A (en) Message processing method, device, equipment and medium for cross-block chain node
CN111475390A (en) Log collection system deployment method, device, equipment and storage medium
CN111400102A (en) Application program change monitoring method, device, equipment and storage medium
CN113687858A (en) Configuration file checking method and device, electronic equipment and storage medium
CN110737548B (en) Data request method and server
WO2021093672A1 (en) Method for embedding external system, workflow system, device and computer readable storage medium
CN110231921B (en) Log printing method, device, equipment and computer readable storage medium
CN116910077A (en) Method, system, terminal equipment and computer storage medium for issuing data object
CN111158889A (en) Batch task processing method and system
CN116149829A (en) Task management method, device, equipment and storage medium
CN111857736B (en) Cloud computing product generation method, device, equipment and storage medium
CN111078571B (en) Test method for analog response, terminal equipment and computer readable storage medium
CN111030874B (en) Service arranging method, equipment, storage medium and device
CN113326052A (en) Method and device for upgrading service component, computer equipment and storage medium
CN112416384A (en) Software upgrading method and device and computer equipment
CN113448818B (en) Log tracking method, device and medium based on probability
CN114095495B (en) Terminal control method, device, storage medium and apparatus
CN114253441B (en) Method and device for enabling target function, storage medium and electronic device
CN111151008B (en) Verification method and device for game operation data, configuration background and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination