CN114416113A - Containerization-based data release system, method and device - Google Patents
Containerization-based data release system, method and device Download PDFInfo
- Publication number
- CN114416113A CN114416113A CN202111665796.9A CN202111665796A CN114416113A CN 114416113 A CN114416113 A CN 114416113A CN 202111665796 A CN202111665796 A CN 202111665796A CN 114416113 A CN114416113 A CN 114416113A
- Authority
- CN
- China
- Prior art keywords
- data packet
- management platform
- database
- preset
- data packets
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/50—Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Transfer Between Computers (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a containerization-based data release system, a method and a device, wherein the system comprises an operation management platform, a release management platform and a client; the operation management platform is used for acquiring the service components, packaging the service components into original data packets, and sending the issuing scheme and the data packets which are subpackaged to the containers to the issuing management platform; the release management platform is used for receiving the release scheme sent by the operation management platform and the data packets distributed to the plurality of containers; storing the data packets which are subpackaged to the containers into a local or preset first database according to the release scheme; the client is used for sending an application rendering request to the release management platform and receiving the searched data packet. The embodiment of the invention is provided with the operation management platform and the release management platform, so that the content is definitely provided and released, the operation management platform adopts a combined content development and customization mode, the content providing efficiency is higher, and the release management platform accelerates the rendering speed by reducing the repeated request loading of the rendering content.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a containerization-based data distribution system, a containerization-based data distribution method, and a containerization-based data distribution apparatus.
Background
As the web technology framework and the development language are continuously updated and iterated, front-end rendering methods also become diversified, but the prior art considers how to improve the use efficiency of the system in pursuing the improvement of the interactive performance. For example, a third party template is used to upload and render code for all users bound under the client publishing platform. Although the system use efficiency is improved in the aspect of uniform implementation, the rendering mode is limited by the number of templates, the whole package is integrally issued during rendering, the bearing capacity in the whole package is relatively excessive, the problems of slow loading and application and loading failure of a user occur, and the requirements of user personalized requirements and differentiated service design are not met for diversified application scenes by the rendering mode.
At present, in the prior art, a method for uniformly packaging and then issuing code files meets the personalized requirements of users, and reduces the probability of issuing failure caused by overlarge packet body. And adopt and preset the logic module and need to occupy certain computational resource, receive the influence of calculation time on the timeliness of responding to user's request, the release adopted is to sacrifice the functional integrity and shrink the size of the packet too, and the landability of the method is relatively bad, therefore, while using on the system, the efficiency of providing the content is not high, and the time of rendering will be relatively long.
Disclosure of Invention
In view of the above problems, embodiments of the present invention are proposed to provide a containerization-based data distribution system, a containerization-based data distribution method, and a corresponding containerization-based data distribution apparatus that overcome or at least partially solve the above problems.
In order to solve the above problem, an embodiment of the present invention discloses a containerization-based data distribution system, including: the system comprises an operation management platform, a release management platform and a client;
the operation management platform is used for acquiring service components for making service contents according to operation requirements, respectively packaging the service components into original data packets, and generating the original data packets into a plurality of candidate data packets; packing the original data packet and the candidate data packets into a plurality of containers; generating a publishing scheme according to the user group and the data packets which are distributed to the plurality of containers; sending the issuing scheme and the data packets which are distributed to the plurality of containers to an issuing management platform;
the release management platform is used for receiving the release scheme sent by the operation management platform and the data packets distributed to the containers; storing the data packets which are distributed to the plurality of containers into a local or preset first database according to the release scheme;
and the client is used for sending an application rendering request to the release management platform and receiving the searched data packet.
Optionally, the system comprises: the release management platform is used for preferentially searching a data packet matched with the application rendering request from the local and sending the searched data packet to the client when receiving the application rendering request sent by the client; if the data packet matched with the application rendering request cannot be searched locally, searching the data packet matched with the application rendering request from the preset first database, and sending the searched data packet to the client; and if the data packet matched with the application rendering request cannot be searched in the preset first database, searching the data packet matched with the application rendering request from a preset second database, and sending the searched data packet to the client.
Optionally, the system further comprises: the release management platform is further configured to store the found data packet to the preset first database and perform rendering display in the client if the data packet matching the application rendering request is found in a preset second database; and if the data packet matched with the application rendering request is found in the preset first database, storing the found data packet to the local, and rendering and displaying in the client.
The embodiment of the invention also discloses a containerization-based data release method, which is applied to an operation management platform and comprises the following steps:
acquiring a plurality of service components for making service content according to operation requirements;
respectively packaging the plurality of service components into original data packets, and generating the original data packets into a plurality of candidate data packets;
packing the original data packet and the candidate data packets into a plurality of containers;
generating a publishing scheme according to the user group and the data packets which are distributed to the plurality of containers;
and sending the issuing scheme and the data packets which are distributed to the plurality of containers to an issuing management platform.
The embodiment of the invention also discloses a containerization-based data release method, which is applied to a release management platform and comprises the following steps:
receiving a release scheme sent by an operation management platform and data packets subpackaged to a plurality of containers;
storing the data packets which are distributed to the plurality of containers into a local or preset first database according to the release scheme;
when an application rendering request sent by a client is received, preferentially searching a data packet matched with the application rendering request from the local, and sending the searched data packet to the client;
if the data packet matched with the application rendering request cannot be searched locally, searching the data packet matched with the application rendering request from the preset first database, and sending the searched data packet to the client;
and if the data packet matched with the application rendering request cannot be searched in the preset first database, searching the data packet matched with the application rendering request from the preset second database, and sending the searched data packet to the client.
Optionally, the method further comprises:
if the data packet matched with the application rendering request is found in a preset second database, storing the found data packet to the preset first database;
and if the data packet matched with the application rendering request is found in the preset first database, storing the found data packet to the local.
The embodiment of the invention also discloses a containerization-based data release device, which is applied to an operation management platform and comprises the following components:
the component acquisition module is used for acquiring a plurality of business components for making service contents according to operation requirements;
a data packet generating module, configured to encapsulate the multiple service components into original data packets, and generate the original data packets into multiple candidate data packets;
a data packet packing module, configured to pack the original data packet and the candidate data packets into a plurality of containers;
the operation generation module is used for generating a release scheme according to the user group and the data packets which are distributed to the containers in a split mode;
and the operation sending module is used for sending the publishing scheme and the data packets which are distributed to the plurality of containers to a publishing management platform.
The embodiment of the invention also discloses a containerization-based data release device, which is applied to a release management platform and comprises the following components:
the release receiving module is used for receiving a release scheme sent by the operation management platform and data packets subpackaged to a plurality of containers;
the release storage module is used for storing the data packets which are subpackaged to the plurality of containers into a local or preset first database according to the release scheme;
the system comprises a first searching module, a second searching module and a third searching module, wherein the first searching module is used for preferentially searching a data packet matched with an application rendering request from the local and sending the searched data packet to a client when the application rendering request sent by the client is received;
the second searching module is used for searching the data packet matched with the application rendering request from the preset first database and sending the searched data packet to the client side if the data packet matched with the application rendering request cannot be searched locally;
and the third searching module is used for searching the data packet matched with the application rendering request from the preset second database and sending the searched data packet to the client when the data packet matched with the application rendering request cannot be searched in the preset first database.
Optionally, the apparatus further comprises:
the first storage module is used for storing the searched data packet to a preset first database if the data packet matched with the application rendering request is searched in a preset second database;
and the second storage module is used for storing the searched data packet to the local part if the data packet matched with the application rendering request is searched in a preset first database.
The embodiment of the invention also discloses electronic equipment which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory finish mutual communication through the communication bus;
the memory is used for storing a computer program;
the processor is configured to implement the method according to the embodiment of the present invention when executing the program stored in the memory.
Also disclosed are one or more computer-readable media having instructions stored thereon, which, when executed by one or more processors, cause the processors to perform a method according to an embodiment of the invention.
The embodiment of the invention has the following advantages:
in the embodiment of the invention, the operation management platform is used for acquiring the service components for making the service content according to the operation requirement, respectively packaging the plurality of service components into the original data packets, and generating the original data packets into a plurality of candidate data packets; packing the original data packet and a plurality of candidate data packets into a plurality of containers; generating a publishing scheme according to the user group and the data packets which are distributed to the plurality of containers; sending the issuing scheme and the data packets which are distributed to the plurality of containers to an issuing management platform; the release management platform is used for receiving the release scheme sent by the operation management platform and the data packets subpackaged to the containers; storing the data packets which are distributed to the plurality of containers into a local or preset first database according to the release scheme; and the client is used for sending the application rendering request to the release management platform and receiving the searched data packet. The embodiment of the invention is respectively provided with the operation management platform and the release management platform, so that the content supply and release are clear, and the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the release management platform accelerates the rendering speed by reducing the repeated request loading of the rendering content.
Drawings
Fig. 1 is a block diagram of a containerization-based data distribution system according to an embodiment of the present invention;
fig. 2 is an architecture diagram of an operation management platform, a release management platform, and a client according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating steps of a containerization-based data distribution method according to an embodiment of the present invention;
FIG. 4 is a flowchart illustrating steps of another containerization-based data distribution method according to an embodiment of the present invention;
FIG. 5 is a diagram of a matching center logic process provided by an embodiment of the present invention;
FIG. 6 is a flowchart of an issue execution process provided by an embodiment of the present invention;
fig. 7 is a block diagram of a containerization-based data distribution apparatus according to an embodiment of the present invention;
fig. 8 is a block diagram of a containerization-based data distribution apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
One of the core ideas of the embodiment of the invention is that the providing and the publishing of the content are defined by respectively arranging an operation management platform and a publishing management platform, so that the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the release management platform accelerates the rendering speed by reducing the repeated request loading of the rendering content.
Referring to fig. 1, a block diagram of a containerization-based data distribution system according to an embodiment of the present invention is shown, where the system includes: an operation management platform 101, a release management platform 102 and a client 103;
the operation management platform 101 is configured to acquire service components for making service content according to operation requirements, package the service components into original data packets, and generate the original data packets into candidate data packets; packing the original data packet and the candidate data packets into a plurality of containers; generating a publishing scheme according to the user group and the data packets which are distributed to the plurality of containers; sending the issuing scheme and the data packets which are distributed to the plurality of containers to an issuing management platform;
illustratively, the operation management platform is a working platform for making business content, publishing content and formulating a scheme, and the publishing management platform is a set of publishing systems for formulating a publishing rule and realizing the publishing rule. The operator is responsible for designing and updating the provided content, and the developer is responsible for realizing the content provision and designing the release scheme. And the user determines the updating condition of the rendering container package through an algorithm and a check rule through the rendering space provided by the client, so that the optimal rendering effect of the user is met.
Illustratively, business components for making service contents according to operation requirements are obtained in an operation management platform, wherein the business components are minimum atoms, and the same components can be subjected to multiple display modes and are managed according to network environments, policies, functionalities and the like.
Illustratively, a plurality of service components are packaged into an original data packet according to an operation rule protocol, a platform requirement and the like, and a plurality of candidate data packets are generated according to the original data packet.
For example, the original data packets may be simplified into one or more candidate data packets of different sizes, and the original data packets and the candidate data packets simplified into one or more different sizes in the same group of columns are packed into a plurality of containers.
Illustratively, the user population may be classified based on user history data, wherein the method used for classifying the users may employ a CURE algorithm. The steps of using the CURE algorithm are as follows:
(1) extracting a random sample s from the original data object, wherein the random sample s comprises s objects;
(2) segmenting a sample s into a set of partitions;
(3) clustering each partition locally into q clusters, wherein q > 1;
(4) eliminating abnormal data through random sampling, namely removing a cluster if the growth of the cluster is too slow;
(5) and re-clustering the partial clusters, and shrinking or moving the representative points falling into each newly obtained cluster to the cluster center according to the shrinkage factor. These points will be used to represent and delineate the boundaries of the clusters.
(6) The data is marked with a corresponding cluster label.
Illustratively, a distribution scheme is generated according to the user group and the data packets distributed to the plurality of containers, and the distribution scheme and the data packets distributed to the plurality of containers are sent to the distribution management platform. The issuing scheme can be formulated according to policy information of each province, network environment and culture difference.
The release management platform 102 is configured to receive a release scheme sent by the operation management platform and data packets separately packaged into multiple containers; storing the data packets which are distributed to the plurality of containers into a local or preset first database according to the release scheme; receiving an application rendering request sent by the client, and searching a matched data packet according to the application rendering request;
illustratively, the publishing management platform receives the publishing scheme and the data packets subpackaged to the plurality of containers sent by the operation management platform. The release management platform can further comprise a Job management center, and the release management platform stores the data packets which are distributed to the containers into a local or preset first database by using the Job management center.
Illustratively, the release management platform may further include different application lists, and a Job management center in the release management platform calls data packets separately loaded into the multiple containers according to the release scheme and issues the data packets to the different application lists, and plans to output the different multiple container scheme lists to the outside according to different network dimensions, user dimensions, policy dimensions, and address dimensions;
illustratively, the Job management center may further issue the multiple container scheme list data to a preset first database, so as to ensure a fast response of the data packets distributed to the multiple containers to the user request.
Illustratively, the first database is preset as a database formed by the publishing management platform according to the publishing scheme and composed of data packets of a plurality of containers. The preset first database may be a Redis database, which may be determined according to actual situations, and the embodiment of the present invention is not limited thereto.
Illustratively, the Job management center can also use local cache at the same time, reduce the influence of tens of millions of concurrency of the system on a network layer, and improve the availability of the system.
The client 103 is configured to send an application rendering request to the release management platform, and receive a data packet found by the release management platform for the application rendering request.
For example, the client may send an application rendering request to the release management platform, and may also receive a data packet searched by the release management platform. There may be a plurality of clients, which may be determined according to actual situations, and the embodiment of the present invention is not limited thereto.
In an embodiment, the publishing management platform is configured to, when receiving an application rendering request sent by a client, preferentially search a data packet matching the application rendering request from a local server, and send the searched data packet to the client; if the data packet matched with the application rendering request cannot be searched locally, searching the data packet matched with the application rendering request from the preset first database, and sending the searched data packet to the client; and if the data packet matched with the application rendering request cannot be searched in the preset first database, searching the data packet matched with the application rendering request from a preset second database, and sending the searched data packet to the client.
Exemplarily, the release management platform may further include a second preset database, and when receiving an application rendering request sent by the client, the release management platform may preferentially search a data packet matching the application rendering request from the local, and if there is a matching data packet, send the searched data packet to the client; if the matched data packet does not exist, searching the data packet matched with the application rendering request from a preset first database, and sending the searched data packet to the client; and if the data packet matched with the application rendering request cannot be searched in the preset first database, searching the data packet matched with the application rendering request from the preset second database, and sending the searched data packet to the client.
Illustratively, the second preset database is a database for storing all business components in the operation management platform, where the preset second database may be a MYSQL database, which may be determined according to an actual situation, and the embodiment of the present invention is not limited thereto.
In an embodiment, the publishing management platform is further configured to, if a data packet matching the application rendering request is found in a preset second database, store the found data packet in the preset first database, and perform rendering display in the client; and if the data packet matched with the application rendering request is found in the preset first database, storing the found data packet to the local, and rendering and displaying in the client.
Illustratively, the release management platform may further store the searched data packet according to the search result. If the data packet matched with the application rendering request is found in the preset second database, storing the found data packet into the preset first database; and if the data packet matched with the application rendering request is found in the preset first database, storing the found data packet to the local.
The embodiment of the invention provides a containerization-based data release system, which comprises an operation management platform, a data processing platform and a data processing platform, wherein the operation management platform is used for acquiring service components for making service contents according to operation requirements, respectively packaging a plurality of service components into original data packets, and generating the original data packets into a plurality of candidate data packets; packing the original data packet and a plurality of candidate data packets into a plurality of containers; generating a publishing scheme according to the user group and the data packets which are distributed to the plurality of containers; sending the issuing scheme and the data packets which are distributed to the plurality of containers to an issuing management platform; the release management platform is used for receiving the release scheme sent by the operation management platform and the data packets subpackaged to the containers; storing the data packets which are distributed to the plurality of containers into a local or preset first database according to the release scheme; and the client is used for sending a data packet application rendering request to the release management platform and receiving the searched data packet. The embodiment of the invention is respectively provided with the operation management platform and the release management platform, so that the content supply and release are clear, and the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the release management platform accelerates the rendering speed by reducing the repeated request loading of the rendering content.
Referring to fig. 2, an architecture diagram of an operation management platform, a release management platform, and a client according to an embodiment of the present invention is shown.
In the operation management platform, a developer and an operator create and maintain together, a service component of service content is manufactured according to operation requirements, a plurality of service components are packaged, simplified and processed and then packaged into a container package, wherein the container package is provided with a plurality of service components, and the service components in the container package are also provided with a plurality of service components.
The method comprises the steps that the method is created and maintained by a developer in a release management platform, wherein the release management platform is provided with a Job management center, a local center, a preset first database and a preset second database.
In the client, the client may be a plurality of clients, and a system composed of a set of operation management platform and release management platform is used.
The embodiment of the invention is respectively provided with the operation management platform and the release management platform, so that the content supply and release are clear, and the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the release management platform accelerates the rendering speed by reducing the repeated request loading of the rendering content.
Referring to fig. 3, a flowchart of steps of a containerization-based data publishing method provided in an embodiment of the present invention is shown, and is applied to an operation management platform, where the method specifically includes the following steps:
for example, the operation management platform may be a working platform based on service content production, content distribution, and scheme making, which may be determined according to actual situations, and the embodiment of the present invention is not limited thereto.
Illustratively, the operation management platform is responsible for designing and updating the provided content by the operator. An operator can make a service component of service content according to operation requirements, wherein the service component is a minimum atom, the same component can have multiple display modes, and management is distinguished according to network environment, policy, functionality and the like. The specific situation may be determined according to practical situations, and the embodiment of the present invention is not limited thereto.
illustratively, a plurality of service components are packaged into an original data packet according to an operation rule protocol, a platform requirement and the like, and a plurality of candidate data packets are generated according to the original data packet.
for example, the original data packets may be simplified into one or more candidate data packets of different sizes, and the original data packets and the candidate data packets simplified into one or more different sizes in the same group of columns are packed into a plurality of containers.
illustratively, the user population may be classified based on user history data, wherein the method used for classifying the users may employ a CURE algorithm.
And 305, sending the publishing scheme and the data packets which are distributed to the plurality of containers to a publishing management platform.
Illustratively, a distribution scheme is generated according to the user group and the data packets distributed to the plurality of containers, and the distribution scheme and the data packets distributed to the plurality of containers are sent to the distribution management platform. The issuing scheme can be formulated according to policy information of each province, network environment and culture difference.
The embodiment of the invention provides a containerization-based data publishing method, which is applied to an operation management platform and is used for acquiring a plurality of service components for making service contents according to operation requirements; respectively packaging the plurality of service components into original data packets, and generating the original data packets into a plurality of candidate data packets; packing the original data packet and the candidate data packets into a plurality of containers; generating a publishing scheme according to the user group and the data packets which are distributed to the plurality of containers; and sending the issuing scheme and the data packets which are distributed to the plurality of containers to an issuing management platform. The embodiment of the invention is respectively provided with the operation management platform and the release management platform, so that the content supply and release are clear, and the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the rendering speed is increased by reducing the repeated request loading of the rendering content.
Referring to fig. 4, a flowchart illustrating steps of a containerization-based data publishing method provided in an embodiment of the present invention is shown, and is applied to a publishing management platform, where the method specifically includes the following steps:
illustratively, the publishing management platform may include a Job management center, and after the publishing scheme and the data packets distributed into the plurality of containers are sent to the publishing management platform by the operation management platform, the publishing management platform stores the data packets distributed into the plurality of containers into a local or preset first database by using the Job management center.
illustratively, the Job management center can use a local cache, reduce the influence of tens of millions of concurrency on a network layer of the system and improve the availability of the system.
For example, when receiving an application rendering request sent by a client, the publishing management platform may preferentially search a data packet matching the application rendering request from the local, and if the matching data packet exists, send the searched data packet to the client.
illustratively, the publishing management platform may include a matching center, and when the user sends the application rendering request, the matching center performs matching output according to the identified user address information, MD5 information, verification information, file package size, and the like according to a "proximity rule", where a rule of the "proximity rule" is that matching is performed from local preferentially, and if matching is not performed, performing matching output from the preset first database. The method reduces the network pressure of the output of the rendering content of the repeated service packet body, enables the loading speed to be higher, and improves the service perception effect of the user.
Illustratively, the Job management center may further use a preset first database, where the preset first database may be a Redis database, which may be determined according to practical situations, and the embodiment of the present invention is not limited thereto.
For example, the release management platform may further include a second preset database, and if the data packet matching the application rendering request is not found in the first preset database, the data packet matching the application rendering request is found in the second preset database, and the found data packet is sent to the client.
In an embodiment of the present invention, the method further comprises: if the data packet matched with the application rendering request is found in a preset second database, storing the found data packet to the preset first database; and if the data packet matched with the application rendering request is found in the preset first database, storing the found data packet to the local.
Illustratively, the release management platform may include a matching center, and when the matching center finds a data packet matching the application rendering request in the preset second database, the found data packet is stored in the preset first database; and if the data packet matched with the application rendering request is found in the preset first database, storing the found data packet to the local.
The embodiment of the invention provides a containerization-based data release method, which is applied to a release management platform and used for receiving a release scheme sent by an operation management platform and data packets subpackaged to a plurality of containers; storing the data packets which are distributed to the plurality of containers into a local or preset first database according to the release scheme; when an application rendering request sent by a client is received, preferentially searching a data packet matched with the application rendering request from the local, and sending the searched data packet to the client; if the data packet matched with the application rendering request cannot be searched locally, searching the data packet matched with the application rendering request from the preset first database, and sending the searched data packet to the client; and if the data packet matched with the application rendering request cannot be searched in the preset first database, searching the data packet matched with the application rendering request from the preset second database, and sending the searched data packet to the client. The embodiment of the invention is respectively provided with the operation management platform and the release management platform, so that the content supply and release are clear, and the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the rendering speed is increased by reducing the repeated request loading of the rendering content.
In order to enable those skilled in the art to better understand the process of the matching center embodiments of the present invention, a full example is described below. Referring to fig. 5, a matching center logic processing diagram provided in the embodiment of the present invention is shown, for example, a first database is preset to Redis, and a second database is preset to MYSQL database, and specifically, the following steps may be included:
step 1, starting; the client sends an application rendering request;
Step 3, obtaining the data from a preset first database; and if the data packet matched with the application rendering request cannot be searched in the preset first database, acquiring and outputting the data packet from the preset second database, and storing the data packet matched and output to the preset first database.
In the embodiment of the invention, the release management platform may include a matching center, and when the matching center finds a data packet matching with the application rendering request in the preset second database, the found data packet is stored in the preset first database; if the data packet matched with the application rendering request is found in the preset first database, the found data packet is stored to the local, so that the network pressure of the output of the rendering content of the repeated service packet body is reduced, the loading speed is higher, and the service perception effect of a user is improved.
In order to enable those skilled in the art to better understand the process of the matching center embodiments of the present invention, a full example is described below. Referring to fig. 6, which is a flowchart of a release execution provided in the embodiment of the present invention, for example, the first database is preset to Redis, and the second database is preset to MYSQL database, which specifically includes the following steps:
step 1, manufacturing a plurality of containers on an operation management platform;
and 3, storing the data packets which are distributed to the multiple containers into local or Redis by a Job management center in the release management platform according to a release scheme.
An issue execution flow in an embodiment of the present invention includes: the operation management platform makes a plurality of containers, stores the containers in a containerized database in a file mode, and simultaneously makes a release scheme according to the container package and sends the release scheme to the release management platform; and the Job management center in the release management platform stores the data packets which are distributed into the plurality of containers into local or Redis according to a release scheme. An operation management platform and a release management platform are respectively arranged, so that the content supply and release are defined, and the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the release management platform accelerates the rendering speed by reducing the repeated request loading of the rendering content.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 7, a block diagram of a structure of a containerization-based data distribution apparatus according to an embodiment of the present invention is shown, and the block diagram is applied to an operation management platform, and may specifically include the following modules:
a component obtaining module 701, configured to obtain a plurality of service components for making service content according to an operation requirement;
a data packet generating module 702, configured to encapsulate the multiple service components into original data packets, and generate the original data packets into multiple candidate data packets;
a data packet packing module 703, configured to pack the original data packet and the candidate data packets into a plurality of containers;
an operation generating module 704, configured to generate a distribution scheme according to a user group and data packets separately loaded into multiple containers;
an operation sending module 705, configured to send the publishing scheme and the data packets separately packaged into multiple containers to a publishing management platform.
The embodiment of the invention provides a containerization-based data publishing device, which is applied to an operation management platform and is used for acquiring a plurality of service components for making service contents according to operation requirements; respectively packaging the plurality of service components into original data packets, and generating the original data packets into a plurality of candidate data packets; packing the original data packet and the candidate data packets into a plurality of containers; generating a publishing scheme according to the user group and the data packets which are distributed to the plurality of containers; and sending the issuing scheme and the data packets which are distributed to the plurality of containers to an issuing management platform. The embodiment of the invention is respectively provided with the operation management platform and the release management platform, so that the content supply and release are clear, and the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the release management platform accelerates the rendering speed by reducing the repeated request loading of the rendering content.
Referring to fig. 8, a block diagram of a structure of a containerization-based data publishing device according to an embodiment of the present invention is shown, and is applied to a publishing management platform, and specifically includes the following modules:
a release receiving module 801, configured to receive a release scheme sent by an operation management platform and data packets separately loaded into multiple containers;
the release storage module 802 is configured to store the data packets separately packaged into the multiple containers into a local or preset first database according to the release scheme;
a first search module 803, configured to preferentially search, when an application rendering request sent by a client is received, a data packet matching the application rendering request from a local server, and send the searched data packet to the client;
a second searching module 804, configured to search, if the data packet matching the application rendering request is not searched locally, the data packet matching the application rendering request from the preset first database, and send the searched data packet to the client;
a third searching module 805, configured to search, if the data packet matching the application rendering request is not found in the preset first database, the data packet matching the application rendering request from the preset second database, and send the found data packet to the client.
In an embodiment, the first storage module is configured to, if a data packet matching the application rendering request is found in a preset second database, store the found data packet in a preset first database;
in an embodiment, the second storage module is configured to, if a data packet matching the application rendering request is found in a preset first database, store the found data packet locally.
The embodiment of the invention provides a containerization-based data release device, which is applied to a release management platform and used for receiving a release scheme sent by an operation management platform and data packets distributed to a plurality of containers; storing the data packets which are distributed to the plurality of containers into a local or preset first database according to the release scheme; when an application rendering request sent by a client is received, preferentially searching a data packet matched with the application rendering request from the local, and sending the searched data packet to the client; if the data packet matched with the application rendering request cannot be searched locally, searching the data packet matched with the application rendering request from the preset first database, and sending the searched data packet to the client; and if the data packet matched with the application rendering request cannot be searched in the preset first database, searching the data packet matched with the application rendering request from the preset second database, and sending the searched data packet to the client. The embodiment of the invention is respectively provided with the operation management platform and the release management platform, so that the content supply and release are clear, and the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the rendering speed is increased by reducing the repeated request loading of the rendering content.
Preferably, an embodiment of the present invention further provides an electronic device, including: the processor, the memory, and the computer program stored in the memory and capable of running on the processor, when executed by the processor, implement the processes of the above-mentioned data publishing method embodiment based on containerization, and can achieve the same technical effects, and in order to avoid repetition, details are not repeated here.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when being executed by a processor, the computer program implements each process of the above-mentioned containerization-based data distribution method embodiment, and can achieve the same technical effect, and is not described herein again to avoid repetition. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (11)
1. A containerization-based data distribution system, the system comprising: the system comprises an operation management platform, a release management platform and a client;
the operation management platform is used for acquiring service components for making service contents according to operation requirements, respectively packaging the service components into original data packets, and generating the original data packets into a plurality of candidate data packets; packing the original data packet and the candidate data packets into a plurality of containers; generating a publishing scheme according to the user group and the data packets which are distributed to the plurality of containers; sending the issuing scheme and the data packets which are distributed to the plurality of containers to an issuing management platform;
the release management platform is used for receiving the release scheme sent by the operation management platform and the data packets distributed to the containers; storing the data packets which are distributed to the plurality of containers into a local or preset first database according to the release scheme; receiving an application rendering request sent by the client, and searching a matched data packet according to the application rendering request;
and the client is used for sending an application rendering request to the release management platform and receiving the data packet searched by the release management platform aiming at the application rendering request.
2. The system of claim 1, wherein the system comprises:
the release management platform is used for preferentially searching a data packet matched with the application rendering request from the local and sending the searched data packet to the client when receiving the application rendering request sent by the client; if the data packet matched with the application rendering request cannot be searched locally, searching the data packet matched with the application rendering request from the preset first database, and sending the searched data packet to the client; and if the data packet matched with the application rendering request cannot be searched in the preset first database, searching the data packet matched with the application rendering request from a preset second database, and sending the searched data packet to the client.
3. The system of claim 1, wherein the system comprises:
the release management platform is further configured to store the found data packet to the preset first database and perform rendering display in the client if the data packet matching the application rendering request is found in a preset second database; and if the data packet matched with the application rendering request is found in the preset first database, storing the found data packet to the local, and rendering and displaying in the client.
4. A containerization-based data publishing method is applied to an operation management platform, and comprises the following steps:
acquiring a plurality of service components for making service content according to operation requirements;
respectively packaging the plurality of service components into original data packets, and generating the original data packets into a plurality of candidate data packets;
packing the original data packet and the candidate data packets into a plurality of containers;
generating a publishing scheme according to the user group and the data packets which are distributed to the plurality of containers;
and sending the issuing scheme and the data packet which is subpackaged to the container to an issuing management platform.
5. A containerization-based data publishing method is applied to a publishing management platform, and comprises the following steps:
receiving a release scheme sent by an operation management platform and data packets subpackaged to a plurality of containers;
storing the data packets which are distributed to the plurality of containers into a local or preset first database according to the release scheme;
when an application rendering request sent by a client is received, preferentially searching a data packet matched with the application rendering request from the local, and sending the searched data packet to the client;
if the data packet matched with the application rendering request cannot be searched locally, searching the data packet matched with the application rendering request from the preset first database, and sending the searched data packet to the client;
and if the data packet matched with the application rendering request cannot be searched in the preset first database, searching the data packet matched with the application rendering request from the preset second database, and sending the searched data packet to the client.
6. The method of claim 5, further comprising:
if the data packet matched with the application rendering request is found in a preset second database, storing the found data packet to the preset first database;
and if the data packet matched with the application rendering request is found in the preset first database, storing the found data packet to the local.
7. A containerization-based data publishing device applied to an operation management platform comprises:
the component acquisition module is used for acquiring a plurality of business components for making service contents according to operation requirements;
a data packet generating module, configured to encapsulate the multiple service components into original data packets, and generate the original data packets into multiple candidate data packets;
a data packet packing module, configured to pack the original data packet and the candidate data packets into a plurality of containers;
the operation generation module is used for generating a release scheme according to the user group and the data packets which are distributed to the containers in a split mode;
and the operation sending module is used for sending the publishing scheme and the data packets which are distributed to the plurality of containers to a publishing management platform.
8. A containerization-based data publishing device applied to a publishing management platform comprises:
the release receiving module is used for receiving a release scheme sent by the operation management platform and data packets subpackaged to a plurality of containers;
the release storage module is used for storing the data packets which are subpackaged to the plurality of containers into a local or preset first database according to the release scheme;
the system comprises a first searching module, a second searching module and a third searching module, wherein the first searching module is used for preferentially searching a data packet matched with an application rendering request from the local and sending the searched data packet to a client when the application rendering request sent by the client is received;
the second searching module is used for searching the data packet matched with the application rendering request from the preset first database and sending the searched data packet to the client side if the data packet matched with the application rendering request cannot be searched locally;
and the third searching module is used for searching the data packet matched with the application rendering request from the preset second database and sending the searched data packet to the client when the data packet matched with the application rendering request cannot be searched in the preset first database.
9. The apparatus of claim 8, further comprising:
the first storage module is used for storing the searched data packet to a preset first database if the data packet matched with the application rendering request is searched in a preset second database;
and the second storage module is used for storing the searched data packet to the local part if the data packet matched with the application rendering request is searched in a preset first database.
10. An electronic device, comprising:
one or more processors; and
one or more machine-readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform a containerization-based data distribution method of one or more of claims 4 or 5-6.
11. A computer-readable storage medium storing a computer program for causing a processor to execute a containerization-based data distribution method according to any one of claims 4 or 5 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111665796.9A CN114416113B (en) | 2021-12-30 | 2021-12-30 | Data release system, method and device based on containerization |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111665796.9A CN114416113B (en) | 2021-12-30 | 2021-12-30 | Data release system, method and device based on containerization |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114416113A true CN114416113A (en) | 2022-04-29 |
| CN114416113B CN114416113B (en) | 2023-05-12 |
Family
ID=81272035
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111665796.9A Active CN114416113B (en) | 2021-12-30 | 2021-12-30 | Data release system, method and device based on containerization |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114416113B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130198679A1 (en) * | 2012-01-20 | 2013-08-01 | Vistaprint Limited | Generating media content in a website under construction |
| US20170098008A1 (en) * | 2015-10-06 | 2017-04-06 | Squawqr LLC | Mobile application manager system and method |
| CN107479861A (en) * | 2016-06-07 | 2017-12-15 | 阿里巴巴集团控股有限公司 | Page processing method and its system |
| US20180210715A1 (en) * | 2017-01-25 | 2018-07-26 | Wal-Mart Stores, Inc. | Systems, method, and non-transitory computer-readable storage media for generating code for displaying a webpage |
| US20190208031A1 (en) * | 2017-12-29 | 2019-07-04 | ASG Technologies Group, Inc. dba ASG Technologies | Platform-Independent Application Publishing to a Personalized Front-End Interface by Encapsulating Published Content into a Container |
| WO2019136842A1 (en) * | 2018-01-09 | 2019-07-18 | 武汉斗鱼网络科技有限公司 | Component publishing and compilation method, storage medium, electronic device and system |
| CN110716789A (en) * | 2019-09-12 | 2020-01-21 | 北京大米科技有限公司 | Data configuration method, readable storage medium and electronic device |
| CN111459565A (en) * | 2020-02-27 | 2020-07-28 | 上海钧正网络科技有限公司 | Method and device for rendering client page and mobile terminal |
| CN112132942A (en) * | 2020-09-30 | 2020-12-25 | 深圳星寻科技有限公司 | Three-dimensional scene roaming real-time rendering method |
| CN112316424A (en) * | 2021-01-06 | 2021-02-05 | 腾讯科技（深圳）有限公司 | Game data processing method, device and storage medium |
| CN113468456A (en) * | 2021-07-12 | 2021-10-01 | 工银科技有限公司 | Webpage rendering method and device, electronic equipment and computer-readable storage medium |
-
2021
- 2021-12-30 CN CN202111665796.9A patent/CN114416113B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130198679A1 (en) * | 2012-01-20 | 2013-08-01 | Vistaprint Limited | Generating media content in a website under construction |
| US20170098008A1 (en) * | 2015-10-06 | 2017-04-06 | Squawqr LLC | Mobile application manager system and method |
| CN107479861A (en) * | 2016-06-07 | 2017-12-15 | 阿里巴巴集团控股有限公司 | Page processing method and its system |
| US20180210715A1 (en) * | 2017-01-25 | 2018-07-26 | Wal-Mart Stores, Inc. | Systems, method, and non-transitory computer-readable storage media for generating code for displaying a webpage |
| US20190208031A1 (en) * | 2017-12-29 | 2019-07-04 | ASG Technologies Group, Inc. dba ASG Technologies | Platform-Independent Application Publishing to a Personalized Front-End Interface by Encapsulating Published Content into a Container |
| WO2019136842A1 (en) * | 2018-01-09 | 2019-07-18 | 武汉斗鱼网络科技有限公司 | Component publishing and compilation method, storage medium, electronic device and system |
| CN110716789A (en) * | 2019-09-12 | 2020-01-21 | 北京大米科技有限公司 | Data configuration method, readable storage medium and electronic device |
| CN111459565A (en) * | 2020-02-27 | 2020-07-28 | 上海钧正网络科技有限公司 | Method and device for rendering client page and mobile terminal |
| CN112132942A (en) * | 2020-09-30 | 2020-12-25 | 深圳星寻科技有限公司 | Three-dimensional scene roaming real-time rendering method |
| CN112316424A (en) * | 2021-01-06 | 2021-02-05 | 腾讯科技（深圳）有限公司 | Game data processing method, device and storage medium |
| CN113468456A (en) * | 2021-07-12 | 2021-10-01 | 工银科技有限公司 | Webpage rendering method and device, electronic equipment and computer-readable storage medium |
Non-Patent Citations (2)
| Title |
|---|
| 戴翔宇: "Web前端工程组件化的分析与改进", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 肖伟民: "基于Chromium的渲染进程轻量化隔离方法" * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114416113B (en) | 2023-05-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11163739B2 (en) | Database table format conversion based on user data access patterns in a networked computing environment | |
| CN109983456B (en) | Method and system for searching key range in memory | |
| CN106649676A (en) | Duplication eliminating method and device based on HDFS storage file | |
| CN105100050A (en) | User permission management method and system | |
| US20140059094A1 (en) | Making use of a file path to determine file locality for applications | |
| CN113077259A (en) | Block chain-based evidence storing method and device and electronic equipment | |
| CN113094560A (en) | Data label library construction method, device, equipment and medium based on data middlebox | |
| CN112860412B (en) | Service data processing method and device, electronic equipment and storage medium | |
| CN113077260A (en) | Data access method and device based on block chain and electronic equipment | |
| CN106095511A (en) | A kind of server updating method and apparatus | |
| CN110505289B (en) | File downloading method and device, computer readable medium and wireless communication equipment | |
| CN102571381B (en) | A kind of information storage means and information-storing device | |
| CN114416113B (en) | Data release system, method and device based on containerization | |
| CN110245177A (en) | A kind of deriving method of million grades of data | |
| CN106951225B (en) | Data processing method and device based on service configuration template | |
| CN114238767A (en) | Service recommendation method and device, computer equipment and storage medium | |
| CN111585897B (en) | Request route management method, system, computer system and readable storage medium | |
| CN115185946A (en) | Multi-tenant system, multi-tenant management method, computer device, and storage medium | |
| CN112688980B (en) | Resource distribution method and device, and computer equipment | |
| CN112905354A (en) | Service processing method and system for shared memory | |
| CN114675872A (en) | Data processing method, device and equipment for application program and storage medium | |
| US10162626B2 (en) | Ordered cache tiering for program build files | |
| WO2015021848A1 (en) | Method and apparatus for data distribution and concurrence | |
| CN111861292A (en) | Waybill number generation method, apparatus, server and storage medium | |
| CN105531697B (en) | A kind of content information processing method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |