CN114416113B - Data release system, method and device based on containerization - Google Patents
Data release system, method and device based on containerization Download PDFInfo
- Publication number
- CN114416113B CN114416113B CN202111665796.9A CN202111665796A CN114416113B CN 114416113 B CN114416113 B CN 114416113B CN 202111665796 A CN202111665796 A CN 202111665796A CN 114416113 B CN114416113 B CN 114416113B
- Authority
- CN
- China
- Prior art keywords
- data packet
- database
- management platform
- release
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/50—Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate
Abstract
The invention provides a data release system, a method and a device based on containerization, wherein the system comprises an operation management platform, a release management platform and a client; the operation management platform is used for acquiring service components, packaging a plurality of service components into an original data packet, and sending the release scheme and the data packet packaged in the container to the release management platform; the release management platform is used for receiving a release scheme and data packets of a plurality of containers sent by the operation management platform; according to the release scheme, storing the data packets split into the containers into a local or preset first database; the client is used for sending an application rendering request to the release management platform and receiving the searched data packet. According to the embodiment of the invention, the operation management platform and the release management platform are arranged, so that the content provision and release are defined, and the operation management platform adopts a combined content development and customization mode, so that the content provision efficiency is higher, and the release management platform accelerates the rendering speed by reducing repeated request loading of the rendered content.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a containerized data distribution system, a containerized data distribution method, and a containerized data distribution device.
Background
As web technology frameworks and development languages are continually updated and iterated, front-end rendering methods become diverse, but the prior art is considered in pursuing interactive performance improvement in terms of how to improve system utilization efficiency. For example, a third party's template is used to upload and render code to all users bound under the client publishing platform. Although the rendering mode improves the use efficiency of the system on unified realization, the rendering mode is limited by the number of templates, the whole package is integrally released during rendering, the problem that the bearing capacity in the unified package is relatively excessive, the loading application of a user is slow and the loading fails is caused, and the rendering mode does not meet the requirements of personalized demands of the user and differentiated service design for diversified application scenes.
At present, the prior art is a method for uniformly packaging and then publishing the code files, which meets the personalized requirements of users and reduces the probability of publishing failure caused by oversized bag body. And the adoption of the preset logic module needs to occupy certain calculation resources, the time effect of the calculation time is influenced on the time effect of responding to the user request, the adopted release is to sacrifice the functional integrity to reduce the size of the packet, and the method has poor landability, so that the efficiency of providing the content is low and the rendering time is longer when the method is used on a system.
Disclosure of Invention
In view of the foregoing, embodiments of the present invention have been made to provide a containerized-based data distribution system, a containerized-based data distribution method, and a corresponding containerized-based data distribution apparatus that overcome or at least partially solve the foregoing problems.
In order to solve the above problems, an embodiment of the present invention discloses a containerized data distribution system, which includes: the system comprises an operation management platform, a release management platform and a client;
the operation management platform is used for acquiring service components for making service contents according to operation requirements, respectively packaging the service components into original data packets, and generating the original data packets into a plurality of candidate data packets; subpackaging the original data packet and the plurality of candidate data packets into a plurality of containers; generating a release scheme according to the user group and the data packets split-packed into a plurality of containers; the release scheme and the data packets divided into a plurality of containers are sent to a release management platform;
the release management platform is used for receiving a release scheme and data packets packaged in a plurality of containers, wherein the release scheme and the data packets are sent by the operation management platform; according to the release scheme, the data packets which are sub-packaged into a plurality of containers are stored in a local or preset first database;
The client is used for sending an application rendering request to the release management platform and receiving the searched data packet.
Optionally, the system comprises: the release management platform is used for preferentially searching the data packet matched with the application rendering request from the local when receiving the application rendering request sent by the client and sending the searched data packet to the client; if the data packet matched with the application rendering request cannot be found locally, searching the data packet matched with the application rendering request from the preset first database, and sending the found data packet to the client; if the data packet matched with the application rendering request cannot be found in the preset first database, the data packet matched with the application rendering request is found from the preset second database, and the found data packet is sent to the client.
Optionally, the system further comprises: the release management platform is further configured to, if a data packet matching the application rendering request is found in a preset second database, store the found data packet in the preset first database, and perform rendering display in the client; if the data packet matched with the application rendering request is found in the preset first database, the found data packet is stored locally, and rendering display is performed in the client.
The embodiment of the invention also discloses a data publishing method based on containerization, which is applied to an operation management platform and comprises the following steps:
acquiring a plurality of business components for making service contents according to operation requirements;
respectively packaging the plurality of service components into original data packets, and generating the original data packets into a plurality of candidate data packets;
subpackaging the original data packet and the plurality of candidate data packets into a plurality of containers;
generating a release scheme according to the user group and the data packets split-packed into a plurality of containers;
and sending the release scheme and the data packets divided into a plurality of containers to a release management platform.
The embodiment of the invention also discloses a data publishing method based on containerization, which is applied to a publishing management platform and comprises the following steps:
receiving a release scheme and a data packet of a plurality of containers sent by an operation management platform;
according to the release scheme, the data packets which are sub-packaged into a plurality of containers are stored in a local or preset first database;
when an application rendering request sent by a client is received, preferentially searching a data packet matched with the application rendering request from the local, and sending the searched data packet to the client;
If the data packet matched with the application rendering request cannot be found locally, searching the data packet matched with the application rendering request from the preset first database, and sending the found data packet to the client;
if the data packet matched with the application rendering request cannot be found in the preset first database, the data packet matched with the application rendering request is found in the preset second database, and the found data packet is sent to the client.
Optionally, the method further comprises:
if the data packet matched with the application rendering request is found in a preset second database, storing the found data packet into the preset first database;
and if the data packet matched with the application rendering request is found in the preset first database, storing the found data packet to a local place.
The embodiment of the invention also discloses a data release device based on containerization, which is applied to an operation management platform and comprises:
the component acquisition module is used for acquiring a plurality of business components for making service contents according to operation requirements;
the data packet generation module is used for respectively packaging the plurality of service components into an original data packet and generating the original data packet into a plurality of candidate data packets;
The data packet sub-packaging module is used for sub-packaging the original data packet and the plurality of candidate data packets into a plurality of containers;
the operation generation module is used for generating a release scheme according to the user group and the data packets which are subpackaged to the plurality of containers;
and the operation sending module is used for sending the release scheme and the data packets divided into a plurality of containers to the release management platform.
The embodiment of the invention also discloses a data issuing device based on containerization, which is applied to the issuing management platform and comprises:
the release receiving module is used for receiving a release scheme sent by the operation management platform and data packets split into a plurality of containers;
the release storage module is used for storing the data packets split into a plurality of containers to a local or preset first database according to the release scheme;
the first searching module is used for searching the data packet matched with the application rendering request from the local preferentially when receiving the application rendering request sent by the client, and sending the searched data packet to the client;
the second searching module is used for searching the data packet matched with the application rendering request from the preset first database and sending the searched data packet to the client if the data packet matched with the application rendering request cannot be searched locally;
And the third searching module is used for searching the data packet matched with the application rendering request from the preset second database and sending the searched data packet to the client if the data packet matched with the application rendering request cannot be searched in the preset first database.
Optionally, the apparatus further comprises:
the first storage module is used for storing the searched data packet to a preset first database if the data packet matched with the application rendering request is searched in the preset second database;
and the second storage module is used for storing the searched data packet to the local if the data packet matched with the application rendering request is searched in the preset first database.
The embodiment of the invention also discloses electronic equipment, which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;
the memory is used for storing a computer program;
the processor is configured to implement the method according to the embodiment of the present invention when executing the program stored in the memory.
Embodiments of the invention also disclose one or more computer-readable media having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the methods described in the embodiments of the invention.
The embodiment of the invention has the following advantages:
in the embodiment of the invention, an operation management platform is used for acquiring service components for making service contents according to operation requirements, respectively packaging a plurality of service components into original data packets, and generating the original data packets into a plurality of candidate data packets; split charging the original data packet and the plurality of candidate data packets into a plurality of containers; generating a release scheme according to the user group and the data packets split-packed into a plurality of containers; the method comprises the steps of sending a release scheme and data packets packaged in a plurality of containers to a release management platform; the release management platform is used for receiving a release scheme and data packets packaged in a plurality of containers, wherein the release scheme and the data packets are sent by the operation management platform; according to the release scheme, storing the data packets split into a plurality of containers into a local or preset first database; the client is used for sending an application rendering request to the release management platform and receiving the searched data packet. In the embodiment of the invention, the operation management platform and the release management platform are respectively arranged, so that the provision and release of the content are defined, and the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the release management platform accelerates the rendering speed by reducing repeated request loading of the rendering content.
Drawings
FIG. 1 is a block diagram of a containerized-based data distribution system according to an embodiment of the present invention;
fig. 2 is a schematic diagram of an operation management platform, a release management platform, and a client according to an embodiment of the present invention;
FIG. 3 is a flow chart of steps of a method for publishing data based on containerization according to an embodiment of the present invention;
FIG. 4 is a flowchart illustrating steps of another method for publishing data based on containerization according to an embodiment of the present invention;
FIG. 5 is a logic processing diagram of a matching center provided by an embodiment of the present invention;
FIG. 6 is a flowchart of a publication execution provided by an embodiment of the present invention;
FIG. 7 is a block diagram of a data distribution device based on containerization according to an embodiment of the present invention;
fig. 8 is a block diagram of a data distribution device based on containerization according to an embodiment of the present invention.
Detailed Description
In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description.
One of the core concepts of the embodiment of the invention is that the providing and the publishing of the content are defined by arranging the operation management platform and the publishing management platform respectively, so that the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the release management platform accelerates the rendering speed by reducing repeated request loading of the rendering content.
Referring to fig. 1, a block diagram of a data distribution system based on containerization according to an embodiment of the present invention is shown, where the system includes: an operation management platform 101, a release management platform 102, and a client 103;
the operation management platform 101 is configured to obtain service components that make service contents according to operation requirements, package the service components into original data packets, and generate the original data packets into a plurality of candidate data packets; subpackaging the original data packet and the plurality of candidate data packets into a plurality of containers; generating a release scheme according to the user group and the data packets split-packed into a plurality of containers; the release scheme and the data packets divided into a plurality of containers are sent to a release management platform;
the operation management platform is a working platform for making business content, releasing content and making schemes, and the release management platform is a set of release systems for making release rules and realizing the release rules. Operators are responsible for the design and update of the provided content, and developers are responsible for the realization of the content provision and the design of the release scheme. And the user determines the updating condition of the rendering container package through the rendering space provided by the client and the algorithm and the verification rule, so that the optimal rendering effect of the user is met.
For example, a service component for making service content according to operation requirements is obtained in an operation management platform, wherein the service component is the minimum atom, and the same component can have multiple display modes and is managed in a differentiated mode according to network environment, policy, functionality and the like.
Illustratively, a plurality of service components are encapsulated into an original data packet according to an operation rule protocol, platform requirements, and the like, and a plurality of candidate data packets are generated according to the original data packet.
Illustratively, the original data packets may be reduced to one or more candidate data packets of different sizes, and the original data packets of the same set of columns and the reduced to one or more candidate data packets of different sizes are packaged into a plurality of containers.
Illustratively, the user population may be categorized based on user history data, wherein the method used to categorize the users may employ a CURE algorithm. The procedure using the CURE algorithm is:
(1) Extracting a random sample s from the original data object, which contains s objects;
(2) Dividing the sample s into a set of partitions;
(3) Locally clustering each partition into q clusters, wherein q >1;
(4) Eliminating outlier data by random sampling, i.e., if one cluster grows too slowly, it is removed;
(5) And re-clustering part of the clusters, and shrinking or moving the representative points falling in each newly obtained cluster to the cluster center according to the shrinkage factor. These points will be used to represent and delineate the boundaries of the clusters.
(6) The data is marked with a corresponding cluster tag.
Illustratively, a distribution scheme is generated from a community of users and data packets that are packaged into a plurality of containers, and the distribution scheme and data packets that are packaged into the plurality of containers are sent to a distribution management platform. The release scheme can be formulated according to the policy information of each province, the network environment and cultural differences.
The release management platform 102 is configured to receive a release scheme and a data packet packaged in a plurality of containers sent by the operation management platform; according to the release scheme, the data packets which are sub-packaged into a plurality of containers are stored in a local or preset first database; receiving an application rendering request sent by the client, and searching a matched data packet according to the application rendering request;
illustratively, the distribution management platform receives a distribution scheme and data packets for sub-packaging to a plurality of containers sent by the operations management platform. The publishing management platform can further comprise a Job management center, and the publishing management platform uses the Job management center to store the data packets split into the containers into a local or preset first database.
The Job management center in the release management platform calls the data packets split into a plurality of containers according to the release scheme and issues the data packets to different application lists, and the different container scheme lists are planned to be output outwards according to different network dimensions, user dimensions, policy dimensions and address dimensions;
illustratively, the Job management center may also issue the plurality of container scheme list data into a preset first database to ensure a quick response of the data packets packaged into the plurality of containers to the user request.
Illustratively, the first database is preset as a database formed by the distribution management platform according to the distribution scheme by data packets of a plurality of containers. The preset first database may be a dis database, and may be specific according to actual situations, which is not limited in the embodiment of the present invention.
Illustratively, the Job management center can also use the local cache at the same time, so that the influence of tens of millions of concurrency of the system on the network layer is reduced, and the availability of the system is improved.
The client 103 is configured to send an application rendering request to the release management platform, and receive a data packet that is searched by the release management platform for the application rendering request.
The client may send an application rendering request to the distribution management platform, or may receive a data packet found by the distribution management platform. The number of clients may be multiple, and the embodiment of the present invention is not limited to this, and may be specific according to practical situations.
In one embodiment, the release management platform is configured to, when receiving an application rendering request sent by a client, preferentially search, locally, a data packet that matches the application rendering request, and send the searched data packet to the client; if the data packet matched with the application rendering request cannot be found locally, searching the data packet matched with the application rendering request from the preset first database, and sending the found data packet to the client; if the data packet matched with the application rendering request cannot be found in the preset first database, the data packet matched with the application rendering request is found from the preset second database, and the found data packet is sent to the client.
The release management platform can also comprise a second preset database, when receiving an application rendering request sent by the client, the release management platform can search for a data packet matched with the application rendering request from the local preferentially, and if the matched data packet exists, the release management platform sends the searched data packet to the client; if no matched data packet exists, searching the data packet matched with the application rendering request from a preset first database, and sending the searched data packet to the client; if the data packet matched with the application rendering request cannot be found in the preset first database, the data packet matched with the application rendering request is found from the preset second database, and the found data packet is sent to the client.
The second preset database is a database for storing all service components in the operation management platform, where the second preset database may be a MYSQL database, and may be specific according to practical situations, which is not limited in the embodiments of the present invention.
In one embodiment, the release management platform is further configured to, if a data packet matching the application rendering request is found in a preset second database, store the found data packet in the preset first database, and perform rendering display in the client; if the data packet matched with the application rendering request is found in the preset first database, the found data packet is stored locally, and rendering display is performed in the client.
Illustratively, the distribution management platform may further store the searched data packet according to the search result. If a data packet matched with the application rendering request is found in the preset second database, the found data packet is stored in the preset first database; if the data packet matched with the application rendering request is found in the preset first database, the found data packet is stored locally.
The embodiment of the invention provides a containerized data release system, an operation management platform is used for acquiring service components for making service contents according to operation requirements, respectively packaging a plurality of service components into original data packets, and generating the original data packets into a plurality of candidate data packets; split charging the original data packet and the plurality of candidate data packets into a plurality of containers; generating a release scheme according to the user group and the data packets split-packed into a plurality of containers; the method comprises the steps of sending a release scheme and data packets packaged in a plurality of containers to a release management platform; the release management platform is used for receiving a release scheme and data packets packaged in a plurality of containers, wherein the release scheme and the data packets are sent by the operation management platform; according to the release scheme, storing the data packets split into a plurality of containers into a local or preset first database; the client is used for sending the data packet application rendering request to the release management platform and receiving the searched data packet. In the embodiment of the invention, the operation management platform and the release management platform are respectively arranged, so that the provision and release of the content are defined, and the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the release management platform accelerates the rendering speed by reducing repeated request loading of the rendering content.
Referring to fig. 2, an architecture diagram of an operation management platform, a release management platform, and a client according to an embodiment of the present invention is shown.
In the operation management platform, a developer and an operator create and maintain the service components of the service content together, package the service components according to operation requirements, simplify the processing, and then split the service components into container packages, wherein the number of the container packages is multiple, and the number of the service components in the container packages is also multiple.
The publication management platform is created and maintained by a developer, wherein the publication management platform has a Job management center, a local center, a preset first database, and a preset second database.
Among clients, the clients may be a plurality of clients, and a system formed by a set of operation management platform and release management platform is used.
In the embodiment of the invention, the operation management platform and the release management platform are respectively arranged, so that the provision and release of the content are defined, and the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the release management platform accelerates the rendering speed by reducing repeated request loading of the rendering content.
Referring to fig. 3, a step flow chart of a containerized data publishing method according to an embodiment of the present invention is shown and applied to an operation management platform, where the method specifically may include the following steps:
the operation management platform may be a working platform based on business content production, content distribution and scheme formulation, and may be specifically determined according to practical situations, which is not limited by the embodiment of the present invention.
The operation management platform is responsible for designing and updating the provided content by operators, for example. An operator can make service components of service contents according to operation requirements, wherein the service components are minimum atoms, the same components can have multiple display modes, and the service components are managed in a differentiated mode according to network environments, policies, functionalities and the like. The embodiment of the present invention is not limited thereto, and may be specific according to the actual situation.
illustratively, a plurality of service components are encapsulated into an original data packet according to an operation rule protocol, platform requirements, and the like, and a plurality of candidate data packets are generated according to the original data packet.
illustratively, the original data packets may be reduced to one or more candidate data packets of different sizes, and the original data packets of the same set of columns and the reduced to one or more candidate data packets of different sizes are packaged into a plurality of containers.
illustratively, the user population may be categorized based on user history data, wherein the method used to categorize the users may employ a CURE algorithm.
And step 305, transmitting the release scheme and the data packets of the multiple containers to a release management platform.
Illustratively, a distribution scheme is generated from a community of users and data packets that are packaged into a plurality of containers, and the distribution scheme and data packets that are packaged into the plurality of containers are sent to a distribution management platform. The release scheme can be formulated according to the policy information of each province, the network environment and cultural differences.
The embodiment of the invention provides a containerized data release method which is applied to an operation management platform and used for acquiring a plurality of service components for making service contents according to operation requirements; respectively packaging the plurality of service components into original data packets, and generating the original data packets into a plurality of candidate data packets; subpackaging the original data packet and the plurality of candidate data packets into a plurality of containers; generating a release scheme according to the user group and the data packets split-packed into a plurality of containers; and sending the release scheme and the data packets divided into a plurality of containers to a release management platform. In the embodiment of the invention, the operation management platform and the release management platform are respectively arranged, so that the provision and release of the content are defined, and the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the rendering speed is increased by reducing repeated request loading of rendering content.
Referring to fig. 4, a step flow chart of a containerized data publishing method according to an embodiment of the present invention is shown and applied to a publishing management platform, where the method specifically may include the following steps:
for example, the distribution management platform may include a Job management center, and after the distribution scheme and the data packets packaged in the plurality of containers sent by the operation management platform are transmitted to the distribution management platform, the distribution management platform stores the data packets packaged in the plurality of containers in a local or preset first database using the Job management center.
illustratively, the Job management center can use a local cache to reduce the network layer influence caused by tens of millions of concurrency of the system and improve the usability of the system.
For example, when receiving an application rendering request sent by a client, the publishing management platform may search for a packet matching the application rendering request locally, and if there is a matching packet, send the found packet to the client.
for example, when the user sends an application rendering request, the matching center matches and outputs according to the identified user address information, MD5 information, verification information, file packet size, and the like according to a "nearby rule", where the rule of the "nearby rule" is that the matching is performed from the local preferentially, and if the matching is not performed, the matching is performed from a preset first database. The method reduces the network pressure of the repeated service inclusion rendering content output, makes the loading speed faster, and improves the service perception effect of the user.
Illustratively, the Job management center may further use a preset first database, where the preset first database may be a Redis database, and in particular, may be specific according to the actual situation, which is not limited by the embodiment of the present invention.
The release management platform may further include a second preset database, and if the data packet matching the application rendering request cannot be found in the preset first database, the data packet matching the application rendering request is found in the preset second database, and the found data packet is sent to the client.
In an embodiment of the present invention, the method further includes: if the data packet matched with the application rendering request is found in a preset second database, storing the found data packet into the preset first database; and if the data packet matched with the application rendering request is found in the preset first database, storing the found data packet to a local place.
For example, the release management platform may include a matching center, and when the matching center finds a data packet matching with the application rendering request in the preset second database, the matching center stores the found data packet in the preset first database; if the data packet matched with the application rendering request is found in the preset first database, the found data packet is stored locally.
The embodiment of the invention provides a containerized data release method which is applied to a release management platform and used for receiving a release scheme sent by an operation management platform and data packets packaged in a plurality of containers; according to the release scheme, the data packets which are sub-packaged into a plurality of containers are stored in a local or preset first database; when an application rendering request sent by a client is received, preferentially searching a data packet matched with the application rendering request from the local, and sending the searched data packet to the client; if the data packet matched with the application rendering request cannot be found locally, searching the data packet matched with the application rendering request from the preset first database, and sending the found data packet to the client; if the data packet matched with the application rendering request cannot be found in the preset first database, the data packet matched with the application rendering request is found in the preset second database, and the found data packet is sent to the client. In the embodiment of the invention, the operation management platform and the release management platform are respectively arranged, so that the provision and release of the content are defined, and the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the rendering speed is increased by reducing repeated request loading of rendering content.
In order to enable those skilled in the art to better understand the process of the present invention for embodiments of the matching center, a complete example is described below. Referring to fig. 5, a logic processing diagram of a matching center provided by an embodiment of the present invention, for example, a first database is preset to be Redis, and a second database is preset to be MYSQL database, which may specifically include the following steps:
step 1, starting; the client sends an application rendering request;
Step 3, obtaining from a preset first database; if the data packet matched with the application rendering request cannot be found in the preset first database, acquiring and outputting the data packet from the preset second database, and storing the matched and outputted data packet into the preset first database.
In the embodiment of the invention, the release management platform can comprise a matching center, and when the matching center searches a data packet matched with the application rendering request in a preset second database, the searched data packet is stored in a preset first database; if the data packet matched with the application rendering request is found in the preset first database, the found data packet is stored locally, so that the network pressure of the repeated service inclusion rendering content output is reduced, the loading speed is higher, and the service perception effect of a user is improved.
In order to enable those skilled in the art to better understand the process of the present invention for embodiments of the matching center, a complete example is described below. Referring to fig. 6, a flowchart of publishing execution provided by an embodiment of the present invention, for example, presetting a first database as Redis and presetting a second database as MYSQL database, may specifically include the following steps:
step 1, manufacturing a plurality of containers on an operation management platform;
and 3, storing the data packets split into a plurality of containers to a local or Redis by a Job management center in the release management platform according to a release scheme.
The release execution flow in the embodiment of the invention comprises the following steps: the operation management platform makes a plurality of containers, stores the files into a containerized database, and simultaneously sends the container package making and releasing scheme to the releasing management platform; and the Job management center in the release management platform stores the data packets split into a plurality of containers into a local or Redis according to a release scheme. An operation management platform and a release management platform are respectively arranged, so that the provision and release of the content are defined, and the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the release management platform accelerates the rendering speed by reducing repeated request loading of the rendering content.
It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred embodiments, and that the acts are not necessarily required by the embodiments of the invention.
Referring to fig. 7, a block diagram of a data publishing device based on containerization according to an embodiment of the present invention is shown, which is applied to an operation management platform, and may specifically include the following modules:
a component obtaining module 701, configured to obtain a plurality of service components that make service content according to operation requirements;
a data packet generating module 702, configured to encapsulate the service components into original data packets, and generate the original data packets into a plurality of candidate data packets;
a packet split charging module 703, configured to split the original packet and the plurality of candidate packets into a plurality of containers;
an operation generating module 704, configured to generate a distribution scheme according to a user group and data packets that are split into a plurality of containers;
And the operation sending module 705 is configured to send the distribution scheme and the data packets of the multiple containers to a distribution management platform.
The embodiment of the invention provides a containerized data release device which is applied to an operation management platform and used for acquiring a plurality of service components for making service contents according to operation requirements; respectively packaging the plurality of service components into original data packets, and generating the original data packets into a plurality of candidate data packets; subpackaging the original data packet and the plurality of candidate data packets into a plurality of containers; generating a release scheme according to the user group and the data packets split-packed into a plurality of containers; and sending the release scheme and the data packets divided into a plurality of containers to a release management platform. In the embodiment of the invention, the operation management platform and the release management platform are respectively arranged, so that the provision and release of the content are defined, and the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the release management platform accelerates the rendering speed by reducing repeated request loading of the rendering content.
Referring to fig. 8, a block diagram of a data publishing device based on containerization according to an embodiment of the present invention is shown, which is applied to a publishing management platform, and may specifically include the following modules:
A release receiving module 801, configured to receive a release scheme and a data packet packaged in a plurality of containers sent by an operation management platform;
the distribution storage module 802 is configured to store the data packets split into the plurality of containers to a local or preset first database according to the distribution scheme;
a first searching module 803, configured to, when receiving an application rendering request sent by a client, preferentially search, locally, a data packet that matches the application rendering request, and send the searched data packet to the client;
a second searching module 804, configured to search, if a data packet matching the application rendering request is not found locally, a data packet matching the application rendering request from the preset first database, and send the searched data packet to the client;
and a third searching module 805, configured to, if a data packet matching the application rendering request cannot be found in the preset first database, search a data packet matching the application rendering request from the preset second database, and send the found data packet to the client.
In one embodiment, the first storage module is configured to store, if a data packet matching the application rendering request is found in a preset second database, the found data packet to a preset first database;
In one embodiment, the second storage module is configured to store, if a data packet matching the application rendering request is found in a preset first database, the found data packet locally.
The embodiment of the invention provides a containerized-based data issuing device which is applied to an issuing management platform and is used for receiving an issuing scheme sent by the operation management platform and data packets packaged in a plurality of containers; according to the release scheme, the data packets which are sub-packaged into a plurality of containers are stored in a local or preset first database; when an application rendering request sent by a client is received, preferentially searching a data packet matched with the application rendering request from the local, and sending the searched data packet to the client; if the data packet matched with the application rendering request cannot be found locally, searching the data packet matched with the application rendering request from the preset first database, and sending the found data packet to the client; if the data packet matched with the application rendering request cannot be found in the preset first database, the data packet matched with the application rendering request is found in the preset second database, and the found data packet is sent to the client. In the embodiment of the invention, the operation management platform and the release management platform are respectively arranged, so that the provision and release of the content are defined, and the system is more specialized. The operation management platform adopts a combined content development and customization mode, so that the content providing efficiency is higher, and the rendering speed is increased by reducing repeated request loading of rendering content.
Preferably, the embodiment of the present invention further provides an electronic device, including: the processor, the memory, store the computer program on the memory and can run on the processor, this computer program realizes the above-mentioned all processes based on the data release method embodiment of the containerization when being carried out by the processor, and can reach the same technical result, in order to avoid repetition, will not be repeated here.
The embodiment of the invention also provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor, implements the processes of the embodiment of the containerized data distribution method, and can achieve the same technical effects, so that repetition is avoided and no further description is given here. Wherein the computer readable storage medium is selected from Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic disk or optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The embodiments of the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present invention and the scope of the claims, which are to be protected by the present invention.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a usb disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk, etc.
The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present invention. Therefore, the protection scope of the invention is subject to the protection scope of the claims.
Claims (11)
1. A containerized-based data distribution system, the system comprising: the system comprises an operation management platform, a release management platform and a client;
the operation management platform is used for acquiring a plurality of service components for making service contents according to operation requirements, respectively packaging the service components into an original data packet, and generating the original data packet into a plurality of candidate data packets; subpackaging the original data packet and the plurality of candidate data packets into a plurality of containers; generating a release scheme according to the user group and the data packets split-packed into a plurality of containers; the release scheme is formulated according to the policy information of each province, the network environment and cultural differences; the release scheme and the data packets divided into a plurality of containers are sent to a release management platform;
The release management platform is used for receiving a release scheme and data packets packaged in a plurality of containers, wherein the release scheme and the data packets are sent by the operation management platform; according to the release scheme, the data packets which are sub-packaged into a plurality of containers are stored in a local or preset first database; receiving an application rendering request sent by the client, and sequentially searching matched data packets from a local database, the preset first database and the preset second database according to the application rendering request; the preset first database is a database formed by a plurality of data packets of containers according to a release scheme by a release management platform; presetting a second database as a database for storing all service components in an operation management platform; the client is used for sending an application rendering request to the release management platform and receiving a data packet searched by the release management platform aiming at the application rendering request.
2. The system according to claim 1, characterized in that the system comprises:
the release management platform is used for preferentially searching the data packet matched with the application rendering request from the local when receiving the application rendering request sent by the client and sending the searched data packet to the client; if the data packet matched with the application rendering request cannot be found locally, searching the data packet matched with the application rendering request from the preset first database, and sending the found data packet to the client; if the data packet matched with the application rendering request cannot be found in the preset first database, the data packet matched with the application rendering request is found from the preset second database, and the found data packet is sent to the client.
3. The system according to claim 1, characterized in that the system comprises:
the release management platform is further configured to, if a data packet matching the application rendering request is found in a preset second database, store the found data packet in the preset first database, and perform rendering display in the client; if the data packet matched with the application rendering request is found in the preset first database, the found data packet is stored locally, and rendering display is performed in the client.
4. A method for publishing data based on containerization, which is applied to an operation management platform, the method comprising:
acquiring a plurality of business components for making service contents according to operation requirements;
respectively packaging the plurality of service components into original data packets, and generating the original data packets into a plurality of candidate data packets;
subpackaging the original data packet and the plurality of candidate data packets into a plurality of containers;
generating a release scheme according to the user group and the data packets split-packed into a plurality of containers; the release scheme is formulated according to the policy information of each province, the network environment and cultural differences;
And sending the release scheme and the data packet split-packed into the container to a release management platform.
5. A containerized-based data distribution method, applied to a distribution management platform, the method comprising:
receiving a release scheme and a data packet of a plurality of containers sent by an operation management platform;
according to the release scheme, the data packets which are sub-packaged into a plurality of containers are stored in a local or preset first database;
when an application rendering request sent by a client is received, preferentially searching a data packet matched with the application rendering request from the local, and sending the searched data packet to the client;
if the data packet matched with the application rendering request cannot be found locally, searching the data packet matched with the application rendering request from the preset first database, and sending the found data packet to the client;
if the data packet matched with the application rendering request cannot be found in the preset first database, the data packet matched with the application rendering request is found from the preset second database, and the found data packet is sent to the client;
the preset first database is a database formed by a plurality of data packets of containers according to a release scheme by a release management platform; the second database is preset as a database for storing all service components in the operation management platform.
6. The method of claim 5, wherein the method further comprises:
if the data packet matched with the application rendering request is found in a preset second database, storing the found data packet into the preset first database;
and if the data packet matched with the application rendering request is found in the preset first database, storing the found data packet to a local place.
7. A containerized-based data distribution device for use with an operations management platform, the device comprising:
the component acquisition module is used for acquiring a plurality of business components for making service contents according to operation requirements;
the data packet generation module is used for respectively packaging the plurality of service components into an original data packet and generating the original data packet into a plurality of candidate data packets;
the data packet sub-packaging module is used for sub-packaging the original data packet and the plurality of candidate data packets into a plurality of containers;
the operation generation module is used for generating a release scheme according to the user group and the data packets which are subpackaged to the plurality of containers; the release scheme is formulated according to the policy information of each province, the network environment and cultural differences;
And the operation sending module is used for sending the release scheme and the data packets divided into a plurality of containers to the release management platform.
8. A containerized-based data distribution device for use with a distribution management platform, the device comprising:
the release receiving module is used for receiving a release scheme sent by the operation management platform and data packets split into a plurality of containers;
the release storage module is used for storing the data packets split into a plurality of containers to a local or preset first database according to the release scheme;
the first searching module is used for searching the data packet matched with the application rendering request from the local preferentially when receiving the application rendering request sent by the client, and sending the searched data packet to the client;
the second searching module is used for searching the data packet matched with the application rendering request from the preset first database and sending the searched data packet to the client if the data packet matched with the application rendering request cannot be searched locally;
a third searching module, configured to search, if a data packet matching the application rendering request cannot be found in the preset first database, a data packet matching the application rendering request from the preset second database, and send the searched data packet to the client;
The preset first database is a database formed by a plurality of data packets of containers according to a release scheme by a release management platform; the second database is preset as a database for storing all service components in the operation management platform.
9. The apparatus of claim 8, wherein the apparatus further comprises:
the first storage module is used for storing the searched data packet to a preset first database if the data packet matched with the application rendering request is searched in the preset second database;
and the second storage module is used for storing the searched data packet to the local if the data packet matched with the application rendering request is searched in the preset first database.
10. An electronic device, comprising:
one or more processors; and
one or more machine-readable media having instructions stored thereon, which when executed by the one or more processors, cause the electronic device to perform a containerized data distribution method of one or more of claims 4 or 5-6.
11. A computer-readable storage medium, characterized in that a computer program stored therein causes a processor to execute a containerized data distribution method according to any one of claims 4 or 5 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111665796.9A CN114416113B (en) | 2021-12-30 | 2021-12-30 | Data release system, method and device based on containerization |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111665796.9A CN114416113B (en) | 2021-12-30 | 2021-12-30 | Data release system, method and device based on containerization |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114416113A CN114416113A (en) | 2022-04-29 |
| CN114416113B true CN114416113B (en) | 2023-05-12 |
Family
ID=81272035
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111665796.9A Active CN114416113B (en) | 2021-12-30 | 2021-12-30 | Data release system, method and device based on containerization |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114416113B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111459565A (en) * | 2020-02-27 | 2020-07-28 | 上海钧正网络科技有限公司 | Method and device for rendering client page and mobile terminal |
| CN112132942A (en) * | 2020-09-30 | 2020-12-25 | 深圳星寻科技有限公司 | Three-dimensional scene roaming real-time rendering method |
| CN112316424A (en) * | 2021-01-06 | 2021-02-05 | 腾讯科技（深圳）有限公司 | Game data processing method, device and storage medium |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130198658A1 (en) * | 2012-01-20 | 2013-08-01 | Vistaprint Limited | Designing website user controls |
| US20170098008A1 (en) * | 2015-10-06 | 2017-04-06 | Squawqr LLC | Mobile application manager system and method |
| CN107479861B (en) * | 2016-06-07 | 2021-04-06 | 阿里巴巴集团控股有限公司 | Page processing method and system |
| US10268460B2 (en) * | 2017-01-25 | 2019-04-23 | Walmart Apollo, Llc | Systems, method, and non-transitory computer-readable storage media for generating code for displaying a webpage |
| US10812611B2 (en) * | 2017-12-29 | 2020-10-20 | Asg Technologies Group, Inc. | Platform-independent application publishing to a personalized front-end interface by encapsulating published content into a container |
| CN108255493B (en) * | 2018-01-09 | 2021-04-23 | 武汉斗鱼网络科技有限公司 | Component publishing and compiling method, storage medium, electronic device and system |
| CN110716789A (en) * | 2019-09-12 | 2020-01-21 | 北京大米科技有限公司 | Data configuration method, readable storage medium and electronic device |
| CN113468456B (en) * | 2021-07-12 | 2022-04-22 | 工银科技有限公司 | Webpage rendering method and device, electronic equipment and computer-readable storage medium |
-
2021
- 2021-12-30 CN CN202111665796.9A patent/CN114416113B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111459565A (en) * | 2020-02-27 | 2020-07-28 | 上海钧正网络科技有限公司 | Method and device for rendering client page and mobile terminal |
| CN112132942A (en) * | 2020-09-30 | 2020-12-25 | 深圳星寻科技有限公司 | Three-dimensional scene roaming real-time rendering method |
| CN112316424A (en) * | 2021-01-06 | 2021-02-05 | 腾讯科技（深圳）有限公司 | Game data processing method, device and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 肖伟民.基于Chromium的渲染进程轻量化隔离方法.《计算机工程》.2017,第43卷(第8期),第95-100页. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114416113A (en) | 2022-04-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10725991B2 (en) | Database table format conversion based on user data access patterns in a networked computing environment | |
| CN109829287A (en) | Api interface permission access method, equipment, storage medium and device | |
| CN103473696A (en) | Method and system for collecting, analyzing and distributing internet business information | |
| US10169348B2 (en) | Using a file path to determine file locality for applications | |
| CN110413845B (en) | Resource storage method and device based on Internet of things operating system | |
| CN116955361A (en) | Method and system for searching key range in memory | |
| CN104346345A (en) | Data storage method and device | |
| CN109088914B (en) | Block generation method, block chain ecosystem and computer readable storage medium | |
| CN109586970A (en) | Resource allocation methods, apparatus and system | |
| CN113626512A (en) | Data processing method, device, equipment and readable storage medium | |
| CN114416113B (en) | Data release system, method and device based on containerization | |
| CN113077260A (en) | Data access method and device based on block chain and electronic equipment | |
| CN113568758A (en) | GPU resource pooling method, system, device and computer readable storage medium | |
| CN105930104B (en) | Date storage method and device | |
| CN111045928B (en) | Interface data testing method, device, terminal and storage medium | |
| CN116842012A (en) | Method, device, equipment and storage medium for storing Redis cluster in fragments | |
| CN109002332B (en) | Process starting and configuring method, device and system | |
| CN115016862A (en) | Kubernetes cluster-based software starting method, device, server and storage medium | |
| US20220050811A1 (en) | Method and apparatus for synchronizing file | |
| CN112688980B (en) | Resource distribution method and device, and computer equipment | |
| CN114416131A (en) | Application upgrading method, application upgrading platform, electronic equipment and storage medium | |
| CN112905354A (en) | Service processing method and system for shared memory | |
| CN102378964A (en) | In-process intermediary to create virtual processes | |
| CN112306466A (en) | AAR packet generation method, electronic device, and storage medium | |
| WO2015021848A1 (en) | Method and apparatus for data distribution and concurrence |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |