CN114282210A - Sandbox automatic construction method and system, computer equipment and readable storage medium - Google Patents

Sandbox automatic construction method and system, computer equipment and readable storage medium Download PDF

Info

Publication number
CN114282210A
CN114282210A CN202111671854.9A CN202111671854A CN114282210A CN 114282210 A CN114282210 A CN 114282210A CN 202111671854 A CN202111671854 A CN 202111671854A CN 114282210 A CN114282210 A CN 114282210A
Authority
CN
China
Prior art keywords
sandbox
target
data
industrial
sandbox environment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111671854.9A
Other languages
Chinese (zh)
Inventor
胡宇航
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Rootcloud Technology Co Ltd
Original Assignee
Rootcloud Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Rootcloud Technology Co Ltd filed Critical Rootcloud Technology Co Ltd
Priority to CN202111671854.9A priority Critical patent/CN114282210A/en
Publication of CN114282210A publication Critical patent/CN114282210A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the invention discloses a sandbox automatic construction method, a sandbox automatic construction system, computer equipment and a readable storage medium, wherein the sandbox automatic construction system is applied to the sandbox automatic construction system and is used for carrying out data communication with an industrial internet platform, and the sandbox automatic construction method comprises the following steps: receiving a sandbox construction application sent by a target object, wherein the target object is a user terminal of an industrial internet platform, and the sandbox construction application comprises a demand data set; generating a target sandbox environment building scheme according to the demand data set; synchronizing target industrial data of the industrial internet platform based on the sandbox environment building scheme; building a target sandbox environment according to preset rules, the sandbox environment building scheme and synchronous industrial data; providing a virtual interface of the target sandbox environment for a preset service period to the target object. The sandbox automatic construction method can achieve customization of sandbox service and meet the requirement of rapid landing of industrial application.

Description

Sandbox automatic construction method and system, computer equipment and readable storage medium
Technical Field
The invention relates to the field of industrial internet, in particular to a sandbox automatic construction method, a sandbox automatic construction system, computer equipment and a readable storage medium.
Background
Industrial internet as one of new foundries, a large number of devices have been networked to an industrial internet platform through internet of things technology, and have expanded primary industrial applications such as internet of things presentation. However, the large industrial data that has been accumulated historically for a long time and is voluminous is mostly still not fully used. As an enterprise side with industrial big data, more time and energy are needed in core links such as self business combing and industrial data analysis model research and development, but not in aspects such as environment preparation, data preparation, platform building, platform operation and maintenance and the like, and particularly the problem related to historical stock data can be solved only by participation of an industrial internet platform side.
The method has the advantages that the industrial big data analysis is directly carried out in the original environment in the network-connected industrial big data environment, and the problems that the online service performance is influenced by resource preemption and the data authority control is complex and the like exist.
Disclosure of Invention
In order to solve the above technical problem, an embodiment of the present application provides an automatic sandbox construction method, system, computer device and readable storage medium, and the specific scheme is as follows:
in a first aspect, an embodiment of the present application provides an automatic sandbox building method, which is applied to an automatic sandbox building system, where the automatic sandbox building system is used for performing data communication with an industrial internet platform, and the method includes:
receiving a sandbox construction application sent by a target object, wherein the target object is a user terminal of an industrial internet platform, and the sandbox construction application comprises a demand data set;
generating a target sandbox environment building scheme according to the demand data set;
synchronizing target industrial data of the industrial internet platform based on the target sandbox environment building scheme;
building a target sandbox environment according to preset rules, the sandbox environment building scheme and synchronous industrial data;
providing a virtual interface of the target sandbox environment for a preset service period to the target object.
According to a specific implementation manner of the embodiment of the present application, the sandbox construction application further includes identity information of a target object, and the step of receiving the sandbox construction application sent by the target object includes:
checking whether the identity information of the target object is an industrial Internet platform authorized user terminal;
if the target object is an authorized user terminal of the industrial internet platform, skipping to execute the step of generating the sandbox environment building scheme according to the demand data set;
and if the target object is not the authorized user terminal of the industrial internet platform, ending the sandbox automatic construction process.
According to a specific implementation manner of the embodiment of the application, the step of generating the target sandbox environment building scheme according to the demand data set includes:
judging whether the demand data set in the sandbox construction application comprises all associated data associated with the target sandbox environment construction scheme;
if all the associated data associated with the target sandbox environment building scheme are included, generating the target sandbox environment building scheme according to all the data in the demand data set;
if not, repeatedly executing the step of obtaining the demand data set in the sandbox construction application and judging whether all the associated data associated with the target sandbox environment construction scheme is included after obtaining a new demand data set each time until all the associated data associated with the target sandbox environment construction scheme is included in the demand data set.
According to a specific implementation manner of the embodiment of the application, the step of generating the target sandbox environment building scheme according to the demand data set further includes:
generating a preliminary sandbox environment building scheme according to the demand data set, and displaying the preliminary sandbox environment building scheme to the target object through a display module;
receiving a user-defined demand list fed back by the target object according to the preliminary sandbox environment building scheme;
and generating a target sandbox environment building scheme for executing the data synchronization step according to the user-defined requirement list and the preliminary sandbox environment building scheme.
According to a specific implementation manner of the embodiment of the application, the step of synchronizing the target industrial data of the industrial internet platform based on the target sandbox environment building scheme includes:
determining target industrial data according to the target sandbox environment building scheme;
and backing up the target industrial data from the industrial internet platform according to a preset synchronization period and synchronization time, wherein the preset synchronization period is greater than the data updating period of the industrial internet platform, and the preset synchronization time is later than the data updating time of the industrial internet platform.
According to a specific implementation manner of the embodiment of the application, the step of synchronizing the target industrial data of the industrial internet platform based on the target sandbox environment building scheme further includes:
monitoring industrial data associated with the target industrial data in the industrial internet platform;
and backing up the updated data of the industrial data according to a preset synchronization period and synchronization time.
According to a specific implementation manner of the embodiment of the present application, after the step of providing the virtual interface of the target sandbox environment with the preset service period to the target object, the method further includes:
if the target sandbox environment meets a termination condition, stopping providing the virtual interface of the target sandbox environment for the target object, and releasing resources in the target sandbox environment;
wherein the termination condition includes receiving a termination command of a user or completing the preset service period.
In a second aspect, an embodiment of the present application provides an automatic sandbox building system, configured to perform data communication with an industrial internet platform, where the system includes:
the service management module is used for receiving a sandbox construction application sent by a target object, wherein the target object is a user terminal of an industrial internet platform, and the sandbox construction application comprises a demand data set;
the environment building module is used for generating a target sandbox environment building scheme according to the demand data set;
the data maintenance module is used for synchronizing the target industrial data of the industrial internet platform based on the target sandbox environment construction scheme;
the environment building module is also used for building a target sandbox environment according to a preset rule, the target sandbox environment building scheme and synchronous industrial data;
the service management module is used for providing a virtual interface of the target sandbox environment with a preset service period for the target object.
In a third aspect, an embodiment of the present application provides a computer device, including a processor and a memory, where the memory stores a computer program, and the computer program executes the sandbox automatic building method according to the first aspect when running on the processor.
In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a computer program is stored, and when the computer program runs on a processor, the computer program performs the automatic sandbox building method according to the first aspect.
The embodiment of the application provides a sandbox automatic construction method, a sandbox automatic construction system, computer equipment and a readable storage medium, wherein the sandbox automatic construction system is applied to the sandbox automatic construction system and used for carrying out data communication with an industrial internet platform, and the sandbox automatic construction method comprises the following steps: receiving a sandbox construction application sent by a target object, wherein the target object is a user terminal of an industrial internet platform, and the sandbox construction application comprises a demand data set; generating a target sandbox environment building scheme according to the demand data set; synchronizing target industrial data of the industrial internet platform based on the sandbox environment building scheme; building a target sandbox environment according to preset rules, the sandbox environment building scheme and synchronous industrial data; providing a virtual interface of the target sandbox environment for a preset service period to the target object. The sandbox automatic construction method can achieve customization of sandbox service and meet the requirement of rapid landing of industrial application.
Drawings
In order to more clearly illustrate the technical solution of the present invention, the drawings required to be used in the embodiments will be briefly described below, and it should be understood that the following drawings only illustrate some embodiments of the present invention, and therefore should not be considered as limiting the scope of the present invention. Like components are numbered similarly in the various figures.
Fig. 1 is a schematic flow chart illustrating a method of a sandbox automatic construction method according to an embodiment of the present application;
fig. 2 is a schematic structural diagram illustrating a sandbox base environment constructed by an automatic sandbox constructing method according to an embodiment of the present application;
fig. 3 is a schematic system structure diagram of an automatic sandbox building system according to an embodiment of the present disclosure;
fig. 4 is a functional module schematic diagram illustrating a target sandbox environment constructed by an automatic sandbox construction method according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
Hereinafter, the terms "including", "having", and their derivatives, which may be used in various embodiments of the present invention, are only intended to indicate specific features, numbers, steps, operations, elements, components, or combinations of the foregoing, and should not be construed as first excluding the existence of, or adding to, one or more other features, numbers, steps, operations, elements, components, or combinations of the foregoing.
Furthermore, the terms "first," "second," "third," and the like are used solely to distinguish one from another and are not to be construed as indicating or implying relative importance.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which various embodiments of the present invention belong. The terms (such as those defined in commonly used dictionaries) should be interpreted as having a meaning that is consistent with their contextual meaning in the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein in various embodiments of the present invention.
Cloud sandbox experimental environment products are released by a plurality of cloud service providers, however, the products cannot well meet the requirements of the current scene, an industrial big data sandbox needs to meet the requirements of three aspects of storage, analysis and application verification at the same time, the demand of personalization among the three aspects is particularly high, particularly, in order to meet the demand of rapid landing of industrial application, the customization of sandbox service is realized by combining the architecture of the industrial internet platform and the personalized demands of application development of users, and the method and the system for automatically constructing the sandbox for industrial big data analysis and application research and development are provided.
Referring to fig. 1, an automatic sandbox building method, an automatic sandbox building system, a computer device and a readable storage medium provided in an embodiment of the present application are provided, and the automatic sandbox building method provided in an embodiment of the present application is applied to an automatic sandbox building system, where the automatic sandbox building system is configured to perform data communication with an industrial internet platform, and as shown in fig. 1, the automatic sandbox building method includes:
step S101, receiving a sandbox construction application sent by a target object, wherein the target object is a user terminal of an industrial Internet platform, and the sandbox construction application comprises a demand data set;
in a specific embodiment, the industrial internet platform may be any type of data sharing platform in the prior art, and a plurality of user terminals manage industrial big data by joining the industrial internet platform.
A user can initiate construction application of an industrial big data analysis and application research and development sandbox on an industrial internet platform through a user terminal, wherein the construction application comprises identity data and a demand data set of the user terminal.
And (3) the user puts forward the type of industrial big data service required to be carried out on the industrial Internet platform, such as analysis and application development of the industrial big data service. The industrial internet platform can automatically display the data set which accords with the use permission of the current user, and the user can automatically generate a required data set comprising the data set selected by the user on the industrial internet platform by checking the corresponding data set. The data set comprises data sets with descriptions of explicit metadata definitions, data storage media, data query usage rights, data declaration periods (start time and deadline), data volumes, and the like, such as historical IOT data sets of a certain device and basic data sets of the device.
The process of acquiring the required data set by the industrial internet platform is completed at a data center station of the industrial internet platform, a data extraction work order is submitted to the data center station by the back end of the automatic sandbox building system, a data range, a data set synchronization mechanism and a data synchronization target address are indicated, the data center station completes processing after receiving the work order, and a processing process and an analysis report are given.
It should be understood that the generation of the requirement data set can also be performed in the sandbox automatic construction system, and is not limited in any way.
According to a specific implementation manner of the embodiment of the present application, the sandbox construction application further includes identity information of a target object, and the step of receiving the sandbox construction application sent by the target object includes:
checking whether the identity information of the target object is an industrial Internet platform authorized user terminal;
if the target object is an authorized user terminal of the industrial internet platform, skipping to execute the step of generating the sandbox environment building scheme according to the demand data set;
and if the target object is not the authorized user terminal of the industrial internet platform, ending the sandbox automatic construction process.
In a specific embodiment, after receiving the sandbox construction application sent by the target object, the sandbox automatic construction system automatically detects the identity information of the target object and determines whether the identity information of the target object is an authorized user terminal of the industrial internet platform.
And if the target object is not an authorized user terminal of the industrial internet platform, the automatic sandbox building system cannot directly acquire industrial big data of the target object from the industrial internet platform, and at the moment, the automatic sandbox building system directly ends the automatic sandbox building process. And an unauthorized user terminal is required to determine that industrial big data logs in the industrial internet platform and obtain an authorization command of the industrial internet platform, and then the sandbox construction application of the user terminal can be accepted again.
And if the target object is a user terminal authorized by the industrial internet platform, continuing to execute a subsequent sandbox automatic construction process.
It should be noted that after the target object is determined to be a user terminal authorized by the industrial internet platform, the sandbox automatic construction system may further determine the authorization authority of the target object, the authorization authority of the target object is divided into an administrator authority and a general authority, the user terminal having the administrator authority can use more sandbox services, and the specific sandbox services of the user terminal having the administrator authority and the user terminal having the general authority are different, and may be adaptively changed according to specific conditions in an actual application process, which is not limited herein.
Step S102, generating a target sandbox environment building scheme according to the demand data set;
in a specific embodiment, the sandbox automatic construction system can automatically generate a target sandbox environment construction scheme according to a demand data set of a target object acquired from an industrial internet platform.
After a user submits an effective industrial big data demand, the system can make a preliminary sandbox basic environment building scheme according to the comprehensive condition of a demand data set, wherein the preliminary sandbox basic environment building scheme comprises a server resource list of an Infrastructure as a Service (IaaS) layer of a cloud environment to be built, a Platform as a Service (PaaS) layer component or tool list required by cloud development, a Software as a Service (SaaS) layer Service list subscribed by the user and the like;
after the user obtains the sandbox basic environment to set up the plan, the user can adjust the demand data in each demand data set according to the own demand, such as adding, modifying or deleting a tool deployment list of some function items.
According to a specific implementation manner of the embodiment of the application, the step of generating the target sandbox environment building scheme according to the demand data set includes:
judging whether the demand data set in the sandbox construction application comprises all associated data associated with the target sandbox environment construction scheme;
if all the associated data associated with the target sandbox environment building scheme are included, generating a sandbox environment building scheme according to all the data in the demand data set;
if not, repeatedly executing the step of obtaining the demand data set in the sandbox construction application and judging whether all the associated data associated with the target sandbox environment construction scheme is included after obtaining a new demand data set each time until all the associated data associated with the target sandbox environment construction scheme is included in the demand data set.
In a specific embodiment, in the process of constructing the target sandbox environment construction scheme, a requirement data set sent by a user terminal through an industrial internet platform needs to be judged, and if data in the requirement data set also comprises a dependent or associated data set which is not selected, the sandbox automatic construction system returns a sandbox construction application to the user terminal.
The user terminal can check the data sets which are not selected and comprise the dependency or association data sets in the demand data set on the industrial internet platform, and reselects and submits a new demand data set to the sandbox automatic construction system according to the unselected data sets, so that the sandbox automatic construction system can construct a target sandbox environment construction scheme according to the new demand data set.
According to a specific implementation manner of the embodiment of the application, the step of generating the target sandbox environment building scheme according to the demand data set further includes:
generating a preliminary sandbox environment building scheme according to the demand data set, and displaying the preliminary sandbox environment building scheme to the target object through a display module;
receiving a user-defined demand list fed back by the target object according to the preliminary sandbox environment building scheme;
and generating a target sandbox environment building scheme for executing the data synchronization step according to the user-defined requirement list and the preliminary sandbox environment building scheme.
Further, in a specific embodiment, the sandbox building system further comprises a display module, and in the generation process of the sandbox environment building scheme, the sandbox automatic building system displays the generation process of the sandbox environment building scheme to the target object in real time through the display module.
The user can modify and adjust the demand list according to the real-time process of the sandbox environment building scheme, so that the sandbox building system can update the preliminary sandbox environment building scheme according to the user-defined demand list. The method fully ensures that the target sandbox environment building scheme meets the requirements of users on industrial big data analysis and application research and development.
Step S103, synchronizing target industrial data of the industrial internet platform based on the target sandbox environment building scheme;
in a specific embodiment, in the process of obtaining the target sandbox building scheme, the sandbox automatic building system can also automatically generate a synchronization scheme of the required industrial big data, wherein the synchronization scheme comprises a data set mirroring scheme, a data synchronization period, synchronization time and other synchronization data.
The data set mirroring scheme is to store a piece of data which is the same as the required industrial large data set in a new sandbox environment according to the storage mode of the original platform environment; the synchronous period refers to that incremental data are synchronized according to a certain period time to ensure that sandbox data is consistent with data of the industrial internet platform environment; the synchronization time refers to a point in time at which a synchronization operation is determined to be performed.
The data synchronization scheme comprises stock data synchronization and incremental data synchronization, wherein the stock data synchronization is performed at one time, and the incremental data synchronization is performed through a synchronization mechanism and a monitoring mechanism of the sandbox automatic construction system.
The stock data is industrial big data with huge data quantity accumulated historically, and the incremental data is newly added data which is continuously updated on the basis of the stock data by the industrial internet platform.
To facilitate analysis of industrial big data, the industrial data processed in the sandbox environment needs to be structured data. In the data storage process of the industrial internet platform, a conversion step of converting unstructured data into structured data is often performed through a data middling stage of the industrial internet platform.
The structured data set storage is divided into 3 types of local file storage, distributed file storage and relational database storage, and in order to ensure the integrity of the synchronized data, data synchronization is generally performed in a file backup mode. The backup transfer of the data files is realized through the file-like server middleware, the file backup can be carried out after the distributed files are converted into the local files in consideration of the isolation of the sandbox environment network, and the synchronization of the database table can be realized by means of various database synchronization tools in the prior art.
According to a specific implementation manner of the embodiment of the application, the step of synchronizing the target industrial data of the industrial internet platform based on the target sandbox environment building scheme includes:
determining target industrial data according to the target sandbox environment building scheme;
and backing up the target industrial data from the industrial internet platform according to a preset synchronization period and synchronization time, wherein the preset synchronization period is greater than the data updating period of the industrial internet platform, and the preset synchronization time is later than the data updating time of the industrial internet platform.
In a specific embodiment, after the target sandbox environment building scheme is obtained, the target industrial data required to be used can be determined according to the requirement for building the target sandbox environment, and the sandbox automatic building system completes synchronization of the target industrial data by building a preset data synchronization mechanism.
In the process of completing data synchronization, the sandbox automatic construction system needs to meet the requirement that a preset synchronization period is larger than the updating period of the industrial internet platform, so that when the sandbox automatic construction system synchronizes the industrial data in the industrial internet platform to a new sandbox environment, the updated industrial data in the peer internet platform is synchronized.
The preset synchronization time is required to be later than the data updating time of the industrial internet platform, so that the industrial internet platform does not update data simultaneously in the synchronization process of the sandbox automatic construction system, and the integrity and timeliness of data synchronization are guaranteed.
According to a specific implementation manner of the embodiment of the application, the step of synchronizing the target industrial data of the industrial internet platform based on the target sandbox environment building scheme further includes:
monitoring industrial data associated with the target industrial data in the industrial internet platform;
and backing up the updated data of the industrial data according to a preset synchronization period and synchronization time.
In a specific embodiment, after the sandbox automatic construction system completes synchronization of the stock data in the industrial internet platform, the sandbox automatic construction system needs to synchronize incremental data in the industrial internet platform through a monitoring mechanism.
The sandbox automatic construction system monitors industrial data related to the target industrial data in the industrial internet platform in real time through a monitoring module, and backups incremental data of the target industrial internet according to a preset synchronization period and a synchronization time rule so as to ensure that data in the sandbox basic environment can be kept synchronous with industrial data in the industrial internet platform.
Step S104, building a target sandbox environment according to preset rules, the target sandbox environment building scheme and synchronous industrial data;
in a specific embodiment, when the sandbox automatic construction system generates a target sandbox environment construction scheme according to a sandbox construction application of a target object and completes industrial data synchronization of an industrial internet platform, sandbox service confirmation information is automatically generated, wherein the sandbox service confirmation information includes sandbox use rules, payment cost and sandbox service period. The target sandbox environment includes a sandbox base environment and a synchronized data environment.
The sandbox automatic construction system sends the sandbox service confirmation information to the user terminal, and after a user feeds back a confirmation instruction according to the sandbox service confirmation information, the sandbox automatic construction system starts construction of a target sandbox environment according to the target sandbox environment construction scheme and synchronous industrial data.
Specifically, the manner of the user feeding back the confirmation instruction may be that a "one-key deployment" button displayed on the user terminal is clicked, the user terminal sends the deployment instruction to the sandbox automatic construction system, and the sandbox automatic construction system starts construction of the target sandbox environment according to the deployment instruction.
As shown in fig. 2, a sandbox infrastructure is deployed in a one-key manner, and the continuous progress of cloud technology makes the construction of a complex industrial big data analysis infrastructure more and more convenient, an IaaS service provided by a cloud manufacturer is used to construct an infrastructure, such as a cloud host, a cloud database, cloud load balancing, and the like, and then platform tool deployment of a PaaS layer, such as DevOps, object storage, cloud notebooks, and the like, is realized through a cloud container service on the IaaS basis, and then other subscribed SaaS services can be called through Web pages, and the IaaS and the PaaS can call cloud product APIs provided by mainstream cloud manufacturers at home and abroad through an automation script, so as to realize automatic calling, rapid deployment, and implementation management functions of the sandbox automatic construction system.
And if the user does not feed back a confirmation instruction according to the sandbox service confirmation information within the preset time, the sandbox automatic construction system automatically ends the sandbox environment construction process.
Step S105, providing a virtual interface of the target sandbox environment with a preset service period to the target object.
In a specific embodiment, after the sandbox automatic construction system automatically completes construction of the target sandbox environment in the background, the virtual interface of the target sandbox environment is sent to the target object. The information that can be transmitted by the virtual interface of the target sandbox environment includes a deployment document of the target sandbox environment and an access deployment service list, where the access deployment service list includes information such as an access Uniform Resource Locator (Uniform Resource Locator, URL for short), an access administrator account, and the like.
After the user terminal receives the virtual interface of the target sandbox environment, the user can perform various industrial big data analysis and application development works in the sandbox system.
According to a specific implementation manner of the embodiment of the present application, after the step of providing the virtual interface of the target sandbox environment with the preset service period to the target object, the method further includes:
if the target sandbox environment meets a termination condition, stopping providing the virtual interface of the target sandbox environment for the target object, and releasing resources in the target sandbox environment;
wherein the termination condition includes receiving a termination command of a user or completing the preset service period.
In a specific embodiment, the constructed target sandbox environment has a certain service period, and when the target sandbox environment completes the preset service period, a service expiration reminder is sent to the user terminal.
And after receiving the service expiration reminder, the user can select a renewal sandbox service, and the sandbox automatic construction system can prolong the service period of the target sandbox environment according to the renewal sandbox service information.
If the user does not select the renewal sandbox service, the sandbox automatic construction system automatically terminates the sandbox service at the time of completing the service period and releases the resources occupied in the target sandbox environment, the created sandbox bottom layer IaaS is cancelled, and the resources occupied in the target sandbox environment include storage resources and computing resources.
It should be appreciated that the industrial internet platform can also reclaim industrial data resources in the sandbox when the target sandbox environment completes the service period.
In addition, if the user wants to terminate the sandbox service in advance in the service period, a termination application can be submitted to the sandbox automatic construction system through the industrial internet platform, and the sandbox automatic construction system can terminate the sandbox service in advance according to the termination application and release resources occupied in the target sandbox environment.
The sandbox automatic construction method is not limited by specific products of the cloud platform, has better compatibility, and can better meet the environment use requirement of rich industrial big data analysis. The method can flexibly expand and contract as required in the aspects of storage and computing resources, so that a user who needs to analyze the industrial big data does not need to pay more attention to the complicated construction problem of the industrial big data analysis environment, and can quickly and comprehensively know the data profile of the existing industrial big data and learn and master the related knowledge of the industrial big data technology.
Referring to fig. 3, for an embodiment of the present application, there is provided an automatic sandbox building system for data communication with an industrial internet platform, where as shown in fig. 3, the automatic sandbox building system includes:
the service management module is used for receiving a sandbox construction application sent by a target object, wherein the target object is a user terminal of an industrial internet platform, and the sandbox construction application comprises a demand data set;
the environment building module is used for generating a target sandbox environment building scheme according to the demand data set;
the data maintenance module is used for synchronizing target industrial data of the industrial internet platform based on the sandbox environment construction scheme;
the environment building module is also used for building a target sandbox environment according to a preset rule, the sandbox environment building scheme and synchronous industrial data;
the service management module is further configured to provide a virtual interface of the target sandbox environment with a preset service period to the target object.
More specifically, the service management module is configured to receive a front-end sandbox service creation application, store generated sandbox service confirmation information, manage a valid period of the sandbox service, manage a renewal of the sandbox service, terminate the sandbox service, and the like;
the authority control module is used for butting a uniform identity authentication function module of the industrial internet platform, acquiring tenant information of the industrial internet platform and a data set list authorized by the tenant, and managing a target sandbox environment network environment and a related tool or service account;
the environment building module is used for realizing automatic deployment of the sandbox basic environment by means of the DevOps capability of the industrial internet platform after a user submits a sandbox basic environment personalized demand scheme;
the data maintenance module is used for butting a data center of an industrial internet platform, synchronizing industrial big data required by a user to a sandbox environment, forming a required data set mirror image, and realizing synchronization of incremental data by using a scheduling tool;
the monitoring and auditing module is used for monitoring basic running condition indexes of the target sandbox environment and various use operation records; and monitoring the data synchronization condition, wherein the related monitoring data are displayed in a visual report form at the front end.
As shown in fig. 4, based on the location of the functions of the authority control and monitoring audit module, the sandbox automatic construction system further provides the sub-functions of sandbox services such as account management, asset management, application management, authority management, connection management, log audit, configuration management, monitoring reports, value added services and the like for the user; after the target sandbox environment is built, the user can log in the sandbox service management portal and can enjoy the functional services;
the sandbox management module is used for synchronizing user authority system information of users on an industrial Internet platform, and a sandbox administrator can create and maintain unique user groups and users under the user groups in the sandbox environment and check information of authorized assets, authorized applications and the like of the users;
the asset management comprises two major types of asset management of basic environment assets and data assets, wherein the basic environment assets are mainly a cloud IaaS resource list and a related account authority list in use, and only a sandbox administrator can create a common account of the basic environment assets for being distributed to common sandboxes for use; the sandbox administrator can also create new data assets, upload data files from a user terminal to basic environment assets of the sandbox environment locally, and share the data files for a team to use;
the application management relates to database application, cloud containers, cloud notebooks, and cloud object storage; the database application supports the application connection of the mainstream database in the industry to carry out configuration management; cloud containers support mainstream container management technologies in the industry such as Kubernetes and the like; the cloud notebook has two sources, one is a notebook cloud product of a cloud manufacturer customized by a user, and the other is a notebook such as a jupyter notebook which is required to be installed in a sandbox environment by the user; the cloud object storage displays the required industrial big data set catalog and the details thereof stored on the cloud object storage;
the authority management comprises management of two types of authorization information, namely asset authorization and application authorization: a base environment authorization of the asset authorizations is assigned by a sandbox administrator to a base environment account created by a sandbox user; data asset authorizations in asset authorizations are added, modified, and deleted by sandbox administrators the right of a sandbox account to access data assets;
the connection management helps a user to manage history and online connection, a web terminal, FTP use, a data synchronization subtask, cloud notebook connection and other conditions, a history connection record is inquired in a selected history time period, the web terminal refers to a tool for connecting infrastructure resources at a web end, and corresponding records are inquired if the FTP, the data synchronization, the cloud notebook and the like are used;
log audit users can select a historical time period to inquire log contents including log logs, FTP logs, operation logs, administrator account modification password logs and user-defined logs, wherein the user-defined logs are monitoring program logs which are added by users in a sandbox system, and newly added log display items are configured through configuration management, so that the logs of the sandbox system can be conveniently and uniformly and classified viewed by the users;
configuration management refers to information configuration items of a system level in a sandbox system, including but not limited to mail setting, LDAP setting, terminal setting, security setting, custom log setting, monitoring report configuration and the like, and only an administrator has configuration permission;
the monitoring report forms are visual display of monitoring report form configuration items in configuration management, and are displayed in a Dashboard form, and basic information display items comprise: the method comprises the following steps of 1, counting the total number of users, the total number of basic assets, the total number of data assets, the total number of applications, the number of online users, the number of online connections, a failed data synchronization subtask list, an active user Top10 and the like, wherein the others are key index data reports which are added by users and expected to be displayed;
the value-added service refers to an application scene of comprehensive monitoring and intelligent data analysis and prediction of the data in the using process of the sandbox system, and is provided only when a user creates the sandbox through special customization, such as sandbox storage computing cluster capacity expansion prediction, operation abnormity warning, performance monitoring warning, log NLP analysis and the like, and all the services need to be agreed by the user to bury point sampling in the sandbox system and are sent to a platform end for AI model prediction.
The sandbox service management portal function module is characterized in that all sandbox administrator accounts are visible after logging in, and a functional interface which can be checked by a corresponding administrator can not be opened by a sandbox common account.
In addition, the embodiment of the application can also provide a specific implementation process of the automatic sandbox building system used by a user, for example, the user has a relatively clear industrial big data analysis target, the number of users using the sandbox for development work is relatively small (not more than 3 people), the driving behavior analysis of the equipment is expected to be performed by using IOT data of certain type of equipment for a period of time, the driving grade of the equipment in a future period of time is predicted by using artificial intelligence algorithm modeling, the building of the sandbox environment of the scene is realized by using object storage and cloud notebook service provided by a cloud manufacturer, the big data analysis and application research and development work of the required equipment are realized, the size of an object storage space and the size of a cloud notebook computing memory can be estimated according to the size of a data set to be analyzed, a data console end of the analysis equipment on an industrial internet platform is responsible for storing an incremental data subset to a specified object storage directory, a user accesses the cloud notebook through the Internet, and the connection object stores directory data to perform work such as development, exploration, debugging and the like of an analysis modeling program; the monitoring audit module can display the condition of object storage directory data, the service condition of the cloud notebook and the performance condition of the cloud notebook, and finally, the sandbox service is stopped to cancel and release related resources in advance through effect verification after the model is developed.
Another user wants to perform industrial big data analysis and application research and development on IOT data of more than TB level of ten thousand devices of a certain device in the last 3 years, a special analysis team is researched and developed, the number of members exceeds 10, the submitted industrial big data set requirement also comprises metadata of an internet of things device, device basic data and a service data table data set of the device in other service systems, the sandbox automatic construction system of the application rapidly provides a sandbox system basic environment construction plan according to historical data of the sandbox automatic construction system in a data framework of an industrial internet platform, a scheme with high configuration is selected in the aspects of calculation and storage, in order to meet the multi-aspect exploration requirement of the sandbox automatic construction system, a plurality of cloud host Linux systems are applied to a certain cloud manufacturer to construct a big data set group of an HA high-availability cluster system, Hadoop related components, spark distributed computing frames, kafka message queue (used for transmitting real-time data streams) and the like, a python program language operating environment is configured on each node, and a jupyter notebook is configured to facilitate flexible single-machine and distributed computing script development; meanwhile, in consideration of the visual editing requirement, a cloud host of the windows system is applied for installing a data analysis tool such as pycharm and the like which needs to be installed in the windows environment; and finally, business intelligent application of the platform is applied to carry out self-service visual report development for data analysis result display and effect verification, and a user also submits new data demand and sandbox service renewal application in the using process of the sandbox system.
In addition, an embodiment of the present application further provides a computer device, which includes a processor and a memory, where the memory stores a computer program, and the computer program executes the sandbox automatic construction method in the above embodiment when running on the processor.
The embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored, and when the computer program runs on a processor, the method for automatically constructing a sandbox in the above embodiments is executed.
To sum up, the embodiment of the present application provides an automatic sandbox construction method, system, computer device and readable storage medium, which can ensure that the industrial big data analysis and application implementation can be quickly performed based on the existing industrial big data link, and the industrial application developed in the sandbox environment can be quickly submitted to the production environment for deployment and on-line through simple operations such as configuration modification and dependency package addition, so that the influence on the original industrial internet platform service is minimal, and the support and guarantee for promoting the industrial big data development and landing are maximal. The sandbox automatic construction method in the embodiment of the application is not limited by specific products of the cloud platform, has better compatibility, and can meet the rich environment use requirements of industrial big data analysis. In addition, for specific implementation of the sandbox automatic construction system, the computer device and the computer-readable storage medium provided in the embodiment of the present application, reference may be made to the specific implementation of the method embodiment described above, which is not described in detail herein.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative and, for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, each functional module or unit in each embodiment of the present invention may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention or a part of the technical solution that contributes to the prior art in essence can be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a smart phone, a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention.

Claims (10)

1. An automatic sandbox building method is applied to an automatic sandbox building system, the automatic sandbox building system is used for being in data communication with an industrial internet platform, and the method comprises the following steps:
receiving a sandbox construction application sent by a target object, wherein the target object is a user terminal of an industrial internet platform, and the sandbox construction application comprises a demand data set;
generating a target sandbox environment building scheme according to the demand data set;
synchronizing target industrial data of the industrial internet platform based on the target sandbox environment building scheme;
building a target sandbox environment according to preset rules, the target sandbox environment building scheme and synchronous industrial data;
providing a virtual interface of the target sandbox environment for a preset service period to the target object.
2. The method of claim 1, wherein the sandbox construction application further includes identity information of the target object, and the step of receiving the sandbox construction application sent by the target object includes:
checking whether the identity information of the target object is an industrial Internet platform authorized user terminal;
if the target object is an authorized user terminal of the industrial internet platform, skipping to execute the step of generating the sandbox environment building scheme according to the demand data set;
and if the target object is not the authorized user terminal of the industrial internet platform, ending the sandbox automatic construction process.
3. The method of claim 1, wherein the step of generating a target sandbox environment build scheme from the demand data set comprises:
judging whether the demand data set in the sandbox construction application comprises all associated data associated with the target sandbox environment construction scheme;
if all the associated data associated with the target sandbox environment building scheme are included, generating the target sandbox environment building scheme according to all the data in the demand data set;
if not, repeatedly executing the step of obtaining the demand data set in the sandbox construction application and judging whether all the associated data associated with the target sandbox environment construction scheme is included after obtaining a new demand data set each time until all the associated data associated with the target sandbox environment construction scheme is included in the demand data set.
4. The method of claim 1, wherein the step of generating a target sandbox environment build scheme from the demand data set further comprises:
generating a preliminary sandbox environment building scheme according to the demand data set, and displaying the preliminary sandbox environment building scheme to the target object through a display module;
receiving a user-defined demand list fed back by the target object according to the preliminary sandbox environment building scheme;
and generating a target sandbox environment building scheme for executing the data synchronization step according to the user-defined requirement list and the preliminary sandbox environment building scheme.
5. The method of claim 1, wherein the step of synchronizing the target industrial data of the industrial internet platform based on the target sandbox environment building scheme comprises:
determining target industrial data according to the target sandbox environment building scheme;
and backing up the target industrial data from the industrial internet platform according to a preset synchronization period and synchronization time, wherein the preset synchronization period is greater than the data updating period of the industrial internet platform, and the preset synchronization time is later than the data updating time of the industrial internet platform.
6. The method of claim 5, wherein the step of synchronizing the target industrial data of the industrial internet platform based on the target sandbox environment building scheme further comprises:
monitoring industrial data associated with the target industrial data in the industrial internet platform;
and backing up the updated data of the industrial data according to a preset synchronization period and synchronization time.
7. The method of claim 1, wherein after the step of providing the target object with the virtual interface of the target sandbox environment for the preset service period, the method further comprises:
if the target sandbox environment meets a termination condition, stopping providing the virtual interface of the target sandbox environment for the target object, and releasing resources in the target sandbox environment;
wherein the termination condition includes receiving a termination command of a user or completing the preset service period.
8. An automated sandbox building system for data communication with an industrial internet platform, said system comprising:
the service management module is used for receiving a sandbox construction application sent by a target object, wherein the target object is a user terminal of an industrial internet platform, and the sandbox construction application comprises a demand data set;
the environment building module is used for generating a target sandbox environment building scheme according to the demand data set;
the data maintenance module is used for synchronizing the target industrial data of the industrial internet platform based on the target sandbox environment construction scheme;
the basic environment building module is also used for building a target sandbox environment according to preset rules, the target sandbox environment building scheme and synchronous industrial data;
the service management module is used for providing a virtual interface of the target sandbox environment with a preset service period for the target object.
9. A computer arrangement comprising a processor and a memory, said memory storing a computer program which, when run on said processor, performs the sandbox auto-construction method of any one of claims 1 to 7.
10. A computer-readable storage medium, in which a computer program is stored which, when run on a processor, performs the method of automatically building a sandbox according to any one of claims 1-7.
CN202111671854.9A 2021-12-31 2021-12-31 Sandbox automatic construction method and system, computer equipment and readable storage medium Pending CN114282210A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111671854.9A CN114282210A (en) 2021-12-31 2021-12-31 Sandbox automatic construction method and system, computer equipment and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111671854.9A CN114282210A (en) 2021-12-31 2021-12-31 Sandbox automatic construction method and system, computer equipment and readable storage medium

Publications (1)

Publication Number Publication Date
CN114282210A true CN114282210A (en) 2022-04-05

Family

ID=80879438

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111671854.9A Pending CN114282210A (en) 2021-12-31 2021-12-31 Sandbox automatic construction method and system, computer equipment and readable storage medium

Country Status (1)

Country Link
CN (1) CN114282210A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116991563A (en) * 2023-09-28 2023-11-03 之江实验室 Queue generating method and device supporting rapid sandbox construction

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116991563A (en) * 2023-09-28 2023-11-03 之江实验室 Queue generating method and device supporting rapid sandbox construction
CN116991563B (en) * 2023-09-28 2023-12-22 之江实验室 Queue generating method and device supporting rapid sandbox construction

Similar Documents

Publication Publication Date Title
JP6774499B2 (en) Providing access to hybrid applications offline
KR102121159B1 (en) Event-driven blockchain workflow processing
CN103380423B (en) For the system and method for private cloud computing
CN114008605A (en) Big data application lifecycle management
CN111401029B (en) Document version updating system and method based on document partition and collaborative editing
CN109492013B (en) Data processing method, device and system applied to database cluster
CN104380261A (en) Locally backed cloud-based storage
CN109144785A (en) Method and apparatus for Backup Data
CN110162334B (en) Code management method, device and storage medium
CN111327613A (en) Distributed service authority control method and device and computer readable storage medium
KR101086620B1 (en) Smart office system and server for managing the sames and method for managing the sames
CN110895534A (en) Data splicing method, device, medium and electronic equipment
CN113220633A (en) Unified file coding management method and system
CN114282210A (en) Sandbox automatic construction method and system, computer equipment and readable storage medium
CN112699118A (en) Data synchronization method, corresponding device, system and storage medium
CN117235400A (en) Unified multi-platform portal system based on Kafka technology
CN114006815A (en) Automatic deployment method and device for cloud platform nodes, nodes and storage medium
CN108833328B (en) Cloud management method and device, storage medium and processor
EP4130982A1 (en) Network-based solution module deployment platform
CN108959309B (en) Method and device for data analysis
US10728323B2 (en) Method and apparatus for operating infrastructure layer in cloud computing architecture
CN113449035B (en) Data synchronization method, device, computer equipment and readable storage medium
CN103401715B (en) The management method of across a network emergency resources and system
US11953972B2 (en) Selective privileged container augmentation
US20230108031A1 (en) Computer System and Method for Accessing User Data that is Distributed Within a Multi-Zone Computing Platform

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination