CN115086356A

CN115086356A - Cloud data management method based on competition management platform

Info

Publication number: CN115086356A
Application number: CN202210670176.2A
Authority: CN
Inventors: 高伟; 章煌创; 潘志一; 徐春香; 赵海英
Original assignee: Peking University Shenzhen Graduate School
Current assignee: Peking University Shenzhen Graduate School
Priority date: 2022-06-14
Filing date: 2022-06-14
Publication date: 2022-09-20

Abstract

The cloud data management method based on the competition management platform comprises the following steps: s1, resource hosting; s2, downloading a question data set; and S3, submitting a question data set. The invention solves the problem of insufficient bandwidth, can support concurrent user access, and can simultaneously support mass user online access; the data sharing can be supported, and the security mechanism is guaranteed; the system can provide an administrator interface, support authorization management, be freely controlled, reduce resource waste and be used for performing daily maintenance and system monitoring and data reliability under special conditions; the method can flexibly expand or reduce resources at any time according to application requirements, and has the advantages of fast overall service deployment, fast online service, high availability and high disaster tolerance, simplified operation and maintenance flow and low operation and maintenance cost.

Description

Cloud data management method based on competition management platform

Technical Field

The invention relates to the field of competition platforms, in particular to a cloud data management method based on a competition management platform.

Background

Currently, in the field of competition platforms, the outstanding main problems exist in that for a single local cloud computing center or a server of a renting cloud computing center, a large number of data sets need to be provided for the competition platform, and the bottleneck problems of insufficient bandwidth and resource waste exist along with the increase of the number of users. Meanwhile, the problems of data sharing, data security, authorized access and the like need to be met on the basis. The current general competition management platform can deal with a small amount of data and users. However, once the platform is developed rapidly and vigorously, the problems of server bandwidth, data sharing, scheduling, safety and the like are particularly obvious when the platform faces massive data and users. It is far from solving these problems that only a single local cloud computing center or a server of a leased cloud computing center.

Therefore, the work that needs to be done at present is: when the competition platform runs, the problems of insufficient bandwidth, data sharing, data safety, authorized access and the like of the platform are solved based on the cloud data management method.

The business requirement is that a large server bandwidth is needed in a part of time period of a competition platform, and a single server cannot meet the requirement. Therefore, a solution is needed that can obtain a large amount of download bandwidth in a short time. At the same time, it is desirable to ensure that the downloaded file has the proper authority control and management mechanism.

The difficulty in solving the above problems and defects is focused on how to break through bandwidth limitation in a massive data set, and simultaneously satisfy the problems of data security sharing, access and authorization.

The significance of solving the problems and the defects is as follows: if a cloud data management method based on a competition management platform can be designed, a good bandwidth processing, data sharing and safety management mode is provided for the competition management platform, efficiency of competition users and platform managers is improved, waste of platform resources is reduced, and the method has great significance for promoting development of an online scientific research competition platform.

Disclosure of Invention

The invention provides a cloud data management method based on a competition management platform, which solves the problems of bandwidth and data security and the like of mass data access of the competition management platform, can be controlled freely according to the requirement of the competition platform in a targeted manner, and reduces resource waste.

The technical scheme of the invention is as follows:

the invention discloses a cloud data management method based on a competition management platform, which comprises the following steps: s1, resource hosting; s2, downloading a question data set; and S3, submitting a question data set.

Preferably, in the cloud data management method based on the competition management platform, in step S1, a massive data set is stored in the cloud data management method based on a third-party cloud storage platform, and corresponding access interfaces are set according to different requirements.

Preferably, in the cloud data management method based on the competition management platform, in step S2, the static file download link with different permissions is set to manage according to different authorizations.

Preferably, in the cloud data management method based on the competition management platform, in step S2, during downloading of the competition question data set, the management manner of downloading the competition question data file is as follows: firstly, an administrator uploads a game question file, stores the game question file on a cloud storage server, and sets a download link; setting an authorization deadline operation for the file; secondly, linking and accessing a file information management library by a user through a download link, and providing file download after the file information library passes verification through a password judgment mode; finally, the user side receives the feedback of the file information base and whether the file information base can be downloaded or not; if yes, triggering downloading; if not, the prompt time of the download failure is expired, and the download fails.

Preferably, in the cloud data management method based on the competition management platform, in step S3, the submission is performed by a git address or a suitable file combination is selected for submission.

Preferably, in the cloud data management method based on the competition management platform, in step S3, the submitting of the competition question data includes: uploading files to be submitted to a cloud server by a player, wherein the player can also directly input a git address to submit, and the system can automatically authenticate and pull related files; the player browses all files uploaded to the cloud server by the team to which the player belongs, and selects a proper file combination from the files to submit; after the submission is successful or fails due to various reasons, the player can obtain corresponding feedback on the submission page; after the submission is successful, the player can see the corresponding submission in the 'my submission' column, and the status of the initial submission is 'waiting', which represents that the submission is waiting for review and audit; after the auditing and scoring are finished, the submitting state is changed into 'evaluating and finishing', and the final submitting score and the running information can be checked by the player under the permission of the administrator.

According to the technical scheme of the invention, the beneficial effects are as follows:

the invention solves the problem of insufficient bandwidth, can support concurrent user access, and can simultaneously support mass user online access; the data sharing can be supported and the security mechanism is guaranteed; the system can provide an administrator interface, support authorized management, be freely controlled, reduce resource waste, and be used for daily maintenance and system monitoring and data reliability under special conditions.

For a better understanding and appreciation of the concepts, principles of operation, and effects of the invention, reference will now be made in detail to the following examples, taken in conjunction with the accompanying drawings, in which:

drawings

In order to more clearly illustrate the detailed description of the invention or the technical solutions in the prior art, the drawings that are needed in the detailed description of the invention or the prior art will be briefly described below.

FIG. 1 is a flow chart of a cloud data management method based on a competition management platform according to the present invention;

FIG. 2 is a management of the download of a game title data file;

FIG. 3 is a page diagram showing how players can obtain feedback on a submit page after the submission of the contest question data is successful or fails for various reasons;

FIG. 4 is a page diagram of the final scores and run information that the player can view when the administrator allows after the end of the review scoring.

Detailed Description

In order to make the objects, technical means and advantages of the present invention more apparent, the present invention will be further described in detail with reference to the accompanying drawings and specific examples. These examples are merely illustrative and not restrictive of the invention.

The invention discloses a cloud data management method based on a competition management platform, which comprises the following steps:

s1, resource hosting. And storing a mass data set in a cloud storage platform (Tencent cloud) of a third party, and setting corresponding access interfaces according to different requirements.

And S2, downloading the question data set. And managing by setting static file download links with different authorities corresponding to different authorizations.

And S3, submitting a question data set. Submit with git address or select the appropriate combination of files to submit.

The cloud data management method based on the competition management platform solves the problem of insufficient bandwidth by relying on a third-party cloud storage platform (Tencent cloud); the problems of data sharing, safety management and the like are solved by designing static links and authority control. Static linking is the practice of adding the contents of the library to the executable program by the linker at the time of linking, and may set the age. A linker is a stand-alone program that links one or more libraries or object files (previously generated by a compiler or assembler) to a block generating executable.

The scheme is shown below by taking the downloading and submitting of the subject data files of the enlightenment platform (openI) and the 2021 national artificial intelligence competition platform as an example.

Downloading of question data files

101. And the administrator converts the file uploaded to the cloud into a public download link for the player to download through a 'generate static file download link' dialog box of the theme configuration page.

102. The static download link is managed in a mode of 'data timeliness setting'. That is, when the administrator user uploads a file, the uploader fills out the file expiration time. Download link automatic stop service upon expiration

103. Players can download data using a download link embedded in the title.

The management method of the downloading of the game data file is shown in fig. 2. The method specifically comprises the following steps: firstly, the administrator uploads and stores the game question file on the cloud storage server, and sets a download link. Setting an authorization deadline and other operations for the file; secondly, the user links and accesses the file information management library by downloading the link. The file information base provides file downloading after the verification is passed through a mode of judging passwords and the like; and finally, the user side receives the feedback of the file information base and judges whether the file information base can be downloaded. If yes, triggering downloading; if not, the prompt time of the download failure is expired, and the download fails.

Second, data submission of contest questions

The submission content of the artificial intelligence competition is generally large (including various machine learning models), and the direct submission to a server can cause network congestion and waste of storage space, so that the competition submission problem of players is divided into two parts:

201. and uploading the file to be submitted to a cloud server by the player. The player can also directly input the git address for submission, and the system can automatically authenticate and pull the related file.

202. The player browses all files uploaded to the cloud server by the team, and selects a proper file combination from the files to submit.

203. After the submission is successful or fails for various reasons, the player can obtain corresponding feedback on the submission page, as shown in fig. 3.

204. After the submission is successful, the player can see the corresponding submission in the "my submissions" column, and the status of the initial submission is "waiting," indicating that the submission is waiting for review and review.

205. After the auditing scoring is finished, the submitting state is changed into 'evaluating finished', and the final submitting score and running information can be checked by the player under the permission of the administrator, as shown in fig. 4.

The method of the invention also has the following advantages:

1) the service flexible expansion is realized, the estimation of the application resource usage is necessary, the resource waste is easily caused by overhigh estimation, the card is easily caused by overlow estimation of a website and is difficult to normally operate, and the pain point is well solved by trusting the website on a third-party cloud storage platform. The capacity can be flexibly expanded or the resources can be flexibly reduced at any time according to the application requirements.

2) The whole service is deployed quickly, and the service is on-line quickly. Time cost can affect various aspects, and based on the cloud server, a user can quickly call resources to obtain a complete cloud server, and the quick delivery cannot be provided by a traditional physical server.

3) Has high availability and high disaster tolerance. Hardware failure occurs in the use of the physical host, and a great deal of time is consumed for maintenance. The cloud server has the functions of snapshot backup, multiple copy disaster tolerance, heat migration and the like, and even if a single-point hardware fault occurs, the cloud server can be rapidly and automatically migrated to other cloud servers to continue normal use.

4) The operation and maintenance flow is simplified, and the operation and maintenance cost is reduced. By using the cloud server, maintenance work of all bottom layer server hardware and networks is provided by a service provider, so that the cost can be reduced to a great extent.

The foregoing description is of the preferred embodiment of the concepts and principles of operation in accordance with the invention. The above-described embodiments should not be construed as limiting the scope of the claims, and other embodiments and combinations of implementations according to the inventive concept are within the scope of the invention.

Claims

1. A cloud data management method based on a competition management platform is characterized by comprising the following steps:

s1, resource hosting;

s2, downloading a question data set; and

and S3, submitting a question data set.

2. The cloud data management method based on the competition management platform as claimed in claim 1, wherein in step S1, a massive data set is stored in the cloud data management method based on a third-party cloud storage platform, and corresponding access interfaces are set according to different requirements.

3. The cloud data management method based on the competition management platform of claim 1, wherein in step S2, management is performed by setting static file download links with different permissions corresponding to different authorizations.

4. The cloud data management method based on the competition management platform as claimed in claim 1, wherein in step S2, during the downloading of the competition question data sets, the management manner of the downloading of the competition question data files is as follows: firstly, an administrator uploads a game question file, stores the game question file on a cloud storage server, and sets a download link; setting an authorization deadline operation for the file; secondly, linking and accessing a file information management library by a user through a download link, wherein the file information library provides file download after passing verification through a password judgment mode; finally, the user side receives the feedback of the file information base and judges whether the file information base can be downloaded; if yes, triggering downloading; if not, the prompt time of the download failure is expired, and the download fails.

5. The cloud data management method based on the competition management platform of claim 1, wherein in step S3, the submission is performed by a git address or a proper file combination is selected for submission.

6. The cloud data management method based on the competition management platform of claim 1, wherein in step S3, the submitting of the competition question data includes:

uploading files to be submitted to a cloud server by a player, wherein the player can also directly input a git address to submit, and the system can automatically authenticate and pull related files;

the player browses all files uploaded to the cloud server by the team to which the player belongs, and selects a proper file combination from the files to submit;

after the submission is successful or fails due to various reasons, the player can obtain corresponding feedback on the submission page;

after the submission is successful, the player can see the corresponding submission in the 'my submission' column, and the initial submission state is 'waiting', which represents that the submission is waiting for review and audit;

after the auditing and scoring are finished, the submitting state is changed into 'evaluating and finishing', and the final submitting score and the running information can be checked by the player under the permission of the administrator.