CN111611523B - Resource management system, resource management method, device and storage medium - Google Patents

Resource management system, resource management method, device and storage medium Download PDF

Info

Publication number
CN111611523B
CN111611523B CN202010506710.7A CN202010506710A CN111611523B CN 111611523 B CN111611523 B CN 111611523B CN 202010506710 A CN202010506710 A CN 202010506710A CN 111611523 B CN111611523 B CN 111611523B
Authority
CN
China
Prior art keywords
resource
resources
content
release
task
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010506710.7A
Other languages
Chinese (zh)
Other versions
CN111611523A (en
Inventor
吕三龙
王松
黄燕达
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bigo Technology Singapore Pte Ltd
Original Assignee
Guangzhou Baiguoyuan Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Baiguoyuan Information Technology Co Ltd filed Critical Guangzhou Baiguoyuan Information Technology Co Ltd
Priority to CN202010506710.7A priority Critical patent/CN111611523B/en
Publication of CN111611523A publication Critical patent/CN111611523A/en
Application granted granted Critical
Publication of CN111611523B publication Critical patent/CN111611523B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/951—Indexing; Web crawling techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/953—Querying, e.g. by the use of web search engines
    • G06F16/9535—Search customisation based on user profiles and personalisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4532—Management of client data or end-user data involving end-user characteristics, e.g. viewer profile, preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • H04N21/8405—Generation or processing of descriptive data, e.g. content descriptors represented by keywords
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The disclosure provides a resource management system, a resource management method, equipment and a storage medium, and belongs to the technical field of Internet. The system comprises: the resource acquisition device is used for acquiring resources according to preset resource acquisition conditions and adding the resources meeting the preset conditions into a content resource pool of the content center; and the resource release device is used for acquiring the resources from the content resource pool according to preset resource release conditions and releasing the resources subjected to release pretreatment to the appointed application. According to the method and the device, the resources are selectively acquired through the preset resource acquisition conditions, and the preset resource acquisition conditions can meet the preference of the user, so that the acquired resources are more targeted. And the obtained resources are added into the content resource pool, and the resources in the content resource pool are oriented to different applications and can be released into different applications, so that the resource multiplexing rate is higher.

Description

Resource management system, resource management method, device and storage medium
Technical Field
The disclosure relates to the technical field of internet, and in particular relates to a resource management system, a resource management method, a resource management device and a storage medium.
Background
In recent years, applications focused on content are rapidly developed, and the richness of content resources and distribution efficiency are important. Taking short video as an example, in order to attract users, operators of short video applications need to acquire resources of interest to more users from the internet. Considering that users in different regions and different cultures have different favorites, and resources which are not disclosed or related to user privacy may exist on the network, how to manage the resources of the short video application so as to obtain more legal resources which accord with the favorites of the users and furthest improve the multiplexing rate of the resources becomes a concern of those skilled in the art.
At present, when managing resources of short video applications, the related art mainly adopts the following two modes:
in the first mode, the updating time of the target website is estimated, when the updating time of the target website is reached, resources are obtained from the target website in a crawler mode, and then the obtained resources are directly released to the appointed short video application.
And in the second mode, acquiring resources from the target website in a crawler mode, storing the acquired resources into different resource pools according to the content of the resources, editing the resources in the different resource pools, and then publishing the edited resources to the appointed short video application.
However, the two ways acquire all updated resources of the target website, the updated resources do not necessarily conform to the preference of the user group for the short video application, the acquired resources lack pertinence, and the acquired resources are directionally released to the designated short video application, so that the resource multiplexing rate is low.
Disclosure of Invention
The embodiment of the disclosure provides a resource management system, a resource management method, a resource management device and a storage medium, which can improve the pertinence of acquired resources and the multiplexing rate of release resources. The technical scheme is as follows:
in one aspect, there is provided a resource management system, the system comprising: a resource acquisition device, a content center and a resource release device;
the resource acquisition device is used for acquiring resources according to preset resource acquisition conditions, adding the resources meeting the preset conditions into a content resource pool of the content center, wherein the content resource pool corresponds to at least one application, and the resources in the content resource pool can be released into the at least one application;
the resource release device is used for acquiring resources from the content resource pool of the content center according to preset resource release conditions and releasing the resources after release pretreatment to the appointed application.
In another aspect, a resource management method is provided, where the method is applied to a resource management system, the resource management system includes a resource acquisition device, a content center, and a resource publishing device, and the method includes:
the resource acquisition device acquires resources according to preset resource acquisition conditions, adds the resources meeting the preset conditions into a content resource pool of the content center, wherein the content resource pool corresponds to at least one application, and the resources in the content resource pool can be released into the at least one application;
and the resource release device acquires resources from a content resource pool of the content center according to preset resource release conditions, and releases the resources subjected to release pretreatment to the appointed application.
In another aspect, a machine device is provided, where the machine device includes a processor and a memory, where the memory stores at least one program code, and the at least one program code is loaded and executed by the processor to implement the resource management method described above.
In another aspect, a computer readable storage medium having stored therein at least one program code loaded and executed by a processor to implement the above-described resource management method is provided.
The technical scheme provided by the embodiment of the disclosure has the beneficial effects that:
the resources are selectively acquired through the preset resource acquisition conditions, and the preset resource acquisition conditions can meet the preference of the user, so that the acquired resources are more targeted. And the obtained resources are added into the content resource pool, and the resources in the content resource pool are oriented to different applications and can be released into different applications, so that the resource multiplexing rate is higher.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and other drawings may be obtained according to these drawings without inventive effort for a person of ordinary skill in the art.
FIG. 1 is an architecture diagram of a resource management system provided by an embodiment of the present disclosure;
FIG. 2 is a diagram of data interactions of various devices within a resource management system provided by an embodiment of the present disclosure;
fig. 3 is a schematic diagram of a service unit for creating a resource acquisition task in a resource scheduling device according to an embodiment of the present disclosure;
FIG. 4 is a schematic diagram of a resource acquisition device provided by an embodiment of the present disclosure;
fig. 5 is a schematic diagram of a service unit for acquiring task details and data in a resource scheduling device according to an embodiment of the present disclosure;
fig. 6 is a schematic diagram of a service unit for creating a resource publishing task in a resource scheduling apparatus according to an embodiment of the present disclosure;
FIG. 7 is a schematic diagram of a resource publishing device according to an embodiment of the present disclosure;
fig. 8 is a schematic diagram of a service unit for publishing task details and data in a resource scheduling device according to an embodiment of the present disclosure;
FIG. 9 is a flow chart of a method of resource management provided by an embodiment of the present disclosure;
FIG. 10 is a schematic diagram of a resource management system according to an embodiment of the present disclosure;
FIG. 11 is a schematic diagram of another resource management system according to an embodiment of the present disclosure;
fig. 12 is a schematic structural diagram of a server according to an embodiment of the present disclosure.
Detailed Description
For the purposes of clarity, technical solutions and advantages of the present disclosure, the following further details the embodiments of the present disclosure with reference to the accompanying drawings.
Before executing the embodiments of the present disclosure, the terms related to the embodiments of the present disclosure will be explained first.
UGC (User-Generated Content, user produced content) refers to content that is generated by the contribution of an average User.
CV (Computer Vision) refers to a technology of recognizing an object and performing image processing by using a Computer instead of human eyes.
NLP (Natural Language Processing ) refers to a technology in computer science and linguistics that focuses on computer and human language conversion.
ASR (Automatic Speech Recognition ) refers to a technique that converts audio input into text.
In order to solve the problems in the related art, the embodiment of the disclosure provides a resource management method, which enables the same resource to be uniformly grabbed, stored and processed by constructing a uniform grabbing service, an expandable content resource pool and a flexible resource release device and to be distributed to different applications according to the respective characteristics. The method not only reduces the cost of the server and labor, but also improves the utilization rate of the resources and improves the acquisition and release efficiency of the resources.
Fig. 1 is an architecture diagram of a resource management system provided in an embodiment of the present disclosure, and referring to fig. 1, the system architecture includes a resource scheduling device 101, a resource obtaining device 102, a content center 103, and a resource publishing device 104.
The resource scheduling device 101 is mainly used for creating a resource acquisition task and a resource release task, managing the created task, dynamically inquiring the created task in real time, managing the acquired and released resource, and simultaneously monitoring the resource on the platform in real time to find out an abnormal resource in the system, thereby providing a high-availability ecological system.
The resource obtaining device 102 is mainly used for capturing resources based on the resource obtaining task created by the resource scheduling device 101, and the resource obtaining device can call a third party server to capture resources such as characters, pictures and videos, and stores the captured resources into a content resource pool of the content center. Proxy IP (Internet Proctocol, internetworking protocol) may be used in the process of crawling resources to reduce the risk of being blocked by third party servers. The resources acquired by the resource acquisition device 102 are uniformly detected, so that the detection pressure of a service side is reduced, and the same resource is prevented from being detected for multiple times, so that the detection resources are wasted.
The content center 103 provides a plurality of query interfaces for users to query for acquired and published resources. The content center 103 stores the resource acquired by the resource acquisition device 102 and the resource released by the resource release device 104 by using the Tidb. The Tidb mode is adopted to store more resources, so that the service performance is improved, and the influence on the online service is avoided.
The resource issuing device 104 is mainly used for acquiring resources from a content resource pool of the content center 103, performing processing such as tagging, UID (User Identification) allocation, user identification, transcoding and the like on the acquired resources, and issuing the resources after the issuing pretreatment to a designated application by one key. The processing procedure of the resource issuing device 104 for the resource is as follows: the method comprises the steps of obtaining resources meeting resource release conditions from a content resource pool, sending the obtained resources to a tag platform, adding tags for the resources by the tag platform, returning the tagged resources to a resource release device 104, distributing UIDs for the resources by the resource release device 104 according to the added tags, sending the resources to a transcoding platform, transcoding by the transcoding platform, and releasing the transcoded resources to a designated application. The resource release device 104 performs unified processing on released resources, avoids multiple processing on the same resources, reduces cost and improves the multiplexing rate of the resources.
Fig. 2 is an interaction diagram of each device in the resource management system shown in fig. 1, and referring to fig. 2, the resource scheduling device includes a service unit for creating a resource acquisition task, a service unit for displaying task details and data of a crawling task, a service unit for creating a resource release task, and a service unit for displaying task details and data of a release task.
Fig. 3 is a service unit for creating a resource acquisition task on a resource scheduling device, where the service unit for creating the resource acquisition task includes subunits of content type, source, target, filter, frequency, task, and the like. Content types include short videos, long videos, articles, user descriptions, and the like, i.e., long videos, short videos, articles, user descriptions, and other types of resources may be acquired. Sources include networks and APPs, i.e. the acquired resources may originate from the network or from other APPs. The targets include random targets including payment, topic units of tweets, and others, and directional targets including topic units of tweets, keywords, and others, i.e., the obtained resources may be payment resources, topic units of tweets, keywords, other resources, and others. The filters include country, language, title, statistics, description, aspect ratio, creation time, others, etc., i.e., the resources may be filtered according to country, language, title, statistics, description, aspect ratio, creation time, others, etc. The frequency includes route selection (i.e. the number of times set by the user) and two kinds of frequency, namely, the frequency can be used for grabbing the resource once or a plurality of times according to the number of times set by the user. Tasks include task 1, task 2, tasks 3, …, task N, i.e., multiple subtasks can be created on the platform at the same time.
Fig. 5 is a service unit for displaying task details and data of a crawling task on the resource scheduling device, where the service unit for displaying task details and data of the crawling task includes task information and data, and the task information includes information such as a source, a country, a language, a creation time, and others, that is, information such as a source, a country, a language, a creation time, and others of the obtained resource can be displayed, and specific data content can be also checked.
FIG. 6 is a business unit for creating a resource publication task on a resource scheduler, where the business unit for creating a resource publication task includes product and modules, given tasks, filters, and sub-units of tasks. The product and the module comprise A, B, C, D, E and other business modules, namely, resources can be released through A, B, C, D and E business modules. A given task includes content type, resource source, country, other, etc., i.e., resources may be published according to content type, source, country, other, etc. The filters include title, statistics, description, aspect ratio, creation time, CV model score, duration, and others, i.e., the resources may be filtered based on title, statistics, aspect ratio, creation time, CV model score, duration, and others. Tasks include task 1, task 2, tasks 3, …, task N, i.e., multiple subtasks can be created on the platform at the same time.
Fig. 8 is a service unit for displaying details and data of a release task on a resource scheduling device, where the service unit for displaying details and data of a release task includes task information and data. The task information includes products and modules, content types, countries, languages, and others, that is, the information of the products and modules, content types, countries, languages, and others that can display the published resources, and can also view specific contents.
Fig. 4 is a resource acquisition device including units for tasks and deleting duplicate data, machine inspection, and the like. The task and duplicate data deleting module comprises a plurality of crawler scripts such as a crawler script 1, a crawler script 2, a crawler script 3 and the like and a duplicate content deleting module, namely the resource acquisition device can acquire data by adopting the crawler script 1, the crawler script 2 or the crawler script 3 and delete the acquired duplicate data. The machine inspection includes an NLP model and a CV model, i.e., the NLP model and CV model can be employed to detect the acquired resources to determine whether the acquired resources include anomalous content.
Fig. 7 is a resource issuing device including units of tasks, labels, user resources, combining, transcoding, issuing, and the like. The task units include a release script 1, a release script 2, a release script 3, and the like, that is, resources can be released using the release script 1, the release script 2, or the release script 3. The tag unit comprises a product, a long video, a product, a short video, a product, an article and the like, namely, the product, the long video tag, the product, the short video tag, the product, the article tag and the like can be added for the resource. The user resources comprise user identities and user profiles, i.e. user identities and user profiles may be added to the resources. The combining unit may combine the content type, country, language, tag of the publishing resource. The transcoding unit may transcode video and pictures. The issue unit includes A, B, C, D modules, i.e., A, B, C or D modules may be used to issue resources.
For the above-described data interaction procedure, details will be described below.
1. When the resource acquisition task is successfully created, the resource scheduling device sends a resource acquisition request message to the resource acquisition device to trigger the resource acquisition device to acquire the resource.
2. And after receiving the resource acquisition request message, the resource acquisition device returns a notification message to the resource scheduling device.
3. The resource acquisition device performs machine detection on the acquired resources and sends the detected resources to the content center for storage.
4. The content center stores the resource transmitted by the resource acquisition device and transmits a notification message to the resource acquisition device.
5. When a display request for crawling resources is received, the resource scheduling device sends a request message to the content.
6. The content center transmits the resource requested by the resource scheduling device to the resource scheduling device.
7. The resource issuing device transmits a request message to the slave content center.
8. The content center transmits the resource requested by the resource issuing device to the resource issuing device.
9. The resource issuing device adds a label to the acquired resource and sends an addition success message to the content center.
10. And after receiving the successful adding message sent by the resource issuing device, the content center sends a notification message to the resource issuing device.
11. The resource release device acquires the related information of the resource from the content center, combines the acquired information, and then sends a combination success message to the content center.
12. After receiving the combination success message sent by the resource issuing device, the content center sends a notification message to the resource issuing device.
13. And after transcoding the resource to be published, the resource publishing device sends a transcoding success message to the content center.
14. And after receiving the transcoding success message of the resource release device, the content center sends a notification message to the resource release device.
15. And after the resource is released by the resource release device, sending a release success message to the content center.
16. And after receiving the release success message of the resource release device, the content center sends a notification message to the resource release device.
17. When receiving a display request for publishing resources, the resource scheduling device sends a request message to the content center.
18. The content center transmits the resource requested by the resource scheduling device to the resource scheduling device.
Based on the resource management system architecture shown in fig. 1, an embodiment of the present disclosure provides a resource management method, referring to fig. 9, where a method flow provided by the embodiment of the present disclosure includes:
901. The resource scheduling means creates a resource acquisition task.
The resource scheduling device provided by the embodiment of the disclosure can create a resource acquisition task, and based on the resource scheduling device, a user can set a resource acquisition condition of a resource to be acquired, wherein the resource acquisition condition is a condition satisfied by the acquired resource and is used for acquiring the resource meeting the requirement from a network or other applications. The resource acquisition conditions comprise sources of resources and limiting conditions, wherein the limiting conditions comprise playing time of the video, praise number of the video and the like.
902. The resource acquisition device acquires the resources according to preset resource acquisition conditions.
When the resource acquisition task is successfully created, the resource scheduling device sends a resource acquisition request message to the resource acquisition device to trigger the resource acquisition device to acquire the resource. When receiving the resource acquisition request message, the resource acquisition device can call the third party application interface, and acquire the resources meeting the preset resource acquisition conditions from the third party application server in a crawler mode.
In order to protect the privacy of a user and avoid acquiring resources which are not public or related to the privacy of the user, when the resources are acquired in a crawler mode, the crawled pages are pages which follow a crawler protocol and are not privately owned.
903. The resource acquisition means determines a resource satisfying a predetermined condition from among the acquired resources.
In order to purify the network environment and avoid that the acquired resources comprise abnormal contents such as pornography, violence and horror, the resource acquisition device detects the acquired resources after acquiring the resources so as to determine whether the acquired resources comprise the abnormal contents or not, and determines the resources which do not comprise the abnormal contents as the resources meeting the preset conditions. At least one of manual and machine methods may be employed in determining whether the acquired resources include anomalous content. For example, the obtained resources may be manually detected for abnormal content to determine whether the resources include abnormal images or abnormal sounds; the CV model can be called to detect abnormal contents so as to determine whether the resources comprise abnormal images, and the NLP model and the ASR model are called to detect abnormal contents so as to determine whether the resources comprise abnormal sounds; and the CV model can be also called to detect abnormal contents so as to determine whether the resource comprises an abnormal image, the NLP model and the ASR model are called to detect abnormal contents so as to determine whether the resource comprises abnormal sounds, and then a manual mode is adopted to carry out secondary auditing on the detection result.
In consideration of the cultural tradition difference of different nationalities in different areas, when the acquired resources are detected, the detection can be carried out to different degrees according to the application issued by the resources and the popularization region of the application. For example, for the european and american regions, the culture is relatively open, and the detection effort may be relatively loose when detecting resources in the application to the european and american regions, and for the middle east region, the culture is relatively conservative, and the detection effort is relatively large when detecting resources in the application to the middle east region.
904. The resource acquisition means adds a resource satisfying a predetermined condition to a content resource pool of the content center.
The resource acquisition device adds the resources meeting the preset conditions into a content resource pool of the content center, wherein the content resource pool corresponds to at least one application, and the resources in the content resource pool can be released into the at least one application; for resources that include anomalous content, the resource acquisition device may discard the resources directly.
In the embodiment of the disclosure, the content center maintains an acquisition task list, and when a query request for acquiring resources is received, the acquisition task list can be sent to the resource scheduling device, and when the acquisition task list is received, the resource scheduling device displays the acquisition task list, wherein the acquisition task list comprises attribute information, detail options and operation options of each successfully created resource acquisition task. Wherein the attribute information includes a task name, a source, a creation date, and the like of each successfully created task. Because the attribute information of each successfully created resource acquisition task is displayed in the acquisition task list, the number of resources of each source can be checked according to the resource acquisition task list, and of course, the resources acquired by each resource acquisition task can be screened, for example, the acquired resources can be screened according to the country, the acquired resources can be screened according to the language, and the acquired resources can be screened according to the creation time. When a click operation on a detail option corresponding to any successfully created resource acquisition task is detected, detail information of a subtask of the successfully created resource acquisition task, wherein the detail information comprises a name, a source and the like of the subtask, can be displayed. The operation options comprise opening, suspending or closing, and when a clicking operation of the operation option corresponding to any successfully created resource acquisition task is detected, the successfully created resource acquisition task can be opened, suspended or closed.
905. The resource scheduling device creates a resource publishing task.
The resource scheduling device provided by the embodiment of the disclosure can create a resource release task, and based on the resource scheduling device, a user can set a resource release condition of a resource to be released and a released specified short video application, wherein the release condition comprises a resource source and a limiting condition, and the limiting condition comprises a video playing time length, a video praying number and the like.
906. The resource release device acquires resources from a content resource pool of the content center according to preset resource release conditions.
When the resource issuing task is successfully created, the resource scheduling device sends a resource issuing request message to the resource issuing device so as to trigger the resource issuing device to acquire the resource from the content resource pool of the content center. When receiving the resource release request message, the resource release device can call the resource screening interface to acquire the resources meeting the preset resource release conditions from the content resource pool of the content center.
907. The resource issuing device performs issuing pretreatment on the acquired resources.
For the acquired resources, the resource issuing device also performs issuing pretreatment on the acquired resources. The specific treatment can be carried out by adopting the following steps:
9071. The resource issuing device adds a label to the acquired resource.
For the obtained resource, the resource issuing device detects whether the resource has a tag, if so, step 9072 is executed to allocate a UID for the tagged resource; and if the resource does not have the tag, calling a tag interface, and adding the tag to the resource through a tag platform. When adding a label for a resource, a label adding model can be trained in advance, and then the label is added for the resource based on the label adding model, and the label adding model can be a CV model, an NLP model, an ASR model and the like. Of course, the resources may also be labeled manually.
9072. The resource issuing device allocates UIDs for the resources according to the added labels.
The resource issuing device allocates a UID to the resource based on the added tag, the UID including a user identification, a user profile, and the like.
9073. And when the allocated UID is legal, the resource issuing device transcodes the resources allocated with the UID to obtain the resources after the issuing pretreatment.
For the resources allocated with UIDs, the resource issuing device also checks whether the allocated UIDs are legal, and if the allocated UIDs are legal, transcoding operations such as format conversion and the like are carried out on the resources; if the allocated UID is illegal, an application interface of the application is called to register a user account, the UID is allocated for the resource, and further transcoding operation is carried out on the resource, so that the resource after the preprocessing is issued is obtained.
908. The resource issuing device issues the resource after the issuing pretreatment to the appointed application.
After the obtained resource is subjected to release pretreatment, the resource release device releases the resource subjected to release pretreatment to the appointed application by calling the release interface.
In another embodiment of the present disclosure, the content center maintains a distribution resource pool into which the resource distribution device will store the resources involved throughout the phase of resource distribution. After the resources are acquired from the content resource pool, the resource release device stores the resources acquired from the content resource pool into a release resource pool; after the UID is allocated for the resource, the resource issuing device also stores the resource allocated with the UID into an issuing resource pool; when the resource is released to the designated application, the resource releasing device also stores the resource released to the designated application in a released resource pool. The resource issuing device stores the resources acquired from the content resource pool, the resources allocated with UIDs and the processed resources into the issuing resource pool, so that the resources in the issuing resource pool are greatly enriched.
In another embodiment of the present disclosure, the content center maintains a publishing task list, and when a query request for a publishing resource is received, the content center may send the publishing task list to the resource scheduling device, and when the publishing task list is received, the resource scheduling device displays the publishing task list, where the publishing task list includes attribute information, detail options, and operation options of each successfully created resource publishing task. Wherein the attribute information includes a task name, a source, a creation date, and the like of each successfully issued task. Because the attribute information of each successfully issued resource issuing task is displayed in the issuing task list, the number of the resources issued by each service module can be checked according to the resource issuing task list, and of course, the resources issued by each resource issuing task can be screened, for example, the issued resources can be screened according to the country, the issued resources can be screened according to the language, and the issued resources can be screened according to the creation time. When a click operation on a detail option corresponding to any successfully created resource release task is detected, detail information of a subtask of the successfully created resource release task can be displayed, wherein the detail information comprises a name, a source and the like of the subtask. The operation options comprise opening, suspending or closing, and when the clicking operation of the operation option corresponding to any successfully created resource release task is detected, the successfully created resource release task can be opened, suspended or closed.
In the resource release stage, a resource release task can be created in the resource scheduling device, and the resource release device is triggered to call a resource screening interface to acquire resources from the content resource pool by scheduling the task. If the obtained resource is not added with the tag, a tag interface is called, the tag is added for the resource through a tag platform, and if the obtained resource is added with the tag, the UID is allocated for the resource according to the added tag. And then, detecting whether the allocated UID is legal or not, if the allocated UID is illegal, calling an application interface to register a user account, allocating the UID for the resource, further adding the resource into a transcoding queue for transcoding, obtaining the resource after the release pretreatment, and further calling the application interface to release the resource after the release pretreatment into an application.
The embodiment of the disclosure is mainly applied to capturing resources which are disclosed by various websites and do not relate to personal privacy, detecting the content of the resources through at least one of a CV model, an NLP model and an ASR model to determine whether the acquired resources comprise abnormal content, adding labels to the resources through at least one of a manual work, the CV model, the NLP model and the ASR model, and then publishing the resources. In the process, a user can create a resource acquisition task so as to determine the source and target resources of the resource; resource publishing tasks may also be created to decide which application to provide resources for and what type of resources to provide.
Further, the method provided by the embodiment of the disclosure can be applied to acquiring and publishing short videos and can also be applied to storage and publishing scheduling of UGC and PGC resources, so that the resources can be managed and published in a multi-dimensional and comprehensive manner.
In the process of resource acquisition and release, the embodiment of the disclosure establishes a unified content resource pool and a reusable resource scheduling device by interfacing each module, and greatly improves the resource multiplexing rate based on the unified resource scheduling device and the content resource pool.
According to the method provided by the embodiment of the disclosure, the resources are selectively acquired through the preset resource acquisition conditions, and the preset resource acquisition conditions can meet the preference of the user, so that the acquired resources are more targeted. And the obtained resources are added into the content resource pool, and the resources in the content resource pool are oriented to different applications and can be released into different applications, so that the resource multiplexing rate is higher.
In addition, the embodiment of the disclosure establishes a unified resource management system, detects the acquired resources by adopting a multidimensional algorithm model, and stores the resources meeting the preset conditions into a unified content resource pool. When the resources in the content resource pool are required to be released, the label system can be freely selected and flexibly released to the appointed application, so that the reusability of the resources is improved, the cost of a server and labor is reduced, and the acquisition and release efficiency of the resources is improved.
In addition, the embodiment of the disclosure can quickly know the grabbing orders of different current resource sources and the release orders of different applications, so that the acquisition and release strategies can be adjusted in real time, and the problems encountered in the process can be corrected in time.
In addition, the embodiment of the disclosure reduces the service coupling speed by interfacing each link, and can rapidly add a new code module, thereby accelerating the response to the service requirement.
Referring to fig. 10, the disclosed embodiment provides a resource management system, the system comprising: a resource acquisition device 1001, a content center 1002, and a resource distribution device 1003;
a resource obtaining device 1001, configured to obtain a resource according to a preset resource obtaining condition, add the resource meeting the preset condition to a content resource pool of a content center 1002, where the content resource pool corresponds to at least one application, and the resource in the content resource pool can be published to the at least one application;
the resource publishing device 1003 is configured to obtain a resource from a content resource pool of the content center 1002 according to a preset resource publishing condition, and publish the resource after the publishing pre-processing to a specified application.
In another embodiment of the present disclosure, the resource obtaining device 1001 is further configured to invoke a third party application interface, and obtain, in a crawler manner, a resource that meets a resource obtaining condition from a third party application server.
In another embodiment of the present disclosure, the resource obtaining device 1001 is further configured to invoke at least one of a computer vision CV model, a natural language processing NLP model, and an automatic speech recognition ASR model to determine whether the obtained resource includes abnormal content, and determine the resource that does not include the abnormal content as a resource that satisfies a predetermined condition;
the CV model is used for determining whether the resources comprise abnormal images, and the NLP model and the ASR model are used for determining whether the resources comprise abnormal sounds.
Referring to fig. 11, in another embodiment of the present disclosure, the system further comprises: resource scheduler 1004.
The content center 1002 is further configured to, when receiving a query request for acquiring a resource, send an acquisition task list to the resource scheduling device 1004;
the resource scheduling device 1004 is configured to display an acquisition task list, where the acquisition task list includes attribute information, detail options, and operation options of each successfully created resource acquisition task;
the acquisition task list is used for checking the quantity of resources of each source based on attribute information, screening the resources acquired by each resource acquisition task, the detail options are used for displaying the detail information of subtasks of each successfully-created resource acquisition task after being triggered, and the operation options are used for carrying out opening, pausing or closing operations on each successfully-created resource acquisition task.
In another embodiment of the present disclosure, the resource publishing device 1003 is further configured to call a resource filtering interface to obtain a resource that meets a resource publishing condition from a content resource pool in the content center.
In another embodiment of the present disclosure, the resource publishing device 1003 is further configured to perform a publishing pre-process for the acquired resource: adding a label; distributing user identification UIDs for the resources according to the added labels; and when the allocated UID is legal, transcoding the resources allocated with the UID to obtain the resources after release processing.
In another embodiment of the present disclosure, the resource publishing device 1003 is further configured to invoke a publishing interface to publish the resource after the publishing pre-process to the specified application.
In another embodiment of the present disclosure, the resource publishing device 1003 is further configured to store the resource obtained from the content resource pool of the content center, the resource to which the UID is allocated, and the processed resource into the publishing resource pool of the content center.
In another embodiment of the present disclosure, the system includes: resource scheduler 1004.
The content center 1002 is further configured to send, when receiving a query request for publishing resources, a publishing task list to the resource scheduling apparatus 1004;
The resource scheduling device 1004 is configured to display a publishing task list, where the publishing task list displays attribute information, detail options and operation options of each successfully created resource publishing task;
the issuing task list is used for checking the quantity of resources issued by each service module based on attribute information, screening the resources issued by each resource issuing task, the detail options are used for displaying the detail information of subtasks of each resource issuing task after being triggered, and the operation options are used for carrying out opening, pause or closing operations on each resource issuing task.
In summary, the system provided in the embodiments of the present disclosure selectively acquires resources through preset resource acquisition conditions, where the preset resource acquisition conditions can satisfy the preference of the user, so that the acquired resources are more targeted. And the obtained resources are added into the content resource pool, and the resources in the content resource pool are oriented to different applications and can be released into different applications, so that the resource multiplexing rate is higher.
In addition, the embodiment of the disclosure establishes a unified resource management system, detects the acquired resources by adopting a multidimensional algorithm model, and stores the resources meeting the preset conditions into a unified content resource pool. When the resources in the content resource pool are required to be released, the label system can be freely selected and flexibly released to the appointed application, so that the reusability of the resources is improved, the cost of a server and labor is reduced, and the acquisition and release efficiency of the resources is improved.
In addition, the embodiment of the disclosure can quickly know the grabbing orders of different current resource sources and the release orders of different applications, so that the acquisition and release strategies can be adjusted in real time, and the problems encountered in the process can be corrected in time.
In addition, the embodiment of the disclosure reduces the service coupling speed by interfacing each link, and can rapidly add a new code module, thereby accelerating the response to the service requirement.
Fig. 12 is a server, which may be any of the devices shown in fig. 1, shown according to an exemplary embodiment. Referring to fig. 12, server 1200 includes a processing component 1222 that further includes one or more processors, and memory resources, represented by memory 1232, for storing instructions, such as application programs, executable by processing component 1222. The application programs stored in memory 1232 may include one or more modules each corresponding to a set of instructions. In addition, the processing component 1222 is configured to execute instructions to perform the functions performed by the server in the resource acquisition and distribution methods described above.
The server 1200 may also include a power component 1226 configured to perform power management of the server 1200, a wired or wireless network interface 1250 configured to connect the server 1200 to a network, and an input-output (I/O) interface 1258. The Server 1200 may operate an operating system based on storage in memory 1232, such as Windows Server TM ，Mac OS X TM ，Unix TM ,Linux TM ，FreeBSD TM Or the like.
According to the server provided by the embodiment of the disclosure, the resources are selectively acquired through the preset resource acquisition conditions, and the preset resource acquisition conditions can meet the preference of the user, so that the acquired resources are more targeted. And the obtained resources are added into the content resource pool, and the resources in the content resource pool are oriented to different applications and can be released into different applications, so that the resource multiplexing rate is higher.
In addition, the embodiment of the disclosure establishes a unified resource management system, detects the acquired resources by adopting a multidimensional algorithm model, and stores the resources meeting the preset conditions into a unified content resource pool. When the resources in the content resource pool are required to be released, the label system can be freely selected and flexibly released to the appointed application, so that the reusability of the resources is improved, the cost of a server and labor is reduced, and the acquisition and release efficiency of the resources is improved.
In addition, the embodiment of the disclosure can quickly know the grabbing orders of different current resource sources and the release orders of different applications, so that the acquisition and release strategies can be adjusted in real time, and the problems encountered in the process can be corrected in time.
In addition, the embodiment of the disclosure reduces the service coupling speed by interfacing each link, and can rapidly add a new code module, thereby accelerating the response to the service requirement.
Embodiments of the present disclosure provide a computer readable storage medium having at least one program code stored therein, the at least one program code being loaded and executed by a processor to implement the above-described resource management method.
The computer readable storage medium provided by the embodiment of the disclosure selectively acquires the resources through the preset resource acquisition conditions, and the preset resource acquisition conditions can meet the preference of the user, so that the acquired resources are more targeted. And the obtained resources are added into the content resource pool, and the resources in the content resource pool are oriented to different applications and can be released into different applications, so that the resource multiplexing rate is higher.
In addition, the embodiment of the disclosure establishes a unified resource management system, detects the acquired resources by adopting a multidimensional algorithm model, and stores the resources meeting the preset conditions into a unified content resource pool. When the resources in the content resource pool are required to be released, the label system can be freely selected and flexibly released to the appointed application, so that the reusability of the resources is improved, the cost of a server and labor is reduced, and the acquisition and release efficiency of the resources is improved.
In addition, the embodiment of the disclosure can quickly know the grabbing orders of different current resource sources and the release orders of different applications, so that the acquisition and release strategies can be adjusted in real time, and the problems encountered in the process can be corrected in time.
In addition, the embodiment of the disclosure reduces the service coupling speed by interfacing each link, and can rapidly add a new code module, thereby accelerating the response to the service requirement.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program for instructing relevant hardware, where the program may be stored in a computer readable storage medium, and the storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The foregoing description of the preferred embodiments of the present disclosure is not intended to limit the disclosure, but rather to enable any modification, equivalent replacement, improvement or the like, which fall within the spirit and principles of the present disclosure.

Claims (11)

1. The resource management system is characterized by comprising a resource acquisition device, a content center and a resource release device;
The resource acquisition device is used for acquiring resources according to preset resource acquisition conditions, calling at least one of a computer vision CV model, a natural language processing NLP model and an automatic speech recognition ASR model to determine whether the acquired resources comprise abnormal contents or not, and determining the resources which do not comprise the abnormal contents as the resources meeting preset conditions, wherein the CV model is used for determining whether the resources comprise abnormal images or not, and the NLP model and the ASR model are used for determining whether the resources comprise abnormal sounds or not; adding the resources meeting the preset conditions into a content resource pool of the content center, wherein the content resource pool corresponds to at least one application, and the resources in the content resource pool can be released into the at least one application;
the resource release device is used for acquiring resources from the content resource pool of the content center according to preset resource release conditions and releasing the resources after release pretreatment to the appointed application.
2. The system according to claim 1, wherein the resource obtaining device is further configured to invoke a third party application interface to obtain, in a crawler manner, a resource that meets the resource obtaining condition from a third party application server.
3. The system of claim 1, wherein the system further comprises: a resource scheduling device;
the content center is further configured to send an acquisition task list to the resource scheduling device when receiving a query request for acquiring resources;
the resource scheduling device is used for displaying the acquisition task list, wherein the acquisition task list comprises attribute information, detail options and operation options of each successfully created resource acquisition task;
the acquisition task list is used for checking the quantity of resources of each source based on the attribute information, screening the resources acquired by each resource acquisition task, the detail options are used for displaying the detail information of the subtasks of each successfully-created resource acquisition task after being triggered, and the operation options are used for carrying out opening, pausing or closing operations on each successfully-created resource acquisition task.
4. The system of claim 1, wherein the resource publishing device is further configured to invoke a resource screening interface to obtain resources from a content resource pool of the content center that satisfy the resource publishing condition.
5. The system of claim 1, wherein the resource publishing device is further configured to perform a publishing pre-process for the acquired resource: adding a label; distributing user identification UIDs for the resources according to the added labels; and when the allocated UID is legal, transcoding the resources allocated with the UID to obtain the resources after the release pretreatment.
6. The system of claim 1, wherein the resource publishing device is further configured to invoke a publishing interface to publish the post-publishing preprocessed resource to the specified application.
7. The system of claim 5, wherein the resource issuing means is further configured to store the resource obtained from the content resource pool of the content center, the resource to which the UID is assigned, and the processed resource in the issuing resource pool of the content center.
8. The system according to any one of claims 1 to 7, further comprising: a resource scheduling device;
the content center is further configured to send a publishing task list to the resource scheduling device when receiving a query request for publishing resources;
the resource scheduling device is used for displaying a release task list, wherein the release task list displays attribute information, detail options and operation options of each successfully created resource release task;
the issuing task list is used for checking the quantity of resources issued by each service module based on the attribute information, screening the resources issued by each resource issuing task, the detail options are used for displaying the detail information of subtasks of each resource issuing task after being triggered, and the operation options are used for performing opening, pause or closing operations on each resource issuing task.
9. A resource management method, wherein the method is applied to a resource management system, the resource management system comprises a resource acquisition device, a content center and a resource release device, and the method comprises:
the resource acquisition device acquires resources according to preset resource acquisition conditions, invokes at least one of a computer vision CV model, a natural language processing NLP model and an automatic speech recognition ASR model to determine whether the acquired resources comprise abnormal contents or not, and determines the resources which do not comprise the abnormal contents as the resources meeting preset conditions, wherein the CV model is used for determining whether the resources comprise abnormal images or not, and the NLP model and the ASR model are used for determining whether the resources comprise abnormal sounds or not; adding the resources meeting the preset conditions into a content resource pool of the content center, wherein the content resource pool corresponds to at least one application, and the resources in the content resource pool can be released into the at least one application;
and the resource release device acquires resources from a content resource pool of the content center according to preset resource release conditions, and releases the resources after release pretreatment to the appointed application.
10. A machine device comprising a processor and a memory, the memory having stored therein at least one program code that is loaded and executed by the processor to implement the resource management method of claim 9.
11. A computer readable storage medium having stored therein at least one program code, the at least one program code loaded and executed by a processor to implement the resource management method of claim 9.
CN202010506710.7A 2020-06-05 2020-06-05 Resource management system, resource management method, device and storage medium Active CN111611523B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010506710.7A CN111611523B (en) 2020-06-05 2020-06-05 Resource management system, resource management method, device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010506710.7A CN111611523B (en) 2020-06-05 2020-06-05 Resource management system, resource management method, device and storage medium

Publications (2)

Publication Number Publication Date
CN111611523A CN111611523A (en) 2020-09-01
CN111611523B true CN111611523B (en) 2023-05-12

Family

ID=72204213

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010506710.7A Active CN111611523B (en) 2020-06-05 2020-06-05 Resource management system, resource management method, device and storage medium

Country Status (1)

Country Link
CN (1) CN111611523B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112379912B (en) * 2020-11-16 2024-05-14 北京百度网讯科技有限公司 Algorithm management method and device, electronic equipment and storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102164156A (en) * 2010-02-24 2011-08-24 腾讯科技（深圳）有限公司 Method and system for publishing resources
CN102118449A (en) * 2011-03-25 2011-07-06 天脉聚源(北京)传媒科技有限公司 Method and system for content distribution
CN108540375B (en) * 2018-03-26 2021-02-09 黄敬易 Resource propagation method, device, server and computer readable storage medium

Also Published As

Publication number Publication date
CN111611523A (en) 2020-09-01

Similar Documents

Publication Publication Date Title
US9699409B1 (en) Recording web conferences
CN103780700A (en) Application system and method for achieving compatibility and sharing among multi-source heterogeneous systems
CN110058987B (en) Method, apparatus, and computer readable medium for tracking a computing system
US20070047439A1 (en) Method and apparatus of supporting business performance management with active shared data spaces
US20060277313A1 (en) System and method of data brokering
CN101821993A (en) Method and system for handling failover in distributed environment that uses session affinity
CN102648464A (en) System and method for generating vocabulary from network data
US20070156878A1 (en) System and method for managing workflow execution in a distributed system
Hunter et al. A semi-automated digital preservation system based on semantic web services
US8037153B2 (en) Dynamic partitioning of messaging system topics
CN110505534B (en) Monitoring video processing method, device and storage medium
AU2012211490A1 (en) Systems and methods for identifying associations between malware samples
CN105677536A (en) Implementing method for task messages and task system for implementing task messages
CN112732949B (en) Service data labeling method and device, computer equipment and storage medium
US20140108572A1 (en) Multi-variant e-mail testing
CN110007950A (en) A kind of management method of application programming interfaces, device and server
CN111611523B (en) Resource management system, resource management method, device and storage medium
CN109800081A (en) A kind of management method and relevant device of big data task
CN100521679C (en) Sensitive information filter system and method for server up transfer file
US20060248193A1 (en) State management in a distributed computing system
CN104080016A (en) Method and device for displaying audio/video information in browser
US10044652B2 (en) Context driven modification of attachments in a messaging session
US20210337013A1 (en) System and method for large scale screen capture across global data center deployments
US20200327122A1 (en) Conflation of topic selectors
CN113778709A (en) Interface calling method, device, server and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20231007

Address after: 31a, 15 / F, building 30, maple mall, bangrang Road, Brazil, Singapore

Patentee after: Baiguoyuan Technology (Singapore) Co.,Ltd.

Address before: 511402 5-13 / F, West Tower, building C, 274 Xingtai Road, Shiqiao street, Panyu District, Guangzhou City, Guangdong Province

Patentee before: GUANGZHOU BAIGUOYUAN INFORMATION TECHNOLOGY Co.,Ltd.