CN111159516B - Media information processing method and device - Google Patents

Media information processing method and device Download PDF

Info

Publication number
CN111159516B
CN111159516B CN201911253353.1A CN201911253353A CN111159516B CN 111159516 B CN111159516 B CN 111159516B CN 201911253353 A CN201911253353 A CN 201911253353A CN 111159516 B CN111159516 B CN 111159516B
Authority
CN
China
Prior art keywords
data
crawling
media
grabbing
database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911253353.1A
Other languages
Chinese (zh)
Other versions
CN111159516A (en
Inventor
刘明升
吕宝红
梁国豪
迟伟松
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Jukanyun Technology Co ltd
Original Assignee
Qingdao Jukanyun Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Jukanyun Technology Co ltd filed Critical Qingdao Jukanyun Technology Co ltd
Priority to CN201911253353.1A priority Critical patent/CN111159516B/en
Publication of CN111159516A publication Critical patent/CN111159516A/en
Application granted granted Critical
Publication of CN111159516B publication Critical patent/CN111159516B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/951Indexing; Web crawling techniques

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application discloses a method and a device for processing media information, which are used for checking, correcting and alarming the acquired media information, so that the problems of various missing and misplaced media information acquired from a third party interface are solved, the workload of operators is greatly reduced, and the working efficiency is improved. The media information processing method provided by the embodiment of the application comprises the following steps: crawling media data on a network through a crawling module; accessing a media resource interface through a grabbing module, and grabbing media resource data; verifying the media asset data grabbed by the grabbing module according to the media asset data grabbed by the crawling module and the preset rules by the media asset processing module; and processing the grabbed media data according to the verification result.

Description

Media information processing method and device
Technical Field
The application relates to the technical field of electricity, in particular to a method and a device for processing media information.
Background
At present, the industry generally obtains the media information through accessing an interface of a third party, and the media information is changed into identifiable media information after simple conversion, but errors and missing in information issued by the interface of the third party cannot be identified in time, operators can only conduct manual auditing to modify and supplement one by one, the workload is huge, and intelligent conversion cannot be conducted on the data of the third party according to self-requirements, so that personalized operation is conducted.
Disclosure of Invention
The embodiment of the application provides a method and a device for processing media information, which are used for checking the acquired media information and correcting and alarming, so that the problems of various missing and misplaced media information acquired from a third party interface are solved, the workload of operators is greatly reduced, and the working efficiency is improved.
The media information processing method provided by the embodiment of the application comprises the following steps:
crawling media data on a network through a crawling module; accessing a media resource interface through a grabbing module, and grabbing media resource data;
verifying the media asset data grabbed by the grabbing module according to the media asset data grabbed by the crawling module and the preset rules by the media asset processing module;
and processing the grabbed media data according to the verification result.
The method comprises the steps of crawling media data on a network through a crawling module; accessing a media resource interface through a grabbing module, and grabbing media resource data; verifying the media asset data grabbed by the grabbing module according to the media asset data grabbed by the crawling module and the preset rules by the media asset processing module; and processing the captured media information according to the verification result, so as to realize the detection, correction and alarm of the acquired media information, solve the problems of various missing and misplaced media information acquired from a third party interface, greatly lighten the workload of operators and improve the working efficiency.
The media information processing device provided by the embodiment of the application comprises the following components:
the crawling module is used for crawling the media data on the network;
the grabbing module is used for accessing the media resource interface and grabbing media resource data;
the media resource processing module is used for verifying the media resource data grabbed by the grabbing module according to the media resource data grabbed by the crawling module according to a preset rule; and processing the grabbed media data according to the verification result.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a media information processing device according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a crawling flow provided in an embodiment of the present application;
fig. 3 is a schematic diagram of a grabbing flow provided in an embodiment of the present application;
FIG. 4 is a schematic diagram of media asset processing according to an embodiment of the present application;
FIG. 5 is a schematic flow chart of a media information processing method according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a computing device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The embodiment of the application provides a method and a device for processing media information, which are used for realizing the examination of acquired media information and correcting and alarming, so that the problems of various missing and misplaced media information acquired from a third party interface are solved, the workload of operators is greatly reduced, and the working efficiency is improved.
The method and the device are based on the same application, and because the principles of solving the problems by the method and the device are similar, the implementation of the device and the method can be referred to each other, and the repetition is not repeated.
Various embodiments of the application are described in detail below with reference to the drawings attached to the specification. It should be noted that, the display sequence of the embodiments of the present application only represents the sequence of the embodiments, and does not represent the advantages or disadvantages of the technical solutions provided by the embodiments.
The embodiment of the application provides a scheme for automatically correcting and alarming the grabbed media assets, which solves the problems of various missing and misplaced media asset information acquired from a third party interface in daily operation, automatically checks the media assets through a program, automatically corrects and alarms according to rules, greatly reduces the workload of operators, and can perform batch personalized operation through adding the rules.
Referring to fig. 1, an apparatus for processing media information provided by an embodiment of the present application includes:
1. and (5) crawling the module:
referring to fig. 2, the crawling module is mainly responsible for crawling network media asset information, for example: some video client applications provide video and other media related information, etc.
Wherein crawling refers to the use of crawler tools to obtain specific content from specific websites.
The crawling module periodically crawls the media information by using a web crawler technology, acquires appointed field information of the media information, performs data conversion according to a set format, compares the data with data in a crawling database, writes newly added data and updated data into the crawling database, sends the newly added data and the updated data to the message notification kafaka module, and waits for the media information processing module to process the newly added data and the updated data.
The acquired media information includes, for example: information such as the name of the media asset, the label of the media asset, the brief introduction, the definition, the release date, the score, the language, the country, the total collection number, the poster picture, whether the film is on a piece of flower, whether the film is 4k and the like.
The data conversion is performed according to a set format, for example, json format conversion may be performed. For example, the data will be crawled from the bean cotyledon { "title": "works A", "directors": "Zhang Sanj" into { "escape_title": "work A", "director": "Zhang Sanj".
Regarding the message notification kafka module, kafka is an open source stream processing platform, written by Scala and Java. kafka is a high-throughput distributed publish-subscribe messaging system that can handle all action flow data for consumers in websites.
The message notification kaf ka module is used for efficiently publishing the message and waiting for the message to be read and processed by the media asset processing module.
2. And (3) grabbing a module:
referring to fig. 3, the crawling module is mainly responsible for accessing the media asset interfaces of the respective collaboration providers, for example, obtaining media asset related information from the media asset interfaces of the collaboration providers of the video client application.
The grabbing module accesses the provider interface according to the agreed time and frequency total or increment, analyzes the returned data, converts the data according to the interface definition, compares the data with the data in the grabbing database, sends the newly added and updated data to the message notification kaf ka module, waits for the media resource processing module to process and writes the newly added and updated data into the grabbing database, as shown in the following table I and table II.
Table one: grabbing media resource (grabber_media)
And (II) table: grabbing video (grabber_video)
The full-volume data interface refers to a full-volume data interface of a provider, and all video information of the provider can be acquired. The increment is based on the last time the provider was requested to acquire the media asset data, and all updated or newly added video information from the last time to the present is acquired.
And regarding the data conversion, converting the data returned by the provider interface accessed in full or increment according to the agreed time and frequency into database data according to the mapping relation defined by the interface. For example:
in the provider provided data json, there are the following information: "showname": "My on board girl first season", the data json provided by the provider is converted to the escape_title field value of the database gradber_media according to the interface definition as "My on board girl first season".
First season of my veneer girl
With respect to the above two tables, the media asset data contains shell information and diversity information. For example: for the media asset data "my on-board girl first season video", the grabber_media shown in table one represents its shell data, one piece of data representing one video. The grabber_video shown in table two represents its diversity data, and one piece of data represents a set of information of the video. How many sets there are pieces of data for the video.
3. And (5) rule warehousing:
and recording or modifying the media resource rules according to the set format at the operation interface, storing the media resource rules into a rule base, and simultaneously notifying a media resource processing module to load the newly added or updated rules.
Rules fall into two categories:
the media assets meeting the rules are automatically processed according to the rules in the media asset processing module (see the processing of the media asset processing module for specific processing process), and error data or supplementary data are corrected.
The other type is warning rules, the media asset processing module alarms the media asset conforming to the rules (the specific processing process refers to the processing of the media asset processing module), and sends the alarm information to an operator to wait for the operator to manually check and process.
See table three below, where the rule field represents a rule json format expression. type represents the type of rule, 0 represents an alert rule, 1 represents an automatic correction rule, and the following are rule data examples:
table three: rules (rules)
Wherein the rule field is a json format expression of rules, and each rule needs to correspond to a program with an algorithm. For example, in rule 5, "match" corresponds to a condition that meets the rule, media.image=null indicates that capturing a video picture is NULL and meets the correction rule, and "rule" indicates the correction method, and the video picture is replaced with a picture of crawling a vacated video.
4. The media resource processing module:
the media resource processing module is mainly used for processing the captured media resource data and the crawled media resource data, and automatically correcting or alarming the media resource according to the rule.
Referring to fig. 4, the flow of the media asset processing module is described as follows:
1. after the message type is the message of the grabbing module, accessing the grabbing database according to the video id in the message to acquire grabbing data, according to an algorithm, judging whether the grabbing video accords with an alarm rule, if yes, sending an email alarm, writing the grabbing data into the media data database, if not, judging whether the grabbing video accords with a correction rule, if not, directly writing the grabbing data into the media data database, if yes, inquiring matching crawling data according to video information (video name, classification and other conditions), writing the matching relationship of the grabbing data into a matching relationship table of the media data database, then correcting according to a correction rule, and finally writing the correction data into the media data database.
2. The message type is a crawling module message, a crawling database is accessed according to video id in the message to obtain crawling data, then a matching relation table in a media asset database is accessed to find matched crawling data, then whether the crawled video accords with correction rules or not is checked according to an algorithm, if so, data processing is carried out according to the rules, and corrected media asset data is written into the media asset database.
Referring to fig. 4, a process flow implementation scenario of the media asset processing module includes, for example:
step 1, capturing videos, wherein the total collection number of the television drama provided by a third party interface is 0, a media asset processing module judges that the media asset accords with an alarm rule (1), sends out an alarm, prompts operators to manually modify, and submits the error information to a third party.
The rules (1) to (10) described in this embodiment are, for example, the respective rules identified by 1 to 10 shown in the above table three.
And 2, capturing videos, wherein the total collection number of the cartoon provided by the third party interface is 10, but the current collection number is 20, judging that the media asset accords with the alarm rule (2) by the media asset processing module, sending an alarm, prompting operators to modify manually, and submitting the error information to a third party.
And 3, in capturing the video, a third party interface provides the entertainment video mark as a cut flower, but pays, and a media resource processing module judges that the media resource accords with an alarm rule (3), sends out an alarm, prompts operators to manually modify, and submits the error information to a third party.
And 4, capturing videos, wherein diversity is paid in the television drama provided by the third party interface, but the media asset is free, judging that the media asset accords with the alarm rule (4) by the media asset processing module, sending an alarm, prompting operators to manually modify the media asset, and submitting the error information to a third party.
And 5, after capturing the new video, automatically acquiring the matched bean cotyledon video from the crawled data by the media resource processing module according to the rule (5), and covering the scores of the crawled bean cotyledon video into the scores of the captured video.
And 6, after capturing the new video, the video poster provided by the third party interface is empty, the media asset processing module judges that the media asset accords with the rule (6), automatically acquires the matched flight video from the crawled data, and updates the picture address of the crawled flight video into the video picture address.
And 7, after capturing a new video, judging that the video transverse poster provided by the third party interface is not 496_280 resolution, and automatically acquiring a matched flight video from the crawled data by a media resource processing module according to a rule (7), and updating the picture address of the crawled flight video with 496_280 resolution into the picture address of the video transverse poster.
And 8, after the new video is captured, the director information provided by the third-party interface is empty, the medium resource processing module judges that the medium resource accords with the rule (8), automatically acquires the matched bean cotyledon video from the captured data, and updates the director information of the captured bean cotyledon video into the director information of the video.
And 9, after capturing the new video, the actor information provided by the third-party interface is empty, the medium resource processing module judges that the medium resource accords with the rule 9, automatically acquires the matched bean-shaped video from the crawled data, and updates the actor information of the crawled bean-shaped video into director information of the video.
And 10, after capturing a new video, judging that the media asset accords with a rule (10) by a media asset processing module, automatically acquiring a matched bean cotyledon video from the captured data, combining tag information of the captured bean cotyledon video with captured video tag information, removing duplication, and updating a result into the tag information of the video.
In summary, referring to fig. 5, a media information processing method provided by an embodiment of the present application includes:
s101, crawling media data on a network through a crawling module; accessing a media resource interface through a grabbing module, and grabbing media resource data;
s102, verifying the media asset data grabbed by the grabbing module according to the media asset data grabbed by the crawling module and the preset rule by the media asset processing module; and processing the grabbed media data according to the verification result.
Optionally, the processing the captured media asset data specifically includes:
when the captured media asset data accords with a preset alarm rule, carrying out alarm processing on the captured media asset data;
and when the grabbed media data accords with a preset correction rule, correcting the grabbed media data.
Optionally, the verifying, by the media asset processing module according to a preset rule, the media asset data captured by the capturing module according to the media asset data captured by the capturing module specifically includes:
when the message type received by the media asset processing module is a grabbing module message, accessing a grabbing database according to a video identifier in the grabbing module message, acquiring grabbing data corresponding to the video identifier, triggering an alarm if the grabbing data accords with an alarm rule, and writing the grabbing data into the media asset database.
Optionally, the verifying, by the media asset processing module, the media asset data captured by the capturing module according to a preset rule, and specifically further includes:
if the grabbing data does not accord with the alarm rule, judging whether the grabbing data accord with the correction rule, if not, directly writing the grabbing data into a media database, if so, matching the crawling data by inquiring the crawling module according to the video information of the video data, writing the matching relation between the grabbing data and the crawling data into a matching relation table of the media database, correcting the grabbing data according to the correction rule, and finally writing the corrected grabbing data into the media database.
Optionally, the verifying, by the media asset processing module according to a preset rule, the media asset data captured by the capturing module according to the media asset data captured by the capturing module specifically includes:
when the message type received by the media resource processing module is a crawling module message, accessing a crawling database according to a video identifier in the crawling module message, obtaining crawling data corresponding to the video identifier, then accessing a matching relation table in the media resource database, finding crawling data matched with the crawling data, judging whether the crawling data accords with a correction rule according to the crawling data, if so, correcting the crawling data according to the correction rule, and writing the corrected crawling data into the media resource database.
Correspondingly, referring to fig. 6, the media information processing device provided by the embodiment of the present application includes:
a crawling module 11, configured to crawl media data on a network;
a grabbing module 12, configured to access a media resource interface and grab media resource data;
the media resource processing module 13 is configured to verify the media resource data captured by the capturing module according to a preset rule; and processing the grabbed media data according to the verification result.
Optionally, the processing the captured media asset data specifically includes:
when the captured media asset data accords with a preset alarm rule, carrying out alarm processing on the captured media asset data;
and when the grabbed media data accords with a preset correction rule, correcting the grabbed media data.
Optionally, the verifying, by the media asset processing module according to a preset rule, the media asset data captured by the capturing module according to the media asset data captured by the capturing module specifically includes:
when the message type received by the media asset processing module is a grabbing module message, accessing a grabbing database according to a video identifier in the grabbing module message, acquiring grabbing data corresponding to the video identifier, triggering an alarm if the grabbing data accords with an alarm rule, and writing the grabbing data into the media asset database.
Optionally, the verifying, by the media asset processing module, the media asset data captured by the capturing module according to a preset rule, and specifically further includes:
if the grabbing data does not accord with the alarm rule, judging whether the grabbing data accord with the correction rule, if not, directly writing the grabbing data into a media database, if so, matching the crawling data by inquiring the crawling module according to the video information of the video data, writing the matching relation between the grabbing data and the crawling data into a matching relation table of the media database, correcting the grabbing data according to the correction rule, and finally writing the corrected grabbing data into the media database.
Optionally, the verifying, by the media asset processing module according to a preset rule, the media asset data captured by the capturing module according to the media asset data captured by the capturing module specifically includes:
when the message type received by the media resource processing module is a crawling module message, accessing a crawling database according to a video identifier in the crawling module message, obtaining crawling data corresponding to the video identifier, then accessing a matching relation table in the media resource database, finding crawling data matched with the crawling data, judging whether the crawling data accords with a correction rule according to the crawling data, if so, correcting the crawling data according to the correction rule, and writing the corrected crawling data into the media resource database.
It should be noted that, in the embodiment of the present application, the division of the modules is schematic, which is merely a logic function division, and other division manners may be implemented in actual implementation. In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
In addition, the embodiment of the application provides a computing device, which can be a desktop computer, a portable computer, a smart phone, a tablet computer, a personal digital assistant (Personal Digital Assistant, PDA) and the like. The computing device may include a central processing unit (Center Processing Unit, CPU), memory, and may also include input/output devices, etc., which may include a keyboard, mouse, touch screen, etc., and output devices may include display devices, such as a liquid crystal display (Liquid Crystal Display, LCD), cathode Ray Tube (CRT), etc.
The memory may include Read Only Memory (ROM) and Random Access Memory (RAM) and provides the processor with program instructions and data stored in the memory. In the embodiment of the present application, the memory may be used to store a program of any of the methods provided in the embodiment of the present application.
The processor is configured to execute any of the methods provided by the embodiments of the present application according to the obtained program instructions by calling the program instructions stored in the memory.
An embodiment of the present application provides a computer storage medium storing computer program instructions for use in an apparatus provided in the embodiment of the present application, where the computer storage medium includes a program for executing any one of the methods provided in the embodiment of the present application.
The computer storage media may be any available media or data storage device that can be accessed by a computer, including, but not limited to, magnetic storage (e.g., floppy disks, hard disks, magnetic tape, magneto-optical disks (MOs), etc.), optical storage (e.g., CD, DVD, BD, HVD, etc.), and semiconductor storage (e.g., ROM, EPROM, EEPROM, nonvolatile storage (NAND FLASH), solid State Disk (SSD)), etc.
The above-described method process flow may be implemented in a software program, which may be stored in a storage medium, and which performs the above-described method steps when the stored software program is called.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, magnetic disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present application without departing from the spirit or scope of the application. Thus, it is intended that the present application also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.

Claims (6)

1. A method for processing media information, the method comprising:
the method comprises the steps of crawling media information on a network through a crawling module by using a web crawler technology, obtaining appointed field information of the media information, performing data conversion according to a preset format, comparing the data with data in a crawling database, writing newly added data and updated data into the crawling database, and sending the newly added data and the updated data to a media information processing module through a message; the system comprises a capturing module, a media resource processing module, a data conversion module, a data updating module and a data updating module, wherein the capturing module accesses a media resource interface provided by a third party, analyzes returned data, converts the data according to interface definition, compares the data with data in a capturing database, and sends newly added and updated data to the media resource processing module through a message;
when the message is received by the media asset processing module, accessing the grabbing database according to a video identifier in the message, acquiring grabbing data corresponding to the video identifier, judging whether the grabbing data accords with a preset correction rule if the grabbing data does not accord with a preset alarm rule, if so, inquiring the crawling database according to video information in the grabbing data to match the crawling data, writing the matching relation between the grabbing data and the crawling data into a matching relation table of the media asset database, correcting the grabbing data according to the correction rule, and finally writing the corrected grabbing data into the media asset database;
when the message is received by the media resource processing module, accessing the crawling database according to a video identifier in the message, obtaining crawling data corresponding to the video identifier, then accessing a matching relation table in the media resource database, finding crawling data matched with the crawling data, judging whether the crawling data accords with the correction rule according to the crawling data, if so, correcting the crawling data according to the correction rule, and writing the corrected crawling data into the media resource database;
the alarm rules and the correction rules are input or modified according to a preset format through a user interface, and the newly added or input rules are sent to the media resource processing module through messages.
2. The method of claim 1, wherein if the captured data meets a preset alert rule, an alert is triggered and the captured data is written to a media database.
3. The method of claim 1, wherein if the captured data does not meet a predetermined correction rule, directly writing the captured data to a media database.
4. A media information processing device, comprising:
the crawling module is used for crawling the media information on the network by using a web crawler technology, acquiring appointed field information of the media information, performing data conversion according to a preset format, comparing the data with data in a crawling database, writing newly added data and updated data into the crawling database, and sending the newly added data and the updated data to the media information processing module through a message;
the grabbing module is used for accessing a media resource interface provided by a third party, analyzing the returned data, converting the data according to interface definition, comparing the data with the data in the grabbing database, and sending the newly added and updated data to the media resource processing module through a message;
the media resource processing module is used for accessing the grabbing database according to the video identifier in the message when the message is received, acquiring grabbing data corresponding to the video identifier, judging whether the grabbing data accords with a preset correction rule if the grabbing data does not accord with a preset alarm rule, inquiring the crawling database to match the crawling data according to the video information in the grabbing data if the grabbing data accords with the preset correction rule, writing the matching relation between the grabbing data and the crawling data into a matching relation table of the media resource database, correcting the grabbing data according to the correction rule, and finally writing the corrected grabbing data into the media resource database; when a crawling module message is received, accessing the crawling database according to a video identifier in the message, acquiring crawling data corresponding to the video identifier, accessing a matching relation table in the media asset database, finding crawling data matched with the crawling data, judging whether the crawling data accords with the correction rule according to the crawling data, if so, correcting the crawling data according to the correction rule, and writing the corrected crawling data into the media asset database;
the alarm rules and the correction rules are input or modified according to a preset format through a user interface, and the newly added or input rules are sent to the media resource processing module through messages.
5. The apparatus of claim 4, wherein the means for determining that the captured data meets a preset alert rule triggers an alert and writes the captured data to a media database.
6. The apparatus of claim 4, wherein the captured data is directly written to a media database by the media processing module determining that the captured data does not conform to a predetermined correction rule.
CN201911253353.1A 2019-12-09 2019-12-09 Media information processing method and device Active CN111159516B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911253353.1A CN111159516B (en) 2019-12-09 2019-12-09 Media information processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911253353.1A CN111159516B (en) 2019-12-09 2019-12-09 Media information processing method and device

Publications (2)

Publication Number Publication Date
CN111159516A CN111159516A (en) 2020-05-15
CN111159516B true CN111159516B (en) 2023-10-13

Family

ID=70556692

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911253353.1A Active CN111159516B (en) 2019-12-09 2019-12-09 Media information processing method and device

Country Status (1)

Country Link
CN (1) CN111159516B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103686452A (en) * 2013-12-06 2014-03-26 北京普瑞众合国际科技有限公司 Addition processing method for video associated information
CN106649811A (en) * 2016-12-29 2017-05-10 广州酷狗计算机科技有限公司 Music score library establishing method and device
CN107547912A (en) * 2017-09-01 2018-01-05 深圳创维数字技术有限公司 A kind of method for processing resource, system and the storage medium of full matchmaker's money
CN109831683A (en) * 2019-01-03 2019-05-31 中国电信股份有限公司新疆分公司 Third party's Resource Fusion method of combination and system based on CMS platform under IPTV

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11062365B2 (en) * 2017-03-23 2021-07-13 Walmart Apollo, Llc Systems and methods for correcting incorrect product information in an electronic data catalog

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103686452A (en) * 2013-12-06 2014-03-26 北京普瑞众合国际科技有限公司 Addition processing method for video associated information
CN106649811A (en) * 2016-12-29 2017-05-10 广州酷狗计算机科技有限公司 Music score library establishing method and device
CN107547912A (en) * 2017-09-01 2018-01-05 深圳创维数字技术有限公司 A kind of method for processing resource, system and the storage medium of full matchmaker's money
CN109831683A (en) * 2019-01-03 2019-05-31 中国电信股份有限公司新疆分公司 Third party's Resource Fusion method of combination and system based on CMS platform under IPTV

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
杨超.基于NGOD架构的VOD推流服务器的研究与实现.《中国优秀硕士学位论文全文数据库信息科技辑》.2013,全文. *

Also Published As

Publication number Publication date
CN111159516A (en) 2020-05-15

Similar Documents

Publication Publication Date Title
CN109144647B (en) Form design method and device, terminal equipment and storage medium
CN111274045B (en) Multi-platform docking method and device, computer equipment and readable storage medium
US20220301051A1 (en) Systems and methods for managing a loan application
CN107784205B (en) User product auditing method, device, server and storage medium
CN110347888B (en) Order data processing method and device and storage medium
CN110880100A (en) Business approval processing method, device and system
CN112579118A (en) Method, device, system, medium and equipment for updating configuration information of microservice
CN111367531B (en) Code processing method and device
CN110245684B (en) Data processing method, electronic device, and medium
CN114003818A (en) Page recommendation method, device, server and storage medium
CN113761565B (en) Data desensitization method and device
CN111159516B (en) Media information processing method and device
CN112965943A (en) Data processing method and device, electronic equipment and storage medium
CN111277465A (en) Abnormal data message detection method and device and electronic equipment
US11657030B2 (en) Multi-dimensional data tagging and reuse
CN114880387A (en) Data integration script generation method and device, storage medium and electronic equipment
CN111209765B (en) Method and device for identifying material bar code and terminal equipment
CN110781142A (en) Data import method and device, server and storage medium
US11620697B2 (en) Systems and methods of polymorphic content generation
CN115208762B (en) Configuration updating method, device, configuration server and computer readable storage medium
CN117312349B (en) Data updating method based on industrial identification and related equipment
CN114356689A (en) Workflow monitoring method, device and equipment
US20230065934A1 (en) Extract Data From A True PDF Page
CN117312398A (en) Data processing method and device, electronic equipment and computer readable storage medium
CN114218254A (en) Report generation method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant