CN107330069B - Multimedia data processing method and device, server and storage medium - Google Patents
Multimedia data processing method and device, server and storage medium Download PDFInfo
- Publication number
- CN107330069B CN107330069B CN201710523198.5A CN201710523198A CN107330069B CN 107330069 B CN107330069 B CN 107330069B CN 201710523198 A CN201710523198 A CN 201710523198A CN 107330069 B CN107330069 B CN 107330069B
- Authority
- CN
- China
- Prior art keywords
- data
- multimedia
- target
- terminal
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/48—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
Abstract
The embodiment of the invention discloses a multimedia data processing method and a device thereof, a server and a storage medium, wherein the method comprises the following steps: sending multimedia data and a tag data set corresponding to the multimedia data to a first terminal corresponding to a target user identifier; acquiring target mark data selected from a mark data set corresponding to the multimedia data returned by the first terminal; and correspondingly storing the multimedia data and the target mark data. By adopting the method and the device, the marking process of the multimedia data is completed through the application program platform, and the problem of how to improve the marking efficiency of the multimedia data is solved.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a multimedia data processing method and apparatus, a server, and a storage medium.
Background
With the rapid development of computer technology, artificial intelligence is an important branch of computer science, and its application field is more and more extensive, and in the process of using artificial intelligence algorithm to process related data in the field of artificial intelligence, the processed data needs to be labeled, for example, when articles are classified, the label type corresponding to each article data needs to be known to accurately classify the articles. In the prior art, data to be processed is marked manually and offline, and then the marked data is processed, however, when the data amount to be processed is large, a large amount of manpower and time are needed to complete the marking process of the data, and the marking efficiency of the data is reduced.
Disclosure of Invention
The embodiment of the invention provides a multimedia data processing method and device, a server and a storage medium, which finish the marking process of multimedia data through an application program platform and solve the problem of how to improve the marking efficiency of the multimedia data.
A first aspect of an embodiment of the present invention provides a multimedia data processing method, which may include:
sending multimedia data and a tag data set corresponding to the multimedia data to a first terminal corresponding to a target user identifier;
acquiring target mark data selected from a mark data set corresponding to the multimedia data returned by the first terminal;
and correspondingly storing the multimedia data and the target mark data.
In a possible design, before sending the multimedia data and the tag data set corresponding to the multimedia data to the first terminal corresponding to the target user identifier, the method further includes:
and acquiring the target user identification corresponding to the application program.
In one possible design, the obtaining the target user identifier corresponding to the application includes:
acquiring a user identification set corresponding to the application program;
sending multimedia test data and a mark data set corresponding to the multimedia test data to a second terminal corresponding to each user identifier in the user identifier set, and acquiring target test mark data corresponding to the multimedia test data returned by each second terminal;
and acquiring the user identification of the target test mark data matched with the preset target test mark data from the user identifications, and determining the matched user identification as the target user identification.
In one possible design, further comprising:
acquiring the quantity of all multimedia data historically received by a first terminal corresponding to the target user identification;
and when the number is equal to a preset number threshold, sending multimedia test data and a mark data set corresponding to the multimedia test data to the first terminal, and acquiring target test mark data corresponding to the multimedia test data returned by the first terminal.
In one possible design, further comprising:
and returning multimedia feedback data to the first terminal.
A second aspect of an embodiment of the present invention provides a multimedia data processing apparatus, which may include:
the data sending unit is used for sending multimedia data and a mark data set corresponding to the multimedia data to a first terminal corresponding to a target user identifier;
a data obtaining unit, configured to obtain target tag data selected from a tag data set corresponding to the multimedia data, where the target tag data is returned by the first terminal;
and the data storage unit is used for correspondingly storing the multimedia data and the target mark data.
In one possible design, further comprising:
and the identification acquisition unit is used for acquiring the target user identification corresponding to the application program.
In one possible design, the identification acquisition unit includes:
a set obtaining subunit, configured to obtain a user identifier set corresponding to the application program;
the identification testing subunit is configured to send multimedia testing data and a tag data set corresponding to the multimedia testing data to a second terminal corresponding to each user identification in the user identification set, and obtain target testing tag data corresponding to the multimedia testing data returned by each second terminal;
and the identifier determining subunit is configured to obtain, from the user identifiers, a user identifier in which the target test tag data matches preset target test tag data, and determine the matched user identifier as a target user identifier.
In one possible design, further comprising:
the quantity obtaining unit is used for obtaining the quantity of all multimedia data which are historically received by the first terminal and correspond to the target user identification;
and the target identification testing unit is used for sending multimedia testing data and a mark data set corresponding to the multimedia testing data to the first terminal when the number is equal to a preset number threshold value, and acquiring target testing mark data corresponding to the multimedia testing data returned by the first terminal.
In one possible design, further comprising:
and the data feedback unit is used for returning the multimedia feedback data to the first terminal.
A third aspect of an embodiment of the present invention provides a server, which may include: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method of the first aspect of an embodiment of the invention.
A fourth aspect of embodiments of the present invention provides a computer storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the method of the first aspect of embodiments of the present invention.
An embodiment of the fifth aspect of the present invention provides a computer program product, which, when being executed by an instruction processor, executes the method in the first aspect of the present invention.
In the embodiment of the invention, the multimedia data and the mark data set corresponding to the multimedia data are sent to the first terminal corresponding to the target user identification, then the target mark data selected from the mark data set corresponding to the multimedia data returned by the first terminal is obtained, and finally the multimedia data and the target mark data are correspondingly stored. The multimedia data and the marking data are sent to the user terminal through the application program platform in a set mode, the marking process of the multimedia data is achieved in the application program platform, and the marking efficiency of the multimedia data is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart illustrating a multimedia data processing method according to an embodiment of the present invention;
FIG. 2a is a schematic diagram illustrating a multimedia data display effect according to an embodiment of the present invention;
FIG. 2b is a schematic diagram illustrating a feedback data display effect according to an embodiment of the present invention;
FIG. 3 is a flow chart of another multimedia data processing method according to an embodiment of the present invention;
FIG. 4 is a flow chart illustrating another multimedia data processing method according to an embodiment of the present invention;
FIG. 5 is a block diagram of a multimedia data processing apparatus according to an embodiment of the present invention;
FIG. 6 is a schematic structural diagram of another multimedia data processing apparatus according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an identifier obtaining unit according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a server according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The multimedia data processing method provided by the embodiment of the invention can be applied to a scene for carrying out type marking on articles through an application program platform, for example: sending multimedia data and a mark data set corresponding to the multimedia data to a first terminal corresponding to a target user identifier, then acquiring target mark data selected from the mark data set corresponding to the multimedia data returned by the first terminal, and finally correspondingly storing the multimedia data and the target mark data. The multimedia data and the marking data are sent to the user terminal through the application program platform in a set mode, the marking process of the multimedia data is achieved in the application program platform, and the marking efficiency of the multimedia data is improved.
The following describes the multimedia data processing method according to an embodiment of the present invention in detail with reference to fig. 1 to 4.
Referring to fig. 1, a flow chart of a multimedia data processing method according to an embodiment of the present invention is shown. As shown in fig. 1, the method of the embodiment of the present invention may include the following steps S101 to S103.
S101, sending multimedia data and a mark data set corresponding to the multimedia data to a first terminal corresponding to a target user identifier;
specifically, the server may send the multimedia data and the tag data set corresponding to the multimedia data to the first terminal corresponding to the target user identifier, where it is understood that the target user identifier may be identification information of a user registered in a related application (for example, a login account or a nickname of the user, etc.), and the application may provide a corresponding reward for the user after the user completes a related task, for example, an application that encourages the user to complete the related task through reward points may be provided. The application program may be at least one application program having a corresponding relationship with the target user identifier, and may provide a corresponding reward for the user after the user completes a related task, for example, the application program may be a game application, a social application, a service application, and the like. The server may be a computer device having the ability to manage resources and provide services to users, and may be, for example, a server having greater data carrying and processing capabilities. The first terminal corresponding to the target user identifier may be a tablet computer, a smart phone, a palm computer, a Mobile Internet Device (MID) or other terminal devices capable of being in communication connection with the server. The multimedia data may be articles, videos or pictures, etc. The tag data in the tag data set may be tag type data corresponding to the multimedia data, or may be data related to the multimedia data or data unrelated to the multimedia data, for example, when the multimedia data is an article (an article describing information related to a brand a mobile phone), the tag data included in the tag data set may be a keyword "mobile phone" and a brand name "a" in the article, or may be a non-keyword "communication" and "network" or other data capable of tagging the article.
S102, obtaining target mark data selected from a mark data set corresponding to the multimedia data returned by the first terminal;
it is understood that, after receiving the multimedia data and the tag data set corresponding to the multimedia data, the first terminal may receive tag data corresponding to the multimedia data selected by the user indicated by the target user identifier in the tag data set, where the selected tag data may be used as target tag data, for example, the multimedia data received by the first terminal is an article of information related to brand a mobile phone in fig. 2a, the tag data set corresponding to the article is a lower keyword (news, mobile phone, network, mobile, and a) in the figure, and the target tag data selected by the user in fig. 2a may be a "mobile phone".
Specifically, after the first terminal obtains the target tag data selected by the user for the media data, which is indicated by the target user identifier, the server may obtain the target tag data returned by the first terminal.
S103, storing the multimedia data and the target mark data;
specifically, the server may store the multimedia data and the target mark data in a corresponding manner, and it can be understood that the server may store the multimedia data and the target mark data in a one-to-one correspondence relationship, which may facilitate a processing process of a related algorithm for marked multimedia data during big data processing, for example, a marked article, which is a key for smoothly performing deep learning of a content recommendation algorithm in artificial intelligence.
In the embodiment of the invention, the multimedia data and the mark data set corresponding to the multimedia data are sent to the first terminal corresponding to the target user identification, then the target mark data selected from the mark data set corresponding to the multimedia data returned by the first terminal is obtained, and finally the multimedia data and the target mark data are correspondingly stored. The multimedia data and the marking data are sent to the user terminal through the application program platform in a set mode, the marking process of the multimedia data is achieved in the application program platform, and the marking efficiency of the multimedia data is improved.
Referring to fig. 3, a flow chart of another application status prediction method according to an embodiment of the invention is shown. As shown in fig. 3, the method of the embodiment of the present invention may include the following steps S201 to S207.
S201, acquiring the target user identification corresponding to the application program;
specifically, the server may obtain the target user identifier corresponding to the application program, and it is understood that the application program may be at least one application program having a corresponding relationship with the target user identifier, and may provide a corresponding reward for the user after the user completes a related task, for example, the reward may be a game application, a social application, a service application, and the like, and the target user identifier may be identification information of the registered user in the related application program (for example, the identification information may be a login account number or a nickname of the user). Optionally, the target user identifier may be all user identifiers corresponding to the application program, or may be a user identifier corresponding to a high-quality user obtained after the application program is screened (for example, the user may frequently log in the application program, or a user with a high success rate of completing a task allocated to the application program, or the like).
It should be noted that, when the target user identifier is a user identifier corresponding to a high-quality user, the process of screening the high-quality user by the server may be: firstly, acquiring a user identification set corresponding to the application program (the user identification set may include all user identifications corresponding to the application program), then sending multimedia test data and a tag data set corresponding to the multimedia test data to a second terminal corresponding to each user identification in the user identification set, and obtaining target test mark data corresponding to the multimedia test data returned by each second terminal, and finally obtaining a user mark matching the target test mark data with preset target test mark data from each user mark, and determining the matched user mark as a target user mark, where a match may indicate that the target test mark data is completely consistent or partially consistent with the preset target test mark data (e.g., a probability of partial consistency may be greater than 80%).
It is to be understood that the multimedia test data may be data for testing each user indicated by each user identifier in the user identifier set, and may be, for example, an article, a video, a picture, or the like. The label data in the label data set may be the label type data corresponding to the multimedia test data, and may be the words related to the multimedia test data or the words unrelated thereto, for example, when the multimedia test data is an article (an article describing education information), the label data included in the label data set may be the keywords "education to be tried" and "literacy education" in the article, or may include the non-keywords "composition" and "reading" in the article, or other data capable of labeling the article. The target test mark data may be mark test data selected by each user for the multimedia test data, and may be data of a tag type corresponding to the multimedia test data. The preset target test mark data may be a mark test data which is preset and may be regarded as correct mark data. For example, when the multimedia test data sent by the server to each user indicated by each user identifier is an "article of education information", the target test flag data is preset to be "literacy education" and "education to be tried", and the user identifier corresponding to the user (i.e., a good-quality user) who selects "literacy education" or "education to be tried" as the target test flag data can be used as the target user identifier.
S202, sending multimedia data and a mark data set corresponding to the multimedia data to a first terminal corresponding to a target user identifier;
specifically, the server may send the multimedia data and the tag data set corresponding to the multimedia data to a first terminal corresponding to a target user identifier, and it can be understood that the first terminal corresponding to the target user identifier may be other terminal devices that can be in communication connection with the server, such as a tablet computer, a smart phone, a palmtop computer, and a Mobile Internet Device (MID). The multimedia data may be articles, videos or pictures, etc. The tag data in the tag data set may be data of a tag type corresponding to the multimedia data, and may be words related to the multimedia data or words unrelated to the multimedia data, for example, when the multimedia data is an article (an article describing information related to a brand a mobile phone), the tag data included in the tag data set may be a keyword "mobile phone" and a brand name "a" in the article, or may be non-keyword "communication" and "network" or other data capable of tagging the article. The second terminal in S201 may include the first terminal.
S203, acquiring target mark data selected from the mark data set corresponding to the multimedia data returned by the first terminal;
it is understood that, after receiving the multimedia data and the tag data set corresponding to the multimedia data, the first terminal may receive tag data corresponding to the multimedia data selected by the user indicated by the target user identifier in the tag data set, where the selected tag data may be used as target tag data, for example, the multimedia data received by the first terminal is an article of information related to brand a mobile phone in fig. 2a, the tag data set corresponding to the article is a lower keyword (news, mobile phone, network, mobile, and a) in the figure, and the target tag data selected by the user in fig. 2a may be a "mobile phone".
Specifically, after the first terminal obtains the target tag data selected by the user for the media data, which is indicated by the target user identifier, the server may obtain the target tag data returned by the first terminal.
S204, correspondingly storing the multimedia data and the target mark data;
specifically, the server may store the multimedia data and the target mark data in a corresponding manner, and it can be understood that the server may store the multimedia data and the target mark data in a one-to-one correspondence relationship, which may facilitate a processing process of a related algorithm for marked multimedia data during big data processing, for example, a marked article, which is a key for smoothly performing deep learning of a content recommendation algorithm in artificial intelligence.
S205, acquiring the quantity of all multimedia data historically received by the first terminal;
it should be noted that, when the target user identifier is the user identifier corresponding to the high-quality user, after the user indicated by the target user identifier completes the task of marking the multimedia data, the server may perform multiple high-quality user tests on the user indicated by the target user identifier.
Specifically, the server may obtain the number of all multimedia data historically received by the first terminal (for example, the number of multimedia data received by the first terminal from the beginning to the current time of receiving the first multimedia data).
S206, when the number is equal to a preset number threshold, sending multimedia test data and a mark data set corresponding to the multimedia test data to the first terminal, and acquiring target test mark data corresponding to the multimedia test data returned by the first terminal;
specifically, when the number is equal to a preset number threshold, the server may send multimedia test data and a marker data set corresponding to the multimedia test data to the first terminal, and it is understood that the preset number threshold may be a regularly changing number, for example, an integer multiple number (for example, a multiple of 5, a multiple of 10, or a multiple of 15). The multimedia test data and the tag data set corresponding to the multimedia test data may be consistent with the multimedia test data and the tag data set corresponding to the multimedia test data in step S201, and it may be understood that when the number of the multimedia test data and the tag data set corresponding to the multimedia test data sent by the server meets a preset number threshold, the sent multimedia test data and the tag data set corresponding to the multimedia test data may perform a high-quality user test again on the user indicated by the target user identifier.
Further, the server may obtain target test flag data corresponding to the multimedia test data returned by the first terminal, and when the target test flag data matches preset target test flag data, re-determine that the target user identifier is a target user identifier, that is, re-confirm that the user indicated by the target user identifier is a good-quality user.
In the embodiment of the invention, the user participating in the marking of the multimedia data is ensured to be a user with high accuracy by testing the target user identification again, and the stability of the marking accuracy of the multimedia data is improved.
S207, multimedia feedback data are returned to the first terminal;
specifically, the server may return multimedia feedback data to the first terminals, and it is understood that the multimedia feedback data includes reward data after completing a marking task for the user indicated by each first terminal, for example, a bonus point package as shown in fig. 2 b.
In a specific implementation manner of the embodiment of the present invention, when the target user identifier is a user identifier corresponding to a high-quality user, the obtaining of the target user identifier corresponding to the application program may include the following steps, as shown in fig. 4:
s301, acquiring a user identification set corresponding to the application program;
specifically, the server may obtain a user identifier set corresponding to the application program, and it may be understood that the user identifier set may be a set of all registered user identifiers corresponding to the application program.
S302, sending multimedia test data and a mark data set corresponding to the multimedia test data to a second terminal corresponding to each user identifier in the user identifier set, and acquiring target test mark data corresponding to the multimedia test data returned by each second terminal;
specifically, the server may send multimedia test data and a tag data set corresponding to the multimedia test data to a second terminal corresponding to each user identifier in the user identifier set, where it may be understood that the multimedia test data may be data for testing each user indicated by each user identifier in the user identifier set, and may be, for example, an article, a video, or a picture. The label data in the label data set may be the label type data corresponding to the multimedia test data, may be the data related to the multimedia test data, or may be the data unrelated to the multimedia test data, for example, when the multimedia test data is an article (an article describing education information), the label data included in the label data set may be the keywords "education to be tried" and "literacy education" in the article, or may include the non-keywords "composition" and "reading" in the article, or other data capable of labeling the article.
It can be understood that the second terminal may be a tablet computer, a smart phone, a palm computer, a Mobile Internet Device (MID), or other terminal devices that can be in communication connection with the server, where the second terminal includes the first terminal when the user indicated by the target user identifier is a good user, and the second terminal is the first terminal when the user indicated by the target user identifier is all registered users.
Further, the server may obtain target test tag data corresponding to the multimedia test data returned by each second terminal, and it may be understood that the target test tag data may be tag test data selected by each user in the tag data set for the multimedia test data, and may be data of a tag type corresponding to the multimedia test data.
S303, acquiring a user identifier of the target test mark data matched with preset target test mark data from the user identifiers, and determining the matched user identifier as a target user identifier;
specifically, the server may obtain, from the user identifiers, a user identifier matching the target test mark data with preset target test mark data, and determine the matched user identifier as a target user identifier, where matching may indicate that the target test mark data is completely consistent with the preset target test mark data or partially consistent with the preset target test mark data (for example, the probability that partial consistency is consistent may be greater than 80%). It is to be understood that the preset target test mark data may be a mark test data which is preset and may be considered as a correct mark data. For example, when the multimedia test data sent by the server to each user indicated by each user identifier is an "article of education information", the target test flag data is preset to be "literacy education" and "education to be tried", and the user identifier corresponding to the user (i.e., a good-quality user) who selects "literacy education" or "education to be tried" as the target test flag data can be used as the target user identifier.
In the embodiment of the invention, the target user identification is selected from the user identification set, so that the accuracy of completing the multimedia data marking task is ensured, and the efficiency of marking the multimedia data is improved.
The server according to the embodiment of the present invention may be a computer device that manages resources and provides services to a user, for example, a server with strong data carrying capacity and processing capacity.
In the embodiment of the invention, the multimedia data and the mark data set corresponding to the multimedia data are sent to the first terminal corresponding to the target user identification, then the target mark data selected from the mark data set corresponding to the multimedia data returned by the first terminal is obtained, and finally the multimedia data and the target mark data are correspondingly stored. The multimedia data and the marking data are sent to the user terminal through the application program platform in a set mode, the marking process of the multimedia data is achieved in the application program platform, and the marking efficiency of the multimedia data is improved; by selecting the target user identifier from the user identifier set, the accuracy of completing the multimedia data marking task is ensured, and the efficiency of marking the multimedia data is improved; by testing the target user identification again, the users participating in the marking of the multimedia data are guaranteed to be users with high accuracy, and the stability of the marking accuracy of the multimedia data is improved.
The following describes the multimedia data processing apparatus according to an embodiment of the present invention in detail with reference to fig. 5 to 7. It should be noted that the apparatuses shown in fig. 5-7 are used for executing the method according to the embodiments of the present invention shown in fig. 1-4, and for convenience of description, only the parts related to the embodiments of the present invention are shown, and details of the technology are not disclosed, please refer to the embodiments of the present invention shown in fig. 1-4.
Referring to fig. 5, a schematic structural diagram of a multimedia data processing apparatus according to an embodiment of the invention is provided. As shown in fig. 5, the multimedia data processing apparatus 1 according to the embodiment of the present invention may include: a data transmitting unit 11, a data acquiring unit 12, and a data storing unit 13.
A data sending unit 11, configured to send multimedia data and a tag data set corresponding to the multimedia data to a first terminal corresponding to a target user identifier;
in a specific implementation, the data sending unit 11 may send the multimedia data and the tag data set corresponding to the multimedia data to a first terminal corresponding to a target user identifier, where it is understood that the target user identifier may be identification information of a registered user in a related application (for example, a login account or a nickname of the user, etc.), and the application may provide a corresponding reward for the user after the user completes a related task, for example, an application that encourages the user to complete the related task through reward points may be used. The application program may be at least one application program having a corresponding relationship with the target user identifier, and may provide a corresponding reward for the user after the user completes a related task, for example, the application program may be a game application, a social application, a service application, and the like. The server may be a computer device having the ability to manage resources and provide services to users, and may be, for example, a server having greater data carrying and processing capabilities. The first terminal corresponding to the target user identifier may be a tablet computer, a smart phone, a palm computer, a Mobile Internet Device (MID) or other terminal devices capable of being in communication connection with the server. The multimedia data may be articles, videos or pictures, etc. The tag data in the tag data set may be tag type data corresponding to the multimedia data, or may be data related to the multimedia data or data unrelated to the multimedia data, for example, when the multimedia data is an article (an article describing information related to a brand a mobile phone), the tag data included in the tag data set may be a keyword "mobile phone" and a brand name "a" in the article, or may be a non-keyword "communication" and "network" or other data capable of tagging the article.
A data obtaining unit 12, configured to obtain target tag data selected from a tag data set corresponding to the multimedia data, where the target tag data is returned by the first terminal;
it is understood that, after receiving the multimedia data and the tag data set corresponding to the multimedia data, the first terminal may receive tag data corresponding to the multimedia data selected by the user indicated by the target user identifier in the tag data set, where the selected tag data may be used as target tag data, for example, the multimedia data received by the first terminal is an article of information related to brand a mobile phone in fig. 2a, the tag data set corresponding to the article is a lower keyword (news, mobile phone, network, mobile, and a) in the figure, and the target tag data selected by the user in fig. 2a may be a "mobile phone".
In a specific implementation, after the first terminal obtains the target tag data selected by the user indicated by the target user identifier for the media data, the data obtaining unit 12 may obtain the target tag data returned by the first terminal.
A data storage unit 13, configured to correspondingly store the multimedia data and the target mark data;
in specific implementation, the data storage unit 13 may store the multimedia data and the target mark data in a corresponding manner, and it can be understood that the data storage unit 13 may store the multimedia data and the target mark data in a one-to-one correspondence relationship, which may facilitate a processing process of performing a related algorithm on the marked multimedia data when processing big data, for example, a marked article, which is a key for smoothly performing deep learning of a content recommendation algorithm in artificial intelligence.
In the embodiment of the invention, the multimedia data and the mark data set corresponding to the multimedia data are sent to the first terminal corresponding to the target user identification, then the target mark data selected from the mark data set corresponding to the multimedia data returned by the first terminal is obtained, and finally the multimedia data and the target mark data are correspondingly stored. The multimedia data and the marking data are sent to the user terminal through the application program platform in a set mode, the marking process of the multimedia data is achieved in the application program platform, and the marking efficiency of the multimedia data is improved.
Referring to fig. 6, a schematic structural diagram of another multimedia data processing apparatus according to an embodiment of the invention is provided. As shown in fig. 6, the multimedia data processing apparatus 1 according to the embodiment of the present invention may include: a data transmitting unit 11, a data acquiring unit 12, a data storing unit 13, an identification acquiring unit 14, a number acquiring unit 15, a target identification testing unit 16, and a data feedback unit 17.
An identifier obtaining unit 14, configured to obtain the target user identifier corresponding to the application program;
in a specific implementation, the identifier obtaining unit 14 may obtain the shown target user identifier corresponding to the application program, and it is understood that the application program may be at least one application program having a corresponding relationship with the target user identifier, and may provide a corresponding reward for the user after the user completes a related task, for example, a game application, a social application, a service application, and the like, and the target user identifier may be identification information of the registered user in the related application program (for example, the target user identifier may be a login account number or a nickname of the user, and the like). Optionally, the target user identifier may be all user identifiers corresponding to the application program, or may be a user identifier corresponding to a high-quality user obtained after the application program is screened (for example, the user may frequently log in the application program, or a user with a high success rate of completing a task allocated to the application program, or the like).
Referring to fig. 7, a schematic structural diagram of an identifier obtaining unit is provided in an embodiment of the present invention. As shown in fig. 7, the identification obtaining unit 14 may include:
a set obtaining subunit 141, configured to obtain a user identifier set corresponding to the application program;
in a specific implementation, the set obtaining subunit 141 may obtain a user identifier set corresponding to an application program, and it is understood that the user identifier set may be a set of all registered user identifiers corresponding to the application program.
An identifier testing subunit 142, configured to send multimedia testing data and a tag data set corresponding to the multimedia testing data to a second terminal corresponding to each user identifier in the user identifier set, and obtain target testing tag data corresponding to the multimedia testing data returned by each second terminal;
in a specific implementation, the identifier testing subunit 142 may send multimedia test data and a tag data set corresponding to the multimedia test data to a second terminal corresponding to each user identifier in the user identifier set, where it may be understood that the multimedia test data may be data for testing each user indicated by each user identifier in the user identifier set, and may be, for example, an article, a video, or a picture. The label data in the label data set may be the label type data corresponding to the multimedia test data, may be the data related to the multimedia test data, or may be the data unrelated to the multimedia test data, for example, when the multimedia test data is an article (an article describing education information), the label data included in the label data set may be the keywords "education to be tried" and "literacy education" in the article, or may include the non-keywords "composition" and "reading" in the article, or other data capable of labeling the article.
It can be understood that the second terminal may be a tablet computer, a smart phone, a palm computer, a Mobile Internet Device (MID), or other terminal devices that can be in communication connection with the server, where the second terminal includes the first terminal when the user indicated by the target user identifier is a good user, and the second terminal is the first terminal when the user indicated by the target user identifier is all registered users.
Further, the identification testing subunit 142 may obtain target test flag data corresponding to the multimedia test data returned by each second terminal, and it may be understood that the target test flag data may be the flag test data selected by each user in the flag data set for the multimedia test data, and may be data of a tag type corresponding to the multimedia test data.
An identifier determining subunit 143, configured to obtain, from the user identifiers, a user identifier in which the target test tag data matches preset target test tag data, and determine the matched user identifier as a target user identifier;
in a specific implementation, the identifier determining subunit 143 may obtain, from the user identifiers, a user identifier that the target test mark data matches preset target test mark data, and determine the matched user identifier as a target user identifier, where matching may indicate that the target test mark data completely matches or partially matches the preset target test mark data (for example, a probability that partial agreement may be agreement is greater than 80%). It is to be understood that the preset target test mark data may be a mark test data which is preset and may be considered as a correct mark data. For example, when the multimedia test data transmitted by the multimedia data processing apparatus 1 to each user indicated by each user identifier is "article of education information", the target test flag data is preset to "literacy education" and "education to be tried", and the user identifier corresponding to the user (i.e., good user) who selects "literacy education" or "education to be tried" as the target test flag data may be used as the target user identifier.
In the embodiment of the invention, the target user identification is selected from the user identification set, so that the accuracy of completing the multimedia data marking task is ensured, and the efficiency of marking the multimedia data is improved.
A data sending unit 11, configured to send multimedia data and a tag data set corresponding to the multimedia data to a first terminal corresponding to a target user identifier;
in a specific implementation, the data sending unit 11 may send the multimedia data and the tag data set corresponding to the multimedia data to a first terminal corresponding to a target user identifier, and it is understood that the first terminal corresponding to the target user identifier may be other terminal devices that can be in communication connection with a server, such as a tablet computer, a smart phone, a palmtop computer, and a Mobile Internet Device (MID). The multimedia data may be articles, videos or pictures, etc. The tag data in the tag data set may be tag type data corresponding to the multimedia data, or may be data related to the multimedia data or data unrelated to the multimedia data, for example, when the multimedia data is an article (an article describing information related to a brand a mobile phone), the tag data included in the tag data set may be a keyword "mobile phone" and a brand name "a" in the article, or may be a non-keyword "communication" and "network" or other data capable of tagging the article.
A data obtaining unit 12, configured to obtain target tag data selected from a tag data set corresponding to the multimedia data, where the target tag data is returned by the first terminal;
it is understood that, after receiving the multimedia data and the tag data set corresponding to the multimedia data, the first terminal may receive tag data corresponding to the multimedia data selected by the user indicated by the target user identifier in the tag data set, where the selected tag data may be used as target tag data, for example, the multimedia data received by the first terminal is an article of information related to brand a mobile phone in fig. 2a, the tag data set corresponding to the article is a lower keyword (news, mobile phone, network, mobile, and a) in the figure, and the target tag data selected by the user in fig. 2a may be a "mobile phone".
In a specific implementation, after the first terminal obtains the target tag data selected by the user indicated by the target user identifier for the media data, the data obtaining unit 12 may obtain the target tag data returned by the first terminal.
A data storage unit 13, configured to correspondingly store the multimedia data and the target mark data;
in specific implementation, the data storage unit 13 may store the multimedia data and the target mark data in a corresponding manner, and it can be understood that the data storage unit 13 may store the multimedia data and the target mark data in a one-to-one correspondence relationship, which may facilitate a processing process of performing a related algorithm on the marked multimedia data when processing big data, for example, a marked article, which is a key for smoothly performing deep learning of a content recommendation algorithm in artificial intelligence.
A quantity obtaining unit 15, configured to obtain the quantity of all multimedia data historically received by the first terminal;
it should be noted that, when the target user identifier is the user identifier corresponding to the high-quality user, after the user indicated by the target user identifier completes the task of marking the multimedia data, the quantity obtaining unit 15 may perform multiple high-quality user tests on the user indicated by the target user identifier.
In a specific implementation, the quantity obtaining unit 15 may obtain the quantity of all multimedia data historically received by the first terminal (for example, the multimedia data received by the first terminal from the beginning to the current time of receiving the first multimedia data).
A target identifier testing unit 16, configured to send multimedia test data and a tag data set corresponding to the multimedia test data to the first terminal when the number is equal to a preset number threshold, and obtain target test tag data corresponding to the multimedia test data returned by the first terminal;
in a specific implementation, when the number is equal to a preset number threshold, the target identification testing unit 16 may send multimedia test data and a flag data set corresponding to the multimedia test data to the first terminal, and it is understood that the preset number threshold may be a regularly changing number, for example, an integer multiple number (for example, a multiple of 5, a multiple of 10, or a multiple of 15). The multimedia test data and the tag data set corresponding to the multimedia test data may be consistent with the multimedia test data in the identifier testing subunit 142 and the tag data set corresponding to the multimedia test data, and it can be understood that when the number of the target identifier testing unit 16 meets a preset number threshold, the sent multimedia test data and the tag data set corresponding to the multimedia test data may perform a high-quality user test again on the user indicated by the target user identifier.
Further, the target identifier testing unit 16 may obtain target test flag data corresponding to the multimedia test data returned by the first terminal, and when the target test flag data matches preset target test flag data, re-determine that the target user identifier is the target user identifier, that is, re-determine that the user indicated by the target user identifier is a good user.
In the embodiment of the invention, the user participating in the marking of the multimedia data is ensured to be a user with high accuracy by testing the target user identification again, and the stability of the marking accuracy of the multimedia data is improved.
A data feedback unit 17, configured to return multimedia feedback data to the first terminal;
in a specific implementation, the data feedback unit 17 may return multimedia feedback data to the first terminals, and it is understood that the multimedia feedback data includes reward data after completing a marking task for the user indicated by each first terminal, for example, a bonus point red packet as shown in fig. 2 b.
In the embodiment of the invention, the multimedia data and the mark data set corresponding to the multimedia data are sent to the first terminal corresponding to the target user identification, then the target mark data selected from the mark data set corresponding to the multimedia data returned by the first terminal is obtained, and finally the multimedia data and the target mark data are correspondingly stored. The multimedia data and the marking data are sent to the user terminal through the application program platform in a set mode, the marking process of the multimedia data is achieved in the application program platform, and the marking efficiency of the multimedia data is improved; by selecting the target user identifier from the user identifier set, the accuracy of completing the multimedia data marking task is ensured, and the efficiency of marking the multimedia data is improved; by testing the target user identification again, the users participating in the marking of the multimedia data are guaranteed to be users with high accuracy, and the stability of the marking accuracy of the multimedia data is improved.
An embodiment of the present invention further provides a computer storage medium, where the computer storage medium may store a plurality of instructions, where the instructions are suitable for being loaded by a processor and executing the method steps in the embodiments shown in fig. 1 to 4, and a specific execution process may refer to specific descriptions of the embodiments shown in fig. 1 to 4, which are not described herein again.
Please refer to fig. 8, which provides a schematic structural diagram of a server according to an embodiment of the present invention. As shown in fig. 8, the server 1000 may include: at least one processor 1001, such as a CPU, at least one network interface 1004, a user interface 1003, memory 1005, at least one communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display) and a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a standard wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one disk memory. The memory 1005 may optionally be at least one memory device located remotely from the processor 1001. As shown in fig. 8, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a multimedia data processing application program.
In the server 1000 shown in fig. 8, the user interface 1003 is mainly used as an interface for providing input for a user, and acquiring data input by the user; the network interface 1004 is used for data communication with the user terminal; and the processor 1001 may be configured to invoke the multimedia data processing application stored in the memory 1005 and specifically perform the following operations:
sending multimedia data and a tag data set corresponding to the multimedia data to a first terminal corresponding to a target user identifier;
acquiring target mark data selected from a mark data set corresponding to the multimedia data returned by the first terminal;
and storing the multimedia data and the target mark data.
In one embodiment, before performing sending of multimedia data and a tag data set corresponding to the multimedia data to a first terminal corresponding to a target user identifier, the processor 1001 further performs the following operations:
and acquiring the target user identification corresponding to the application program.
In an embodiment, when the processor 1001 acquires the target user identifier corresponding to the application program, the following operations are specifically performed:
acquiring a user identification set corresponding to the application program;
sending multimedia test data and a mark data set corresponding to the multimedia test data to a second terminal corresponding to each user identifier in a user identifier set, and acquiring target test mark data corresponding to the multimedia test data returned by each second terminal;
and acquiring the user identification of the target test mark data matched with the preset target test mark data from the user identifications, and determining the matched user identification as the target user identification.
In one embodiment, the processor 1001 is further configured to:
acquiring the quantity of all multimedia data historically received by the first terminal;
and when the number is equal to a preset number threshold, sending multimedia test data and a mark data set corresponding to the multimedia test data to the first terminal, and acquiring target test mark data corresponding to the multimedia test data returned by the first terminal.
In one embodiment, the processor 1001, after performing the corresponding storing of the multimedia data and the target mark data, is further configured to:
and returning multimedia feedback data to the first terminal.
In the embodiment of the invention, the multimedia data and the mark data set corresponding to the multimedia data are sent to the first terminal corresponding to the target user identification, then the target mark data selected from the mark data set corresponding to the multimedia data returned by the first terminal is obtained, and finally the multimedia data and the target mark data are correspondingly stored. The multimedia data and the marking data are sent to the user terminal through the application program platform in a set mode, the marking process of the multimedia data is achieved in the application program platform, and the marking efficiency of the multimedia data is improved; by selecting the target user identifier from the user identifier set, the accuracy of completing the multimedia data marking task is ensured, and the efficiency of marking the multimedia data is improved; by testing the target user identification again, the users participating in the marking of the multimedia data are guaranteed to be users with high accuracy, and the stability of the marking accuracy of the multimedia data is improved.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.
Claims (8)
1. A method for processing multimedia data, comprising:
acquiring a user identifier set corresponding to an application program, sending multimedia test data and a tag data set corresponding to the multimedia test data to a second terminal corresponding to each user identifier in the user identifier set, acquiring target test tag data corresponding to the multimedia test data returned by each second terminal, acquiring a user identifier of which the target test tag data is matched with preset target test tag data from each user identifier, and determining the matched user identifier as a target user identifier, wherein the user identifier set comprises all user identifiers corresponding to the application program;
sending multimedia data and a tag data set corresponding to the multimedia data to a first terminal corresponding to a target user identifier, wherein the tag data set comprises tag data irrelevant to the multimedia data;
acquiring target mark data selected from a mark data set corresponding to the multimedia data returned by the first terminal;
and correspondingly storing the multimedia data and the target mark data.
2. The method of claim 1, further comprising:
acquiring the quantity of all multimedia data historically received by the first terminal;
and when the number is equal to a preset number threshold, sending multimedia test data and a mark data set corresponding to the multimedia test data to the first terminal, and acquiring target test mark data corresponding to the multimedia test data returned by the first terminal.
3. The method of claim 1, wherein after storing the multimedia data and the target mark-up data correspondingly, further comprising:
and returning multimedia feedback data to the first terminal.
4. A multimedia data processing apparatus, comprising:
the system comprises an identification acquisition unit, a storage unit and a processing unit, wherein the identification acquisition unit is used for acquiring a user identification set corresponding to an application program, sending multimedia test data and a mark data set corresponding to the multimedia test data to a second terminal corresponding to each user identification in the user identification set, acquiring target test mark data corresponding to the multimedia test data returned by each second terminal, acquiring user identifications, matched with preset target test mark data, of the target test mark data in each user identification, and determining the matched user identifications as target user identifications, and the user identification set comprises all user identifications corresponding to the application program;
the system comprises a data sending unit, a data receiving unit and a data sending unit, wherein the data sending unit is used for sending multimedia data and a tag data set corresponding to the multimedia data to a first terminal corresponding to a target user identifier, and the tag data set comprises tag data irrelevant to the multimedia data;
a data obtaining unit, configured to obtain target tag data selected from a tag data set corresponding to the multimedia data, where the target tag data is returned by the first terminal;
and the data storage unit is used for correspondingly storing the multimedia data and the target mark data.
5. The apparatus of claim 4, further comprising:
the quantity acquisition unit is used for acquiring the quantity of all multimedia data historically received by the first terminal;
and the target identification testing unit is used for sending multimedia testing data and a mark data set corresponding to the multimedia testing data to the first terminal when the number is equal to a preset number threshold value, and acquiring target testing mark data corresponding to the multimedia testing data returned by the first terminal.
6. The apparatus of claim 5, further comprising:
and the data feedback unit is used for returning the multimedia feedback data to the first terminal.
7. A server, comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method according to any of claims 1-3.
8. A computer storage medium having stored thereon a plurality of instructions adapted to be loaded by a processor and to perform the method according to any of claims 1-3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710523198.5A CN107330069B (en) | 2017-06-30 | 2017-06-30 | Multimedia data processing method and device, server and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710523198.5A CN107330069B (en) | 2017-06-30 | 2017-06-30 | Multimedia data processing method and device, server and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107330069A CN107330069A (en) | 2017-11-07 |
| CN107330069B true CN107330069B (en) | 2020-10-23 |
Family
ID=60198101
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710523198.5A Active CN107330069B (en) | 2017-06-30 | 2017-06-30 | Multimedia data processing method and device, server and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107330069B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109614209B (en) * | 2018-10-26 | 2023-09-05 | 创新先进技术有限公司 | Task processing method, application server and system |
| CN110688628B (en) * | 2019-10-09 | 2021-08-13 | 北京达佳互联信息技术有限公司 | Multimedia information processing method and device and server |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101989289A (en) * | 2009-08-06 | 2011-03-23 | 富士通株式会社 | Data clustering method and device |
| CN102279887A (en) * | 2011-08-18 | 2011-12-14 | 北京百度网讯科技有限公司 | Method, device and system for classifying documents |
| CN102867025A (en) * | 2012-08-23 | 2013-01-09 | 百度在线网络技术（北京）有限公司 | Method and device for acquiring picture marking data |
| CN102982076A (en) * | 2012-10-30 | 2013-03-20 | 新华通讯社 | Multi-dimensionality content labeling method based on semanteme label database |
| CN103412935A (en) * | 2013-08-21 | 2013-11-27 | 珠海金山办公软件有限公司 | Method and system for automatically identifying and recommending hyperlink markup type |
| CN104216882A (en) * | 2013-05-29 | 2014-12-17 | 华为技术有限公司 | File labeling method and device |
| CN104572735A (en) * | 2013-10-23 | 2015-04-29 | 华为技术有限公司 | Photo tagging word recommending method and device |
| CN105094760A (en) * | 2014-04-28 | 2015-11-25 | 小米科技有限责任公司 | Picture marking method and device |
| CN105912682A (en) * | 2016-04-14 | 2016-08-31 | 乐视控股（北京）有限公司 | Video classification label generating method and device |
| CN106878444A (en) * | 2017-03-08 | 2017-06-20 | 深圳市八圈科技有限公司 | Terminal, host device, computer-readable recording medium and data processing method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130097172A1 (en) * | 2011-04-04 | 2013-04-18 | Zachary McIntosh | Method and apparatus for indexing and retrieving multimedia with objective metadata |
-
2017
- 2017-06-30 CN CN201710523198.5A patent/CN107330069B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101989289A (en) * | 2009-08-06 | 2011-03-23 | 富士通株式会社 | Data clustering method and device |
| CN102279887A (en) * | 2011-08-18 | 2011-12-14 | 北京百度网讯科技有限公司 | Method, device and system for classifying documents |
| CN102867025A (en) * | 2012-08-23 | 2013-01-09 | 百度在线网络技术（北京）有限公司 | Method and device for acquiring picture marking data |
| CN102982076A (en) * | 2012-10-30 | 2013-03-20 | 新华通讯社 | Multi-dimensionality content labeling method based on semanteme label database |
| CN104216882A (en) * | 2013-05-29 | 2014-12-17 | 华为技术有限公司 | File labeling method and device |
| CN103412935A (en) * | 2013-08-21 | 2013-11-27 | 珠海金山办公软件有限公司 | Method and system for automatically identifying and recommending hyperlink markup type |
| CN104572735A (en) * | 2013-10-23 | 2015-04-29 | 华为技术有限公司 | Photo tagging word recommending method and device |
| CN105094760A (en) * | 2014-04-28 | 2015-11-25 | 小米科技有限责任公司 | Picture marking method and device |
| CN105912682A (en) * | 2016-04-14 | 2016-08-31 | 乐视控股（北京）有限公司 | Video classification label generating method and device |
| CN106878444A (en) * | 2017-03-08 | 2017-06-20 | 深圳市八圈科技有限公司 | Terminal, host device, computer-readable recording medium and data processing method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107330069A (en) | 2017-11-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112868004B (en) | Resource recommendation method and device, electronic equipment and storage medium | |
| US10929600B2 (en) | Method and apparatus for identifying type of text information, storage medium, and electronic apparatus | |
| KR102002024B1 (en) | Method for processing labeling of object and object management server | |
| CN109961032B (en) | Method and apparatus for generating classification model | |
| CN104951456A (en) | Method, device and equipment used for obtaining answer information | |
| CN110084317B (en) | Method and device for recognizing images | |
| CN110727868A (en) | Object recommendation method, device and computer-readable storage medium | |
| CN107864405B (en) | Viewing behavior type prediction method, device and computer readable medium | |
| CN112818224B (en) | Information recommendation method and device, electronic equipment and readable storage medium | |
| CN104508689A (en) | A two-dimension code processing method and a terminal | |
| CN103455587B (en) | Obtain and push the method and device of content, receive the method and device for pushing content | |
| CN112351350B (en) | Content display method, device, system, equipment and storage medium | |
| CN107330069B (en) | Multimedia data processing method and device, server and storage medium | |
| CN110727782A (en) | Question and answer corpus generation method and system | |
| CN111182332B (en) | Video processing method, device, server and storage medium | |
| CN111026969A (en) | Content recommendation method and device, storage medium and server | |
| CN113986062A (en) | Information processing method, device and storage medium | |
| CN111695041B (en) | Method and device for recommending information | |
| CN103457944A (en) | Method and device for pushing information and server | |
| CN107146098B (en) | Advertisement operation configuration method and equipment | |
| CN115061785A (en) | Information issuing method and device, storage medium and server | |
| CN104580164B (en) | Method for processing business and device | |
| CN114297380A (en) | Data processing method, device, equipment and storage medium | |
| CN112947748A (en) | Augmented reality AR remote interaction method and system thereof | |
| CN112287173A (en) | Method and apparatus for generating information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |