CN110866147A - Method, apparatus and storage medium for classifying live broadcast application - Google Patents
Method, apparatus and storage medium for classifying live broadcast application Download PDFInfo
- Publication number
- CN110866147A CN110866147A CN201910975070.1A CN201910975070A CN110866147A CN 110866147 A CN110866147 A CN 110866147A CN 201910975070 A CN201910975070 A CN 201910975070A CN 110866147 A CN110866147 A CN 110866147A
- Authority
- CN
- China
- Prior art keywords
- information
- live broadcast
- client
- application
- application program
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/75—Clustering; Classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Multimedia (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present disclosure relates to a method, an apparatus, and a storage medium for classifying a live application, wherein the method includes: acquiring current live broadcast information of a first client, wherein the current live broadcast information comprises identification information of the first client, identity information of a first user and first application information, the first application information represents relevant information of a first application program selected by the first user on the first client, and the first application program represents a live broadcast application program actively confirmed by the first user and running; and acquiring the reported data of the first client according to the identification information and the identity information, and determining a classification result corresponding to the current actual live broadcast application program of the first client by using the current live broadcast information and the reported data, wherein the reported data comprises related information of a historical live broadcast application program collected and uploaded by the first client. The method and the device avoid the anchor from manually selecting the video classification of the current actual live broadcast application program, and improve the accuracy of watching the live broadcast video of the interested video classification by the user.
Description
Technical Field
The present disclosure relates to the field of live broadcast technologies, and in particular, to a method, an apparatus, and a storage medium for classifying live broadcast applications.
Background
With the development of network technology, more and more users watch live videos such as game live videos through a network. Because of the numerous categories of live videos, a user needs to select a video category of interest before watching a live video, and then select which live video of a live broadcast room to watch from the selected video category.
In the related art, before video live broadcast, a main broadcast needs to manually select a corresponding video category. Part of the anchor may erroneously select a video category, causing a problem that the user cannot view live video of the video category of interest.
Disclosure of Invention
The present disclosure provides a method, an apparatus, and a storage medium for classifying live applications, so as to at least solve a problem in the related art that a user cannot watch live video of an interesting video classification due to a broadcaster erroneously selecting a video classification. The technical scheme of the disclosure is as follows:
according to a first aspect of the embodiments of the present disclosure, there is provided a method for classifying a live application, which is applied to a server side, the method including:
acquiring current live broadcast information from a first client, wherein the current live broadcast information comprises identification information of the first client, identity information of a first user of the first client and first application information, the first application information represents relevant information of a first application program selected by the first user on the first client, and the first application program represents a running live broadcast application program actively confirmed by the first user;
and acquiring reported data of the first client according to the identification information and the identity information, and determining a classification result corresponding to a current actual live broadcast application program of the first client by using the current live broadcast information and the reported data, wherein the reported data comprises related information of a historical live broadcast application program collected and uploaded by the first client.
Optionally, the step of obtaining the reported data of the first client according to the identification information and the identity information, and determining a classification result corresponding to a current actual live broadcast application program of the first client by using the current live broadcast information and the reported data includes:
acquiring a first continuous amount of reported data of the first client according to the identification information and the identity information;
and determining a classification result corresponding to the current actual live broadcast application program according to the continuous first quantity of the reported data, the first application information and a preset first rule.
Optionally, the step of determining a classification result corresponding to the current actual live broadcast application program according to the continuous first amount of the reported data, the first application information, and a preset first rule includes:
inquiring whether the first application information exists in the reported data of continuous first quantity;
and if one or more of the reported data in the continuous first amount of the reported data has the first application information, determining that the classification result corresponding to the current actual live broadcast application program is the first application program.
Optionally, after the step of querying whether the first application information exists in a first continuous amount of the reported data, the method further includes:
if the first application information does not exist in the continuous first amount of reported data, acquiring identification data of the first client according to the identification information and the identity information, and determining a classification result corresponding to the current actual live broadcast application program by using the current live broadcast information and the identification data, wherein the identification data represents an identification result obtained by classifying and identifying the historical live broadcast application program on the first client.
Optionally, the step of obtaining the identification data of the first client according to the identification information and the identity information, and determining the classification result corresponding to the current actual live broadcast application program by using the current live broadcast information and the identification data includes:
acquiring a second continuous amount of identification data of the first client according to the identification information and the identity information;
and determining a classification result corresponding to the current actual live broadcast application program according to the continuous first amount of the reported data, the continuous second amount of the identification data, the first application information and a preset second rule.
Optionally, the step of determining a classification result corresponding to the current actual live broadcast application program according to the continuous first amount of the report data, the continuous second amount of the identification data, the first application information, and a preset second rule includes:
counting the third quantity of the first application information and the fourth quantity of the second application information in the continuous second quantity of the identification data, wherein the second application information is related information of a second application program;
if the third number is greater than or equal to a preset second threshold and the second application information exists in the continuous first number of reported data under the condition that the third number is a preset first threshold, or if the fourth number is greater than or equal to a preset third threshold and the second application information does not exist in the continuous first number of reported data under the condition that the third number is the first threshold, determining that the classification result corresponding to the current actual live broadcast application program is the second application program;
if the third quantity is smaller than the second threshold and/or the second application information does not exist in the continuous first quantity of the reported data under the condition that the third quantity is the first threshold, or if the fourth quantity is smaller than the third threshold and/or the second application information exists in the continuous first quantity of the reported data under the condition that the third quantity is the first threshold, determining that the classification result corresponding to the current actual live broadcast application program is other application programs.
Optionally, before the step of obtaining the identification data of the first client according to the identification information and the identity information, the method further includes:
intercepting an operation interface of at least one historical live broadcast application program of the first client to obtain at least one live broadcast screenshot;
identifying feature points in at least one of the live screenshots;
determining the probability of a plurality of alternative classification results corresponding to each historical live broadcast application program according to the feature points;
taking the alternative classification result with the maximum probability corresponding to each historical live broadcast application program as the identification result of each historical live broadcast application program;
and taking the identification result of each historical live application program of the first client as identification data of the first client.
Optionally, the method further comprises:
obtaining a live broadcast watching request from a second client, wherein the live broadcast watching request comprises a live broadcast classification;
searching the identification information matched with the live broadcast classification in the classification result;
and if the matched identification information is the identification information of the first client, returning the identification information of the first client to the second client so that the second client can watch the live audio and video data of the current actual live application program of the first client according to the identification information of the first client.
According to a second aspect of the embodiments of the present disclosure, there is provided an apparatus for classifying a live application, applied to a server, the apparatus including:
an obtaining unit, configured to obtain current live broadcast information from a first client, where the current live broadcast information includes identification information of the first client, identity information of a first user of the first client, and first application information, where the first application information represents information related to a first application selected by the first user on the first client, and the first application represents a running live broadcast application actively confirmed by the first user;
and the classification unit is configured to acquire reported data of the first client according to the identification information and the identity information, and determine a classification result corresponding to a current actual live broadcast application program of the first client by using the current live broadcast information and the reported data, wherein the reported data comprises related information of a historical live broadcast application program collected and uploaded by the first client.
Optionally, the classification unit includes:
the acquisition module is configured to acquire a first continuous amount of reported data of the first client according to the identification information and the identity information;
and the determining module is configured to determine a classification result corresponding to the current actual live broadcast application program according to the continuous first amount of the reported data, the first application information and a preset first rule.
Optionally, the determining module includes:
the query submodule is configured to query whether the first application information exists in the continuous first amount of the reported data;
the determining sub-module is configured to determine that a classification result corresponding to the current actual live broadcast application program is the first application program if the first application information exists in one or more of the continuous first amount of the reported data.
Optionally, the determining sub-module is further configured to, if no first application information exists in the continuous first amount of the reported data, obtain identification data of the first client according to the identification information and the identity information, and determine a classification result corresponding to the current actual live broadcast application program by using the current live broadcast information and the identification data, where the identification data represents an identification result obtained by performing classification and identification on a historical live broadcast application program on the first client.
Optionally, the determining sub-module is configured to obtain a second continuous amount of identification data of the first client according to the identification information and the identity information; and determining a classification result corresponding to the current actual live broadcast application program according to the continuous first amount of the reported data, the continuous second amount of the identification data, the first application information and a preset second rule.
Optionally, the determining sub-module is configured to count that a third amount of the first application information and a fourth amount of second application information exist in a second continuous amount of the identification data, where the second application information is related to a second application program; if the third number is greater than or equal to a preset second threshold and the second application information exists in the continuous first number of reported data under the condition that the third number is a preset first threshold, or if the fourth number is greater than or equal to a preset third threshold and the second application information does not exist in the continuous first number of reported data under the condition that the third number is the first threshold, determining that the classification result corresponding to the current actual live broadcast application program is the second application program; if the third quantity is smaller than the second threshold and/or the second application information does not exist in the continuous first quantity of the reported data under the condition that the third quantity is the first threshold, or if the fourth quantity is smaller than the third threshold and/or the second application information exists in the continuous first quantity of the reported data under the condition that the third quantity is the first threshold, determining that the classification result corresponding to the current actual live broadcast application program is other application programs.
Optionally, the apparatus further comprises: the generating unit is configured to intercept an operation interface of at least one historical live broadcast application program of the first client to obtain at least one live broadcast screenshot before the determining submodule acquires the identification data of the first client according to the identification information and the identity information; identifying feature points in at least one of the live screenshots; determining the probability of a plurality of alternative classification results corresponding to each historical live broadcast application program according to the feature points; taking the alternative classification result with the maximum probability corresponding to each historical live broadcast application program as the identification result of each historical live broadcast application program; and taking the identification result of each historical live application program of the first client as identification data of the first client.
Optionally, the obtaining unit is further configured to obtain a live viewing request from a second client, where the live viewing request includes a live category;
the device further comprises:
a searching unit configured to search the classification result for the identification information matching the live broadcast classification;
and the returning unit is configured to return the identification information of the first client to the second client if the matched identification information is the identification information of the first client, so that the second client can watch the live audio and video data of the current actual live application program of the first client according to the identification information of the first client.
According to a third aspect of embodiments of the present disclosure, there is provided an apparatus comprising:
a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the method of classifying a live application as described in the first aspect.
According to a fourth aspect of embodiments of the present disclosure, there is provided a storage medium, wherein instructions that, when executed by a processor of an apparatus, enable the apparatus to perform the method of classifying a live application according to the first aspect.
According to a fifth aspect of embodiments of the present disclosure, there is provided a computer program product comprising readable program code for execution by a processor of a device to perform the method of classifying a live application of the first aspect.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:
the embodiment of the disclosure acquires current live broadcast information from a first client, where the current live broadcast information may include identification information of the first client, identity information of a first user of the first client, and first application information, where the first application information may represent related information of a first application manually selected by the first user in the first client, and the first application represents a live broadcast application actively confirmed by the first user and running. The method comprises the steps of obtaining reported data of a first client according to identification information of the first client and identity information of a first user, determining a classification result corresponding to a current actual live broadcast application program of the first client by using current live broadcast information and the reported data, wherein the reported data represent related information of a historical live broadcast application program collected and uploaded by the first client.
According to the embodiment of the method and the device, the classification result corresponding to the current actual live broadcast application program is determined by utilizing the current live broadcast information and the reported data of the first client, the situation that the anchor manually selects the video classification of the current actual live broadcast application program is avoided, and the accuracy of watching the live broadcast video of the interested video classification by the user is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.
FIG. 1 is a flow diagram illustrating a method of classifying a live application in accordance with an exemplary embodiment.
FIG. 2 is a flow diagram illustrating a method of classifying a live game according to an exemplary embodiment.
FIG. 3 is a flow diagram illustrating a method of processing a live game in accordance with an exemplary embodiment.
Fig. 4 is a block diagram illustrating an apparatus for classifying a live application according to an example embodiment.
Fig. 5 is a block diagram illustrating an apparatus for classifying a live application according to an example embodiment.
Fig. 6 is a block diagram illustrating an apparatus for classifying a live application according to an example embodiment.
Detailed Description
In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
Fig. 1 is a flowchart illustrating a method for classifying a live application, which may be used in a server, as shown in fig. 1, according to an exemplary embodiment, and includes the following steps.
In step S11, current live information from the first client is acquired.
In the embodiment of the present disclosure, the first client may be a client that publishes a live video, and it may be understood that the first client may be a anchor client, and the anchor publishes the live video at the first client. The current live broadcast information may include identification information of the first client, identity information of a first user of the first client, and first application information, where the first application information represents information about a first application selected by the first user on the first client, and the first application represents an active live broadcast application that is actively confirmed by the first user. For example, the current live information may include a physical address of the first client, a username of the anchor, and a process identification of the first application X selected by the anchor on the first client, etc.
It should be noted that the first application selected by the first user may be a current actual live application on the first client, and the first application selected by the first user may not be the current actual live application on the first client, and may specifically be determined according to a selection condition of the first user. Embodiments of the present disclosure are primarily directed to classifying live applications in the case where the first application selected by the first user is not the current actual live application on the first client.
In step S12, the reported data of the first client is obtained according to the identification information and the identity information, and a classification result corresponding to the current actual live broadcast application of the first client is determined by using the current live broadcast information and the reported data.
In this embodiment of the disclosure, the reported data of the first client may include related information of the historical live broadcast application program collected and uploaded by the first client. For example, reporting the data may include the first client collecting process identifiers of historical live applications running on the first client, and the like. In addition, the reported data may further include identification information of the first client, identity information of the first user, acquisition time information, and the like. The reported data of the first client can be stored in a database of the server, and the server can also store the reported data of other clients and perform differentiated management on the reported data from different clients. Therefore, when the reported data of the first client is obtained in step S12, the reported data of the first client may be obtained according to the identification information and the identity information in the current live broadcast information. Specifically, the corresponding reported data may be searched in the database according to the identification information and the identity information in the current live broadcast information. For example, the identification information in the current live information zb01 is b1, the identity information is s1, and the reported data sb01 with the identification information of b1 and the identity information of s1 is obtained by searching in the database. Further, the classification result corresponding to the current actual live application dzb01 of the first client is determined by using the current live information zb01 and the report data sb 01.
In an exemplary embodiment of the disclosure, when the report data of the first client is obtained according to the identification information and the identity information, a continuous first amount of report data may be obtained, for example, the first amount may be 5. Namely, 5 continuous reported data of the first client are obtained according to the identification information and the identity information in the current live broadcast information. The continuity of the reported data can be embodied by the time information of the reported data, and the time information in the continuous 5 reported data can be relatively adjacent 5 time points. And then, determining a classification result corresponding to the current actual live broadcast application program according to the continuous first amount of reported data, the first application information and a preset first rule.
In an exemplary embodiment of the present disclosure, when determining a classification result corresponding to a current actual live broadcast application program according to a first continuous amount of reported data, first application information, and a preset first rule, it may be queried whether the first application information exists in the first continuous amount of reported data, and if one or more pieces of the first continuous amount of reported data have the first application information, it is determined that the classification result corresponding to the current actual live broadcast application program is the first application program. For example, if the first application information y1 exists in both the 1 st reported data and the 3 rd reported data of the 5 consecutive reported data, it is determined that the classification result corresponding to the current actual live broadcast application is the first application app 1.
In an exemplary embodiment of the present disclosure, after querying whether first application information exists in the continuous first amount of reported data, if the first application information does not exist in the continuous first amount of reported data, obtaining identification data of the first client according to the identification information and the identity information, and determining a classification result corresponding to a current actual live broadcast application program by using current live broadcast information and the identification data. The identification data may represent an identification result obtained by classifying and identifying the historical live broadcast application program on the first client. The identification data of the first client may be an identification result obtained by performing image identification on a screenshot of an operation interface of a historical live broadcast application program on the first client. For example, the identification data may include probabilities of a plurality of alternative classification results corresponding to screenshots of a running interface of the historical live application on the first client. In addition, the identification data may further include identification information of the first client, identity information of the first user, time information of the screenshot, and the like. The identification data of the first client can be stored in a database of the server, and the server can also store the identification data of other clients and perform differentiated management on the identification data from different clients. Therefore, when the identification data of the first client is obtained, the identification data of the first client can be obtained according to the identification information and the identity information in the current live broadcast information. Specifically, the corresponding identification data may be searched in the database according to the identification information and the identity information in the current live broadcast information. For example, the identification information in the current live information zb01 is b1, the identity information is s1, and the database is searched to obtain the identification data shb01 with the identification information being b1 and the identity information being s 1. Further, the classification result corresponding to the current actual live application dzb01 of the first client is determined using the current live information zb01 and the identification data shb 01.
In an exemplary embodiment of the present disclosure, when acquiring the identification data of the first client according to the identification information and the identity information, a consecutive second number of identification data may be acquired, for example, the second number may be 5. Namely, 5 continuous identification data of the first client are obtained according to the identification information and the identity information in the current live broadcast information. The continuity of the identification data can be embodied by the time information of the identification data, and the time information in the continuous 5 identification data can be relatively adjacent 5 time points. And then, determining a classification result corresponding to the current actual live broadcast application program according to the continuous first amount of reported data, the continuous second amount of identification data, the first application information and a preset second rule.
In an exemplary embodiment of the present disclosure, when the classification result corresponding to the current actual live broadcast application program is determined according to the continuous first amount of reported data, the continuous second amount of identification data, the first application information, and a preset second rule, a third amount of the first application information and a fourth amount of the second application information existing in the continuous second amount of identification data may be counted, and the second application information is related information of the second application program. And then, determining a classification result corresponding to the current actual live broadcast application program according to the third quantity, the fourth quantity, a plurality of preset thresholds and the like.
In practical application, under the condition that the third quantity is a preset first threshold, if the fourth quantity is greater than or equal to a preset second threshold and second application information exists in the continuous first quantity of reported data, determining that a classification result corresponding to the current actual live broadcast application program is the second application program. For example, the first number is 5, the second number is 5, the first threshold is 0, and the second threshold is 1, that is, in the case that the first application information does not exist in 5 consecutive identification data, if there are more than or equal to 1 identification data in the 5 consecutive identification data that have the second application information, and there are second application information in 5 consecutive reported data, it is determined that the classification result corresponding to the current actual live broadcast application program is the second application program.
In practical application, under the condition that the third quantity is the first threshold, if the fourth quantity is greater than or equal to a preset third threshold and the second application information does not exist in the continuous first quantity of reported data, determining that the classification result corresponding to the current actual live broadcast application program is the second application program. In the above example, the third threshold is 3, and under the condition that the first application information does not exist in 5 consecutive identification data, if there are more than or equal to 3 identification data in the 5 consecutive identification data and there is no second application information in the 5 consecutive reported data, it is determined that the classification result corresponding to the current actual live broadcast application program is the second application program.
In practical application, under the condition that the third quantity is the first threshold, if the fourth quantity is smaller than the second threshold and/or the second application information does not exist in the continuous first quantity of reported data, determining that the classification result corresponding to the current practical live broadcast application program is other application programs. Or, under the condition that the third quantity is the first threshold, if the fourth quantity is smaller than the third threshold and/or second application information exists in the reported data of the continuous first quantity, determining that the classification result corresponding to the current actual live broadcast application program is the other application program. In the above example, under the condition that the first application information does not exist in the continuous 5 pieces of identification data, if the second application information does not exist in the continuous 5 pieces of identification data and/or the second application information does not exist in the continuous 5 pieces of reported data, it is determined that the classification result corresponding to the current actual live broadcast application program is the other application programs except the first application program and the second application program. Or, under the condition that the first application information does not exist in the continuous 5 identification data, if the second application information exists in less than 3 identification results in the continuous 5 identification data and/or the second application information exists in the continuous 5 reported data, determining that the classification result corresponding to the current actual live broadcast application program is the other application programs except the first application program and the second application program.
In an exemplary embodiment of the present disclosure, a server may obtain a live broadcast watching request from a second client, where the live broadcast watching request may include a live broadcast classification, the server searches for identification information matching the live broadcast classification in a classification result, returns the found identification information to the second client, and if the found identification information is identification information of the first client, the second client watches live broadcast audio and video data of a current actual live broadcast application program of the first client according to the identification information. The second client may be a client that watches live video, and it is understood that the second client may be a vermicelli end, and the vermicelli watches the live video at the second client.
Based on the above description about a method for classifying live-broadcast applications, a method for classifying live-broadcast games is described below, which is applied to a server side and is used for classifying live-broadcast games of a main broadcast side. As shown in fig. 2, the anchor on the anchor side selects game a as the category of the current anchor game, and the server side receives the progress identification of game a from the anchor side. The server side inquires whether the process identification of the game A exists in the latest 5 times of reported data of the anchor side or not in the stored reported data, and if the process identification of the game A exists in the latest 5 times of reported data of the anchor side, the live game of the anchor side is determined to be the game A; if the process identifier of the game a does not exist in the last 5 times reported data of the anchor, the server side inquires whether the process identifier of the game a exists in the last 5 times identification data of the anchor in the stored identification data, and if at least one time identification data exists in the last 5 times identification data of the anchor is the game a, the live game of the anchor is determined to be the game a.
If the identification data of the anchor end in the latest 5 times does not exist and is game A, but the identification data of the anchor end in the latest 5 times is game B which is greater than or equal to 1 time, and the reported data of the anchor end contains the process identification of the game B, the live game of the anchor end is determined to be game B. If the identification data of the anchor end in the latest 5 times does not exist and is game A, but the identification data of the anchor end in the latest 5 times is game B which is greater than or equal to 3 times, and the reported data of the anchor end does not contain the process identification of the game B, the live game of the anchor end is determined to be game B. If there is no identification data of game a in the last 5 times of identification data of the anchor and there are no two cases (two cases where the live game of the anchor is determined to be game B), it is determined that the live game of the anchor is a game other than game a and game B.
Based on the above description about a method for classifying live application programs and a method for classifying live games, a method for processing live games is introduced below, which is applied to a server side and is used for responding to a live game request from a fan side. As shown in fig. 3, the server may include a Web service, an image recognition service, a message queue, a Content Delivery Network (CDN), a cache/database, and the like. The anchor terminal can upload the process identification of the live game and the relevant information of the selected game to the Web service, and the Web service can store the process identification of the live game and the relevant information of the selected game in a cache/database. The CDN can capture the operation interface of the live game of the anchor end to obtain a game capture, and stores the game capture in a message queue. And the image recognition service reads the game screenshot from the message queue, judges the probability of the live game corresponding to the game screenshot according to the characteristic points in the game screenshot, generates and sends probability information to a cache/database. The Web service reads out the reported data and the identification data from the cache/database, wherein the reported data is the process identification of the live game uploaded by the main broadcasting terminal and the relevant information of the selected game, and the identification data is the probability of the live game corresponding to the game screenshot. The Web service merges the read report data and the read identification data according to the anchor terminal, that is, the report data of the same anchor terminal is grouped together, and the identification data of the same anchor terminal is also grouped together. And the Web service stores the combined reported data and the combined identification data into a cache/database. The vermicelli end sends a watching request of a certain live game to the Web end, the Web end reads the reported data and the identification data corresponding to the certain live game from the cache/database according to the watching request, filters the reported data and the identification data which do not belong to the same category as the certain live game, reserves the reported data and the identification data which belong to the same category as the certain live game, extracts the identifier of the anchor end from the reserved reported data and identification data, and then returns the extracted identifier of the anchor end to the vermicelli end, and the vermicelli end can select one of the anchor ends according to the returned identifier of the anchor end to watch.
The embodiment of the disclosure acquires current live broadcast information from a first client, where the current live broadcast information may include identification information of the first client, identity information of a first user of the first client, and first application information, where the first application information may represent related information of a first application manually selected by the first user in the first client, and the first application represents a live broadcast application actively confirmed by the first user and running. The method comprises the steps of obtaining reported data of a first client according to identification information of the first client and identity information of a first user, determining a classification result corresponding to a current actual live broadcast application program of the first client by using current live broadcast information and the reported data, wherein the reported data represent related information of a historical live broadcast application program collected and uploaded by the first client.
According to the embodiment of the method and the device, the classification result corresponding to the current actual live broadcast application program is determined by utilizing the current live broadcast information and the reported data of the first client, the situation that the anchor manually selects the video classification of the current actual live broadcast application program is avoided, and the accuracy of watching the live broadcast video of the interested video classification by the user is improved.
Fig. 4 is a block diagram illustrating an apparatus for classifying a live application according to an example embodiment. The device is applied to a server side, and referring to fig. 4, the device comprises the following units and modules.
An obtaining unit 40, configured to obtain current live broadcast information from a first client, where the current live broadcast information includes identification information of the first client, identity information of a first user of the first client, and first application information, where the first application information represents relevant information of a first application selected by the first user on the first client, and the first application represents a running live broadcast application actively confirmed by the first user;
the classifying unit 41 is configured to obtain the reported data of the first client according to the identification information and the identity information, and determine a classification result corresponding to a current actual live broadcast application program of the first client by using the current live broadcast information and the reported data, where the reported data includes related information of a historical live broadcast application program collected and uploaded by the first client.
In an exemplary embodiment of the present disclosure, the classifying unit 41 includes:
an obtaining module 410, configured to obtain a first continuous amount of reported data of the first client according to the identification information and the identity information;
the determining module 411 is configured to determine a classification result corresponding to the current actual live broadcast application program according to the continuous first amount of the reported data, the first application information, and a preset first rule.
In an exemplary embodiment of the present disclosure, the determining module 411 includes:
the query submodule is configured to query whether the first application information exists in the continuous first amount of the reported data;
the determining sub-module is configured to determine that a classification result corresponding to the current actual live broadcast application program is the first application program if the first application information exists in one or more of the continuous first amount of the reported data.
In an exemplary embodiment of the disclosure, the determining sub-module is further configured to, if no first application information exists in the continuous first amount of the reported data, obtain identification data of the first client according to the identification information and the identity information, and determine a classification result corresponding to the current actual live broadcast application program by using the current live broadcast information and the identification data, where the identification data represents an identification result obtained by classifying and identifying a historical live broadcast application program on the first client.
In an exemplary embodiment of the disclosure, the determining sub-module is configured to obtain a second number of consecutive identification data of the first client according to the identification information and the identity information; and determining a classification result corresponding to the current actual live broadcast application program according to the continuous first amount of the reported data, the continuous second amount of the identification data, the first application information and a preset second rule.
In an exemplary embodiment of the disclosure, the determining sub-module is configured to count that a third amount of the first application information and a fourth amount of second application information exist in a second continuous amount of the identification data, and the second application information is related to a second application program; if the third number is greater than or equal to a preset second threshold and the second application information exists in the continuous first number of reported data under the condition that the third number is a preset first threshold, or if the fourth number is greater than or equal to a preset third threshold and the second application information does not exist in the continuous first number of reported data under the condition that the third number is the first threshold, determining that the classification result corresponding to the current actual live broadcast application program is the second application program; if the third quantity is smaller than the second threshold and/or the second application information does not exist in the continuous first quantity of the reported data under the condition that the third quantity is the first threshold, or if the fourth quantity is smaller than the third threshold and/or the second application information exists in the continuous first quantity of the reported data under the condition that the third quantity is the first threshold, determining that the classification result corresponding to the current actual live broadcast application program is other application programs.
In an exemplary embodiment of the present disclosure, the apparatus further includes: the generating unit 42 is configured to, before the determining submodule acquires the identification data of the first client according to the identification information and the identity information, intercept an operation interface of at least one historical live broadcast application program of the first client to obtain at least one live broadcast screenshot; identifying feature points in at least one of the live screenshots; determining the probability of a plurality of alternative classification results corresponding to each historical live broadcast application program according to the feature points; taking the alternative classification result with the maximum probability corresponding to each historical live broadcast application program as the identification result of each live broadcast application program; and taking the identification result of each historical live application program of the first client as identification data of the first client.
In an exemplary embodiment of the present disclosure, the obtaining unit 40 is further configured to obtain a live viewing request from a second client, where the live viewing request includes a live category;
the device further comprises:
a searching unit 43 configured to search the classification result for the identification information matching the live broadcast classification;
a returning unit 44, configured to, if the matched identification information is the identification information of the first client, return the identification information of the first client to the second client, so that the second client can watch live audio and video data of the current actual live application program of the first client according to the identification information of the first client.
With regard to the apparatus in the above-described embodiment, the specific manner in which each unit and each module perform operations has been described in detail in the embodiment related to the method, and will not be described in detail here.
Fig. 5 is a block diagram illustrating an apparatus 500 for classifying a live application according to an example embodiment. For example, the apparatus 500 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 5, the apparatus 500 may include one or more of the following components: a processing component 502, a memory 504, a power component 506, a multimedia component 508, an audio component 510, an input/output (I/O) interface 512, a sensor component 514, and a communication component 516.
The processing component 502 generally controls overall operation of the device 500, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 502 may include one or more processors 520 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 502 can include one or more modules that facilitate interaction between the processing component 502 and other components. For example, the processing component 502 can include a multimedia module to facilitate interaction between the multimedia component 508 and the processing component 502.
The memory 504 is configured to store various types of data to support operations at the apparatus 500. Examples of such data include instructions for any application or method operating on device 500, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 504 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power supply component 506 provides power to the various components of the device 500. The power components 506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 500.
The multimedia component 508 includes a screen that provides an output interface between the device 500 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 508 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 500 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 510 is configured to output and/or input audio signals. For example, audio component 510 includes a Microphone (MIC) configured to receive external audio signals when apparatus 500 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 504 or transmitted via the communication component 516. In some embodiments, audio component 510 further includes a speaker for outputting audio signals.
The I/O interface 512 provides an interface between the processing component 502 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 514 includes one or more sensors for providing various aspects of status assessment for the device 500. For example, the sensor assembly 514 may detect an open/closed state of the apparatus 500, the relative positioning of the components, such as a display and keypad of the apparatus 500, the sensor assembly 514 may also detect a change in the position of the apparatus 500 or a component of the apparatus 500, the presence or absence of user contact with the apparatus 500, orientation or acceleration/deceleration of the apparatus 500, and a change in the temperature of the apparatus 500. The sensor assembly 514 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 514 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 516 is configured to facilitate communication between the apparatus 500 and other devices in a wired or wireless manner. The apparatus 500 may access a wireless network based on a communication standard, such as WiFi, an operator network (such as 2G, 3G, 4G, or 5G), or a combination thereof. In an exemplary embodiment, the communication component 516 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 516 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 500 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a storage medium comprising instructions, such as the memory 504 comprising instructions, executable by the processor 520 of the apparatus 500 to perform the above-described method is also provided. Alternatively, the storage medium may be a non-transitory computer readable storage medium, which may be, for example, a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
In an exemplary embodiment, a computer program product is also provided, which comprises readable program code executable by the processor 520 of the apparatus 500 to perform the above-described method. Alternatively, the program code may be stored in a storage medium of the apparatus 500, which may be a non-transitory computer readable storage medium, for example, ROM, Random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.
Fig. 6 is a block diagram illustrating an apparatus 600 for classifying a live application according to an example embodiment. For example, the apparatus 600 may be provided as a server. Referring to fig. 6, the apparatus 600 includes a processing component 622 that further includes one or more processors and memory resources, represented by memory 632, for storing instructions, such as applications, that are executable by the processing component 622. The application programs stored in memory 632 may include one or more modules that each correspond to a set of instructions. Further, the processing component 622 is configured to execute instructions to perform the above-described method of classifying a live application.
The apparatus 600 may also include a power component 626 configured to perform power management of the apparatus 600, a wired or wireless network interface 650 configured to connect the apparatus 600 to a network, and an input/output (I/O) interface 658. The apparatus 600 may operate based on an operating system stored in the memory 632, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, or the like.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
1. A method for classifying a live application, applied to a server, the method comprising:
acquiring current live broadcast information from a first client, wherein the current live broadcast information comprises identification information of the first client, identity information of a first user of the first client and first application information, the first application information represents relevant information of a first application program selected by the first user on the first client, and the first application program represents a running live broadcast application program actively confirmed by the first user;
and acquiring reported data of the first client according to the identification information and the identity information, and determining a classification result corresponding to a current actual live broadcast application program of the first client by using the current live broadcast information and the reported data, wherein the reported data comprises related information of a historical live broadcast application program collected and uploaded by the first client.
2. The method of claim 1, wherein the step of obtaining the reported data of the first client according to the identification information and the identity information, and determining the classification result corresponding to the current actual live broadcast application of the first client by using the current live broadcast information and the reported data comprises:
acquiring a first continuous amount of reported data of the first client according to the identification information and the identity information;
and determining a classification result corresponding to the current actual live broadcast application program according to the continuous first quantity of the reported data, the first application information and a preset first rule.
3. The method of claim 2, wherein the step of determining the classification result corresponding to the current actual live broadcast application according to the first continuous amount of the reported data, the first application information, and a preset first rule comprises:
inquiring whether the first application information exists in the reported data of continuous first quantity;
and if one or more of the reported data in the continuous first amount of the reported data has the first application information, determining that the classification result corresponding to the current actual live broadcast application program is the first application program.
4. The method of claim 3, wherein after the step of querying whether the first application information is present in the first consecutive amount of the reported data, the method further comprises:
if the first application information does not exist in the continuous first amount of reported data, acquiring identification data of the first client according to the identification information and the identity information, and determining a classification result corresponding to the current actual live broadcast application program by using the current live broadcast information and the identification data, wherein the identification data represents an identification result obtained by classifying and identifying the historical live broadcast application program on the first client.
5. The method of claim 4, wherein the step of obtaining identification data of the first client according to the identification information and the identity information, and determining a classification result corresponding to the current actual live application by using the current live information and the identification data comprises:
acquiring a second continuous amount of identification data of the first client according to the identification information and the identity information;
and determining a classification result corresponding to the current actual live broadcast application program according to the continuous first amount of the reported data, the continuous second amount of the identification data, the first application information and a preset second rule.
6. The method of claim 5, wherein the step of determining the classification result corresponding to the current actual live broadcast application according to the first continuous amount of the report data, the second continuous amount of the identification data, the first application information, and a preset second rule comprises:
counting the third quantity of the first application information and the fourth quantity of the second application information in the continuous second quantity of the identification data, wherein the second application information is related information of a second application program;
if the third number is greater than or equal to a preset second threshold and the second application information exists in the continuous first number of reported data under the condition that the third number is a preset first threshold, or if the fourth number is greater than or equal to a preset third threshold and the second application information does not exist in the continuous first number of reported data under the condition that the third number is the first threshold, determining that the classification result corresponding to the current actual live broadcast application program is the second application program;
if the third quantity is smaller than the second threshold and/or the second application information does not exist in the continuous first quantity of the reported data under the condition that the third quantity is the first threshold, or if the fourth quantity is smaller than the third threshold and/or the second application information exists in the continuous first quantity of the reported data under the condition that the third quantity is the first threshold, determining that the classification result corresponding to the current actual live broadcast application program is other application programs.
7. The method of classifying a live application according to claim 4, wherein prior to the step of obtaining identification data of the first client based on the identification information and the identity information, the method further comprises:
intercepting an operation interface of at least one historical live broadcast application program of the first client to obtain at least one live broadcast screenshot;
identifying feature points in at least one of the live screenshots;
determining the probability of a plurality of alternative classification results corresponding to each historical live broadcast application program according to the feature points;
taking the alternative classification result with the maximum probability corresponding to each historical live broadcast application program as the identification result of each historical live broadcast application program;
and taking the identification result of each historical live application program of the first client as identification data of the first client.
8. An apparatus for classifying a live application, applied to a server, the apparatus comprising:
an obtaining unit, configured to obtain current live broadcast information from a first client, where the current live broadcast information includes identification information of the first client, identity information of a first user of the first client, and first application information, where the first application information represents information related to a first application selected by the first user on the first client, and the first application represents a running live broadcast application actively confirmed by the first user;
and the classification unit is configured to acquire reported data of the first client according to the identification information and the identity information, and determine a classification result corresponding to a current actual live broadcast application program of the first client by using the current live broadcast information and the reported data, wherein the reported data comprises related information of a historical live broadcast application program collected and uploaded by the first client.
9. An apparatus, comprising:
a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the method of classifying a live application of any one of claims 1 to 7.
10. A storage medium having instructions which, when executed by a processor of an apparatus, enable the apparatus to perform a method of categorizing a live application as claimed in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910975070.1A CN110866147B (en) | 2019-10-14 | 2019-10-14 | Method, apparatus and storage medium for classifying live broadcast application |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910975070.1A CN110866147B (en) | 2019-10-14 | 2019-10-14 | Method, apparatus and storage medium for classifying live broadcast application |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110866147A true CN110866147A (en) | 2020-03-06 |
| CN110866147B CN110866147B (en) | 2023-01-20 |
Family
ID=69652449
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910975070.1A Active CN110866147B (en) | 2019-10-14 | 2019-10-14 | Method, apparatus and storage medium for classifying live broadcast application |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110866147B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111654717A (en) * | 2020-07-17 | 2020-09-11 | 腾讯科技（深圳）有限公司 | Data processing method, device, equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040070594A1 (en) * | 1997-07-12 | 2004-04-15 | Burke Trevor John | Method and apparatus for programme generation and classification |
| CN105404681A (en) * | 2015-11-25 | 2016-03-16 | 广州酷狗计算机科技有限公司 | Live broadcast sentiment classification method and apparatus |
| CN107509118A (en) * | 2017-08-08 | 2017-12-22 | 北京小米移动软件有限公司 | Main broadcaster's display methods, device and computer-readable recording medium |
| CN108712665A (en) * | 2018-05-18 | 2018-10-26 | 武汉斗鱼网络科技有限公司 | A kind of generation method, device, server and the storage medium of live streaming list |
| CN109246451A (en) * | 2018-08-23 | 2019-01-18 | 武汉斗鱼网络科技有限公司 | A kind of direct broadcasting room recommended method, device, server and storage medium |
| CN110267057A (en) * | 2019-07-16 | 2019-09-20 | 北京达佳互联信息技术有限公司 | A kind of method and device of the classification of live data |
| CN110267067A (en) * | 2019-06-28 | 2019-09-20 | 广州酷狗计算机科技有限公司 | Method, apparatus, equipment and the storage medium that direct broadcasting room is recommended |
-
2019
- 2019-10-14 CN CN201910975070.1A patent/CN110866147B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040070594A1 (en) * | 1997-07-12 | 2004-04-15 | Burke Trevor John | Method and apparatus for programme generation and classification |
| CN105404681A (en) * | 2015-11-25 | 2016-03-16 | 广州酷狗计算机科技有限公司 | Live broadcast sentiment classification method and apparatus |
| CN107509118A (en) * | 2017-08-08 | 2017-12-22 | 北京小米移动软件有限公司 | Main broadcaster's display methods, device and computer-readable recording medium |
| CN108712665A (en) * | 2018-05-18 | 2018-10-26 | 武汉斗鱼网络科技有限公司 | A kind of generation method, device, server and the storage medium of live streaming list |
| CN109246451A (en) * | 2018-08-23 | 2019-01-18 | 武汉斗鱼网络科技有限公司 | A kind of direct broadcasting room recommended method, device, server and storage medium |
| CN110267067A (en) * | 2019-06-28 | 2019-09-20 | 广州酷狗计算机科技有限公司 | Method, apparatus, equipment and the storage medium that direct broadcasting room is recommended |
| CN110267057A (en) * | 2019-07-16 | 2019-09-20 | 北京达佳互联信息技术有限公司 | A kind of method and device of the classification of live data |
Non-Patent Citations (1)
| Title |
|---|
| 兰荣享 等: "众包直播中精彩片段的自动化识别", 《计算机系统应用》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111654717A (en) * | 2020-07-17 | 2020-09-11 | 腾讯科技（深圳）有限公司 | Data processing method, device, equipment and storage medium |
| CN111654717B (en) * | 2020-07-17 | 2023-11-03 | 腾讯科技（深圳）有限公司 | Data processing method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110866147B (en) | 2023-01-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111556327A (en) | Live broadcast room recommendation method, device, terminal, server, system and storage medium | |
| CN111083512A (en) | Switching method and device of live broadcast room, electronic equipment and storage medium | |
| CN111405302B (en) | Live broadcast room attention reminding method and device, electronic equipment and storage medium | |
| US20170118298A1 (en) | Method, device, and computer-readable medium for pushing information | |
| CN109714643B (en) | Recommendation method, system, server and storage medium for video data | |
| CN110691268B (en) | Message sending method, device, server, mobile terminal and storage medium | |
| CN110688576B (en) | Content recommendation method and device, electronic equipment and storage medium | |
| CN113259226B (en) | Information synchronization method and device, electronic equipment and storage medium | |
| CN112291631A (en) | Information acquisition method, device, terminal and storage medium | |
| CN112131466A (en) | Group display method, device, system and storage medium | |
| CN107402767B (en) | Method and device for displaying push message | |
| WO2022252610A1 (en) | Bullet screen comment issuing method and bullet screen comment receiving method | |
| CN110636318A (en) | Message display method, message display device, client device, server and storage medium | |
| CN109525966B (en) | Intelligent device query method and device and storage medium | |
| CN110866147B (en) | Method, apparatus and storage medium for classifying live broadcast application | |
| CN106878654B (en) | Video communication method and device | |
| CN113868467A (en) | Information processing method, information processing device, electronic equipment and storage medium | |
| CN113031837B (en) | Content sharing method and device, storage medium, terminal and server | |
| CN112000878A (en) | Article information query method, device, system, electronic equipment and storage medium | |
| CN110690979B (en) | Group message processing method, device, server, client and storage medium | |
| CN112685599A (en) | Video recommendation method and device | |
| CN110769282A (en) | Short video generation method, terminal and server | |
| CN108228433B (en) | Electronic equipment, and method and device for counting visit time and stay time of mobile application | |
| CN112291581B (en) | Server, terminal equipment, information processing method and device | |
| CN114189719A (en) | Video information extraction method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |