CN115412747A - Surveillance broadcast method, surveillance broadcast device, and computer-readable medium - Google Patents
Surveillance broadcast method, surveillance broadcast device, and computer-readable medium Download PDFInfo
- Publication number
- CN115412747A CN115412747A CN202110586432.5A CN202110586432A CN115412747A CN 115412747 A CN115412747 A CN 115412747A CN 202110586432 A CN202110586432 A CN 202110586432A CN 115412747 A CN115412747 A CN 115412747A
- Authority
- CN
- China
- Prior art keywords
- data stream
- plan
- data
- schedule
- service end
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 64
- 238000012544 monitoring process Methods 0.000 claims abstract description 54
- 230000008859 change Effects 0.000 claims description 25
- 230000004044 response Effects 0.000 claims description 19
- 230000006870 function Effects 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 3
- 238000012806 monitoring device Methods 0.000 abstract description 6
- 230000000875 corresponding effect Effects 0.000 description 27
- 230000002123 temporal effect Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000002596 correlated effect Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000012546 transfer Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44204—Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The present disclosure provides a broadcast monitoring method, which includes: acquiring a data index of a schedule of a service end, and determining a schedule acquisition mode according to the data index; acquiring at least part of display pictures of a display end, and identifying the media data stream at the current moment according to the at least part of display pictures; acquiring a plan data stream at the current moment according to a plan acquisition mode; and performing association query on the media data stream and the plan data stream at the current moment to determine whether the media data stream and the plan data stream are associated. The present disclosure also provides a monitoring device and a computer readable medium.
Description
Technical Field
The present disclosure relates to the field of multimedia technologies, and in particular, to a broadcast monitoring method, broadcast monitoring equipment, and computer readable medium.
Background
The monitoring is a process of monitoring whether the playing content of the current screen is consistent with the playing plan in real time in a broadcast television and a scene related to media, and is mostly applied to advertisement delivery and real-time program playing control. At the present stage, when the playing content is analyzed in real time, the database corresponding to the playing plan needs to be repeatedly queried, and when the number of monitoring targets is large and the amount of analysis data is large, the overhead corresponding to the query of the database operation is large, and situations such as delay and data backlog may occur. In addition, in the process of the playing content entering the analysis queue for waiting and analyzing the playing content, the updating condition of the playing plan cannot be perceived by the monitoring side, and the accuracy of monitoring is affected.
Disclosure of Invention
The present disclosure is directed to solve at least one of the technical problems of the prior art, and provides a broadcast monitoring method, a broadcast monitoring device, and a computer readable medium.
In order to achieve the above object, in a first aspect, an embodiment of the present disclosure provides a broadcast monitoring method, which includes:
acquiring a data index of a schedule table of a service end, and determining a schedule acquisition mode according to the data index, wherein the schedule table stores schedule data streams at multiple moments, and the data index comprises: data change frequency and/or data volume;
acquiring at least part of display pictures of a display end, and identifying media data streams at the current moment according to the at least part of display pictures;
acquiring the plan data stream at the current moment according to the plan acquisition mode;
and performing association query on the media data stream and the plan data stream at the current moment to determine whether the media data stream and the plan data stream are associated.
In some embodiments, the acquiring at least a part of a display screen of the display terminal, and identifying a media data stream at a current time according to the at least a part of the display screen includes:
shooting at least part of the display picture through image acquisition equipment, recognizing graphical identification in a shooting result, and determining the media data stream according to the graphical identification.
In some embodiments, the determining a planned acquisition manner according to the data index includes:
determining that the plan acquisition mode is a memory synchronization mode in response to the data change frequency being less than or equal to a preset first threshold and the data volume being less than or equal to a preset second threshold;
the acquiring the plan data stream at the current moment according to the plan acquisition mode includes:
acquiring the schedule from the service end every preset time period according to the memory synchronization mode, and storing the schedule into a memory;
and inquiring the plan data stream at the current moment from the plan table.
In some embodiments, the determining a planned acquisition manner according to the data index includes:
determining the plan acquisition mode to be a message queue synchronization mode in response to the data change frequency being greater than or equal to a preset third threshold;
the acquiring the plan data stream at the current moment according to the plan acquisition mode includes:
according to the message queue synchronization mode, responding to plan updating data existing in a service end message queue, acquiring the plan updating data and storing the plan updating data as a new plan data stream, wherein the plan updating data is added to the service end message queue when the service end has the new plan data stream or an original plan data stream is changed in the plan table;
and querying each stored planning data flow to obtain the planning data flow at the current moment.
In some embodiments, said obtaining and storing said schedule update data as a new schedule data stream comprises:
responding to the fact that the data volume is smaller than or equal to a preset fourth threshold value, storing the plan updating data as a new plan data stream into a preset map state storage area, and broadcasting;
the querying of each stored planning data stream to obtain the planning data stream at the current time includes:
and querying the broadcast stream to obtain the planning data stream at the current moment.
In some embodiments, before the acquiring the display screen of the display end, the method includes:
acquiring the schedule of the service end, and analyzing the schedule data flow at each moment in the schedule;
appointing a timestamp, and generating a first time state table according to the associated fields of the plan data stream at each time;
the obtaining and storing the schedule update data as a new schedule data stream includes:
and analyzing the plan updating data and adding the plan updating data to the first time state table according to the corresponding time stamp and the associated field.
In some embodiments, prior to said performing an association query on said media data stream and said planning data stream, comprising:
analyzing the media data stream and determining a timestamp corresponding to the media data stream;
generating a second time state table corresponding to the media data stream according to the timestamp and the associated field of the media data stream;
the querying of each stored planning data stream to obtain the planning data stream at the current time includes:
inquiring the association field of the planned data stream at the current moment from the first time state table according to the timestamp in the second time state table;
the performing of the correlation query on the media data stream and the plan data stream includes:
and determining whether the media data stream is associated with the plan data stream according to the associated field of the media data stream and the inquired associated field.
In some embodiments, the method further comprises:
responding to the support of the asynchronous query function of the service end, and determining that the plan acquisition mode is an asynchronous query mode;
the acquiring the plan data stream at the current moment according to the plan acquisition mode includes:
according to the asynchronous query mode, responding to the media data stream, sending an asynchronous query request to the service end and configuring callback parameters;
and storing the plan data stream fed back by the service end into a preset cache.
In some embodiments, the method further comprises:
responsive to the media data stream being associated with the scheduled data stream, outputting the media data stream;
in response to the media data stream not being associated with the planning data stream, outputting alert information.
In a second aspect, an embodiment of the present disclosure further provides a broadcast monitoring device, which includes:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the method of supervising as described in any of the above embodiments.
In a third aspect, this disclosed embodiment also provides a computer readable medium, on which a computer program is stored, where the program, when executed by a processor, implements the steps in the monitoring method as described in any of the above embodiments.
Drawings
Fig. 1 is a schematic flow chart of a broadcast monitoring method according to an embodiment of the present disclosure;
fig. 2 is a schematic flow chart of another monitoring method according to an embodiment of the present disclosure;
fig. 3 is a schematic flow chart of another monitoring method according to an embodiment of the present disclosure;
fig. 4 is a schematic flowchart of another broadcast monitoring method according to an embodiment of the present disclosure;
FIG. 5 is a flowchart illustrating a method for implementing step S3 according to an embodiment of the present disclosure;
fig. 6 is a schematic flowchart of another broadcast monitoring method according to an embodiment of the present disclosure;
FIG. 7 is a flowchart illustrating another exemplary implementation of step S3 in the disclosed embodiment;
fig. 8 is a schematic structural diagram of a monitoring device according to an embodiment of the present disclosure;
fig. 9 is a schematic structural diagram of a computer-readable medium according to an embodiment of the present disclosure.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present disclosure, the following detailed description is provided for the monitoring method, the monitoring device and the computer readable medium provided in the present disclosure with reference to the accompanying drawings.
Example embodiments will be described more fully hereinafter with reference to the accompanying drawings, but which may be embodied in different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, … … specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It will be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. Thus, a first element, component, or module discussed below could be termed a second element, component, or module without departing from the teachings of the present disclosure.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and the present disclosure, and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
Fig. 1 is a schematic flow chart of a broadcast monitoring method according to an embodiment of the present disclosure. As shown in fig. 1, the method includes:
s1, acquiring a data index of a schedule of a service end, and determining a schedule acquisition mode according to the data index.
In step S1, a plan acquisition mode is determined according to the data volume change frequency and the data volume of the plan table. (ii) a The schedule is stored in a service database of the service end, and the service end is responsible for arranging and storing streaming media information, multimedia information and other related data streams, can be a flexibly deployed information processing unit, and can also be deployed as an independent hardware server. (ii) a
And S2, acquiring at least part of display pictures of the display end, and identifying the media data stream at the current moment according to the at least part of display pictures.
In step S2, the display terminal is monitored in real time, the current whole display picture or the image block with identification significance of the current display picture is obtained by directly receiving the display picture transmitted by the display terminal or erecting an image acquisition device, the whole display picture or the image block is identified, the media data stream corresponding to the video image is determined, and thus, the media data stream at the current moment is identified based on the current display picture.
And S3, acquiring the plan data stream at the current moment according to the plan acquisition mode.
Determining a plan acquisition mode based on the data change frequency and the data volume of the schedule, for example, when the data change frequency and the data volume are small, synchronously interacting with the service end to acquire a plan data stream at the current moment, or acquiring a complete schedule from the service end at intervals and storing the complete schedule into a memory; when the data change frequency is larger, the service end synchronously sends the updated data to the message queue, and the monitoring side carries out the data updating synchronization with the service end through the message queue.
And S4, performing correlation query on the media data stream and the plan data stream at the current moment to determine whether the media data stream and the plan data stream are correlated.
In step S4, a process of monitoring whether the playing content of the current screen is consistent with the playing plan in real time is performed, and in order to determine a correlation condition between the media data stream and the plan data stream at the current time, if the media data stream and the plan data stream are correlated, the playing content corresponding to the current time is consistent with the playing plan, and if the media data stream and the plan data stream are not correlated, the playing content corresponding to the current time is inconsistent with the playing plan.
In some embodiments, identifying whether the media data stream and the programmatic data stream are the same to determine whether the media data stream and the programmatic data stream are associated; or, in some embodiments, the respective association identifier, association field, or flag bit is identified from the media data stream and the schedule data stream, and whether the media data stream and the schedule data stream are associated is determined according to whether the above-mentioned parameters are matched; alternatively, in some embodiments, the media data stream and the planning data stream are targeted to retrieve their respective corresponding video image content, such as identification frames, video segments, etc., to determine whether their corresponding video image content is consistent, thereby determining whether the media data stream and the planning data stream are associated.
In some embodiments, the media data stream is output in response to the media data stream being associated with the scheduled data stream; outputting alarm information in response to the media data stream not being associated with the planning data stream; in some embodiments, the media data stream and the alarm information are output to a display device or a visual interface on the monitoring side, so as to confirm and calibrate the monitoring condition based on manual or logic processes.
The embodiment of the disclosure provides a monitoring and broadcasting method, which can be used for determining one of a plurality of plan acquisition modes according to the data change frequency and the data volume of a schedule table of a service end, acquiring at least part of a display picture of a display end to identify a media data stream at the current moment, acquiring the plan data stream at the current moment according to the determined plan acquisition mode, and then performing association query on the media data stream and the plan data stream at the current moment, thereby dynamically adjusting the communication interaction mode with the service end according to the data change frequency and the data volume of the schedule table of the service end and monitoring the broadcasting condition of the display end.
Fig. 2 is a schematic flow chart of another monitoring method according to the embodiment of the present disclosure. As shown in fig. 2, the method is an embodied alternative embodiment based on the method shown in fig. 1. Specifically, the method not only includes step S1, step S3 and step S4, but also includes step S201, and step S201 is an optional implementation of step S2. Only step S201 will be described in detail below.
Step S201, shooting at least part of display pictures through image acquisition equipment, recognizing graphical identifiers in shooting results, and determining media data streams according to the graphical identifiers.
The method comprises the following steps that image acquisition equipment is erected in front of a display end, and the whole display picture or image blocks in the display picture are shot based on play content replacement event triggering or time sequence triggering; in some embodiments, the portion of the display is the graphical indicia, which may include, for example, two-dimensional codes, bar codes, image watermarks, and other representational images.
Fig. 3 is a schematic flowchart of another broadcast monitoring method according to an embodiment of the present disclosure. As shown in fig. 3, the method is an embodied alternative embodiment based on the method shown in fig. 1. Specifically, the method includes not only step S2 and step S4, but also step S101a, step S301a, and step S302a, where step S101a is an alternative embodiment of step S1, and step S301a and step S302a are an alternative embodiment of step S3. Only step S101a, step S301a, and step S302a will be described in detail below.
Specifically, in step S1, determining a plan acquisition mode according to the data index includes:
step S101a, determining that the scheduled acquisition mode is the memory synchronization mode in response to the data change frequency being less than or equal to a preset first threshold and the data amount being less than or equal to a preset second threshold.
If the data change frequency and the data volume are small and the real-time requirement on the update data synchronization is low, the data can be interacted with the service end in a memory synchronization mode.
Step S3, acquiring the plan data stream of the current moment according to the plan acquisition mode, wherein the step S comprises the following steps:
step S301a, according to the memory synchronization mode, acquiring a schedule from the service end every preset time period, and storing the schedule in the memory.
Step S302a, obtaining the scheduled data stream at the current time from the schedule table.
In some embodiments, the dynamic configuration of the preset time period, the data recovery strategy and the data invalidation strategy is further included.
The method and the system have the advantages that the schedule table is periodically loaded from the service end, the schedule data flow in the schedule table is inquired in the memory, the communication between the monitoring side and the service end is easy to maintain, the data inquiry response speed is high, the efficiency is high, and the load of the service database of the service end is reduced.
Fig. 4 is a flowchart illustrating another broadcast monitoring method according to an embodiment of the present disclosure. As shown in fig. 4, the method is an embodied alternative embodiment based on the method shown in fig. 1. Specifically, the method includes not only step S2 and step S4, but also step S101b, step S301b, and step S302b, where step S101b is an alternative embodiment of step S1, and step S301b and step S302b are an alternative embodiment of step S3. Only step S101b, step S301b, and step S302b will be described in detail below.
Specifically, in step S1, determining a plan acquisition manner according to the data index includes:
and step S101b, responding to the situation that the data change frequency is larger than or equal to a preset third threshold value, and determining that the planned acquisition mode is a message queue synchronization mode.
If the data change frequency is large, the data can be interacted with the service end in a message queue synchronization mode in order to ensure the data synchronization with the service end.
Step S3, acquiring the plan data stream of the current moment according to the plan acquisition mode, wherein the step S comprises the following steps:
step S301b, according to the message queue synchronization mode, responding to the plan updating data existing in the message queue of the service end, acquiring the plan updating data and storing the plan updating data as a new plan data stream.
When a new plan data stream or an original plan data stream is changed in a corresponding plan table of the service end, plan updating data is added to a service end message queue by the service end; the message Queue may include a message passing model of a Queue (Queue) and a Topic (Topic), in some embodiments, the service side message Queue adopts a Publish/Subscribe (Pub/Sub) mode, the message passing model based on the Topic performs message passing, which is a push model, the condition that there is planned update data in the service side message Queue is automatically broadcast, the monitoring side consumes the data in the service side message Queue in real time, and does not need to obtain new messages by actively requesting or polling the Topic, and particularly, the service side message Queue adopts a Kafka Queue; alternatively, in some embodiments, the service-side database synchronizes its Binary log file (Binary log, binlog for short) to achieve synchronization.
Step S302b, a scheduled data stream at the current time is obtained by searching the stored scheduled data streams.
The schedule data change frequency of the service end is large, and the schedule updating data is acquired in real time based on the service end message queue issued by the service end, so that the load of a service end service database can be reduced, and the real-time performance of data synchronization is improved.
Fig. 5 is a flowchart of a specific implementation method of step S3 in the embodiment of the present disclosure. Specifically, based on the embodied alternative embodiment shown in fig. 4, as shown in fig. 5, step S301b includes step S3011, and step S302b includes step S3021.
Specifically, in step S301b, the schedule update data is acquired and stored as a new schedule data stream, including step S3011.
Step S3011, in response to the data amount being less than or equal to the preset fourth threshold, storing the plan update data as a new plan data stream into a preset map state storage area (Mapstate) and broadcasting.
The broadcast data can exist in the memory, that is, the broadcast variable exists in the memory of each node, so that the data volume of the schedule table is limited to a certain extent, and when the data volume is small, the data transmission and query can be realized by adopting a message queue synchronization mode and a broadcast State (State) updating mode.
In some embodiments, after receiving data in the original schedule, parsing the data and obtaining an instance thereof, a predefined map state store is used to store the scheduled data stream, and a broadcast function is invoked to transfer into the map state store such that, when there is a new data stream, the broadcast state is updated in real time according to the data.
Step S302b, querying the stored scheduled data streams to obtain the scheduled data stream at the current time, includes step S3021.
Step S3021, a scheduled data stream at the current time is obtained by searching the broadcast stream.
When the schedule data of the service end is changed frequently and the data volume is small, the schedule updating data is obtained in real time and the broadcast state is updated based on the service end message queue issued by the service end, the load of a service end service database can be reduced, the schedule data updating condition can be obtained in real time, and correlation query can be carried out based on the latest data during correlation.
Fig. 6 is a flowchart illustrating another broadcast monitoring method according to an embodiment of the present disclosure. As shown in fig. 6, the method is an embodied alternative embodiment based on the method shown in fig. 4. Specifically, the method includes not only step S101b and step S2, but also step S3012, step S3022, and step S403, where step S301 and step S3022 are an alternative implementation of step S301b and step S302b, respectively, step S403 is an alternative implementation of step S4, and before step S2, step S102 and step S103 are further included, and before step S4, step S401 and step S402 are further included. Only S102, step S103, step S3012, step S3022, and steps S401 to S403 will be described in detail below.
Specifically, step S102 and step S103 are further included before step S2.
And S102, acquiring a schedule of a service end, and analyzing the scheduled data flow of each moment in the schedule.
In some embodiments, the scheduled data streams at various times in the schedule are parsed to obtain instances thereof.
Step S103, appointing a time stamp, and generating a first time state table according to the associated field of the planning data stream at each time.
After the scheduled data stream is analyzed, a timestamp is assigned, and the data stream is converted into a table format.
In step S301b, plan update data is acquired and stored as a new plan data stream, including step S3012.
Step S3012, analyzing the plan update data, and adding the plan update data to the first time state table according to the corresponding timestamp and the associated field.
And adding the new planned data flow obtained by the service end message queue to the first time state table in real time.
Step S302b, obtaining the current scheduled data stream from the stored scheduled data streams, includes step S3022.
And step S3022, inquiring the association field of the planned data stream at the current moment from the first time state table according to the timestamp in the second time state table.
In some embodiments, after generating the first time state table, the method further includes: defining and registering a Table function, wherein in some embodiments, the function is a history Table (Temporal Table) function, the history Table function comprises a parameter primary key and a timestamp, the primary key is used for marking records, most of the primary keys are related fields, the timestamp is used for marking a specified time, the history Table is a view of a certain time on a continuous change Table, and the function returns the view of the history Table at the corresponding specified time by using the corresponding Table function to transfer one timestamp. Thus, the associated field of the planned data flow at the current time can be obtained.
Before step S4, step S401 and step S402 are also included.
Step S401, parsing the media data stream, and determining a timestamp corresponding to the media data stream.
In some embodiments, the media data stream is parsed to obtain instances, and timestamps are assigned to the media data stream.
Step S402, generating a second time state table corresponding to the media data stream according to the timestamp and the associated field of the media data stream.
In the subsequent monitoring process, the media data stream can be added to the second temporal table in real time so as to establish the association relationship between the second temporal table and the first temporal table.
It should be noted that, the present disclosure does not limit the execution sequence of step S3 and steps S401 to S402, and step S3 may be executed before step S401 to step S402, or step S3 is executed after step S401 to step S402, or step S3 is executed in parallel with step S401 to step S402, which are all applicable to the technical solution of the present application.
And, in step S4, performing a correlation query on the media data stream and the planning data stream, including step S403.
Step S403, determining whether the media data stream is associated with the planning data stream according to the associated field of the media data stream and the queried associated field.
When the schedule data change frequency of the service end is large, the schedule updating data is acquired in real time based on the service end message queue issued by the service end, the load of a service end service database can be reduced, the schedule data updating condition can be acquired in real time, association query can be performed based on the latest data during association, association query is performed in a mode of synchronizing the time state table, the corresponding timestamp can be accurately queried based on the corresponding relation between the timestamps, and the query accuracy is higher than that of the query based on the system time.
Fig. 7 is a flowchart of another specific implementation method of step S3 in the embodiment of the present disclosure. Specifically, in response to that the service end supports the asynchronous query function, it is determined that the plan acquisition manner is the asynchronous query manner, and thus, as shown in fig. 7, step S3 includes step S301c and step S302c.
Step S301c, according to the asynchronous query mode, responding to the media data stream, sending an asynchronous query request to the service end and configuring callback parameters.
In some embodiments, in response to the data change frequency being greater than or equal to a preset fifth threshold and the data amount being greater than or equal to a preset sixth threshold, it is determined that the scheduled acquisition mode is the asynchronous query mode.
Step S302c, storing the planned data stream fed back by the service end into a preset cache.
The asynchronous query mode avoids the problem of thread blocking which can occur when a synchronous call mode is adopted, and meanwhile, the cache is introduced to solve the problem of access pressure to a service database of a service end when the data throughput is large, and avoid the situations of connection failure, full thread pool and the like; in some embodiments, by setting a reasonable expiration policy, the data flow is directly and asynchronously associated with the cache data, so that the throughput is increased, and meanwhile, the load of a service-side database is reduced.
The following describes the monitoring method provided by the present disclosure in detail in conjunction with practical applications. The monitoring and broadcasting method is applied to a monitoring and broadcasting system, and the monitoring and broadcasting system comprises: the system comprises a display end, a monitoring and broadcasting end and a service end, wherein the monitoring and broadcasting end can construct a scheduling system based on a Flink framework.
Firstly, a monitoring terminal acquires a data index of a schedule of a service terminal and determines a plan acquisition mode according to the data index, wherein the data index comprises data change frequency and/or data volume, and the plan acquisition mode comprises a memory synchronization mode, an asynchronous query mode and a message queue synchronization mode. Among these, there are a number of situations: determining that the plan acquisition mode is a memory synchronization mode in response to the data change frequency being less than or equal to a preset first threshold and the data volume being less than or equal to a preset second threshold; in response to the data change frequency being greater than or equal to a preset third threshold and the data volume being less than or equal to a preset fourth threshold, determining that the plan acquisition mode is a message queue synchronization mode, and determining that the association query is performed based on a broadcast state on the basis of the message queue synchronization mode; in response to the data change frequency being greater than or equal to a preset third threshold, determining that the plan acquisition mode is a message queue synchronization mode, and performing correlation query synchronously based on a temporal table; and determining that the plan acquisition mode is an asynchronous query mode in response to the data change frequency being greater than or equal to a preset fifth threshold and the data volume being greater than or equal to a preset sixth threshold.
The display end displays the corresponding display picture in real time, the monitoring and broadcasting end shoots a part of the display picture through the image acquisition equipment, identifies the graphical identification in the shooting result, and determines the media data stream according to the graphical identification.
Aiming at the condition that the plan acquisition mode is determined to be a memory synchronization mode, the monitoring and broadcasting terminal acquires a plan table from a service database of the service terminal every other preset time period and stores the plan table into a memory, and then the plan table stored in the memory is inquired to obtain a plan data stream at the current moment; aiming at the condition that the plan acquisition mode is determined to be a message queue synchronization mode and the correlation query is carried out based on the broadcast state, the service end responds to the plan table update and issues plan update data in the corresponding service end message queue, correspondingly, the monitoring end responds to the plan update data in the service end message queue, stores the plan update data as a new plan data stream into a preset map state storage area, broadcasts, and then queries from the broadcast stream to obtain the plan data stream at the current moment; aiming at the condition that the plan acquisition mode is determined to be a message queue synchronization mode and the correlation query is synchronously carried out based on a time state table, a broadcast end acquires a plan table of a service end in advance, analyzes the plan data stream of each time in the plan table, specifies a time stamp after the analysis is finished, generates a first time state table according to the correlation field of the plan data stream of each time, responds to the plan table to update the plan update data issued in a corresponding service end message queue, responds to the fact that the plan update data exist in the service end message queue, analyzes the plan update data, adds the plan update data to the first time state table according to the corresponding time stamp and the correlation field, analyzes the media data stream before the correlation query, determines the time stamp corresponding to the media data stream, generates a second time state table corresponding to the media data stream according to the time stamp and the correlation field of the media data stream, and queries whether the correlation field of the plan data stream of the current time is searched from the first time state table according to the time stamp in the second time state table, and determines whether the correlation field of the media data stream and the correlation field of the media data stream are correlated with the correlation field of the correlation data; and aiming at the condition that the plan acquisition mode is determined to be an asynchronous query mode, after the media data stream is identified, the monitoring and broadcasting end sends an asynchronous query request to the service end and configures a callback parameter, after the service end completes a corresponding task based on a callback mechanism, the service end feeds back the plan data stream at the current moment to the monitoring and broadcasting end, and the monitoring and broadcasting end stores the plan data stream into a preset cache.
And the monitoring terminal outputs corresponding data based on the determined association condition of the media data stream and the plan data stream, wherein the media data stream is output in response to the association of the media data stream and the plan data stream, and the alarm information is output in response to the non-association of the media data stream and the plan data stream.
Fig. 8 is a schematic structural diagram of a monitoring device according to an embodiment of the present disclosure. As shown in fig. 8, the monitoring and broadcasting device includes:
one or more processors 101;
a memory 102 on which one or more programs are stored, which when executed by the one or more processors, cause the one or more processors to implement the method of supervising broadcast as in any of the embodiments described above;
one or more I/O interfaces 103 coupled between the processor and the memory and configured to enable information interaction between the processor and the memory.
The processor 101 is a device with data processing capability, and includes but is not limited to a Central Processing Unit (CPU) and the like; memory 102 is a device having data storage capabilities including, but not limited to, random access memory (RAM, more specifically SDRAM, DDR, etc.), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), FLASH memory (FLASH); an I/O interface (read/write interface) 103 is connected between the processor 101 and the memory 102, and can realize information interaction between the processor 101 and the memory 102, which includes but is not limited to a data Bus (Bus) and the like.
In some embodiments, the processor 101, memory 102, and I/O interface 103 are interconnected via a bus 104, which in turn connects with other components of the computing device.
In some embodiments, the monitoring and broadcasting device further includes an image acquisition module, a display module, and the like, where the image acquisition module may be configured to acquire and shoot a display picture of the display terminal, and the display module may be configured to display a picture corresponding to the media data stream that is output after successful association or the alarm information.
Fig. 9 is a schematic structural diagram of a computer-readable medium according to an embodiment of the present disclosure. The computer readable medium has stored thereon a computer program, wherein the program, when executed by a processor, implements the steps in the method for supervising broadcast as in any of the above embodiments.
It will be understood by those of ordinary skill in the art that all or some of the steps of the methods disclosed above, functional modules/units in the apparatus, may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed by several physical components in cooperation. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as is well known to those of ordinary skill in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as known to those skilled in the art.
Example embodiments have been disclosed herein, and although specific terms are employed, they are used and should be interpreted in a generic and descriptive sense only and not for purposes of limitation. In some instances, features, characteristics and/or elements described in connection with a particular embodiment may be used alone or in combination with features, characteristics and/or elements described in connection with other embodiments, unless expressly stated otherwise, as would be apparent to one skilled in the art. Accordingly, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the disclosure as set forth in the appended claims.
Claims (11)
1. A method of supervising a broadcast, comprising:
acquiring a data index of a schedule table of a service end, and determining a schedule acquisition mode according to the data index, wherein the schedule table stores schedule data streams at a plurality of moments, and the data index comprises: data change frequency and/or data volume;
acquiring at least part of display pictures of a display end, and identifying media data streams at the current moment according to the at least part of display pictures;
acquiring the plan data stream at the current moment according to the plan acquisition mode;
and performing association query on the media data stream and the plan data stream at the current moment to determine whether the media data stream and the plan data stream are associated.
2. The monitoring and broadcasting method of claim 1, wherein the acquiring at least a portion of a display screen of the display terminal and identifying the media data stream at the current time according to the at least a portion of the display screen comprises:
shooting at least part of the display picture through image acquisition equipment, recognizing graphical identification in a shooting result, and determining the media data stream according to the graphical identification.
3. The monitoring method according to claim 1, wherein the determining a plan acquisition manner according to the data index comprises:
determining that the plan acquisition mode is a memory synchronization mode in response to the data change frequency being less than or equal to a preset first threshold and the data volume being less than or equal to a preset second threshold;
the acquiring the plan data stream at the current moment according to the plan acquisition mode includes:
acquiring the schedule from the service end every preset time period according to the memory synchronization mode, and storing the schedule into a memory;
and inquiring the plan data stream at the current moment from the plan table.
4. The monitoring method according to claim 1, wherein the determining a plan acquisition manner according to the data index comprises:
determining the plan acquisition mode to be a message queue synchronization mode in response to the data change frequency being greater than or equal to a preset third threshold;
the acquiring the plan data stream at the current moment according to the plan acquisition mode includes:
according to the message queue synchronization mode, responding to the fact that plan updating data exist in a service end message queue, obtaining the plan updating data and storing the plan updating data as a new plan data stream, wherein the plan updating data is added to the service end message queue when the new plan data stream or the original plan data stream exists in the plan table or is changed by the service end;
and querying each stored planning data flow to obtain the planning data flow at the current moment.
5. The supervised method as recited in claim 4, wherein the obtaining and storing the schedule update data as a new schedule data stream comprises:
responding to the fact that the data volume is smaller than or equal to a preset fourth threshold value, storing the plan updating data as a new plan data stream into a preset map state storage area, and broadcasting;
the querying of each stored scheduled data flow to obtain the scheduled data flow at the current time includes:
and querying the broadcast stream to obtain the planning data stream at the current moment.
6. The monitoring and broadcasting method according to claim 4, wherein before the acquiring of the display screen of the display end, the method comprises:
acquiring the schedule of the service end, and analyzing the schedule data flow at each moment in the schedule;
appointing a timestamp, and generating a first time state table according to the associated fields of the plan data stream at each time;
the obtaining and storing the schedule update data as a new schedule data stream includes:
and analyzing the plan updating data and adding the plan updating data to the first time state table according to the corresponding time stamp and the associated field.
7. The monitoring method of claim 6, wherein prior to the performing the association query on the media data stream and the schedule data stream, comprising:
analyzing the media data stream and determining a timestamp corresponding to the media data stream;
generating a second time state table corresponding to the media data stream according to the timestamp and the associated field of the media data stream;
the querying of each stored planning data stream to obtain the planning data stream at the current time includes:
inquiring the association field of the planned data stream at the current moment from the first time state table according to the timestamp in the second time state table;
the performing of the correlation query on the media data stream and the plan data stream includes:
and determining whether the media data stream is associated with the plan data stream according to the associated field of the media data stream and the inquired associated field.
8. The monitoring method of claim 1, further comprising:
responding to the support of the asynchronous query function of the service end, and determining that the plan acquisition mode is an asynchronous query mode;
the acquiring the plan data stream at the current moment according to the plan acquisition mode includes:
according to the asynchronous query mode, responding to the media data stream, sending an asynchronous query request to the service end and configuring callback parameters;
and storing the plan data stream fed back by the service end into a preset cache.
9. The monitoring method of claim 1, further comprising:
responsive to the media data stream being associated with the scheduled data stream, outputting the media data stream;
in response to the media data stream not being associated with the planning data stream, outputting alert information.
10. An audition device, comprising:
one or more processors;
a memory for storing one or more programs;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method for supervising broadcast as recited in any of claims 1 to 9.
11. A computer-readable medium, on which a computer program is stored, wherein the program, when being executed by a processor, carries out the steps of the method for supervising a broadcast according to any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110586432.5A CN115412747B (en) | 2021-05-27 | 2021-05-27 | Monitoring method, monitoring device and computer readable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110586432.5A CN115412747B (en) | 2021-05-27 | 2021-05-27 | Monitoring method, monitoring device and computer readable medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115412747A true CN115412747A (en) | 2022-11-29 |
| CN115412747B CN115412747B (en) | 2024-03-01 |
Family
ID=84155947
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110586432.5A Active CN115412747B (en) | 2021-05-27 | 2021-05-27 | Monitoring method, monitoring device and computer readable medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115412747B (en) |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101588475A (en) * | 2009-06-03 | 2009-11-25 | 中兴通讯股份有限公司 | Timing period periodical play system and method of Internet TV set-top boxes |
| CN102629484A (en) * | 2012-03-20 | 2012-08-08 | 秦汉香 | Method and system for monitoring audio and video file to play |
| US20140013008A1 (en) * | 2012-07-05 | 2014-01-09 | Eric Lazarus | Managing data in a data queue including synchronization of media on multiple devices |
| WO2016187745A1 (en) * | 2015-05-22 | 2016-12-01 | 深圳市博安达信息技术股份有限公司 | Monitoring task generation method and system |
| CN107241316A (en) * | 2017-05-24 | 2017-10-10 | 大连金华录数码科技有限公司 | A kind of play system and method based on satellite+4G multimedia messages playback terminals |
| US20170366835A1 (en) * | 2016-06-16 | 2017-12-21 | International Business Machines Corporation | Streaming video queue management system |
| CN109660837A (en) * | 2018-11-12 | 2019-04-19 | 中国铁道科学研究院集团有限公司电子计算技术研究所 | A kind of multimedia programming dispatching method and device |
| CN110536174A (en) * | 2019-09-10 | 2019-12-03 | 世纪美映影院技术服务（北京）有限公司 | The method and system broadcast intelligently are supervised in a kind of pair of movie theatre broadcasting content progress |
| CN110636328A (en) * | 2019-09-02 | 2019-12-31 | 世纪美映影院技术服务（北京）有限公司 | Method and system for monitoring cinema advertisement playing |
| CN110677705A (en) * | 2019-09-10 | 2020-01-10 | 世纪美映影院技术服务（北京）有限公司 | Cinema intelligent management method and system |
| CN111200517A (en) * | 2019-12-24 | 2020-05-26 | 苏州达家迎信息技术有限公司 | Service data early warning control method, device, equipment and storage medium |
| CN111510395A (en) * | 2020-06-16 | 2020-08-07 | 腾讯科技（深圳）有限公司 | Service message reporting method, device, equipment and medium |
| CN111541913A (en) * | 2020-05-12 | 2020-08-14 | 京东方科技集团股份有限公司 | Video playing method and device of spliced screen, computer equipment and medium |
| CN111654726A (en) * | 2020-05-25 | 2020-09-11 | 深圳创维－Rgb电子有限公司 | Television program playing method, television and computer readable storage medium |
-
2021
- 2021-05-27 CN CN202110586432.5A patent/CN115412747B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101588475A (en) * | 2009-06-03 | 2009-11-25 | 中兴通讯股份有限公司 | Timing period periodical play system and method of Internet TV set-top boxes |
| CN102629484A (en) * | 2012-03-20 | 2012-08-08 | 秦汉香 | Method and system for monitoring audio and video file to play |
| US20140013008A1 (en) * | 2012-07-05 | 2014-01-09 | Eric Lazarus | Managing data in a data queue including synchronization of media on multiple devices |
| WO2016187745A1 (en) * | 2015-05-22 | 2016-12-01 | 深圳市博安达信息技术股份有限公司 | Monitoring task generation method and system |
| US20170366835A1 (en) * | 2016-06-16 | 2017-12-21 | International Business Machines Corporation | Streaming video queue management system |
| CN107241316A (en) * | 2017-05-24 | 2017-10-10 | 大连金华录数码科技有限公司 | A kind of play system and method based on satellite+4G multimedia messages playback terminals |
| CN109660837A (en) * | 2018-11-12 | 2019-04-19 | 中国铁道科学研究院集团有限公司电子计算技术研究所 | A kind of multimedia programming dispatching method and device |
| CN110636328A (en) * | 2019-09-02 | 2019-12-31 | 世纪美映影院技术服务（北京）有限公司 | Method and system for monitoring cinema advertisement playing |
| CN110536174A (en) * | 2019-09-10 | 2019-12-03 | 世纪美映影院技术服务（北京）有限公司 | The method and system broadcast intelligently are supervised in a kind of pair of movie theatre broadcasting content progress |
| CN110677705A (en) * | 2019-09-10 | 2020-01-10 | 世纪美映影院技术服务（北京）有限公司 | Cinema intelligent management method and system |
| CN111200517A (en) * | 2019-12-24 | 2020-05-26 | 苏州达家迎信息技术有限公司 | Service data early warning control method, device, equipment and storage medium |
| CN111541913A (en) * | 2020-05-12 | 2020-08-14 | 京东方科技集团股份有限公司 | Video playing method and device of spliced screen, computer equipment and medium |
| CN111654726A (en) * | 2020-05-25 | 2020-09-11 | 深圳创维－Rgb电子有限公司 | Television program playing method, television and computer readable storage medium |
| CN111510395A (en) * | 2020-06-16 | 2020-08-07 | 腾讯科技（深圳）有限公司 | Service message reporting method, device, equipment and medium |
Non-Patent Citations (1)
| Title |
|---|
| 汪剑超;金蓓弘;邵丹华;: "数字电视中的设备管理和监控系统", 计算机应用与软件, no. 01 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115412747B (en) | 2024-03-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106155780B (en) | node election method and device based on time | |
| CN110933449B (en) | Method, system and device for synchronizing external data and video pictures | |
| CN109842781B (en) | Monitoring video playing method, device, system, media server and storage medium | |
| CN112188225B (en) | Bullet screen issuing method for live broadcast playback and live broadcast video bullet screen playback method | |
| US20130290556A1 (en) | Systems and Methods for Controlling Client Behavior in Adaptive Streaming | |
| JP6906540B2 (en) | Web page data processing methods, devices and systems | |
| US20190320212A1 (en) | Picture storage method, apparatus and video monitoring system | |
| CN105338564B (en) | A kind of client adaptation method, client, server and system | |
| CA3153390A1 (en) | Multi-camera synchronization method and distributed system | |
| WO2023131269A1 (en) | Method and system for monitoring playing of screen device, and storage medium | |
| CN112148493A (en) | Streaming media task management method and device and data server | |
| CN111352994A (en) | Data synchronization method and related equipment and device | |
| CN110795264A (en) | Monitoring management method and system and intelligent management terminal | |
| CN113779094A (en) | Batch-flow-integration-based data processing method and device, computer equipment and medium | |
| CN115412747B (en) | Monitoring method, monitoring device and computer readable medium | |
| CN113965538B (en) | Equipment state message processing method, device and storage medium | |
| WO2021174730A1 (en) | Network address processing method, computer device, and storage medium | |
| CN115269719A (en) | Data synchronization method and device | |
| CN111479161B (en) | Live broadcast quality data reporting method and device | |
| CN114077409A (en) | Screen projection method and device, electronic equipment and computer readable medium | |
| CN114374705A (en) | Service cluster and message pushing method | |
| US20170171574A1 (en) | Method and system for switching video live broadcasting to on-demand broadcasting | |
| CN111708997B (en) | Method, device and storage medium for determining target object identity identifier | |
| CN115278278B (en) | Page display method and device, electronic equipment and storage medium | |
| CN115499435B (en) | Task scheduling method, system, electronic device and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |