WO2023220956A1 - 多媒体监播方法、系统及电子设备 - Google Patents

多媒体监播方法、系统及电子设备 Download PDF

Info

Publication number
WO2023220956A1
WO2023220956A1 PCT/CN2022/093467 CN2022093467W WO2023220956A1 WO 2023220956 A1 WO2023220956 A1 WO 2023220956A1 CN 2022093467 W CN2022093467 W CN 2022093467W WO 2023220956 A1 WO2023220956 A1 WO 2023220956A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
display
data
information
logo
Prior art date
Application number
PCT/CN2022/093467
Other languages
English (en)
French (fr)
Inventor
吴艳红
房浩
高艳
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Priority to PCT/CN2022/093467 priority Critical patent/WO2023220956A1/zh
Priority to CN202280001247.8A priority patent/CN117426100A/zh
Publication of WO2023220956A1 publication Critical patent/WO2023220956A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content

Definitions

  • the present disclosure belongs to the field of media transmission technology, and specifically relates to a multimedia monitoring method, system and electronic equipment.
  • a traditional solution can be carried out by manually patrolling.
  • Remote monitoring of broadcasts but this method has high labor costs, low detection efficiency, and low detection accuracy, and when incorrect display content is detected, the execution efficiency of the response plan is low.
  • Another solution is to use the peripheral camera of the display screen for optical monitoring and use algorithms to analyze and detect multimedia content.
  • this method requires a monitoring camera for each display screen, and it needs to be installed according to specific standards such as height and angle. Cameras, and during the installation process, camera-related structures, wiring and other projects are often limited in application scenarios, making it difficult to implement projects.
  • the present invention aims to solve at least one of the technical problems existing in the prior art and provide a multimedia monitoring method, system and electronic equipment.
  • the technical solution adopted to solve the technical problems of the present disclosure is a multimedia monitoring method, which includes:
  • the first verification image of the playback plan is generated;
  • the first identification image is used to represent the first identity authentication information;
  • the first The identity authentication information is used to characterize the playback plan in the playback plan table;
  • Receive the display image sent by the display terminal analyze the display image, and after parsing out the second logo image in the display image, determine the second logo image and the first logo image. If consistent, obtain the second identity authentication information corresponding to the second identification image;
  • the second identity authentication information is compared with the first identity authentication information, and whether the display image of the display terminal is accurate is determined based on the comparison result.
  • generating the first verification image of the playback plan based on the pre-generated first identification image and the configuration information of the display terminal and through an image generation algorithm includes:
  • the first encoded data is replaced with the display data of the corresponding pixels in the specific area of the transparent image to generate a first verification image.
  • the method further includes:
  • the transparent image is generated according to the resolution information of the display terminal; the resolution of the transparent image is consistent with the resolution of the display terminal.
  • the transparent image has a middle area and an edge area surrounding the middle area; the specific area is the edge area.
  • the first encoded data is used to replace the corresponding pixels in the specific area of the transparent image.
  • Display data to generate the first verification image including:
  • the specific steps of analyzing the display image to determine whether the display image of the display terminal is accurate include:
  • the second identity authentication information is compared with the first identity authentication information to determine whether the displayed image is accurate.
  • processing the actually displayed logo image and obtaining the second logo image based on the resolution information of the first logo image includes:
  • a second identification image is generated according to the resolution information of the first identification image and the decoded data.
  • encoding the display information of each pixel of the first target identification image to obtain first encoded data includes:
  • Processing the actually displayed logo image according to the number of pixels corresponding to the specific area of the transparent image to obtain a second target logo image includes:
  • the display data of each pixel in the actually displayed logo image is assembled in sequence according to the first preset order to obtain a second target logo image.
  • replacing the display data of corresponding pixels in a specific area of the transparent image with the first encoded data to generate a first verification image includes:
  • the analysis of the display image to obtain the logo image actually displayed by the display terminal includes:
  • the playback plan includes playback window information and playback order information for each of the multimedia files in the display terminal;
  • Generating data to be displayed based on the received playback plan, the multimedia file corresponding to the playback plan and the first verification image includes:
  • the data to be displayed is generated according to the display area information and display order information of each multimedia file in the display terminal, as well as the multimedia file corresponding to the playback plan and the first verification image, so that the The display terminal responds to the data to be displayed to display according to the play window information and play sequence information of each multimedia file in the display terminal.
  • the display image when analyzing the display image, it also includes:
  • a control instruction to cancel the display is sent to the display terminal, so that the display terminal cancels the display of the display image and generates an alarm message.
  • the multimedia monitoring method further includes:
  • the parameter information in the playback plan is encoded to generate the first identity authentication information.
  • embodiments of the present disclosure also provide a multimedia broadcast monitoring system, which includes a verification image generation module, a playback control module, an analysis module and a display terminal; wherein,
  • the verification image generation module is configured to generate the first verification image of the playback plan according to the pre-generated first identification image and the configuration information of the display terminal and through an image generation algorithm; the first identification image Used to characterize the first identity authentication information; the first identity authentication information is used to characterize the play plan in the play plan table;
  • the playback control module is configured to generate data to be displayed based on the received playback plan, the multimedia file corresponding to the playback plan, and the first verification image;
  • the display terminal is configured to display in response to the data to be displayed, and intercept the currently displayed image as a display image according to a preset frequency;
  • the analysis module is configured to analyze the display image, and after parsing out the second logo image in the display image, and determining that the second logo image is consistent with the first logo image, Obtain the second identity authentication information corresponding to the second identification image, compare the second identity authentication information with the first identity authentication information, and determine whether the display image of the display terminal is based on the comparison result. precise.
  • embodiments of the present disclosure also provide a computer device, including: a processor, a memory, and a bus.
  • the memory stores machine-readable instructions executable by the processor.
  • the processing The processor communicates with the memory through a bus, and when the machine-readable instructions are executed by the processor, the steps of the above-mentioned first aspect, or any possible multimedia monitoring method in the first aspect, are performed.
  • embodiments of the present disclosure also provide a computer non-transitory readable storage medium, the computer non-transitory readable storage medium stores a computer program, and the computer program executes the above first aspect when run by a processor, Or the steps of any possible multimedia monitoring method in the first aspect.
  • an embodiment of the present disclosure further provides an electronic device, including the multimedia monitoring system and a display terminal described in the second aspect.
  • Figure 1 is a schematic structural diagram of a multimedia monitoring system provided by an embodiment of the present disclosure
  • Figure 2 is a schematic diagram of the processing flow of the verification image generation module provided by an embodiment of the present disclosure
  • Figure 3 is a schematic diagram of the first target identification image encoding sequence provided by an embodiment of the present disclosure
  • Figure 4 is a schematic diagram of the replacement sequence of the first encoded data replacing the transparent image provided by an embodiment of the present disclosure
  • Figure 5 is a schematic diagram of the processing flow of the second logo image analysis unit provided by an embodiment of the present disclosure
  • Figure 6 is a schematic diagram of a display image provided by an embodiment of the present disclosure.
  • Figure 7 is a flow chart of a multimedia monitoring method provided by an embodiment of the present disclosure.
  • Figure 8 is a schematic structural diagram of a computer device provided for an embodiment of the present application.
  • Figure 1 is a schematic structural diagram of a multimedia monitoring system provided by an embodiment of the present disclosure.
  • the multimedia monitoring system 100 is configured to monitor the display content of the display terminal 101 to The user is prompted to display the current display situation of the terminal 101.
  • the multimedia monitoring system 100 includes a verification image generation module 11 , a playback control module 12 and an analysis module 13 .
  • the verification image generation module 11 is configured to generate a first verification image of the playback plan according to the pre-generated first identification image and the configuration information of the display terminal 101, and through an image generation algorithm.
  • the first identification image is generated according to the first identity verification information and is used to represent the first identity authentication information
  • the first identity authentication information is generated by the information management module 14 according to the play plan in the play plan table and is used to represent the playback plan.
  • the playback plan is generated based on the information management module 14 using the parameter information of at least one playback plan.
  • a playback plan corresponds to a first identity authentication information
  • a first identity authentication information corresponds to a first identification image.
  • each image can be generated separately through the image generation algorithm.
  • the first identity authentication information and the configuration information of the display terminal 101 are used as input data of the image generation algorithm, and through the processing of the image generation algorithm, the first verification image of the playback plan can be generated.
  • the verification image generation module 11 is configured to send the first verification image of the playback plan to the distribution control module, so that the playback plan currently to be played, the playback plan, and the playback plan can be transferred to the distribution control module according to the playback plan table.
  • the planned first verification image and the multimedia files corresponding to the playback plan are sent to the playback control module 12 at the same time.
  • the playback control module 12 is configured to generate data to be displayed according to the received playback plan, the multimedia file corresponding to the playback plan and the first verification image for display by the display terminal 101 .
  • the data to be displayed specifically includes a playback plan, a multimedia file corresponding to the playback plan, and a first verification image.
  • the playback control module 12 can send the data to be displayed to the display terminal 101 for display through a High Definition Multimedia Interface (HDMI).
  • HDMI High Definition Multimedia Interface
  • the analysis module 13 is configured to analyze the display image intercepted by the display terminal 101 according to a preset frequency, and after parsing the second logo image and determining that the second logo image is consistent with the first logo image, obtain the second logo image.
  • the corresponding second identity authentication information is compared with the first identity authentication information, and based on the comparison result, it is judged whether the display of the display terminal 101 is accurate.
  • the playback content of the display terminal 101 is monitored in a timely manner without affecting the playback content of the multimedia file. Specifically, by taking a screenshot of the image currently displayed by the display terminal 101 and further analyzing and displaying it. image, it can quickly monitor whether the displayed image of the display terminal 101 is accurate, which greatly improves the security of multimedia monitoring. Compared with the manual point patrol method in the traditional solution, the embodiment of the present disclosure can reduce the cost of multimedia monitoring, and The real-time performance is high; compared with the solution of optical monitoring by external cameras on the display screen, the multimedia monitoring system 100 provided by the embodiment of the present disclosure belongs to the system's built-in multimedia monitoring algorithm and uses background data processing without the need for external detection equipment. Multimedia monitoring can be completed efficiently.
  • the display terminal 101 performs display in response to the data to be displayed, intercepts the current display image according to a preset frequency, and sends the display image to the analysis module 13 .
  • the display terminal 101 may include a display screen for displaying images corresponding to multimedia files.
  • the display terminal 101 uses the playback card in the display terminal 101 to control the playback of multimedia files, intercepts the image displayed on the current display screen at a preset frequency, and uses the image as a display image for subsequent display.
  • the accuracy of the multimedia content currently played by the terminal 101 is monitored in a timely manner.
  • FIG 2 is a schematic processing flow diagram of the verification image generation module 11 provided by the embodiment of the present disclosure.
  • the verification image generation module 11 includes a first identification image generation unit, an image processing unit, an encoding unit and a first verification unit. Test image generation unit.
  • the first identification image generating unit is configured to generate a first identification image according to the first identity authentication information.
  • the first logo image generating unit is configured to use a logo generation function to arrange the logos of the first identity authentication information according to specific rules and generate the first logo image according to specific geometric figures.
  • the identification generation function may be a QR code generation function
  • the first identification image generation unit is configured to call the QR code generation function to generate an image of an identity information QR code with a resolution of L1*L1.
  • the identity information The image of the QR code is the first identification image.
  • the use of the identity information QR code to represent the first identity authentication information can realize coding protection of the first identity authentication information and enhance the robustness of the first identity authentication information, that is, prevent the first identity authentication information from being stored in the system. And information extraction fails due to noise pollution during the transmission process.
  • the image processing unit is configured to process the first identification image according to the number of pixels corresponding to the specific area of the pre-generated transparent image to obtain the first target identification image.
  • the transparent image may be pre-generated by the transparent image generating unit in the verification image generating module 11 .
  • the specific area of the transparent image can be a preset area, and the area range can be limited based on actual application scenarios and experience.
  • the transparent image has a middle area and an edge area surrounding the middle area.
  • the specific area may include an edge area of the transparent image, a corner area of the transparent image, or an irregularly shaped set area of the transparent image, etc.
  • the image processing unit is configured to process the first identification image according to the number of pixels corresponding to the specific area of the pre-generated transparent image, so that the number of pixels in the obtained first target identification image is less than or equal to The number of pixels corresponding to a specific area of the transparency image.
  • the identity information QR code is calculated based on the number of pixels corresponding to a specific area of the pre-generated transparent image. Zoom is performed to obtain the first target identification image with the scaled identity information QR code.
  • the encoding unit is configured to encode the display information of each pixel of the first target identification image to obtain first encoded data.
  • the display information includes information about the color displayed by the first target identification image, which may include information about different colors, including but not limited to black and white.
  • the encoding unit is configured to encode the display information of each pixel of the first target identification image. Different display information can encode different first encoding data. For example, black pixels can be encoded as first encoding sub-data (for example, 0), encode the white pixel point into the second encoding sub-data (for example, 1), etc.
  • the encoding unit is configured to sequentially encode the display information of each pixel of the first target identification image in a first preset order to obtain first encoded data arranged in the preset order.
  • Figure 3 is a schematic diagram of the encoding order of the first target identification image provided by an embodiment of the present disclosure. As shown in Figure 3, the first preset order can be traversed sequentially from left to right and from top to bottom as shown in Figure 3. The first target identifies each pixel point of the image, encodes each pixel point, and records the first encoded data of each pixel point in a preset order.
  • the first verification image generating unit is configured to replace the display data of corresponding pixels in a specific area of the transparent image with the first encoded data to generate a first verification image.
  • a transparent image is a single-channel image, that is, an image with an alpha channel.
  • the display data of the corresponding pixels in a specific area of the transparent image may be the data of the alpha channel of the transparent image.
  • the first verification image generating unit is configured to replace the alpha channel data of corresponding pixels in a specific area of the transparent image with the first encoded data, and generate a transparent image with a scaled identity information QR code (i.e., the first a verification image).
  • the first verification image generating subunit is configured to sequentially replace the display data of corresponding pixels in a specific area of the transparent image with the first encoded data in a second preset order to generate the first verification image.
  • the first encoded data of each pixel recorded in the first target identification image in a preset order can be recorded from left to right, from top to bottom, and from right to left. , sequentially replace the display data of each pixel in the edge area of the transparent image from bottom to top, and generate a transparent image with a scaled identity information QR code (that is, the first verification image).
  • Figure 4 is a schematic diagram of the replacement sequence of the first encoded data replacing the transparent image provided by the embodiment of the present disclosure.
  • the first encoded data from left to right and top to bottom in the target identification image is sequentially replaced with each pixel from top to bottom, right to left, bottom to top, and bottom to top (arrow direction) of the transparent image Point display data.
  • the second preset order may not be limited to the order of "from left to right, from top to bottom, from right to left, from bottom to top” and may be limited based on experience and actual application scenarios. , non-disclosed embodiments will not be listed one by one.
  • the first verification image generating unit is configured to convert the first encoded data into While replacing the display data of the corresponding pixels in the specific area of the transparent image, replace the display data of the pixels in the specific area of the transparent image except the pixels corresponding to the first target identification image with the second encoded data. , get the first verification image.
  • the first verification image generating unit is configured to sequentially replace the display data of corresponding pixels in the specific area of the transparent image with the first encoded data in a second preset order, and at the same time, change the specific area of the transparent image to In the area, the display data of the pixels other than the pixels corresponding to the first target identification image are continued to be replaced with the second encoded data in accordance with the second preset order to obtain the first verification image.
  • Pixel points other than the pixel points corresponding to the first target identification image that is, among the N' pixel points in the specific area, pixel points other than N2 pixel points in the first target identification image.
  • the second encoded data may be randomly set encoded data, or may be different from the first encoded data or the second encoded data.
  • the same data is not limited to this embodiment of the present disclosure.
  • the transparent image generation process specifically, the verification image generation module 11 also includes a transparent image generating unit; the transparent image generating unit is configured to generate a transparent image according to the resolution information of the display terminal 101; the resolution of the transparent image The rate is consistent with the resolution of the display terminal 101.
  • the resolution of the transparent image may be inconsistent with the resolution of the display terminal 101.
  • the pixel points of the transparent image are located at the locations of some pixels in the display terminal 101.
  • the analysis module 13 includes an image analysis unit, a second identification image analysis unit, a first comparison unit, a second identity authentication information analysis unit and a second comparison unit.
  • the image analysis unit is configured to analyze the display image to obtain the logo image actually displayed by the display terminal 101 .
  • the image analysis unit is configured to extract the display data of each pixel corresponding to the position range of the display image according to the pixel position range corresponding to the specific area of the pre-generated transparent image, and obtain the logo actually displayed by the display terminal 101 image.
  • the first verification image generating unit is configured to sequentially replace the display data of corresponding pixels in a specific area of the transparent image with the first encoded data in a second preset order to generate the first verification image.
  • the image analysis unit is configured to sequentially extract the display data of the corresponding pixels in the specific area of the display image (that is, the area corresponding to the pixel position range of the specific area of the transparent image) according to the second preset order, and Based on the extracted display data, the logo image actually displayed by the display terminal 101 is obtained.
  • the first verification image generation subunit When the first verification image generation subunit generates the first verification image, a specific area of the transparent image is used as the edge area, and the second preset order is from left to right, from top to bottom, and from right to left. , taking the order from bottom to top as an example.
  • the corresponding pixels in the edge area of the displayed image can be extracted in order from left to right, from top to bottom, from right to left, and from bottom to top. display data, and based on the extracted display data, the logo image actually displayed by the display terminal 101 is obtained.
  • the first verification image generation unit uses the first coded data to replace the replacement rules of the transparent image (that is, in a manner of sequential replacement according to the second preset order), and the image analysis unit extracts the extraction rules of the display image pixels (That is, the method of extracting according to the second preset order) is the same.
  • the second logo image analysis unit is configured to process the actually displayed logo image and obtain the second logo image according to the resolution information of the first logo image.
  • FIG. 5 is a schematic processing flow diagram of the second logo image analysis unit provided by the embodiment of the present disclosure.
  • the second logo image analysis unit includes an image processing sub-unit, a first judgment sub-unit, a decoding sub-unit and a second logo image generation sub-unit.
  • the actual displayed logo image is processed through each sub-unit of the second logo image analysis unit. The specific process is as follows:
  • the image processing subunit is configured to process the actually displayed logo image according to the number of pixels corresponding to the specific area of the transparent image to obtain the second target logo image. Specifically, the image processing subunit is configured to assemble the display data of each pixel point in the actually displayed identification image into the second target identification image according to the number of pixel points corresponding to the specific area of the transparent image.
  • the number of display data of each pixel in the actually displayed logo image is N3
  • the number of pixels corresponding to a specific area of the transparent image is N'
  • N3 N'.
  • the encoding unit is configured to sequentially encode the display information of each pixel of the first target identification image in a first preset order to obtain first encoded data arranged in the preset order.
  • the reason for this may be that the multimedia files being played currently do not belong to the multimedia files in the playback plan, that is, the playback content is inaccurate.
  • the multimedia files played by the display terminal 101 are multimedia files in the playback plan.
  • the captured display image is an incomplete image, and the captured display image may not exist after being encoded. that part of the image. Therefore, the second target identification image is preliminarily verified using the first judgment sub-unit in the second identification image analysis unit.
  • the first determination subunit is configured to determine whether there is target encoding data that encodes the display information of each pixel point in the second target identification image. If it is determined that there is no target encoding data that encodes the display information of each pixel in the second target identification image, the displayed image is inaccurate.
  • the target encoding data is the first encoding data; when the number of pixels in the specific area is equal to the number of pixels in the first target identification image, the target encoding data Includes first encoded data and second encoded data.
  • the decoding subunit is configured to decode the target coded data to obtain decoded data when it is determined that there is target coded data that codes the display information of each pixel in the second target logo image.
  • Different target encoding data can be decoded into different display information (ie, decoded data). For example, the first encoded sub-data is decoded into black, the second encoded sub-data is decoded into white (first decoded sub-data), the second encoded data is decoded into black (second decoded sub-data), and so on.
  • the second identification image generating subunit is configured to generate a second identification image according to the resolution information and decoded data of the first identification image.
  • the second identification image generation subunit is specifically configured to scale the decoded second target identification image with decoded data according to the resolution information of the first identification image, so that the resolution of the scaled second identification image is
  • the rate L4*L4 is the same as the resolution L1*L1 of the first logo image.
  • the second target identification image has the QR code corresponding to the decoded data.
  • the second identification image generating subunit is configured to scale the two-dimensional code corresponding to the decoded data according to the resolution information of the first identification image to obtain a second identification image.
  • the scaling method here is the same as the above-mentioned scaling method of "zooming the identity information QR code to obtain the first target identification image with the scaled identity information QR code". If the second target identification image with decoded data is decoded, The resolution L3*L3 is smaller than L1*L1. According to the resolution L1*L1 of the first logo image, the second target logo image is enlarged, for example, using interpolation method to fill the pixels until the resolution of the generated second logo image is the same as that of the first logo image. A logo image has the same resolution.
  • the second target logo image is reduced according to the resolution L1*L1 of the first logo image, for example, some pixels are eliminated. , until the resolution of the generated second identification image is the same as the resolution of the first identification image.
  • the first comparison unit is configured to compare the type of the second identification image with the type of the first identification image. If the two types are inconsistent, the displayed image is incorrect.
  • the type of the first identification image is a two-dimensional code. If the type of the second identification image is also a two-dimensional code, it is determined that the type of the second identification image is consistent with the type of the first identification image; if the type of the second identification image is If the type is not an identification image in the form of a two-dimensional code, it is determined that the type of the second identification image is inconsistent with the type of the first identification image.
  • the first comparison unit is configured to use the QR code reading function to read the QR code information of the second identification image. If the reading is successful, it means that the second identification image is a QR code type image. , if the reading fails, it means that the type of the second logo image is not a QR code type, and it is determined that the displayed image is incorrect.
  • the second identity authentication information parsing unit is configured to obtain the second identity authentication information based on the second identity image when the second identity image is consistent with the first identity image.
  • the second identity authentication information parsing unit is configured to, when the second identification image is consistent with the first identification image, use the inverse function of identification generation to inversely parse the second identification image according to a specific rule and arrange it to obtain the second identity authentication information. .
  • the inverse logo generation function is the inverse operation function of the above logo generation function.
  • the logo generation function can be a QR code generation function
  • the logo generation inverse function is the inverse operation process of the QR code generation function
  • the QR code uses the QR code generation function.
  • the reverse operation process is reversely parsed into the second identity authentication information.
  • a second comparison unit is set in the analysis module 13. The second comparison unit is configured to compare the second identity authentication information with the first identity authentication information to determine whether the displayed image precise.
  • the second comparison unit is configured to compare the second identity authentication information with the first identity authentication information, determine the similarity of the two identity information, and determine when the similarity of the identity information is greater than or equal to the preset similarity threshold. Display image is accurate. When the identity information similarity is less than the preset threshold, it is determined that the displayed image is incorrect.
  • the preset similarity threshold can be determined based on actual application scenarios and experience, and is not specifically limited in the embodiments of the present disclosure.
  • the analysis module 13 is further configured to send a control instruction to cancel the display to the display terminal 101 when it is determined that the displayed image is inaccurate, so that the display terminal 101 cancels the display of the displayed image and generates an alarm message.
  • the display terminal 101 When the display terminal 101 receives the control instruction to cancel the display sent by the analysis module 13, it can use the play card to close the screen and generate alarm information.
  • the alarm information can be displayed on the screen in the form of text; or the alarm information can also be It is played as an alarm tone.
  • the first identification image generating unit is configured to generate the identity information QR code according to the first identity authentication information.
  • the transparent image generating unit is configured to generate a transparent image according to the resolution information of the display terminal 101; the resolution of the transparent image is consistent with the resolution of the display terminal 101.
  • the image processing unit is configured to process the identity information QR code according to the number of pixels corresponding to the edge area of the pre-generated transparent image to obtain a first target identification image with the scaled identity information QR code.
  • the encoding unit is configured to sequentially encode the display information of each pixel of the first target identification image in order from left to right and from top to bottom (that is, the first preset order), for example, the first color pixel (eg, black) is encoded into the first encoding sub-data, and the second color pixel (eg, white) is encoded into the second encoding sub-data.
  • the first encoded data includes first encoded sub-data and second encoded sub-data.
  • the first verification image generating unit is configured to sequentially replace the corresponding pixels in the edge area of the transparent image with the first encoded data in the order of "from left to right, from top to bottom, from right to left, and from bottom to top"
  • the display data of the pixels in the edge area of the transparent image except the pixels corresponding to the first target logo image will be Continue to follow the order of "from left to right, from top to bottom, from right to left, and from bottom to top” and replace it with the second encoded data in order to obtain the first verification image.
  • the playback control module 12 is configured to generate data to be displayed according to the received playback plan, the multimedia file corresponding to the playback plan and the first verification image.
  • the display terminal 101 performs display in response to the data to be displayed, and intercepts the currently displayed image as a display image according to a preset frequency.
  • Figure 6 is a schematic diagram of a display image provided by an embodiment of the present disclosure. As shown in Figure 6, it is a display image of the display terminal 101 under normal playback according to the playback plan, including the structural frame of the display terminal 101, the black border of the screen of the display terminal 101, the screen area of the display terminal 101, and each element of the display terminal 101. pixels and edge areas.
  • the image analysis unit is specifically configured to sequentially extract the edge areas of the displayed image in the order of "from left to right, from top to bottom, from right to left, and from bottom to top".
  • the display data of the corresponding pixels in the display terminal 101 is obtained, and based on the extracted display data, the logo image actually displayed by the display terminal 101 is obtained.
  • the image processing subunit is configured to, according to the number of pixels corresponding to the edge area of the transparent image, display data of each pixel in the actually displayed identification image in order from left to right and from top to bottom (that is, the first (preset order) are assembled sequentially to obtain the second target identification image.
  • the first determination subunit is configured to determine whether there is target encoding data (including first encoding data and second encoding data) that encodes the color information of each pixel in the second target identification image.
  • the decoding subunit is configured to decode the target coded data, for example, decode the first coded sub-data into the first coded data when it is determined that there is target coded data that has coded the color information of each pixel in the second target identification image.
  • the second encoded sub-data is decoded into second color information
  • the second encoded data is decoded into third color information (the third color information may be first color information or second color information).
  • the decoded data includes first color information, second color information and third color information.
  • the second logo image generating subunit is configured to scale the decoded second target logo image with decoded data to generate a second logo image.
  • the resolution information of the second identification image is the same as the resolution information of the first identification image.
  • the first comparison unit is configured to call the QR code reading function to determine whether the second logo image can be read. If the reading fails, the image is displayed incorrectly.
  • the second identity authentication information parsing unit is configured to obtain the second identity authentication information based on the second identity image when the second identity image is read successfully.
  • the second comparison unit is configured to compare the second identity authentication information with the first identity authentication information to determine whether the displayed image is accurate.
  • the above example takes the specific area of the transparent image as the edge area and the first identification image as the identity information QR code. Since the specific area of the transparent image is the edge area, it does not affect the user's viewing of the playback of multimedia files displayed by the display terminal 101.
  • the content can display the playback content of the terminal 101 for real-time monitoring.
  • Specific monitoring process By taking a screenshot of the image currently displayed by the display terminal 101 and further analyzing the displayed image, it is possible to promptly discover whether the playback content is played according to the playback order and whether the playback content is accurate, which greatly improves the security of multimedia monitoring.
  • the embodiment of the present disclosure can reduce the cost of multimedia monitoring and has higher timeliness; compared with the solution of optical monitoring with a peripheral camera on the display screen, the implementation of the present disclosure
  • the multimedia monitoring system 100 provided in the example belongs to the system's built-in multimedia monitoring algorithm, which uses background data processing to efficiently complete multimedia monitoring without the need for external detection equipment.
  • the information management module 14 is configured to encode parameter information in the playback plan and generate first identity authentication information.
  • the information management module 14 may be an Internet web client.
  • the parameter information in the playback plan includes the playback plan identifier, the number of multimedia files, the type of playback window in the display terminal 101, the number of playback windows, the identifier of each multimedia file, the type of each multimedia file, and the number of playback windows used for playback.
  • the information management module 14 is configured to encode the parameter information in the playback plan table.
  • the first 0 to 3 bytes represent the playback plan identification, 4 bytes represent the number of multimedia files, and 5 bytes represent the display terminal.
  • the type of play window in 101 6 bytes represent the number of play windows, 7 to 10 bytes represent the identification of the multimedia file, 11 bytes represent the type of the multimedia file, and 12 bytes represent the number of play windows used to play multimedia files.
  • Identification, 13 represents the playback order of multimedia files, and 14 represents the number of times multimedia files are played in a loop. If a playback plan includes multiple multimedia files to be played, continue to use the last 8 bytes to encode the parameter information of the second multimedia file, and so on.
  • a playback plan containing M multimedia files requires a total of 7+8M The number of bytes, where the first 7 bytes represent the attributes of the playback plan, the last 8M bytes represent the playback information of a multimedia file, and M is a positive integer.
  • the type of playback window can be expressed by numbers, where 1 represents one window; 2 represents two windows, distributed horizontally; 3 represents two windows, distributed vertically; 4 represents three windows, one row and distributed horizontally; 5 represents three windows.
  • the types of multimedia files include at least one of the following: video type, image type, text type, and audio type.
  • the type of multimedia files can be represented by numbers, where 1 represents the video type, that is, .mp4 format; 2 represents the image type, that is, .jpg format, .png format; 3 represents the file type, such as .pptx format, .txt format; 4 Represents the audio format, i.e. .mp3.
  • the playback plan includes playback window information and playback order information of each multimedia file in the display terminal 101.
  • the playback window information includes the identification of the playback window, the number of playback windows, and the type of playback window.
  • the playback order information includes the playback order of each multimedia file in a playback plan.
  • the display terminal 101 may include at least one playback window, and each playback window may independently execute a playback plan, or multiple playback windows may jointly play multimedia files indicated by a playback plan.
  • the playback control module 12 is specifically configured to generate data to be displayed based on the display area information and display order information of each multimedia file in the display terminal 101, as well as the multimedia file corresponding to the playback plan and the first verification image.
  • the display terminal 101 is specifically configured to respond to the data to be displayed so as to display the multimedia files according to the playback window information and playback order information in the display terminal 101 .
  • the multimedia monitoring system 100 also includes a file distribution module 15 .
  • the distribution control module is configured to send the playback plan and the multimedia files corresponding to the playback plan to the playback control module 12 .
  • the distribution control module is configured to receive the playback plan sent by the information management module 14, and according to the playback plan, according to the playback order of each multimedia file in the playback plan, the playback plan currently to be played and the playback plan are The corresponding multimedia files are sent to the playback control module 12 at the same time.
  • the playback control module 12 After the playback control module 12 receives the playback plan and the multimedia files corresponding to the playback plan, the playback control module 12 is configured to combine the multimedia files corresponding to the playback plan and the first verification image according to the parameter information of the current playback plan in the playback plan. Match and generate data to be displayed.
  • the data to be displayed generated by the playback control module 12 includes multimedia file x1, multimedia file x2, the first verification image, the playback window of multimedia file x1, the playback window of multimedia file x2, The number of cycles of multimedia file x1 and the number of cycles of multimedia file x2.
  • the display terminal 101 is specifically configured to respond to the data to be displayed by placing the multimedia file x1 (audio) into the first row of play windows for playback, and the multimedia file x2 (video) into the second row of playback windows for playback.
  • the embodiment of the present disclosure also provides a multimedia monitoring method corresponding to the multimedia monitoring system 100. Since the problem-solving principle of the multimedia monitoring method in the embodiment of the present disclosure is the same as that of the multimedia monitoring method described above in the embodiment of the present disclosure, The system 100 is similar, so the implementation of the multimedia broadcast monitoring method can be referred to the implementation of the multimedia broadcast monitoring system 100 , and repeated details will not be repeated.
  • the following describes the multimedia monitoring method provided by the embodiment of the present disclosure, taking the execution subject being the platform where the multimedia monitoring system 100 is located as an example.
  • Figure 7 is a flow chart of a multimedia monitoring method provided by an embodiment of the present disclosure. As shown in Figure 7, the method includes steps S1 to S4:
  • the first identification image is used to represent the first identity authentication information
  • the first identity Authentication information is used to characterize the playback plan in the playback plan table.
  • S1 can be implemented using the verification image generation module 11 in the multimedia monitoring system 100 in the above embodiment.
  • S2 can be implemented using the playback control module 12 in the multimedia monitoring system 100 in the above embodiment.
  • S3 and S4 can be implemented using the analysis module 13 in the multimedia monitoring system 100 in the above embodiment.
  • the playback content of the display terminal 101 is monitored in a timely manner without affecting the playback content of the multimedia file. Specifically, by taking a screenshot of the image currently displayed by the display terminal 101 and further analyzing the display image, It can quickly monitor whether the display image of the display terminal 101 is accurate, which greatly improves the security of multimedia monitoring. Compared with the manual point patrol method in the traditional solution, the embodiments of the present disclosure can reduce the cost of multimedia monitoring and improve the timeliness. Higher; compared with the optical monitoring solution using a peripheral camera on the display screen, the multimedia monitoring system 100 provided by the embodiment of the present disclosure belongs to the system's built-in multimedia monitoring algorithm, which uses background data processing and can be efficient without the need for external detection equipment. Complete multimedia monitoring.
  • the verification image generation module 11 includes a first identification image generation unit, an image processing unit, a transparent image generation unit, an encoding unit and a first verification image generation unit;
  • the analysis module 13 includes an image analysis unit , the second identification image analysis unit, the first comparison unit, the second identity authentication information analysis unit and the second comparison unit, this method can be implemented using the multimedia monitoring system 100.
  • the specific area of the transparent image is used as the edge area below.
  • the first logo image is the identity information QR code as an example for explanation.
  • the method specifically includes the following steps:
  • S101 may be implemented using a first identification image generating unit.
  • a logo generation function is used to arrange the logos of the first identity authentication information according to a specific rule, and the first logo image is generated according to a specific geometric figure.
  • the identification generation function can be a QR code generation function.
  • the QR code generation function can be called to generate an identity information QR code image with a resolution of L1*L1.
  • the identity information QR code image That is the first logo image.
  • the use of the identity information QR code to represent the first identity authentication information can realize coding protection of the first identity authentication information and enhance the robustness of the first identity authentication information, that is, prevent the first identity authentication information from being stored in the system. And information extraction fails due to noise pollution during the transmission process.
  • the multimedia monitoring system 100 also includes an information management module 14 .
  • the first identity authentication information can be generated using the information management module 14. Specifically, the parameter information in the playback plan is encoded to generate the first identity authentication information.
  • S102 may be implemented using a transparent image generating unit.
  • the transparent image has a middle area and an edge area surrounding the middle area.
  • the specific area may include an edge area of the transparent image, a corner area of the transparent image, or an irregularly shaped set area of the transparent image, etc.
  • S103 may be implemented using an image processing unit. Specifically, the identity information QR code is processed according to the number of pixels corresponding to the edge area of the pre-generated transparent image, and a first target identification image with the scaled identity information QR code is obtained.
  • the scaling method may refer to the scaling process of the above-mentioned image processing unit.
  • the display information includes information about the color displayed by the first target identification image, which may include information about different colors, including but not limited to black and white.
  • S104 may be implemented using coding units.
  • the display information of each pixel of the first target identification image is encoded. Different display information can encode different first encoding data.
  • the black pixel can be encoded as the first encoding sub-data (for example, 0).
  • the white pixels into the second encoding sub-data for example, 1.
  • the display information of each pixel point of the first target identification image is sequentially encoded in the order from left to right and top to bottom (that is, the first preset order), for example, the first color pixel (eg, black) is encoded into the first encoding sub-data, and the second color pixel (eg, white) is encoded into the second encoding sub-data.
  • the first encoded data includes first encoded sub-data and second encoded sub-data.
  • a transparent image is a single-channel image, that is, an image with an alpha channel.
  • the display data of the corresponding pixels in a specific area of the transparent image may be the data of the alpha channel of the transparent image.
  • the alpha channel data of corresponding pixels in a specific area of the transparent image is replaced with the first encoded data to generate a transparent image with a scaled identity information QR code (that is, a first verification image).
  • S105 may be implemented using the first verification image generation unit.
  • the first encoded data is sequentially replaced with the display data of corresponding pixels in a specific area of the transparent image according to a second preset order to generate a first verification image.
  • the corresponding pixels in the specific area of the transparent image are replaced with the first encoded data. While displaying the data of the points, the display data of the pixels in the specific area of the transparent image except the pixels corresponding to the first target identification image are replaced with the second encoded data to obtain the first verification image.
  • Pixel points other than the pixel points corresponding to the first target identification image that is, among the N' pixel points in the specific area, pixel points other than N2 pixel points in the first target identification image.
  • the first encoded data of each pixel recorded in the first target identification image in a preset order can be processed according to "from left to right, from top to bottom, and from right to left.” , and "from bottom to top” order, sequentially replace the display data of the corresponding pixels in the edge area of the transparent image.
  • the display data of pixels other than the pixels corresponding to the first target logo image is continued to be replaced by the second one in sequence in the order of "from left to right, from top to bottom, from right to left, and from bottom to top”. Encode the data to obtain the first verification image.
  • the second preset order may not be limited to the order of "from left to right, from top to bottom, from right to left, from bottom to top” and may be limited based on experience and actual application scenarios. , non-disclosed embodiments will not be listed one by one.
  • the second encoded data may be randomly set encoded data, or may be different from the first encoded data or the second encoded data.
  • the same data is not limited to this embodiment of the present disclosure.
  • the multimedia monitoring system 100 also includes a file distribution module 15.
  • the step of simultaneously sending the playback plan currently to be played and the multimedia files corresponding to the playback plan to the playback control module 12 can be implemented through the file distribution module 15.
  • S106 may be implemented using the playback control module 12 .
  • the data to be displayed is generated according to the display area information and display sequence information of each multimedia file in the display terminal 101, as well as the multimedia file corresponding to the playback plan and the first verification image, so that the display terminal 101 can display the data according to each multimedia file.
  • the playback window information and playback order information are displayed on the display terminal 101.
  • the display terminal 101 performs display in response to the data to be displayed, intercepts the current display image according to a preset frequency, and sends the display image to the analysis module 13 .
  • the display terminal 101 may include a display screen for displaying images corresponding to multimedia files.
  • the display terminal 101 uses the playback card in the display terminal 101 to control the playback of multimedia files, intercepts the image displayed on the current display screen at a preset frequency, and uses the image as a display image for subsequent display.
  • the accuracy of the multimedia content currently played by the terminal 101 is monitored in a timely manner.
  • this S107 can be implemented using an image analysis unit. Taking the specific area of the transparent image as the edge area as an example, the method is to sequentially extract the corresponding pixels in the edge area of the displayed image in the order of "from left to right, from top to bottom, from right to left, and from bottom to top”. display data, and based on the extracted display data, the logo image actually displayed by the display terminal 101 is obtained.
  • S108 Process the actually displayed logo image, and obtain a second logo image based on the resolution information of the first logo image.
  • S108 may be implemented using a second identification image parsing unit.
  • the second identification image analysis unit includes an image processing subunit, a first judgment subunit, a decoding subunit and a second identification image generation subunit.
  • S108 specifically includes the following steps (S108-1 ⁇ S108-4):
  • S108-1 Process the actually displayed logo image according to the number of pixels corresponding to the specific area of the transparent image to obtain the second target logo image.
  • this S108-1 may be implemented using an image processing subunit. Specifically, the display data of each pixel point in the actually displayed identification image is assembled into the second target identification image according to the number of pixel points corresponding to the specific area of the transparent image.
  • the display data of each pixel in the logo image is actually displayed from left to right and from top to bottom. (i.e., the first preset order) are assembled sequentially to obtain the second target identification image.
  • the display information of each pixel of the first target identification image is sequentially encoded according to a first preset order to obtain first encoded data arranged in the preset order.
  • S108-2 Determine whether there is target encoding data that encodes the display information of each pixel in the second target identification image.
  • S108-2 can be implemented using the first judgment subunit. Specifically, it is determined whether there is target coded data (including first coded data and second coded data) that codes the color information of each pixel in the second target identification image. If it is determined that there is no target encoding data that encodes the display information of each pixel in the second target identification image, the displayed image is inaccurate.
  • target coded data including first coded data and second coded data
  • this S108-3 may be implemented using a decoding subunit.
  • the target encoding data is the first encoding data; when the number of pixels in the specific area is equal to the number of pixels in the first target identification image, the target encoding data Includes first encoded data and second encoded data.
  • the target encoding data is decoded, for example, the first encoding sub-data is decoded into the first color information, The second encoded sub-data is decoded into second color information, and the second encoded data is decoded into third color information (the third color information may be first color information or second color information).
  • the decoded data includes first color information, second color information and third color information.
  • S108-4 may be implemented using the second identification image generation subunit. Specifically, according to the resolution information of the first logo image, the decoded second target logo image with decoded data is scaled so that the resolution of the scaled second logo image L4*L4 is the same as the resolution of the first logo image. The rates L1*L1 are the same.
  • the second target identification image has the QR code corresponding to the decoded data. Specifically, according to the resolution information of the first identification image, the two-dimensional code corresponding to the decoded data is scaled to obtain the second identification image.
  • the scaling method here is the same as the above-mentioned scaling method of "zooming the identity information QR code to obtain the first target identification image with the scaled identity information QR code". If the second target identification image with decoded data is decoded, The resolution L3*L3 is smaller than L1*L1. According to the resolution L1*L1 of the first logo image, the second target logo image is enlarged, for example, using interpolation method to fill the pixels until the resolution of the generated second logo image is the same as that of the first logo image. A logo image has the same resolution.
  • the second target logo image is reduced according to the resolution L1*L1 of the first logo image, for example, some pixels are eliminated. , until the resolution of the generated second identification image is the same as the resolution of the first identification image.
  • S109 may be implemented using the first comparison unit.
  • the type of the first identification image is a two-dimensional code. If the type of the second identification image is also a two-dimensional code, it is determined that the type of the second identification image is consistent with the type of the first identification image; if the type of the second identification image is If the type is not an identification image in the form of a two-dimensional code, it is determined that the type of the second identification image is inconsistent with the type of the first identification image.
  • the QR code reading function is used to read the QR code information of the second logo image. If the reading is successful, it means that the second logo image is a QR code type image. If the reading fails, it means The type of the second identification image is not a QR code type, and it is further determined that the displayed image is incorrect.
  • S110 may be implemented using a second identity authentication information parsing unit.
  • the second logo image is consistent with the first logo image
  • the second logo image is arranged according to a specific rule and inversely parsed to obtain the second identity authentication information using the logo generation inverse function.
  • the inverse logo generation function is the inverse operation function of the above logo generation function.
  • the logo generation function can be a QR code generation function
  • the logo generation inverse function is the inverse operation process of the QR code generation function
  • the QR code uses the QR code generation function.
  • the reverse operation process is reversely parsed into the second identity authentication information.
  • this S111 can be implemented using the second comparison unit.
  • the second identity authentication information is compared with the first identity authentication information to determine the similarity of the two identity information.
  • the similarity of the identity information is greater than or equal to the preset similarity threshold, it is determined whether the displayed image is accurate.
  • the identity information similarity is less than the preset threshold, it is determined that the displayed image is incorrect.
  • the preset similarity threshold can be determined based on actual application scenarios and experience, and is not specifically limited in the embodiments of the present disclosure.
  • S112 may be implemented using a second comparison unit.
  • the display terminal 101 When the display terminal 101 receives the control instruction to cancel the display sent by the analysis module 13, it can use the play card to close the screen and generate alarm information.
  • the alarm information can be displayed on the screen in the form of text; or the alarm information can also be It is played as an alarm tone.
  • a schematic structural diagram of a computer device provided by an embodiment of the present application includes:
  • Processor 81 memory 82 and bus 83.
  • the memory 82 stores machine-readable instructions executable by the processor 81
  • the processor 81 is used to execute the machine-readable instructions stored in the memory 82 .
  • the processor 81 executes The following steps: S1.
  • the pre-generated first identification image and the configuration information of the display terminal 101, and through the image generation algorithm generate a first verification image of the playback plan;
  • the first identification image is used to represent the first identity authentication information ;
  • the first identity authentication information is used to characterize the play plan in the play plan table.
  • the above-mentioned memory 82 includes a memory 821 and an external memory 822; the memory 821 here is also called an internal memory, and is used to temporarily store the operation data in the processor 81, as well as the data exchanged with an external memory 822 such as a hard disk.
  • the processor 81 communicates with the external memory 822 through the memory 821.
  • the external memory 822 performs data exchange.
  • the processor 81 and the memory 82 communicate through the bus 83, so that the processor 81 executes the execution instructions mentioned in the above method embodiment.
  • Embodiments of the present disclosure also provide a computer non-transitory readable storage medium.
  • the computer non-transitory readable storage medium stores a computer program. When the computer program is run by a processor, it executes the multimedia described in the above method embodiment. The steps of monitoring method.
  • the storage medium may be a volatile or non-volatile computer-readable storage medium.
  • An embodiment of the present disclosure also provides an electronic device, including the multimedia monitoring system 100 and the display terminal 101 in the above disclosed embodiment.

Abstract

本公开提供一种多媒体监播方法，系统及电子设备，属于媒体传播技术领域，其包括根据预先生成的第一标识图像和显示终端的配置信息，并通过图像生成算法，生成播放计划的第一校验图像；第一标识图像用于表征第一身份认证信息；第一身份认证信息用于表征播放计划；根据接收到的播放计划、与播放计划对应的多媒体文件和第一校验图像，生成待显示数据，以使显示终端响应于待显示数据进行显示；接收显示终端发送的显示图像，对显示图像进行解析，并在解析出显示图像中的第二标识图像后，且判断出第二标识图像与第一标识图像一致，获取第二身份认证信息；将第二身份认证信息与第一身份认证信息进行比对，并根据比对结果判断显示终端的显示图像是否准确。

Description

多媒体监播方法、系统及电子设备 技术领域
本公开属于媒体传输技术领域，具体涉及一种多媒体监播方法、系统及电子设备。
背景技术
针对已经发布的多媒体内容，若需要监播终端显示屏上最终显示的多媒体内容的播放情况，例如多媒体内容是否按时显示或显示内容是否正确等，一种传统方案，可以利用人工巡点的方式进行远程监播，但是该方式人力成本高，检测效率低，检测准确率低，且在检测到显示内容有误的情况下，应对方案执行效率较低。另一种方案，可以通过显示屏外设摄像头进行光学监播，利用算法实现多媒体内容的分析检测，但是该方式需要为每块显示屏配套监播摄像头，需要遵循特定的高度角度等标准来安装摄像头，且安装过程中摄像头相关结构、布线等工程往往受限应用场景，在工程实施上难以落地。
发明内容
本发明旨在至少解决现有技术中存在的技术问题之一，提供一种多媒体监播方法、系统及电子设备。
第一方面，解决本公开技术问题所采用的技术方案是一种多媒体监播方法，包括：
根据预先生成的第一标识图像和显示终端的配置信息，并通过图像生成算法，生成播放计划的第一校验图像；所述第一标识图像用于表征第一身份认证信息；所述第一身份认证信息用于表征播放计划表中的播放计划；
根据接收到的播放计划、与所述播放计划对应的多媒体文件和所述第一校验图像，生成待显示数据，以使显示终端响应于待显示数据进行显示；
接收所述显示终端发送的显示图像，对所述显示图像进行解析，并在解析出所述显示图像中的第二标识图像后，且判断出所述第二标识图像与所述 第一标识图像一致，获取所述第二标识图像对应的第二身份认证信息；
将所述第二身份认证信息与所述第一身份认证信息进行比对，并根据比对结果判断所述显示终端的显示图像是否准确。
在一些示例中，所述根据预先生成的第一标识图像和所述显示终端的配置信息，并通过图像生成算法，生成播放计划的第一校验图像，包括：
根据所述第一身份信息生成第一标识图像；
根据预先生成的透明图的特定区域所对应的像素点数量，对第一标识图像进行处理，得到第一目标标识图像；
对所述第一目标标识图像的各像素点的显示信息进行编码，得到第一编码数据；
将所述第一编码数据替换所述透明图的特定区域内对应的像素点的显示数据，生成第一校验图像。
在一些示例中，在所述根据所述第一身份信息生成第一标识图像之后，还包括：
根据所述显示终端的分辨率信息生成所述透明图；所述透明图的分辨率与所述显示终端的分辨率一致。
在一些示例中，所述透明图具有中间区域和环绕所述中间区域的边缘区域；所述特定区域为所述边缘区域。
在一些示例中，当所述特定区域的像素点数量大于所述第一目标标识图像的像素点数量时，所述将所述第一编码数据替换所述透明图的特定区域内对应的像素点的显示数据，生成第一校验图像，包括：
在将所述第一编码数据替换所述透明图的特定区域内对应的像素点的显示数据的同时，将所述透明图的特定区域中，除与所述第一目标标识图像对应的像素点外的像素点的显示数据，替换为第二编码数据，得到所述第一校验图像。
在一些示例中，对所述显示图像进行解析，以判断所述显示终端的显示 图像是否准确的具体步骤包括：
对所述显示图像进行解析，得到所述显示终端实际显示的标识图像；
对所述实际显示的标识图像进行处理，并根据所述第一标识图像的分辨率信息，得到所述第二标识图像；
将所述第二标识图像与所述第一标识图像进行比对，若二者不一致则显示图像有误；
当所述第二标识图像与所述第一标识图像一致时，根据所述第二标识图像，获取第二身份认证信息；
将所述第二身份认证信息与所述第一身份认证信息进行比对，以确定所述显示图像是否准确。
在一些示例中，所述对所述实际显示的标识图像进行处理，并根据所述第一标识图像的分辨率信息，得到所述第二标识图像，包括：
根据所述透明图的特定区域所对应的像素点数量，对所述实际显示的标识图像进行处理，得到第二目标标识图像；
判断是否存在对所述第二目标标识图像中的各像素点的显示信息编码后的目标编码数据；
当判断出存在对所述第二目标标识图像中的各像素点的显示信息编码后的目标编码数据时，对所述目标编码数据进行解码，得到解码数据；
根据所述第一标识图像的分辨率信息和所述解码数据，生成第二标识图像。
在一些示例中，所述对所述第一目标标识图像的各像素点的显示信息进行编码，得到第一编码数据，包括：
按照第一预设次序依次对所述第一目标标识图像的各像素点的显示信息进行编码，得到第一编码数据；
所述根据所述透明图的特定区域所对应的像素点数量，对所述实际显示的标识图像进行处理，得到第二目标标识图像，包括：
根据所述透明图的特定区域所对应的像素点数量，将所述实际显示的标识图像中的各像素点的显示数据，按照所述第一预设次序依次进行组装，得到第二目标标识图像。
在一些示例中，所述将所述第一编码数据替换所述透明图的特定区域内对应的像素点的显示数据，生成第一校验图像，包括：
将所述第一编码数据按照预设次序依次替换所述透明图的特定区域内对应的像素点的显示数据，生成所述第一校验图像；
所述对所述显示图像进行解析，得到所述显示终端实际显示的标识图像，包括：
为按照所述预设次序，依次提取所述显示图像的特定区域内对应的像素点的显示数据，并根据提取到的显示数据，得到所述显示终端实际显示的标识图像。
在一些示例中，所述播放计划包括各个所述多媒体文件在所述显示终端中的播放窗口信息和播放顺序信息；
所述根据接收到的播放计划、与所述播放计划对应的多媒体文件和所述第一校验图像，生成待显示数据，包括：
根据各个所述多媒体文件在所述显示终端中的展示区域信息和展示顺序信息，以及与所述播放计划对应的多媒体文件和所述第一校验图像，生成所述待显示数据，以使所述显示终端响应于所述待显示数据，以按照各个所述多媒体文件在所述显示终端中的播放窗口信息和播放顺序信息进行显示。
在一些示例中，在对所述显示图像进行分析时，还包括：
当判断出所述显示图像不准确时，向所述显示终端发送取消显示的控制指令，以使所述显示终端取消对所述显示图像的显示，并生成报警信息。
在一些示例中，所述多媒体监播方法还包括：
对所述播放计划中的参数信息进行编码，生成所述第一身份认证信息。
第二方面，本公开实施例还提供了一种多媒体监播系统，其包括校验图 像生成模块、播放控制模块、分析模块和显示终端；其中，
所述校验图像生成模块，被配置为根据预先生成的第一标识图像和所述显示终端的配置信息，并通过图像生成算法，生成播放计划的第一校验图像；所述第一标识图像用于表征第一身份认证信息；所述第一身份认证信息用于表征播放计划表中的播放计划；
所述播放控制模块，被配置为根据接收到的播放计划、与所述播放计划对应的多媒体文件和所述第一校验图像，生成待显示数据；
所述显示终端，被配置为响应于所述待显示数据进行显示，并按照预设频次截取当前所显示的图像，作为显示图像；
所述分析模块，被配置为对所述显示图像进行解析，并在解析出所述显示图像中的第二标识图像后，且判断出所述第二标识图像与所述第一标识图像一致，获取所述第二标识图像对应的第二身份认证信息，并将所述第二身份认证信息与所述第一身份认证信息进行比对，并根据比对结果判断所述显示终端的显示图像是否准确。
第三方面，本公开实施例还提供一种计算机设备，包括：处理器、存储器和总线，所述存储器存储有所述处理器可执行的机器可读指令，当计算机设备运行时，所述处理器与所述存储器之间通过总线通信，所述机器可读指令被所述处理器执行时执行上述第一方面，或第一方面中任一种可能的多媒体监播方法的步骤。
第四方面，本公开实施例还提供一种计算机非瞬态可读存储介质，该计算机非瞬态可读存储介质上存储有计算机程序，该计算机程序被处理器运行时执行上述第一方面，或第一方面中任一种可能的多媒体监播方法的步骤。
第五方面，本公开实施例还提供一种电子设备，包括第二方面所述的多媒体监播系统和显示终端。
附图说明
图1为本公开实施例所提供的一种多媒体监播系统的结构示意图；
图2为本公开实施例提供的校验图像生成模块的处理流程示意图；
图3为本公开实施例提供的第一目标标识图像编码次序的示意图；
图4为本公开实施例提供的第一编码数据替换透明图的替换顺序示意图；
图5为本公开实施例提供的第二标识图像解析单元的处理流程示意图；
图6为本公开实施例提供的显示图像的示意图；
图7为本公开实施例提供的一种多媒体监播方法的流程图；
图8为为本申请实施例提供的计算机设备的结构示意图。
具体实施方式
为使本领域技术人员更好地理解本发明/实用新型的技术方案，下面结合附图和具体实施方式对本发明/实用新型作进一步详细描述。
除非另外定义，本公开使用的技术术语或者科学术语应当为本公开所属领域内具有一般技能的人士所理解的通常意义。本公开中使用的“第一”、“第二”以及类似的词语并不表示任何顺序、数量或者重要性，而只是用来区分不同的组成部分。同样，“一个”、“一”或者“该”等类似词语也不表示数量限制，而是表示存在至少一个。“包括”或者“包含”等类似的词语意指出现该词前面的元件或者物件涵盖出现在该词后面列举的元件或者物件及其等同，而不排除其他元件或者物件。“连接”或者“相连”等类似的词语并非限定于物理的或者机械的连接，而是可以包括电性的连接，不管是直接的还是间接的。“上”、“下”、“左”、“右”等仅用于表示相对位置关系，当被描述对象的绝对位置改变后，则该相对位置关系也可能相应地改变。
第一方面，图1为本公开实施例所提供的一种多媒体监播系统的结构示意图，如图1所示，该多媒体监播系统100被配置为对显示终端101的显示内容进行监控，以提示用户显示终端101的当前显示情况。该多媒体监播系统100包括校验图像生成模块11、播放控制模块12和分析模块13。
校验图像生成模块11被配置为根据预先生成的第一标识图像和显示终 端101的配置信息，并通过图像生成算法，生成播放计划的第一校验图像。其中，第一标识图像是根据第一身份验证信息生成的，并用于表征第一身份认证信息；第一身份认证信息是信息管理模块14根据播放计划表中的播放计划生成的，用于表征播放计划表中的播放计划。播放计划表是根据信息管理模块14利用至少一个播放计划的参数信息生成的。
需要说明的是，一个播放计划对应一个第一身份认证信息，一个第一身份认证信息对应一个第一标识图像，在播放计划表包括多个播放计划的情况下，通过图像生成算法可以分别生成每个播放计划对应的第一校验图像。
在一些示例中，将第一身份认证信息和显示终端101的配置信息作为图像生成算法的输入数据，通过图像生成算法的处理，可以生成播放计划的第一校验图像。
在一些示例中，校验图像生成模块11被配置为将播放计划的第一校验图像发送至分发控制模块，以通过分发控制模块，根据播放计划表，将当前待播放的播放计划、该播放计划的第一校验图像、以及与该播放计划对应的多媒体文件同时发送至播放控制模块12。
播放控制模块12被配置为根据接收到的播放计划、与播放计划对应的多媒体文件和第一校验图像，生成待显示数据，以供显示终端101进行显示。待显示数据具体包括播放计划、与该播放计划对应的多媒体文件和第一校验图像。
播放控制模块12可以通过高清多媒体接口(High Definition Multimedia Interface，HDMI)将待显示数据发送至显示终端101进行显示。
分析模块13被配置为对显示终端101按照预设频次截取的显示图像进行解析，并在解析出第二标识图像后，且判断出第二标识图像与第一标识图像一致，获取第二标识图像对应的第二身份认证信息，并将第二身份认证信息与第一身份认证信息进行比对，并根据比对结果判断显示终端101的显示是否准确。
在本公开实施例中，在不影响多媒体文件的播放内容的情况下，对显示 终端101的播放内容进行及时监控，具体地，通过对显示终端101当前所显示的图像进行截图，并进一步解析显示图像，能够快速监测显示终端101的显示图像是否准确，极大提高了多媒体监播的安全性，相比于传统方案中人工巡点的方式，本公开实施例能够降低多媒体监播的成本，且实时性较高；相比于显示屏外设摄像头进行光学监播的方案，本公开实施例提供的多媒体监播系统100属于系统内置多媒体监播算法，利用后台数据处理，无需外设检测设备即可高效完成多媒体监播。
显示终端101响应于待显示数据进行显示，并按照预设频次截取当前的显示图像，并将显示图像发送至分析模块13。显示终端101可以包括显示屏，用于显示多媒体文件对应的画面。具体地，显示终端101响应于待显示数据，利用显示终端101中的播放卡控制多媒体文件播放，并按照预设频次截取当前显示屏所显示的图像，将该图像作为显示图像用于后续对显示终端101当前播放的多媒体内容的准确性进行及时监控。
图2为本公开实施例提供的校验图像生成模块11的处理流程示意图，如图2所示，校验图像生成模块11包括第一标识图像生成单元、图像处理单元、编码单元和第一校验图像生成单元。
第一标识图像生成单元被配置为根据第一身份认证信息生成第一标识图像。
具体地，第一标识图像生成单元被配置为利用标识生成函数将第一身份认证信息的标识按照特定规律进行排布，并按照特定几何图形生成第一标识图像。
示例性的，标识生成函数可以为二维码生成函数，第一标识图像生成单元被配置为调用二维码生成函数生成一个分辨率为L1*L1的身份信息二维码的图像，该身份信息二维码的图像即为第一标识图像。
本公开实施例中利用身份信息二维码表征第一身份认证信息能够实现对第一身份认证信息的编码保护，增强第一身份认证信息的鲁棒性，也即防止第一身份认证信息在存储和传输过程中被噪声污染而导致信息提取失败。
图像处理单元被配置为根据预先生成的透明图的特定区域所对应的像素点数量，对第一标识图像进行处理，得到第一目标标识图像。
透明图可以是校验图像生成模块11中的透明图生成单元预先生成的。透明图的特定区域可以是预先设置的区域，区域范围可以根据实际应用场景和经验进行限定。透明图具有中间区域和环绕中间区域的边缘区域，特定区域可以包括透明图的边缘区域、或者透明图的顶角区域、或者透明图的非规则形状的设定区域等。
具体地，图像处理单元被配置为根据预先生成的透明图的特定区域所对应的像素点数量，对第一标识图像进行处理，以使得到的第一目标标识图像中像素点的数量小于或等于透明图的特定区域所对应的像素点数量。
以第一标识图像为身份信息二维码对应的图像为例(下述简称为身份信息二维码)，根据预先生成的透明图的特定区域所对应的像素点数量，对身份信息二维码进行缩放，得到具有缩放后身份信息二维码的第一目标标识图像。
例如，身份信息二维码的分辨率信息为L1*L1＝N1个像素点，若身份信息二维码像素点的数量N1大于或等于透明图的特定区域所对应的像素点数量N′，则将该身份信息二维码的分辨率等比缩小为L2*L2，其中，L2*L2＝N2≤N′，且L2为小于或等于
Figure PCTCN2022093467-appb-000001
内的最大的正整数，得到分辨率为L2*L2的第一目标标识图像。若身份信息二维码像素点的数量N1小于或等于透明图的特定区域所对应的像素点数量，则将该身份信息二维码的分辨率等比放大为L2*L2，其中，L2*L2＝N2≤N′，且L2为小于或等于
Figure PCTCN2022093467-appb-000002
内的最大的正整数，得到分辨率为L2*L2的第一目标标识图像。
编码单元被配置为对第一目标标识图像的各像素点的显示信息进行编码，得到第一编码数据。
显示信息包括第一目标标识图像所显示出的颜色的信息，可以包括不同种颜色的信息，例如包括但不仅限于黑色和白色等。编码单元被配置为对第一目标标识图像的各像素点的显示信息进行编码，不同的显示信息可以编码 不同的第一编码数据，例如可以将黑色像素点编码为第一编码子数据(例如为0)，将白色像素点编码为第二编码子数据(例如为1)等。
在一些示例中，编码单元被配置为按照第一预设次序依次对第一目标标识图像的各像素点的显示信息进行编码，得到按照预设顺序排列的第一编码数据。图3为本公开实施例提供的第一目标标识图像编码次序的示意图，如图3所示，第一预设次序可以为图3所示的从左至右，从上至下的顺序依次遍历第一目标标识图像的各像素点，并对各像素点进行编码，并按照预设顺序记录各像素点的第一编码数据。
第一校验图像生成单元被配置为将第一编码数据替换透明图的特定区域内对应的像素点的显示数据，生成第一校验图像。
透明图为单通道的图像，也即具有alpha通道的图像。透明图的特定区域内对应的像素点的显示数据可以是透明图alpha通道的数据。例如，第一校验图像生成单元被配置为将第一编码数据替换透明图的特定区域内对应的像素点的alpha通道的数据，生成具有缩放后身份信息二维码的透明图(也即第一校验图像)。
在一些示例中，第一校验图像生成子单元被配置为将第一编码数据按照第二预设次序依次替换透明图的特定区域内对应的像素点的显示数据，生成第一校验图像。
以透明图的特定区域为边缘区域为例，可以将第一目标标识图像中按照预设顺序记录的各像素点的第一编码数据，按照从左到右，从上到下，从右到左，从下到上的顺序依次替换透明图边缘区域的各像素点的显示数据，生成具有缩放后身份信息二维码的透明图(也即第一校验图像)。图4为本公开实施例提供的第一编码数据替换透明图的替换顺序示意图，如图4所示，按照透明图从上到下，从右到左，从下到上的顺序，将第一目标标识图像中从左到右、从上到下的第一编码数据依次替换为透明图从上到下、从右到左、从下到上、以及从下到上(箭头方向)的各像素点的显示数据。
需要说明的是，本示例中第二预设次序可以不限定为“从左到右，从上 到下，从右到左，从下到上”的顺序，可以根据经验和实际应用场景进行限定，不公开实施例不再一一列举。
为了能够使最终在显示终端101显示出较为规则的画面，当特定区域的像素点数量大于第一目标标识图像的像素点数量时，第一校验图像生成单元被配置为在将第一编码数据替换透明图的特定区域内对应的像素点的显示数据的同时，将透明图的特定区域中，除与第一目标标识图像对应的像素点外的像素点的显示数据，替换为第二编码数据，得到第一校验图像。在一些示例中，第一校验图像生成单元被配置为在将第一编码数据按照第二预设次序依次替换透明图的特定区域内对应的像素点的显示数据的同时，将透明图的特定区域中，除与第一目标标识图像对应的像素点外的像素点的显示数据，继续按照第二预设次序依次替换为第二编码数据，得到第一校验图像。
与第一目标标识图像对应的像素点外的像素点，也即特定区域内N′个像素点中，除了第一目标标识图像内N2的像素点之外的像素点。
由于该第二编码数据在后续不参与显示终端101所显示画面的准确性的判断，因此，第二编码数据可以是随机设置的编码数据，或者也可以是与第一编码数据或第二编码数据相同的数据，对此本公开实施例不进行限定。
在一些示例中，透明图的生成过程，具体地，校验图像生成模块11还包括透明图生成单元；透明图生成单元被配置为根据显示终端101的分辨率信息生成透明图；透明图的分辨率与显示终端101的分辨率一致。
需要说明的是，透明图的分辨率可以与显示终端101的分辨率不一致，例如，透明图的像素点所在位置位于显示终端101中部分像素点所在位置。
如图2所示，分析模块13包括图像解析单元、第二标识图像解析单元、第一比对单元、第二身份认证信息解析单元和第二比对单元。
图像解析单元被配置为对显示图像进行解析，得到显示终端101实际显示的标识图像。
具体地，图像解析单元被配置为按照预先生成的透明图的特定区域所对应的像素点位置范围，提取显示图像与该位置范围对应的各像素点的显示数 据，得到显示终端101实际显示的标识图像。
在一些示例中，在第一校验图像生成单元被配置为将第一编码数据按照第二预设次序依次替换透明图的特定区域内对应的像素点的显示数据，生成第一校验图像的情况下，图像解析单元被配置为按照第二预设次序，依次提取显示图像的特定区域(也即与透明图的特定区域像素点位置范围对应的区域)内对应的像素点的显示数据，并根据提取到的显示数据，得到显示终端101实际显示的标识图像。
在上述第一校验图像生成子单元生成第一校验图像时，以其中透明图的特定区域为边缘区域，且第二预设次序为从左到右，从上到下，从右到左，从下到上的顺序为例，在本示例中，可以按照从左到右，从上到下，从右到左，从下到上的顺序依次提取显示图像的边缘区域内对应的像素点的显示数据，并根据提取到的显示数据，得到显示终端101实际显示的标识图像。
需要说明的是，第一校验图像生成单元利用第一编码数据替换透明图的替换规则(也即按照第二预设次序依次替换的方式)，与图像解析单元提取显示图像像素点的提取规则(也即按照第二预设次序提取的方式)相同。
第二标识图像解析单元被配置为对实际显示的标识图像进行处理，并根据第一标识图像的分辨率信息，得到第二标识图像。
图5为本公开实施例提供的第二标识图像解析单元的处理流程示意图，第二标识图像解析单元包括图像处理子单元、第一判断子单元、解码子单元和第二标识图像生成子单元，通过第二标识图像解析单元的各个子单元对实际显示的标识图像进行处理，具体过程如下：
图像处理子单元被配置为根据透明图的特定区域所对应的像素点数量，对实际显示的标识图像进行处理，得到第二目标标识图像。具体地，图像处理子单元被配置为将实际显示的标识图像中的各像素点的显示数据，按照透明图的特定区域所对应的像素点数量，组装成第二目标标识图像。
例如，实际显示的标识图像中的各像素点的显示数据的数量为N3，透明图的特定区域所对应的像素点数量为N′，且N3＝N′。在组装显示数据的过 程中，满足第二目标标识图像的分辨率L3*L3＝N4≤N′，且L3为小于或等于
Figure PCTCN2022093467-appb-000003
的最大的正整数。
在一些示例中，编码单元被配置为按照第一预设次序依次对第一目标标识图像的各像素点的显示信息进行编码，得到按照预设顺序排列的第一编码数据。在上述图像处理子单元进行数据组装过程中，可以将实际显示的标识图像中的各像素点的显示数据，按照第一预设次序依次进行组装，若第二目标标识图像的分辨率L3*L3＝N4＜N′，将实际显示的标识图像中未被组装的其他像素点的显示数据删除，得到第二目标标识图像。
由于从显示终端101截取到的显示图像可能存在未编码的图像，出现此种情况的原因可能为当期播放的多媒体文件不属于播放计划中的多媒体文件，也即播放内容不准确。或者，也可能是显示终端101播放的多媒体文件为播放计划中的多媒体文件，由于显示终端101硬件问题，导致截取到的显示图像为不完整图像，进而截取到的显示图像可能不存在被编码后的那部分图像。因此，利用第二标识图像解析单元中的第一判断子单元初步校验第二目标标识图像。具体地，第一判断子单元被配置为判断是否存在对第二目标标识图像中的各像素点的显示信息编码后的目标编码数据。若判断出不存在对第二目标标识图像中的各像素点的显示信息编码后的目标编码数据，则显示图像不准确。
当特定区域的像素点数量等于第一目标标识图像的像素点数量时，目标编码数据为第一编码数据；当特定区域的像素点数量等于第一目标标识图像的像素点数量时，目标编码数据包括第一编码数据和第二编码数据。
解码子单元被配置为当判断出存在对第二目标标识图像中的各像素点的显示信息编码后的目标编码数据时，对目标编码数据进行解码，得到解码数据。
不同的目标编码数据可以解码为不同的显示信息(也即解码数据)。例如，将第一编码子数据解码为黑色，将第二编码子数据解码为白色(第一解码子数据)，将第二编码数据解码为黑色(第二解码子数据)等。
第二标识图像生成子单元被配置为根据第一标识图像的分辨率信息和解码数据，生成第二标识图像。
具体地，第二标识图像生成子单元，具体被配置根据第一标识图像的分辨率信息，将解码后具有解码数据的第二目标标识图像进行缩放，以使缩放后的第二标识图像的分辨率L4*L4与第一标识图像的分辨率L1*L1相同。
在第一目标标识图像具有缩放后身份信息二维码、且播放计划正常的情况下，第二目标标识图像具有解码数据对应的二维码。第二标识图像生成子单元被配置为根据第一标识图像的分辨率信息，缩放具有解码数据对应的二维码得到第二标识图像。
这里的缩放方式与上述“对身份信息二维码进行缩放，得到具有缩放后身份信息二维码的第一目标标识图像”的缩放方式相同，若解码后具有解码数据的第二目标标识图像的分辨率L3*L3小于L1*L1，根据第一标识图像的分辨率L1*L1，对该第二目标标识图像进行放大，例如利用插值法填充像素，直到生成的第二标识图像分辨率与第一标识图像分辨率相同。若解码后具有解码数据的第二目标标识图像的分辨率L3*L3大于L1*L1，根据第一标识图像的分辨率L1*L1，对该第二目标标识图像进行缩小，例如剔除部分像素点，直到生成的第二标识图像分辨率与第一标识图像分辨率相同。
第一比对单元被配置为将第二标识图像的类型与第一标识图像的类型进行比对，若二者类型不一致则显示图像有误。
具体地，第一标识图像的类型为二维码，若第二标识图像的类型也为二维码，则确定第二标识图像的类型与第一标识图像的类型一致；若第二标识图像的类型并非为二维码形式的标识图像，则确定第二标识图像的类型与第一标识图像的类型不一致。具体地，第一比对单元被配置为利用二维码读取函数，读取第二标识图像的二维码信息，若读取成功，则表示该第二标识图像为二维码类型的图像，若读取失败，则表示该第二标识图像的类型并非为二维码类型，进而确定显示图像有误。
第二身份认证信息解析单元被配置为当第二标识图像与第一标识图像 一致时，根据第二标识图像，获取第二身份认证信息。
具体地，第二身份认证信息解析单元被配置为当第二标识图像与第一标识图像一致时，利用标识生成反函数将第二标识图像，按照特定规律排布反解析出第二身份认证信息。
标识生成反函数为上述标识生成函数的逆运算函数。以第二标识图像为二维码为例，标识生成函数可以为二维码生成函数，则标识生成反函数为二维码生成函数的逆运算过程，将二维码利用二维码生成函数的逆运算过程反解析为第二身份认证信息。
由于显示终端101当前播放的显示图像可能不是预先设置当前播放计划对应的多媒体内容，可能是此时播放计划的计划播放时间被打乱，显示终端101当前播放的显示图像为播放计划表中的其他播放计划对应的多媒体内容，因此，在分析模块13中设置第二比对单元，第二比对单元被配置为将第二身份认证信息与第一身份认证信息进行比对，以确定显示图像是否准确。
具体地，第二比对单元被配置将第二身份认证信息与第一身份认证信息进行比对，确定二者身份信息相似度，在身份信息相似度大于或等于预设相似度阈值时，确定显示图像是否准确。在身份信息相似度小于预设阈值时，确定显示图像有误。其中，预设相似度阈值可以根据实际应用场景和经验确定，本公开实施例不进行具体限定。
在一些示例中，分析模块13还被配置为当判断出显示图像不准确时，向显示终端101发送取消显示的控制指令，以使显示终端101取消对显示图像的显示，并生成报警信息。
当显示终端101接收到分析模块13发送的取消显示的控制指令时，可以利用播放卡关闭屏幕，并生成报警信息，报警信息可以是以文本的形式显示在屏幕上的；或者，报警信息也可以是以报警提示音进行播放的。
下面以透明图的特定区域为边缘区域、第一标识图像为身份信息二维码为例，对多媒体监播系统100中各个模块进行监播的过程进行详细说明。
第一标识图像生成单元被配置为根据第一身份认证信息生成身份信息二维码。
透明图生成单元被配置为根据显示终端101的分辨率信息生成透明图；透明图的分辨率与显示终端101的分辨率一致。
图像处理单元被配置为根据预先生成的透明图的边缘区域所对应的像素点数量，对身份信息二维码进行处理，得到具有缩放后身份信息二维码的第一目标标识图像。
编码单元被配置为按照从左到右、从上到下(也即第一预设次序)的顺序，依次对第一目标标识图像的各像素点的显示信息进行编码，例如将第一颜色像素(例如黑色)编码为第一编码子数据，将第二颜色像素(例如白色)编码为得到第二编码子数据。第一编码数据包括第一编码子数据和第二编码子数据。
第一校验图像生成单元被配置为将第一编码数据按照“从左至右、从上至下、从右至左、以及从下至上”顺序依次替换透明图的边缘区域内对应的像素点的显示数据，当边缘区域的像素点数量大于第一目标标识图像的像素点数量时，将透明图的边缘区域中，除与第一目标标识图像对应的像素点外的像素点的显示数据，继续按照“从左至右、从上至下、从右至左、以及从下至上”顺序，依次替换为第二编码数据，得到第一校验图像。
播放控制模块12被配置为根据接收到的播放计划、与播放计划对应的多媒体文件和第一校验图像，生成待显示数据。
具体地，显示终端101响应于待显示数据进行显示，并按照预设频次截取当前所显示的图像，作为显示图像。图6为本公开实施例提供的显示图像的示意图。如图6所示，其为按照播放计划正常播放下的显示终端101的显示图像，包括显示终端101的结构边框，显示终端101的屏幕黑边，显示终端101的画面区域，显示终端101中每个像素点和边缘区域。
以透明图的特定区域为边缘区域为例，图像解析单元具体被配置为按照“从左至右、从上至下、从右至左、以及从下至上”顺序，依次提取显示图 像的边缘区域内对应的像素点的显示数据，并根据提取到的显示数据，得到显示终端101实际显示的标识图像。
图像处理子单元被配置为根据透明图的边缘区域所对应的像素点数量，将实际显示的标识图像中的各像素点的显示数据，按照从左到右、从上到下(也即第一预设次序)的顺序依次进行组装，得到第二目标标识图像。
第一判断子单元被配置为判断是否存在对第二目标标识图像中的各像素点的颜色信息编码后的目标编码数据(包括第一编码数据和第二编码数据)。
解码子单元被配置为当判断出存在对第二目标标识图像中的各像素点的颜色信息编码后的目标编码数据时，对目标编码数据进行解码，例如将第一编码子数据解码为第一颜色信息，将第二编码子数据解码为第二颜色信息，将第二编码数据解码为第三颜色信息(第三颜色信息可以为第一颜色信息或第二颜色信息)。解码数据包括第一颜色信息、第二颜色信息和第三颜色信息。
第二标识图像生成子单元被配置为将解码后具有解码数据的第二目标标识图像进行缩放，生成第二标识图像。第二标识图像的分辨率信息与第一标识图像的分辨率信息相同。
第一比对单元被配置为调用二维码读取函数，判断是否能够读取第二标识图像，若读取失败则显示图像有误。
第二身份认证信息解析单元被配置为当第二标识图像读取成功时，根据第二标识图像，获取第二身份认证信息。
第二比对单元被配置为将第二身份认证信息与第一身份认证信息进行比对，以确定显示图像是否准确。
上述以透明图的特定区域为边缘区域、第一标识图像为身份信息二维码为例的示例，由于透明图的特定区域为边缘区域，因此不影响用户观看显示终端101显示的多媒体文件的播放内容，能够显示终端101的播放内容进行及时监控。具体监控过程：通过对显示终端101当前所显示的图像进行截图， 并进一步解析显示图像，能够及时发现播放内容是否按照播放顺序播放，播放内容是否准确的问题，极大提高了多媒体监播的安全性，相比于传统方案中人工巡点的方式，本公开实施例能够降低多媒体监播的成本，且及时性较高；相比于显示屏外设摄像头进行光学监播的方案，本公开实施例提供的多媒体监播系统100属于系统内置多媒体监播算法，利用后台数据处理，无需外设检测设备即可高效完成多媒体监播。
在一些示例中，信息管理模块14被配置为对播放计划中的参数信息进行编码，生成第一身份认证信息。
信息管理模块14可以为互联网web端。
参见表一，播放计划中的参数信息包括播放计划标识、多媒体文件的数量、显示终端101中的播放窗口的类型、播放窗口的数量、各个多媒体文件的标识、各个多媒体文件的类型、用于播放各个多媒体文件的播放窗口的标识、各个多媒体文件的播放顺序、各个多媒体文件循环播放的次数。
表一
Figure PCTCN2022093467-appb-000004
Figure PCTCN2022093467-appb-000005
信息管理模块14被配置为对播放计划表中的参数信息进行编码，参见表一，起始0～3个字节表示播放计划标识，4字节表示多媒体文件的数量，5字节表示显示终端101中的播放窗口的类型，6字节表示播放窗口的数量，7～10字节表示多媒体文件的标识，11字节表示多媒体文件的类型，12字节表示用于播放多媒体文件的播放窗口的标识，13表示多媒体文件的播放顺序，14表示多媒体文件循环播放的次数。如果一个播放计划包括多个待播放的多媒体文件，则继续用后8个字节编码第二个多媒体文件的参数信息，依次类推，一个包含M个多媒体文件的播放计划，共需要7+8M个字节数，其中，前7个字节数表示播放计划的属性，后8M个字节数表示一个多媒体文件的播放信息，M为正整数。
播放窗口的类型可以用数字表示，其中，1表示一个窗口；2表示两个窗口，且横向分布；3表示两个窗口，且纵向分布；4表示三个窗口，一行且横向分布；5表示三个窗口，两行，第一行两个窗口，第二行一个窗口；6表示三个窗口，两行，第一行一个窗口，第二行两个窗口。
多媒体文件的类型包括以下至少一项：视频类型、图像类型、文本类型和音频类型。多媒体文件的类型可以用数字表示，其中，1表示视频类型，即.mp4格式；2表示图像类型，即.jpg格式，.png格式；3表示文件类型，例如.pptx格式、.txt格式；4表示音频格式，即.mp3。
针对上述的播放控制模块12，在一些示例中，播放计划包括各个多媒体文件在显示终端101中的播放窗口信息和播放顺序信息。其中，播放窗口信息包括播放窗口的标识、播放窗口的数量和播放窗口的类型。播放顺序信息包括在一个播放计划中各个多媒体文件的播放顺序。
显示终端101可以包括至少一个播放窗口，每个播放窗口均可以独立执行播放计划，或者，多个播放窗口共同播放一个播放计划指示的多媒体文件。
播放控制模块12，具体被配置为根据各个多媒体文件在显示终端101中的展示区域信息和展示顺序信息，以及与播放计划对应的多媒体文件和第一校验图像，生成待显示数据。显示终端101，具体被配置为响应于待显示数据，以按照各个多媒体文件在显示终端101中的播放窗口信息和播放顺序信息进行显示。
多媒体监播系统100还包括文件分发模块15。分发控制模块被配置为将播放计划和与播放计划对应的多媒体文件发送至播放控制模块12。在一些示例中，分发控制模块被配置为接收信息管理模块14发送的播放计划表，根据播放计划表，按照播放计划中各多媒体文件的播放顺序，将当前待播放的播放计划和与该播放计划对应的多媒体文件同时发送至播放控制模块12。
播放控制模块12在接收到播放计划表和播放计划对应的多媒体文件之后，播放控制模块12被配置为根据播放计划表当前播放计划的参数信息，将播放计划对应的多媒体文件和第一校验图像进行匹配，生成待显示数据。
以参见表一中的播放计划2为例，播放控制模块12生成的待显示数据包括多媒体文件x1、多媒体文件x2、第一校验图像、多媒体文件x1的播放窗口、多媒体文件x2的播放窗口、多媒体文件x1的循环次数和多媒体文件x2的循环次数。显示终端101，具体被配置响应于待显示数据，将多媒体文 件x1(音频)投放到第一行播放窗口进行播放，将多媒体文件x2(视频)投放到第二行播放窗口进行播放。
基于同一发明构思，本公开实施例中还提供了与多媒体监播系统100对应的多媒体监播方法，由于本公开实施例中的多媒体监播方法解决问题的原理与本公开实施例上述多媒体监播系统100相似，因此多媒体监播方法的实施可以参见多媒体监播系统100的实施，重复之处不再赘述。
下面以执行主体为多媒体监播系统100所在平台为例对本公开实施例提供的多媒体监播方法加以说明。
第二方面，图7为本公开实施例提供的一种多媒体监播方法的流程图，如图7所示，该方法包括步骤S1～S4：
S1、根据预先生成的第一标识图像和显示终端101的配置信息，并通过图像生成算法，生成播放计划的第一校验图像；第一标识图像用于表征第一身份认证信息；第一身份认证信息用于表征播放计划表中的播放计划。
在一些示例中，S1可以采用上述实施例中多媒体监播系统100中的校验图像生成模块11实现。
S2、根据接收到的播放计划、与播放计划对应的多媒体文件和第一校验图像，生成待显示数据，以使显示终端101响应于待显示数据进行显示。
在一些示例中，S2可以采用上述实施例中多媒体监播系统100中的播放控制模块12实现。
S3、接收显示终端101发送的显示图像，对显示图像进行解析，并在解析出显示图像中的第二标识图像后，且判断出第二标识图像与第一标识图像一致，获取第二标识图像对应的第二身份认证信息。
S4、将第二身份认证信息与第一身份认证信息进行比对，并根据比对结果判断显示终端101的显示图像是否准确。
在一些示例中，S3和S4可以采用上述实施例中多媒体监播系统100中的分析模块13实现。
本公开实施例，在不影响多媒体文件的播放内容的情况下，对显示终端101的播放内容进行及时监控，具体地，通过对显示终端101当前所显示的图像进行截图，并进一步解析显示图像，能够快速监测显示终端101的显示图像是否准确，极大提高了多媒体监播的安全性，相比于传统方案中人工巡点的方式，本公开实施例能够降低多媒体监播的成本，且及时性较高；相比于显示屏外设摄像头进行光学监播的方案，本公开实施例提供的多媒体监播系统100属于系统内置多媒体监播算法，利用后台数据处理，无需外设检测设备即可高效完成多媒体监播。
为了更清楚本公开实施例的多媒体监播方法，以下给出一种示例性的监播方法。其中，当上述的监播系统中校验图像生成模块11包括第一标识图像生成单元、图像处理单元、透明图生成单元、编码单元和第一校验图像生成单元；分析模块13包括图像解析单元、第二标识图像解析单元、第一比对单元、第二身份认证信息解析单元和第二比对单元时，该方法可以采用多媒体监播系统100实现，下面以透明图的特定区域为边缘区域、第一标识图像为身份信息二维码为例进行说明。该方法具体包括如下步骤：
S101、根据第一身份认证信息生成第一标识图像。
在一些示例中，S101可以采用第一标识图像生成单元实现。具体地，利用标识生成函数将第一身份认证信息的标识按照特定规律进行排布，并按照特定几何图形生成第一标识图像。
示例性的，标识生成函数可以为二维码生成函数，具体地，可以调用二维码生成函数生成一个分辨率为L1*L1的身份信息二维码的图像，该身份信息二维码的图像即为第一标识图像。
本公开实施例中利用身份信息二维码表征第一身份认证信息能够实现对第一身份认证信息的编码保护，增强第一身份认证信息的鲁棒性，也即防止第一身份认证信息在存储和传输过程中被噪声污染而导致信息提取失败。
多媒体监播系统100还包括信息管理模块14。第一身份认证信息可以采用信息管理模块14生成，具体地，对播放计划中的参数信息进行编码， 生成第一身份认证信息。
S102、根据显示终端101的分辨率信息生成透明图；透明图的分辨率与显示终端101的分辨率一致。
在一些示例中，S102可以采用透明图生成单元实现。
透明图具有中间区域和环绕中间区域的边缘区域，特定区域可以包括透明图的边缘区域、或者透明图的顶角区域、或者透明图的非规则形状的设定区域等。
S103、根据预先生成的透明图的特定区域所对应的像素点数量，对第一标识图像进行处理，得到第一目标标识图像。
在一些示例中，该S103可以采用图像处理单元实现。具体地，根据预先生成的透明图的边缘区域所对应的像素点数量，对身份信息二维码进行处理，得到具有缩放后身份信息二维码的第一目标标识图像。
这里，缩放方式可以参照上述图像处理单元的缩放处理过程。例如，身份信息二维码的分辨率信息为L1*L1＝N1个像素点，若身份信息二维码像素点的数量N1大于或等于透明图的特定区域所对应的像素点数量N′，则将该身份信息二维码的分辨率等比缩小为L2*L2，其中，L2*L2＝N2≤N′，且L2为小于或等于
Figure PCTCN2022093467-appb-000006
内的最大的正整数，得到分辨率为L2*L2的第一目标标识图像。若身份信息二维码像素点的数量N1小于或等于透明图的特定区域所对应的像素点数量，则将该身份信息二维码的分辨率等比放大为L2*L2，其中，L2*L2＝N2≤N′，且L2为小于或等于
Figure PCTCN2022093467-appb-000007
内的最大的正整数，得到分辨率为L2*L2的第一目标标识图像。
S104、对第一目标标识图像的各像素点的显示信息进行编码，得到第一编码数据。
显示信息包括第一目标标识图像所显示出的颜色的信息，可以包括不同种颜色的信息，例如包括但不仅限于黑色和白色等。
在一些示例中，该S104可以采用编码单元实现。具体地，对第一目标标识图像的各像素点的显示信息进行编码，不同的显示信息可以编码不同的 第一编码数据，例如可以将黑色像素点编码为第一编码子数据(例如为0)，将白色像素点编码为第二编码子数据(例如为1)等。
在一些示例中，按照从左到右、从上到下(也即第一预设次序)的顺序，依次对第一目标标识图像的各像素点的显示信息进行编码，例如将第一颜色像素(例如黑色)编码为第一编码子数据，将第二颜色像素(例如白色)编码为得到第二编码子数据。第一编码数据包括第一编码子数据和第二编码子数据。
S105、将第一编码数据替换透明图的特定区域内对应的像素点的显示数据，生成第一校验图像。
透明图为单通道的图像，也即具有alpha通道的图像。透明图的特定区域内对应的像素点的显示数据可以是透明图alpha通道的数据。例如，将第一编码数据替换透明图的特定区域内对应的像素点的alpha通道的数据，生成具有缩放后身份信息二维码的透明图(也即第一校验图像)。
在一些示例中，该S105可以采用第一校验图像生成单元实现。
具体实施时，将第一编码数据按照第二预设次序依次替换透明图的特定区域内对应的像素点的显示数据，生成第一校验图像。为了能够使最终在显示终端101显示出较为规则的画面，当特定区域的像素点数量大于第一目标标识图像的像素点数量时，在将第一编码数据替换透明图的特定区域内对应的像素点的显示数据的同时，将透明图的特定区域中，除与第一目标标识图像对应的像素点外的像素点的显示数据，替换为第二编码数据，得到第一校验图像。
与第一目标标识图像对应的像素点外的像素点，也即特定区域内N′个像素点中，除了第一目标标识图像内N2的像素点之外的像素点。
以透明图的特定区域为边缘区域为例，可以将第一目标标识图像中按照预设顺序记录的各像素点的第一编码数据按照“从左至右、从上至下、从右至左、以及从下至上”顺序，依次替换透明图的边缘区域内对应的像素点的显示数据，当边缘区域的像素点数量大于第一目标标识图像的像素点数量 时，将透明图的边缘区域中，除与第一目标标识图像对应的像素点外的像素点的显示数据，继续按照“从左至右、从上至下、从右至左、以及从下至上”顺序，依次替换为第二编码数据，得到第一校验图像。
需要说明的是，本示例中第二预设次序可以不限定为“从左到右，从上到下，从右到左，从下到上”的顺序，可以根据经验和实际应用场景进行限定，不公开实施例不再一一列举。
由于该第二编码数据在后续不参与显示终端101所显示画面的准确性的判断，因此，第二编码数据可以是随机设置的编码数据，或者也可以是与第一编码数据或第二编码数据相同的数据，对此本公开实施例不进行限定。
多媒体监播系统100还包括文件分发模块15，将当前待播放的播放计划和与该播放计划对应的多媒体文件同时发送至播放控制模块12的步骤可以通过文件分发模块15实现。
S106、根据接收到的播放计划、与播放计划对应的多媒体文件和第一校验图像，生成待显示数据。
在一些示例中，该S106可以采用播放控制模块12实现。具体地，根据各个多媒体文件在显示终端101中的展示区域信息和展示顺序信息，以及与播放计划对应的多媒体文件和第一校验图像，生成待显示数据，以使显示终端101按照各个多媒体文件在显示终端101中的播放窗口信息和播放顺序信息进行显示。
显示终端101响应于待显示数据进行显示，并按照预设频次截取当前的显示图像，并将显示图像发送至分析模块13。显示终端101可以包括显示屏，用于显示多媒体文件对应的画面。具体地，显示终端101响应于待显示数据，利用显示终端101中的播放卡控制多媒体文件播放，并按照预设频次截取当前显示屏所显示的图像，将该图像作为显示图像用于后续对显示终端101当前播放的多媒体内容的准确性进行及时监控。
S107、对显示图像进行解析，得到显示终端101实际显示的标识图像。
在一些示例中，该S107可以采用图像解析单元实现。以透明图的特定 区域为边缘区域为例，为按照“从左至右、从上至下、从右至左、以及从下至上”顺序，依次提取显示图像的边缘区域内对应的像素点的显示数据，并根据提取到的显示数据，得到显示终端101实际显示的标识图像。
S108、对实际显示的标识图像进行处理，并根据第一标识图像的分辨率信息，得到第二标识图像。
在一些示例中，该S108可以采用第二标识图像解析单元实现。第二标识图像解析单元包括图像处理子单元、第一判断子单元、解码子单元和第二标识图像生成子单元。S108具体包括如下步骤(S108-1～S108-4)：
S108-1、根据透明图的特定区域所对应的像素点数量，对实际显示的标识图像进行处理，得到第二目标标识图像。
在一些示例中，该S108-1可以采用图像处理子单元实现。具体地，将实际显示的标识图像中的各像素点的显示数据，按照透明图的特定区域所对应的像素点数量，组装成第二目标标识图像。
以透明图的特定区域为边缘区域为例，根据透明图的边缘区域所对应的像素点数量，将实际显示的标识图像中的各像素点的显示数据，按照从左到右、从上到下(也即第一预设次序)的顺序依次进行组装，得到第二目标标识图像。
实际显示的标识图像中的各像素点的显示数据的数量为N3，透明图的特定区域所对应的像素点数量为N′，且N3＝N′。在组装显示数据的过程中，满足第二目标标识图像的分辨率L3*L3＝N4≤N′，且L3为小于或等于
Figure PCTCN2022093467-appb-000008
的最大的正整数。
在一些示例中，按照第一预设次序依次对第一目标标识图像的各像素点的显示信息进行编码，得到按照预设顺序排列的第一编码数据。在上述图像处理子单元进行数据组装过程中，可以将实际显示的标识图像中的各像素点的显示数据，按照第一预设次序依次进行组装，若第二目标标识图像的分辨率L3*L3＝N4＜N′，将实际显示的标识图像中未被组装的其他像素点的显示数据删除，得到第二目标标识图像。
S108-2、判断是否存在对第二目标标识图像中的各像素点的显示信息编码后的目标编码数据。
在一些示例中，该S108-2可以采用第一判断子单元实现。具体地，判断是否存在对第二目标标识图像中的各像素点的颜色信息编码后的目标编码数据(包括第一编码数据和第二编码数据)。若判断出不存在对第二目标标识图像中的各像素点的显示信息编码后的目标编码数据，则显示图像不准确。
S108-3、当判断出存在对第二目标标识图像中的各像素点的显示信息编码后的目标编码数据时，对目标编码数据进行解码，得到解码数据。
在一些示例中，该S108-3可以采用解码子单元实现。
当特定区域的像素点数量等于第一目标标识图像的像素点数量时，目标编码数据为第一编码数据；当特定区域的像素点数量等于第一目标标识图像的像素点数量时，目标编码数据包括第一编码数据和第二编码数据。
具体地，当判断出存在对第二目标标识图像中的各像素点的颜色信息编码后的目标编码数据时，对目标编码数据进行解码，例如将第一编码子数据解码为第一颜色信息，将第二编码子数据解码为第二颜色信息，将第二编码数据解码为第三颜色信息(第三颜色信息可以为第一颜色信息或第二颜色信息)。解码数据包括第一颜色信息、第二颜色信息和第三颜色信息。
S108-4、根据第一标识图像的分辨率信息和解码数据，生成第二标识图像。
在一些示例中，该S108-4可以采用第二标识图像生成子单元实现。具体地，根据第一标识图像的分辨率信息，将解码后具有解码数据的第二目标标识图像进行缩放，以使缩放后的第二标识图像的分辨率L4*L4与第一标识图像的分辨率L1*L1相同。
在第一目标标识图像具有缩放后身份信息二维码、且播放计划正常的情况下，第二目标标识图像具有解码数据对应的二维码。具体地，根据第一标识图像的分辨率信息，缩放具有解码数据对应的二维码得到第二标识图像。
这里的缩放方式与上述“对身份信息二维码进行缩放，得到具有缩放后身份信息二维码的第一目标标识图像”的缩放方式相同，若解码后具有解码数据的第二目标标识图像的分辨率L3*L3小于L1*L1，根据第一标识图像的分辨率L1*L1，对该第二目标标识图像进行放大，例如利用插值法填充像素，直到生成的第二标识图像分辨率与第一标识图像分辨率相同。若解码后具有解码数据的第二目标标识图像的分辨率L3*L3大于L1*L1，根据第一标识图像的分辨率L1*L1，对该第二目标标识图像进行缩小，例如剔除部分像素点，直到生成的第二标识图像分辨率与第一标识图像分辨率相同。
S109、将第二标识图像的类型与第一标识图像的类型进行比对，若二者类型不一致则显示图像有误。
在一些示例中，该S109可以采用第一对比单元实现。具体地，第一标识图像的类型为二维码，若第二标识图像的类型也为二维码，则确定第二标识图像的类型与第一标识图像的类型一致；若第二标识图像的类型并非为二维码形式的标识图像，则确定第二标识图像的类型与第一标识图像的类型不一致。具体地，利用二维码读取函数，读取第二标识图像的二维码信息，若读取成功，则表示该第二标识图像为二维码类型的图像，若读取失败，则表示该第二标识图像的类型并非为二维码类型，进而确定显示图像有误。
S110、当第二标识图像的类型与第一标识图像的类型一致时，根据第二标识图像，获取第二身份认证信息。
在一些示例中，该S110可以采用第二身份认证信息解析单元实现。
具体地，当第二标识图像与第一标识图像一致时，利用标识生成反函数将第二标识图像，按照特定规律排布反解析出第二身份认证信息。
标识生成反函数为上述标识生成函数的逆运算函数。以第二标识图像为二维码为例，标识生成函数可以为二维码生成函数，则标识生成反函数为二维码生成函数的逆运算过程，将二维码利用二维码生成函数的逆运算过程反解析为第二身份认证信息。
S111、将第二身份认证信息与第一身份认证信息进行比对，以确定显示 图像是否准确，若判断显示图像准确，则流程结束；若判断显示图像有误，则执行S112。
在一些示例中，该S111可以采用第二比对单元实现。
具体地，将第二身份认证信息与第一身份认证信息进行比对，确定二者身份信息相似度，在身份信息相似度大于或等于预设相似度阈值时，确定显示图像是否准确。在身份信息相似度小于预设阈值时，确定显示图像有误。其中，预设相似度阈值可以根据实际应用场景和经验确定，本公开实施例不进行具体限定。
S112、当判断出显示图像不准确时，向显示终端101发送取消显示的控制指令，以使显示终端101取消对显示图像的显示，并生成报警信息。
在一些示例中，该S112可以采用第二比对单元实现。
当显示终端101接收到分析模块13发送的取消显示的控制指令时，可以利用播放卡关闭屏幕，并生成报警信息，报警信息可以是以文本的形式显示在屏幕上的；或者，报警信息也可以是以报警提示音进行播放的。
基于同一技术构思，本申请实施例还提供了一种计算机设备。参照图8所示，为本申请实施例提供的计算机设备的结构示意图，包括：
处理器81、存储器82和总线83。其中，存储器82存储有处理器81可执行的机器可读指令，处理器81用于执行存储器82中存储的机器可读指令，所述机器可读指令被处理器81执行时，处理器81执行下述步骤：S1、根据预先生成的第一标识图像和显示终端101的配置信息，并通过图像生成算法，生成播放计划的第一校验图像；第一标识图像用于表征第一身份认证信息；第一身份认证信息用于表征播放计划表中的播放计划。S2、根据接收到的播放计划、与播放计划对应的多媒体文件和第一校验图像，生成待显示数据，以使显示终端101响应于待显示数据进行显示。S3、接收显示终端101发送的显示图像，对显示图像进行解析，并在解析出显示图像中的第二标识图像后，且判断出第二标识图像与第一标识图像一致，获取第二标识图像对应的第二身份认证信息。S4、将第二身份认证信息与第一身份认证信息进行 比对，并根据比对结果判断显示终端101的显示图像是否准确。
上述存储器82包括内存821和外部存储器822；这里的内存821也称内存储器，用于暂时存放处理器81中的运算数据，以及与硬盘等外部存储器822交换的数据，处理器81通过内存821与外部存储器822进行数据交换，当计算机设备运行时，处理器81与存储器82之间通过总线83通信，使得处理器81在执行上述方法实施例中所提及的执行指令。
本公开实施例还提供一种计算机非瞬态可读存储介质，该计算机非瞬态可读存储介质上存储有计算机程序，该计算机程序被处理器运行时执行上述方法实施例中所述的多媒体监播方法的步骤。其中，该存储介质可以是易失性或非易失的计算机非瞬态可读取存储介质。
本公开实施例还提供了一种电子设备，包括上述公开实施例中的多媒体监播系统100和显示终端101。
可以理解的是，以上实施方式仅仅是为了说明本发明/实用新型的原理而采用的示例性实施方式，然而本发明/实用新型并不局限于此。对于本领域内的普通技术人员而言，在不脱离本发明/实用新型的精神和实质的情况下，可以做出各种变型和改进，这些变型和改进也视为本发明/实用新型的保护范围。

Claims (16)

  1. 一种多媒体监播方法，其中，包括：
    根据预先生成的第一标识图像和显示终端的配置信息，并通过图像生成算法，生成播放计划的第一校验图像；所述第一标识图像用于表征第一身份认证信息；所述第一身份认证信息用于表征播放计划表中的播放计划；
    根据接收到的播放计划、与所述播放计划对应的多媒体文件和所述第一校验图像，生成待显示数据，以使显示终端响应于待显示数据进行显示；
    接收所述显示终端发送的显示图像，对所述显示图像进行解析，并在解析出所述显示图像中的第二标识图像后，且判断出所述第二标识图像与所述第一标识图像一致，获取所述第二标识图像对应的第二身份认证信息；
    将所述第二身份认证信息与所述第一身份认证信息进行比对，并根据比对结果判断所述显示终端的显示图像是否准确。
  2. 根据权利要求1所述的多媒体监播方法，其中，所述根据预先生成的第一标识图像和所述显示终端的配置信息，并通过图像生成算法，生成播放计划的第一校验图像，包括：
    根据所述第一身份信息生成第一标识图像；
    根据预先生成的透明图的特定区域所对应的像素点数量，对第一标识图像进行处理，得到第一目标标识图像；
    对所述第一目标标识图像的各像素点的显示信息进行编码，得到第一编码数据；
    将所述第一编码数据替换所述透明图的特定区域内对应的像素点的显示数据，生成第一校验图像。
  3. 根据权利要求2所述的多媒体监播方法，其中，在所述根据所述第一身份信息生成第一标识图像之后，还包括：
    根据所述显示终端的分辨率信息生成所述透明图；所述透明图的分辨率与所述显示终端的分辨率一致。
  4. 根据权利要求2所述的多媒体监播方法，其中，所述透明图具有中间区域和环绕所述中间区域的边缘区域；所述特定区域为所述边缘区域。
  5. 根据权利要求2所述的多媒体监播方法，其中，当所述特定区域的像素点数量大于所述第一目标标识图像的像素点数量时，所述将所述第一编码数据替换所述透明图的特定区域内对应的像素点的显示数据，生成第一校验图像，包括：
    在将所述第一编码数据替换所述透明图的特定区域内对应的像素点的显示数据的同时，将所述透明图的特定区域中，除与所述第一目标标识图像对应的像素点外的像素点的显示数据，替换为第二编码数据，得到所述第一校验图像。
  6. 根据权利要求2所述的多媒体监播方法，其中，对所述显示图像进行解析，以判断所述显示终端的显示图像是否准确的具体步骤包括：
    对所述显示图像进行解析，得到所述显示终端实际显示的标识图像；
    对所述实际显示的标识图像进行处理，并根据所述第一标识图像的分辨率信息，得到所述第二标识图像；
    将所述第二标识图像与所述第一标识图像进行比对，若二者不一致则显示图像有误；
    当所述第二标识图像与所述第一标识图像一致时，根据所述第二标识图像，获取第二身份认证信息；
    将所述第二身份认证信息与所述第一身份认证信息进行比对，以确定所述显示图像是否准确。
  7. 根据权利要求6所述的多媒体监播方法，其中，所述对所述实际显示的标识图像进行处理，并根据所述第一标识图像的分辨率信息，得到所述第二标识图像，包括：
    根据所述透明图的特定区域所对应的像素点数量，对所述实际显示的标识图像进行处理，得到第二目标标识图像；
    判断是否存在对所述第二目标标识图像中的各像素点的显示信息编码后的目标编码数据；
    当判断出存在对所述第二目标标识图像中的各像素点的显示信息编码后的目标编码数据时，对所述目标编码数据进行解码，得到解码数据；
    根据所述第一标识图像的分辨率信息和所述解码数据，生成第二标识图像。
  8. 根据权利要求7所述的多媒体监播方法，其中，所述对所述第一目标标识图像的各像素点的显示信息进行编码，得到第一编码数据，包括：
    按照第一预设次序依次对所述第一目标标识图像的各像素点的显示信息进行编码，得到第一编码数据；
    所述根据所述透明图的特定区域所对应的像素点数量，对所述实际显示的标识图像进行处理，得到第二目标标识图像，包括：
    根据所述透明图的特定区域所对应的像素点数量，将所述实际显示的标识图像中的各像素点的显示数据，按照所述第一预设次序依次进行组装，得到第二目标标识图像。
  9. 根据权利要求6所述的多媒体监播方法，其中，所述将所述第一编码数据替换所述透明图的特定区域内对应的像素点的显示数据，生成第一校验图像，包括：
    将所述第一编码数据按照预设次序依次替换所述透明图的特定区域内对应的像素点的显示数据，生成所述第一校验图像；
    所述对所述显示图像进行解析，得到所述显示终端实际显示的标识图像，包括：
    为按照所述预设次序，依次提取所述显示图像的特定区域内对应的像素点的显示数据，并根据提取到的显示数据，得到所述显示终端实际显示的标识图像。
  10. 根据权利要求1所述的多媒体监播方法，其中，所述播放计划包括 各个所述多媒体文件在所述显示终端中的播放窗口信息和播放顺序信息；
    所述根据接收到的播放计划、与所述播放计划对应的多媒体文件和所述第一校验图像，生成待显示数据，包括：
    根据各个所述多媒体文件在所述显示终端中的展示区域信息和展示顺序信息，以及与所述播放计划对应的多媒体文件和所述第一校验图像，生成所述待显示数据，以使所述显示终端响应于所述待显示数据，以按照各个所述多媒体文件在所述显示终端中的播放窗口信息和播放顺序信息进行显示。
  11. 根据权利要求1所述的多媒体监播方法，其中，在对所述显示图像进行分析时，还包括：
    当判断出所述显示图像不准确时，向所述显示终端发送取消显示的控制指令，以使所述显示终端取消对所述显示图像的显示，并生成报警信息。
  12. 根据权利要求1所述的多媒体监播方法，其中，还包括：
    对所述播放计划中的参数信息进行编码，生成所述第一身份认证信息。
  13. 一种多媒体监播系统，其包括校验图像生成模块、播放控制模块和分析模块，其中，
    所述校验图像生成模块，被配置为根据预先生成的第一标识图像和显示终端的配置信息，并通过图像生成算法，生成播放计划的第一校验图像；所述第一标识图像用于表征第一身份认证信息；所述第一身份认证信息用于表征播放计划表中的播放计划；
    所述播放控制模块，被配置为根据接收到的播放计划、与所述播放计划对应的多媒体文件和所述第一校验图像，生成待显示数据，以供所述显示终端进行显示；
    所述分析模块，被配置为对所述显示终端按照预设频次截取的显示图像进行解析，并在解析出第二标识图像后，且判断出所述第二标识图像与所述第一标识图像一致，获取所述第二标识图像对应的第二身份认证信息，并将所述第二身份认证信息与所述第一身份认证信息进行比对，并根据比对结果判断所述显示终端的显示是否准确。
  14. 一种计算机设备，其特征在于，包括：处理器、存储器和总线，所述存储器存储有所述处理器可执行的机器可读指令，当计算机设备运行时，所述处理器与所述存储器之间通过总线通信，所述机器可读指令被所述处理器执行时执行如权利要求1至12中任一项所述的多媒体监播方法的步骤。
  15. 一种计算机非瞬态可读存储介质，其特征在于，该计算机非瞬态可读存储介质上存储有计算机程序，该计算机程序被处理器运行时执行如权利要求1至12中任一项所述的多媒体监播方法的步骤。
  16. 一种电子设备，其中，包括权利要求13所述的多媒体监播系统和显示终端。
PCT/CN2022/093467 2022-05-18 2022-05-18 多媒体监播方法、系统及电子设备 WO2023220956A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2022/093467 WO2023220956A1 (zh) 2022-05-18 2022-05-18 多媒体监播方法、系统及电子设备
CN202280001247.8A CN117426100A (zh) 2022-05-18 2022-05-18 多媒体监播方法、系统及电子设备

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/093467 WO2023220956A1 (zh) 2022-05-18 2022-05-18 多媒体监播方法、系统及电子设备

Publications (1)

Publication Number Publication Date
WO2023220956A1 true WO2023220956A1 (zh) 2023-11-23

Family

ID=88834465

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/093467 WO2023220956A1 (zh) 2022-05-18 2022-05-18 多媒体监播方法、系统及电子设备

Country Status (2)

Country Link
CN (1) CN117426100A (zh)
WO (1) WO2023220956A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103002338A (zh) * 2012-08-09 2013-03-27 杨世忠 视频智能监播识别系统
CN103731634A (zh) * 2013-12-04 2014-04-16 西安诺瓦电子科技有限公司 媒体监播方法和媒体监播系统
CN103763624A (zh) * 2014-01-27 2014-04-30 北京运轩科技有限公司 一种电视频道节目互动的方法与装置
CN107993087A (zh) * 2017-11-15 2018-05-04 深圳市金立通信设备有限公司 一种数据处理方法、服务器及计算机可读介质
CN108012189A (zh) * 2017-04-13 2018-05-08 广州欢网科技有限责任公司 一种智能电视的直播频道识别方法与系统
CN112148896A (zh) * 2020-09-10 2020-12-29 京东数字科技控股股份有限公司 一种用于终端媒体监播的数据处理方法及装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103002338A (zh) * 2012-08-09 2013-03-27 杨世忠 视频智能监播识别系统
CN103731634A (zh) * 2013-12-04 2014-04-16 西安诺瓦电子科技有限公司 媒体监播方法和媒体监播系统
CN103763624A (zh) * 2014-01-27 2014-04-30 北京运轩科技有限公司 一种电视频道节目互动的方法与装置
CN108012189A (zh) * 2017-04-13 2018-05-08 广州欢网科技有限责任公司 一种智能电视的直播频道识别方法与系统
CN107993087A (zh) * 2017-11-15 2018-05-04 深圳市金立通信设备有限公司 一种数据处理方法、服务器及计算机可读介质
CN112148896A (zh) * 2020-09-10 2020-12-29 京东数字科技控股股份有限公司 一种用于终端媒体监播的数据处理方法及装置

Also Published As

Publication number Publication date
CN117426100A (zh) 2024-01-19

Similar Documents

Publication Publication Date Title
WO2018214693A1 (zh) 视频通信系统的检测方法、装置、存储介质和计算机设备
US9076071B2 (en) Logo recognition
WO2014194825A1 (zh) 移动终端处理可视化图形编码的方法和装置
CN112135140B (zh) 视频清晰度识别方法、电子设备及存储介质
CN111510752B (zh) 数据传输方法、装置、服务器及存储介质
CN110633675A (zh) 一种基于卷积神经网络的视频中火灾识别系统及方法
CN112422909B (zh) 一种基于人工智能的视频行为分析管理系统
WO2023179161A1 (zh) 一种视频帧率控制方法、装置、电子设备及存储介质
CA2788561A1 (en) Method and apparatus for engaging functionality with a color tag
WO2020155486A1 (zh) 人脸识别优化方法、装置、计算机设备和存储介质
WO2023220956A1 (zh) 多媒体监播方法、系统及电子设备
CN112633200A (zh) 基于人工智能的人脸图像比对方法、装置、设备及介质
KR102095968B1 (ko) 영상의 프라이버시 보호 및 변조 방지를 위한 영상 처리 장치, 영상 검증 장치 및 그 방법
Bozkurt et al. Detection and localization of frame duplication using binary image template
CN115761567A (zh) 视频处理方法、装置、电子设备及计算机可读存储介质
Singla et al. HEVC based tampered video database development for forensic investigation
CN108108794B (zh) 一种基于二维码图像隐藏的可视化信息增强方法和系统
CN112203117A (zh) 基于视频编/解码器的视频溯源和防篡改方法
CN116391200A (zh) 缩放不可知水印提取
WO2024045064A1 (zh) 播放内容的监测方法、主机、系统、装置、介质及设备
CN117176979B (zh) 多源异构视频的内容帧提取方法、装置、设备及存储介质
Hadwiger Robust Forensic Analysis of Strongly Compressed Images
WO2024044868A1 (zh) 多媒体监播系统、方法及电子设备
CN116740540B (zh) 一种数据处理方法、装置、设备以及计算机可读存储介质
CN112492333B (zh) 图像生成方法及装置、封面更换方法、介质和设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22941998

Country of ref document: EP

Kind code of ref document: A1