CN113115073B - Image coding method, system, device and medium capable of reducing interference - Google Patents

Abstract

The application relates to an image coding method capable of reducing interference, a system, a video processor and a storage medium, wherein the image coding method capable of reducing interference is used for image synthesis processing of a competition scene and comprises the following steps: acquiring a terminal display frame frequency when a video image is displayed on a terminal display screen; creating a virtual frame template according to the display frame frequency of the terminal; receiving at least two first advertisement frames, and synthesizing the at least two first advertisement frames according to the virtual frame template to obtain virtual frames; the display frame frequency of the virtual frame is equal to the display frame frequency of the terminal; receiving a second advertisement frame, and inserting the virtual frame into the second advertisement frame according to a preset rule to obtain an image display code stream; and transmitting the image display code stream to a terminal display screen for display. The method has the advantages that a plurality of frames of the first advertisement frames are synthesized into the virtual frames through the virtual frame template, then the virtual frame template is inserted into the second advertisement frame, and on the premise that the display frame frequency of the terminal is not changed, the display time of the first advertisement frame is reduced, so that the influence of the insertion of the first advertisement frame on the second advertisement frame can be reduced.

Description

Image coding method, system, device and medium capable of reducing interference

technical field

The present application relates to the field of event broadcasting, and in particular, to an image coding method, system, device and medium that can reduce interference.

Background technique

Advertising sales are the main income for sports events. Under the traditional model, event sponsors buy on-site billboards and display sponsors' brand or product advertisements on the billboards. In this way, a billboard intelligent One sale, limited advertising revenue. Modern events have introduced LED displays, which can achieve multiple advertising sales. Specifically, insert other advertising frames into the advertising frames on the scene, so that the other advertising frames are invisible to the audience, and then use the relay camera to capture other advertising frames, so that multiple sales of a billboard can be realized. Increased advertising revenue for sporting events.

However, when the number of other advertisement frames inserted is large, it will negatively affect the advertisement frames on site, therefore, it is expected to provide a method to reduce the influence of the other advertisement frames inserted on the advertisement frames on site.

SUMMARY OF THE INVENTION

Based on this, it is necessary to provide an image encoding method, system, device and medium that can reduce interference in order to solve the problem that when a large number of other advertisement frames are inserted, it will negatively affect the advertisement frames on site.

A first aspect of the present application provides an image coding method with reduced interference, which is used for image synthesis processing at the event site, including:

Obtain the terminal display frame rate when the video image is displayed on the terminal display screen;

Create a virtual frame template according to the terminal display frame rate;

Receive at least two kinds of first advertisement frames, synthesize at least two kinds of first advertisement frames according to a virtual frame template, and obtain a virtual frame; wherein, the display frame rate of the virtual frame is equal to the terminal display frame rate;

Receive the second advertisement frame, insert the virtual frame into the second advertisement frame according to the preset rule, and obtain the image display code stream;

The image display code stream is sent to the terminal display screen for display.

In one of the embodiments, the at least two first advertisement frames are synthesized according to the virtual frame template to obtain the virtual frame, which specifically includes:

Encoding the first advertisement frame as a whole into a framed data packet;

Pack the framed data into a virtual frame template to obtain a virtual frame.

In one embodiment, within different virtual frames, a plurality of first advertisement frames have the same location distribution.

In one of the embodiments, the virtual frame is inserted into the second advertisement frame according to a preset rule, which specifically includes:

determining a group of second advertisement frames according to the display frame rate of the virtual frame;

Determine the insertion sequence number of the virtual frame, and determine the insertion position of the virtual frame according to the insertion sequence number;

Insert the virtual frame into the determined group of second advertisement frames at the position corresponding to the insertion position.

In one embodiment, the determining of a group of second advertisement frames according to the display frame rate of the virtual frame is specifically:

A cycle number is determined according to the display frame rate of the virtual frame and the number of virtual frames, and then a group of second advertisement frames is determined according to the cycle number, wherein the cycle number is less than the terminal display frame rate.

In one embodiment, before the step of receiving the second advertisement frame and inserting the virtual frame into the second advertisement frame according to a preset rule, the method further includes:

Perform chromaticity value operation on the first advertisement frame to obtain the operation frame corresponding to the first advertisement frame of each frame;

Synthesize at least two operation frames according to the virtual frame template to obtain a virtual operation frame.

The described virtual frame is inserted into the second advertisement frame according to the preset rule, specifically:

The virtual frame and the virtual operation frame are inserted into the second advertisement frame according to preset rules.

In one of the embodiments, in the step of delivering the image display code stream to be displayed on the display screen of the terminal,

When the terminal display screen receives the virtual frame, it analyzes the virtual frame according to the virtual frame template, and obtains the multi-frame first advertisement frame encapsulated in the virtual frame;

The display of the first advertisement frames of the multiple frames is controlled, wherein the display order of the first advertisement frames of the multiple frames is determined according to the distribution of the first advertisement frames in the virtual frame.

A second aspect of the present application provides an image processing system, including a frame rate acquisition component, a template creation component, a synthesis component, an insertion component, and an output component, wherein,

The frame rate acquisition component is used to acquire the terminal display frame rate when the video image is displayed on the terminal display screen;

The template creation component is used to create a virtual frame template according to the terminal display frame rate;

a synthesizing component, configured to receive at least two kinds of first advertisement frames, and synthesize at least two kinds of first advertisement frames according to a virtual frame template to obtain a virtual frame; wherein, the display frame rate of the virtual frame is equal to the terminal display frame rate;

The inserting component is used for receiving the second advertisement frame, inserting the virtual frame into the second advertisement frame according to the preset rule, and obtaining the image display code stream;

The output part is used to deliver the image display code stream to the terminal display screen for display.

According to the image coding method and system for reducing interference according to the embodiments of the present application, multiple frames of the first advertisement frame are synthesized into a virtual frame by using a virtual frame template, and then the virtual frame template is inserted into the second advertisement frame. In this way, it is equivalent to the original Multiple frames of the first advertisement frame share the display time of one virtual frame. Since the display time of the first advertisement frame is reduced without changing the terminal display frame rate, the effect of inserting the first advertisement frame on the second advertisement can be reduced. frame effect.

A third aspect of the present application provides a computer device, comprising: a processor; a memory for storing executable instructions of the processor; the processor is configured to execute any of the above-mentioned executable instructions by executing the executable instructions steps of the method described.

A fourth aspect of the present application provides a machine-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the steps of any one of the above-mentioned methods.

Description of drawings

1 is a schematic structural diagram of an LED display system in the related art;

FIG. 2 is a schematic diagram of the event advertisement broadcasting of the event broadcasting system in the related art;

FIG. 3 is a schematic flowchart of an image coding method with reduced interference according to an embodiment of the present application;

4 is a schematic flowchart of an image coding method with reduced interference according to another embodiment of the present application;

5 is a schematic diagram of a process for synthesizing a first advertisement frame according to a virtual frame template;

FIG. 6 is a schematic flowchart of an image coding method with reduced interference according to another embodiment of the present application;

FIG. 7 is a schematic flowchart of an image coding method with reduced interference according to another embodiment of the present application;

FIG. 8 is a schematic flowchart of an image coding method with reduced interference according to another embodiment of the present application;

FIG. 9 is a frame structure diagram of an image processing system according to an embodiment of the application;

10 is a frame structure diagram of an image processing system according to another embodiment of the application;

FIG. 11 is a frame structure diagram of an image processing system according to another embodiment of the present application.

Detailed ways

In order to facilitate understanding of the present application, the present application will be described more fully below with reference to the related drawings. The preferred embodiments of the present application are shown in the accompanying drawings. However, the present application may be implemented in many different forms and is not limited to the embodiments described herein. Rather, these embodiments are provided so that a thorough and complete understanding of the disclosure of this application is provided.

It should be noted that when an element is referred to as being "fixed to" another element, it can be directly on the other element or intervening elements may also be present. When an element is referred to as being "connected" to another element, it can be directly connected to the other element or intervening elements may also be present. The terms "vertical", "horizontal", "left", "right" and similar expressions used herein are for the purpose of illustration only and do not represent the only embodiment.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the technical field to which this application belongs. The terms used herein in the specification of the present application are for the purpose of describing particular embodiments only, and are not intended to limit the present application. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.

LED display system

Please refer to FIG. 1, the LED display system includes a video source 810, a sending card 820, a receiving card 830 (also called a control card) and a terminal display screen 840. Under the control of the host computer, the video frame stream flows from the video source 810 to the sending card. The video frame is displayed and distributed by the sending card 820, and then sent to the receiving card 830. The receiving card 830 is set on the terminal display screen 840. After receiving the video frame, the receiving card 830 displays at least a part of the video frame on its own video frame. on the loading area. Alternatively, the video frame is directly sent from the sending card 820 to the receiving card 830, the sending card 820 does not perform display allocation, but the receiving card 830 intercepts its own video frame from the video frame when the receiving card 830 receives the complete video frame. The display part corresponding to the loading area is displayed on the display screen 840 of the terminal.

The terminal display screen 840 is commonly referred to as an LED display screen, and includes a plurality of LED boxes 841 , which are formed by splicing a plurality of LED boxes 841 . When the terminal display screen 840 displays one frame of video frame, the complete display of the video frame is completed by the plurality of LED cabinets 841 , that is, each LED cabinet 841 only displays a part of the video frame. Each LED box 841 is correspondingly provided with at least one control card, each control card corresponds to a loading area, and the control card controls the image display of the loading area. For example, when only one control card is set in one LED box 841 , the loading area corresponding to the control card is changed to the LED box 841 . When one LED box 841 is provided with two control cards, the loading area corresponding to each control card is smaller than the display area of the LED box 841 .

A plurality of LED boxes 841 are cascaded with each other through a network cable, so that the plurality of LED boxes 841 can cooperate to complete the display of one frame of video frame. In some of the embodiments, the terminal display screen 840 is provided with an external network interface, and all the LED boxes 841 are cascaded in a manner similar to that in a series circuit in a circuit. In this cascading mode, video frames can be transmitted from the sending card to the external network interface of the terminal display screen, and transmitted along the cascading path. When passing through each control card, the control card obtains the video frame and determines its own Display section. Display assignments can also be made by the sending card. In other embodiments, the terminal display screen is provided with multiple network interfaces, the sending card can send data to multiple external network interfaces respectively, and all the LED boxes 841 are cascaded in parallel in a similar circuit. In this cascading mode, in order to reduce the data bandwidth, the video frame can be sent to each external network interface after display distribution by the sending card, and then each control card only receives the data packet of its own display part, but not the complete data packet. video frame.

The LED box 841 includes a plurality of display modules, each display module constitutes a display unit, and each control card carries at least one display module.

Event broadcast system

The event broadcast system is mainly realized through the LED display system, which is arranged at the event site. According to the image encoding method for reducing interference of advertisements at the event site according to the embodiment of the present application, the pre-processed video frame stream constitutes a video source, and is displayed on the terminal display screen after passing through the sending card and the receiving card. When the video frame stream is displayed on the terminal display screen in sequence, from the audience's point of view, only one type of advertisement is displayed on the terminal display screen, but in fact, a variety of advertisements are mixed, and other advertisements are visually hidden from the live audience.

Referring to FIG. 2 , it is assumed that the on-site visible advertisement frame A is an advertisement frame visible to the live audience, and the hidden advertisement frames B1 and C1 are the advertisement frames that are not visible to the live audience. The advertisement subject corresponding to the on-site visible advertisement frame may be the main sponsor. The main body of the advertisement corresponding to the hidden advertisement frame can be a sub-sponsor, which can advertise in a specific country at a relatively low cost. When the TV station in the specific country broadcasts, only when the terminal display screen displays the hidden advertisement frame B1 or C1, start the broadcast The shutter of the camera captures the live image. For example, if sponsor B2 advertises sponsorship in country B, and sponsor C2 advertises sponsorship in country C, then the TV station of country B opens the shutter of the relay camera when the terminal display screen displays the hidden advertisement frame B1, and the TV station of country C is in When the terminal display screen displays the hidden advertisement frame C1, the shutter of the relay camera is opened. TV stations in different countries open the shutters of the broadcast cameras at different times, thus realizing the broadcast of various hidden advertising frames in different countries.

Please refer to FIG. 3 , which exemplarily shows a flowchart of an image coding method with reduced interference according to an embodiment of the present application. The image coding method that can reduce the interference is used for the image synthesis processing of the event scene. The method includes steps S102 to S108, and the following is a specific description of each step.

S102: Obtain the terminal display frame rate when the video image is displayed on the terminal display screen;

When a group of video frame queues are sent to a display for display, it has a preset display frame rate. Display frame rate refers to the number of video frames displayed per unit time. For example, if 256 video frames are displayed in 1 second, the display frame rate is 256.

In the embodiment of the present application, the terminal display screen is a display device at the event site. For example, it is the LED display of the event broadcasting system mentioned above. The video frame queue obtained after being processed by the interference-reducing image coding method according to the embodiment of the present application is sent to the terminal display screen, and displayed at a preset display frame rate.

Display frame rate can be stored in the host computer or video processor. For example, in some embodiments, the display frame rate is stored in the host computer, and when the host computer sends the video code stream to the video processor, it also sends the display frame rate to the video processor, and the video processor controls the video according to the display frame rate. frame display. In other embodiments, the display frame rate is stored within the video processor. For example, the video processor has preset display frame rate parameters, and after the display frame rate parameters are set, the video frames passing through the video processor are displayed at the display frame rate.

In some embodiments, the terminal display frame rate when the video image is displayed on the terminal display screen is acquired, that is, the terminal display frame rate is acquired from the video processor. Even if the display frame rate is stored in the host computer, during image synthesis, it still needs to be sent from the host computer to the video processor, and then distributed by the video processor to each terminal display screen for display (one video processor may control the display of multiple terminals). screen), therefore, it only needs to go from the video processor to the terminal to display the frame rate.

S104: Create a virtual frame template according to the terminal display frame rate;

After the display frame rate is determined, the video processor can create a virtual frame template according to the display frame rate. The virtual frame template defines a frame frame, and the video frame queue formed by the video frames obtained after processing the virtual frame template has a display frame rate equal to the display frame rate of the terminal. For example, after a group of video frame queues pass through the virtual frame template, the display frame rate is set to 256.

In the embodiment of the present application, the virtual frame template processes at least two video frame queues at the same time, and at least two video frames from the at least two video frame queues are input into the virtual frame template and then synthesized into one virtual frame. That is, a virtual frame includes multiple frames of video frames from different video frame queues. For example, when two video frame queues are delivered to the virtual frame template, the virtual frame template obtains one video frame from each of the two video frame queues, and combines the two video frames into one virtual frame. That is, one virtual frame includes two different video frames from two video frame queues. The virtual frame has the same display frame rate of each terminal.

When the video processor processes the virtual frame, the virtual frame is used as a whole frame for processing. That is to say, the video processor considers the virtual frame to be one video frame and cannot be identified as the multi-frame first advertisement frame.

In a specific embodiment, the virtual frame template includes a frame separator, and the frame separator is used to separate different video frames. In this way, different video frames from different video frame queues are separated by The multi-frame video frames of the video frame queue are combined into one virtual frame.

S106: Receive at least two types of first advertisement frames, synthesize at least two types of first advertisement frames according to a virtual frame template, and obtain virtual frames;

After the video processor creates the virtual frame template, the virtual frame template can be used to synthesize the first advertisement frame. Specifically, the video processor receives multiple frames of the first advertisement frame, and synthesizes the multiple frames of the first advertisement frame into one virtual frame by using a virtual frame template. The first advertisement frame is an advertisement frame sold by other TV stations and invisible to the live audience. After the first advertisement frame is processed by the virtual frame template, a virtual frame is obtained, and the virtual frame is sent to the terminal display screen for decoding to obtain the multi-frame first advertisement frame before synthesis.

There are many kinds of first advertisement frames, which come from different TV stations. One virtual frame template can process multiple first advertisement frames, and use the virtual frame template to synthesize at least two first advertisement frames from different video sources into a virtual frame. In this way, after the first advertisement frames of at least two different video sources are synthesized, a virtual frame queue is obtained. It can be understood that one virtual frame template should not synthesize too many kinds of first advertisement frames, otherwise, the display time of the first advertisement frame is too short, which is not conducive to the capture of the relay camera. Multiple virtual frame templates can be set, so that when the number of types of the first advertisement frame is too large, sufficient processing can be achieved. In a specific embodiment, one virtual frame template corresponds to two types of first advertisement frames, then among the obtained virtual frames, one virtual frame includes two frames of first advertisement frames, and the first advertisement frames come from different first advertisement frames queue. The display frame rate of the virtual frame is equal to the terminal display frame rate.

Referring to Fig. 4, in some embodiments, at least two first advertisement frames are synthesized according to a virtual frame template to obtain a virtual frame, which specifically includes:

S161: Encode the first advertisement frame as a whole into a framed data packet;

S163: Pack the framed data into a virtual frame template to obtain a virtual frame.

When synthesizing the first advertisement frame according to the virtual frame template, after receiving the first advertisement frame, the video processor encodes the first advertisement frame into a framed data packet, and then loads the framed data packet into the data field of the virtual frame template, Different framed data packets (ie, different first advertisement frames) are separated by frame separators, so that two frames of the first advertisement frames are loaded as one virtual frame.

When the virtual frame is sent to the terminal display screen for display, the virtual frame needs to be decoded, the first advertisement frame is decoded from the virtual frame, and then the decoded first advertisement frame is displayed on the terminal display screen. The frame rate of the virtual frame can be defined so that the multiple first advertisement frames decoded from the virtual frame share the display time of the virtual frame, thereby shortening the display time of the first advertisement frame. The display time of the virtual frame, so the display time of the first advertisement frame is shorter than the display time of the virtual frame. The display time of the first advertisement frame is reduced, thereby reducing the interference with the live visible advertisement frame (hereinafter the second advertisement frame). When performing display control on the decoded multi-frame first advertisement frames, the display sequence may be determined according to the distribution of the first advertisement frames in the virtual frame.

For example, referring to FIG. 5, the virtual frame template has two data fields B1, B2, and a frame separator exists between the data fields B1, B2. When synthesizing two first advertisement frames C1 and C2 according to the virtual frame template, the two first advertisement frames C1 and C2 are loaded into the data fields B1 and B2 respectively. Exemplarily, the first advertisement frame C1 is loaded into the data field B1 , the second advertisement frame C2 is loaded into the data field B2. When decoding the virtual frame, it is decoded according to the preset rules. For example, if the data field B1 is decoded first, and then the data field B2 is decoded, the first advertisement frame C1 is decoded first, and can be displayed first when displayed on the terminal display screen. The first advertisement frame C1 is displayed, and then the first advertisement frame C2 is displayed.

In order to make the display of the first advertisement frame of the same type have periodicity and regularity, and it is convenient for the relay camera to capture the first advertisement frame, in different virtual frames, a variety of first advertisement frames have the same position distribution. For example, when synthesizing two first advertisement frames C1 and C2 according to the virtual frame template, the first advertisement frames of the first video source to which the first advertisement frame C1 belongs are loaded into the data field B1, and the first advertisement frame C2 belongs to the first advertisement frame. The first advertisement frames of a video source are loaded into the data field B2.

When the number of first advertisement frames does not match the virtual frame template, for example, there are 11 types of first advertisement frames, and each virtual frame template synthesizes 2 first advertisement frames, then one frame of the first advertisement frame cannot be combined with other first advertisement frames. The advertisement frame is loaded into the virtual frame template, and at this time, the unmatched first advertisement frame and the empty frame are loaded into a virtual frame template.

S108: Receive a second advertisement frame, insert a virtual frame into the second advertisement frame according to a preset rule, and obtain an image display code stream.

The second advertisement frame is a frame displayed on the terminal display screen and visible to the live audience. After receiving the first advertisement frame and the second advertisement frame, the video processor processes the first advertisement frame with a virtual frame template to obtain a virtual frame. Then process the obtained virtual frame and the second advertisement frame, insert the virtual frame into the second advertisement frame, and finally, transmit the second advertisement frame (ie, the image display code stream) after inserting the virtual frame to the terminal display screen show.

It can be understood that when multiple virtual frame templates are set, multiple virtual frames obtained from the multiple virtual frame templates are inserted into the second advertisement frame. Insert directly into the second ad frame without frame rate adjustments.

Please refer to FIG. 6, in some embodiments, the virtual frame is inserted into the second advertisement frame according to a preset rule, which specifically includes:

S182: Determine a group of second advertisement frames according to the display frame rate of the virtual frame;

S184: Determine the insertion sequence number of the virtual frame, and determine the insertion position of the virtual frame according to the insertion sequence number;

S186: Insert the virtual frame into the determined group of second advertisement frames at a position corresponding to the insertion position.

When inserting the virtual frame into the second advertisement frame, in order to facilitate the capture of the rebroadcast camera, periodic insertion can be implemented. Therefore, a period number can be determined according to the display frame rate of the virtual frame and the number of virtual frames, and then according to the number of periods A set of second advertisement frames is determined. The number of cycles is less than the terminal display frame rate.

For example, if the display frame rate of the virtual frame is 256, and the number of cycles may be determined as 256, the second advertisement frame queue after the virtual frame is inserted may include 256 video frames. If there are two virtual frame templates, and both virtual frame templates perform the synthesis processing of the first advertisement frame, then there are two virtual frames, and the corresponding first advertisement frame has 4 frames, then, the 256 video frames include two frame dummy frame and 252 frame second ad frame. Therefore, the determined set of second advertisement frames includes 252 frames of second advertisement frames, and two virtual frames are inserted into the 252 frames of second advertisement frames. In the foregoing example, the sum of the frame number of the second advertisement frame and the frame number of the first advertisement frame in the virtual frame is equal to the display frame rate, that is, the number of cycles is equal to the display frame rate, but it is not limited in practice. If the number of cycles is equal to the display frame rate setting, the broadcast camera only captures one frame of the first advertisement frame within 1 second, which is obviously not conducive to broadcast. Therefore, in order to capture more first advertisement frames, the number of cycles can be much smaller than the display frame rate. frame rate.

The insertion sequence number defines the insertion position of the virtual frame within a group of second advertisement frames, and can be pre-stored in the video processor. For example, in some embodiments, the insertion sequence number is associated with the virtual frame template. When creating a virtual frame template, an insertion sequence number is assigned to each virtual frame template. When a virtual frame is obtained from the virtual frame template, the virtual frame The insertion sequence number is determined, so different virtual frames correspond to different insertion positions.

When a group of second advertisement frames is determined, and the insertion position of each virtual frame in the group of second advertisement frames is determined, the virtual frame can be inserted into the corresponding position according to the insertion sequence number.

After the insertion is completed, the video processor can obtain the broadcast sequence of various first advertisement frames according to the video frame queue obtained after insertion. The event broadcast system generates the broadcast signal according to the broadcast sequence, and sends the broadcast signal to the broadcast camera. Determine when to open the shutter according to the broadcast signal, so as to capture the first advertisement frame sold by the own TV station from the display screen of the terminal. The broadcasting sequence of various first advertisement frames may also be pre-stored in the event broadcasting system. For example, the insertion sequence number of each first advertisement frame may be determined according to the pre-stored broadcasting sequence. Before generating the rebroadcast signal according to the rebroadcast sequence, the rebroadcast sequence fed back by the video processor can be compared with the pre-stored rebroadcast sequence, and after the verification is correct, the rebroadcast signal is generated and sent to the rebroadcast camera.

Please refer to Fig. 7, in some embodiments, before step S108, also include:

S172: Perform chromaticity value operation on the first advertisement frame to obtain the operation frame corresponding to the first advertisement frame of each frame;

S174: Synthesize at least two operation frames according to the virtual frame template to obtain a virtual operation frame.

In step 108, the virtual frame is inserted into the second advertisement frame according to the preset rule, specifically:

The virtual frame and the virtual operation frame are inserted into the second advertisement frame according to preset rules.

When the image display code stream is sent to the terminal display screen for display, the image display code stream includes a virtual frame and a second advertisement frame. The virtual frame is decoded into the first advertisement frame on the terminal display screen, and the number of the second advertisement frame is much more than that of the first advertisement frame. Advertising frame. However, because the first advertisement frame also has a certain number, and the image difference between the first advertisement frame and the second advertisement frame is large, and the chromaticity value is greatly different, it will have a certain impact on the display of the second advertisement frame. The greater the number, the greater the impact. In order to reduce this influence, the chromaticity value operation can be performed based on the first advertisement frame to obtain the operation frame, and the operation frame and the corresponding first advertisement frame are superimposed and displayed on the display as pure white. Therefore, as long as the operation frame and the corresponding first advertisement frame are displayed successively in a very short period of time, the interference caused by the first advertisement frame corresponding to the operation frame to the second advertisement frame can be reduced through the operation frame. Each frame corresponds to one operation frame, so that the interference of all the first advertisement frames can be reduced. Of course, in order to reduce the number of other video frames inserted into the second advertisement frame, only part of the operation frames corresponding to the second advertisement frame may be inserted into the second advertisement frame.

It can be understood that the process of synthesizing the virtual operation frame according to the virtual frame template is basically the same as the process of synthesizing the virtual frame. When finally displayed on the terminal display screen, the operation frame is decoded to obtain the operation frame and then displayed.

The process of synthesizing the operation frame according to the virtual frame template can be adapted to the process of synthesizing the first advertisement frame according to the virtual frame template. Frames are also composited into a virtual arithmetic frame.

The insertion of the virtual operation frame may be randomly inserted into a certain group of second advertisement frames without inserting a serial number, as long as the operation frame can be ensured to reduce the influence of the first advertisement frame. Computational frames are not captured by the broadcast camera.

Please refer to Fig. 8, in some embodiments, can also include steps:

S110: Send the image display code stream to the terminal display screen for display.

The virtual frame is inserted into the second advertisement frame to obtain an image display code stream, the image display code stream includes the virtual frame and the second advertisement frame, and the virtual frame and the second advertisement frame are sent to the terminal display screen.

During delivery, the virtual frame is delivered to the terminal display screen as one frame, that is, the first advertisement frames of multiple frames within the virtual frame are simultaneously delivered to the terminal display screen.

When receiving the second advertisement frame, the terminal display screen directly displays the second advertisement frame. When the terminal display screen receives the virtual frame, the virtual frame is first decoded to obtain the multi-frame first advertisement frame, and then the multi-frame first advertisement frame is successively displayed on the terminal display screen. Specifically, after receiving the virtual frame, the control card of the terminal display screen parses the virtual frame according to the virtual frame template, and obtains the multi-frame first advertisement frame encapsulated in the virtual frame. Then, the control card controls the display of the first advertisement frame of the multiple frames.

The display sequence of the first advertisement frames of the multiple frames may be determined according to the distribution of the first advertisement frames in the virtual frame. Specifically, it can be displayed according to the aforementioned decoding order. Alternatively, the data fields in the virtual frame are prioritized, and the decoded first advertisement frame is displayed on the display screen of the terminal according to the priority order of the data fields.

According to the image coding method for reducing interference according to the embodiment of the present application, multiple frames of the first advertisement frame are synthesized into a virtual frame by using a virtual frame template, and then the virtual frame template is inserted into the second advertisement frame. In this way, it is equivalent to the original multiple frames. The first advertisement frame shares the display time of a virtual frame. Since the display time of the first advertisement frame is reduced without changing the terminal display frame rate, the insertion time of the first advertisement frame to the second advertisement frame can be reduced. influences.

It should be noted that, for the sake of simple description, the method embodiments are described as a series of action combinations, but those skilled in the art should know that the embodiments of the present invention are not limited by the described action sequences, because According to embodiments of the present invention, certain steps may be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

Referring to FIG. 9, the present application further provides an image processing system 10, including a frame rate acquisition unit 110, a template creation unit 120, a synthesis unit 130, an insertion unit 140, and an output unit 150, wherein,

a frame rate acquiring component 110, configured to acquire the terminal display frame rate when the video image is displayed on the terminal display screen;

a template creation component 120, configured to create a virtual frame template according to the terminal display frame rate;

The synthesizing component 130 is configured to receive at least two kinds of first advertisement frames, and synthesize at least two kinds of first advertisement frames according to a virtual frame template to obtain a virtual frame; wherein, the display frame rate of the virtual frame is equal to the terminal display frame rate;

The virtual frame template processes at least two video frame queues at the same time, and at least two video frames from the at least two video frame queues are input into the virtual frame template and then synthesized into one virtual frame. That is, a virtual frame includes multiple frames of video frames from different video frame queues. For example, when two video frame queues are delivered to the virtual frame template, the virtual frame template obtains one video frame from each of the two video frame queues, and combines the two video frames into one virtual frame. In the synthesized virtual frames, in different virtual frames, various first advertisement frames have the same position distribution.

The inserting part 140 is used for receiving the second advertisement frame, inserting the virtual frame into the second advertisement frame according to the preset rule, and obtaining the image display code stream;

The output component 150 is used for delivering the image display code stream to the terminal display screen for display.

Referring to FIG. 10, in one or more embodiments, the synthesis component 130 includes:

an encoding component 131, configured to encode the first advertisement frame as a whole into a framed data packet;

The loading component 133 is used to package the framed data into a virtual frame template to obtain a virtual frame.

When synthesizing the first advertisement frame according to the virtual frame template, after receiving the first advertisement frame, the video processor encodes the first advertisement frame into a framed data packet, and then loads the framed data packet into the data field of the virtual frame template, Different framed data packets (ie, different first advertisement frames) are separated by frame separators, so that two frames of the first advertisement frames are loaded as one virtual frame.

Referring to Figure 10, in one or more embodiments, the insert member 140 includes:

The group number determination component 141 is used to determine a group of second advertisement frames according to the display frame rate of the virtual frame; specifically, the group number determination component 141 determines a cycle number according to the display frame rate of the virtual frame and the number of virtual frames, and then according to The number of cycles determines a group of second advertisement frames, wherein the number of cycles is less than the terminal display frame rate.

Insertion determining component 143, for determining the insertion sequence number of the virtual frame, and determining the insertion position of the virtual frame according to the insertion sequence number;

The insertion execution component 145 is used for inserting the virtual frame into the determined group of second advertisement frames at a position corresponding to the insertion position.

Referring to Figure 11, in one or more embodiments, it also includes:

The operation part 160 is used for performing chromaticity value operation on the first advertisement frame to obtain the operation frame corresponding to the first advertisement frame of each frame;

The synthesizing component 130 is further configured to synthesize at least two operation frames according to the virtual frame template to obtain a virtual operation frame.

When inserting the dummy frame into the second advertisement frame, the inserting part 140 inserts the dummy operation frame into the second advertisement frame at the same time. The insertion of virtual operation frames may be random insertion.

When the image display code stream is sent to the terminal display screen for display, when the terminal display screen receives the virtual frame, it parses the virtual frame according to the virtual frame template, and obtains the multi-frame first advertisement frame encapsulated in the virtual frame; then control the multi-frame The display of the first advertisement frame, wherein the display sequence of the multiple frames of the first advertisement frame may be determined according to the distribution of the first advertisement frame in the virtual frame.

An embodiment of the present application further provides a machine-readable storage medium on which a computer program is stored, wherein the computer program implements the method described in any of the foregoing embodiments when executed by a processor.

The integrated components/modules/units of the system/computer device, if implemented in the form of software functional units and sold or used as independent products, may be stored in a computer-readable storage medium. Based on this understanding, the present application can implement all or part of the processes in the methods of the above embodiments, and can also be completed by instructing relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, and the When the computer program is executed by the processor, the steps of the above-mentioned various method embodiments can be implemented. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate form, and the like. The computer-readable storage medium may include: any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a removable hard disk, a magnetic disk, an optical disc, a computer memory, a read-only memory (ROM, Read-Only Memory) , Random Access Memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the computer-readable media may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, the computer-readable media Electric carrier signals and telecommunication signals are not included.

The present application also provides a computer device, comprising: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured to perform any of the above implementations by executing the executable instructions method described in the example. The computer device may be a video processor.

In the several specific embodiments provided in this application, it should be understood that the disclosed system and method may be implemented in other manners. For example, the system implementations described above are only illustrative. For example, the division of the components is only a logical function division, and there may be other division manners in actual implementation.

In addition, each functional module/component in each embodiment of the present application may be integrated in the same processing module/component, or each module/component may exist physically alone, or two or more modules/components may be integrated in the same processing module/component. in the module/component. The above-mentioned integrated modules/components may be implemented in the form of hardware, or may be implemented in the form of hardware plus software function modules/components.

For those skilled in the art, it is obvious that the embodiments of the present application are not limited to the details of the above-mentioned exemplary embodiments, and can be implemented in other specific forms without departing from the spirit or essential features of the embodiments of the present application. example. Accordingly, the embodiments should be considered in all respects to be exemplary rather than restrictive, and the scope of the embodiments of the present application is defined by the appended claims rather than the foregoing description, and is therefore intended to fall within the scope of All changes within the meaning and scope of equivalents of the claims are included in the embodiments of the present application. Any reference signs in the claims shall not be construed as limiting the involved claim. Furthermore, it is clear that the word "comprising" does not exclude other units or steps and the singular does not exclude the plural. Multiple units, modules or means recited in the system, device or terminal claims can also be implemented by the same unit, module or means by software or hardware. The terms first, second, etc. are used to denote names and do not denote any particular order.

The above-mentioned embodiments only represent several embodiments of the present application, and the descriptions thereof are specific and detailed, but should not be construed as a limitation on the scope of the invention patent. It should be pointed out that for those skilled in the art, without departing from the concept of the present application, several modifications and improvements can be made, which all belong to the protection scope of the present application. Therefore, the scope of protection of the patent of the present application shall be subject to the appended claims.

Claims (10)

1. a kind of image coding method that can reduce interference, is used for the image synthesis processing of event site, it is characterised in that comprising: Obtain the terminal display frame rate when the video image is displayed on the terminal display screen; Create a virtual frame template according to the terminal display frame rate; Receive at least two kinds of first advertisement frames, synthesize at least two kinds of first advertisement frames according to a virtual frame template, and obtain a virtual frame; wherein, the display frame rate of the virtual frame is equal to the terminal display frame rate; Receive the second advertisement frame, insert the virtual frame into the second advertisement frame according to the preset rule, and obtain the image display code stream; The image display code stream is sent to the terminal display screen for display. 2. the image coding method of reducing interference according to claim 1, is characterized in that, described according to virtual frame template synthesizing at least two frames of first advertisement frame, obtains virtual frame, specifically comprises: Encoding the first advertisement frame as a whole into a framed data packet; Pack the framed data into a virtual frame template to obtain a virtual frame. 3 . The image coding method with reduced interference according to claim 1 , wherein, within different virtual frames, a plurality of first advertisement frames have the same location distribution. 4 . 4. The image coding method that can reduce interference according to claim 1, is characterized in that, described virtual frame is inserted in the second advertisement frame according to preset rule, specifically comprises: determining a group of second advertisement frames according to the display frame rate of the virtual frame; Determine the insertion sequence number of the virtual frame, and determine the insertion position of the virtual frame according to the insertion sequence number; Insert the virtual frame into the determined group of second advertisement frames at the position corresponding to the insertion position. 5. The image coding method for reducing interference according to claim 4, wherein the determining a group of second advertisement frames according to the display frame frequency of the virtual frame is specifically: A cycle number is determined according to the display frame rate of the virtual frame and the number of virtual frames, and then a group of second advertisement frames is determined according to the cycle number, wherein the cycle number is less than the terminal display frame rate. 6 . The image coding method for reducing interference according to claim 4 , wherein before the step of receiving the second advertisement frame and inserting the virtual frame into the second advertisement frame according to a preset rule, the method further comprises: 7 . : Perform chromaticity value operation on the first advertisement frame to obtain the operation frame corresponding to the first advertisement frame of each frame; Synthesize at least two operation frames according to the virtual frame template to obtain a virtual operation frame; The described virtual frame is inserted into the second advertisement frame according to the preset rule, specifically: The virtual frame and the virtual operation frame are inserted into the second advertisement frame according to preset rules. 7. The image encoding method with reduced interference according to claim 1, wherein, in the step of delivering the image display code stream to display on the terminal display screen, When the terminal display screen receives the virtual frame, it analyzes the virtual frame according to the virtual frame template, and obtains the multi-frame first advertisement frame encapsulated in the virtual frame; The display of the first advertisement frames of the multiple frames is controlled, wherein the display order of the first advertisement frames of the multiple frames is determined according to the distribution of the first advertisement frames in the virtual frame. 8. An image processing system, characterized in that it comprises a frame rate acquisition part, a template creation part, a synthesis part, an insertion part and an output part, wherein, The frame rate acquisition component is used to acquire the terminal display frame rate when the video image is displayed on the terminal display screen; The template creation component is used to create a virtual frame template according to the terminal display frame rate; a synthesizing component, configured to receive at least two kinds of first advertisement frames, and synthesize at least two kinds of first advertisement frames according to a virtual frame template to obtain a virtual frame; wherein, the display frame rate of the virtual frame is equal to the terminal display frame rate; The inserting component is used for receiving the second advertisement frame, inserting the virtual frame into the second advertisement frame according to the preset rule, and obtaining the image display code stream; The output part is used to deliver the image display code stream to the terminal display screen for display. 9. A computer device comprising: a processor; a memory for storing executable instructions of the processor; characterized in that the processor is configured to execute claims 1- via executing the executable instructions 7 the steps of any one of the methods. 10 . A machine-readable storage medium on which a computer program is stored, wherein the computer program, when executed by a processor, implements the steps of any one of the methods of claims 1 to 7 .

Images