CN113115073B - Image coding method, system, device and medium capable of reducing interference - Google Patents
Image coding method, system, device and medium capable of reducing interference Download PDFInfo
- Publication number
- CN113115073B CN113115073B CN202110388698.9A CN202110388698A CN113115073B CN 113115073 B CN113115073 B CN 113115073B CN 202110388698 A CN202110388698 A CN 202110388698A CN 113115073 B CN113115073 B CN 113115073B
- Authority
- CN
- China
- Prior art keywords
- frame
- advertisement
- virtual
- frames
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000003780 insertion Methods 0.000 claims abstract description 33
- 230000037431 insertion Effects 0.000 claims abstract description 33
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 20
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 13
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 13
- 238000009432 framing Methods 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 10
- 238000010586 diagram Methods 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/458—Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application relates to an image coding method capable of reducing interference, a system, a video processor and a storage medium, wherein the image coding method capable of reducing interference is used for image synthesis processing of a competition scene and comprises the following steps: acquiring a terminal display frame frequency when a video image is displayed on a terminal display screen; creating a virtual frame template according to the display frame frequency of the terminal; receiving at least two first advertisement frames, and synthesizing the at least two first advertisement frames according to the virtual frame template to obtain virtual frames; the display frame frequency of the virtual frame is equal to the display frame frequency of the terminal; receiving a second advertisement frame, and inserting the virtual frame into the second advertisement frame according to a preset rule to obtain an image display code stream; and transmitting the image display code stream to a terminal display screen for display. The method has the advantages that a plurality of frames of the first advertisement frames are synthesized into the virtual frames through the virtual frame template, then the virtual frame template is inserted into the second advertisement frame, and on the premise that the display frame frequency of the terminal is not changed, the display time of the first advertisement frame is reduced, so that the influence of the insertion of the first advertisement frame on the second advertisement frame can be reduced.
Description
Technical Field
The present application relates to the field of event relay, and in particular, to an image encoding method, system, device, and medium capable of reducing interference.
Background
Advertisement selling is the main income of sports events for the sports events, and under the traditional mode, the event sponsor buys the on-the-spot bill-board, shows sponsor's brand or product advertisement on the bill-board, and in this way, a bill-board intelligence is sold once, and advertising income is limited. Modern events introduce LED display screens, which can realize multiple advertisement sales. Specifically, other advertisement frames are inserted into the advertisement frames on the spot, so that the other advertisement frames are invisible to the audience on the spot, and then the rebroadcasting camera is used for capturing the other advertisement frames, so that the multiple selling of one billboard can be realized, and the advertisement income of sports events is increased.
However, when the number of inserted other advertisement frames is large, there is a negative influence on the advertisement frames in the field, and therefore, it is expected to provide a method of reducing the influence of the inserted other advertisement frames on the advertisement frames in the field.
Disclosure of Invention
Based on this, it is necessary to provide an image encoding method, system, device and medium capable of reducing interference, aiming at the problem that when the number of inserted other advertisement frames is large, the advertisement frames in the scene are negatively affected.
The first aspect of the present application provides an image encoding method capable of reducing interference, which is used for image synthesis processing at a scene of an event, and includes:
acquiring a terminal display frame frequency when a video image is displayed on a terminal display screen;
creating a virtual frame template according to the display frame frequency of the terminal;
receiving at least two kinds of first advertisement frames, and synthesizing the at least two kinds of first advertisement frames according to a virtual frame template to obtain virtual frames; the display frame frequency of the virtual frame is equal to the display frame frequency of the terminal;
receiving a second advertisement frame, and inserting the virtual frame into the second advertisement frame according to a preset rule to obtain an image display code stream;
and transmitting the image display code stream to a terminal display screen for display.
In one embodiment, the synthesizing at least two first advertisement frames according to the virtual frame template to obtain a virtual frame specifically includes:
integrally encoding the first advertisement frame into a framing data packet;
and loading the framing data packet into a virtual frame template to obtain a virtual frame.
In one embodiment, the plurality of first advertisement frames have the same position distribution within different virtual frames.
In one embodiment, the inserting the virtual frame into the second advertisement frame according to a preset rule specifically includes:
determining a group of second advertisement frames according to the display frame frequency of the virtual frames;
determining an insertion sequence number of the virtual frame, and determining the insertion position of the virtual frame according to the insertion sequence number;
and inserting the virtual frame into the determined group of second advertisement frames and the position corresponding to the inserting position.
In one embodiment, the determining a group of second advertisement frames according to the display frame rate of the virtual frame specifically includes:
and determining a period number according to the display frame frequency of the virtual frames and the number of the virtual frames, and determining a group of second advertisement frames according to the period number, wherein the period number is less than the terminal display frame frequency.
In one embodiment, before the step of receiving the second advertisement frame and inserting the virtual frame into the second advertisement frame according to a preset rule, the method further includes:
carrying out chromatic value operation on the first advertisement frame to obtain an operation frame corresponding to each frame of the first advertisement frame;
and synthesizing at least two frames of operation frames according to the virtual frame template to obtain a virtual operation frame.
The inserting the virtual frame into the second advertisement frame according to a preset rule specifically comprises:
and inserting the virtual frame and the virtual operation frame into the second advertisement frame according to a preset rule.
In one embodiment, in the step of transmitting the image display code stream to the terminal display screen for display,
when the terminal display screen receives the virtual frame, analyzing the virtual frame according to the virtual frame template to obtain a plurality of frames of first advertisement frames encapsulated in the virtual frame;
controlling display of a first advertisement frame of the plurality of frames, wherein the display of the first advertisement frame of the plurality of frames determines a display order according to a distribution of the first advertisement frame within the virtual frame.
A second aspect of the present application provides an image processing system comprising a frame rate acquisition section, a template creation section, a synthesis section, an insertion section, and an output section, wherein,
a frame frequency acquiring part for acquiring a terminal display frame frequency when the video image is displayed on a terminal display screen;
a template creating component for creating a virtual frame template according to a terminal display frame frequency;
the synthesis component is used for receiving the at least two first advertisement frames and synthesizing the at least two first advertisement frames according to the virtual frame template to obtain virtual frames; the display frame frequency of the virtual frame is equal to the display frame frequency of the terminal;
the inserting component is used for receiving the second advertisement frame and inserting the virtual frame into the second advertisement frame according to a preset rule to obtain an image display code stream;
and the output component is used for transmitting the image display code stream to a terminal display screen for display.
According to the image coding method and system capable of reducing interference, the first advertisement frames of the multiple frames are synthesized into the virtual frame through the virtual frame template, and then the virtual frame template is inserted into the second advertisement frame, so that the display time of one virtual frame is shared by the first advertisement frames of the multiple frames, and the display time of the first advertisement frame is reduced on the premise that the display frame frequency of the terminal is not changed, so that the influence of the insertion of the first advertisement frame on the second advertisement frame can be reduced.
A third aspect of the present application provides a computer device comprising: a processor; a memory for storing executable instructions of the processor; the processor is configured to perform the steps of any of the methods described above via execution of the executable instructions.
A fourth aspect of the present application provides a machine-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of any of the methods described above.
Drawings
FIG. 1 is a schematic diagram of a related art LED display system;
FIG. 2 is a schematic diagram of an event advertisement rebroadcasting system of the related art;
fig. 3 is a flowchart illustrating an interference-reducing image encoding method according to an embodiment of the present disclosure;
fig. 4 is a flowchart illustrating an interference reduction image encoding method according to another embodiment of the present application;
FIG. 5 is a schematic diagram of a process for synthesizing a first advertisement frame based on a virtual frame template;
FIG. 6 is a flowchart illustrating an interference reduction image encoding method according to another embodiment of the present application;
FIG. 7 is a flowchart illustrating an interference reduction image encoding method according to another embodiment of the present application;
FIG. 8 is a flowchart illustrating an interference reduction image encoding method according to another embodiment of the present application;
FIG. 9 is a block diagram of a framework of an image processing system according to an embodiment of the present application;
FIG. 10 is a block diagram of a frame of an image processing system according to another embodiment of the present application;
fig. 11 is a block diagram of an image processing system according to another embodiment of the present application.
Detailed Description
To facilitate an understanding of the present application, the present application will now be described more fully with reference to the accompanying drawings. Preferred embodiments of the present application are given in the accompanying drawings. This application may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.
It will be understood that when an element is referred to as being "secured to" another element, it can be directly on the other element or intervening elements may also be present. When an element is referred to as being "connected" to another element, it can be directly connected to the other element or intervening elements may also be present. The terms "vertical," "horizontal," "left," "right," and the like as used herein are for illustrative purposes only and do not represent the only embodiments.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the description of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
LED display system
Referring to fig. 1, the LED display system includes a video source 810, a sending card 820, a receiving card 830 (also called a control card), and a terminal display screen 840, under the control of an upper computer, a video frame code stream flows from the video source 810 to the sending card, the sending card 820 performs display distribution on video frames, and then sends the video frames to the receiving card 830, the receiving card 830 is disposed on the terminal display screen 840, and after receiving the video frames, the receiving card 830 displays at least a part of the video frames on its own loaded area. Alternatively, the video frame is directly transmitted from the transmitting card 820 to the receiving card 830, the transmitting card 820 does not perform display allocation, but the receiving card 830 itself intercepts the display portion corresponding to the self loading area from the video frame and displays it on the terminal display 840 when the receiving card 830 receives the complete video frame.
The terminal display screen 840, which is generally called an LED display screen, includes a plurality of LED boxes 841 formed by splicing a plurality of LED boxes 841, and the number of the spliced boxes can be added at will, thereby realizing display in an ultra-large area. When the terminal display 840 displays a frame of video, the LED boxes 841 together complete the full display of the video frame-that is, each LED box 841 displays only a portion of the video frame. Each LED box 841 is correspondingly provided with at least one control card, each control card is correspondingly provided with a tape carrier area, and the control cards control the image display of the tape carrier area. For example, when only one control card is set in one LED box 841, the area of the LED box 841 corresponding to the control card is changed. When one LED box 841 is provided with two control cards, the area of load corresponding to each control card is smaller than the display area of the LED box 841.
The plurality of LED boxes 841 are cascaded to each other through a network cable, so that the plurality of LED boxes 841 can cooperate to complete the display of one frame of video frame. In some embodiments, the terminal display 840 is provided with an external network interface, and all the LED boxes 841 are cascaded in a similar circuit. In the cascade mode, the video frame can be transmitted from the sending card to the external network interface of the terminal display screen and is transmitted all the way along the cascade path, and when passing through each control card, the control card acquires the video frame and determines the display part of the control card. The display assignment may also be made by the transmitting card. In other embodiments, the terminal display screen is provided with a plurality of network interfaces, the transmitting card can transmit data to a plurality of external network interfaces respectively, and all the LED boxes 841 are cascaded in a parallel manner in a similar circuit. In the cascade mode, in order to reduce the data bandwidth, the sending card can send the video frame to each pair of external network interfaces after performing display distribution, and then each control card only receives the data packet of the self display part and does not receive the complete video frame.
The LED box body 841 comprises a plurality of display modules, each display module forms a display unit, and each control card at least carries one display module.
Event relay system
The event relay system is mainly implemented by an LED display system, which is arranged at an event site. Video frame code streams which are processed in advance according to the image coding method capable of reducing interference of the advertisements in the competition field form a video source, and the video source is displayed on a terminal display screen after passing through a sending card and a receiving card. When the video frame code streams are sequentially displayed on the terminal display screen, the terminal display screen only plays one kind of advertisement when viewed by a live audience, and actually, a plurality of kinds of advertisements are mixed, and other advertisements are hidden from the live audience visually.
Referring to fig. 2, it is assumed that the live visible advertisement frame a is an advertisement frame visible to the live audience, and the hidden advertisement frames B1 and C1 are advertisement frames invisible to the live audience. The advertising subject to which the live visible advertising frame corresponds may be a main sponsor. The advertisement subject corresponding to the hidden advertisement frame can be a secondary sponsor, and the advertisement is put in a specific country with low cost, and a television station in the specific country opens a shutter of a relay camera to capture a live image only when a terminal display screen displays the hidden advertisement frame B1 or C1 during relay. For example, sponsor B2 released the ad sponsorship in country B, sponsor C2 released the ad sponsorship in country C, the television station of country B opened the shutter of the rebroadcast camera when the terminal display screen displayed hidden ad frame B1, and the television station of country C opened the shutter of the rebroadcast camera when the terminal display screen displayed hidden ad frame C1. The television stations of different countries open the shutters of the rebroadcasting cameras at different times, so that the rebroadcasting of various hidden advertisement frames in different countries is realized.
Referring to fig. 3, a flowchart of an interference reduction image encoding method according to an embodiment of the present application is exemplarily shown. The interference-reducing image coding method is used for image synthesis processing of the competition scene. The method includes steps S102 to S108, and the following is a detailed description of each step.
S102: acquiring a terminal display frame frequency when a video image is displayed on a terminal display screen;
when a group of video frame queues are transmitted to a display to be displayed, the display has a preset display frame frequency. The display frame rate refers to the number of frames of a video frame displayed in a unit time. For example, if 256 video frames are displayed within 1 second, the display frame rate is 256.
In the embodiment of the application, the display screen of the terminal is a display device of the scene of the event. For example, an LED display screen of the event relay system described above. The video frame queue obtained after the processing of the interference-reducing image coding method is transmitted to a terminal display screen and displayed at a preset display frame frequency.
The display frame frequency can be stored in an upper computer or a video processor. For example, in some embodiments, the display frame rate is stored in an upper computer that sends the display frame rate to a video processor when sending a video bitstream to the video processor, and the video processor controls the display of the video frames according to the display frame rate. In other embodiments, the display frame rate is stored in the video processor. For example, the video processor has a preset display frame rate parameter, and when the display frame rate parameter is set, the video frame passing through the video processor is displayed at the display frame rate.
In some embodiments, the terminal display frame rate when the video image is displayed on the terminal display screen is obtained, i.e. the terminal display frame rate is obtained from the video processor. Even if the display frame frequency is stored in the upper computer, the display frame frequency is still transmitted to the video processor from the upper computer when image synthesis is carried out, and then the image is distributed to each terminal display screen by the video processor for display (one video processor can control a plurality of terminal display screens), so that the display frame frequency of the terminal can be passed only from the video processor.
S104: creating a virtual frame template according to the display frame frequency of the terminal;
when the display frame rate is determined, the video processor may create a virtual frame template according to the display frame rate. The virtual frame template defines a frame, and a video frame queue formed by video frames obtained after the processing of the virtual frame template has a display frame frequency equal to the display frame frequency of the terminal. For example, after a group of video frame queues passes through the virtual frame template, the display frame rate is set to 256.
In the embodiment of the application, the virtual frame template simultaneously processes at least two video frame queues, and at least two video frames from the at least two video frame queues are input into the virtual frame template and then synthesized into a frame of virtual frame. That is, the virtual frames comprise a plurality of video frames from different video frame queues. For example, when two video frame queues are transmitted to the virtual frame template, the virtual frame template acquires a frame of video frame from each of the two video frame queues, and synthesizes the two frames of video frames into a frame of virtual frame. I.e., two different video frames from two video frame queues are included in a frame of virtual frames. The virtual frame has a display frame rate at which the display frame rates of the respective terminals are the same.
When the video processor processes the virtual frame, the virtual frame is taken as the whole frame for processing. That is, the video processor considers the virtual frame to be a frame of video and not to be identified as the first advertisement frame of the plurality of frames.
In a particular embodiment, the virtual frame template includes frame separators that separate different video frames, such that different video frames from different video frame queues are separated by the frame separators, and multiple video frames from different video frame queues are merged into one virtual frame.
S106: receiving at least two kinds of first advertisement frames, and synthesizing the at least two kinds of first advertisement frames according to a virtual frame template to obtain virtual frames;
after the video processor creates the virtual frame template, the first advertisement frame can be synthesized by using the virtual frame template. Specifically, the video processor receives a plurality of first advertisement frames and synthesizes the plurality of first advertisement frames into a frame of virtual frame by using the virtual frame template. The first advertisement frame is an advertisement frame sold by other television stations that is not visible to the live audience. And processing the first advertisement frame by a virtual frame template to obtain a virtual frame, and sending the virtual frame to a terminal display screen for decoding to obtain a plurality of frames of the first advertisement frame before synthesis.
The first advertisement frame is of a plurality of types, and is respectively from different television stations. A virtual frame template can process a plurality of first advertisement frames, and the virtual frame template is used for synthesizing at least two first advertisement frames from different video sources into a virtual frame. Thus, the first advertisement frames of at least two different video sources are synthesized to obtain a virtual frame queue. It will be appreciated that a single virtual frame template is not suitable for composing too many types of first advertising frames that would otherwise be displayed for too short a time to be captured by the rebroadcast camera. The number of the virtual frame templates may be set to be plural to enable sufficient processing when the number of the kinds of the first advertisement frame is excessive. In a specific embodiment, one virtual frame template corresponds to two types of first advertisement frames, and one virtual frame in the obtained virtual frames comprises two first advertisement frames, and the first advertisement frames are from different first advertisement frame queues. The display frame rate of the virtual frame is equal to the terminal display frame rate.
Referring to fig. 4, in some embodiments, synthesizing at least two first advertisement frames according to a virtual frame template to obtain a virtual frame includes:
s161: integrally encoding the first advertisement frame into a framing data packet;
s163: and loading the framing data packet into a virtual frame template to obtain a virtual frame.
When the first advertisement frame is synthesized according to the virtual frame template, the video processor receives the first advertisement frame, encodes the first advertisement frame into a framing data packet, and then loads the framing data packet into a data field of the virtual frame template, wherein different framing data packets (namely different first advertisement frames) are separated by a frame separator, so that two frames of the first advertisement frame are loaded into one frame of the virtual frame.
When the virtual frame is transmitted to the terminal display screen for display, the virtual frame needs to be decoded, the first advertisement frame is decoded from the virtual frame, and then the first advertisement frame obtained by decoding is displayed on the terminal display screen. The frame frequency of the virtual frame can be defined so that a plurality of frames of first advertisement frames decoded from the virtual frame share the display time of the virtual frame, thereby shortening the display time of the first advertisement frame, and the display time of the first advertisement frame is shorter than that of the virtual frame because a plurality of first advertisement frames share the display time of the virtual frame. The display time of the first advertising frame is reduced, thereby reducing interference with the live visible advertising frame (hereinafter the second advertising frame). When the display of the first advertisement frame of the plurality of decoded frames is controlled, the display order may be determined according to the distribution of the first advertisement frame within the virtual frame.
For example, referring to fig. 5, the virtual frame template has two data fields B1, B2, and a frame delimiter exists between the data fields B1, B2. When two first advertisement frames C1, C2 are synthesized according to the virtual frame template, the two first advertisement frames C1, C2 are loaded into the data fields B1, B2, respectively, illustratively, the first advertisement frame C1 is loaded into the data field B1, and the second advertisement frame C2 is loaded into the data field B2. When the virtual frame is decoded, the data field B1 is decoded first and then the data field B2 is decoded according to a preset rule, for example, the first advertisement frame C1 is decoded first, and when the virtual frame is displayed on the terminal display screen, the first advertisement frame C1 may be displayed first and then the first advertisement frame C2 may be displayed.
In order to make the display of the same kind of first advertisement frame have periodicity and regularity, the rebroadcast camera is convenient to capture the first advertisement frame, and in different virtual frames, the plurality of kinds of first advertisement frames have the same position distribution. For example, when two first advertisement frames C1 and C2 are synthesized according to the virtual frame template, the first advertisement frames of the first video source to which the first advertisement frame C1 belongs are loaded into the data field B1, and the first advertisement frames of the first video source to which the first advertisement frame C2 belongs are loaded into the data field B2.
When the number of the first advertisement frames is not matched with the virtual frame templates, for example, there are 11 first advertisement frames, each virtual frame template synthesizes 2 first advertisement frames, one first advertisement frame cannot be loaded into the virtual frame template together with other first advertisement frames, and at this time, the unmatched first advertisement frame and the unmatched empty frame are loaded into one virtual frame template.
S108: and receiving a second advertisement frame, and inserting the virtual frame into the second advertisement frame according to a preset rule to obtain an image display code stream.
The second advertisement frame is a frame displayed on the terminal display screen and visible to the live audience. And after receiving the first advertisement frame and the second advertisement frame, the video processor processes the first advertisement frame by using the virtual frame template to obtain a virtual frame. And processing the obtained virtual frame and a second advertisement frame, inserting the virtual frame into the second advertisement frame, and finally transmitting the second advertisement frame (namely, an image display code stream) inserted with the virtual frame to a terminal display screen for displaying.
It can be understood that when a plurality of virtual frame templates are provided, a plurality of virtual frames obtained by the plurality of virtual frame templates are all inserted into the second advertisement frame, and because the frame frequency of the virtual frame is equal to the terminal display frame frequency, the virtual frame can be directly inserted into the second advertisement frame without frame frequency adjustment.
Referring to fig. 6, in some embodiments, inserting the virtual frame into the second advertisement frame according to a preset rule specifically includes:
s182: determining a group of second advertisement frames according to the display frame frequency of the virtual frames;
s184: determining an insertion sequence number of the virtual frame, and determining the insertion position of the virtual frame according to the insertion sequence number;
s186: and inserting the virtual frame into the determined group of second advertisement frames and the position corresponding to the inserting position.
When inserting the virtual frame into the second advertisement frame, the insertion may be periodically performed in order to facilitate capturing by the relay camera, and therefore, a period number may be determined according to the display frame rate of the virtual frame and the number of virtual frames, and then a group of second advertisement frames may be determined according to the period number. The number of cycles is less than the terminal display frame rate.
For example, if the display frame rate of the virtual frame is 256 and the number of cycles can be determined to be 256, the second advertisement frame queue after inserting the virtual frame can include 256 video frames. If there are two virtual frame templates and the virtual frame templates all execute the synthesis processing of the first advertisement frame, there are two virtual frames and the corresponding first advertisement frame has 4 frames, and 256 video frames include two virtual frames and 252 second advertisement frames. Thus, the determined set of second advertisement frames includes 252 second advertisement frames, and the two virtual frames are inserted into the 252 second advertisement frames. In the foregoing example, the sum of the number of the second advertisement frames and the number of the first advertisement frames in the virtual frame is equal to the display frame rate, i.e., the number of cycles is equal to the display frame rate, but is not limited thereto. If the number of cycles is equal to the display frame rate setting, the retransmission camera captures only the first advertisement frame of one frame in 1 second, which is obviously disadvantageous for retransmission, and therefore, the number of cycles may be much smaller than the display frame rate in order to capture more first advertisement frames.
The insertion sequence number defines the insertion position of the virtual frame within a set of second advertisement frames, which may be pre-stored in the video processor. For example, in some embodiments, the insertion sequence number is associated with a virtual frame template, and when creating the virtual frame template, each virtual frame template is assigned with an insertion sequence number, and when obtaining a virtual frame from the virtual frame template, the insertion sequence number of the virtual frame is determined, so that different virtual frames correspond to different insertion positions.
When a group of second advertisement frames is determined and the insertion position of each virtual frame in the group of second advertisement frames is determined, the virtual frame can be inserted into the corresponding position according to the insertion sequence number.
After the insertion is completed, the video processor can obtain various rebroadcasting sequences of the first advertisement frames according to the video frame queues obtained after the insertion, the event rebroadcasting system generates rebroadcasting signals according to the rebroadcasting sequences, and after the rebroadcasting signals are sent to the rebroadcasting camera, the rebroadcasting camera can determine when to open the shutter according to the rebroadcasting signals, so that the first advertisement frames sold by the home television station can be captured from the display screen of the terminal. The event relay system may also be configured to store various relay sequences of the first advertisement frames in advance, and for example, the insertion sequence number of each first advertisement frame may be determined based on the pre-stored relay sequence. Before generating the rebroadcast signal according to the rebroadcast sequence, the rebroadcast sequence fed back by the video processor can be compared with the prestored rebroadcast sequence for checking, and after the rebroadcast sequence is checked to be correct, the rebroadcast signal is generated and sent to the rebroadcast camera.
Referring to fig. 7, in some embodiments, before step S108, the method further includes:
s172: carrying out chromatic value operation on the first advertisement frame to obtain an operation frame corresponding to each frame of the first advertisement frame;
s174: and synthesizing at least two frames of operation frames according to the virtual frame template to obtain a virtual operation frame.
In step 108, the virtual frame is inserted into the second advertisement frame according to a preset rule, specifically:
and inserting the virtual frame and the virtual operation frame into the second advertisement frame according to a preset rule.
When the image display code stream is transmitted to the terminal display screen for display, the image display code stream comprises a virtual frame and a second advertisement frame, the virtual frame is decoded into a first advertisement frame on the terminal display screen, and the number of the second advertisement frame is far more than that of the first advertisement frame. However, the first advertisement frame also has a certain number, and the difference between the images of the first advertisement frame and the second advertisement frame is large, and the difference between the chromatic values is large, so that a certain influence is caused on the display of the second advertisement frame, and the larger the number of the first advertisement frame is, the larger the influence is caused. In order to reduce the influence, a chromatic value operation can be carried out on the basis of the first advertisement frame to obtain an operation frame, and the operation frame and the corresponding first advertisement frame are displayed on the display in a pure white mode in an overlapping mode. Therefore, as long as the operation frame and the corresponding first advertisement frame are displayed in sequence within a very short time, the interference of the first advertisement frame corresponding to the operation frame on the second advertisement frame can be reduced through the operation frame, and the interference of all the first advertisement frames can be reduced as each first advertisement frame corresponds to one operation frame. Of course, in order to reduce the number of other video frames inserted into the second advertisement frame, only a part of the operation frame corresponding to the second advertisement frame may be inserted into the second advertisement frame.
It can be understood that the process of synthesizing the virtual operation frame according to the virtual frame template is basically the same as the process of synthesizing the virtual frame, and when the virtual operation frame is finally displayed on a terminal display screen, the operation frame is obtained by decoding and then displayed.
The process of synthesizing the operation frame according to the virtual frame template can be adapted to the process of synthesizing the first advertisement frame according to the virtual frame template, and when a plurality of frames of the first advertisement frame are synthesized into one virtual frame, the operation frame corresponding to the plurality of frames of the first advertisement frame is also synthesized into one virtual operation frame.
The virtual operation frame can be inserted into a certain group of second advertisement frames randomly without inserting a sequence number, as long as the operation frame can reduce the influence of the first advertisement frame. The calculation frame is not captured by the relay camera.
Referring to fig. 8, in some embodiments, the method may further include:
s110: and transmitting the image display code stream to a terminal display screen for display.
And inserting the virtual frame into the second advertisement frame to obtain an image display code stream, wherein the image display code stream comprises the virtual frame and the second advertisement frame, and transmitting the virtual frame and the second advertisement frame to a terminal display screen.
In the delivery, the virtual frame is delivered to the terminal display screen as one frame, that is, the first advertisement frame of the plurality of frames in the virtual frame is delivered to the terminal display screen at the same time.
And when the terminal display screen receives the second advertisement frame, the second advertisement frame is directly displayed. When the terminal display screen receives the virtual frame, the virtual frame is decoded to obtain a plurality of first advertisement frames, and then the plurality of first advertisement frames are displayed on the terminal display screen in sequence. Specifically, after receiving the virtual frame, the control card of the terminal display screen analyzes the virtual frame according to the virtual frame template to obtain a plurality of first advertisement frames encapsulated in the virtual frame. The control card then controls the display of the first advertisement frame of the plurality of frames.
The display of the first advertisement frame of the plurality of frames may determine a display order according to a distribution of the first advertisement frame within the virtual frame. In particular, the display may be according to the aforementioned decoding order. Or, the data fields in the virtual frame are subjected to priority grading, and the decoded first advertisement frame is displayed on the display screen of the terminal according to the priority sequence of the data fields.
According to the interference-reducing image coding method, the multi-frame first advertisement frame is synthesized into the virtual frame through the virtual frame template, and then the virtual frame template is inserted into the second advertisement frame, so that the display time of one frame of virtual frame is shared by the original multi-frame first advertisement frame, and the display time of the first advertisement frame is reduced on the premise of not changing the display frame frequency of the terminal, so that the influence of inserting the first advertisement frame on the second advertisement frame can be reduced.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 9, the present application further provides an image processing system 10 comprising a frame rate acquisition component 110, a template creation component 120, a synthesis component 130, an insertion component 140, and an output component 150, wherein,
a frame frequency acquiring part 110 for acquiring a terminal display frame frequency when the video image is displayed on the terminal display screen;
a template creating part 120 for creating a virtual frame template according to a terminal display frame rate;
a synthesizing component 130, configured to receive at least two types of first advertisement frames, and synthesize the at least two types of first advertisement frames according to the virtual frame template to obtain a virtual frame; the display frame frequency of the virtual frame is equal to the display frame frequency of the terminal;
the virtual frame template processes at least two video frame queues at the same time, and at least two video frames from the at least two video frame queues are input into the virtual frame template and then synthesized into a frame of virtual frame. That is, the virtual frames comprise a plurality of video frames from different video frame queues. For example, when two video frame queues are transmitted to the virtual frame template, the virtual frame template acquires a frame of video frame from each of the two video frame queues, and synthesizes the two frames of video frames into a frame of virtual frame. In the synthesized virtual frames, different virtual frames have the same position distribution of the first advertisement frames.
The inserting component 140 is configured to receive the second advertisement frame, and insert the virtual frame into the second advertisement frame according to a preset rule to obtain an image display code stream;
and the output component 150 is used for transmitting the image display code stream to a terminal display screen for display.
Referring to fig. 10, in one or more embodiments, the synthesis component 130 includes:
an encoding component 131 for integrally encoding the first advertisement frame into a framed data packet;
the loading component 133 is configured to package the framing data into the virtual frame template to obtain a virtual frame.
When a first advertisement frame is synthesized according to a virtual frame template, a video processor receives the first advertisement frame, encodes the first advertisement frame into a framing data packet, and then loads the framing data packet into a data field of the virtual frame template, wherein different framing data packets (namely different first advertisement frames) are separated by a frame separator, so that two frames of the first advertisement frame are loaded into one frame of the virtual frame.
Referring to fig. 10, in one or more embodiments, insert member 140 includes:
a group number determining component 141 for determining a group of second advertisement frames according to the display frame rate of the virtual frames; specifically, the group number determining component 141 determines a cycle number according to the display frame rate of the virtual frames and the number of the virtual frames, and then determines a group of second advertisement frames according to the cycle number, wherein the cycle number is smaller than the terminal display frame rate.
An insertion determining component 143, configured to determine an insertion sequence number of the virtual frame, and determine an insertion position of the virtual frame according to the insertion sequence number;
an insertion performing component 145 for inserting the virtual frame into the determined set of second advertisement frames at a position corresponding to the inserted position.
Referring to fig. 11, in one or more embodiments, the method further includes:
the operation unit 160 is configured to perform chrominance value operation on the first advertisement frame to obtain an operation frame corresponding to each frame of the first advertisement frame;
the synthesizing unit 130 is further configured to synthesize at least two frames of operation frames according to the virtual frame template, so as to obtain a virtual operation frame.
The insertion unit 140 inserts the virtual operation frame into the second advertisement frame at the same time when the virtual frame is inserted into the second advertisement frame. The insertion of the virtual operation frame may be irregular.
When the image display code stream is transmitted to a terminal display screen for display, when the terminal display screen receives a virtual frame, the virtual frame is analyzed according to a virtual frame template to obtain a plurality of frames of first advertisement frames encapsulated in the virtual frame; the display of the first advertisement frame of the plurality of frames is then controlled, wherein the display of the first advertisement frame of the plurality of frames may determine the display order based on the distribution of the first advertisement frame within the virtual frame.
An embodiment of the present application further provides a machine-readable storage medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the method of any of the above embodiments.
The system/computer device integrated components/modules/units, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow in the method of the embodiments described above can be realized by a computer program, which can be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments described above can be realized. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable storage medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, etc. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
The present application further provides a computer device, comprising: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured to perform the method of any of the embodiments described above via execution of the executable instructions. The computer device may be a video processor.
In the several embodiments provided in this application, it should be understood that the disclosed systems and methods may be implemented in other ways. For example, the above-described system embodiments are merely illustrative, and for example, the division of the components is only one logical division, and other divisions may be realized in practice.
In addition, each functional module/component in the embodiments of the present application may be integrated into the same processing module/component, or each functional module/component may exist alone physically, or two or more functional modules/components may be integrated into the same processing module/component. The integrated modules/components can be implemented in the form of hardware, or in the form of hardware plus software functional modules/components.
It will be evident to those skilled in the art that the embodiments of the present application are not limited to the details of the foregoing illustrative embodiments, and that the embodiments of the present application can be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the embodiments being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. Several units, modules or means recited in the system, apparatus or terminal claims may also be implemented by one and the same unit, module or means in software or hardware. The terms first, second, etc. are used to denote names, but not any particular order.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. An interference-reducing image encoding method for image synthesis processing at a scene of an event, comprising:
acquiring a terminal display frame frequency when a video image is displayed on a terminal display screen;
creating a virtual frame template according to the display frame frequency of the terminal;
receiving at least two kinds of first advertisement frames, and synthesizing the at least two kinds of first advertisement frames according to a virtual frame template to obtain virtual frames; the display frame frequency of the virtual frame is equal to the display frame frequency of the terminal;
receiving a second advertisement frame, and inserting the virtual frame into the second advertisement frame according to a preset rule to obtain an image display code stream;
and transmitting the image display code stream to a terminal display screen for display.
2. The interference-reducing image coding method according to claim 1, wherein the synthesizing at least two first advertisement frames according to the virtual frame template to obtain the virtual frame specifically comprises:
integrally encoding the first advertisement frame into a framing data packet;
and loading the framing data packet into a virtual frame template to obtain a virtual frame.
3. The interference reduction image encoding method according to claim 1, wherein the plurality of types of first advertisement frames have the same position distribution within different virtual frames.
4. The method for encoding an image capable of reducing interference according to claim 1, wherein the inserting the virtual frame into the second advertisement frame according to a preset rule specifically comprises:
determining a group of second advertisement frames according to the display frame frequency of the virtual frames;
determining an insertion sequence number of the virtual frame, and determining the insertion position of the virtual frame according to the insertion sequence number;
and inserting the virtual frame into the determined group of second advertisement frames and the position corresponding to the inserting position.
5. The interference-reducing image coding method according to claim 4, wherein the determining a group of second advertisement frames according to the display frame rate of the virtual frames specifically comprises:
and determining a cycle number according to the display frame frequency of the virtual frames and the number of the virtual frames, and determining a group of second advertisement frames according to the cycle number, wherein the cycle number is less than the display frame frequency of the terminal.
6. The interference reduction image coding method according to claim 4, wherein before the step of receiving the second advertisement frame and inserting the virtual frame into the second advertisement frame according to the preset rule, the method further comprises:
carrying out chromatic value operation on the first advertisement frame to obtain an operation frame corresponding to each frame of the first advertisement frame;
synthesizing at least two frames of operation frames according to the virtual frame template to obtain virtual operation frames;
the inserting the virtual frame into the second advertisement frame according to a preset rule specifically comprises:
and inserting the virtual frame and the virtual operation frame into the second advertisement frame according to a preset rule.
7. The interference reduction image coding method according to claim 1, wherein in the step of transmitting the image display code stream to the terminal display screen for display,
when the terminal display screen receives the virtual frame, analyzing the virtual frame according to the virtual frame template to obtain a multi-frame first advertisement frame encapsulated in the virtual frame;
controlling display of a first advertisement frame of the plurality of frames, wherein the display of the first advertisement frame of the plurality of frames determines a display order according to a distribution of the first advertisement frame within the virtual frame.
8. An image processing system characterized by comprising a frame rate acquisition section, a template creation section, a synthesis section, an insertion section, and an output section, wherein,
a frame frequency acquiring part for acquiring a terminal display frame frequency when the video image is displayed on a terminal display screen;
a template creating component for creating a virtual frame template according to a terminal display frame frequency;
the synthesis component is used for receiving the at least two first advertisement frames and synthesizing the at least two first advertisement frames according to the virtual frame template to obtain virtual frames; the display frame frequency of the virtual frame is equal to the display frame frequency of the terminal;
the inserting component is used for receiving the second advertisement frame and inserting the virtual frame into the second advertisement frame according to a preset rule to obtain an image display code stream;
and the output component is used for transmitting the image display code stream to a terminal display screen for display.
9. A computer device, comprising: a processor; a memory for storing executable instructions of the processor; characterized in that the processor is configured to perform the steps of the method of any of claims 1-7 via execution of the executable instructions.
10. A machine readable storage medium, having stored thereon a computer program, the computer program, when being executed by a processor, performing the steps of the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110388698.9A CN113115073B (en) | 2021-04-12 | 2021-04-12 | Image coding method, system, device and medium capable of reducing interference |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110388698.9A CN113115073B (en) | 2021-04-12 | 2021-04-12 | Image coding method, system, device and medium capable of reducing interference |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113115073A CN113115073A (en) | 2021-07-13 |
| CN113115073B true CN113115073B (en) | 2022-09-02 |
Family
ID=76715552
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110388698.9A Active CN113115073B (en) | 2021-04-12 | 2021-04-12 | Image coding method, system, device and medium capable of reducing interference |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113115073B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118317093B (en) * | 2024-06-11 | 2024-09-03 | 杭州芯正微电子有限公司 | Compression coding stable code rate stream pushing method, device and application thereof |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4849297B2 (en) * | 2005-04-26 | 2012-01-11 | ソニー株式会社 | Encoding apparatus and method, decoding apparatus and method, and program |
| US9031138B1 (en) * | 2014-05-01 | 2015-05-12 | Google Inc. | Method and system to combine multiple encoded videos for decoding via a video docoder |
| CN106162221A (en) * | 2015-03-23 | 2016-11-23 | 阿里巴巴集团控股有限公司 | The synthetic method of live video, Apparatus and system |
| DE102016010037A1 (en) * | 2016-08-22 | 2018-02-22 | Michael Schick | Changing a representation of a reality for informational purposes |
| AU2018211533B2 (en) * | 2017-01-27 | 2020-08-27 | Appario Global Solutions (AGS) AG | Method and system for transmitting alternative image content of a physical display to different viewers |
| CN107071322A (en) * | 2017-04-27 | 2017-08-18 | 西安诺瓦电子科技有限公司 | Video record and processing system and method |
| CN107147861A (en) * | 2017-04-27 | 2017-09-08 | 西安诺瓦电子科技有限公司 | Video record and processing system and method |
| CN110225265A (en) * | 2019-06-21 | 2019-09-10 | 深圳市奥拓电子股份有限公司 | Advertisement replacement method, system and storage medium during video transmission |
| CN110677559B (en) * | 2019-09-10 | 2021-07-09 | 深圳市奥拓电子股份有限公司 | Method, device and storage medium for displaying rebroadcast video in different ways |
| WO2021056199A1 (en) * | 2019-09-24 | 2021-04-01 | 华为技术有限公司 | Communication method and apparatus |
| CN110806845B (en) * | 2019-09-30 | 2021-10-26 | 深圳市奥拓电子股份有限公司 | Image display control method, system and storage medium |
-
2021
- 2021-04-12 CN CN202110388698.9A patent/CN113115073B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN113115073A (en) | 2021-07-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR100565470B1 (en) | Packet Filtering | |
| US6335755B1 (en) | Methods and apparatus for the creation and transmission of 3-dimensional images | |
| DE69937608T2 (en) | DECODER AND METHOD FOR PROCESSING A TRANSPORT PACKAGE CURRENT | |
| CN110225265A (en) | Advertisement replacement method, system and storage medium during video transmission | |
| DE69907426T2 (en) | DIGITAL PROCESSING OF GRAPHIC IMAGES IN A DECODER | |
| CN100466720C (en) | Video composition apparatus, video composition method and video composition program | |
| CN106713942B (en) | Video processing method and device | |
| CN113115073B (en) | Image coding method, system, device and medium capable of reducing interference | |
| US10924779B2 (en) | Location agnostic media control room and broadcasting facility | |
| CN106454256A (en) | Real-time splicing method and apparatus of multiple videos | |
| CN110806845B (en) | Image display control method, system and storage medium | |
| CN107071322A (en) | Video record and processing system and method | |
| US20180131995A1 (en) | Method for rendering audio-video content, decoder for implementing this method and rendering device for rendering this audio-video content | |
| CN105812960B (en) | Method, display terminal and system for carrying hidden information in display picture | |
| KR102054453B1 (en) | Method for providing image output based artificial intelligence | |
| KR20120027587A (en) | Apparatus and method for multi-screen image broadcasting | |
| CN113099290B (en) | Advertisement image display method, system, device and storage medium | |
| CN112969080B (en) | Image processing method, system, equipment and storage medium | |
| JP2003518836A (en) | Broadcasting extension system and method | |
| US20190281352A1 (en) | Digital Signage Method and System for Implementing the Same | |
| KR20130084502A (en) | Apparatus for moving prossing unit and method thereof and storaging unit | |
| CN107005401B (en) | Method and device for playing multimedia data | |
| CN113891101A (en) | Live broadcast method for real-time three-dimensional image display | |
| CN111757153A (en) | Method, system, equipment and readable storage medium for audience rating survey | |
| CN116074559A (en) | Design method of reference clock when multi-terminal synchronous playing contains pure audio stream |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220810 Address after: 644000 Room 301, block d1-c, science and technology innovation center, Guoxing Avenue, Lingang Economic Development Zone, Yibin City, Sichuan Province Applicant after: Yibin Tianlong Communication Co.,Ltd. Address before: No. 230, Zhonghuan West Road, Panyu District, Guangzhou, Guangdong 511400 Applicant before: Li Hongfu |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |