CN110677559B

CN110677559B - Method, device and storage medium for displaying rebroadcast video in different ways

Info

Publication number: CN110677559B
Application number: CN201910853873.XA
Authority: CN
Inventors: 吴未; 严振航; 吴振志; 孙兴红; 吴涵渠
Original assignee: Shenzhen Aoto Electronics Co Ltd
Current assignee: Shenzhen Aoto Electronics Co Ltd
Priority date: 2019-09-10
Filing date: 2019-09-10
Publication date: 2021-07-09
Anticipated expiration: 2039-09-10
Also published as: WO2021046804A1; CN110677559A

Abstract

The invention relates to a method, a device and a storage medium for displaying rebroadcast video distinctively, wherein the method is used for realizing the distinctive display of the video and comprises the following steps: inputting a plurality of videos, synthesizing a plurality of paths of videos in a frame by a sending card, and sending out the videos in a time-sharing way; adjusting the phase of the shutter opening time of the image pickup relay broadcasting equipment relative to the synchronous locking signal; adding compensation corresponding to the rebroadcast video into the live video; the method for differentially displaying the rebroadcast video realizes that the camera shooting rebroadcast equipment moves randomly by calculating the final three-color gray value of each pixel point of the field video displayed on the display screen for compensation, and the field video controller can play the video on the display screen for the camera shooting rebroadcast equipment to shoot, so that the method can be suitable for differentially displaying the field video by the camera shooting rebroadcast equipment.

Description

Method, device and storage medium for displaying rebroadcast video in different ways

Technical Field

The present invention relates to the field of image and video processing technologies, and in particular, to a method, an apparatus, and a storage medium for displaying a relayed video in a differentiated manner.

Background

In a virtual studio, there is a need to seamlessly blend the activity of the presenter in the field with the virtual background generated by the graphics workstation. In the process of rebroadcasting of sports games such as football, basketball and the like, advertisements played by the display screen at the periphery of the court need to be replaced, so that the advertisements played by the display screen seen by live audiences are different from the advertisements seen by television audiences. The same sports game also requires different advertisements to be broadcast for different relay countries. These requirements are all fulfilled by virtual display technology.

In the prior art, a pure-color picture, such as green, is fixedly inserted into each frame through a controller at a field display screen end, a camera shooting rebroadcasting device inputs a synchronous locking signal generated by a synchronous signal generator and keeps synchronous with the pure-color picture played by a field screen body, the camera shooting rebroadcasting device is ensured to capture only the green displayed by the field screen body by adjusting the shutter speed, then the green is scratched by a color key, and the picture used for rebroadcasting by a television station is superposed through a virtual server. And synthesizing a real scene shot by the shooting relay equipment and a virtual three-dimensional scene rendered by the pattern workstation to obtain a picture seen by a television viewer finally. The virtual display technology is high in equipment cost, a large number of design equipment is provided, time and labor are wasted in the calibration process of the camera shooting relay equipment and the virtual server in the field debugging process, once the calibration is completed, the pan-tilt of the camera shooting relay equipment is required to be fixed and cannot be moved randomly, once the position of the camera shooting relay equipment is moved, the calibration needs to be carried out again, and the acquisition and calculation of the parameters of panning, pitching, focusing and focusing are highly depended. In the prior art, a live video controller inserts a frame of offline picture into a live video which is normally played, and the influence on human eyes is offset by adding a frame of reverse color, so that live audiences are not easy to visually perceive the offline picture. The live audience sees a dynamic video while the camera relay device captures a static picture. Under the prior art scheme, the field video controller can only play a frame of static picture to shoot for the camera shooting rebroadcasting equipment, and the rebroadcasting requirement of the dynamic video cannot be met. Accordingly, the prior art is deficient and needs improvement.

Disclosure of Invention

Based on this, it is necessary to provide a method, an apparatus and a storage medium for displaying relay video distinctively, which can solve the problems that the pan-tilt of the camera relay device cannot move at will and the on-site video controller can only play one frame of still picture to the camera relay device for shooting.

The invention provides a method for displaying rebroadcast video in a distinguishing way, which is used for realizing the distinguishing display of shot rebroadcast video and/or pictures and live video and/or pictures, and comprises the following steps:

step 1: inputting multi-channel video, synthesizing the multi-channel video in a frame by a controller, and sending the multi-channel video by a sending card in a time-sharing manner;

step 2: adjusting the phase of the shutter opening time of the image pickup relay broadcasting equipment relative to the synchronous locking signal;

and step 3: and adding compensation corresponding to the rebroadcast video into the live video.

The input multi-channel video is synthesized in one frame by the controller and sent out by the sending card in a time-sharing way, and the input multi-channel video is input into the site controller, synthesized in one frame by the controller and sent out by the sending card in a time-sharing way; inputting a plurality of videos into a field controller, branching the videos by the controller, and synthesizing the plurality of videos in a frame by a sending card for time-sharing sending; inputting multi-channel videos into a field controller, synthesizing the videos into a frame by the controller, and sending the videos by a sending device comprising a sending card in a time-sharing and/or simultaneous manner; the multi-path video comprises more than two paths of videos and/or pictures.

The adjusting of the phase of the shutter opening time of the image pickup relay broadcasting equipment relative to the synchronous locking signal comprises the step that the image pickup relay broadcasting equipment adjusts the phase of the shutter opening time of the image pickup relay broadcasting equipment relative to the synchronous locking signal, so that different image pickup relay broadcasting equipment can open the shutter at the set shutter opening time and/or delay the shutter according to the set shutter delay time. The shutter delay time is the length of time the shutter is open. The broadcasting time of the rebroadcast video in one frame is very short, and the broadcasting time of the field visible video is very long;

adding compensation corresponding to the rebroadcast video into the live video; adding compensation corresponding to the rebroadcast video into the live video by the live controller; the image pickup relay apparatus includes a camera. The rebroadcast video is a live invisible video which is played by a live display screen shot by the camera shooting rebroadcast equipment and is invisible to the naked eyes of live audiences, and is played by rebroadcasting. The on-site controller compensates the display of the on-site display screen, so that the sensitivity of on-site audiences to the rebroadcast video invisible to naked eyes in the on-site display screen is reduced, and the on-site audiences finally form the technical effect of invisible to naked eyes on the television rebroadcast video. The rebroadcast video comprises a television rebroadcast video.

Preferably, the step of inputting multiple channels of video, the controller composing the multiple channels of video in one frame, and before the multiple channels of video are sent out by the sending card in time division, further includes: setting the number of paths of input video; respectively adjusting the brightness of each path of video; the time proportion of several paths of videos in one frame is adjusted;

setting the path number of input videos, setting the minimum path number of field videos to be 1, and setting the minimum path number of television rebroadcast videos to be 1;

the brightness of each video is respectively adjusted, and the brightness of each video can be respectively adjusted singly, or adjusted in groups, manually adjusted, or automatically adjusted; to reduce the impact of the rebroadcast video on the viewing experience of the live audience, the brightness of the video watched by the live audience is adjusted to be higher, while the brightness of the television rebroadcast video is adjusted to be lower. The method comprises the steps of adjusting the brightness of each video respectively, and also comprises the steps of setting a brightness adjusting parameter corresponding to each video independently and/or setting a brightness adjusting parameter corresponding to each group of videos independently; the broadcasting brightness of the rebroadcast video which is played on the live display screen and is invisible to the naked eyes of live audiences in one frame is very low, and the broadcasting brightness of the live video which is visible to the live audiences is very high;

the time proportion of several paths of videos in one frame is adjusted; to reduce the impact of the rebroadcast video on the viewing experience of the live audience, the video time occupation ratio for live audience viewing is longer, and the video time occupation ratio for television rebroadcast is shorter. The ratio of the rebroadcast video to the live visible video viewed by the live audience includes 1: 10, the larger the ratio of the rebroadcast video to the live visible video of the video watched by the live audience, the less the impact on the vision of the live audience.

Preferably, before adjusting the phase of the open shutter time of the image pickup relay apparatus with respect to the synchronization lock signal, the method further includes:

setting the shutter time of the camera shooting relay broadcasting equipment;

and outputting a synchronous locking signal to a field controller of the display screen and each camera shooting relay broadcasting device.

The synchronous locking signal equipment simultaneously outputs a synchronous locking signal to the field controller of the display screen and each camera shooting relay broadcasting equipment; and each shooting relay device control module controls each shooting relay device to open the shutter at the set starting time for opening the shutter.

Preferably, the setting of the shutter time of the image pickup relay broadcasting equipment further comprises setting of a starting time for opening the shutter and setting of a time length for opening the shutter; the starting time for opening the shutter is set after the corresponding delay of the synchronous locking signal; the time length for opening the shutter is set to be less than the playing time of the corresponding rebroadcast video on the live screen; the setting of the starting time for opening the shutter further comprises setting a plurality of shooting relay devices to open the shutter at the same time, and setting a plurality of shooting relay devices to open the shutter at different times.

The starting time of opening the shutter set by the plurality of camera shooting relay broadcasting devices is different, the plurality of camera shooting relay broadcasting devices shoot different relay broadcasting pictures of the on-site invisible video played by the on-site display screen, the relay broadcasting video displays different relay broadcasting contents, the television audience watches different relay broadcasting videos, and the on-site audience cannot see the relay broadcasting video from the on-site display screen. The time for broadcasting the rebroadcast video in one frame is short, and the time for broadcasting the invisible video on the spot is long.

If the starting time of opening the shutters set by the plurality of camera shooting relay broadcasting devices is the same time, the plurality of camera shooting relay broadcasting devices shoot the same relay broadcasting picture of the live invisible video played by the live display screen, the relay broadcasting video displays the same relay broadcasting content, the television audience watches the same relay broadcasting video, and the live audience cannot see the relay broadcasting video from the live display screen. The time for broadcasting the rebroadcast video in one frame is short, and the broadcasting time of the field invisible video is long; the starting time of opening the shutter comprises setting the shutter time according to the number of the paths of the inserted rebroadcast videos and the time proportion, for example, when a live audience watches one path of live video, two paths of rebroadcast videos exist, the time proportion is 1:8, the frame frequency of the original video is 50Hz, the frame frequency of the finally played rebroadcast video is 500Hz, and the shutter time of each frame of the camera shutter is not longer than 1/500 s.

If the time lengths of the shutters which are set by the plurality of camera shooting relay broadcasting devices and opened by naked eyes are the same, the plurality of camera shooting relay broadcasting devices shoot the same and/or different relay broadcasting pictures of the invisible live video which is played by the live display screen, the relay broadcasting videos display the same and/or different relay broadcasting contents, the relay broadcasting videos which are watched by television audiences are the same in time length, and the videos are the invisible live videos which are watched by the live audiences. The shutter time of the camera relay device must be set within the time that the relay video is played on the live screen.

If the time lengths of the shutter opening set by the plurality of camera shooting relay broadcasting devices are different, the plurality of camera shooting relay broadcasting devices shoot the same and/or different relay broadcasting pictures of the invisible live video played by the live display screen, the relay broadcasting videos display the same and/or different relay broadcasting contents, the television audience watches the same and/or different relay broadcasting videos, the time lengths are different, and the videos are the invisible live videos of the live audience. The shutter time of the camera relay device must be set within the time that the relay video is played on the live screen.

Preferably, the plurality of image pickup relay apparatuses open the shutter at different times, including setting start times of the plurality of image pickup relay apparatuses to open the shutter, respectively; respectively setting the starting time of opening the shutter of the multiple groups of shooting relay broadcasting equipment; the method further comprises the step of selecting a preset scheme according to preset setting, and finishing setting the starting time of the shutter opening of the plurality of camera shooting relay broadcasting devices at one time. For example, a preset scheme sets start times of shutter opening of a plurality of sets or a plurality of image pickup relay apparatuses in the form of an array.

Preferably, the synchronous locking signal is used for determining a time reference point for shooting and playing the video by each camera and the display screen, so that the response time of each camera is consistent with that of the field display screen; the time reference point for playing the video comprises the starting time of each frame of the video sent by the sending card as the time reference point, and is used for respectively determining the starting time of each camera for opening the shutter according to the corresponding delay of the synchronous locking signal.

Preferably, the field controller adds compensation corresponding to the relayed video to the field video, including the steps of:

recording three-color gray values of each pixel point in each frame of video in the camera shooting relay broadcasting equipment, and calculating a compensation value of each pixel point;

adding the compensation value of each pixel point to the original three-color gray value of each pixel point in the field video;

and calculating the final three-color gray value of each pixel point of the field video on the display screen.

Preferably, the method for calculating the compensation value of each pixel point is;

Rcompensating i(x,y)＝(max i–Rin i(x,y))*lumi camera i/n

Gcompensating i(x,y)＝(max i–Gin i(x,y))*lumi camera i/n

Bcompensating i(x,y)＝(max i–Bin i(x,y))*lumi camera i/n

if the relayed video of the first camera relay device is video camera 1, the relayed video of the second camera relay device is video camera 2, the relayed video of the ith camera relay device is video camera i, and the live video is video field, then the video camera i: the time length ratio of the video field is 1: n; the coefficient n is a multiple of the length of time that the live audience watches the video than the time that the camera rebroadcasts. The brightness of the video camera _ i is lumi camera i and ranges from 0% to 100%; the brightness of the video field is lumifield and ranges from 0% to 100%; the maximum value of RGB three color gray levels in all pixel points in a certain frame in the video camera i is max i, and Rin i (x, y), Gin i (x, y) and Bin i (x, y) are the three color gray levels of the (x, y) th pixel point in the ith television rebroadcast video respectively; the Rcompensating i (x, y), the Gcompensating i (x, y) and the Bcomlasting i (x, y) are compensation values aiming at the (x, y) th pixel point in the ith television rebroadcast video respectively.

For example: if the relayed video of the first camera relay device is video1 and the live video is video0, then video 1: the time length ratio of video0 is 1: n; the coefficient n is a multiple of the length of time that the live audience watches the video than the time that the camera rebroadcasts. The brightness of the video1 is lumi 1%; the brightness of the video0 is lumi 0%, the maximum value of RGB three color gray levels in all pixel points in a certain frame in the video1 is max, and the Rin1, the Gin1 and the Bin1 are three-color gray levels respectively; the Rcompensating, the Gcompensating and the Bcompenating are compensation values of each pixel point respectively;

then, the method for calculating the compensation value of each pixel point is as follows;

Rcompensating＝max*lumi1％/n-Rin1

Gcompensating＝max*lumi1％/n-Gin1

Bcompensating＝max*lumi1％/n-Bin1；

preferably, the method for calculating the final three-color gray value of each pixel point of the live video on the display screen comprises the following steps:

the Rin field (x, y), the Gin field (x, y) and the Bin field (x, y) are original three-color gray values of the (x, y) th pixel point of a video visible to a field viewer in each frame respectively; the lumifield is the brightness value of a video visible to a field viewer, and ranges from 0% to 100%; the Rcompensating i (x, y), the Gcompensating i (x, y) and the Bcomlasting i (x, y) are respectively compensation values of the (x, y) th pixel point in the ith television rebroadcast video, and k is the total number of the television rebroadcast videos; rout (x, y), Gout (x, y) and Bout (x, y) are the final three-color gray values of the (x, y) th pixel point of the video visible to the field audience in each frame respectively.

For example, Rin0, Gin0 and Bin0 are the original three-color gray values of each pixel point respectively; lumi 0% is the brightness value; the Rcompensating, the Gcompensating and the Bcompenstating are compensation values of each pixel point respectively; rout, Gout and Bout are final three-color gray values respectively;

then, the method for calculating the final three-color gray value of each pixel point of the live video on the display screen comprises the following steps:

Rout＝Rin0*lumi0％+Rcompensating

Gout＝Gin0*lumi0％+Gcompensating

Bout＝Bin0*lumi0％+Bcompensating。

preferably, the method further comprises the following steps after adding compensation corresponding to the rebroadcast video into the live video:

and judging whether the compensated final three-color gray value exceeds the maximum three-color gray value which can be displayed by the corresponding field display screen, if so, automatically cutting the maximum three-color gray value to the maximum value without overflowing display, and if not, adopting the original result. The anti-overflow process, for example, red, automatically cuts off to the maximum value if Rin0 × lumi 0% + rcomposition is greater than the maximum value of the gradation that can be achieved by the system, and the original result is obtained if it is less than or equal to the maximum value that can be achieved by the system.

A second aspect of the present invention provides an apparatus for displaying a relayed video distinctively, comprising:

the camera shooting relay broadcasting equipment is used for shooting and relaying videos and/or pictures;

the synchronous equipment generates a synchronous locking signal and outputs the synchronous locking signal to the field controller of the display screen and each camera shooting relay broadcasting equipment, including outputting the synchronous locking signal simultaneously;

the sending card is used for synthesizing the multi-channel video in a frame and sending out the multi-channel video in a time-sharing way;

the calculation module is used for calculating the compensation value of each pixel point and calculating the final three-color gray value of each pixel point of the field video on the display screen;

the field controller is used for inputting a plurality of videos and adding compensation corresponding to the rebroadcast video into the field video;

in one embodiment, the method further comprises the following steps:

the on-site display screen is used for playing on-site videos, and the played on-site videos comprise videos visible to naked eyes of on-site audiences and/or videos invisible to the naked eyes of the on-site audiences;

the setting module is used for setting the number of input videos; respectively adjusting the brightness of each path of video; the time proportion of several paths of videos in one frame is adjusted; setting the shutter time of the camera shooting relay broadcasting equipment;

the camera shooting relay broadcasting equipment control module is used for adjusting the phase of the time for opening the shutter of the camera shooting relay broadcasting equipment relative to the synchronous locking signal and controlling different camera shooting relay broadcasting equipment to open the shutter at different times;

and the judgment module is used for judging whether the compensated final three-color gray value exceeds the maximum three-color gray value which can be displayed by the corresponding field display screen.

A third aspect of the invention provides a machine readable storage medium having stored thereon a computer program which, when executed by a processor, implements any of the above-described methods of differentially displaying relayed videos.

According to the method for displaying the rebroadcast video distinctively, the final three-color gray value of each pixel point of the field video displayed on the display screen is calculated for compensation, and the compensation algorithm for watching the field video greatly reduces the influence on the appearance of the field audience, so that the field audience cannot identify the specific video shot by the camera through human eyes, and the purpose that the camera shooting rebroadcast equipment moves randomly is achieved. The field video controller can play videos on the display screen for the camera shooting relay broadcasting equipment to shoot, can be suitable for relay broadcasting of the camera shooting relay broadcasting equipment to the field videos, and realizes differential display for different audiences. In the prior art, the rebroadcast video is generated by overlapping the virtual servers, and the camera lens usually has distortion, so the rebroadcast video cannot be seamlessly overlapped with the edge of the display screen. In the prior art, when pure color is used for matting, for example, green is used for matting, players wearing green clothes and field green plants participating in a match on the scene can be scratched off, and according to the technical scheme provided by the invention, the field color is not limited, so that the effect of differential display is improved, and the application scene is enlarged. The position of the camera and the parameters of the virtual server do not need to be calibrated on site, so that the debugging time is saved, and the maintenance is facilitated; the equipment such as cloud platform, color key, virtual server have been saved, the cost is reduced by a wide margin.

Drawings

FIG. 1 is a flow chart of a method for differentiated display of relayed video according to an embodiment of the present invention;

FIG. 2 is a flow chart of a method for differentiated display of relayed video according to yet another embodiment of the present invention;

FIG. 3 is a flow chart of a method for differentiated display of relayed video according to yet another embodiment of the present invention;

FIG. 4 is a partial flow diagram of a method for differentiated display of relayed video according to yet another embodiment of the present invention;

FIG. 5 is an exploded view of a portion of a flowchart of a method for differentiated display of relayed video according to yet another embodiment of the present invention;

fig. 6 is a schematic diagram of the shutter time of the image pickup relay apparatus of the present invention according to still another embodiment of the present invention;

fig. 7 is a block diagram of a video relay device according to an embodiment of the invention.

Detailed Description

So that the manner in which the above recited objects, features and advantages of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to the embodiments thereof which are illustrated in the appended drawings. In addition, the embodiments and features of the embodiments of the present application may be combined with each other without conflict.

In the following description, numerous specific details are set forth to provide a thorough understanding of the present invention, and the described embodiments are merely a subset of the embodiments of the present invention, rather than a complete embodiment. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used herein in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.

Fig. 1 is a flow chart of a method of differentially displaying a relayed video, which is applicable to live broadcasts, relayed broadcasts, and virtual studios of televisions, in accordance with some embodiments of the present invention. It should be noted that the method for displaying a relayed video distinctively according to the embodiments of the present invention is not limited to the steps and the sequence in the flowchart shown in fig. 1, and the steps in the flowchart may be added, removed, or changed in sequence according to different requirements.

The method for displaying the rebroadcast video in a distinguishing way in the embodiment of the invention takes the shot video and/or the picture of the camera device as a processing object, and the camera device can be statically placed at a certain specific position or dynamically move to shoot in the shooting process. The method for displaying the rebroadcast video in a distinguishing way can add compensation corresponding to the rebroadcast video into the live video by using the live controller, so that different videos and/or pictures can be seen in different areas. The display carrier comprises a billboard or an advertising machine, such as an LED display screen, and the display video and/or pictures can be videos and/or pictures which are played on the screen.

As shown in fig. 1, the method for displaying the rebroadcast video distinctively includes the following steps:

step S96: inputting multi-channel video, synthesizing the multi-channel video in a frame by a controller, and sending the multi-channel video by a sending card in a time-sharing manner;

step S102: adjusting the phase of the shutter opening time of the image pickup relay broadcasting equipment relative to the synchronous locking signal;

step S104: and adding compensation corresponding to the rebroadcast video into the live video.

The rebroadcast video is the live video which is invisible to the naked eyes of live audiences and is played by the live display screen. And adjusting the phase of the shutter opening time of the image pickup relay broadcasting equipment relative to the synchronous locking signal so as to open the shutter of different image pickup relay broadcasting equipment at the set time. Setting the starting time for opening the shutter comprises setting the shutter to be opened at the same time and the shutter to be opened at different times. The time length of shutter opening set by the plurality of image pickup relay apparatuses is the delay time of the shutter, and may be the same time length or different time lengths. When the starting time for opening the shutter is the same for a plurality of camera shooting rebroadcasting devices, the camera shooting rebroadcasting devices shoot the same rebroadcasting picture of the invisible live video played by the live display screen, the rebroadcasting video displays the same rebroadcasting content, and television audiences watch the same rebroadcasting video; when the starting time of the shutter opening of the plurality of camera shooting relay broadcasting devices is different, the plurality of camera shooting relay broadcasting devices shoot different relay broadcasting pictures of the invisible live video played by the live display screen, the relay broadcasting video displays different relay broadcasting contents, and television audiences watch different relay broadcasting videos. The length of time that the shutters set by the plurality of image pickup relay apparatuses are open cannot individually decide whether the contents of the relay videos of the respective image pickup relay apparatuses are the same.

The plurality of camera shooting relay broadcasting equipment can shoot the same and/or different relay broadcasting pictures of the invisible live video played by the live display screen, the relay broadcasting video displays the same relay broadcasting content, and the television audience watches the same and/or different relay broadcasting video which is the invisible live video of the live audience. The playing time of the rebroadcast video in one frame is very short, and the playing time of the video visible to the field audience is very long; the broadcasting brightness of the rebroadcast video which is played on the live display screen and is invisible to the naked eyes of live audiences in one frame is very low, and the broadcasting brightness of the live video which is visible to the live audiences is very high; the on-site controller compensates the display of the on-site display screen, so that the sensitivity of on-site audiences to the rebroadcast video invisible to naked eyes in the on-site display screen is reduced, and the on-site audiences finally form the technical effect of invisible to naked eyes on the television rebroadcast video.

Referring to fig. 2, in some embodiments, before inputting a plurality of videos into the site controller and synthesizing the plurality of videos into one frame by the transmitting card, the transmitting card sends out the plurality of videos in a time-sharing manner, further includes:

step SII 0: setting the number of paths of input video;

step S112: respectively adjusting the brightness of each path of video;

step S114: the time ratio of several paths of video in one frame is adjusted.

Specifically, the number of paths of input videos is set, the minimum number of paths of live videos is set to be 1, and the minimum number of paths of television rebroadcast videos is set to be 1.

The brightness of each video is respectively adjusted, and the brightness of each video can be respectively adjusted singly, or adjusted in groups, manually adjusted, or automatically adjusted; to reduce the impact of the rebroadcast video on the viewing experience of the live audience, the brightness of the video watched by the live audience is adjusted to be higher, while the brightness of the television rebroadcast video is adjusted to be lower. The method comprises the steps of adjusting the brightness of each video respectively, and also comprises the steps of setting a brightness adjusting parameter corresponding to each video independently and/or setting a brightness adjusting parameter corresponding to each group of videos independently; the broadcast video which is played on the live display screen and is invisible to the naked eyes of the live audience has low broadcast brightness in one frame, and the broadcast brightness of the live video which is visible to the live audience is high.

Referring to fig. 3, in some embodiments, the method further includes: step S98 sets the shutter time of the image capturing relay apparatus; s100, outputting a synchronous locking signal to the field controller and each camera shooting relay broadcasting device;

step S98: setting the shutter time of the camera shooting relay broadcasting equipment;

step S100: outputting a synchronous locking signal to the field controller and each camera shooting relay broadcasting device;

Specifically, the setting of the shutter time of the image pickup relay broadcasting equipment comprises setting of a starting time for opening the shutter and setting of a time length for opening the shutter; the starting time for opening the shutter is set after the corresponding delay of the synchronous locking signal; the time length for opening the shutter is set to be less than the playing time of the corresponding rebroadcast video on the live screen; the setting of the starting time for opening the shutter comprises the steps that a plurality of shooting relay broadcasting devices are set to open the shutter at the same time, and the plurality of shooting relay broadcasting devices open the shutter at different times; the plurality of camera shooting relay broadcasting devices open the shutters at different times, and the starting time of the plurality of camera shooting relay broadcasting devices for opening the shutters needs to be set respectively; the synchronous locking signal is used for determining the time reference points of the video shot and played by each camera and the display screen, so that the response time of each camera is consistent with that of the field display screen; the time reference point comprises a starting time in each frame of a video sent by the sending card as the time reference point, and is used for respectively determining the starting time of each camera for opening the shutter according to the corresponding delay of the synchronous locking signal.

Setting the starting time for opening the shutter comprises setting the shutter to be opened at the same time and the shutter to be opened at different times. The time length of shutter opening set by the plurality of image pickup relay apparatuses is the delay time of the shutter, and may be the same time length or different time lengths. When the starting time for opening the shutter is the same for a plurality of camera shooting rebroadcasting devices, the camera shooting rebroadcasting devices shoot the same rebroadcasting picture of the invisible live video played by the live display screen, the rebroadcasting video displays the same rebroadcasting content, and television audiences watch the same rebroadcasting video; when the starting time of the shutter opening of the plurality of camera shooting relay broadcasting devices is different, the plurality of camera shooting relay broadcasting devices shoot different relay broadcasting pictures of the invisible live video played by the live display screen, the relay broadcasting video displays different relay broadcasting contents, and television audiences watch different relay broadcasting videos. The length of time that the shutters set by the plurality of image pickup relay apparatuses are open cannot individually decide whether the contents of the relay videos of the respective image pickup relay apparatuses are the same.

The setting of the starting time for opening the shutter and the time length for opening the shutter further includes setting the same starting time for opening the shutter or different starting times for opening the shutter for each of the plurality of image pickup relay apparatuses; setting the same starting time for opening the shutter or different starting times for opening the shutter for the multiple groups of shooting relay broadcasting equipment; the setting of the time length for opening the shutter further includes setting the same time length for opening the shutter or different time lengths for opening the shutter for each of the plurality of image pickup relay apparatuses; the time length of opening the shutter is set to be the same or different for the multiple groups of shooting relay broadcasting equipment; the shutter times of a plurality of image pickup relay apparatuses of the plurality of sets of image pickup relay apparatuses may be exceptionally set.

The starting time for opening the shutter set by the plurality of camera shooting relay broadcasting devices can be set to be the same time or different times, the plurality of camera shooting relay broadcasting devices shoot the same or different relay broadcasting pictures of the field invisible video played by the field display screen, the relay broadcasting videos display the same relay broadcasting content, television audiences watch the same or different relay broadcasting videos, and the field audiences cannot see the relay broadcasting videos from the field display screen. The time for broadcasting the rebroadcast video in one frame is short, and the time for broadcasting the invisible video on the spot is long.

The time length of opening the shutter includes setting the shutter time according to the number of the paths of the inserted rebroadcast video and the time proportion, for example, when a live audience watches one path of live video, two paths of rebroadcast videos exist, the time proportion is 1:8, the frame frequency of the original video is 50Hz, the frame frequency of the finally played rebroadcast video is 500Hz, and the shutter time of each frame of the camera shutter is not longer than 1/500 s. The shutter opening time set by the plurality of camera shooting relay broadcasting devices is the same time and/or different time, the plurality of camera shooting relay broadcasting devices shoot the same and/or different relay broadcasting pictures of the invisible live video played by the live display screen, the relay broadcasting videos display the same relay broadcasting content, the television audience watches the same and/or different relay broadcasting videos, and the videos are the invisible live videos of the live audience. The shutter time of the camera relay device must be set within the time that the relay video is played on the live screen.

The synchronous locking signal equipment simultaneously outputs a synchronous locking signal to the field controller of the display screen and each camera shooting relay broadcasting equipment; and each camera shooting relay broadcasting equipment control module controls different camera shooting relay broadcasting equipment to open the shutter at the set time.

Referring to fig. 4, in some embodiments, the adding compensation corresponding to the rebroadcast video to the live video further includes the steps of:

step S120: recording three-color gray values of each pixel point in each frame of video in the camera shooting relay broadcasting equipment, and calculating a compensation value of each pixel point;

step S122: adding the compensation value of each pixel point to the original three-color gray value of each pixel point in the field video;

step S124: and calculating the final three-color gray value of each pixel point of the field video on the display screen.

The method for calculating the compensation value of each pixel point comprises the following steps of;

Rcompensating i(x,y)＝(max_i–Rin i(x,y))*lumi camera i/n

Gcompensating i(x,y)＝(max_i–Gin i(x,y))*lumi camera i/n

Bcompensating i(x,y)＝(max_i–Bin i(x,y))*lumi camera i/n

Rcompensating＝max*lumi1％/n-Rin1

Gcompensating＝max*lumi1％/n-Gin1

Bcompensating＝max*lumi1％/n-Bin1；

the method for calculating the final three-color gray value of each pixel point of the field video on the display screen comprises the following steps:

Rout＝Rin0*lumi0％+Rcompensating

Gout＝Gin0*lumi0％+Gcompensating

Bout＝Bin0*lumi0％+Bcompensating。

referring to fig. 5, in another embodiment, the method for displaying a rebroadcast video distinctively further includes the steps of determining whether the compensated final three-color gray-scale value exceeds the maximum three-color gray-scale value that can be displayed by the corresponding on-site display screen;

step S104: adding compensation corresponding to the rebroadcast video into the live video by the live controller;

step S105: judging whether the compensated final three-color gray value exceeds the maximum three-color gray value which can be displayed by the corresponding field display screen, if so, performing step S108 to automatically cut the gray value to the maximum value, and if not, performing step S106 to adopt the original result;

step S106: adopting an original result;

step S108: the truncation is automatically to a maximum.

Specifically, whether the compensated final three-color gray value exceeds the maximum three-color gray value which can be displayed by the corresponding field display screen is judged, if yes, the maximum three-color gray value is automatically cut off to be the maximum value, the three-color gray value cannot be displayed in an overflowing way, and if not, the three-color gray value is automatically cut off to be the maximum valueThe row steps adopt the original results. Anti-overflow treatment, take red as an example, if

If the maximum value is less than or equal to the maximum value which can be reached by the system, the result is the original result. Adding compensation corresponding to the rebroadcast video into the live video; adding compensation corresponding to the rebroadcast video into the live video by the live controller; the image pickup relay apparatus includes a camera. The rebroadcast video is a live invisible video which is played by a live display screen shot by the camera shooting rebroadcast equipment and is invisible to the naked eyes of live audiences, and is played by rebroadcasting.

Referring to fig. 6, a schematic diagram of shutter time of the camera relay device according to the present invention, in some embodiments, three

camera relay devices

80, 80 ', 80 ″ are used to relay a live invisible video, which is invisible to the naked eye of a live viewer in a live video, to correspond to three

relay videos

82, 82', 82 ″; the three rebroadcast videos 82, 82 'and 82' are videos which are not visible to naked eyes of field audiences in the field videos shot by the cameras, the number of input video paths can be set, one of the videos is fixed as the visible field video of the field audiences, the other videos are rebroadcast videos, and the minimum number of the rebroadcast video paths is 1. The three image

pickup relay apparatuses

80, 80', 80 ″ respectively correspond to the three image pickup relay apparatuses for the shutter-on times. The shutter opening time corresponds to the starting time 84, 84 'of the shutter opening time of each shooting relay broadcasting equipment respectively, the starting time 84, 84' of the shutter opening is set, the time length of the shutter opening is adjustable and is less than the time length of each frame of single television relay broadcasting video; each

camera relay device

80, 80 ', 80 "can individually adjust the time delay from the receipt of the synchronization lock signal to the opening of the shutter so that each

camera relay device

80, 80 ', 80" opens the shutter at a different time and just within the time of the

corresponding relay video

82, 82 ', 82 ", respectively. The factor n86 is a multiple of the length of time that a live viewer sees live visible video relative to the length of time that each television relay video is played. The time proportion of several paths of videos in one frame can be adjusted to be 1: n is the same as the formula (I). The timeline live visible video 88 is the live visible video seen by the live audience. Live video includes live visible video that is visible to the naked eye of the live audience and live invisible video that is not visible to the naked eye of the live audience. The output frame frequency is 90, and 24Hz, 30Hz, 50Hz and 60Hz can be selected; a time axis 92 for representing video playback time; the

camera relay device

80, 80 ', 80 "takes a live invisible video, forming a corresponding relayed

video

82, 82', 82". The

relay video

82, 82 ', 82 ″ is longer in time axis than the

length

94, 94 ', 94 ″ of the shutter open time of the corresponding image

pickup relay apparatus

80, 80 ', 80 ″ respectively. The

start time

84, 84 ', 84 "for opening the shutter is after a

delay time

96, 96', 96" relative to the synchronization lock signal.

Setting the path number of input videos, setting the minimum path number of field videos to be 1, and setting the minimum number of television rebroadcast videos to be 1; the number of paths of input video corresponds to the number of paths of relayed

video

82, 82', 82 ", respectively.

The time proportion of several paths of videos in one frame is adjusted; to reduce the impact of the rebroadcast video on the viewing experience of the live audience, the video time occupation ratio for live audience viewing is longer, and the video time occupation ratio for television rebroadcast is shorter. The ratio of the

rebroadcast video

82, 82', 82 "to the live visible video 88 viewed by the live viewer includes 1: 10, the greater the ratio of the relayed

video

82, 82', 82 "to the live visible video 88, the less the impact on the live audience vision.

Setting shutter time of the camera relay broadcasting equipment; the shutter time includes setting the shutter time according to the number of paths of the inserted rebroadcast video 82, 82 'and the time ratio, for example, one live video 88 watched by a live viewer, two rebroadcast videos 82, 82', the time ratio is 1:8, the frame frequency of the original video is 50Hz, the frame frequency of the finally played rebroadcast video is 500Hz, and the opening time of each frame of the camera shutter is not longer than 1/500 s. The set camera relay device

open shutter time

84, 84', 84 "must be shorter than the time that the relayed video is played on the live screen; three

shutter opening times

84, 84 ', 84 ″ corresponding to the starting time of the live invisible video to be shot and relayed by the shooting relay broadcasting equipment to be played on the live display screen comprise three

corresponding delay times

96, 96 ', 96 ″ of the synchronous locking signals, and are respectively behind the three delay times 96, 96 '; the relayed

video

82, 82', 82 "comprises television relayed video.

Referring to fig. 7, the present invention further provides a device for displaying and relaying video distinctively, in some embodiments, a camera relay device 30 for capturing and relaying video and/or pictures;

a transmitting card 28 for synthesizing the multi-channel video into a frame and transmitting the frame in a time-sharing manner;

the calculation module 26 is used for calculating the compensation value of each pixel point and calculating the final three-color gray value of each pixel point of the field video on the display screen;

a site controller 20 for inputting a plurality of videos and adding compensation corresponding to the relayed video to the site video;

the live display screen 36 is used for playing a live video, and the played live video is divided into a video visible by the naked eyes of a live audience and/or a video invisible by the naked eyes of the live audience;

a synchronization device 34 for generating a synchronization lock signal and outputting the synchronization lock signal to the site controller of the display screen and each camera relay device, including outputting the synchronization lock signal at the same time; a setting module 22 for setting the number of input videos; respectively adjusting the brightness of each path of video; the time proportion of several paths of videos in one frame is adjusted; setting the shutter time of the camera shooting relay broadcasting equipment;

the camera shooting relay broadcasting equipment control module 32 is used for adjusting the phase of the shutter opening time of the camera shooting relay broadcasting equipment relative to the synchronous locking signal and controlling different camera shooting relay broadcasting equipment to open the shutter at different times;

the determining module 22 is configured to determine whether the compensated final three-color gray value exceeds a maximum three-color gray value that can be displayed by the corresponding field display screen.

Specifically, the site controller 20 inputs multiple paths of videos, the site controller 20 of the display screen synthesizes the multiple paths of videos into one frame, the multiple paths of videos are sent to the site display screen 36 by the sending card 28 in a time-sharing manner, the site display screen 36 plays the site videos, and the played site videos are divided into videos visible to the naked eyes of site audiences and/or videos invisible to the naked eyes of the site audiences; the camera shooting relay broadcasting equipment 30 shoots and relays videos and/or pictures; the setting module 22 sets the number of paths of input video, respectively adjusts the brightness of each path of video, adjusts the time proportion of several paths of video in one frame, and sets the shutter time of the camera relay broadcasting equipment; a synchronization device 34 for generating a synchronization lock signal and outputting the synchronization lock signal to the site controller 20 of the display screen and each of the camera relay devices, including outputting the synchronization lock signal at the same time; the camera shooting relay broadcasting equipment control module 32 is used for adjusting the phase of the shutter opening time of the camera shooting relay broadcasting equipment relative to the synchronous locking signal and controlling different camera shooting relay broadcasting equipment to open the shutter at different times; the calculation module 26 calculates the compensation value of each pixel point and calculates the final three-color gray value of each pixel point of the field video on the display screen; the site controller 20 adds compensation corresponding to the rebroadcast video to the site video; the determining module 22 is configured to determine whether the compensated final three-color gray value exceeds a maximum three-color gray value that can be displayed by the corresponding field display screen.

Some embodiments of the present invention also provide a machine-readable storage medium having stored thereon a computer program, wherein the computer program, when executed by a processor, implements the method for differentiated display of relayed video according to any of the embodiments described above.

The image system/computer device integrated components/modules/units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow in the method according to the above embodiments may be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable storage medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.

In the several embodiments provided in the present invention, it should be understood that the disclosed system and method may be implemented in other ways. The above-described apparatus embodiments are merely illustrative, and for example, the division of the components is only one logical division, and other divisions may be realized in practice.

In addition, each functional module/component in each embodiment of the present invention may be integrated into the same processing module/component, or each module/component may exist alone physically, or two or more modules/components may be integrated into the same module/component. The integrated modules/components can be implemented in the form of hardware, or can be implemented in the form of hardware plus software functional modules/components.

It will be evident to those skilled in the art that the embodiments of the present invention are not limited to the details of the foregoing illustrative embodiments, and that the embodiments of the present invention are capable of being embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the embodiments being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. Several units, modules or means recited in the system, apparatus or terminal claims may also be implemented by one and the same unit, module or means in software or hardware. The terms first, second, etc. are used to denote names, but not any particular order.

The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

1. A method for displaying a relayed video distinctively, said method being used to implement the distinctive display of a shot relayed video and/or picture from a live video and/or picture, said method comprising the steps of:

inputting multiple paths of videos, and synthesizing the videos in one frame by the controller; the input multi-channel videos are synthesized in one frame by the controller and are sent to a field display screen for playing by a sending card in a time sharing mode, and the multi-channel videos comprise rebroadcast videos invisible to naked eyes of field audiences and field videos visible to the field audiences;

shooting the field display screen by the camera equipment; the synchronous locking signal equipment simultaneously outputs the synchronous locking signal to a controller of a field display screen and each camera shooting relay equipment; adjusting a time for opening a shutter of the image pickup relay apparatus by adjusting a start time for opening the shutter and setting a length of time for opening the shutter; the phase of the shutter opening time of the shooting relay broadcasting equipment relative to the synchronous locking signal is adjusted;

adding compensation corresponding to the rebroadcast video into the live video; recording three-color gray values of each pixel point in each frame of video in the camera shooting relay broadcasting equipment, and calculating a compensation value of each pixel point;

calculating the final three-color gray value of each pixel point of the live video on the display screen,

the method for calculating the compensation value of each pixel point is as follows:

Rcompensating i(x,y)＝(max i–Rin i(x,y))*lumi camera i/n

Gcompensating i(x,y)＝(max i–Gin i(x,y))*lumi camera i/n

Bcompensating i(x,y)＝(max i–Bin i(x,y))*lumi camera i/n

if the relayed video of the first camera relay device is video camera 1, the relayed video of the second camera relay device is video camera 2, the relayed video of the ith camera relay device is video camera i, and the live video is video field, then the video camera i: the time length ratio of the video field is 1: n; the coefficient n is a multiple of the time length of the video watching time of the live audience to the rebroadcasting time of the camera; the brightness of the video camera _ i is lumi camera i and ranges from 0% to 100%; the brightness of the video field is lumifield and ranges from 0% to 100%; the maximum value of RGB three color gray levels in all pixel points in a certain frame in the video camera i is max i, and Rin i (x, y), Gin i (x, y) and Bin i (x, y) are the three color gray levels of the (x, y) th pixel point in the ith television rebroadcast video respectively; the Rcompensating i (x, y), the Gcompensating i (x, y) and the Bcomlasting i (x, y) are respectively compensation values aiming at the (x, y) th pixel point in the ith television rebroadcast video,

2. The method of differentially displaying relayed video as claimed in claim 1, wherein the input of multiple channels of video is composed by the controller in one frame before being time-shared by the transmitting card, and further comprising:

setting the number of paths of input video; respectively adjusting the brightness of each path of video;

the time proportion of several paths of video in one frame is adjusted.

3. The method of differentially displaying relayed video according to claim 1, wherein said step of adjusting the phase of the open shutter time of the image-pickup relay device relative to the synchronization lock signal further comprises the steps of:

setting the shutter time of the camera shooting relay broadcasting equipment;

4. The method of distinctively displaying a relay video according to claim 3, wherein the setting of a shutter time of the image-pickup relay device further includes setting a start time for opening the shutter and setting a length of time for opening the shutter; the setting is carried out for the starting time of opening the shutter after the corresponding delay of the synchronous locking signal; the time length for opening the shutter is set to be less than the playing time of the corresponding rebroadcast video on the live screen; the setting of the starting time for opening the shutter further comprises setting a plurality of shooting relay devices to open the shutter at the same time, and setting a plurality of shooting relay devices to open the shutter at different times.

5. The method of differentially displaying relay video according to claim 4, wherein the setting of the plurality of image pickup relay apparatuses to open the shutters at different times further comprises setting start times of the opening of the shutters of the plurality of image pickup relay apparatuses, respectively.

6. The method for differentiated display of relayed video according to claim 1, wherein said synchronization lock signal is used to determine the time reference point for each camera and display screen to capture and play video, so that the response time of each camera is consistent with that of the live display screen; the time reference point for playing the video comprises the starting time of each frame of the video sent by the sending card as the time reference point, and is used for respectively determining the starting time of each camera for opening the shutter according to the corresponding delay of the synchronous locking signal.

7. The method for differentiated presentation of relayed video according to claim 1, wherein said step of adding compensation to the live video corresponding to the relayed video, is followed by the steps of:

and judging whether the compensated final three-color gray value exceeds the maximum three-color gray value which can be displayed by the corresponding field display screen, if so, automatically cutting the maximum three-color gray value to be the maximum value, and if not, performing the steps to adopt the original result.

8. An apparatus for differentially displaying relayed video, comprising:

the camera shooting relay broadcasting equipment is used for shooting the same and/or different relay broadcasting pictures of the invisible live video played by the live display screen; the system is also used for shooting and rebroadcasting videos and/or pictures;

the synchronous equipment is used for simultaneously outputting the synchronous locking signal to the controller of the field display screen and each camera shooting relay broadcasting equipment; adjusting a time for opening a shutter of the image pickup relay apparatus by adjusting a start time for opening the shutter and setting a length of time for opening the shutter;

the transmitting card is used for synthesizing the input multi-channel videos into one frame by the controller and transmitting the multi-channel videos to a field display screen for playing in a time-sharing mode, wherein the multi-channel videos comprise rebroadcast videos invisible to naked eyes of field audiences and field videos visible to the field audiences;

the field controller is used for recording the three-color gray value of each pixel point in each frame of video in the camera shooting relay broadcasting equipment through the calculation module and calculating the compensation value of each pixel point;

Rcompensating i(x,y)＝(max i–Rin i(x,y))*lumi camera i/n

Gcompensating i(x,y)＝(max i–Gin i(x,y))*lumi camera i/n

Bcompensating i(x,y)＝(max i–Bin i(x,y))*lumi camera i/n

9. The apparatus for differentiated display of relayed video according to claim 8, further comprising:

10. A machine readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of differentially displaying relayed videos according to any one of claims 1 to 7.