CN113099126A - Image transmission method and device, electronic equipment and storage medium - Google Patents
Image transmission method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113099126A CN113099126A CN201911337810.5A CN201911337810A CN113099126A CN 113099126 A CN113099126 A CN 113099126A CN 201911337810 A CN201911337810 A CN 201911337810A CN 113099126 A CN113099126 A CN 113099126A
- Authority
- CN
- China
- Prior art keywords
- target
- windowing
- bandwidth
- output
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0127—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter
Abstract
The application discloses an image transmission method, an image transmission device, an electronic device and a computer readable storage medium, wherein the method comprises the following steps: determining a target service quantity of a target signal, and determining a transmission bandwidth threshold value and a windowing quantity threshold value based on the target service quantity; when the transmission bandwidth of the input board card is larger than the transmission bandwidth threshold value, calculating an input scaling multiple based on the residual bandwidth, the created service quantity and the target service quantity; when the windowing quantity of the output board card is larger than the windowing quantity threshold value, calculating an output scaling multiple based on the residual bandwidth, the windowed quantity and the target service quantity; and taking the smaller value of the input scaling multiple and the output scaling multiple as a final scaling multiple, and realizing the transmission of the target signal based on the final scaling multiple. Therefore, the image transmission method provided by the application can meet the requirements of creation and transmission of the same service quantity of high-quality signals under the premise of not changing hardware of the splicing processor, and keeps the competitiveness of products.
Description
Technical Field
The present application relates to the field of image processing technologies, and in particular, to an image transmission method and apparatus, an electronic device, and a computer-readable storage medium.
Background
As image quality requirements increase, performance requirements for the stitching processor also increase. For the splicing processor, a hardware architecture of PCIe (peripheral component interconnect express, a high-speed serial computer expansion bus standard) is generally used to implement high-speed transmission of data, but a transmission scheme of PCIe has a limitation of transmission bandwidth, and as a video image requirement advances from 1080P to 4K, the splicing processor cannot meet the transmission requirement.
Therefore, how to make the stitching processor meet the transmission requirement of higher quality images without changing the hardware architecture is a technical problem to be solved by those skilled in the art.
Disclosure of Invention
The present application aims to provide an image transmission method, an image transmission device, an electronic apparatus, and a computer-readable storage medium, which enable a stitching processor to meet the transmission requirement of a higher-quality image without changing a hardware architecture.
To achieve the above object, the present application provides an image transmission method, including:
determining a target traffic quantity of a target signal, and determining a transmission bandwidth threshold value and a windowing quantity threshold value based on the target traffic quantity;
when the transmission bandwidth of the input board card is larger than the transmission bandwidth threshold value, calculating an input scaling multiple based on the residual bandwidth, the created service quantity and the target service quantity;
when the windowing quantity of the output board card is larger than the windowing quantity threshold value, calculating an output scaling multiple based on the residual bandwidth, the windowed quantity and the target service quantity;
and taking the smaller value of the input scaling multiple and the output scaling multiple as a final scaling multiple, and realizing the transmission of the target signal based on the final scaling multiple.
Wherein the target signal comprises a signal with a resolution of 4K and a frame rate of 30.
Wherein the determining the target traffic amount of the target signal includes:
determining the number of input channels of the input board card or the number of output channels of the output board card as the basic service number of the target signal;
determining the target service quantity of the target signal to be a preset multiple of the basic service quantity.
Wherein the determining a transmission bandwidth threshold and a windowing number threshold based on the target traffic number comprises:
determining the transmission bandwidth threshold and the windowing quantity threshold as the basic service quantity.
When the transmission bandwidth of the input board card is greater than the transmission bandwidth threshold, calculating an input scaling multiple based on the remaining bandwidth, the created service quantity and the target service quantity, including:
when the transmission bandwidth of the input board card is larger than the transmission bandwidth threshold, calculating the residual service quantity according to the created service quantity and the target service quantity;
and determining the ratio of the residual bandwidth to the residual service quantity as a residual bandwidth weight, and determining the input scaling multiple based on the residual bandwidth weight.
When the windowing number of the output board card is greater than the windowing number threshold, calculating an output scaling multiple based on the residual bandwidth, the windowed number and the target service number, including:
when the windowing quantity of the output board card is larger than the windowing quantity threshold value, calculating the residual windowing quantity according to the windowed quantity and the target service quantity;
and determining the ratio of the residual bandwidth to the residual windowing quantity as a residual windowing weight value, and determining the output scaling multiple based on the residual windowing weight value.
Wherein, still include:
when an operation command of moving or scaling a first window into a second window is received, determining all target output board cards corresponding to the second window based on the position information of the second window;
calculating a target output scaling multiple corresponding to each target output board card based on the residual bandwidth, the windowed quantity and the target service quantity of each target output board card;
determining a minimum value of all the target output scaling factors as a final output scaling factor, and scaling the second window based on the final output scaling factor.
To achieve the above object, the present application provides an image transmission apparatus comprising:
the device comprises a first determining module, a second determining module and a third determining module, wherein the first determining module is used for determining a target service quantity of a target signal and determining a transmission bandwidth threshold value and a windowing quantity threshold value based on the target service quantity;
the first calculation module is used for calculating an input scaling multiple based on the residual bandwidth, the created service quantity and the target service quantity when the transmission bandwidth of the input board card is larger than the transmission bandwidth threshold;
the second calculation module is used for calculating an output scaling multiple based on the residual bandwidth, the windowed quantity and the target service quantity when the windowing quantity of the output board card is greater than the windowing quantity threshold value;
and the transmission module is used for taking the smaller value of the input scaling multiple and the output scaling multiple as a final scaling multiple and realizing the transmission of the target signal based on the final scaling multiple.
To achieve the above object, the present application provides an electronic device including:
a memory for storing a computer program;
a processor for implementing the steps of the image transmission method as described above when executing the computer program.
To achieve the above object, the present application provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the image transmission method as described above.
According to the scheme, the image transmission method provided by the application comprises the following steps: determining a target traffic quantity of a target signal, and determining a transmission bandwidth threshold value and a windowing quantity threshold value based on the target traffic quantity; when the transmission bandwidth of the input board card is larger than the transmission bandwidth threshold value, calculating an input scaling multiple based on the residual bandwidth, the created service quantity and the target service quantity; when the windowing quantity of the output board card is larger than the windowing quantity threshold value, calculating an output scaling multiple based on the residual bandwidth, the windowed quantity and the target service quantity; and taking the smaller value of the input scaling multiple and the output scaling multiple as a final scaling multiple, and realizing the transmission of the target signal based on the final scaling multiple.
Due to the limitation of the hardware transmission capability of the splicing processor in the related art, the creation and transmission of the same service quantity cannot be satisfied under the condition of improving the signal quality. For example, the splicing processor in the related art can realize transmission of 12 signals with a resolution of 1080P and a frame rate of 60, but when the signal quality is improved to 4K, the transmission capability of 12 signals cannot be satisfied. Taking the signal with the resolution of 4K and the frame rate of 30 as an example, the performance of the splicing processor will be reduced by half, and only the transmission of 6 signals can be realized. Therefore, according to the image transmission method provided by the application, the input scaling factor and the output scaling factor are respectively calculated for the input board card and the output board card, and the smaller value of the input scaling factor and the output scaling factor is used as the final scaling factor for image scaling and transmission. For the input board card, when the transmission bandwidth is greater than the transmission bandwidth threshold, an input scaling multiple is calculated based on the residual bandwidth, the created service quantity and the target service quantity, so that the residual bandwidth meets the requirement of the residual service quantity. For the output board card, when the windowing number of the output board card is greater than the windowing number threshold, the output scaling factor is calculated based on the residual bandwidth, the windowed number and the target service number, so that the residual bandwidth meets the requirement of the residual windowing number. Therefore, the image transmission method provided by the application can meet the requirements of creation and transmission of the same service quantity of high-quality signals under the premise of not changing hardware of the splicing processor, and keeps the competitiveness of products. The application also discloses an image transmission device, an electronic device and a computer readable storage medium, which can also realize the technical effects.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts. The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure without limiting the disclosure. In the drawings:
FIG. 1 is an architectural diagram illustrating an image transmission system according to an exemplary embodiment;
FIG. 2 is a flow diagram illustrating an image transmission method according to an exemplary embodiment;
FIG. 3 is a flow diagram illustrating another method of image transmission according to an exemplary embodiment;
FIG. 4 is a schematic view of a fenestration;
FIG. 5 is a flow chart illustrating yet another method of image transmission according to an exemplary embodiment;
FIG. 6 is a schematic view of another windowing scheme;
FIG. 7 is a block diagram illustrating an image transmission apparatus according to an exemplary embodiment;
FIG. 8 is a block diagram illustrating an electronic device in accordance with an exemplary embodiment.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In order to facilitate understanding of the image transmission method provided in the present application, a system for use thereof will be described below. Referring to fig. 1, an architecture diagram of an image transmission system provided by an embodiment of the present application is shown, as shown in fig. 1, including a plurality of signal input devices 100, a splicing processor 200, and a large screen 300, where the signal input devices 100 and the splicing processor 200, and the splicing processor 200 and the large screen 300 are connected by cables.
The signal input device 100 is a source device of a signal, such as a PC (Personal Computer, and Personal Computer), a video conference terminal, and the like, and is not limited herein.
The splicing processor 200 receives signals of a plurality of signal input devices 100 through cables, calculates a scaling factor based on the target service quantity and the transmission capacities of the input board and the output board, performs scaling processing on the signals transmitted by the signal input devices 100 according to the scaling factor, and outputs the signals to the large screen 300 for display.
The large screen 300 includes a plurality of display areas each for displaying a signal transmitted from one signal input device 100 or a plurality of display areas for displaying a signal transmitted from one signal input device 100, which are determined according to the zoom factor calculated by the stitching processor 200. The image transmission system provided by the embodiment can realize the functions of free movement of pictures, batch switching of large-screen pictures, enlargement of video pictures to a larger screen and the like.
The embodiment of the application discloses an image transmission method, which enables a splicing processor to meet the transmission requirement of a higher-quality image on the premise of not changing a hardware architecture.
Referring to fig. 2, a flowchart of an image transmission method according to an exemplary embodiment is shown, as shown in fig. 2, including:
s101: determining a target traffic quantity of a target signal, and determining a transmission bandwidth threshold value and a windowing quantity threshold value based on the target traffic quantity;
the implementation subject of this embodiment is the stitching processor 200 in the image transmission system, and in this step, the target traffic amount that needs to be realized by the target signal is determined, where the target signal is a high-quality signal, for example, a signal with a resolution of 4k and a frame rate of 30.
As an optional implementation, the determining the target traffic amount of the target signal includes: determining the number of input channels of the input board card or the number of output channels of the output board card as the basic service number of the target signal; determining the target service quantity of the target signal to be a preset multiple of the basic service quantity. In a specific implementation, the target traffic amount of the target signal may be determined based on the number of channels of the input board and the output board. For example, if the number of input channels of the input board card and the number of output channels of the output board card are both 4, the number of basic services of the target signal is 4. In order to implement redundancy backup of signals, each input signal needs to output two output signals, that is, the preset multiple is 2, and the target service number of the target signal is 8.
And determining a transmission bandwidth threshold of the input board card and a windowing number threshold of the output board card based on the target service number required to be realized by the target signal. It can be understood that, if the splicing processor can implement transmission of 12 channels of signals with a resolution of 1080P and a frame rate of 60, when the signal quality is improved to 4K, taking the signals with the resolution of 4K and the frame rate of 30 as an example, the performance of the splicing processor will be reduced by half, and each input board card can only implement transmission of 6 channels of signals. Therefore, the transmission bandwidth threshold may be set to 4, i.e., the number of basic services of the target signal. As can be seen from the above analysis, each output board card can also implement transmission in 6 windowing regions, where the area of the windowing region is the area covering the entire large screen 300, and the threshold value of the number of windowing regions covering the entire large screen 300 can be set to 4, that is, the number of basic services of the target signal. That is, as a possible implementation, the determining the transmission bandwidth threshold and the windowing number threshold based on the target traffic number includes: determining the transmission bandwidth threshold and the windowing quantity threshold as the basic service quantity.
S102: when the transmission bandwidth of the input board card is larger than the transmission bandwidth threshold value, calculating an input scaling multiple based on the residual bandwidth, the created service quantity and the target service quantity;
this step is intended to calculate the input zoom factor of the input board. In specific implementation, when the transmission bandwidth of the output board card is less than or equal to the transmission bandwidth threshold, the input scaling multiple is the scaling multiple defined by the current target signal, when the transmission bandwidth of the output board card is greater than the transmission bandwidth threshold, the remaining bandwidth needs to be counted, and the input scaling multiple is calculated according to the remaining bandwidth, the created service quantity and the target service quantity, so that the remaining bandwidth can meet the requirement of the remaining service quantity, where the remaining service quantity is the difference between the target service quantity and the created service quantity.
In the process of counting the remaining bandwidth, the capability of the input board card to transmit 1080P @60 signals per channel (i.e., the resolution is 1080P and the frame rate is 60) may be set to be 100, and if each input board card can transmit 12 channels of 1080P @60 signals, the bandwidth transmission capability of each input board card is 1200, and the transmission capability of the output board card is the same. For transmission, the two ends of input and output are included, and for a specific path of service, the transmission bandwidths consumed by the input and the output are consistent, so for the specific path of service, the input and the output only need to use the same bandwidth for statistics. When a path of 1080P @60 signal is created, the signal is input into the splicing processor through the input board card and is output to the large screen through the output board card. If the window area at this time is 1/4 of one windowing region, for the input, it is necessary to transmit 1080P @60 signals to the output, and it should occupy 100 transmission capacity, and for the output, the window area only occupies 1/4 of one windowing region, and only 1/4 transmission bandwidth, that is, 25 transmission capacity, is necessary, and the actual transmission bandwidth is 25.
When the above-mentioned idea of bandwidth statistics is applied to the transmission process of the target signal, the bandwidth for transmitting 1 path of target signal may be set to 1, and for a 4K @30 (i.e. resolution is 4K, frame rate is 30) signal, the maximum transmission bandwidth of each input board is 6, and the current residual bandwidth may be obtained through statistics based on the above-mentioned method.
S103: when the windowing quantity of the output board card is larger than the windowing quantity threshold value, calculating an output scaling multiple based on the residual bandwidth, the windowed quantity and the target service quantity;
this step aims to calculate the input scaling factor of the output board card. In specific implementation, when the windowing number of the output board card is less than or equal to the windowing number threshold, the output scaling multiple is the scaling multiple defined by the current target signal, when the windowing number of the output board card is greater than the windowing number threshold, the remaining bandwidth needs to be counted, and the output scaling multiple is calculated according to the remaining bandwidth, the windowed number and the target service number, so that the remaining bandwidth can meet the requirement of the remaining windowing number, where the remaining windowing number is the difference between the target service number and the windowed number.
S104: and taking the smaller value of the input scaling multiple and the output scaling multiple as a final scaling multiple, and realizing the transmission of the target signal based on the final scaling multiple.
In this step, the smaller value of the input zoom factor and the output zoom factor calculated in the previous step is used as the final zoom factor, so as to zoom the current target signal, and the zoomed signal is transmitted to a large screen for display.
According to the image transmission method provided by the embodiment of the application, the input scaling factor and the output scaling factor are respectively calculated for the input board card and the output board card, and the smaller value of the input scaling factor and the output scaling factor is used as the final scaling factor for image scaling and transmission. For the input board card, when the transmission bandwidth is greater than the transmission bandwidth threshold, an input scaling multiple is calculated based on the residual bandwidth, the created service quantity and the target service quantity, so that the residual bandwidth meets the requirement of the residual service quantity. For the output board card, when the windowing number of the output board card is greater than the windowing number threshold, the output scaling factor is calculated based on the residual bandwidth, the windowed number and the target service number, so that the residual bandwidth meets the requirement of the residual windowing number. Therefore, the image transmission method provided by the embodiment of the application can meet the requirements of creation and transmission of the same service quantity of high-quality signals under the premise of not changing hardware of the splicing processor, and keeps the competitiveness of products.
The embodiment of the application discloses an image transmission method, and compared with the previous embodiment, the embodiment further explains and optimizes the technical scheme. Specifically, the method comprises the following steps:
referring to fig. 3, a flowchart of another image transmission method according to an exemplary embodiment is shown, as shown in fig. 3, including:
s201: determining the number of input channels of the input board card or the number of output channels of the output board card as the basic service number of the target signal;
s202: determining the target service quantity of the target signal as a preset multiple of the basic service quantity;
s203: determining a transmission bandwidth threshold and a windowing quantity threshold as the basic service quantity;
s204: when the transmission bandwidth of the input board card is larger than the transmission bandwidth threshold, calculating the residual service quantity according to the created service quantity and the target service quantity;
s205: determining the ratio of the residual bandwidth to the residual service quantity as a residual bandwidth weight, and determining the input scaling multiple based on the residual bandwidth weight;
in a specific implementation, when the remaining bandwidth weight is greater than or equal to 1, the input scaling factor is the scaling factor defined by the current target signal, when the remaining bandwidth weight is less than 1 and greater than or equal to the first preset value, the input scaling factor is the smaller value of the scaling factor defined by the current target signal and the first preset value, when the remaining bandwidth weight is less than the first preset value, the input scaling factor is the smaller value of the scaling factor defined by the current target signal and the second preset value, it can be understood that the second preset value is a value less than the first preset value and greater than 0.
For example, the determination rule for defining the input zoom factor is: when the remaining bandwidth weight is greater than or equal to 1, the input scaling multiple is the scaling multiple defined by the current target signal, when the remaining bandwidth weight is less than 1 and greater than or equal to 0.75, the input scaling multiple is the smaller of the scaling multiple defined by the current target signal and 0.75, and when the remaining bandwidth weight is less than 0.75, the input scaling multiple is the smaller of the scaling multiple defined by the current target signal and 0.5. If the current remaining bandwidth is 2, the created traffic amount is 4, and the target traffic amount is 8, the remaining bandwidth weight is 2/(8-4) ═ 0.5, and the scaling factor defined by the current target signal is 1, then the calculated input scaling factor is 0.5.
S206: when the windowing quantity of the output board card is larger than the windowing quantity threshold value, calculating the residual windowing quantity according to the windowed quantity and the target service quantity;
s207: determining the ratio of the residual bandwidth to the residual windowing quantity as a residual windowing weight value, and determining the output scaling multiple based on the residual windowing weight value;
in a specific implementation, when the remaining windowing weight is greater than or equal to 1, the output scaling factor is the scaling factor defined by the current target signal, when the remaining windowing weight is less than 1 and greater than or equal to the first preset value, the output scaling factor is the smaller value between the scaling factor defined by the current target signal and the first preset value, and when the remaining windowing weight is less than the first preset value, the output scaling factor is the smaller value between the scaling factor defined by the current target signal and the second preset value, it can be understood that the second preset value is a value less than the first preset value and greater than 0.
For example, the determination rule for defining the output scaling factor is: when the remaining windowing weight value is greater than or equal to 1, the output scaling multiple is the scaling multiple defined by the current target signal, when the remaining windowing weight value is less than 1 and greater than or equal to 0.75, the output scaling multiple is the smaller value of the scaling multiple defined by the current target signal and 0.75, and when the remaining windowing weight value is less than 0.75, the output scaling multiple is the smaller value of the scaling multiple defined by the current target signal and 0.5. As shown in fig. 4, the one-way shaded area represents a windowed area, the non-shaded area represents a non-windowed area, at this time, the number of windowed areas is 4, 4 transmission bandwidths are already occupied, the remaining bandwidth is 2, and therefore, the remaining windowing weight is 0.5, that is, from the bandwidth remaining point of view, the current target signal (i.e., the two-way shaded area in the figure) should reduce the transmission bandwidth to 0.5, and if the scaling factor defined by the current target signal is 0.25, since 0.25<0.5, the output scaling factor is 0.25.
S208: and taking the smaller value of the input scaling multiple and the output scaling multiple as a final scaling multiple, and realizing the transmission of the target signal based on the final scaling multiple.
Therefore, in this embodiment, the ratio of the remaining bandwidth to the remaining service number is determined as a remaining bandwidth weight, and an input scaling multiple is determined based on the remaining bandwidth weight, so that the remaining bandwidth can meet the requirement of the remaining service number. And determining the ratio of the residual bandwidth to the residual windowing quantity as a residual windowing weight value, and determining an output scaling multiple based on the residual windowing weight value, so that the residual bandwidth can meet the requirement of the residual windowing quantity. Under the precondition of not changing the hardware of the splicing processor, the requirements of creating and transmitting the same service quantity of high-quality signals can be met
The embodiment of the application discloses an image transmission method which can realize the moving and scaling of any window. Specifically, the method comprises the following steps:
referring to fig. 5, a flowchart of yet another image transmission method according to an exemplary embodiment is shown, as shown in fig. 5, including:
s301: when an operation command of moving or scaling a first window into a second window is received, determining all target output board cards corresponding to the second window based on the position information of the second window;
it can be understood that the splicing processor supports arbitrary scaling and moving of the window, and therefore in an actual service operation process, the window is on a current output board card originally, but occupies other board cards after operation, and at this time, a situation that the service does not need to be scaled before moving or scaling, and scaling is needed after moving or scaling occurs. Therefore, in this embodiment, when an operation command for moving or scaling the first window into the second window is received, the scaling factor of the moved or scaled second window is recalculated.
In this step, all target output boards corresponding to the second window are determined based on the position information of the second window. For example, as shown in fig. 6, 4 windowing regions in the first row belong to the output board 1, 4 windowing regions in the second row belong to the output board 2, and the second window is a bidirectional shadow region, where all target output boards corresponding to the second window include the output board 1 and the output board 2.
S302: calculating a target output scaling multiple corresponding to each target output board card based on the residual bandwidth, the windowed quantity and the target service quantity of each target output board card;
in this step, the target output scaling factor corresponding to each target output board card is calculated based on the remaining bandwidth, the windowed number, and the target service number of each target output board card, and the specific calculation manner is described in detail in the previous embodiment, which is not described herein again.
S303: determining a minimum value of all the target output scaling factors as a final output scaling factor, and scaling the second window based on the final output scaling factor.
In this step, the minimum value of all the target output scaling factors is determined as the final output scaling factor, and the second window is scaled based on the final output scaling factor. In fig. 6, the number of output boards 1 that have been windowed is 4, and the number of output boards 2 that have been windowed is 3. In this case, for the double-hatched area, the scaling calculated according to the upper half (i.e. the part in the output board 1) is 0.5, and the scaling calculated according to the lower half (i.e. the part in the output board 2) is 1, so the whole final output scaling factor should be 0.5.
Therefore, the splicing processor in the embodiment supports arbitrary scaling and moving of the window, and recalculates the scaling multiple of the window after moving or scaling. Under the condition of not influencing the content of the large-screen picture, the content of the large-screen display picture is ensured not to be lost after moving or zooming operation, and the service does not need to be reconstructed.
For convenience of understanding, the image transmission system may be an operation screen of a command center, which is described in conjunction with an application scenario of the present application. Referring to fig. 1, the signal input device 100 is an operation device for different operators, and the large screen 300 is used for displaying operation screens of different operators. Firstly, setting the hardware capability of the splicing processor: the number of input channels of each input board card and the number of output channels of each output board card are both 4, the transmission bandwidth of each input board card and the transmission bandwidth of each output board card are both 12-channel 1080P @60, one input channel is output to one output channel, full-screen display is carried out, 1-channel 1080P @60 transmission bandwidth is occupied, and on one input board card, 2-channel videos are output on each channel on average.
The quality requirement of the current signal is 4K @30, for the transmission bandwidth capability of 12-way 1080P @60, the video service of 4K @30 is completely applied, 12/2 ═ 6-way can be realized, in order to realize that each input can output 2 videos, the transmission bandwidth of 4K @30 of 2-way is reduced on the transmission capability, in order to prevent the service of the input board from building service to one output port all the time, a window with 2 times of windowing area can be created on each output port.
Under the condition that the bandwidth of the output board card is enough, after the bandwidth of the input board card exceeds 4 paths of transmission bandwidth, judging the average bandwidth weight of the number of the remained on-wall channels, assuming that the remained bandwidth is X and the established service number is Y, the remained bandwidth weight is X/(8-Y), if the remained bandwidth weight is more than 1, zooming according to the zoom ratio of the on-wall window, if the remained bandwidth weight is more than 0.75, zooming according to the minimum value of the zoom ratio of the on-wall window of 0.75, and if the remained bandwidth weight is less than 0.75, zooming according to the minimum value of the zoom ratio of the on-wall window of 0.5.
Under the condition that the bandwidth of an input board card is enough, for an output board card, after the bandwidth exceeds 4 times of the windowing area, calculating a residual average bandwidth weight according to 8 full-windowing windows, assuming that the residual bandwidth is X and the windowed area is Y times of the full-windowing area, the residual windowing weight is X/(8-Y), if the residual windowing weight is greater than 1, zooming according to the upper wall window zooming ratio, if the residual windowing weight is greater than 0.75, zooming according to the minimum value of the upper wall window zooming ratio of 0.75, and if the residual windowing weight is less than 0.75, zooming according to the minimum value of the upper wall window zooming ratio of 0.5.
Based on the scaling strategy, two paths of services can be averagely output to the output from one input channel.
An image transmission apparatus provided in an embodiment of the present application is described below, and an image transmission apparatus described below and an image transmission method described above may be referred to each other.
Referring to fig. 7, a block diagram of an image transmission apparatus according to an exemplary embodiment is shown, as shown in fig. 7, including:
a first determining module 701, configured to determine a target traffic amount of a target signal, and determine a transmission bandwidth threshold and a windowing amount threshold based on the target traffic amount;
a first calculating module 702, configured to calculate an input scaling factor based on the remaining bandwidth, the created service quantity, and the target service quantity when the transmission bandwidth of the input board is greater than the transmission bandwidth threshold;
a second calculating module 703, configured to calculate an output scaling factor based on the remaining bandwidth, the windowed number, and the target service number when the windowed number of the output board card is greater than the windowed number threshold;
a transmission module 704, configured to use the smaller value of the input scaling factor and the output scaling factor as a final scaling factor, and implement transmission of the target signal based on the final scaling factor.
The image transmission device provided by the embodiment of the application calculates the input scaling factor and the output scaling factor respectively aiming at the input board card and the output board card, and performs image scaling and transmission by taking the smaller value of the input scaling factor and the output scaling factor as the final scaling factor. For the input board card, when the transmission bandwidth is greater than the transmission bandwidth threshold, an input scaling multiple is calculated based on the residual bandwidth, the created service quantity and the target service quantity, so that the residual bandwidth meets the requirement of the residual service quantity. For the output board card, when the windowing number of the output board card is greater than the windowing number threshold, the output scaling factor is calculated based on the residual bandwidth, the windowed number and the target service number, so that the residual bandwidth meets the requirement of the residual windowing number. Therefore, the image transmission device provided by the embodiment of the application can meet the requirements of creation and transmission of the same service quantity of high-quality signals under the precondition that the hardware of the splicing processor is not changed, and the competitiveness of products is kept.
On the basis of the above embodiment, as a preferred implementation, the target signal includes a signal with a resolution of 4K and a frame rate of 30.
On the basis of the foregoing embodiment, as a preferred implementation, the first determining module 701 includes:
a first determining unit, configured to determine, as the basic service number of the target signal, the number of input channels of the input board card or the number of output channels of the output board card;
a second determining unit, configured to determine that the target service quantity of the target signal is a preset multiple of the basic service quantity;
a third determining unit, configured to determine a transmission bandwidth threshold and a windowing number threshold based on the target traffic number.
On the basis of the foregoing embodiment, as a preferred implementation manner, the third determining unit specifically determines the transmission bandwidth threshold and the windowing quantity threshold as the basic service quantity.
On the basis of the foregoing embodiment, as a preferred implementation, the first computing module 702 includes:
the first calculating unit is used for calculating the residual service quantity according to the created service quantity and the target service quantity when the transmission bandwidth of the input board card is larger than the transmission bandwidth threshold;
a fourth determining unit, configured to determine a ratio of the remaining bandwidth to the remaining service number as a remaining bandwidth weight, and determine the input scaling factor based on the remaining bandwidth weight.
On the basis of the foregoing embodiment, as a preferred implementation, the second computing module 703 includes:
the second calculating unit is used for calculating the residual windowing quantity according to the windowed quantity and the target service quantity when the windowing quantity of the output board card is larger than the windowing quantity threshold value;
and the fifth determining unit is used for determining the ratio of the residual bandwidth to the residual windowing quantity as a residual windowing weight value and determining the output scaling multiple based on the residual windowing weight value.
On the basis of the above embodiment, as a preferred implementation, the method further includes:
the second determining module is used for determining all target output board cards corresponding to a second window based on the position information of the second window when an operation command of moving or scaling the first window into the second window is received;
a third calculating module, configured to calculate a target output scaling factor corresponding to each target output board card based on the remaining bandwidth, the windowed number, and the target service number of each target output board card;
and the scaling module is used for determining the minimum value of all the target output scaling factors as a final output scaling factor and scaling the second window based on the final output scaling factor.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
The present application further provides an electronic device, and referring to fig. 8, a structure diagram of an electronic device 200 provided in an embodiment of the present application, as shown in fig. 8, may include a processor 11 and a memory 12. The electronic device 200 may also include one or more of a multimedia component 13, an input/output (I/O) interface 14, and a communication component 15.
The processor 11 is configured to control the overall operation of the electronic device 200, so as to complete all or part of the steps in the image transmission method. The memory 12 is used to store various types of data to support operation at the electronic device 200, such as instructions for any application or method operating on the electronic device 200 and application-related data, such as contact data, transmitted and received messages, pictures, audio, video, and so forth. The Memory 12 may be implemented by any type of volatile or non-volatile Memory device or combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic Memory, flash Memory, magnetic disk or optical disk. The multimedia component 13 may include a screen and an audio component. Wherein the screen may be, for example, a touch screen and the audio component is used for outputting and/or inputting audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signal may further be stored in the memory 12 or transmitted via the communication component 15. The audio assembly also includes at least one speaker for outputting audio signals. The I/O interface 14 provides an interface between the processor 11 and other interface modules, such as a keyboard, mouse, buttons, etc. These buttons may be virtual buttons or physical buttons. The communication module 15 is used for wired or wireless communication between the electronic device 200 and other devices. Wireless Communication, such as Wi-Fi, bluetooth, Near Field Communication (NFC), 2G, 3G or 4G, or a combination of one or more of them, so that the corresponding Communication component 15 may include: Wi-Fi module, bluetooth module, NFC module.
In an exemplary embodiment, the electronic Device 200 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the image transmission method described above.
In another exemplary embodiment, there is also provided a computer readable storage medium comprising program instructions which, when executed by a processor, implement the steps of the above-described image transmission method. For example, the computer readable storage medium may be the memory 12 described above including program instructions that are executable by the processor 11 of the electronic device 200 to perform the image transmission method described above.
The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. An image transmission method, comprising:
determining a target traffic quantity of a target signal, and determining a transmission bandwidth threshold value and a windowing quantity threshold value based on the target traffic quantity;
when the transmission bandwidth of the input board card is larger than the transmission bandwidth threshold value, calculating an input scaling multiple based on the residual bandwidth, the created service quantity and the target service quantity;
when the windowing quantity of the output board card is larger than the windowing quantity threshold value, calculating an output scaling multiple based on the residual bandwidth, the windowed quantity and the target service quantity;
and taking the smaller value of the input scaling multiple and the output scaling multiple as a final scaling multiple, and realizing the transmission of the target signal based on the final scaling multiple.
2. The image transmission method according to claim 1, wherein the target signal includes a signal having a resolution of 4K and a frame rate of 30.
3. The image transmission method according to claim 1, wherein the determining the target traffic amount of the target signal comprises:
determining the number of input channels of the input board card or the number of output channels of the output board card as the basic service number of the target signal;
determining the target service quantity of the target signal to be a preset multiple of the basic service quantity.
4. The image transmission method according to claim 3, wherein the determining a transmission bandwidth threshold and a windowing number threshold based on the target traffic number comprises:
determining the transmission bandwidth threshold and the windowing quantity threshold as the basic service quantity.
5. The image transmission method according to claim 1, wherein when the transmission bandwidth of the input board card is greater than the transmission bandwidth threshold, calculating an input scaling factor based on the remaining bandwidth, the created traffic amount, and the target traffic amount includes:
when the transmission bandwidth of the input board card is larger than the transmission bandwidth threshold, calculating the residual service quantity according to the created service quantity and the target service quantity;
and determining the ratio of the residual bandwidth to the residual service quantity as a residual bandwidth weight, and determining the input scaling multiple based on the residual bandwidth weight.
6. The image transmission method according to claim 1, wherein when the windowing number of the output board card is greater than the windowing number threshold, calculating an output scaling factor based on the remaining bandwidth, the windowed number, and the target traffic number comprises:
when the windowing quantity of the output board card is larger than the windowing quantity threshold value, calculating the residual windowing quantity according to the windowed quantity and the target service quantity;
and determining the ratio of the residual bandwidth to the residual windowing quantity as a residual windowing weight value, and determining the output scaling multiple based on the residual windowing weight value.
7. The image transmission method according to any one of claims 1 to 6, further comprising:
when an operation command of moving or scaling a first window into a second window is received, determining all target output board cards corresponding to the second window based on the position information of the second window;
calculating a target output scaling multiple corresponding to each target output board card based on the residual bandwidth, the windowed quantity and the target service quantity of each target output board card;
determining a minimum value of all the target output scaling factors as a final output scaling factor, and scaling the second window based on the final output scaling factor.
8. An image transmission apparatus, comprising:
the device comprises a first determining module, a second determining module and a third determining module, wherein the first determining module is used for determining a target service quantity of a target signal and determining a transmission bandwidth threshold value and a windowing quantity threshold value based on the target service quantity;
the first calculation module is used for calculating an input scaling multiple based on the residual bandwidth, the created service quantity and the target service quantity when the transmission bandwidth of the input board card is larger than the transmission bandwidth threshold;
the second calculation module is used for calculating an output scaling multiple based on the residual bandwidth, the windowed quantity and the target service quantity when the windowing quantity of the output board card is greater than the windowing quantity threshold value;
and the transmission module is used for taking the smaller value of the input scaling multiple and the output scaling multiple as a final scaling multiple and realizing the transmission of the target signal based on the final scaling multiple.
9. An electronic device, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the image transmission method according to any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the image transmission method according to one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911337810.5A CN113099126B (en) | 2019-12-23 | 2019-12-23 | Image transmission method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911337810.5A CN113099126B (en) | 2019-12-23 | 2019-12-23 | Image transmission method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113099126A true CN113099126A (en) | 2021-07-09 |
| CN113099126B CN113099126B (en) | 2022-12-23 |
Family
ID=76662842
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911337810.5A Active CN113099126B (en) | 2019-12-23 | 2019-12-23 | Image transmission method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113099126B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110176602A1 (en) * | 2010-01-21 | 2011-07-21 | Qualcomm Incorporated | Systems and methods for interfacing a white space device with a host device |
| CN102843522A (en) * | 2011-06-24 | 2012-12-26 | 北京彩讯科技股份有限公司 | Video stitching processing card based on PCIE, as well as control system and control method for video stitching processing card |
| CN103037170A (en) * | 2011-10-10 | 2013-04-10 | 杭州海康威视数字技术股份有限公司 | Surveillance video matrix system, network and cascade switch and band width adjustment methods of surveillance video matrix system |
| CN103501418A (en) * | 2013-09-17 | 2014-01-08 | 广东威创视讯科技股份有限公司 | Image resizing splicing method and system and image resizing splicing control device |
| CN108111912A (en) * | 2017-12-15 | 2018-06-01 | 深圳Tcl新技术有限公司 | Image transfer method, terminal and storage medium in multi-screen interactive |
| CN109510951A (en) * | 2019-01-16 | 2019-03-22 | 深圳市康帕斯科技发展有限公司 | A kind of super fusion video server of multi-functional hardware |
-
2019
- 2019-12-23 CN CN201911337810.5A patent/CN113099126B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110176602A1 (en) * | 2010-01-21 | 2011-07-21 | Qualcomm Incorporated | Systems and methods for interfacing a white space device with a host device |
| CN102843522A (en) * | 2011-06-24 | 2012-12-26 | 北京彩讯科技股份有限公司 | Video stitching processing card based on PCIE, as well as control system and control method for video stitching processing card |
| CN103037170A (en) * | 2011-10-10 | 2013-04-10 | 杭州海康威视数字技术股份有限公司 | Surveillance video matrix system, network and cascade switch and band width adjustment methods of surveillance video matrix system |
| CN103501418A (en) * | 2013-09-17 | 2014-01-08 | 广东威创视讯科技股份有限公司 | Image resizing splicing method and system and image resizing splicing control device |
| CN108111912A (en) * | 2017-12-15 | 2018-06-01 | 深圳Tcl新技术有限公司 | Image transfer method, terminal and storage medium in multi-screen interactive |
| CN109510951A (en) * | 2019-01-16 | 2019-03-22 | 深圳市康帕斯科技发展有限公司 | A kind of super fusion video server of multi-functional hardware |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113099126B (en) | 2022-12-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112135059B (en) | Shooting method, shooting device, electronic equipment and storage medium | |
| CN107517482B (en) | Data transmission method and device | |
| CN110032701B (en) | Image display control method and device, storage medium and electronic equipment | |
| CN105554429A (en) | Video conversation display method and video conversation equipment | |
| CN112256231B (en) | Volume control method, device, terminal and storage medium | |
| CN110825997A (en) | Information flow page display method and device, terminal equipment and system | |
| JP2023528311A (en) | VIDEO CALL INTERFACE DISPLAY CONTROL METHOD, DEVICE, STORAGE MEDIUM AND DEVICE | |
| CN105554430A (en) | Video call method, system and device | |
| CN113721807B (en) | Information display method and device, electronic equipment and storage medium | |
| CN113099126B (en) | Image transmission method and device, electronic equipment and storage medium | |
| KR20160099977A (en) | Data processing apparatus and data processing method for videoconferencing service | |
| CN114040144A (en) | Video call method and electronic equipment | |
| CN112261408B (en) | Image processing method and device for head-mounted display equipment and electronic equipment | |
| KR102201659B1 (en) | Video display modification for video environments | |
| CN115469816B (en) | Method, device, equipment and storage medium for switching reading and writing of memory | |
| CN114125367A (en) | Method, apparatus and related product for processing display of video conference pictures | |
| CN112256172B (en) | Application display method, device, terminal and storage medium | |
| CN114356568A (en) | Information processing method, information processing device, electronic equipment and storage medium | |
| CN114760309A (en) | Business interaction method, device, equipment and medium of terminal based on cloud service | |
| CN111832279B (en) | Text partitioning method, apparatus, device and computer readable medium | |
| CN115079917A (en) | Display control method, display control device, electronic equipment and storage medium | |
| CN114092362A (en) | Panoramic picture loading method and device | |
| CN111585784A (en) | Network slice deployment method and device | |
| CN112312224A (en) | Information display method and device and electronic equipment | |
| CN112118233B (en) | Data transmission method, device, system and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |