CN113055675A - Image transmission method and device and video processing equipment - Google Patents
Image transmission method and device and video processing equipment Download PDFInfo
- Publication number
- CN113055675A CN113055675A CN201911370172.7A CN201911370172A CN113055675A CN 113055675 A CN113055675 A CN 113055675A CN 201911370172 A CN201911370172 A CN 201911370172A CN 113055675 A CN113055675 A CN 113055675A
- Authority
- CN
- China
- Prior art keywords
- image
- sub
- transmitted
- transmission
- pixel area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/156—Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The embodiment of the invention discloses an image transmission method and device and video processing equipment. The method for example comprises: acquiring the required transmission bandwidth of an image to be transmitted and the effective bandwidth of a single transmission channel; determining the division number M of the image to be transmitted according to the effective bandwidth and the required transmission bandwidth, wherein the required transmission bandwidth is larger than the effective bandwidth, and M is a positive integer larger than 1; dividing the image to be transmitted into M sub-images based on the division number M, wherein the required transmission bandwidth of each sub-image is smaller than the effective bandwidth; caching the M sub-images; and sending the cached M sub-images to M transmission channels according to respective output time sequences for transmission. The embodiment of the invention can realize the transmission of the image to be transmitted under the condition that the required transmission bandwidth of the image to be transmitted exceeds the effective bandwidth of a single transmission channel.
Description
Technical Field
The present invention relates to the field of data transmission technologies, and in particular, to an image transmission method, an image transmission device, and a video processing apparatus.
Background
With the development of video technology, an input interface of a video processing device is required to support input video of a plurality of video formats (e.g., 4K × 2K @30Hz, 1080P @60Hz, 720@ P @60Hz, etc., and for video of a format of 4K × 2K @30Hz, 4K × 2K is the resolution of the video, and 30Hz is the frame frequency of the video), so that the compatibility and processing capability of the input interface in the video processing device are very important. With the increase of the resolution and the frame frequency of the video, the data bandwidth required by video transmission also increases, however, the effective bandwidth of a single transmission channel for transmitting the video is limited, and how to realize the transmission of the image to be transmitted is an urgent problem to be solved when the required transmission bandwidth of the image to be transmitted exceeds the effective bandwidth of the single transmission channel.
Disclosure of Invention
Therefore, to overcome the defects and shortcomings in the prior art, embodiments of the present invention provide an image transmission method, an image transmission apparatus, and a video processing device, which are capable of implementing transmission of an image to be transmitted under the condition that a required transmission bandwidth of the image to be transmitted exceeds an effective bandwidth of a single transmission channel.
In one aspect, an image transmission method provided in an embodiment of the present invention includes: acquiring the required transmission bandwidth of an image to be transmitted and the effective bandwidth of a single transmission channel; determining the division number M of the image to be transmitted according to the effective bandwidth and the required transmission bandwidth, wherein the required transmission bandwidth is larger than the effective bandwidth, and M is a positive integer larger than 1; dividing the image to be transmitted into M sub-images based on the division number M, wherein the required transmission bandwidth of each sub-image is smaller than the effective bandwidth; caching the M sub-images; and sending the cached M sub-images to M transmission channels according to respective output time sequences for transmission.
In the above scheme, the required transmission bandwidth of the image to be transmitted and the effective bandwidth of a single transmission channel are first obtained by the image transmission method, then the division number M of the image to be transmitted is determined according to the required transmission bandwidth and the effective bandwidth, wherein the required transmission bandwidth of the image to be transmitted is greater than the effective bandwidth of the single transmission channel, then the image to be transmitted is divided into M sub-images based on the determined division number M and cached, and finally the cached M sub-images are sent to the M transmission channels for transmission according to respective output timings.
In an embodiment of the present invention, the dividing the image to be transmitted into M sub-images based on the division number M includes: determining an effective pixel area of each sub-image; determining the number of pixels of the effective pixel area extended outwards on each segmentation side of the sub-image according to the scaling parameters to obtain an extended pixel area, wherein the extended pixel area is connected with the effective pixel area; and carrying out segmentation processing on the image to be transmitted according to the effective image area and the continuation pixel area to obtain the sub-image.
In an embodiment of the present invention, the dividing the image to be transmitted into M sub-images based on the division number M includes: determining an effective pixel area of each sub-image; determining the number of pixels extended outwards from each segmentation side of the sub-image according to the pixel point of the effective pixel area, which is required by the pixel point of each segmentation side of the sub-image during zooming, so as to obtain an extension pixel area, wherein the extension pixel area is connected with the effective pixel area; and carrying out segmentation processing on the image to be transmitted according to the effective image area and the continuation pixel area to obtain the sub-image.
In an embodiment of the present invention, the dividing the image to be transmitted into M sub-images based on the division number M includes: determining an effective pixel area of each sub-image; determining the number of pixels of the effective pixel area extended outwards on each segmentation side of the sub-image according to a preset extension value to obtain an extension pixel area, wherein the extension pixel area is connected with the effective pixel area; and carrying out segmentation processing on the image to be transmitted according to the effective image area and the continuation pixel area to obtain the sub-image.
In one embodiment of the present invention, the image transmission method further includes: before the M cached sub-images are sent to M transmission channels according to respective output time sequences to be transmitted, generating the output time sequence of each sub-image according to the original time sequence of the image to be transmitted; wherein the generating the output timing for each of the sub-images according to the original timing for the image to be transmitted comprises: generating a field synchronizing signal, a line synchronizing signal and a data enabling signal in the output time sequence of each sub-image according to the field synchronizing signal, the line synchronizing signal and the data enabling signal in the original time sequence of the image to be transmitted; and converting the number of pixels per clock in the original time sequence of the image to be transmitted to 1PPC as the number of pixels per clock in the output time sequence of each sub-image.
In another aspect, an embodiment of the present invention provides an image transmission apparatus, including: the acquisition module is used for acquiring the required transmission bandwidth of the image to be transmitted and the effective bandwidth of a single transmission channel; the determining module is used for determining the division number M of the image to be transmitted according to the effective bandwidth and the required transmission bandwidth, wherein the required transmission bandwidth is larger than the effective bandwidth, and M is a positive integer larger than 1; a dividing module, configured to divide the image to be transmitted into M sub-images based on the division number M, where a required transmission bandwidth of each sub-image is smaller than the effective bandwidth; the M caching modules are used for caching the M sub-images respectively; and the M sending modules are used for respectively sending the cached M sub-images to the M transmission channels according to respective output time sequences so as to carry out transmission.
In the above scheme, the image transmission device can realize the transmission of the image to be transmitted under the condition that the required transmission bandwidth of the image to be transmitted exceeds the effective bandwidth of a single transmission channel, specifically, the acquisition module acquires the required transmission bandwidth of the image to be transmitted and the effective bandwidth of the single transmission channel at first, then, a determining module determines the division number M of the image to be transmitted according to the required transmission bandwidth and the size of the effective bandwidth, the required transmission bandwidth of the image to be transmitted is larger than the effective bandwidth of a single transmission channel, then the segmentation module segments the image to be transmitted into M sub-images based on the determined segmentation number M, the M sub-images are cached through the M caching modules, and finally the M sending modules send the cached M sub-images to the M transmission channels for transmission according to respective output time sequences.
In one embodiment of the invention, the segmentation module comprises: a determination unit configured to determine an effective pixel area of each of the sub-images; the continuation unit is used for determining the number of pixels of the effective pixel area which are extended outwards on each segmentation side of the sub-image according to the scaling parameters so as to obtain a continuation pixel area, wherein the continuation pixel area is connected with the effective pixel area; and the segmentation unit is used for segmenting the image to be transmitted according to the effective image area and the continuation pixel area to obtain the sub-image.
In one embodiment of the present invention, the image transmission apparatus further includes: the time sequence generation module is used for generating the output time sequence of each sub-image according to the original time sequence of the image to be transmitted; wherein the timing generation module is specifically configured to: generating a field synchronizing signal, a line synchronizing signal and a data enabling signal in the output time sequence of each sub-image according to the field synchronizing signal, the line synchronizing signal and the data enabling signal in the original time sequence of the image to be transmitted; and converting the number of pixels per clock in the original time sequence of the image to be transmitted to 1PPC as the number of pixels per clock in the output time sequence of each sub-image.
In another aspect, an embodiment of the present invention provides a video processing apparatus, including: an input card, a matrix switching module, and a plurality of transmission channels electrically connected between the input card and the matrix switching module; the input card is integrated with the image transmission apparatus according to any of the above embodiments, and the M transmission channels are some or all of the plurality of transmission channels.
In the above scheme, the video processing apparatus can transmit an image to be transmitted through an input card included therein when a required transmission bandwidth of the image to be transmitted exceeds an effective bandwidth of a single transmission channel, and transmit a plurality of sub-images obtained by processing through the input card to a matrix switching module via a plurality of transmission channels for subsequent processing, specifically, first, an acquisition module of an image transmission device in the input card acquires the required transmission bandwidth of the image to be transmitted and the effective bandwidth of the single transmission channel, then, a determination module determines a division number M of the image to be transmitted according to the required transmission bandwidth and the effective bandwidth, wherein the required transmission bandwidth of the image to be transmitted is greater than the effective bandwidth of the single transmission channel, and then, the division module divides the image to be transmitted based on the determined division number M to divide the image to be transmitted into M sub-images and buffers the M buffer modules, and finally, the M sending modules send the cached M sub-images to M transmission channels for transmission according to respective output time sequences.
In an embodiment of the present invention, the plurality of transmission channels are a plurality of SERDES channels, the input card includes a programmable logic device, the image transmission apparatus is integrated with the programmable logic device, and the matrix switching module includes a matrix switching chip.
One or more of the above technical solutions may have the following advantages or beneficial effects: the image transmission method, the image transmission device and the video processing equipment can realize the transmission of the image to be transmitted under the condition that the required transmission bandwidth of the image to be transmitted exceeds the effective bandwidth of a single transmission channel. The image transmission method can be specifically realized by the following steps: the method comprises the steps of firstly obtaining the required transmission bandwidth of an image to be transmitted and the effective bandwidth of a single transmission channel, then determining the division number M of the image to be transmitted according to the required transmission bandwidth and the effective bandwidth, dividing the image to be transmitted into M sub-images based on the determined division number M, caching, and finally sending the cached M sub-images to the M transmission channels for transmission according to respective output time sequences.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a flowchart illustrating an image transmission method according to a first embodiment of the present invention.
Fig. 2 is a flowchart illustrating another image transmission method according to a first embodiment of the present invention.
Fig. 3 is a schematic diagram of an image segmentation process adopted by the image transmission method according to the first embodiment of the present invention.
Fig. 4 is a diagram illustrating a method for determining extended pixel values according to a first embodiment of the present invention.
Fig. 5 is a block diagram of an image transmission apparatus according to a second embodiment of the present invention.
Fig. 6 is a schematic diagram of the units of the segmentation module 206 shown in fig. 5.
Fig. 7 is a block diagram of another image transmission apparatus according to a second embodiment of the present invention.
Fig. 8 is a schematic structural diagram of a video processing apparatus according to a third embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
[ first embodiment ] A method for manufacturing a semiconductor device
Referring to fig. 1, it is a flowchart illustrating an image transmission method according to a first embodiment of the present invention. The image transmission method may, for example, include:
step S102, acquiring the required transmission bandwidth of the image to be transmitted and the effective bandwidth of a single transmission channel;
step S104, determining the division number M of the image to be transmitted according to the effective bandwidth and the required transmission bandwidth, wherein the required transmission bandwidth is larger than the effective bandwidth, and M is a positive integer larger than 1;
step S106, dividing the image to be transmitted into M sub-images based on the division number M, wherein the required transmission bandwidth of each sub-image is smaller than the effective bandwidth;
step S108, caching the M sub-images;
step S110, sending the buffered M sub-images to the M transmission channels according to their respective output timing sequences for transmission.
To facilitate understanding of the present embodiment, the image transmission method of the present embodiment is described in detail below with reference to fig. 2 and 4.
The image transmission method according to an embodiment of the present invention may be executed, for example, by image processing software on a Programmable logic device of a video processing apparatus, such as an FPGA (Programmable Gate Array). The image transmission method according to the embodiment of the present invention is described in detail below by taking an example that a parameter of an image to be transmitted is 3840 × 1080@60Hz, a bit depth value of the image to be transmitted is 24 bits, a threshold bandwidth of a single transmission channel is 6.5Gbps, and an encoding manner of the transmission channel is 8B/10B encoding, but the embodiment of the present invention is not limited thereto.
Specifically, as shown in fig. 2, in step S102, the programmable logic device first obtains a required transmission bandwidth of an image to be transmitted and an effective bandwidth of a single transmission channel. Specifically, the programmable logic device determines that the resolution of the image to be transmitted is 3840 pixels × 1080 pixels and the frame frequency is 60Hz according to the parameter 3840 × 1080@60Hz of the image to be transmitted; and the programmable logic device determines the required transmission bandwidth of the image to be transmitted to be 3840 × 1080 × 60 × 24-5.98 Gbps according to the resolution of 3840pixel × 1080pixel, the frame frequency of 60Hz and the bit depth value of 24bit, and determines the effective bandwidth of a single transmission channel to be 6.5 × 0.8-5 Gbps according to the threshold bandwidth of the single transmission channel being 6.5Gbps and the coding mode of the transmission channel being 8B/10B coding.
Then, in step S104, the programmable logic device determines the division number M of the image to be transmitted according to the effective bandwidth 5Gbps and the size of the required transmission bandwidth 5.98 Gbps. Obviously, the required transmission bandwidth 5.98Gbps is greater than the effective bandwidth 5Gbps, whereby the number of divisions can be determined to be 2 here, or the number of divisions can be determined to be greater than 2. In the following description, an example is given in which an image to be transmitted is divided into 2 sub-images.
Next, in step S106, based on the division number M being, for example, 2, the programmable logic device divides (Crop) the image to be transmitted into M sub-images, i.e., 2 sub-images, wherein the required transmission bandwidth of each sub-image is less than the effective bandwidth 5 Gbps. Specifically, the programmable logic device can equally divide an image to be transmitted to generate two sub-images, and the transmission bandwidth required by each sub-image is less than the effective bandwidth by 5 Gbps. Of course, the sub-images divided by the programmable logic device may also be unequal, and are not limited herein.
For example, as shown in fig. 3, the detailed process of the segmentation process is as follows. Firstly, the programmable logic device determines an effective pixel area of each sub-image, in the embodiment of the present invention, the effective pixel area of the image 3840pixel × 1080pixel to be transmitted, which is divided, for example, into two areas a and B, which are shown in the upper part of fig. 3 and are equal to each other, of the 2 sub-images after being divided equally, and the two effective pixel areas are both 1920pixel × 1080pixel in size.
Next, the programmable logic device determines, for each valid pixel region, the number of pixels that it extends outward at the corresponding split side. The extended number of pixels can be determined, for example, in the following three ways. The first mode is as follows: the number of pixels that the effective pixel area extends outward on each segmentation side of the sub-image is determined according to a scaling parameter of the image, such as the scaling order (i.e., tap number). For example, for a fourth-order (tap number is equal to 4) scaling algorithm, calculating the pixel value of a pixel to be interpolated requires obtaining 4 × 4 (4 rows in the horizontal direction and 4 rows in the vertical direction) closest to the pixel to be interpolated in an original image, which is 16 corresponding pixels, and performing corresponding calculation according to the weights of the 16 pixels to obtain the pixel value of the pixel to be interpolated, so that the number of pixels on each row required by the pixel to be interpolated is determined according to the scaling order to determine the number of pixels extended outwards. The second way is: and determining the number of pixels extended outwards by each segmentation side according to the pixel point required by the effective pixel area at the zooming of the pixel point of each segmentation side of the sub-image. For example, as shown in fig. 4, for a pixel point E on the segmentation side, a distance (3 pixels in the example of fig. 4) between a pixel point (pixel point H in fig. 4) farthest from the pixel point E and the pixel point E among pixel points (pixel points F, G, H) on the right side of the segmentation side, which need to be collected, is determined according to a scaling algorithm that needs to be adopted for scaling later, so as to determine the number of pixels extended outward, that is, 3 pixels. The third mode is as follows: and determining the number of pixels of the effective pixel area extended outwards on each segmentation side of the subimage according to a preset extension value. For example, the preset extension value may be, for example, 64 pixels, and correspondingly, the number of pixels extended outward is 64 pixels.
After determining the number of pixels extended, the programmable logic device obtains an extended pixel region based on the number of pixels. Wherein the continuation pixel region is connected with the effective pixel region. For example, as shown in the lower part of fig. 3, the programmable logic device determines, according to the scaling parameter of the image, that the extended pixel numbers of the effective pixel area a and the effective pixel area B on the segmentation sides of the right sub-image and the left sub-image are, for example, 1 column of pixels. Then, the programmable logic device determines an extension pixel area according to the number of extension pixels, as shown in the lower part of fig. 3, for the effective pixel area a, the corresponding extension pixel area is an area D obtained by extending the number of extension pixels outwards (i.e., to the right side) of the effective pixel area a, and for the effective pixel area B, the corresponding extension pixel area is an area C obtained by extending the number of extension pixels outwards (i.e., to the left side) of the effective pixel area B, where the extension pixel area D is connected to the effective pixel area a and the extension pixel area C is connected to the effective pixel area B. And finally, the programmable logic device divides the image to be transmitted according to the effective image areas A and B and the corresponding continuation pixel areas D and C to obtain the sub-images, wherein one of the two obtained sub-images comprises the area A and the area D, and the other sub-image comprises the area B and the area C. It should be noted that, in the example shown in fig. 3, there is only one split side, however, in other embodiments, there may be a plurality of split sides, and the embodiment of the present invention is not limited specifically herein. In addition, the embodiment of the present invention does not specifically limit how to determine the number of extended pixels according to the scaling parameter of the image, as long as the number of pixels of the effective pixel area extended outward at each divided side of the sub-image can be determined according to the scaling parameter of the image.
In this regard, in practical applications, it is generally required that the video processing device scales the divided sub-images, but a gap may occur at an edge of an image formed by directly scaling and splicing the simply divided image, so that the embodiment of the present invention obtains each sub-image by extending an effective pixel region of each sub-image, thereby solving a problem that a gap occurs in the spliced image. Of course, if the image to be transmitted does not need to be scaled at the back end, the foregoing continuation processing may not be performed.
Next, in step S108, the programmable logic device buffers the M sub-images, i.e., 2 sub-images. For example, the programmable logic device may divide and buffer the obtained M sub-images into M storage areas, such as FIFO (First Input First Output) memories, but the invention is not limited thereto.
Then, in step S109, the programmable logic device generates the output timing sequence of each sub-image according to the original timing sequence of the image to be transmitted. For example, the generating the output timing of each of the sub-images according to the original timing of the image to be transmitted includes: generating a field sync signal, a line sync signal and a data enable signal in the output timing of each of the sub-images from a field sync signal (VSYNC), a line sync signal (HSYNC) and a data enable signal (DE, an effective data strobe signal) in the original timing of the image to be transmitted; and converting the number of Pixels Per Clock in the original timing of the image to be transmitted (for example, the number of Pixels Per Clock in the original timing of the image to be transmitted is 2PPC (Pixels Per Clock)) to 1PPC as the number of Pixels Per Clock in the output timing of each of the sub-images.
Finally, the programmable logic device sends the buffered M sub-images to the M transmission channels according to the respective output timings for transmission, for example, the M sub-images are subsequently sent to other devices such as a switching matrix chip (e.g., crossbar or crossbar) through the transmission channels for being called by other back-end chips such as other programmable logic devices. Here, the transmission channel may be, for example, a SERDES (SERializer/DESerializer) channel, but the embodiment of the present invention is not limited thereto.
In summary, in the foregoing embodiments of the present invention, the image transmission apparatus can implement transmission of an image to be transmitted under a condition that a required transmission bandwidth of the image to be transmitted exceeds an effective bandwidth of a single transmission channel, specifically, the obtaining module first obtains the required transmission bandwidth of the image to be transmitted and the effective bandwidth of the single transmission channel, then, a determining module determines the division number M of the image to be transmitted according to the required transmission bandwidth and the size of the effective bandwidth, the required transmission bandwidth of the image to be transmitted is larger than the effective bandwidth of a single transmission channel, then the segmentation module segments the image to be transmitted into M sub-images based on the determined segmentation number M, the M sub-images are cached through the M caching modules, and finally the M sending modules send the cached M sub-images to the M transmission channels for transmission according to respective output time sequences.
[ second embodiment ]
Referring to fig. 5, a second embodiment of the present invention provides an image transmission apparatus 200. The image transmission apparatus 200 includes, for example: an acquisition module 202, a determination module 204, a segmentation module 206, a caching module 208, and a sending module 210.
Specifically, the obtaining module 202 is configured to obtain a required transmission bandwidth of an image to be transmitted and an effective bandwidth of a single transmission channel.
The determining module 204 is configured to determine, according to the sizes of the effective bandwidth and the required transmission bandwidth, a division number M of the image to be transmitted, where the required transmission bandwidth is greater than the effective bandwidth, and M is a positive integer greater than 1.
The dividing module 206 is configured to divide the image to be transmitted into M sub-images based on the division number M, where a required transmission bandwidth of each sub-image is smaller than the effective bandwidth.
The number of the buffer modules 208 is M, and the buffer modules are used for respectively buffering the M sub-images.
The number of the sending modules 210 is M, and the sending modules are configured to send the M cached sub-images to the M transmission channels according to respective output time sequences for transmission.
In a specific embodiment, the required transmission bandwidth is related to a resolution size, a frame rate and a bit depth value of the image to be transmitted.
In one embodiment, as shown in fig. 6, the segmentation module 206 includes: a determination unit 2060, a continuation unit 2062 and a segmentation unit 2064. For example, the determination unit 2060 is configured to determine the effective pixel area of each of the sub-images; the continuation unit 2062 is configured to determine, according to the scaling parameter, a number of pixels of the effective pixel region that is extended outward on each segmentation side of the sub-image, so as to obtain a continuation pixel region, where the continuation pixel region is connected to the effective pixel region; and the segmentation unit 2064 is configured to perform segmentation processing on the image to be transmitted according to the effective image region and the continuation pixel region to obtain the sub-image. Optionally, the determining unit 2060 is configured to determine the effective pixel area of each of the sub-images; the continuation unit 2062 is configured to determine, according to a pixel point required by the effective pixel region at the scaling of the pixel point of each segmentation side of the sub-image, a number of pixels of outward continuation of each segmentation side to obtain a continuation pixel region, where the continuation pixel region is connected to the effective pixel region; and the segmentation unit 2064 is configured to perform segmentation processing on the image to be transmitted according to the effective image region and the continuation pixel region to obtain the sub-image.
Optionally, the determining unit 2060 is configured to determine the effective pixel area of each of the sub-images; the continuation unit 2062 is configured to determine, according to a preset continuation value, a number of pixels of the effective pixel region that is extended outward at each segmentation side of the sub-image, so as to obtain a continuation pixel region, where the continuation pixel region is connected to the effective pixel region; and the segmentation unit 2064 is configured to perform segmentation processing on the image to be transmitted according to the effective image region and the continuation pixel region to obtain the sub-image.
In one embodiment, as shown in fig. 7, the image transmission apparatus 200 further includes a timing generation module 209. The timing sequence generation module 209 is configured to generate the output timing sequence of each sub-image according to an original timing sequence of the image to be transmitted; the timing generation module 209 is specifically configured to: generating a field synchronizing signal, a line synchronizing signal and a data enabling signal in the output time sequence of each sub-image according to the field synchronizing signal, the line synchronizing signal and the data enabling signal in the original time sequence of the image to be transmitted; and converting the number of pixels per clock in the original time sequence of the image to be transmitted to 1PPC as the number of pixels per clock in the output time sequence of each sub-image.
For specific working processes and technical effects among the modules in the image transmission apparatus 200 in this embodiment, reference is made to the description of the relevant steps in the first embodiment, and details are not repeated here.
[ third embodiment ]
As shown in fig. 8, a third embodiment of the present invention provides a video processing apparatus 300. The video processing device 300 comprises an input card 301, a matrix switch module 303 and a plurality of transmission channels 302 electrically connected between the input card 301 and the matrix switch module 303. It should be noted that the video processing apparatus 300 is, for example, a card-type video processing apparatus, but the embodiment of the invention is not limited thereto.
The input card 301 incorporates the image transmission apparatus 202 according to the second embodiment. Specifically, the image transmission apparatus 200 includes, for example: an acquisition module 202, a determination module 204, a segmentation module 206, a caching module 208, and a sending module 210. Specifically, the obtaining module 202 is configured to obtain a required transmission bandwidth of an image to be transmitted and an effective bandwidth of a single transmission channel. The determining module 204 is configured to determine, according to the sizes of the effective bandwidth and the required transmission bandwidth, a division number M of the image to be transmitted, where the required transmission bandwidth is greater than the effective bandwidth, and M is a positive integer greater than 1. The dividing module 206 is configured to divide the image to be transmitted into M sub-images based on the division number M, where a required transmission bandwidth of each sub-image is smaller than the effective bandwidth. The number of the buffer modules 208 is M, and the buffer modules are used for respectively buffering the M sub-images. The number of the sending modules 210 is M, and the sending modules are configured to send the M cached sub-images to the M transmission channels according to respective output time sequences for transmission. The M transmission channels are some or all of the plurality of transmission channels 302.
As mentioned above, the transmission channels 302 are a plurality of SERDES channels, the input card 301 includes a programmable logic device, the image transmission apparatus 200 is integrated with the programmable logic device, and the matrix switching module includes a matrix switching chip. It should be noted that the programmable logic device may be, for example, an FPGA, and the matrix switch chip may be, for example, Cross Point, but the embodiment of the present invention is not limited thereto.
For specific working procedures and technical effects among the modules in the image transmission device 200 in the input card 301 of the video processing apparatus 300 in this embodiment, reference is made to the description of the relevant steps in the foregoing first embodiment, and no further description is given here.
In the above embodiment, the video processing apparatus 300, through the input card 301 included therein, can realize transmission of an image to be transmitted in a case that a required transmission bandwidth of the image to be transmitted exceeds an effective bandwidth of a single transmission channel, and transmit a plurality of sub-images obtained by processing through the input card 301 to the matrix switching module 303 via the plurality of transmission channels 302 for subsequent processing, for example, the matrix switching module 303 sends each sub-image to other output cards for scaling or splicing processing, such as image, so that compatibility and processing capability of the video processing apparatus 300 are improved.
In addition, it should be understood that the foregoing embodiments are merely exemplary illustrations of the present invention, and the technical solutions of the embodiments can be arbitrarily combined and collocated without conflict between technical features and structural contradictions, which do not violate the purpose of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, a division of a unit is merely a division of one logic function, and an actual implementation may have another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may also be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, each functional unit/module in the embodiments of the present invention may be integrated into one processing unit/module, or each unit/module may exist alone physically, or two or more units/modules may be integrated into one unit/module. The integrated units/modules may be implemented in the form of hardware, or may be implemented in the form of hardware plus software functional units/modules.
The integrated units/modules, which are implemented in the form of software functional units/modules, may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions for causing one or more processors of a computer device (which may be a personal computer, a server, or a network device) to execute some steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. An image transmission method, comprising:
acquiring the required transmission bandwidth of an image to be transmitted and the effective bandwidth of a single transmission channel;
determining the division number M of the image to be transmitted according to the effective bandwidth and the required transmission bandwidth, wherein the required transmission bandwidth is larger than the effective bandwidth, and M is a positive integer larger than 1;
dividing the image to be transmitted into M sub-images based on the division number M, wherein the required transmission bandwidth of each sub-image is smaller than the effective bandwidth;
caching the M sub-images; and
and sending the cached M sub-images to M transmission channels according to respective output time sequences for transmission.
2. The image transmission method according to claim 1, wherein the dividing the image to be transmitted into M sub-images based on the division number M comprises:
determining an effective pixel area of each sub-image;
determining the number of pixels of the effective pixel area extended outwards on each segmentation side of the sub-image according to the scaling parameters to obtain an extended pixel area, wherein the extended pixel area is connected with the effective pixel area; and
and segmenting the image to be transmitted according to the effective image area and the continuation pixel area to obtain the sub-image.
3. The image transmission method according to claim 1, wherein the dividing the image to be transmitted into M sub-images based on the division number M comprises:
determining an effective pixel area of each sub-image;
determining the number of pixels extended outwards from each segmentation side of the sub-image according to the pixel point of the effective pixel area, which is required by the pixel point of each segmentation side of the sub-image during zooming, so as to obtain an extension pixel area, wherein the extension pixel area is connected with the effective pixel area; and
and segmenting the image to be transmitted according to the effective image area and the continuation pixel area to obtain the sub-image.
4. The image transmission method according to claim 1, wherein the dividing the image to be transmitted into M sub-images based on the division number M comprises:
determining an effective pixel area of each sub-image;
determining the number of pixels of the effective pixel area extended outwards on each segmentation side of the sub-image according to a preset extension value to obtain an extension pixel area, wherein the extension pixel area is connected with the effective pixel area; and
and segmenting the image to be transmitted according to the effective image area and the continuation pixel area to obtain the sub-image.
5. The image transmission method according to claim 1, further comprising: before the M cached sub-images are sent to M transmission channels according to respective output time sequences to be transmitted, generating the output time sequence of each sub-image according to the original time sequence of the image to be transmitted;
wherein the generating the output timing for each of the sub-images according to the original timing for the image to be transmitted comprises:
generating a field synchronizing signal, a line synchronizing signal and a data enabling signal in the output time sequence of each sub-image according to the field synchronizing signal, the line synchronizing signal and the data enabling signal in the original time sequence of the image to be transmitted; and
and converting the number of pixels per clock in the original time sequence of the image to be transmitted to 1PPC as the number of pixels per clock in the output time sequence of each sub-image.
6. An image transmission apparatus, comprising:
the acquisition module is used for acquiring the required transmission bandwidth of the image to be transmitted and the effective bandwidth of a single transmission channel;
the determining module is used for determining the division number M of the image to be transmitted according to the effective bandwidth and the required transmission bandwidth, wherein the required transmission bandwidth is larger than the effective bandwidth, and M is a positive integer larger than 1;
a dividing module, configured to divide the image to be transmitted into M sub-images based on the division number M, where a required transmission bandwidth of each sub-image is smaller than the effective bandwidth;
the M caching modules are used for caching the M sub-images respectively; and
and the M sending modules are used for respectively sending the cached M sub-images to the M transmission channels according to respective output time sequences so as to carry out transmission.
7. The image transmission apparatus according to claim 6, wherein the segmentation module comprises:
a determination unit configured to determine an effective pixel area of each of the sub-images;
the continuation unit is used for determining the number of pixels of the effective pixel area which are extended outwards on each segmentation side of the sub-image according to the scaling parameters so as to obtain a continuation pixel area, wherein the continuation pixel area is connected with the effective pixel area; and
and the segmentation unit is used for segmenting the image to be transmitted according to the effective image area and the continuation pixel area to obtain the sub-image.
8. The image transmission apparatus according to claim 6, further comprising:
the time sequence generation module is used for generating the output time sequence of each sub-image according to the original time sequence of the image to be transmitted;
wherein the timing generation module is specifically configured to:
generating a field synchronizing signal, a line synchronizing signal and a data enabling signal in the output time sequence of each sub-image according to the field synchronizing signal, the line synchronizing signal and the data enabling signal in the original time sequence of the image to be transmitted; and
and converting the number of pixels per clock in the original time sequence of the image to be transmitted to 1PPC as the number of pixels per clock in the output time sequence of each sub-image.
9. A video processing apparatus, comprising: an input card, a matrix switching module, and a plurality of transmission channels electrically connected between the input card and the matrix switching module;
the input card is integrated with the image transmission device according to any one of claims 5 to 8, and the M transmission channels are part or all of the plurality of transmission channels.
10. The video processing apparatus of claim 9, wherein the plurality of transmission channels are a plurality of SERDES channels, respectively, the input card includes a programmable logic device and the image transmission device is integrated with the programmable logic device, and the matrix switching module includes a matrix switching chip.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911370172.7A CN113055675A (en) | 2019-12-26 | 2019-12-26 | Image transmission method and device and video processing equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911370172.7A CN113055675A (en) | 2019-12-26 | 2019-12-26 | Image transmission method and device and video processing equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113055675A true CN113055675A (en) | 2021-06-29 |
Family
ID=76505677
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911370172.7A Pending CN113055675A (en) | 2019-12-26 | 2019-12-26 | Image transmission method and device and video processing equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113055675A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113271392A (en) * | 2021-07-06 | 2021-08-17 | 深圳爱特天翔科技有限公司 | Video image synchronous processing method, device, system and storage medium |
| CN113507629A (en) * | 2021-06-30 | 2021-10-15 | 中标慧安信息技术股份有限公司 | Data transmission control method and system between video end and communication end in Internet of things |
| CN114286133A (en) * | 2021-12-28 | 2022-04-05 | 京东方科技集团股份有限公司 | Image data processing method and device and display system |
| US20220321840A1 (en) * | 2021-03-30 | 2022-10-06 | Shenzhen Antu Autonomous Driving Technologies Ltd. | Method for transmitting high bandwidth camera data through serdes links |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104104888A (en) * | 2014-07-01 | 2014-10-15 | 大连民族学院 | Parallel multi-core FPGA digital image real-time zooming processing method and device |
| CN104320663A (en) * | 2014-11-14 | 2015-01-28 | 中国建设银行股份有限公司 | Video compression method and device and video transmission system |
| CN105609087A (en) * | 2015-12-23 | 2016-05-25 | 天津天地伟业数码科技有限公司 | Method for processing image for image scaler |
| CN106303345A (en) * | 2016-09-29 | 2017-01-04 | 杭州雄迈集成电路技术有限公司 | A kind of dispensing device utilizing Double-strand transmission super large resolution and superelevation frame per second video signal |
| US20170041472A1 (en) * | 2015-08-06 | 2017-02-09 | Textron Systems Corporation | Networked low-bandwidth terminals for transmission of imagery |
| CN107241302A (en) * | 2016-03-29 | 2017-10-10 | 展讯通信（上海）有限公司 | Image data transfer method, device and terminal |
| CN108346131A (en) * | 2018-01-26 | 2018-07-31 | 深圳开阳电子股份有限公司 | A kind of digital image scaling method, device and display equipment |
| US20180309989A1 (en) * | 2002-05-21 | 2018-10-25 | Innotive Corporation | Transferring system for huge and high quality images on network and method thereof |
| CN109561119A (en) * | 2017-09-26 | 2019-04-02 | 中国移动通信有限公司研究院 | A kind of data transmission method for uplink, data receiver method and equipment |
-
2019
- 2019-12-26 CN CN201911370172.7A patent/CN113055675A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180309989A1 (en) * | 2002-05-21 | 2018-10-25 | Innotive Corporation | Transferring system for huge and high quality images on network and method thereof |
| CN104104888A (en) * | 2014-07-01 | 2014-10-15 | 大连民族学院 | Parallel multi-core FPGA digital image real-time zooming processing method and device |
| CN104320663A (en) * | 2014-11-14 | 2015-01-28 | 中国建设银行股份有限公司 | Video compression method and device and video transmission system |
| US20170041472A1 (en) * | 2015-08-06 | 2017-02-09 | Textron Systems Corporation | Networked low-bandwidth terminals for transmission of imagery |
| CN105609087A (en) * | 2015-12-23 | 2016-05-25 | 天津天地伟业数码科技有限公司 | Method for processing image for image scaler |
| CN107241302A (en) * | 2016-03-29 | 2017-10-10 | 展讯通信（上海）有限公司 | Image data transfer method, device and terminal |
| CN106303345A (en) * | 2016-09-29 | 2017-01-04 | 杭州雄迈集成电路技术有限公司 | A kind of dispensing device utilizing Double-strand transmission super large resolution and superelevation frame per second video signal |
| CN109561119A (en) * | 2017-09-26 | 2019-04-02 | 中国移动通信有限公司研究院 | A kind of data transmission method for uplink, data receiver method and equipment |
| CN108346131A (en) * | 2018-01-26 | 2018-07-31 | 深圳开阳电子股份有限公司 | A kind of digital image scaling method, device and display equipment |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20220321840A1 (en) * | 2021-03-30 | 2022-10-06 | Shenzhen Antu Autonomous Driving Technologies Ltd. | Method for transmitting high bandwidth camera data through serdes links |
| US11902706B2 (en) * | 2021-03-30 | 2024-02-13 | Shenzhen Antu Autonmous Driving Technologies Ltd. | Method for transmitting high bandwidth camera data through SerDes links |
| CN113507629A (en) * | 2021-06-30 | 2021-10-15 | 中标慧安信息技术股份有限公司 | Data transmission control method and system between video end and communication end in Internet of things |
| CN113271392A (en) * | 2021-07-06 | 2021-08-17 | 深圳爱特天翔科技有限公司 | Video image synchronous processing method, device, system and storage medium |
| CN113271392B (en) * | 2021-07-06 | 2023-02-03 | 深圳爱特天翔科技有限公司 | Video image synchronous processing method, device, system and storage medium |
| CN114286133A (en) * | 2021-12-28 | 2022-04-05 | 京东方科技集团股份有限公司 | Image data processing method and device and display system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113055675A (en) | Image transmission method and device and video processing equipment | |
| CN103347163B (en) | Ultra high definition video image processing and transmitting system and method thereof | |
| EP2911381B1 (en) | Method and device for processing video image | |
| WO2016107496A1 (en) | Video frame processing method, video processing chip, motion estimation and motion compensation chip | |
| CN102857738B (en) | The image display system that multi-screen controls, method and multi-screen control device | |
| US10008175B2 (en) | Signal output apparatus for reducing power consumption during display on a plurality of image display apparatuses | |
| CN106993150B (en) | Video image processing system and method compatible with ultra-high definition video input | |
| CN102714745B (en) | Digital video signal output device and display device, and digital video signal output method and reception method | |
| CN107249107B (en) | Video controller and image processing method and device | |
| CN104780329A (en) | Multi-picture separator capable of playing high-definition and standard-definition videos based on FPGA and multi-picture separation method based on FPGA | |
| CN102170579B (en) | Graphic image processing system, method and chip | |
| US20220345769A1 (en) | Image data processing device and method, and display device | |
| CN102801948B (en) | High-definition serial digital interface data transfer device and device | |
| CN111988552B (en) | Image output control method and device and video processing equipment | |
| CN115460414A (en) | Video compression method and system of baseboard management control chip and related components | |
| CN111954070A (en) | FPGA-based video resolution conversion method and terminal | |
| KR20020047069A (en) | Device and Method for transmitting picture data | |
| CN114051120A (en) | Video alarm method, device, storage medium and electronic equipment | |
| CN113450245A (en) | Image processing method, device, chip and equipment | |
| EP3169067A1 (en) | Display processing system and method, and electronic device | |
| CN112492247A (en) | Video display design method based on LVDS input | |
| CN111508447A (en) | Image time sequence control circuit of grating type naked eye 3D liquid crystal screen based on FPGA | |
| CN104902192B (en) | The transmission method and equipment of multiple signals | |
| CN115412651A (en) | Video processing apparatus, video processing method, and display system | |
| CN114449178A (en) | Video signal transmission control method and video signal transmission system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |