CN114040226B - Data transmission method, system and equipment for low-bandwidth high-resolution video transmission - Google Patents

Data transmission method, system and equipment for low-bandwidth high-resolution video transmission Download PDF

Info

Publication number
CN114040226B
CN114040226B CN202210021556.3A CN202210021556A CN114040226B CN 114040226 B CN114040226 B CN 114040226B CN 202210021556 A CN202210021556 A CN 202210021556A CN 114040226 B CN114040226 B CN 114040226B
Authority
CN
China
Prior art keywords
code stream
image
data
video
format
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210021556.3A
Other languages
Chinese (zh)
Other versions
CN114040226A (en
Inventor
杨健
马保林
李厚鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Digibird Technology Co ltd
Original Assignee
Beijing Digibird Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Digibird Technology Co ltd filed Critical Beijing Digibird Technology Co ltd
Priority to CN202210021556.3A priority Critical patent/CN114040226B/en
Publication of CN114040226A publication Critical patent/CN114040226A/en
Application granted granted Critical
Publication of CN114040226B publication Critical patent/CN114040226B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234381Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234309Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2385Channel allocation; Bandwidth allocation

Abstract

The invention belongs to the field of video processing, in particular relates to a data transmission method, a system and equipment for low-bandwidth high-resolution video transmission, and aims to solve the problem that the data transmission method, the system and the equipment cannot be suitable for the use scene of multi-path low-resolution videos while breaking through the limitation of the total bandwidth of a data transmission link between a service card and a back plate on the maximum resolution of the processable videos. The invention comprises the following steps: calculating the number N of the detachable code streams; n =1 uncompressed; the multiple of 2 is not the multiple of 3, the image is reduced and the YCbCr420 is converted, the multiple of 3 is the image is reduced and the Bayer array is converted, and the data is 1/N of the original data; otherwise, N +1 is a multiple of 3, image reduction and Bayer array conversion are carried out, N +1 is not a multiple of 3, image reduction and YCbCr420 format conversion are carried out, and data are 1/(N + 1) of the original data; and outputting the code stream after code stream transmission and data restoration. The invention breaks through the limitation of the total bandwidth of the data transmission link between the service card and the backboard on the maximum resolution ratio of the processable video, and is also suitable for the use scene of multi-path small-resolution video.

Description

Data transmission method, system and equipment for low-bandwidth high-resolution video transmission
Technical Field
The invention belongs to the field of video processing, and particularly relates to a data transmission method, a system and equipment for low-bandwidth high-resolution video transmission.
Background
With the wide application of video transmission and display technologies in the industries of electric power, air traffic control, government and enterprise, medical treatment and the like, the requirements of users on the definition and the fluency of video pictures are continuously improved, the resolution of videos is increasingly large, and the transmission of high-resolution videos becomes a main problem facing the development of video processing equipment.
In the video processing equipment, service cards such as an input card and an output card are connected to a back plate, a certain number of data transmission links are connected between each service card and the back plate, and video data are exchanged and transmitted from the input card to the output card through the back plate. The number of links between each traffic card and the backplane and the available bandwidth of each link are limited due to hardware design rules and manufacturing costs.
In a conventional data transmission method, in order to transmit video data with higher resolution, a video processing device may use a data splitting method to bind N links to transmit one path of video data. As shown in fig. 1, which is a schematic diagram of a process of implementing high-resolution video transmission through data splitting in the prior art, a specific method includes: horizontal region splitting: splitting each frame of video into N equal parts in the horizontal direction, wherein each link transmits one part of data, as shown in (a) of FIG. 1; and (3) line interleaving splitting: splitting each frame of video according to lines, wherein a first link transmits … … data of line 1 and line N +1, a second link transmits … … data of line 2 and line N +2, and an nth link transmits … … data of line N and line N + N, as shown in fig. 1 (b); column interleaving and splitting: splitting each frame of video into columns, wherein a first link transmits … … data of the 1 st column and the N +1 st column, a second link transmits … … data of the 2 nd column and the N +2 nd column, and an nth link transmits … … data of the nth column and the N + N th column, as shown in (c) of fig. 1; splitting coded data: and carrying out compression coding on the video picture, and transmitting data according to a horizontal region splitting method, a line interleaving splitting method or a column interleaving splitting method. Similar specific methods for splitting data are also available, which are characterized in that all pixels or encoded data of a video picture are split according to spatial coordinates, and each link transmits a part of pixels or encoded information of the video picture.
However, the prior art has a number of drawbacks: firstly, the upper limit of the video resolution that can be processed by the video processing device is limited by the total bandwidth of the data transmission link between the service card and the backplane: in the prior art, if the transmission data bandwidth exceeds the total bandwidth of the data transmission link between the service card and the backboard, a part of pixels or coded data cannot be transmitted, so that a video picture displayed after being processed by the output card is obviously distorted, and the upper limit of the video resolution which can be processed by the video processor is limited; the second video processing device for high-resolution videos has low use efficiency of a data transmission link and few processable video paths when processing low-resolution videos: in the prior art, because a plurality of data transmission links are bound and transmitted with one path of video data by the video processing equipment according to the requirement of processing a high-resolution video, the number of the video paths which can be processed by the video processor is the same as that of the video in the process of processing the high-resolution video in the use scene of processing a low-resolution video, the use efficiency of the data transmission links is low, and the video processing equipment cannot adapt to the use scene of a plurality of paths of low-resolution videos.
In summary, when the prior art performs video transmission, the limitation of the total bandwidth of the data transmission link between the service card and the backplane on the maximum resolution ratio of the processable video cannot be broken through, and the prior art can adapt to the use scene of multiple paths of small-resolution videos.
Disclosure of Invention
In order to solve the above-mentioned problem in the prior art, namely, the problem that the use scene of multi-path small-resolution videos cannot be adapted while breaking through the limitation of the total bandwidth of the data transmission link between the service card and the backplane to the maximum resolution that can process the videos, the invention provides a data transmission method for low-bandwidth high-resolution video transmission, which comprises the following steps:
step S10, calculating the number of detachable code streams of the input video based on the video bandwidth and the data transmission link bandwidth of the input video
Figure 100002_DEST_PATH_IMAGE001
Step S20, judging the number of the split code stream
Figure 699106DEST_PATH_IMAGE001
And executing:
if the number of the divided code streams
Figure 784743DEST_PATH_IMAGE001
If the video number is 1, taking the input video as a first code stream;
if the number of the divided code streams
Figure 291947DEST_PATH_IMAGE001
Is a multiple of 2, at the same time
Figure 98229DEST_PATH_IMAGE001
If not, reducing the image of each frame of the input video to the original one
Figure 148225DEST_PATH_IMAGE002
And converting the reduced image into YCbCr420 format to obtain the input video data
Figure 100002_DEST_PATH_IMAGE003
A first code stream of;
if the number of the divided code streams
Figure 906228DEST_PATH_IMAGE001
Is a multiple of 3, the image of each frame of the input video is reduced to the original one
Figure 166308DEST_PATH_IMAGE004
And converting the reduced image into Bayer array format to obtain a data volume of the input video
Figure 651647DEST_PATH_IMAGE003
A first code stream of;
otherwise, judging
Figure 100002_DEST_PATH_IMAGE005
Whether or not it is a multiple of 3, if
Figure 946362DEST_PATH_IMAGE005
Is a multiple of 3, the image of each frame of the input video is reduced to the original one
Figure 373801DEST_PATH_IMAGE006
And converting the reduced image into Bayer array format to obtain a data volume of the input video
Figure 100002_DEST_PATH_IMAGE007
A first code stream of; if it is
Figure 996543DEST_PATH_IMAGE005
If not, reducing the image of each frame of the input video to the original one
Figure 410207DEST_PATH_IMAGE008
And converting the reduced image into YCbCr420 format, the obtained data amount is of the input video
Figure 28270DEST_PATH_IMAGE007
A first code stream of;
and step S30, transmitting the first code stream through a single link, performing data restoration on the transmitted first code stream, and outputting an output video with the same size as the input video after the data restoration.
It should be noted that the low bandwidth described in the present invention means that the bandwidth of the data transmission link available for each input video is smaller than the video transmission bandwidth of the input video, i.e. even though the bandwidth of the data transmission link available for the input video is not the low bandwidth in the conventional sense, the bandwidth is smaller than the video transmission bandwidth of the input video, which belongs to the low bandwidth described in the present invention.
In some preferred embodiments, the number of separable bitstreams of the input video
Figure 131005DEST_PATH_IMAGE001
It is expressed as:
Figure 100098DEST_PATH_IMAGE010
wherein the content of the first and second substances,
Figure 100002_DEST_PATH_IMAGE011
representing the bandwidth of the incoming video,
Figure 192819DEST_PATH_IMAGE012
representing the bandwidth of a single link over which the video is transmitted,
Figure 100002_DEST_PATH_IMAGE013
representing a rounding up operation.
In some preferred embodiments, the reduced image is converted to YCbCr420 format in step S20 by:
step S211, converting the reduced RGB444 format image into a YCbCr444 format image according to different conversion coefficients;
when the conversion coefficients follow the BT601 format:
Figure 100002_DEST_PATH_IMAGE015
Figure 100002_DEST_PATH_IMAGE017
Figure 100002_DEST_PATH_IMAGE019
when the transform coefficients follow the BT709 format:
Figure 100002_DEST_PATH_IMAGE021
Figure 100002_DEST_PATH_IMAGE023
Figure 100002_DEST_PATH_IMAGE025
when the conversion coefficients follow the BT2020 format:
Figure 100002_DEST_PATH_IMAGE027
Figure 100002_DEST_PATH_IMAGE029
Figure 100002_DEST_PATH_IMAGE031
wherein the content of the first and second substances,
Figure 337493DEST_PATH_IMAGE032
for the three components of the pixel values of the converted YCbCr444 format image,
Figure 100002_DEST_PATH_IMAGE033
three components of pixel values for the pre-conversion RGB444 format image;
in step S212, the YCbCr444 format image is converted into a YCbCr420 format image.
In some preferred embodiments, the YCbCr444 format image is converted into a YCbCr420 format image in step S212 by:
adjacent 4 pixels in the YCbCr444 format image are sequentially divided into one group, and for each group of pixels, a Y component of 4 pixels, a Cb component of 1 set position pixel, and a Cr component of 1 set position pixel are retained, so that a YCbCr420 format image is obtained.
In some preferred embodiments, the reduced image is converted to bayer array format in step S20 by:
step S221, establishing a rectangular coordinate system by taking the upper left corner of the reduced RGB444 format image as an origin, and setting the distance between adjacent pixels in the horizontal and vertical directions as 1;
step S222, coordinates are determined through a rectangular coordinate system
Figure 123046DEST_PATH_IMAGE034
Representing each pixel point;
step S223, when a pixel point
Figure 100002_DEST_PATH_IMAGE035
And
Figure 733763DEST_PATH_IMAGE036
when the number of the pixels is even or even odd, only the G component of the pixel point is reserved; when a pixel is formed
Figure 489229DEST_PATH_IMAGE035
Is an even number,
Figure 816305DEST_PATH_IMAGE036
When the number is odd, only the B component of the pixel point is reserved; when a pixel is formed
Figure 507181DEST_PATH_IMAGE035
Is odd number,
Figure 450866DEST_PATH_IMAGE036
And when the number is an even number, only the R component of the pixel point is reserved, and the Bayer array format image is obtained.
In some preferred embodiments, the video output is further preceded by a step of bitstream data supplementation, when the number of the detachable bitstreams is greater than the number of the detachable bitstreams
Figure 134657DEST_PATH_IMAGE001
When the number is a multiple of 3 and a number other than 1, the code stream supplementing method comprises the following steps:
cb components and Cr components except Cb components of 1 set position pixel and Cr components of 1 set position pixel reserved in the conversion of the YCbCr420 format are used as code stream supplementary data and recorded as a second code stream;
the image before the conversion of YCbCr420 format is amplified and reduced according to the image reduction multiple, the reduced image and the corresponding frame image of the input video are calculated according to the corresponding pixel difference value, the calculation result is divided into
Figure 100002_DEST_PATH_IMAGE037
The parts are respectively marked as a third code stream, … … and a fourth code stream
Figure 988344DEST_PATH_IMAGE001
Code stream;
sequentially performing a first code stream, a second code stream, a third code stream, … … and a third code stream through a single link
Figure 709175DEST_PATH_IMAGE001
Transmitting the code stream;
if the number of the divided code streams
Figure 874577DEST_PATH_IMAGE001
If the number of the code streams is 2, converting the first code stream and the second code stream into RGB444 format data after aligning and combining the first code stream and the second code stream to obtain an output video;
if the number of the divided code streams
Figure 597945DEST_PATH_IMAGE001
If the number of the code streams is 4, the first code stream and the second code stream are aligned and combined and then converted into RGB444 format data, then the RGB444 format data are amplified and restored according to the image reduction multiple, and the amplified and restored image, the third code stream and the fourth code stream are aligned and overlapped to obtain an output video;
if the number of the divided code streams
Figure 165192DEST_PATH_IMAGE001
Is a multiple of 2 other than 2 and 4, and
Figure 932291DEST_PATH_IMAGE001
the first code stream and the second code stream are aligned and combined and then converted into RGB444 format data, the RGB444 format data are amplified and restored according to the image reduction multiple, and the amplified and restored image, the third code stream, … … and the third code stream are combined and then converted into RGB444 format data
Figure 850569DEST_PATH_IMAGE001
And aligning and superposing the code streams to obtain an output video.
In some preferred embodiments, the video output is further preceded by a step of bitstream data supplementation, when the number of the detachable bitstreams is greater than the number of the detachable bitstreams
Figure 485949DEST_PATH_IMAGE001
When the number of the code stream is multiple of 3, the code stream supplementing method comprises the following steps:
taking the Bayer array complementary data B as a second code stream and taking the Bayer array complementary data R as a third code stream; for each pixel of the video frame image, if the R component, the G component, or the B component remains in the bayer array conversion, the G component, the B component, or the R component remains in the pixel in the bayer array supplemental data B, and the B component, the R component, or the G component remains in the pixel in the bayer array supplemental data R;
the first code stream before Bayer array format conversion is subjected to image amplification reduction according to image reduction times, corresponding pixel difference value calculation is carried out on the reduced image and a corresponding frame image of an input video, and a calculation result is split into
Figure 32337DEST_PATH_IMAGE038
The parts are respectively marked as a fourth code stream, … … and a fourth code stream
Figure 94971DEST_PATH_IMAGE001
Code stream;
sequentially performing a first code stream, a second code stream, a third code stream, a fourth code stream, … … and a third code stream through a single link
Figure 110332DEST_PATH_IMAGE001
Transmitting the code stream;
if the number of the divided code streams
Figure 814982DEST_PATH_IMAGE001
If the number is 3, aligning and combining the first code stream, the second code stream and the third code stream to obtain an output video;
if the number of the divided code streams
Figure 91243DEST_PATH_IMAGE001
If the number is 6, the first code stream, the second code stream and the third code stream are aligned and combined, and then an alignment combination graph is carried out according to the image reduction multipleAmplifying and restoring the image, and aligning and overlapping the amplified and restored image with the fourth code stream, the fifth code stream and the sixth code stream to obtain an output video;
otherwise, aligning and combining the first code stream, the second code stream and the third code stream, then carrying out amplification reduction of the aligned and combined image according to the image reduction multiple, and carrying out amplification reduction on the image, the fourth code stream, … … and the fourth code stream
Figure 231104DEST_PATH_IMAGE001
And aligning and superposing the code streams to obtain an output video.
In another aspect of the present invention, a data transmission system for low-bandwidth high-resolution video transmission is provided, the data transmission system includes the following modules:
a detachable bitstream number acquisition module configured to calculate a detachable bitstream number of an input video based on a video bandwidth and a data transmission link bandwidth of the input video
Figure 858395DEST_PATH_IMAGE001
A first judging and skipping module configured to judge the number of the detachable code streams
Figure 710944DEST_PATH_IMAGE001
And executing: if the number of the divided code streams
Figure 107291DEST_PATH_IMAGE001
If the number is 1, taking the input video as a first code stream, and skipping to a code stream transmission module; if the number of the divided code streams
Figure 901940DEST_PATH_IMAGE001
Is a multiple of 2, at the same time
Figure 750948DEST_PATH_IMAGE001
If the number is not multiple of 3, skipping to the code stream compression module 1; if the number of the divided code streams
Figure 531822DEST_PATH_IMAGE001
If the number is multiple of 3, skipping to the code stream compression module 2; otherwise, skipping to a second judging and skipping module;
a second judging and skipping module configured to determine if
Figure 658041DEST_PATH_IMAGE005
If the number is multiple of 3, skipping to the code stream compression module 3; if it is
Figure 498958DEST_PATH_IMAGE005
If the number of the code stream is not multiple of 3, skipping to the code stream compression module 4;
a code stream compression module 1 configured to reduce each frame of image of the input video to the original one
Figure 726939DEST_PATH_IMAGE002
And converting the reduced image into YCbCr420 format to obtain the input video data
Figure 45925DEST_PATH_IMAGE003
And skipping to the code stream transmission module;
a code stream compression module 2 configured to reduce each frame of image of the input video to the original one
Figure 416863DEST_PATH_IMAGE004
And converting the reduced image into Bayer array format to obtain a data volume of the input video
Figure 38469DEST_PATH_IMAGE003
And skipping to the code stream transmission module;
a code stream compression module 3 configured to reduce each frame of image of the input video to the original one
Figure 862068DEST_PATH_IMAGE006
And converting the reduced image into Bayer array format to obtain a data volume of the input video
Figure 984745DEST_PATH_IMAGE007
And skipping to the code stream transmission module;
a code stream compression module 4 configured to reduce each frame of image of the input video to the original one
Figure 334824DEST_PATH_IMAGE008
And converting the reduced image into YCbCr420 format, the obtained data amount is of the input video
Figure 517543DEST_PATH_IMAGE007
And skipping to the code stream transmission module;
the code stream transmission module is configured to transmit the first code stream through a single link;
and the output module is configured to perform data restoration on the transmitted first code stream, and output video with the same size as the input video after the data restoration is output.
In a third aspect of the present invention, an electronic device is provided, including:
at least one processor; and
a memory communicatively coupled to at least one of the processors; wherein the content of the first and second substances,
the memory stores instructions executable by the processor for execution by the processor to implement the data transfer method of low bandwidth high resolution video transmission described above.
In a fourth aspect of the present invention, a computer-readable storage medium is provided, which stores computer instructions for being executed by the computer to implement the data transmission method for low-bandwidth high-resolution video transmission described above.
The invention has the beneficial effects that:
(1) according to the data transmission method for low-bandwidth high-resolution video transmission, if the video bandwidth to be transmitted is higher than the bandwidth of the data transmission link between the service card and the back plate, the code stream is split according to the relation between the video bandwidth and the transmission link bandwidth, the video image is compressed to the size which can be transmitted by the transmission link, the upper limit of the video resolution which can be processed by the video processor is effectively improved, and meanwhile, the output video does not have obvious distortion.
(2) The data transmission method for low-bandwidth high-resolution video transmission can process high-resolution videos, can meet the requirements of low-resolution video transmission, fully utilizes the use efficiency of a data transmission link, increases the number of the processable videos, and has high use efficiency of the data transmission link and more processable video paths.
(3) The data transmission method for low-bandwidth high-resolution video transmission can acquire the supplementary data of the video according to the actual situation when the compressed image is displayed after transmission, the compressed video image carries the basic information of the original video image, the supplementary data carries the detailed information of the original video image, if the device does not support the high-resolution video, the basic information which is slightly poorer than the image quality of the original image can be displayed, if the device supports the high-resolution video, the original image (including the basic information and the detailed information) without loss of image quality can be displayed, the requirements of transmitting and processing the high-resolution video can be met, the transmission and processing of multi-path low-resolution video can be supported, the flexibility is good, and the method is suitable for application scenes of various video processing devices.
Drawings
Other features, objects and advantages of the present application will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:
fig. 1 is a schematic diagram of a related art process for implementing high-resolution video transmission through data splitting;
FIG. 2 is a schematic diagram of a data transmission method for low-bandwidth high-resolution video transmission according to the present invention;
FIG. 3 is a schematic diagram of pixels of an image in YCbCr444 format according to an embodiment of the data transmission method for low-bandwidth high-resolution video transmission of the present invention;
FIG. 4 is a schematic diagram of pixels for converting an image in YCbCr444 format into an image in YCbCr420 format according to an embodiment of the data transmission method for low-bandwidth high-resolution video transmission of the present invention;
FIG. 5 is a schematic diagram of pixels of an RGB444 format image converted to a Bayer array format according to an embodiment of the data transmission method for low-bandwidth high-resolution video transmission of the present invention;
FIG. 6 is a supplemental data diagram of the conversion of an image in YCbCr444 format to an image in YCbCr420 format in accordance with an embodiment of the data transmission method for low-bandwidth high-resolution video transmission of the present invention;
fig. 7 is a complementary data diagram of RGB444 format image conversion to bayer array format for one embodiment of the data transfer method of low bandwidth high resolution video transfer of the present invention.
Detailed Description
The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the relevant invention and not restrictive of the invention. It should be noted that, for convenience of description, only the portions related to the related invention are shown in the drawings.
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
The invention provides a data transmission method for low-bandwidth high-resolution video transmission, which has the following advantages when processing high-resolution video: first, even if the total bandwidth of the data transmission link between the service card and the backboard is less than the transmission data, the video processing device can be ensured to display complete video pictures without obvious distortion; secondly, the larger the total bandwidth of a data transmission link between the service card and the backboard is, the better the image quality of a display picture of the video processing equipment is; thirdly, when low-resolution videos are processed, the use efficiency of a data transmission link can be improved, and the number of the processable videos can be increased.
The invention discloses a data transmission method for low-bandwidth high-resolution video transmission, which comprises the following steps:
step S10, calculating the number of detachable code streams of the input video based on the video bandwidth and the data transmission link bandwidth of the input video
Figure 703805DEST_PATH_IMAGE001
Step S20, judging the number of the split code stream
Figure 630173DEST_PATH_IMAGE001
And executing:
if the number of the divided code streams
Figure 444545DEST_PATH_IMAGE001
If the video number is 1, taking the input video as a first code stream;
if the number of the divided code streams
Figure 686914DEST_PATH_IMAGE001
Is a multiple of 2, at the same time
Figure 219527DEST_PATH_IMAGE001
If not, reducing the image of each frame of the input video to the original one
Figure 824952DEST_PATH_IMAGE002
And converting the reduced image into YCbCr420 format to obtain the input video data
Figure 493830DEST_PATH_IMAGE003
A first code stream of;
if the number of the divided code streams
Figure 283932DEST_PATH_IMAGE001
Is a multiple of 3, the image of each frame of the input video is reduced to the original one
Figure 428474DEST_PATH_IMAGE004
And converting the reduced image into Bayer array format to obtain a data volume of the input video
Figure 431065DEST_PATH_IMAGE003
A first code stream of;
otherwise, judging
Figure 485609DEST_PATH_IMAGE005
Whether or not it is a multiple of 3, if
Figure 321978DEST_PATH_IMAGE005
Is a multiple of 3, the image of each frame of the input video is reduced to the original one
Figure 563603DEST_PATH_IMAGE006
And converting the reduced image into Bayer array format to obtain a data volume of the input video
Figure 261563DEST_PATH_IMAGE007
A first code stream of; if it is
Figure 170613DEST_PATH_IMAGE005
If not, reducing the image of each frame of the input video to the original one
Figure 771359DEST_PATH_IMAGE008
And converting the reduced image into YCbCr420 format, the obtained data amount is of the input video
Figure 906805DEST_PATH_IMAGE007
A first code stream of;
and step S30, transmitting the first code stream through a single link, performing data restoration on the transmitted first code stream, and outputting an output video with the same size as the input video after the data restoration.
In order to more clearly describe the data transmission method for low-bandwidth high-resolution video transmission according to the present invention, the following describes the steps in the embodiment of the present invention in detail with reference to fig. 2.
The data transmission method for low-bandwidth high-resolution video transmission according to the first embodiment of the present invention includes steps S10-S30, and the steps are described in detail as follows:
the video is composed of continuous images, the images are composed of a plurality of pixel points, adjacent pixel points in the natural images have continuity to a certain extent, therefore, RGB data are converted into a format of YCbCr420 data or a Bayer array, the converted data can be restored into a format of RGB444, a picture displayed according to the restored data can be ensured to be complete, no obvious distortion exists, and the data transmission bandwidth can be reduced by converting the RGB data into the format of the YCbCr420 data or the Bayer array. Another method for reducing the data transmission bandwidth is image scaling, which performs the processing of "reduction-transmission-enlargement" on the image, and the enlarged picture can also ensure that the image has no obvious distortion.
The three data processing modes are comprehensively used according to a proper method: YCbCr420 conversion, Bayer array conversion and image scaling can divide data into a plurality of code streams, a complete image can be displayed when only the first code stream is transmitted, the image quality can be improved by increasing the number of the code streams, and if the code streams are transmitted, the video image is received directly.
Step S10, calculating the number of detachable code streams of the input video based on the video bandwidth and the data transmission link bandwidth of the input video
Figure 516778DEST_PATH_IMAGE001
As shown in formula (1):
Figure 280335DEST_PATH_IMAGE040
wherein the content of the first and second substances,
Figure 176616DEST_PATH_IMAGE011
representing the bandwidth of the incoming video,
Figure 923992DEST_PATH_IMAGE012
representing the bandwidth of a single link over which the video is transmitted,
Figure 72076DEST_PATH_IMAGE013
representing a rounding up operation.
For example, the bandwidth of a single link is 5Gbps, video resolutionA rate of
Figure DEST_PATH_IMAGE041
Bandwidth of input video
Figure 96664DEST_PATH_IMAGE011
As shown in formula (2):
Figure DEST_PATH_IMAGE043
at this time, the number of split streams is as shown in equation (3):
Figure DEST_PATH_IMAGE045
step S20, judging the number of the split code stream
Figure 996137DEST_PATH_IMAGE001
And executing:
if the number of the divided code streams
Figure 575017DEST_PATH_IMAGE001
If the video number is 1, taking the input video as a first code stream;
if the number of the divided code streams
Figure 261213DEST_PATH_IMAGE001
Is a multiple of 2, at the same time
Figure 264941DEST_PATH_IMAGE001
If not, reducing the image of each frame of the input video to the original one
Figure 503024DEST_PATH_IMAGE002
And converting the reduced image into YCbCr420 format to obtain the input video data
Figure 959414DEST_PATH_IMAGE003
A first code stream of;
if the number of the divided code streams
Figure 590246DEST_PATH_IMAGE001
Is a multiple of 3, the image of each frame of the input video is reduced to the original one
Figure 182902DEST_PATH_IMAGE004
And converting the reduced image into Bayer array format to obtain a data volume of the input video
Figure 732832DEST_PATH_IMAGE003
A first code stream of;
otherwise, judging
Figure 302615DEST_PATH_IMAGE005
Whether or not it is a multiple of 3, if
Figure 330614DEST_PATH_IMAGE005
Is a multiple of 3, the image of each frame of the input video is reduced to the original one
Figure 43355DEST_PATH_IMAGE006
And converting the reduced image into Bayer array format to obtain a data volume of the input video
Figure 639553DEST_PATH_IMAGE007
A first code stream of; if it is
Figure 70534DEST_PATH_IMAGE005
If not, reducing the image of each frame of the input video to the original one
Figure 902224DEST_PATH_IMAGE008
And converting the reduced image into YCbCr420 format, the obtained data amount is of the input video
Figure 594105DEST_PATH_IMAGE007
The first code of (1).
Splitting the code stream according to the number of the split code stream to realizeImage compression when
Figure 485838DEST_PATH_IMAGE001
When =1, a single link can transmit complete video data;
Figure 138536DEST_PATH_IMAGE001
when =2, the amount of video data can be reduced to that of YCbCr420 conversion
Figure 649283DEST_PATH_IMAGE046
Figure 71037DEST_PATH_IMAGE001
Where =3, the bayer array can reduce the amount of video data to that using bayer array conversion
Figure DEST_PATH_IMAGE047
(ii) a If it is not
Figure 287999DEST_PATH_IMAGE048
The YCbCr420 conversion or bayer array conversion is used in combination with image scaling. The scaling of the image scaling may be based on
Figure 427993DEST_PATH_IMAGE001
To determine if
Figure 742431DEST_PATH_IMAGE001
Is a multiple of 2, and the video picture needs to be reduced to the original one by adopting the method of YCbCr420 conversion combined with image scaling
Figure 18691DEST_PATH_IMAGE002
(ii) a If it is not
Figure 517806DEST_PATH_IMAGE001
Is a multiple of 3, and the video image needs to be reduced to the original image by adopting a Bayer array mode
Figure DEST_PATH_IMAGE049
. TABLE 1 Split number of bitstreams for input video
Figure 535309DEST_PATH_IMAGE001
The corresponding relation with the code stream splitting method is as follows:
TABLE 1
Figure DEST_PATH_IMAGE051
The manner of bayer array conversion is selected. If the receiving end only receives the code stream on the 1 link, only Bayer array data is transmitted as a main code stream, and the restored image can be completely displayed, but the image quality is slightly poor; if the receiving end receives the code stream on the 2 links, the restored image can be completely displayed, and the image quality is improved compared with the scheme of 1 link; if the receiving end receives the code stream on the 3 links, the restored image is the same as the original image.
In step S20, the reduced image is converted into YCbCr420 format by:
in step S211, the reduced RGB444 format image is converted into a YCbCr444 format image according to different conversion coefficients.
When the conversion coefficient follows the BT601 format, as shown in equation (4) to equation (6):
Figure DEST_PATH_IMAGE053
Figure DEST_PATH_IMAGE055
Figure DEST_PATH_IMAGE057
when the transform coefficients conform to the BT709 format, as shown in equations (7) to (9):
Figure DEST_PATH_IMAGE059
Figure DEST_PATH_IMAGE061
Figure DEST_PATH_IMAGE063
when the conversion coefficient follows the BT2020 format, as shown in equation (10) to equation (12):
Figure DEST_PATH_IMAGE065
Figure DEST_PATH_IMAGE067
Figure DEST_PATH_IMAGE069
wherein the content of the first and second substances,
Figure 732066DEST_PATH_IMAGE070
for the three components of the pixel values of the converted YCbCr444 format image,
Figure DEST_PATH_IMAGE071
three components of pixel values for the pre-conversion RGB444 format image;
in step S212, each frame of YCbCr 444-format image is converted into a YCbCr 420-format image, and an input video in the YCbCr420 format is obtained.
Step S212, converting the YCbCr444 format image into a YCbCr420 format image, wherein the method comprises the following steps:
adjacent 4 pixels in the YCbCr444 format image are sequentially divided into one group, and for each group of pixels, a Y component of 4 pixels, a Cb component of 1 set position pixel, and a Cr component of 1 set position pixel are retained, so that a YCbCr420 format image is obtained.
As shown in fig. 3, a pixel schematic diagram of an image in YCbCr444 format according to an embodiment of the data transmission method for low-bandwidth high-resolution video transmission of the present invention includes pixel 0 (Y0, Cb0, Cr 0), pixel 1 (Y1, Cb1, Cr 1), pixel 2 (Y2, Cb2, Cr 2), pixel 3 (Y3, Cb3, Cr 3), pixel 4 (Y4, Cb4, Cr 4), pixel 5 (Y5, Cb5, Cr 5), pixel 6 (Y6, Cb6, Cr 6), pixel 7 (Y7, Cb7, Cr 7) … …, and all of the Y component, Cb component, and Cr component are 8 bits.
As shown in fig. 4, in order to convert an image in YCbCr444 format into a pixel schematic diagram in YCbCr420 format according to an embodiment of the data transmission method for low-bandwidth high-resolution video transmission of the present invention, all Y component data (Y0, Y1, Y2, Y3, Y4, Y5, Y6, and Y7) are retained, and Cb components (Cb 0, Cb 4) of one pixel and Cr components (Cr 1, Cr 5) of one pixel are retained in each 4 pixels, that is, dark background data in the diagram is valid data. Thus, in every 4 adjacent pixels, the YCbCr444 format has 96-bit data volume, the YCbCr420 format has 48-bit data volume, and the converted video data volume is the video data volume before conversion
Figure 534937DEST_PATH_IMAGE072
In step S20, the reduced image is converted into bayer array format in step S20, by:
step S221, establishing a rectangular coordinate system by taking the upper left corner of the reduced RGB444 format image as an origin, and setting the distance between adjacent pixels in the horizontal and vertical directions as 1;
step S222, coordinates are determined through a rectangular coordinate system
Figure DEST_PATH_IMAGE073
Representing each pixel point;
step S223, when a pixel point
Figure 87842DEST_PATH_IMAGE074
And
Figure DEST_PATH_IMAGE075
when the number of the pixels is even or even odd, only the G component of the pixel point is reserved; when a pixel is formed
Figure 468008DEST_PATH_IMAGE074
Is an even number,
Figure 858669DEST_PATH_IMAGE075
When the number is odd, only the B component of the pixel point is reserved; when a pixel is formed
Figure 109522DEST_PATH_IMAGE074
Is odd number,
Figure 950439DEST_PATH_IMAGE075
And when the number is an even number, only the R component of the pixel point is reserved, and the Bayer array format image is obtained.
As shown in fig. 5, for a schematic diagram of converting an RGB444 format image into a bayer array format pixel according to an embodiment of the data transmission method for low-bandwidth high-resolution video transmission of the present invention, taking a case where R, G, and B components in the image are all 8bit as an example, fig. 5 (a) is RGB444 data of H row and V column, a rectangular coordinate system is established with an upper left corner as an origin, distances between pixels (including horizontal and vertical directions) are all set to 1, a pixel of a 1 st row and a 1 st column is (0, 0), and a pixel of an x row and a y column is a pixel of an x row and a y column
Figure 411376DEST_PATH_IMAGE073
When is coming into contact with
Figure 995941DEST_PATH_IMAGE074
And
Figure 101300DEST_PATH_IMAGE075
when the numbers are even or odd, only the G component of the pixel point is reserved; when in use
Figure 988485DEST_PATH_IMAGE074
Is an even number,
Figure 546505DEST_PATH_IMAGE075
When the number is odd, only the B component of the pixel point is reserved; when in use
Figure 560860DEST_PATH_IMAGE074
Is odd number,
Figure 520725DEST_PATH_IMAGE075
If the number is even, only the R component of the pixel is retained, and the bayer array pattern image shown in fig. 5 (b) is obtained. Thus, the amount of data carried by an RGB444 video image is
Figure 703445DEST_PATH_IMAGE076
The amount of data carried by a Bayer array video image is
Figure DEST_PATH_IMAGE077
Of an amount of RGB444 video data
Figure 420865DEST_PATH_IMAGE078
And step S30, transmitting the first code stream through a single link, performing data restoration on the transmitted first code stream, and outputting an output video with the same size as the input video after the data restoration.
Before video output, there is also code stream data supplement step, when the number of the said detachable code stream
Figure DEST_PATH_IMAGE079
When the number is a multiple of 3 and a number other than 1, the code stream supplementing method comprises the following steps:
cb components and Cr components except Cb components of 1 set position pixel and Cr components of 1 set position pixel reserved in the conversion of the YCbCr420 format are used as code stream supplementary data and recorded as a second code stream;
the image before the conversion of YCbCr420 format is amplified and reduced according to the image reduction multiple, the reduced image and the corresponding frame image of the input video are calculated according to the corresponding pixel difference value, the calculation result is divided into
Figure 471867DEST_PATH_IMAGE080
The parts are respectively marked as a third code stream, … … and a fourth code stream
Figure 551818DEST_PATH_IMAGE079
Code stream;
sequentially performing a first code stream, a second code stream, a third code stream, … … and a third code stream through a single link
Figure 905439DEST_PATH_IMAGE079
Transmitting the code stream;
if the number of the divided code streams
Figure 578997DEST_PATH_IMAGE079
If the number of the code streams is 2, converting the first code stream and the second code stream into RGB444 format data after aligning and combining the first code stream and the second code stream to obtain an output video;
if the number of the divided code streams
Figure 777897DEST_PATH_IMAGE079
If the number of the code streams is 4, the first code stream and the second code stream are aligned and combined and then converted into RGB444 format data, then the RGB444 format data are amplified and restored according to the image reduction multiple, and the amplified and restored image, the third code stream and the fourth code stream are aligned and overlapped to obtain an output video;
if the number of the divided code streams
Figure 601103DEST_PATH_IMAGE079
Is a multiple of 2 other than 2 and 4, and
Figure 125626DEST_PATH_IMAGE079
the first code stream and the second code stream are aligned and combined and then converted into RGB444 format data, the RGB444 format data are amplified and restored according to the image reduction multiple, and the amplified and restored image, the third code stream, … … and the third code stream are combined and then converted into RGB444 format data
Figure 145534DEST_PATH_IMAGE079
And aligning and superposing the code streams to obtain an output video.
The YCbCr444 data is converted into supplementary data of the YCbCr420 data, that is, data that is not retained during the conversion of the YCbCr444 to the YCbCr 420. As shown in fig. 6, the YCbCr444 format image converted into the complementary data map of the YCbCr420 format according to an embodiment of the data transmission method for low-bandwidth high-resolution video transmission of the present invention includes Cb components (Cb 1, Cb2, Cb3, Cb5, Cb6, Cb 7) and Cr components (Cr 0, Cr2, Cr3, Cr4, Cr6, Cr 7), i.e., the deep background portion data in the map is the complementary data.
After the effective data and the supplementary data are aligned and combined, complete YCbCr444 format data are obtained, then reverse conversion is carried out through the formula (4) -formula (12) according to different formats followed by conversion coefficients, the YCbCr444 format data are converted into RGB444 format data, and the consistent transmission of output videos and input videos is achieved.
Before video output, there is also code stream data supplement step, when the number of the said detachable code stream
Figure 289071DEST_PATH_IMAGE079
When the number of the code stream is multiple of 3, the code stream supplementing method comprises the following steps:
taking the Bayer array complementary data B as a second code stream and taking the Bayer array complementary data R as a third code stream; for each pixel of the video frame image, if the R component, the G component, or the B component remains in the bayer array conversion, the G component, the B component, or the R component remains in the pixel in the bayer array supplemental data B, and the B component, the R component, or the G component remains in the pixel in the bayer array supplemental data R;
the first code stream before Bayer array format conversion is subjected to image amplification reduction according to image reduction times, corresponding pixel difference value calculation is carried out on the reduced image and a corresponding frame image of an input video, and a calculation result is split into
Figure DEST_PATH_IMAGE081
The parts are respectively marked as a fourth code stream, … … and a fourth code stream
Figure 609194DEST_PATH_IMAGE079
Code stream;
sequentially performing a first code stream, a second code stream and a third code stream through a single linkA fourth code stream … …, a fourth code stream
Figure 163672DEST_PATH_IMAGE079
Transmitting the code stream;
if the number of the divided code streams
Figure 936456DEST_PATH_IMAGE079
If the number is 3, aligning and combining the first code stream, the second code stream and the third code stream to obtain an output video;
if the number of the divided code streams
Figure 742738DEST_PATH_IMAGE079
If the number is 6, the first code stream, the second code stream and the third code stream are aligned and combined, the aligned and combined image is amplified and restored according to the image reduction multiple, and the amplified and restored image, the fourth code stream, the fifth code stream and the sixth code stream are aligned and superposed to obtain an output video;
otherwise, aligning and combining the first code stream, the second code stream and the third code stream, then carrying out amplification reduction of the aligned and combined image according to the image reduction multiple, and carrying out amplification reduction on the image, the fourth code stream, … … and the fourth code stream
Figure 527154DEST_PATH_IMAGE079
And aligning and superposing the code streams to obtain an output video.
Changing color component information carried by pixel points on a Bayer array, so that pixel points carrying R components carry G components, pixel points carrying G components carry B components, and pixel points carrying B components carry R components, thereby obtaining Bayer array complementary data, namely Bayer array B; and (3) enabling the pixel points carrying the R component to carry the B component, the pixel points carrying the G component to carry the R component and the pixel points carrying the B component to carry the G component to obtain Bayer array complementary data, namely the Bayer array R.
As shown in fig. 7, in the data transfer method for low-bandwidth high-resolution video transfer according to an embodiment of the present invention, the RGB444 format image is converted into a supplemental data map in a bayer array format, fig. 7 (a) shows a bayer array B (i.e., data of the second code stream) composed of a G component, a B component, and an R component discarded when the R component, the G component, and the B component are retained in the bayer array conversion, and fig. 7 (B) shows a bayer array R (i.e., data of the third code stream) composed of a B component, an R component, and a G component discarded when the R component, the G component, and the B component are retained in the bayer array conversion.
And distributing the converted code stream to a data transmission link according to the requirement of an actual use scene, wherein the priority of code stream transmission is that the first code stream > the second code stream > the third code stream > ….
The above-mentioned splitting of the calculation result, taking splitting into L parts, and taking sampling at intervals in the horizontal direction as an example, is explained as follows:
the first selected the pixels with horizontal coordinates of 0, 0+1 × L, 0+2 × L, … … in each row, the second selected 1, 1+1 × L, 1+2 × L, … …, the third selected … … was L-1, L-1+1 × L, L-1+2 × L, … ….
Receiving the transmitted code stream, if the video data is reduced, amplifying the reduced code stream to obtain a video image with the same resolution as that before reduction, wherein the video image can carry basic information of an original video; if the received code stream also contains the reduced supplementary data, the supplementary data is superposed on the amplified video image according to the pixel point coordinates to supplement the detail information of the original video.
Although the foregoing embodiments describe the steps in the above sequential order, those skilled in the art will understand that, in order to achieve the effect of the present embodiments, the steps may not be executed in such an order, and may be executed simultaneously (in parallel) or in an inverse order, and these simple variations are within the scope of the present invention.
Next, for different numbers of splittable code streams
Figure 393479DEST_PATH_IMAGE079
And different number of transmission links
Figure 14078DEST_PATH_IMAGE082
The data receiving and data restoring conditions are further explained to more clearly understand the code stream supplementing method and the data receiving and data restoring process of the invention:
sequentially performing a first code stream, a second code stream, a third code stream, a fourth code stream, … … and a third code stream through a single link
Figure 624051DEST_PATH_IMAGE079
After the transmission of the code stream; the receiving end can use the data transmission link quantity according to each way of input video
Figure 653187DEST_PATH_IMAGE082
And number of separable bitstreams per input video
Figure 300200DEST_PATH_IMAGE079
The data restoration method is determined, and the restored video data is output, so that an input video picture which is lossless or has slightly poor image quality but is not distorted can be displayed.
When in use
Figure DEST_PATH_IMAGE083
And is
Figure 313156DEST_PATH_IMAGE084
When the video is received, the receiving end directly outputs the first code stream of the received input video, and the input video picture can be displayed without damage;
when in use
Figure DEST_PATH_IMAGE085
When, if
Figure 117033DEST_PATH_IMAGE084
If the receiving end performs linear interpolation on the first code stream of the received input video to acquire YCbCr444 format data, then performs reverse conversion through the formula (4) -formula (12) according to the different formats followed by the conversion coefficients, converts the YCbCr444 format data into RGB444 format data, outputs the acquired RGB444 format video data, and outputs the output video which can display slightly poor-quality but undistorted videoInputting a video picture; if it is
Figure 735096DEST_PATH_IMAGE086
If the receiving end aligns and combines the first code stream and the second code stream of the received input video to obtain the data in the YCbCr444 format, then carries out reverse conversion through the formula (4) -formula (12) according to the different formats followed by the conversion coefficients, converts the data in the YCbCr444 format into the data in the RGB444 format, outputs the obtained video data in the RGB444 format, and outputs the video which can display the lossless input video picture;
when in use
Figure DEST_PATH_IMAGE087
When, if
Figure 84169DEST_PATH_IMAGE084
If so, the receiving end performs linear interpolation on the first code stream of the received input video to obtain RGB444 format data, and outputs the obtained RGB444 format video data, and the output video can display an input video picture with slightly poor image quality but no distortion; if it is
Figure 682290DEST_PATH_IMAGE086
If the receiving end aligns and combines the first code stream and the second code stream of the received input video, then linear interpolation is performed to obtain RGB444 format data, and the obtained RGB444 format video data is output, the output video can display an input video picture with slightly poor image quality but no distortion, and the image quality is better than that of the input video picture
Figure 634065DEST_PATH_IMAGE087
And is and
Figure 372214DEST_PATH_IMAGE084
the case (1); if it is
Figure 626609DEST_PATH_IMAGE088
The receiving end aligns and combines the first code stream, the second code stream and the third code stream of the received input video to obtain RGB444 format data, and obtains RGB444 gridsThe video data output of the formula is that the output video can display lossless input video pictures;
when in use
Figure DEST_PATH_IMAGE089
When, if
Figure 348578DEST_PATH_IMAGE084
If so, the receiving end performs linear interpolation on the first code stream of the received input video to acquire YCbCr444 format data, then converts the YCbCr444 format data into RGB444 format data, amplifies the acquired RGB444 format video frame picture according to the image reduction multiple, and then outputs the amplified video data, and the output video can display an input video picture with slightly poor picture quality but no distortion; if it is
Figure 963099DEST_PATH_IMAGE086
If the receiving end aligns and combines the first code stream and the second code stream of the received input video to obtain the data in the YCbCr444 format, then converts the data in the YCbCr444 format into the data in the RGB444 format, amplifies the video picture in the RGB444 format according to the image reduction multiple, and then outputs the amplified video data, the output video can display the input video picture with slightly poor but undistorted image quality, and the image quality is better than that of the input video picture
Figure 821333DEST_PATH_IMAGE089
And is and
Figure 371263DEST_PATH_IMAGE084
the case (1); if it is
Figure 924735DEST_PATH_IMAGE088
Then, the receiving end aligns and combines the first code stream and the second code stream of the received input video to obtain data in the YCbCr444 format, then converts the data in the YCbCr444 format into data in the RGB444 format, amplifies the video picture in the RGB444 format according to the image reduction multiple, aligns and superposes the amplified video picture with the third code stream, then outputs the aligned and superposed video data, and outputs a video capable of being outputTo display a slightly less distorted input video picture with better picture quality than the input video picture
Figure 218313DEST_PATH_IMAGE089
And is and
Figure 557153DEST_PATH_IMAGE086
the case (1); if it is
Figure 277984DEST_PATH_IMAGE090
If so, the receiving end aligns and combines the first code stream and the second code stream of the received input video to obtain YCbCr444 format data, then converts the YCbCr444 format data into RGB444 format data, amplifies the obtained RGB444 format video picture according to the image reduction multiple, aligns and superposes the amplified video picture with the third code stream and the fourth code stream, then outputs the aligned and superposed video data, and the output video can display lossless input video pictures;
when in use
Figure DEST_PATH_IMAGE091
When it comes to
Figure 849911DEST_PATH_IMAGE092
A temporal processing mode;
when in use
Figure 947180DEST_PATH_IMAGE092
When, if
Figure 248849DEST_PATH_IMAGE084
If so, the receiving end performs linear interpolation on the first code stream of the received input video to acquire RGB444 format data, amplifies the acquired video picture in the RGB444 format according to the image reduction multiple, outputs the amplified video data, and outputs the video capable of displaying the input video picture with slightly poor image quality but no distortion; if it is
Figure 530794DEST_PATH_IMAGE086
If the receiving end receives the first code stream of the input video andthe second code stream is aligned and combined, linear interpolation is carried out to obtain RGB444 format data, the obtained RGB444 format video picture is amplified according to the image reduction multiple, the amplified video data is output, the output video can display the input video picture with slightly poor image quality but no distortion, and the image quality is better than that of the input video picture
Figure 917913DEST_PATH_IMAGE092
And is and
Figure 694239DEST_PATH_IMAGE084
the case (1); if it is
Figure 115993DEST_PATH_IMAGE088
Then, the receiving end aligns and combines the first code stream, the second code stream and the third code stream of the received input video to obtain RGB444 format data, amplifies the obtained RGB444 format video picture according to the image reduction multiple, and outputs the amplified video data, the output video can display the input video picture with slightly poor image quality but no distortion, and the image quality is better than that of the input video picture
Figure 444207DEST_PATH_IMAGE092
And is and
Figure 941791DEST_PATH_IMAGE086
the case (1); if it is
Figure 380862DEST_PATH_IMAGE090
Then, the receiving end aligns and combines the first code stream, the second code stream and the third code stream of the received input video to obtain RGB444 format data, amplifies the obtained video picture in RGB444 format according to the image reduction multiple, aligns and superposes the amplified video data with the fourth code stream, then outputs the aligned and superposed video data, the output video can display the input video picture with slightly poor but not distorted image quality, and the image quality is better than that of the input video picture
Figure 657123DEST_PATH_IMAGE092
And is and
Figure 31603DEST_PATH_IMAGE088
the case (1); if it is
Figure 393315DEST_PATH_IMAGE093
Then, the receiving end aligns and combines the first code stream, the second code stream and the third code stream of the received input video to obtain RGB444 format data, amplifies the obtained video picture in RGB444 format according to the image reduction multiple, aligns and superposes the amplified video data with the fourth code stream and the fifth code stream, then outputs the aligned and superposed video data, the output video can display the input video picture with slightly poor image quality but no distortion, and the image quality is better than that of the input video picture with slightly poor image quality but no distortion
Figure 760711DEST_PATH_IMAGE092
And is and
Figure 157057DEST_PATH_IMAGE090
the case (1); if it is
Figure 827073DEST_PATH_IMAGE094
If so, the receiving end aligns and combines the first code stream, the second code stream and the third code stream of the received input video to obtain RGB444 format data, amplifies the obtained video picture in the RGB444 format according to the image reduction multiple, aligns and superposes the amplified video data with the fourth code stream, the fifth code stream and the sixth code stream, outputs the aligned and superposed video data, and the output video can display a lossless input video picture;
when in use
Figure 285867DEST_PATH_IMAGE079
Is a multiple of 2, at the same time
Figure 332321DEST_PATH_IMAGE079
If not a multiple of 3
Figure 474851DEST_PATH_IMAGE095
Then the processing manner is
Figure 50189DEST_PATH_IMAGE089
Figure 386493DEST_PATH_IMAGE095
The temporal video processing methods are the same; if it is
Figure 580845DEST_PATH_IMAGE096
Then the processing manner is
Figure 951783DEST_PATH_IMAGE089
Figure 698022DEST_PATH_IMAGE096
The video processing method is similar, but the amplified video data is compared with the third code stream, … … and the fourth code stream
Figure 911835DEST_PATH_IMAGE082
Code stream alignment and superposition;
when in use
Figure 768932DEST_PATH_IMAGE079
Is a multiple of 3, if
Figure 135323DEST_PATH_IMAGE097
Then the processing manner is
Figure 52463DEST_PATH_IMAGE092
Figure 363359DEST_PATH_IMAGE097
The temporal video processing methods are the same; if it is
Figure 664894DEST_PATH_IMAGE098
Then the processing manner is
Figure 10425DEST_PATH_IMAGE092
Figure 98467DEST_PATH_IMAGE098
The temporal video processing method is similar except that the amplified video data is compared with the fourth oneCode stream, … …, No
Figure 506445DEST_PATH_IMAGE082
Code stream alignment and superposition;
when in use
Figure 236504DEST_PATH_IMAGE079
When the number of the first and second electrodes is not a multiple of 2 or 3, the first electrode is observed
Figure DEST_PATH_IMAGE099
If it is a multiple of 3, the processing method is the same as that of the previous one
Figure 826754DEST_PATH_IMAGE079
The video processing method is the same as the multiple of 3, otherwise, the processing mode is the same as that of the video processing method
Figure 85697DEST_PATH_IMAGE079
Is a multiple of 2 and
Figure 246551DEST_PATH_IMAGE079
video processing methods that are not multiples of 3 are the same.
A data transmission system for low-bandwidth high-resolution video transmission according to a second embodiment of the present invention includes the following modules:
a detachable bitstream number acquisition module configured to calculate a detachable bitstream number of an input video based on a video bandwidth and a data transmission link bandwidth of the input video
Figure 514722DEST_PATH_IMAGE079
A first judging and skipping module configured to judge the number of the detachable code streams
Figure 569265DEST_PATH_IMAGE079
And executing: if the number of the divided code streams
Figure 625208DEST_PATH_IMAGE079
Figure 625208DEST_PATH_IMAGE079
1, taking the input video as a first code stream, and skipping codesA streaming module; if the number of the divided code streams
Figure 132413DEST_PATH_IMAGE079
Is a multiple of 2, at the same time
Figure 204274DEST_PATH_IMAGE079
If the number is not multiple of 3, skipping to the code stream compression module 1; if the number of the divided code streams
Figure 988691DEST_PATH_IMAGE079
If the number is multiple of 3, skipping to the code stream compression module 2; otherwise, skipping to a second judging and skipping module;
a second judging and skipping module configured to determine if
Figure 855015DEST_PATH_IMAGE099
If the number is multiple of 3, skipping to the code stream compression module 3; if it is
Figure 974150DEST_PATH_IMAGE099
If the number of the code stream is not multiple of 3, skipping to the code stream compression module 4;
a code stream compression module 1 configured to reduce each frame of image of the input video to the original one
Figure 584123DEST_PATH_IMAGE100
And converting the reduced image into YCbCr420 format to obtain the input video data
Figure DEST_PATH_IMAGE101
And skipping to the code stream transmission module;
a code stream compression module 2 configured to reduce each frame of image of the input video to the original one
Figure 488625DEST_PATH_IMAGE102
And converting the reduced image into Bayer array format to obtain a data volume of the input video
Figure 525851DEST_PATH_IMAGE101
And skipping to the code stream transmission module;
a code stream compression module 3 configured to reduce each frame of image of the input video to the original one
Figure 7648DEST_PATH_IMAGE103
And converting the reduced image into Bayer array format to obtain a data volume of the input video
Figure 778902DEST_PATH_IMAGE104
And skipping to the code stream transmission module;
a code stream compression module 4 configured to reduce each frame of image of the input video to the original one
Figure 662544DEST_PATH_IMAGE105
And converting the reduced image into YCbCr420 format, the obtained data amount is of the input video
Figure 870671DEST_PATH_IMAGE104
And skipping to the code stream transmission module;
the code stream transmission module is configured to transmit the first code stream through a single link;
and the output module is configured to perform data restoration on the transmitted first code stream, and output video with the same size as the input video after the data restoration is output.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process and related description of the system described above may refer to the corresponding process in the foregoing method embodiments, and will not be described herein again.
It should be noted that, the data transmission system for low-bandwidth high-resolution video transmission provided in the foregoing embodiment is only illustrated by the division of the above functional modules, and in practical applications, the above functions may be allocated to different functional modules according to needs, that is, the modules or steps in the embodiments of the present invention are further decomposed or combined, for example, the modules in the foregoing embodiment may be combined into one module, or may be further split into multiple sub-modules, so as to complete all or part of the above described functions. The names of the modules and steps involved in the embodiments of the present invention are only for distinguishing the modules or steps, and are not to be construed as unduly limiting the present invention.
An electronic apparatus according to a third embodiment of the present invention includes:
at least one processor; and
a memory communicatively coupled to at least one of the processors; wherein the content of the first and second substances,
the memory stores instructions executable by the processor for execution by the processor to implement the data transfer method of low bandwidth high resolution video transmission described above.
A computer-readable storage medium of a fourth embodiment of the present invention stores computer instructions for execution by the computer to implement the data transmission method for low-bandwidth high-resolution video transmission described above.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes and related descriptions of the storage device and the processing device described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
Those of skill in the art would appreciate that the various illustrative modules, method steps, and modules described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that programs corresponding to the software modules, method steps may be located in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. To clearly illustrate this interchangeability of electronic hardware and software, various illustrative components and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as electronic hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The terms "first," "second," and the like are used for distinguishing between similar elements and not necessarily for describing or implying a particular order or sequence.
The terms "comprises," "comprising," or any other similar term are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
So far, the technical solutions of the present invention have been described in connection with the preferred embodiments shown in the drawings, but it is easily understood by those skilled in the art that the scope of the present invention is obviously not limited to these specific embodiments. Equivalent changes or substitutions of related technical features can be made by those skilled in the art without departing from the principle of the invention, and the technical scheme after the changes or substitutions can fall into the protection scope of the invention.

Claims (10)

1. A data transmission method for low-bandwidth high-resolution video transmission, the data transmission method comprising:
step S10, calculating the number of detachable code streams of the input video based on the video bandwidth and the data transmission link bandwidth of the input video
Figure DEST_PATH_IMAGE001
Step S20, judging the number of the split code stream
Figure 391987DEST_PATH_IMAGE001
And executing:
if the number of the divided code streams
Figure 657883DEST_PATH_IMAGE001
If the video number is 1, taking the input video as a first code stream;
if the number of the divided code streams
Figure 1140DEST_PATH_IMAGE001
Is a multiple of 2, at the same time
Figure 33687DEST_PATH_IMAGE001
If not, reducing the image of each frame of the input video to the original one
Figure 513210DEST_PATH_IMAGE002
And converting the reduced image into YCbCr420 format to obtain the input video data
Figure DEST_PATH_IMAGE003
A first code stream of;
if the number of the divided code streams
Figure 809062DEST_PATH_IMAGE001
Is a multiple of 3, the image of each frame of the input video is reduced to the original one
Figure 639614DEST_PATH_IMAGE004
And converting the reduced image into Bayer array format to obtain a data volume of the input video
Figure 85639DEST_PATH_IMAGE003
A first code stream of;
otherwise, judging
Figure DEST_PATH_IMAGE005
Whether or not it is a multiple of 3, if
Figure 529257DEST_PATH_IMAGE005
Is a multiple of 3, then the video will be inputEach frame of image is reduced to the original one
Figure 527169DEST_PATH_IMAGE006
And converting the reduced image into Bayer array format to obtain a data volume of the input video
Figure DEST_PATH_IMAGE007
A first code stream of; if it is
Figure 313860DEST_PATH_IMAGE005
If not, reducing the image of each frame of the input video to the original one
Figure 422630DEST_PATH_IMAGE008
And converting the reduced image into YCbCr420 format, the obtained data amount is of the input video
Figure 876745DEST_PATH_IMAGE007
A first code stream of;
and step S30, transmitting the first code stream through a single link, performing data restoration on the transmitted first code stream, and outputting an output video with the same size as the input video after the data restoration.
2. The method of claim 1, wherein the input video has a number of separable bitstreams
Figure 920924DEST_PATH_IMAGE001
It is expressed as:
Figure 585124DEST_PATH_IMAGE010
wherein the content of the first and second substances,
Figure DEST_PATH_IMAGE011
means for conveyingThe bandwidth of the incoming video is such that,
Figure 467891DEST_PATH_IMAGE012
representing the bandwidth of a single link over which the video is transmitted,
Figure DEST_PATH_IMAGE013
representing a rounding up operation.
3. The method of claim 1, wherein the step S20 is performed by converting the scaled-down image into YCbCr420 format, wherein the method comprises:
step S211, converting the reduced RGB444 format image into a YCbCr444 format image according to different conversion coefficients;
when the conversion coefficients follow the BT601 format:
Figure DEST_PATH_IMAGE015
Figure DEST_PATH_IMAGE017
Figure DEST_PATH_IMAGE019
when the transform coefficients follow the BT709 format:
Figure DEST_PATH_IMAGE021
Figure DEST_PATH_IMAGE023
Figure DEST_PATH_IMAGE025
when the conversion coefficients follow the BT2020 format:
Figure DEST_PATH_IMAGE027
Figure DEST_PATH_IMAGE029
Figure DEST_PATH_IMAGE031
wherein the content of the first and second substances,
Figure 55474DEST_PATH_IMAGE032
for the three components of the pixel values of the converted YCbCr444 format image,
Figure DEST_PATH_IMAGE033
three components of pixel values for the pre-conversion RGB444 format image;
in step S212, the YCbCr444 format image is converted into a YCbCr420 format image.
4. The method of claim 3, wherein the step S212 converts the YCbCr444 format image into the YCbCr420 format image by:
adjacent 4 pixels in the YCbCr444 format image are sequentially divided into one group, and for each group of pixels, a Y component of 4 pixels, a Cb component of 1 set position pixel, and a Cr component of 1 set position pixel are retained, so that a YCbCr420 format image is obtained.
5. The method for transmitting data in a low-bandwidth high-resolution video transmission according to claim 4, wherein the step S20 is performed by converting the reduced image into Bayer array format, and the method comprises:
step S221, establishing a rectangular coordinate system by taking the upper left corner of the reduced RGB444 format image as an origin, and setting the distance between adjacent pixels in the horizontal and vertical directions as 1;
step S222, coordinates are determined through a rectangular coordinate system
Figure 739396DEST_PATH_IMAGE034
Representing each pixel point;
step S223, when a pixel point
Figure DEST_PATH_IMAGE035
And
Figure 359734DEST_PATH_IMAGE036
when the number of the pixels is even or even odd, only the G component of the pixel point is reserved; when a pixel is formed
Figure 951252DEST_PATH_IMAGE035
Is an even number,
Figure 504593DEST_PATH_IMAGE036
When the number is odd, only the B component of the pixel point is reserved; when a pixel is formed
Figure 624996DEST_PATH_IMAGE035
Is odd number,
Figure 263788DEST_PATH_IMAGE036
And when the number is an even number, only the R component of the pixel point is reserved, and the Bayer array format image is obtained.
6. The method of claim 5, wherein the video output is preceded by a bitstream data supplement step, wherein the number of said divided bitstreams is equal to the number of said divided bitstreams
Figure 393418DEST_PATH_IMAGE001
When the number is a multiple of 3 and a number other than 1, the code stream supplementing method comprises the following steps:
cb components and Cr components except Cb components of 1 set position pixel and Cr components of 1 set position pixel reserved in the conversion of the YCbCr420 format are used as code stream supplementary data and recorded as a second code stream;
the image before the conversion of YCbCr420 format is amplified and reduced according to the image reduction multiple, the reduced image and the corresponding frame image of the input video are calculated according to the corresponding pixel difference value, the calculation result is divided into
Figure DEST_PATH_IMAGE037
The parts are respectively marked as a third code stream, … … and a fourth code stream
Figure 771572DEST_PATH_IMAGE001
Code stream;
sequentially performing a first code stream, a second code stream, a third code stream, … … and a third code stream through a single link
Figure 594034DEST_PATH_IMAGE001
Transmitting the code stream;
if the number of the divided code streams
Figure 329909DEST_PATH_IMAGE001
If the number of the code streams is 2, converting the first code stream and the second code stream into RGB444 format data after aligning and combining the first code stream and the second code stream to obtain an output video;
if the number of the divided code streams
Figure 387864DEST_PATH_IMAGE001
If the number of the code streams is 4, the first code stream and the second code stream are aligned and combined and then converted into RGB444 format data, then the RGB444 format data are amplified and restored according to the image reduction multiple, and the amplified and restored image, the third code stream and the fourth code stream are aligned and overlapped to obtain an output video;
if the number of the divided code streams
Figure 260005DEST_PATH_IMAGE001
Is a multiple of 2 over 2 and 4, simultaneously
Figure 253368DEST_PATH_IMAGE001
The first code stream and the second code stream are aligned and combined and then converted into RGB444 format data, the RGB444 format data are amplified and restored according to the image reduction multiple, and the amplified and restored image, the third code stream, … … and the third code stream are combined and then converted into RGB444 format data
Figure 601173DEST_PATH_IMAGE001
And aligning and superposing the code streams to obtain an output video.
7. The method of claim 6, wherein the video output is preceded by a bitstream data supplement step, wherein the number of said divided bitstreams is equal to the number of said divided bitstreams
Figure 72606DEST_PATH_IMAGE001
When the number of the code stream is multiple of 3, the code stream supplementing method comprises the following steps:
taking the Bayer array complementary data B as a second code stream and taking the Bayer array complementary data R as a third code stream; for each pixel of the video frame image, if the R component, the G component, or the B component remains in the bayer array conversion, the G component, the B component, or the R component remains in the pixel in the bayer array supplemental data B, and the B component, the R component, or the G component remains in the pixel in the bayer array supplemental data R;
the first code stream before Bayer array format conversion is subjected to image amplification reduction according to image reduction times, corresponding pixel difference value calculation is carried out on the reduced image and a corresponding frame image of an input video, and a calculation result is split into
Figure 189466DEST_PATH_IMAGE038
The parts are respectively marked as a fourth code stream, … … and a fourth code stream
Figure 353732DEST_PATH_IMAGE001
Code stream;
sequentially performing a first code stream, a second code stream, a third code stream, a fourth code stream, … … and a third code stream through a single link
Figure 798619DEST_PATH_IMAGE001
Transmitting the code stream;
if the number of the divided code streams
Figure 702771DEST_PATH_IMAGE001
If the number is 3, aligning and combining the first code stream, the second code stream and the third code stream to obtain an output video;
if the number of the divided code streams
Figure 815084DEST_PATH_IMAGE001
If the number is 6, the first code stream, the second code stream and the third code stream are aligned and combined, the aligned and combined image is amplified and restored according to the image reduction multiple, and the amplified and restored image, the fourth code stream, the fifth code stream and the sixth code stream are aligned and superposed to obtain an output video;
otherwise, aligning and combining the first code stream, the second code stream and the third code stream, then carrying out amplification reduction of the aligned and combined image according to the image reduction multiple, and carrying out amplification reduction on the image, the fourth code stream, … … and the fourth code stream
Figure 884671DEST_PATH_IMAGE001
And aligning and superposing the code streams to obtain an output video.
8. A data transmission system for low bandwidth high resolution video transmission, the data transmission system comprising the following modules:
a detachable bitstream number acquisition module configured to calculate a detachable bitstream number of an input video based on a video bandwidth and a data transmission link bandwidth of the input video
Figure 207068DEST_PATH_IMAGE001
A first judging and skipping module configured to judge the number of the detachable code streams
Figure 20303DEST_PATH_IMAGE001
And executing: if the number of the divided code streams
Figure 111756DEST_PATH_IMAGE001
If the number is 1, taking the input video as a first code stream, and skipping to a code stream transmission module; if the number of the divided code streams
Figure 352244DEST_PATH_IMAGE001
Is a multiple of 2, at the same time
Figure 37304DEST_PATH_IMAGE001
If the number is not multiple of 3, skipping to the code stream compression module 1; if the number of the divided code streams
Figure 778863DEST_PATH_IMAGE001
If the number is multiple of 3, skipping to the code stream compression module 2; otherwise, skipping to a second judging and skipping module;
a second judging and skipping module configured to determine if
Figure 600189DEST_PATH_IMAGE005
If the number is multiple of 3, skipping to the code stream compression module 3; if it is
Figure 277158DEST_PATH_IMAGE005
If the number of the code stream is not multiple of 3, skipping to the code stream compression module 4;
a code stream compression module 1 configured to reduce each frame of image of the input video to the original one
Figure 810033DEST_PATH_IMAGE002
And is combined withConverting the reduced image into YCbCr420 format to obtain the input video data
Figure 965070DEST_PATH_IMAGE003
And skipping to the code stream transmission module;
a code stream compression module 2 configured to reduce each frame of image of the input video to the original one
Figure 234378DEST_PATH_IMAGE004
And converting the reduced image into Bayer array format to obtain a data volume of the input video
Figure 941303DEST_PATH_IMAGE003
And skipping to the code stream transmission module;
a code stream compression module 3 configured to reduce each frame of image of the input video to the original one
Figure 335375DEST_PATH_IMAGE006
And converting the reduced image into Bayer array format to obtain a data volume of the input video
Figure 294104DEST_PATH_IMAGE007
And skipping to the code stream transmission module;
a code stream compression module 4 configured to reduce each frame of image of the input video to the original one
Figure 214655DEST_PATH_IMAGE008
And converting the reduced image into YCbCr420 format, the obtained data amount is of the input video
Figure 233427DEST_PATH_IMAGE007
And skipping to the code stream transmission module;
the code stream transmission module is configured to transmit the first code stream through a single link;
and the output module is configured to perform data restoration on the transmitted first code stream, and output video with the same size as the input video after the data restoration is output.
9. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to at least one of the processors; wherein the content of the first and second substances,
the memory stores instructions executable by the processor for performing the method of data transmission for low bandwidth high resolution video transmission of any of claims 1-7.
10. A computer-readable storage medium having stored thereon computer instructions for execution by the computer to implement the data transmission method of low-bandwidth high-resolution video transmission of any one of claims 1-7.
CN202210021556.3A 2022-01-10 2022-01-10 Data transmission method, system and equipment for low-bandwidth high-resolution video transmission Active CN114040226B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210021556.3A CN114040226B (en) 2022-01-10 2022-01-10 Data transmission method, system and equipment for low-bandwidth high-resolution video transmission

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210021556.3A CN114040226B (en) 2022-01-10 2022-01-10 Data transmission method, system and equipment for low-bandwidth high-resolution video transmission

Publications (2)

Publication Number Publication Date
CN114040226A CN114040226A (en) 2022-02-11
CN114040226B true CN114040226B (en) 2022-03-11

Family

ID=80147444

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210021556.3A Active CN114040226B (en) 2022-01-10 2022-01-10 Data transmission method, system and equipment for low-bandwidth high-resolution video transmission

Country Status (1)

Country Link
CN (1) CN114040226B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116170592B (en) * 2023-04-21 2023-08-15 深圳市微智体技术有限公司 High-resolution video transmission method, device, equipment and medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101640674A (en) * 2009-09-03 2010-02-03 田园 Method for realizing direct broadcast of P2P high code stream data
CN101977330A (en) * 2010-11-12 2011-02-16 北京空间机电研究所 Bayer image compression method based on YUV conversion
CN105791836A (en) * 2016-03-07 2016-07-20 中国科学院计算技术研究所 Video coding method, video code stream adaptive transmission method and display method
CN108496369A (en) * 2017-03-30 2018-09-04 深圳市大疆创新科技有限公司 Transmission of video, method of reseptance, system, equipment and unmanned vehicle
CN108513712A (en) * 2017-03-30 2018-09-07 深圳市大疆创新科技有限公司 Video transmission method, method of reseptance, system and unmanned vehicle
CN111770347A (en) * 2020-07-17 2020-10-13 广州市奥威亚电子科技有限公司 Video transmission method and system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7142251B2 (en) * 2001-07-31 2006-11-28 Micronas Usa, Inc. Video input processor in multi-format video compression system
US8532170B2 (en) * 2007-08-29 2013-09-10 Harman International Industries, Incorporated Enhanced presentation of sub-picture information
JP2015019182A (en) * 2013-07-10 2015-01-29 ソニー株式会社 Signal processor, signal processing method, program, signal transmission system
US10334219B2 (en) * 2015-10-12 2019-06-25 Lumantek Co., Ltd Apparatus for switching/routing image signals through bandwidth splitting and reduction and the method thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101640674A (en) * 2009-09-03 2010-02-03 田园 Method for realizing direct broadcast of P2P high code stream data
CN101977330A (en) * 2010-11-12 2011-02-16 北京空间机电研究所 Bayer image compression method based on YUV conversion
CN105791836A (en) * 2016-03-07 2016-07-20 中国科学院计算技术研究所 Video coding method, video code stream adaptive transmission method and display method
CN108496369A (en) * 2017-03-30 2018-09-04 深圳市大疆创新科技有限公司 Transmission of video, method of reseptance, system, equipment and unmanned vehicle
CN108513712A (en) * 2017-03-30 2018-09-07 深圳市大疆创新科技有限公司 Video transmission method, method of reseptance, system and unmanned vehicle
CN111770347A (en) * 2020-07-17 2020-10-13 广州市奥威亚电子科技有限公司 Video transmission method and system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
MPEG-4视频压缩编码算法研究;尚宇等;《探测与控制学报》;20060630(第03期);全文 *

Also Published As

Publication number Publication date
CN114040226A (en) 2022-02-11

Similar Documents

Publication Publication Date Title
US20170323617A1 (en) Rgb to yuv format conversion and inverse conversion method and circuit for depth packing and depacking
JPH07507428A (en) digital video signal processor equipment
US9641875B2 (en) Video signal transmitting device, video signal receiving device, and recording medium
US20020033887A1 (en) Image sensing apparatus using a non-interlace or progressive scanning type image sensing device
CN114040226B (en) Data transmission method, system and equipment for low-bandwidth high-resolution video transmission
JPS58117788A (en) Color television signal processing circuit
US20110273623A1 (en) Signal transmission apparatus and signal transmission method
US20100165078A1 (en) Image compression using checkerboard mosaic for luminance and chrominance color space images
JPH02299377A (en) System converter for video signal
JP4522860B2 (en) MPEG-2 saturation up-conversion artifact detection and repair
KR101012585B1 (en) Multi-channelImage registration system and the Method
KR100331372B1 (en) The interpolated video data providing device
EP1870811A2 (en) Line memory packaging apparatus and television receiver
US6424384B1 (en) Method and apparatus for improved signal filtering
US20060274953A1 (en) Signal processing method, signal processing apparatus, computer-readable medium and a data recording medium
US8264601B2 (en) Video picture format conversion method and corresponding device
US20030174246A1 (en) Method and device for processing image data from non-interlacing type into interlacing one
JP3458813B2 (en) Color difference signal interpolation circuit and color difference signal interpolation method used therefor
JP5945816B2 (en) Video processing system
Kuno et al. Aliasing reduction method for color digital still cameras with a single-chip charge-coupled device
JPH1042311A (en) Image signal processor
WO2011030482A1 (en) Image signal transmitter and receiver
CN101258746B (en) Method for graphical scaling of LCDs in mobile television devices
JP5457270B2 (en) Image expansion chip and electronic device
JP3612760B2 (en) Video signal processing method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant