CN102630010A - Wireless video transmission system and transmission method thereof - Google Patents
Wireless video transmission system and transmission method thereof Download PDFInfo
- Publication number
- CN102630010A CN102630010A CN2012100904647A CN201210090464A CN102630010A CN 102630010 A CN102630010 A CN 102630010A CN 2012100904647 A CN2012100904647 A CN 2012100904647A CN 201210090464 A CN201210090464 A CN 201210090464A CN 102630010 A CN102630010 A CN 102630010A
- Authority
- CN
- China
- Prior art keywords
- video
- data
- module
- image
- wireless
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention relates to the field of wireless video transmission and discloses a wireless video transmission system and a transmission method thereof. The wireless video transmission system comprises a video acquisition module, an image extraction module, an encoder, a wireless transmission module, a wireless receiving module, a decoder, an image interpolation module and a video display module, wherein the video acquisition module is used for acquiring a video image to obtain video original data; the image extraction module is used for carrying out image extraction processing on the video original data to obtain video extraction data; the encoder is used for carrying out source encoding and channel encoding on the video extraction data to obtain vide transmission data; the wireless transmission module is used for transmitting the vide transmission data; the wireless receiving module is used for receiving the vide transmission data; the decoder is used for decoding the vide transmission data to obtain the video extraction data; the image interpolation module is used for carrying out image interpolation processing on the video extraction data to obtain video recovery data; and the video display module is used for displaying the video recovery data.
Description
Technical field
The present invention relates to the wireless video transmission field, particularly a kind of wireless video transmission system and transmission method thereof.
Background technology
Along with the development of mobile communication business, the wireless video transport service has obtained to use very widely.But the characteristics of video information and wireless transmission environment have determined the wireless video transmission technology need solve many technical bottlenecks.
The characteristics of video information mainly comprise: (1) data volume is big.For the image of QCIF, its resolution is 176X144 (its value is 25344), that is to say that the pixel that every frame video image comprises is 25344.If each pixel representes that by 24 the data volume of a two field picture reaches 594kbit.Consider that real time video image transmits desired frame frequency (TV signal is 25fps), message transmission rate will reach 14.5Mbps.(2) real-time.People are that video pictures is smooth to the basic demand of vision signal, and transmission delay is little, and real-time is good.General data communication is lower to the requirement of real-time, and therefore for normal data communications, video communication requires better real-time property.
The characteristics of wireless transmission environment: (1) wireless signal-path band width resource-constrained.Because multipath fading, the time delay expansion, noise effect and multiple access interference etc., wireless channel what will face is a series of rugged environments, limited to the above bandwidth resources ten minutes of wireless channel that causes.Especially for the transmission of video signals that realizes big data quantity, the resource of wireless channel is nervous especially.The network that becomes when (2) wireless network is one.The network that the physical characteristics of wireless channel self became when having determined that it is one.
Understand the characteristics of above-mentioned video information and wireless transmission environment, can know that video information wants normal transmission in the wireless channel of resource-constrained, just necessarily need the amount of video information that transmit be compressed in the scope that wireless channel can hold as far as possible.Therefore; The transmission course of existing wireless video transmission system comprises that video acquisition, source encoding, chnnel coding, wireless channel, channel-decoding, source coding, video show; Its method is directly the video initial data of sampling to be sent in the encoder to encode; Transfer to decoder through wireless channel then, deliver to video display apparatus again through decoded video code flow and show.
Can be known that by above wireless video transmission method existing wireless video transmission system technology point mainly concentrates on the encoding and decoding technique of video, this also is the main support that systemic-function realizes.Video coding and decoding technology itself is very ripe; Be mainly reflected in one group of standard agreement realizing its function; These agreements have MPEG-1, MPEG-2, MPEG-4 and H.263, H.264 wait; They are mainly by existing two big ITU-T of standardization body and MPEG to formulate and accomplish in the world, and now agreements that adopt are MPEG-4 and H.264 more, and H.264 than its compression performance of MPEG-4 lifting have further been arranged.
With regard to its H.264 the algorithm itself in the agreement realize the coding and decoding video function, fairly perfect now.Yet the problem that existing wireless video transmission system exists is the restriction that receives its channel width limited, if want to transmit high-resolution video data, along with the increase of deal with data amount, it also just can not meet the demands.
For example, for the video data of transmission QCIF form, its resolution is 176X144 (its value is 25344), that is to say that the pixel that every frame video image comprises is 25344.If each pixel is represented by 24; The data volume of one two field picture reaches 594kbit; Frame frequency is 25fps; Data volume through after the compression H.264 needs the bandwidth of 40kbps~60kbps, that is to say, H.264 under the finite bandwidth of 40kbps~300kbps, can obtain smoothness as far as possible, show clearly.
Yet for the video data of transmission D1 form, its resolution is 720X576 (its value is 414720), that is to say that the pixel that every frame video image comprises is 414720, can see that its data volume is more than 16 times of QCIF.If same each pixel is represented by 24; Frame frequency is 25fps; The bandwidth that needs 1.4Mbps~1.6Mbps through the data volume after H.264 compressing; Need the bandwidth of 1.4Mbps~2.4Mbps through the data volume after the MPEG-4 compression, and through the data volume after the MPEG-2 compression even will reach the bandwidth of 2.4Mbps~4Mbps.
Therefore, can see if improve the resolution of transmission of video, that is to say data quantity transmitted in case increase, receive its band-limited restriction, existing wireless video transmission system just has been difficult to efficiently transmitting video data.
Summary of the invention
The object of the present invention is to provide a kind of wireless video transmission system and transmission method thereof, can under limited bandwidth, transmit high-resolution video information.
Principle of the present invention is based on existing wireless video transmission system; Increase the image contract module at its source encoding module front end; Thereby reduced in transmission course channel the data volume of the video information that will hold; And increase the image interpolation module in source coding module rear end, recover original video information, thereby adapted to the requirement of wireless channel transmission.Wherein, thus image contract is meant the image processing techniques that the resolution that reduced original image through certain algorithm process reduces the raw image data amount; Thereby being meant the resolution that has improved original image through certain algorithm process, image interpolation makes original image image restored treatment technology.
Technical scheme of the present invention is following.
(1) a kind of wireless video transmission system is characterized in that, comprises
Video acquisition module is gathered video image, obtains the video initial data;
The image contract module is carried out image contract to the video initial data and is handled, and obtains the video extracted data;
Encoder carries out source encoding, chnnel coding to the video extracted data, obtains the video transmission data;
Wireless transmitter module, emission video transmission data;
Wireless receiving module, receiver, video transmission data;
Decoder is decoded to the video transmission digital data, obtains the video extracted data;
The image interpolation module is carried out image interpolation process to the video extracted data, obtains the video recovery data,
Video display module shows the video recovery data.
In the technique scheme, be provided with filtration module between said video acquisition module and the image contract module, the video initial data is carried out filtering.
(2) a kind of wireless video transmission method is characterized in that, may further comprise the steps: at first, gather video image, obtain the video initial data; The video initial data is carried out image contract handle, obtain the video extracted data; Again the video extracted data is carried out source encoding, chnnel coding, obtain the video transmission data; Then,, again the video transmission data that receive are decoded, obtain the video extracted data through wireless transmitter module and wireless receiving module physical transfer video transmission data; At last, the video extracted data is carried out image interpolation process, obtain the video recovery data, and show through the video display module certificate.
In the technique scheme, said the video initial data is carried out earlier video being carried out filtering to the video initial data before image contract handles.
The present invention compares with existing wireless video transmission system, through after video acquisition module, increasing the image contract module, video resolution is reduced, and has reduced original data volume, has improved the treatment effeciency of encoder and wireless transmitter module.Accordingly, increase the image interpolation module behind the decoder, the video extracted data is carried out image interpolation process, obtain the video recovery data, recover video resolution.Technique scheme reduced in transmission course channel the video data volume that will hold, thereby adapted to the requirement of wireless channel transmission.
Description of drawings
Below in conjunction with accompanying drawing and embodiment the present invention is done further explain.
Fig. 1 is the structured flowchart of wireless video transmission system.
Embodiment
With reference to Fig. 1, be wireless video transmission system of the present invention, wherein, video acquisition module can be camera, its effect is to gather video image, obtains the video initial data.
The image contract module, the dsp chip of employing TI in particular for the TMS320DM64x series realization of Video processing, specifically can be TMS320DM642, TMS320DM648, TMS320DM6467 etc.; Wherein algorithm can adopt nearest-neighbor method, linear interpolation method, bicubic interpolation method.Present embodiment adopts nearest-neighbor method, and its principle is simple, and processing speed is fast, and function is the video initial data to be carried out image contract handle, and obtains the video extracted data; Adopt linear interpolation method to amplify the image smoothing that the image of generation produces than nearest-neighbor method, but can make the details of image possibly produce degeneration, when multiplication factor was bigger, this phenomenon was more obvious; Adopt bicubic interpolation method algorithm complex the highest, picture quality is higher, but processing speed slows down.
Encoder, the dsp chip of employing TI in particular for the TMS320DM64x series realization of Video processing, specifically can be TMS320DM642, TMS320DM648, TMS320DM6467 etc.; Its algorithm can adopt MPEG4, H264 encryption algorithm, preferentially adopts the H264 encryption algorithm good, and the video extracted data is carried out source encoding, chnnel coding, obtains the video transmission data.
Wireless transmitter module adopts ultrashort wave, microwave communication transmitter to realize, emission video transmission data; Corresponding wireless receiving module adopts ultrashort wave, microwave communication receiving equipment to realize, receiver, video transmission data.
Decoder, the dsp chip of employing TI in particular for the TMS320DM64x series realization of Video processing, specifically can be TMS320DM642, TMS320DM648, TMS320DM6467 etc.; Its algorithm can adopt MPEG4, H264 decoding algorithm, preferentially adopts the H264 decoding algorithm good, and the video transmission data are decoded, and obtains the video extracted data.
The image interpolation module, the dsp chip of employing TI in particular for the TMS320DM64x series realization of Video processing, specifically can be TMS320DM642, TMS320DM648, TMS320DM6467 etc.; Its algorithm can adopt nearest-neighbor method, linear interpolation method, bicubic interpolation method, and the video extracted data is carried out image interpolation process, obtains the video recovery data.Adopt nearest-neighbor method, its principle is simple, and processing speed is fast, and function is that the video extracted data is carried out image interpolation process, obtains the video recovery data.Adopt linear interpolation method to amplify the image smoothing that the image of generation produces than nearest-neighbor method, but the details generation of image is degenerated, when multiplication factor was bigger, this phenomenon was more obvious; Adopt bicubic interpolation method algorithm complex the highest, picture quality is higher, but processing speed slows down.
Video display module can show the video recovery data on computer display or common monitor through computer host computer application program.
The image interpolation method that following brief description the present invention uses always, the inverse process of image interpolation method is an image extraction method.
Nearest-neighbor method, its basic thought are to fill the image after the interpolation with the pixel value of fixing point in the original image, just original image are carried out pointwise and handle, and all use every bit wherein its gray value to carry out duplicating for m time (m is the interpolation multiple).The interpolating function that it adopts is a constant function (rectangular function):
This algorithm interpolation is simple, amount of calculation is very little, and in all interpolation methods, this interpolation method is fastest.But; This algorithm shortcomings is lower algebraically match rank; When grey level had trickle variations between the pixel that comprises in the image, nearest-neighbor method can produce artificial vestige in image, and the distortion of edge of image ladder is apparent in view; Blocking artifact occurs through regular meeting, the image border also possibly produce sawtooth effect.
Linear interpolation method is called the single order interpolation again, when adopting linear interpolation algorithm that image is amplified, image line and column signal is done twice processing, so this method often is called as bilinear interpolation.The basic thought of linear interpolation is: treat four pixels of interpolation point vicinity on every side and use different weights to carry out weighted average; Estimate the value of required pixel; The size of weight confirms that by the distance of interpolating pixel and surrounding pixel is far and near the weight of distance is little, and then weight is big on the contrary.The interpolating function that it adopts is a trigonometric function:
The image that linear interpolation the produces image that nearest-neighbor method produces of comparing is more level and smooth, degenerates but the details of image is produced, and when multiplication factor was bigger, this phenomenon was more obvious.
Bicubic interpolation is with a kind of three rank interpolation methods of pixel as a reference of 16 points around the interpolation point.Typical bicubic interpolation kernel function is:
Wherein parameter a has several kinds of values, can be a=-1 ,-0.5,0.75 etc.The bicubic interpolation method has two demi continuities; Thereby interpolation result has good slickness, can reduce the edge crenellated phenomena, yet along with the increase of interpolation algorithm match order number; Algorithm complex also increases thereupon; Therefore algorithm operation quantity is big, and computing time is long, may show weak point for the requirement of real-time in the practical application.
In the wireless video transmission system of the present invention, the wireless video transmission is based on wireless channel to be carried out, and wireless channel is realized by wireless transmitter module and wireless receiving module.Wherein, encoder comprises source encoding module and channel coding module, and decoder comprises source coding module and channel decoding module.The mentioned image contract processing of the present invention is based on the completion of source encoding front end, just directly carries out down-sampling for the original video data of gathering and handles; Image interpolation process is based on the completion of source coding rear end, just before decoded video data being delivered to video display module, carries out the up-sampling interpolation and recovers to handle.
Transmission system through the present invention's design; For the video data of transmission D1, its resolution is 576X720, after the image contract resume module; If resolution is reduced to 288X352; Its data volume can reduce and is about originally 1/4, if resolution is reduced to 144X176, its data volume can reduce and is about original 1/16.In the process of implementing image contract, may produce spectral aliasing, therefore,, handle front end at image contract and need carry out Filtering Processing if there is aliasing, just increase the average treatment that filtration module carries out sampled value, can adopt Gaussian filter.
Through the video data behind the image contract; Delivering to encoder encodes, transfer to decoder via wireless channel then, there is the video data behind the decoder decode carrying out image interpolation process; This is the process that a video data recovers, and need video data be returned on the preceding resolution of transmission.Image interpolation process is the gray value that estimates each pixel of target image through the gray value of original image pixels in essence.This need be interpolation pixel mapping certain position to original image; The coordinate and the non-integer of common this position; Thereby, be through the predefined interpolating function of the pixel of " existence " (being positioned on the rounded coordinate) application around this position is tried to achieve its gray value.
Based on above-mentioned wireless video transmission system, its method may further comprise the steps: at first, gather video image, obtain the video initial data; Handle carrying out image contract after the filtering of video initial data, obtain the video extracted data; Again the video extracted data is carried out source encoding, chnnel coding, obtain the video transmission digital data; Then,, again the video transmission data that receive are decoded, obtain the video extracted data through wireless transmitter module and wireless receiving module physical transfer video transmission data; At last, the video extracted data is carried out image interpolation process, obtain the video recovery data, and show through the video display module certificate.
For example; Through the transmission system of the present invention's design, for the video image (frame of video) of transmission D1, its resolution is 576X720; After the image contract processing; If resolution is reduced to 288X352, its data volume reduce be about original 1/4, if same each pixel is represented by 24; Frame frequency is 25fps; The bandwidth of 350Kbps~400Kbps need be about through the data volume of compression after (H.264 standard code) H.264, the bandwidth of 350Kbps~600Kbps need be about through the data volume after the MPEG-4 compression (MPEG-4 standard code), and through the data volume after the MPEG-2 compression (Moving Picture Experts Group-2 coding) even will reach the bandwidth that is about 600Kbps~1Mbps; If resolution is reduced to 144X176; Its data volume reduces especially and is about original 1/16; If same each pixel representes that by 24 frame frequency is 25fps, need be about the bandwidth of 40Kbps~100Kbps through the data volume after H.264 compressing; The data volume of passing through after MPEG-4 compresses need be about the bandwidth of 40Kbps~150Kbps, and passes through the data volume after the MPEG-2 compression even will reach the bandwidth that is about 150Kbps~250K bps.Wherein, need to prove: the inferior QCIF of frame of video form, QCIF, CIF, 4CIF, D1 the brightness definition/resolution of correspondence respectively are 96 * 128,144 * 176,288 * 352,576 * 704,576 * 720.
Although more than combine accompanying drawing that embodiment of the present invention are described, the present invention is not limited to above-mentioned specific embodiments and applications field, and above-mentioned specific embodiments only is schematic, guiding, rather than restrictive.Those of ordinary skill in the art under the situation that does not break away from the scope that claim of the present invention protects, can also make a variety of forms under the enlightenment of this specification, these all belong to the row of the present invention's protection.
Claims (4)
1. a wireless video transmission system is characterized in that, comprises
Video acquisition module is gathered video image, obtains the video initial data;
The image contract module is carried out image contract to the video initial data and is handled, and obtains the video extracted data;
Encoder carries out source encoding, chnnel coding to the video extracted data, obtains the video transmission data;
Wireless transmitter module, emission video transmission data;
Wireless receiving module, receiver, video transmission data;
Decoder is decoded to the video transmission data, obtains the video extracted data;
The image interpolation module is carried out image interpolation process to the video extracted data, obtains the video recovery data,
Video display module shows the video recovery data.
2. wireless video transmission system according to claim 1 is characterized in that, is provided with filtration module between said video acquisition module and the image contract module, and the video initial data is carried out filtering.
3. a wireless video transmission method is characterized in that, may further comprise the steps: at first, gather video image, obtain the video initial data; The video initial data is carried out image contract handle, obtain the video extracted data; Again the video extracted data is carried out source encoding, chnnel coding, obtain the video transmission data; Then,, again the video transmission data that receive are decoded, obtain the video extracted data through wireless transmitter module and wireless receiving module physical transfer video transmission data; At last, the video extracted data is carried out image interpolation process, obtain the video recovery data, and show through video display module.
4. wireless video transmission method according to claim 3 is characterized in that, said the video initial data is carried out earlier video being carried out filtering to the video initial data before image contract handles.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2012100904647A CN102630010A (en) | 2012-03-30 | 2012-03-30 | Wireless video transmission system and transmission method thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2012100904647A CN102630010A (en) | 2012-03-30 | 2012-03-30 | Wireless video transmission system and transmission method thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
CN102630010A true CN102630010A (en) | 2012-08-08 |
Family
ID=46588155
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN2012100904647A Pending CN102630010A (en) | 2012-03-30 | 2012-03-30 | Wireless video transmission system and transmission method thereof |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN102630010A (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103096086A (en) * | 2013-02-06 | 2013-05-08 | 上海风格信息技术股份有限公司 | Method of sampling forward in multi-picture display to achieve system optimization |
CN104427384A (en) * | 2013-08-26 | 2015-03-18 | 联想(北京)有限公司 | Data processing method, image demonstration method, data processing apparatus and demonstration equipment |
CN106210745A (en) * | 2016-08-31 | 2016-12-07 | 成都市和平科技有限责任公司 | A kind of intelligent jpeg image coding/decoding system and method |
CN106658095A (en) * | 2016-10-18 | 2017-05-10 | 武汉斗鱼网络科技有限公司 | Webcasting video transmission method, server and user equipment |
CN108184116A (en) * | 2017-12-18 | 2018-06-19 | 西南技术物理研究所 | A kind of image rebuilding method suitable for the transmission of wireless data chain |
CN111031324A (en) * | 2019-12-09 | 2020-04-17 | 中国电子科技集团公司第二十研究所 | Video data transmission method based on high-dimensional matrix transformation |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080273861A1 (en) * | 2005-06-25 | 2008-11-06 | Huawei Technologies Co., Ltd. | Method for Measuring Multimedia Video Communication Quality |
CN101835044A (en) * | 2010-04-23 | 2010-09-15 | 南京邮电大学 | Grouping method in frequency domain distributed video coding |
-
2012
- 2012-03-30 CN CN2012100904647A patent/CN102630010A/en active Pending
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080273861A1 (en) * | 2005-06-25 | 2008-11-06 | Huawei Technologies Co., Ltd. | Method for Measuring Multimedia Video Communication Quality |
CN101835044A (en) * | 2010-04-23 | 2010-09-15 | 南京邮电大学 | Grouping method in frequency domain distributed video coding |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103096086A (en) * | 2013-02-06 | 2013-05-08 | 上海风格信息技术股份有限公司 | Method of sampling forward in multi-picture display to achieve system optimization |
CN104427384A (en) * | 2013-08-26 | 2015-03-18 | 联想(北京)有限公司 | Data processing method, image demonstration method, data processing apparatus and demonstration equipment |
CN106210745A (en) * | 2016-08-31 | 2016-12-07 | 成都市和平科技有限责任公司 | A kind of intelligent jpeg image coding/decoding system and method |
CN106658095A (en) * | 2016-10-18 | 2017-05-10 | 武汉斗鱼网络科技有限公司 | Webcasting video transmission method, server and user equipment |
CN108184116A (en) * | 2017-12-18 | 2018-06-19 | 西南技术物理研究所 | A kind of image rebuilding method suitable for the transmission of wireless data chain |
CN111031324A (en) * | 2019-12-09 | 2020-04-17 | 中国电子科技集团公司第二十研究所 | Video data transmission method based on high-dimensional matrix transformation |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11361404B2 (en) | Electronic apparatus, system and controlling method thereof | |
CN102630010A (en) | Wireless video transmission system and transmission method thereof | |
CN101345870B (en) | Encoding and decoding device for low-code rate video super-resolution reconstruction | |
TW201818346A (en) | A method and system for providing high resolution image through super-resolution reconstruction | |
CN102811373A (en) | Method for carrying out video broadcast on Internet and mobile Internet by mobile terminal | |
EP3038370A1 (en) | Devices and method for video compression and reconstruction | |
Le et al. | Computing offloading over mmWave for mobile VR: Make 360 video streaming alive | |
AU2018250308B2 (en) | Video compression using down-sampling patterns in two phases | |
US20210352347A1 (en) | Adaptive video streaming systems and methods | |
WO2021057480A1 (en) | Video coding method and video decoding method, and related apparatuses | |
WO2021057479A1 (en) | Video coding method, video decoding method, and related devices | |
US10448009B1 (en) | Determining sample adaptive offset filter parameters | |
CN114125448A (en) | Video encoding method, decoding method and related devices | |
US20110176742A1 (en) | Image processing apparatus and image processing method | |
CN107222749B (en) | A kind of chaos code constructing method for wireless video transmission | |
WO2021057478A1 (en) | Video encoding and decoding method and related apparatus | |
US11336902B1 (en) | Systems and methods for optimizing video encoding | |
He et al. | Real-Time Neural Video Recovery and Enhancement on Mobile Devices | |
CN115695905A (en) | Video stream recovery method, electronic device and computer-readable storage medium | |
US9432614B2 (en) | Integrated downscale in video core | |
TW201121317A (en) | Image capturing and transmission device and image receiving and reconstruction device. | |
CN110636295A (en) | Video encoding and decoding method and device, storage medium and electronic device | |
CN102905129B (en) | Distributed coding method of still image | |
He et al. | NERVE: Real-Time Neural Video Recovery and Enhancement on Mobile Devices | |
WO2024078403A1 (en) | Image processing method and apparatus, and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120808 |