CN100375533C - Adaptive video transcoding gateway having multiple transforming functions - Google Patents
Adaptive video transcoding gateway having multiple transforming functions Download PDFInfo
- Publication number
- CN100375533C CN100375533C CNB2004100168329A CN200410016832A CN100375533C CN 100375533 C CN100375533 C CN 100375533C CN B2004100168329 A CNB2004100168329 A CN B2004100168329A CN 200410016832 A CN200410016832 A CN 200410016832A CN 100375533 C CN100375533 C CN 100375533C
- Authority
- CN
- China
- Prior art keywords
- video
- transcoding
- module
- information
- channel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention discloses a self-adaptive transcoding gateway with multiple conversion functions. The gateway comprises a decoder, an automatic detecting module of communication channels, a client configuration inquiring module, a control module and a video transcoding device, wherein the decoder is used for partially decoding source video information; the automatic detecting module of communication channels is used for automatically detecting the situation of communication channel connection during the access of users; the client configuration inquiring module is used for inquiring the state of a terminal device through a transcoding network and a simple communication protocol of the terminal device; the control module comprises network communication channel information detected by the automatic detecting module and terminal device information inquired by the client configuration inquiring module, the information is analyzed and arbitrated, and the information is converted into input transcoding parameters needed by the transcoding device. The video transcoding device can be used for carrying out transcoding in various modes for source videos. The present invention can be used for the access of various devices and networks, and the present invention has a wide range of application.
Description
Technical field
The present invention relates to the video information transcoding technology, particularly, relate to and a kind ofly can be adapted under the heterogeneous network environment, video information process and display capabilities according to the different network bandwidths and channel bit error rate and end equipment, the adaptive video flowing that is fit to transmission and shows that is converted into of source video, with the adaptive video transcoding gateway with multiple translation function of the access that adapts to the more weak end equipment of narrower transmission channel and processing, display capabilities.
Background technology
Because the difference and the multimedia communication network of present various multimedia video audio coding forms are made up of different network configurations, agreement, so all need a kind of multi-media communication mode between can crossover heterogeneous networks under many circumstances.
Such as, in video request program (VOD-Video On Demand) system, in the video distribution server be video quality than higher source video, higher speed, frame per second and resolution are arranged, the outlet network bandwidth bigger.If the available network channel width of access side is smaller, reciever does not have enough bandwidth to accept the source video flowing at all, and this just need reduce the video flowing code check under the situation of as far as possible keeping the source video quality.On the other hand, along with developing rapidly of present handheld device and wireless network, increasing handheld device can be linked in this system.And the processor ability of the low bandwidth of wireless network and higher bit error rate and handheld device and exploration on display resolution ratio are all far away from PC, therefore we are except will reducing the video flowing code check, also to reduce the spatial resolution of video, play to be adapted at handheld device.The application of these reality all requires the transcoding that carries out of video information is handled.
Video code conversion is exactly that current compressed video signal is transformed into other a kind of video compression mode, and the video after the conversion may have different speed, frame per second, frame sign or even compression standard with former video, mode can be different.Video code conversion and common source video encoder have certain similar, he can come automatically video data to be modulated dynamically and changed by adjusting series of parameters (comprising video quality, frame per second, resolution etc.) according to feature, the bandwidth of different transmission channels.
In such as this class Video Applications system of VOD, the different network insertion of the general multiple condition of permission, ask video data simultaneously, but because the source video of coding has higher video quality and high bit rate in advance, and the receptible video flowing of client can not guarantee high video quality because of the disposal ability of the restriction of transmission channel or end equipment usually.
Summary of the invention
Can insert and receive suitable video information in order to solve multiple different communication network and end equipment, need be according to the condition of different transmission channels and the processing of end equipment, display capabilities carries out suitable conversion to the source video information, the present invention proposes a kind ofly can be adapted under the heterogeneous network environment, video information process and display capabilities according to the different network bandwidths and channel bit error rate and end equipment, the adaptive video flowing that is fit to transmission and shows that is converted into of source video, to adapt to narrower transmission channel and processing, the adaptive video transcoding gateway with multiple translation function of the access of the end equipment that display capabilities is more weak.
The technical solution adopted for the present invention to solve the technical problems is: a kind of adaptive video transcoding gateway with multiple translation function comprises:
Decoder carries out partial decoding of h by decoder to the source video information, promptly only is decoded to the DCT territory;
The automatic detection module of channel, the automatic situation that detects connecting channel comprises effective channel width, channel bit error rate when the user inserts, the parameter of real-time detection channel changes in the transmission course of reality, adjusts the transcoding parameter; Once monitor network channel per 10 seconds, and the notice control module recomputates the transcoding parameter;
The client configuration enquiry module obtains the end facility information by the simple queries agreement when state by a simple communications protocol inquiry end equipment of transcoding network and end equipment and client connect, and comprises end device processes performance, display resolution;
Control module comprises the end facility information that acceptance detected network channel information of automatic detection module and client configuration enquiry module inquire, and these information is analyzed and is arbitrated, and be converted into the input transcoding parameter that transcoder needs; Control module is responsible for selecting the transcoding strategy of video code translator and the parameter setting in the real-time change transcoding strategy;
Video code translator can be handled the transcoding that the source video be done multiple mode, comprise transformation, the frame per second of transformation, the frame resolution of video coding type transformation, video flowing code check transformation and video flowing strengthened fault recovering mechanism.
The parameter that video code translator calculates according to control module decides the Transcoding Scheme of employing, calls different modules then and carries out conversion and processing, and these processing mainly comprise:
1. the size conversion of frame of video: the user according to link disposes the size that changes frame of video, for example: most handheld devices can only show smaller video window (QCIF, 176x144pixel), if the size of the video that has just the encoded video size that can show greater than end equipment just need be transcoded into the less video format of frame size in advance.
2. the self adaptation of video code rate: the code check that changes video according to the bandwidth constraints of connecting channel.Need be converted to the channel that the video that hangs down code check satisfies low bandwidth for the high video of image quality.
3. video frame rate conversion: for example: most handheld device can only be come displaying video (5fps, 10fps) with lower frame per second, and for those high-quality videos (30fps), just need carry out transcoding to reduce frame per second.
4. wrong recovery the: than higher channel, should in video flowing, add more fault recovering mechanism for the error rate, reduce the error rate.
5. coded system transforms: change the coding standard of video, for example: from MPEG-2 to H.263 conversion.
For the processing that the coded system in the transcoder transforms, need to select the Final Format of coding by the coding selector.The video here all is based on the video format of macroblock coding and dct transform coding techniques, promptly is MPEG series or H.26X serial video format.
Beneficial effect of the present invention mainly shows:
1, effectively guarantees the video quality that access side obtains.Do not passing through under the situation of transcoding gateway, end equipment that disposal ability is more weak and narrower channel width make video transmission and broadcasting speed very slow, even almost can't see complete image information; On the handheld device of wireless access, because the channel bit error rate of wireless telecommunications is higher, if do not add more wrong recovering information in the Video stream information, cause the error in data accepted too many, so that information dropout is serious in can't decoding or decode, and causes the mosaic effect of serious picture.And adopt transcoding processed video information more suitably on objective network, to transmit, and keep video quality preferably.
2, the different network and the adaptivity of equipment.This transcoding gateway can automatic, real-time monitoring network channel when the user asks to connect, detects the various parameters of connecting channel and equipment, thereby reasonably judge and select transcoding mode.In transcoding and transmission while, the state transformation of real-time monitoring and controlling channels is adjusted the transcoding parameter.
3, the multi-functional core transcoder of this transcoding gateway more helps the access that the network bandwidth is lower, channel bit error rate is higher wireless network side inserted, supported the handheld device that disposal ability and display resolution are lower.
4, the framework of whole transcoding gateway system is the sub-module design, accomplishes the high cohesion in the module and the low coupling of intermodule, and each functions of modules division of labor is relatively independent.Can load and remove some functional module easily in the system, have the configurability of height.
Description of drawings
Fig. 1 is a structural representation of the present invention;
Fig. 2 is the structural representation of control module of the present invention;
Fig. 3 is the operating process schematic diagram of control module of the present invention;
Fig. 4 is a thread structure schematic diagram of the present invention.
Embodiment
Below in conjunction with accompanying drawing the present invention is further described.
With reference to the accompanying drawings 1, have the self adaptation transcoding gateway system configuration of multiple transcoding function, step below adopting:
If control module (2) detects source video information itself and has been adapted at transmitting on the objective network, then do not need video information is done any processing, video code translator (5) is not worked, and video directly sends in the transmission channel;
Video flowing in the video of source is at first by decoder (1), and the decoder is here done the decoding on the DCT territory at the video flowing based on macro block and dct transform coding, promptly only handles by variable-length decoding VLD and inverse quantization.Enter into the core of video code translator (5) through the code stream of partial decoding of h;
The automatic detection module of channel (3) that is used for real-time detected transmission network condition, the detected object of the automatic detection module of described channel is the network condition of the client that connects with server.This module detects one time channel conditions every 10 seconds, and the parameter value that obtains is passed to control module (2);
Be used to detect the client configuration enquiry module (4) of the equipment situation of the client that connects with server, by the configuring condition of a simple communications protocol inquiring client terminal, the communication format of query messages is as follows when connecting foundation for described client configuration enquiry module:
<message>
<target>
ip_address
</target>
<query_tag>
</query_tag>
<query_result>
<cpu_speed>
...
</cpu_speed>
<resolution>
...
</resolution>
<media_type>
...
</media_type>
</query_result>
</message>
Be used for video code translator (5) module that video code flow transforms, the core of described video code translator (5) is made up of five concrete transcoding modules, and in this software module, the folding of five switches is controlled by control module (2).These five functional modules are respectively frame size and transform (6), bit rate conversion (7), frame rate conversion (8), error code recovery (9), type of coding conversion (10).
With reference to the accompanying drawings 2, control module (2) is an implementation structure of the present invention.Described control module is made of a calculation of parameter main thread (12) and parameter watcher thread (11).The parameter watcher thread is a background thread, and it monitors the state variation parameter of the transmission channel of being sent by the automatic detection module of channel constantly, just removes to recomputate control coefrficient in case receive new parameter.The channel condition information here has two aspects: available bandwidth and channel bit error rate; The end status information of equipment has three aspects: CPU disposal ability, display resolution and decodable form.These parameters are interactive a bit, as: the code check of video also decreases when reducing video resolution or video frame rate; The coded format of converting video (MPEG-2 is to MPEG-4) also can make code check reduction etc.Therefore the calculation of parameter function is weighted calculating according to the influence between each parameter when calculating, and selects suitable transcoding strategy according to result of calculation, the see reference calculation process of accompanying drawing 4 of concrete operations.
With reference to the accompanying drawings 3, whether control module needs to carry out the type of coding conversion if at first being checked, if desired, just directly opens switch (17), carries out type of coding and changes; If do not need to carry out type conversion, then respectively the parameter error rate, display resolution, disposal ability, channel width calculated.Function (31) cal_error_rate ([in] error_rate, [in] bandwidth) wants to increase more wrong recovering information when video flowing is recoded according to channel width and error rate calculation; Function (32) cal_resolution ([in] resolution, [in] bandwidth) code check after the calculating reduction resolution, judge whether to satisfy bandwidth requirement, function (33) cal_frame_rate ([in] cpu_speed, [in] resolution, [in] bandwidth) calculate the video frame number that per second can be handled under current resolution according to the disposal ability of equipment, and can the operation of judgement reduction video frame rate satisfy bandwidth requirement; Function (34) cal_video_bit_rate ([in] source_video_rate, [in] bandwidth) calculates video transmission code check suitable under this network bandwidth condition according to the available bandwidth and the source video code rate of current channel.The value of these calculating is weighted according to each other influence and to the influence of final video, weight coefficient is the empirical coefficient that draws through overtesting, if usually under the situation that display resolution is relatively lower and disposal ability is more weak of end equipment, to the result of calculation weight of function cal_frame_rate and cal_resolution between 0.6～0.8, the weight of the error rate of channel decides according to function cal_error_rate result's height, the error rate is high more, and weight is big more.According to the result who finally calculates, which is opened in the decision control switch (18) (19) (20) (21), and which is closed.These control switchs can be opened a plurality of simultaneously, for example under the access situation of radio hand-held equipment, will open (18) or (19) and (21) usually, also need add extra wrong recovering information in code stream when carrying out frame size or frame rate conversion.After having determined the transcoding strategy, control module and Channel Detection module communication obtain current network channel situation, and calculate the optimal parameter of transcoder under this situation of being fit to, the output optimization process result of control transcoder.
With reference to the accompanying drawings 4, video code conversion gateway thread structure is the thread structure framework of video code conversion gateway of the present invention.Threads of conversation in the described thread structure (41) is responsible for and the client of sending request connects; Network monitor thread (43) is responsible for the parameter variation that real-time detection connects network; Transcoding thread (42) is responsible for carrying out the transcoding processing of video; Control thread (44) is monitored the variation getparms of network monitor thread, and the parameter of control transcoding thread; Transmission thread (45) is responsible for the video flowing behind the transcoding is sent to the client that connects in the threads of conversation.
Claims (3)
1. adaptive video transcoding gateway with multiple translation function comprises:
Decoder carries out partial decoding of h by decoder to the source video information;
The automatic detection module of channel, when inserting, the user detects the situation of connecting channel automatically, comprise effective channel width, channel bit error rate, and detect the parameter variation of channel in real time in the transcoding transmission course of reality, the notice control module is adjusted the transcoding parameter;
The client configuration enquiry module is by the state of one between transcoding gateway and the end equipment simple communications protocol inquiry end equipment;
Control module is accepted the end facility information that detected network channel information of automatic detection module and client configuration enquiry module inquire, and these information is analyzed and is arbitrated, and be converted into the input transcoding parameter that transcoder needs;
Video code translator is done the transcoding of multiple mode and is handled to the source video, comprise transformation, the frame per second of transformation, the frame resolution of video coding type transformation, video flowing code check transformation and video flowing strengthened fault recovering mechanism.
2. a kind of adaptive video transcoding gateway with multiple translation function according to claim 1 is characterized in that: described automatic detection module is once monitored network channel per 10 seconds, and the notice control module recomputates the transcoding parameter.
3. a kind of adaptive video transcoding gateway with multiple translation function according to claim 1 is characterized in that: described control module is responsible for selecting the transcoding strategy of video code translator and is changed parameter setting in the transcoding strategy in real time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100168329A CN100375533C (en) | 2004-03-10 | 2004-03-10 | Adaptive video transcoding gateway having multiple transforming functions |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100168329A CN100375533C (en) | 2004-03-10 | 2004-03-10 | Adaptive video transcoding gateway having multiple transforming functions |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1668109A CN1668109A (en) | 2005-09-14 |
| CN100375533C true CN100375533C (en) | 2008-03-12 |
Family
ID=35038950
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2004100168329A Expired - Fee Related CN100375533C (en) | 2004-03-10 | 2004-03-10 | Adaptive video transcoding gateway having multiple transforming functions |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100375533C (en) |
Families Citing this family (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100442849C (en) * | 2006-03-28 | 2008-12-10 | 中山大学 | Apparatus and method for making digital domestic network terminal capable of playing multiple-media format |
| CN101119483B (en) * | 2006-07-31 | 2011-11-02 | 联想(北京)有限公司 | Source quality based video stream transmission velocity regulation means |
| US7962640B2 (en) * | 2007-06-29 | 2011-06-14 | The Chinese University Of Hong Kong | Systems and methods for universal real-time media transcoding |
| US8311058B2 (en) * | 2008-05-10 | 2012-11-13 | Vantrix Corporation | Modular transcoding pipeline |
| CN101365125B (en) | 2008-09-27 | 2012-03-21 | 腾讯科技（深圳）有限公司 | Multipath video communication method and system |
| CN102055966B (en) * | 2009-11-04 | 2013-03-20 | 腾讯科技（深圳）有限公司 | Compression method and system for media file |
| CN102055964A (en) * | 2009-11-11 | 2011-05-11 | 腾讯科技（深圳）有限公司 | Transcoding method for multimedia file, and transcoder |
| CN102263941A (en) * | 2010-05-31 | 2011-11-30 | 苏州闻道网络科技有限公司 | Transcoding method and device for video file |
| CN101945278B (en) * | 2010-09-15 | 2012-07-25 | 中国科学院深圳先进技术研究院 | Video self-adaptive transcoding method and system |
| CN102833531A (en) * | 2011-06-17 | 2012-12-19 | 中国移动通信集团广东有限公司 | Method, device and system for processing images |
| CN102957902B (en) * | 2011-08-22 | 2017-03-15 | 腾讯科技（深圳）有限公司 | The adaptation method and device of audio frequency and video transcoding parameter |
| EP2579595A2 (en) * | 2011-09-30 | 2013-04-10 | Broadcom Corporation | Streaming transcoder with adaptive upstream and downstream transcode coordination |
| CN103138874B (en) * | 2011-11-23 | 2016-07-06 | 中国移动通信集团公司 | A kind of encoding and decoding dynamic negotiation method and apparatus |
| CN102625150A (en) * | 2012-03-16 | 2012-08-01 | 中国科学院计算技术研究所 | Media playing system and method |
| KR101952632B1 (en) * | 2012-08-22 | 2019-02-27 | 삼성전자주식회사 | User terminal device and contents streaming method using the same |
| CN102883133A (en) * | 2012-10-17 | 2013-01-16 | 西安融科通信技术有限公司 | System and method for realizing large-capacity conference service based on single server |
| CN103558650B (en) * | 2013-09-11 | 2015-12-23 | 北京迈特力德信息技术有限公司 | Based on adaptive information processing method and the device of aerodrome automatic observing system |
| CN103607564B (en) * | 2013-11-11 | 2016-08-17 | 天脉聚源(北京)传媒科技有限公司 | The method and device that a kind of video acquisition based on photographic head realizes |
| CN105187835B (en) | 2014-05-30 | 2019-02-15 | 阿里巴巴集团控股有限公司 | Adaptive video code-transferring method and device based on content |
| CN105635734B (en) * | 2014-11-03 | 2019-04-12 | 掌赢信息科技（上海）有限公司 | Adaptive video coding method and device based on video calling scene |
| CN104768026B (en) * | 2015-04-17 | 2018-01-30 | 中国工商银行股份有限公司 | A kind of multichannel audio frequency and video transcoding device |
| CN106331590A (en) * | 2015-06-30 | 2017-01-11 | 华平智慧信息技术（深圳）有限公司 | Streaming media adapter and adaptation method |
| CN108881932A (en) * | 2017-11-24 | 2018-11-23 | 北京视联动力国际信息技术有限公司 | A kind of method and apparatus of video playing |
| CN108093257A (en) * | 2017-12-05 | 2018-05-29 | 北京小米移动软件有限公司 | Bit rate control method, electronic equipment and the storage medium of Video coding |
| CN108063953A (en) * | 2017-12-28 | 2018-05-22 | 武汉烽火众智数字技术有限责任公司 | The code-transferring method of video code conversion gateway, monitoring system and video code conversion gateway |
| CN110611639A (en) * | 2018-06-14 | 2019-12-24 | 视联动力信息技术股份有限公司 | Audio data processing method and device for streaming media conference |
| CN111935459B (en) * | 2020-08-25 | 2022-09-02 | 睿云联(厦门)网络通讯技术有限公司 | Browser-based ladder machine video preview method |
| CN115314723B (en) * | 2022-06-17 | 2023-12-12 | 百果园技术(新加坡)有限公司 | Method, device, equipment and storage medium for transmitting initial gear video stream |
| CN115842918A (en) * | 2022-10-28 | 2023-03-24 | 金程科技有限公司 | Variable-bit-rate video stream real-time transcoding sending device and method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020163967A1 (en) * | 2001-03-02 | 2002-11-07 | Jeongnam Youn | Transcoding apparatus and method |
| CN1407808A (en) * | 2001-09-05 | 2003-04-02 | 影通科技有限公司 | Flow compressible video code converter |
| US20030200337A1 (en) * | 2002-03-12 | 2003-10-23 | Dilithium Networks, Inc. | Method and system for improved transcoding of information through a telecommunication network |
| US20030206590A1 (en) * | 2002-05-06 | 2003-11-06 | Koninklijke Philips Electronics N.V. | MPEG transcoding system and method using motion information |
| CN1529503A (en) * | 2003-10-17 | 2004-09-15 | 清华大学 | Method for selecting video flow code in video gate-link |
-
2004
- 2004-03-10 CN CNB2004100168329A patent/CN100375533C/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020163967A1 (en) * | 2001-03-02 | 2002-11-07 | Jeongnam Youn | Transcoding apparatus and method |
| CN1407808A (en) * | 2001-09-05 | 2003-04-02 | 影通科技有限公司 | Flow compressible video code converter |
| US20030200337A1 (en) * | 2002-03-12 | 2003-10-23 | Dilithium Networks, Inc. | Method and system for improved transcoding of information through a telecommunication network |
| US20030206590A1 (en) * | 2002-05-06 | 2003-11-06 | Koninklijke Philips Electronics N.V. | MPEG transcoding system and method using motion information |
| CN1529503A (en) * | 2003-10-17 | 2004-09-15 | 清华大学 | Method for selecting video flow code in video gate-link |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1668109A (en) | 2005-09-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100375533C (en) | Adaptive video transcoding gateway having multiple transforming functions | |
| US6483851B1 (en) | System for network transcoding of multimedia data flow | |
| EP2271098A1 (en) | Server device, content distribution method, and program | |
| JP4808161B2 (en) | Method and apparatus for moving image communication error processing | |
| EP2271097A1 (en) | Gateway device, method, and program | |
| US9313553B2 (en) | Apparatus and method for simulcast over a variable bandwidth channel | |
| EP2088782B1 (en) | A method and a device for transcoding video | |
| CN101317460A (en) | System and method for efficient scalable stream adaptation | |
| EP1766981B1 (en) | A method and a device for transferring predictive and non-predictive data frames | |
| JP4888672B2 (en) | Content distribution system, conversion device, and content distribution method used therefor | |
| KR100511034B1 (en) | Mpeg video bit stream transmission apparatus and method | |
| US8667554B2 (en) | Method and a device for supplying a decoder with data | |
| CN111093082A (en) | Method and system for live broadcasting of streaming media | |
| Ramakrishna et al. | Estimation of scalable video adaptation parameters for media aware network elements | |
| Kassler et al. | Classification and evaluation of filters for wavelet coded videostreams | |
| KR20100031755A (en) | Connection terminal, distribution system, conversion method, and program | |
| Avramova et al. | On the performance of scalable video coding for VBR TV channels transport in multiple resolutions and qualities | |
| KR100713363B1 (en) | Apparatus and method for transmitting mpeg | |
| Chien et al. | Automatic network-adaptive ultra-low-bit-rate video coding | |
| KR20070048663A (en) | A method and a device for supplying a decoder with data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20080312 Termination date: 20130310 |