CN104768026B - A kind of multichannel audio frequency and video transcoding device - Google Patents
A kind of multichannel audio frequency and video transcoding device Download PDFInfo
- Publication number
- CN104768026B CN104768026B CN201510183900.9A CN201510183900A CN104768026B CN 104768026 B CN104768026 B CN 104768026B CN 201510183900 A CN201510183900 A CN 201510183900A CN 104768026 B CN104768026 B CN 104768026B
- Authority
- CN
- China
- Prior art keywords
- module
- information
- audio
- video
- decoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003908 quality control method Methods 0.000 claims abstract description 49
- 230000005540 biological transmission Effects 0.000 claims abstract description 25
- 238000000034 method Methods 0.000 claims abstract description 24
- 230000008447 perception Effects 0.000 claims abstract description 18
- 230000008569 process Effects 0.000 claims abstract description 17
- 238000007726 management method Methods 0.000 claims description 80
- 238000003860 storage Methods 0.000 claims description 24
- 238000004458 analytical method Methods 0.000 claims description 22
- 230000000694 effects Effects 0.000 claims description 21
- 238000012545 processing Methods 0.000 claims description 20
- 238000013500 data storage Methods 0.000 claims description 3
- 230000009916 joint effect Effects 0.000 claims description 3
- 238000004088 simulation Methods 0.000 claims description 3
- 230000000875 corresponding effect Effects 0.000 description 36
- 230000006870 function Effects 0.000 description 28
- 238000006243 chemical reaction Methods 0.000 description 12
- 230000011664 signaling Effects 0.000 description 12
- 238000004891 communication Methods 0.000 description 11
- 230000001276 controlling effect Effects 0.000 description 9
- 230000010354 integration Effects 0.000 description 9
- 238000005538 encapsulation Methods 0.000 description 7
- 238000012827 research and development Methods 0.000 description 7
- 238000012546 transfer Methods 0.000 description 7
- 230000007704 transition Effects 0.000 description 7
- 238000000605 extraction Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 4
- 241000208340 Araliaceae Species 0.000 description 3
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 3
- 235000003140 Panax quinquefolius Nutrition 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 230000004069 differentiation Effects 0.000 description 3
- 235000008434 ginseng Nutrition 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000006855 networking Effects 0.000 description 2
- 238000013139 quantization Methods 0.000 description 2
- 238000007619 statistical method Methods 0.000 description 2
- 208000019901 Anxiety disease Diseases 0.000 description 1
- 241001269238 Data Species 0.000 description 1
- 241001074085 Scophthalmus aquosus Species 0.000 description 1
- 238000012896 Statistical algorithm Methods 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000003466 anti-cipated effect Effects 0.000 description 1
- 230000036506 anxiety Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 238000000465 moulding Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 238000000275 quality assurance Methods 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 239000012536 storage buffer Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000005641 tunneling Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention provides a kind of multichannel audio frequency and video transcoding device, including：Foreground Web page setup module receives operation initial configuration order and transcoding related command；Operation initial configuration order and transcoding related command of the management configuration module according to reception, generation decoding order or coded command；Receive the Mass adjust- ment order that audio-visual quality control module is sent；Audio/video decoding module receives decoding order and audio, video data carries out decoding process；Collect decoding quality information；Audio/video coding module receives coded command and decoding data carries out coded treatment；Collect encoder complexity and coder resource consumption information；Audio-visual quality control module according to the network transmission quality perception information of reception, order and send to management configuration module by decoding quality information and encoder complexity and coder resource consumption information, generation audio-visual quality adjustment.The transcoding of multi-to-multi can be realized using transcoding device of the present invention, quality control is carried out to the audio/video information of input.
Description
Technical field
The present invention relates to audio/video communication field, more particularly to a kind of multichannel audio frequency and video transcoding device.
Background technology
With the fast development of Internet network, multimedia communication service has accounted in daily life and work
Have highly important status, with the progressively expansion of network size, user to the quality requirement of audio/video communication business also greatly
Improve.Two can be divided into by being presently used for the transcoding mode of audio/video communication system and video monitoring system middle pitch video communication service
Major class, one kind is direct encapsulation transition mode；One kind is attached most importance to new explanation/code conversion mode.Existing outside audio frequency and video information source is set
Producer's brand of standby terminal is a lot, and the terminal device with producer's different model be present；Existing most of outside audio frequency and video
H.264, the terminal of source device carries out Image Coding, but some old-fashioned outside audio frequency and video information sources using video encoding standard
Equipment only supports H.263 standard or other old-fashioned audio/video encoding standards, therefore various video coding standard over a period to come
Will exist simultaneously.In addition, each producer has Different Strategies when handling image I frames, P frames and B frames, it is generally the case that outside
The terminal of audio frequency and video source device can encode the video code flow of two different images quality of output simultaneously, so being needed in decoding end
To be decoded by the function call of distinct methods.Therefore, when needing to carry out the transcoding of multi-to-multi, presently disclosed turn
All it is to be stacked to realize by more transcoding devices according to specific demand mostly in code technical scheme, wherein, every equipment is both needed to
Specific setting or research and development are wanted, will so cause that the R＆D cycle is long, and cost is too high, the problems such as deployment complexity.And in transcoding
In quality, after the terminal both for different outside audio frequency and video source devices carries out independent decoding mostly, further according to recipient
Code capacity collection require that coding exports satisfactory code stream, which requires to carry out audio-visual quality just for output information
Relevant treatment, without the network transmission quality state between the terminal in view of outside audio frequency and video source device, and transcoding
The encoding and decoding resource of device such as uses can not enter to the audio/video information of input at integration capability, i.e., the existing multi-to-multi transcoding mode
The global quality control of row, it is impossible to which dynamic adjusts the coding requirement of the terminal of outside audio frequency and video source device, it is difficult to meet high
The practical application request of performance real-time transcoding.
The content of the invention
, will not without setting more transcoding devices the embodiments of the invention provide a kind of multichannel audio frequency and video transcoding device
The appearance R＆D cycle is long, and cost is too high, the problems such as deployment complexity, while outside audio frequency and video letter is take into account in transcoding
Network transmission quality state between the terminal of source device, and the encoding and decoding resource of transcoder such as use at the integration capability, can be with
Global quality control is carried out to the audio/video information of input, can dynamically adjust turn of the terminal of outside audio frequency and video source device
Code requires, meets the practical application request of high-performance real-time transcoding, and the multichannel audio frequency and video transcoding device includes：Foreground Web page
Face setup module, management configuration module, audio/video decoding module, audio/video coding module and audio-visual quality control module；
The foreground Web page setup module, for providing management and control service interface, and receive user and pass through management and control service circle
The operation initial configuration command information and transcoding relevant command information of face input, and send to management configuration module；
The management configuration module, the operation initial configuration sent for receiving the foreground Web page setup module
Command information and transcoding relevant command information, phase is generated according to operation initial configuration command information and transcoding relevant command information
The decoding command information and coded command information answered, receive the audio-visual quality adjustment life that audio-visual quality control module is sent
Order, the corresponding decoding command information of order generation or coded command information are adjusted according to audio-visual quality；And decoding order is believed
Breath is sent to audio/video decoding module, and coded command information is sent to audio/video coding module；
The audio/video decoding module, the decoding command information sent for receiving the management configuration module, and it is external
The audio, video data that source device is sent, the decoding process of audio, video data is carried out, and decoding data is sent to audio frequency and video and compiled
Code module or ext nal network element；Decoding quality information is collected, and is sent to audio-visual quality control module；
The audio/video coding module, the coded command information sent for receiving the management configuration module, and it is described
The decoding data that audio/video decoding module is sent, carries out the coded treatment of audio, video data, coding information is sent to corresponding
Ext nal network element；Encoder complexity and coder resource consumption information are collected, and is sent to audio-visual quality control module；
The audio-visual quality control module, for receiving network transmission quality perception information, the audio/video decoding mould
The encoder complexity and coder resource consumption information that the decoding quality information and the audio/video coding module that block is sent are sent,
Corresponding audio-visual quality adjustment life is generated according to network transmission quality perception information, decoding quality information and coding quality information
Order, and send to management configuration module.
In one embodiment, the operation initial configuration command information includes：The external source device of required service
List, the unique mark GUID of external source device, the information importance hierarchical definition of external source device, producer OCX ID determine
Justice, channel label, transcoding capabilities collection scope, the definition of external transcoding type, terminal initial data definition, access network primary data
One of definition, control information, transcoding requirement are multiple.
In one embodiment, the unique mark GUID of the transcoding relevant command information including external source device and outer
Switch through code type definition.
In one embodiment, the decoding quality information includes code stream frame bandwidth statistics, code stream information source company-information, code
Whether contain image B frame informations in stream picture dimension information, code stream frame rate information, code stream, present frame I frames judge information, current
Frame head P frames judge information, one of macro block traversal range information and decoding complexity information or multiple.
In one embodiment, encoder complexity and the coder resource consumption information includes coding host processor resources
Occupation proportion, the single-level memory resource occupation ratio for encoding primary processor, the second-level storage resource of coding primary processor account for
With in ratio, encoding stream output occupied bandwidth statistics, encoding stream image dimension information, encoding stream frame per second information, encoding stream whether
Contain one of image B frame informations, coding complexity information or multiple.
In one embodiment, the management configuration module includes decoding capability collection control module, channel management module, solution
Code or code capacity management module, code capacity collection control module；
The decoding capability collection control module, for carrying out decoding link setup and source coding work；Processing is currently running state
All channels decoding channel decoding activities mission requirements, and decoding activities mission requirements is sent to audio/video decoding mould
Block；
The channel management module, the operation for integrating and storing the foreground Web page setup module transmission are initial
Change configuration order information；The transcoding phase command information sent according to the foreground Web page setup module, improve transcoding channel life
Order, transcoding channel command is sent to relative decoding capability set control module；
The decoding or encoding Capacity Management module, for handling the coding or decoding energy of all channels for being currently running state
Power multidate information records；
The code capacity collection control module, for receiving the source coding data of decoding capability collection control module, processing
The coded command information of the encoding channel of all channels of state is currently running, and coded command information is sent to audio/video coding
Module.
In one embodiment, the audio/video decoding module includes special decoding configuration module, returns control information mould
Block, start decoder module, decoded state information summarizing module, encoder to connection module and video wall output module；
The special decoding configuration module, the decoding command information sent for handling management configuration module, and distribute
Corresponding decoding channel is detailed, and enables corresponding producer's OCX decoder modules；
Described time control information collection module, created for returning control information instancesization, dynamic collection audio-visual quality returns control letter
Breath；
The startup decoder module, for decoding the foundation of channel, the reception of audio frequency and video Channel message and audio frequency and video message
Real-time decoding；
The decoded state information summarizing module, for carrying out back controlling collecting for information, summary information is reported into audio frequency and video
Quality control module；
The encoder is to connection module, for when transcoding type is stream forwarding formula, active link setup audio/video coding mould
Block, carry out transcoding information butt joint activity；
The video wall output module, for according to output simulation mouth requirement, decoding data to be sent into display output port.
In one embodiment, the audio/video coding module includes coding parameter configuration receiving module, establishes coding mesh
Mark numbering module, correlative coding container module, encoding state information summarizing module, stream memory module and stream forwarding module；
The coding parameter configures receiving module, for establishing encoding channel list；
It is described to establish encoding target numbering module, for identifying coding parameter requirement, enable correlative coding object instance；
The correlative coding container module, the corresponding audio frequency and video report to be encoded sent for receiving audio/video decoding module
Literary data, and carry out transcoding message data coding according to the coding negotiation parameter required by coding parameter configuration receiving module；
The encoding state information summarizing module, for supervising and recording encoding state information, encoding state information is entered
Row collects, and summary information is reported into audio-visual quality control module；
The stream memory module, for message after coding to be stored；
The stream forwarding module, for the stream issue data for flowing memory module storage to be carried out into stream information forwarding output.
In one embodiment, the audio-visual quality control module includes information storage module, analysis judge module, led to
Know module, starting configuration module and expiry notification module；
Described information storage module, sent for storing summary information, and by summary information to analysis judge module；
The analysis judge module, unlocked for internal signal amount, carry out summary information analysis in real time and obtain corresponding
Audio-visual quality adjustment order, corresponding audio-visual quality is adjusted into order and sent to notification module；
The notification module, order is adjusted for receiving the corresponding audio-visual quality that the analysis judge module is sent,
And the adjustment order of corresponding audio-visual quality is sent to starting configuration module；
The starting configuration module, for the adjustment order of corresponding audio-visual quality to be sent into management configuration module；
The expiry notification module, for according to management configuration module order request, processing data storage return-to-zero.
In embodiments of the present invention, a kind of multichannel audio frequency and video transcoding device and method are proposed, wherein, multichannel audio frequency and video
Transcoding device include foreground Web page setup module, management configuration module, audio/video decoding module, audio/video coding module and
Audio-visual quality control module, it can be carried out multipair multimode audio frequency and video transcoding using apparatus of the present invention, it is not necessary to pass through
More transcoding devices are stacked to realize, avoid the occurrence of that the R＆D cycle is long, and cost is too high, the problems such as deployment complexity；Meanwhile
Employ audio-visual quality control module so that when carrying out audio frequency and video transcoding, it can be considered that outside audio frequency and video source device
Network transmission state between terminal, and the encoding and decoding resource of transcoder such as use at the integration capability, and the sound of input can be regarded
Frequency information carries out global quality control, can dynamically adjust the coding requirement of the terminal of outside audio frequency and video source device, meets
The practical application request of high-performance real-time transcoding.
Brief description of the drawings
Accompanying drawing described herein is used for providing a further understanding of the present invention, forms the part of the application, not
Form limitation of the invention.In the accompanying drawings：
Fig. 1 is a kind of multichannel audio frequency and video transcoding device networking schematic diagram provided in an embodiment of the present invention；
Fig. 2 is a kind of structural representation of multichannel audio frequency and video transcoding device module provided in an embodiment of the present invention；
Fig. 3 is a kind of multichannel audio frequency and video transcoding device state transition graph provided in an embodiment of the present invention；
Fig. 4 is the specific work of the analysis judge module in a kind of audio-visual quality control module provided in an embodiment of the present invention
Make flow chart.
Embodiment
It is right with reference to embodiment and accompanying drawing for the object, technical solutions and advantages of the present invention are more clearly understood
The present invention is described in further details.Here, the exemplary embodiment of the present invention and its illustrate to be used to explain the present invention, but simultaneously
It is not as a limitation of the invention.
All it is that more transcoding devices are passed through according to specific demand mostly in the transcoding technology scheme of existing multi-to-multi
Stack and realize, wherein, every equipment is required to specific setting or research and development, will so cause that the R＆D cycle is long, and cost is too high, portion
Affix one's name to the problems such as complexity；Also, the network transmission quality shape between the terminal of outside audio frequency and video source device is not accounted for
State, and the encoding and decoding resource of transcoder such as use at the integration capability, it is impossible to carry out quality data collection, the analysis of the overall situation, enter
And dynamic adjusts the terminal coding requirement of outside audio frequency and video source device, it is difficult to meet the practical application need of high-performance real-time transcoding
Ask.If designing a kind of multi-to-multi transcoding device, multiple transcoding channels are set to complete the transcoding of multi-to-multi wherein, without
Stacked and completed by more transcoding devices；Simultaneously, it is contemplated that the network transmission between the terminal of outside audio frequency and video source device
State, and the encoding and decoding resource of transcoder such as use at the integration capability, it becomes possible to solve problems of the prior art.It is based on
This, the present invention proposes a kind of multichannel audio frequency and video transcoding device.
Fig. 1 is multichannel audio frequency and video transcoding device networking schematic diagram of the present invention.As shown in figure 1, the multichannel audio frequency and video
Transcoding device and correlated source equipment, related sink device include outside audio frequency and video source device 11, multichannel audio frequency and video turn
Code device 12, ext nal network element 13.
Wherein, outside audio frequency and video source device 11 (referred to as external source device) includes：The IP Camera of each producer
The audio frequency and video source devices such as IPC111, DVR DVR112, alarm host machine 113, general audio-video signal camera 114 with
And IP network 115.Outside audio frequency and video source device can be uniformly accessed into multichannel audio frequency and video transcoding of the present invention by IP network 115
Device, and the information source data input device of the audio, video data message as the present invention.
Ext nal network element 13 includes：Video wall 131, streaming server1132nd, streaming servern133 grades export receiving device and IP
Network 134.All ext nal network elements can be uniformly accessed into multichannel audio frequency and video transcoding device of the present invention, and be regarded as the sound of the present invention
The stay of two nights data output apparatus of frequency data message.
The bite rate control of each several part and audio/video information transcoding transfer process will be described in detail below.
Fig. 2 is the structural representation of multichannel audio frequency and video transcoding device of the present invention, is believed in the figure including outside audio frequency and video
Source device 21 (referred to as external source device), multichannel audio frequency and video transcoding device 20, and ext nal network element 22.
Wherein, outside audio frequency and video source device 21 includes the audio frequency and video message sink coding equipment of all kinds of producers, passes through not same district
The IP network access multichannel audio frequency and video transcoding device 20 in domain.When needing audio/video information transcoding, multichannel audio frequency and video transcoding
Device 20, sound can be carried out actively with outside audio frequency and video source device 21 according to initial network parameter and coding/decoding negotiation parameter
The foundation of video code flow channel.And the dynamic audio-visual quality adjustment made according to multichannel audio frequency and video transcoding device 20 needs
Ask, by initial information source producer configured list information, send corresponding audio-visual quality negotiation adjustment order and arrive outside sound
Video source equipment 21.
Wherein, ext nal network element 22 includes the TV wall display system or image stitcher of all kinds of producers, or normal stream
Issue point device.Ext nal network element 22 can be accessed multichannel sound and regarded by the IP network of physically displayed interface, or different zones
Frequency transcoding device 20.When needing audio/video information to be transcoded onto TV wall display system or image stitcher, multichannel sound regards
Frequency transcoding device 20 can be according to interface standards mandate, directly from the decoder module in multichannel audio frequency and video transcoding device 20, directly
The display physical interface of output image display information to ext nal network element 22 is shown.Standard is transcoded onto when needing audio/video information
During stream issue point device, multichannel audio frequency and video transcoding device 20 can be issued according to normal stream and required, directly from multichannel audio frequency and video
Coding module in transcoding device 20, the normal stream issue point device of output image coding message to ext nal network element 22 carry out sound and regarded
Frequency coding information transmits.
Wherein, multichannel audio frequency and video transcoding device 20 includes following module：Foreground Web communication controls module 201, management are matched somebody with somebody
Put module 200, audio/video decoding module 202, audio-visual quality control module 203, audio/video coding module 204.
Foreground Web communication controls module 201, for providing management and control service interface, and receive user and pass through management and control service circle
The operation initial configuration command information and transcoding relevant command information of face input, and send to management configuration module 200.
Management configuration module 200, the operation initial configuration life sent for receiving foreground Web page setup module 201
Information and transcoding relevant command information are made, is generated according to operation initial configuration command information and transcoding relevant command information corresponding
Decoding activities mission requirements and coding active task requirement, and decoding activities mission requirements is sent to audio/video decoding mould
Block, coding active task is required to send to audio/video coding module；Receive the audio frequency and video that audio-visual quality control module is sent
Mass adjust- ment order, the corresponding decoding command information of order generation or coded command information are adjusted according to audio-visual quality.
Audio/video decoding module 202, the decoding command information sent for receiving management configuration module 200, and external letter
The audio, video data that source device is sent, carries out the decoding process of audio, video data, and decoding data is sent into audio/video coding
Module 204 or ext nal network element 22；Decoding quality information is collected, and is sent to audio-visual quality control module 203.
Audio/video coding module 204, the transcoding task sent for receiving the management configuration module 200, and the sound
The decoding data that Video decoding module 202 is sent, carries out the coded treatment of audio, video data, coding information is sent to corresponding
Ext nal network element；Encoder complexity and coder resource consumption information are collected, and is sent to audio-visual quality control module 203.
Audio-visual quality control module 203, for receiving network transmission quality perception information, the audio/video decoding module
The encoder complexity and coder resource consumption that the 202 decoding quality information sent and the audio/video coding module 204 are sent
Information, given birth to according to network transmission quality perception information, decoding quality information and encoder complexity and coder resource consumption information
Adjust and order into corresponding audio-visual quality, and send to management configuration module 200.
In the present invention, the signalling path data format between each functional module uses XML (eXtensible Markup
Language, extensible markup language) language realization, XML language, which has, develops the specialty characteristicses such as simple, standard universal, always
Since by computer communications industry extensive use, while it is also data representation means maximally efficient in Generation Internet.Institute
With, by by XML language introduce the present invention each module signalling interworking mechanism among, can producer's brand the numerous, production year
For the terminal of different outside audio frequency and video source devices, by support of the unified addition to XML at signaling interface, can specification and
Unified numerous off-gauge privately owned signalings, and then allow multichannel audio frequency and video transcoding device of the present invention to realize by each outside audio frequency and video
The terminal interface order of source device and the signaling adaptation of the unified message form based on XML, it is achieved thereby that based on information
The communications signaling protocols of the unified XML format between each functional module among statistical analysis multichannel audio frequency and video transcoding device
Interaction, so will largely solve the function expansibility of system, and to audio frequency and video source device outside different manufacturers
The exploitation compatibility of terminal.
In the present invention, the data for carrying out XML universal standard signalings are packaged with；In the Web page setup module of foreground, need
Initial configuration command information will be run and transcoding relevant command information carries out the data encapsulation of XML universal standard signalings；
, it is necessary to which the data that will decode command information or coded command information progress XML universal standard signalings encapsulate in management configuration module；
, it is necessary to which the data that decoding data and decoding quality information are carried out to XML universal standard signalings encapsulate in audio/video decoding module；
, it is necessary to which encoder complexity and coder resource consumption information are carried out into XML universal standard signalings in audio/video coding module
Data encapsulate；In audio-visual quality control module, it is necessary to which audio-visual quality to be adjusted to the number of order progress XML universal standard signalings
According to encapsulation.
When it is implemented, the method for carrying out multichannel audio frequency and video transcoding using the multichannel audio frequency and video transcoding device of the present invention
Including two kinds of situations：The first：When not considering encoding and decoding quality planning and encoding and decoding Mass adjust- ment, the multichannel of the present invention is used
The method that audio frequency and video transcoding device carries out multichannel audio frequency and video transcoding includes：
Management and control service interface is provided by foreground Web page setup module, and it is defeated by management and control service interface to receive user
The operation initial configuration command information and transcoding relevant command information entered, and send to management configuration module；
The operation initial configuration order that the foreground Web page setup module sends is received by management configuration module to believe
Breath and transcoding relevant command information, according to operation initial configuration command information and the corresponding solution of transcoding relevant command information generation
Code command information and coded command information, and decoding command information is sent to audio/video decoding module, by coded command information
Send to audio/video coding module；
The decoding command information sent by the audio/video decoding module reception management configuration module, is ordered according to decoding
The decoding OCX engines of external source device corresponding to information loading, obtain the audio, video data that external source device is sent, and carry out
The decoding process of audio, video data, and decoding data is sent to audio/video coding module or ext nal network element；
The coded command information sent by the audio/video coding module reception management configuration module (can include outside
The list of stay of two nights end points, each passage transcoding configuration management requirement, coding pass consult the information such as parameter request), in good time for each
Individual transcoding passage carries out encoding the establishment of plug-in unit example, coding output channel foundation respectively, is sent out when receiving audio/video decoding module
After the decoding data sent, the establishment, intercommunication or orientation of row of channels middle pitch video protocols are entered according to coding pipeline negotiation parameter request
Storage, carries out the coded treatment of audio, video data, coding information is sent to corresponding ext nal network element.
Second：When needing to consider encoding and decoding quality planning and encoding and decoding Mass adjust- ment, the multi-channel video transcoding side
Also need to include in method：
In decoding process, by audio/video decoding module collection decoding quality information, and send to audio-visual quality control
Molding block；
In an encoding process, received by audio/video coding module and collect encoder complexity and coder resource consumption letter
Breath, and send to audio-visual quality control module；
Network transmission quality perception information, the solution that audio/video decoding module is sent are received by audio-visual quality control module
The encoder complexity and coder resource consumption information that code quality information and audio/video coding module are sent, according to network transmission matter
Measure perception information, decoding quality information and encoder complexity and coder resource consumption information generates corresponding audio-visual quality and adjusted
Whole order (coding quality of outside audio frequency and video source device is consulted to require, and encodes the requirement of output quality negotiation), and send
To management configuration module；
The audio-visual quality that the transmission of audio-visual quality control module is received by management configuration module adjusts order, according to sound
The corresponding decoding command information of video quality adjustment order generation or coded command information, by the decoding order with Mass adjust- ment
Information is sent to audio/video decoding module, and the coded command information with Mass adjust- ment is sent to audio/video coding module.Together
When, it is necessary to current set threshold decision in apparatus of the present invention, start or to adjust each encoding and decoding associated components specific
Procedure parameter, realize the functional objective of multichannel audio frequency and video high quality conversion.
During comprehensive statistical analysis is carried out to audio-visual quality information, not only to being currently received network transmission matter
Amount perception information, decoding quality information and encoder complexity and coder resource consumption information are made and laterally cut decision-making judgement, and
And the data in a period of time also are carried out with longitudinal direction and bores decision-making judgement, avoid due to quality caused by network burst mass defect
Adjust decision-making erroneous judgement.In addition, necessary controlling of quality order is being sent to after management configuration module, it is also necessary to carry out decoding channel matter
The I frames for measuring information start differentiation, and during this period, in a period of time that careful controlling of quality order is sent as far as possible excessively continually
Make other controlling of quality decision-making.By actual environment application note, by above method, dynamic has largely been adapted to
The network adaptability of audio-visual quality is adjusted, and audio frequency and video matter caused by the frequency that largely avoided controlling of quality order is too high
Amount repair curve can not restrain and audio-visual quality dissipate the problem of.
Each module in multichannel audio frequency and video transcoding device 20 is described in detail below.
Management configuration module 200 is specifically described.
Management configuration module 200 includes submodule：Decoding capability collection control module 2001, channel management module 2002, solution/
Code capacity management module 2003, code capacity collection control module 2004.
Decoding capability collection control module 2001 has two major functions, and One function is to carry out specific decoding link setup and letter
Source decoding effort, if being indicated as being the stream way of output in transcoding type definition, issue correlative coding capability set control module simultaneously
2004 start specific coding pipeline, and wait the source coding data of decoding capability collection control module 2001 to be received.Second work(
Can be responsible for processing be currently running state all channels decoding channel specific decoding activities mission dispatching to audio/video decoding
Module 202.
The function of the channel management module 2002 is responsible for processing operation initial configuration order, and command context is carried out
Integrate, and stored by MAP modes, searched so that the later stage travels through.And the unique mark of the source device in order
GUID and the definition of external transcoding type, improve transcoding channel command, send relative decoding capability set control module 2001.
The function of the solution or code capacity management module 2003 is the fast data store inquiry of management configuration module 200
Instrument, the responsible coding/decoding ability dynamically recording for handling all channels for being currently running state.
The function of the code capacity collection control module 2004 is responsible for the coding that processing is currently running all channels of state
The specific coding active task of channel, and it is issued to audio/video coding module 204.
Audio/video decoding module 202 is specifically described below.
Audio/video decoding module 202 includes submodule：Special decoding configuration module 2021, return control information collection module
2022nd, decoder module 2023 is started, decoded state information collects 2024, encoder to connection module 2025, video wall output module
2026。
The function of the special decoding configuration module 2021 is responsible for the solution that specific processing management configuration module 200 is sent
Code command information (i.e. decoding task Operations Requirements), and transcoding channel detail corresponding to distribution (decoding channel is detailed) is carried out, with
And producer's OCX decoder modules corresponding to enabling.
The function of described time control information collection module 2022 is responsible for back controlling information instancesization establishment, prepares dynamic collection sound
Video quality returns control information.
The function of starting decoder module 2023 be responsible for decoding the foundation of channel, the reception of audio frequency and video Channel message,
The real-time decoding of audio frequency and video message.
The function of the decoded state information summarizing module 2024 is responsible for carrying out back controlling collecting for information, and regularly 1 second
Summary information (decoding quality information) is reported into audio-visual quality control module 203.
The encoder is responsible for the function of connection module 2025 in stream forwarding formula, active link setup audio/video coding mould
Block 204, carry out transcoding information butt joint activity.
The function of the video wall output module 2026 is responsible for simulating mouth requirement according to output, by display data (decoding
Data afterwards) it is sent into various types of display output ports.
When it is implemented, the decoding quality information collected can be the following information：Code stream frame bandwidth statistics, code stream letter
Whether contain image B frame informations, present frame I frames in source company-information, code stream image dimension information, code stream frame rate information, code stream
Judge that information, present frame head P frames judge information, macro block traversal range information and decoding complexity information etc..
Audio-visual quality control module 203 is specifically described below.
Audio-visual quality control module 203 includes submodule：Information storage module 2031, analysis judge module 2032, lead to
Know module 2033, starting configuration module 2034, expiry notification module 2035.
The function of described information storage module 2031 is responsible for carrying out the summary information storage of MAP forms, so that analysis is sentenced
Disconnected module 2032 carries out summary information analysis and used.
The function of the analysis judge module 2032 is responsible for the unblock of internal signal amount, carries out summary information analysis in real time.
The function of the notification module 2033 is responsible for corresponding in good time being sent to of adjustment decision-making progress starting configuration mould
Block 2034.
The function of the starting configuration module 2034 is responsible for related audio-visual quality adjustment order being sent to management configuration
Module 200
The function of the expiry notification module 2035 is responsible for according to the order request of management configuration module 200, processing data
Return-to-zero is stored, so that next transcoding cycle is normally carried out.
Audio/video coding module 204 is specifically described below.
In addition to functions described above, audio/video coding module 204 also includes following function：It need to be issued according to management configuration module
Link command, handle coding pipeline Link State, carry out the activity of link re-establishment chain in good time, and link tears chain activity open.
When it is implemented, audio/video coding module 204 includes submodule：Coding parameter configuration receiving module 2041, establish
Encoding target numbering module 2042, correlative coding container module 2043, encoding state information summarizing module 2044, stream memory module
2045th, forwarding module 2046 is flowed.
The function of the coding parameter configuration receiving module 2041 is responsible for establishing transcoding channel list (encoding channel row
Table), then enable correlative coding object instance by establishing encoding target numbering module 2042.
The function of establishing encoding target numbering module 2042 is responsible for identifying coding parameter requirement, enables correlative coding
Object instance.
The function of the correlative coding container module 2043 is responsible for receiving audio/video decoding module 202 sending and treated accordingly
Coding audio-visual message data (decoding data), and according to the coding negotiation ginseng required by coding parameter configuration receiving module 2041
Number carries out transcoding message data coding.
The function of the encoding state information summarizing module 2044 is responsible for supervising and recording encoding state information in real time, and
Record summary information (encoder complexity and coder resource consumption information) is sent to audio-visual quality control module 203.
The function of the stream memory module 2045 is responsible for being stored message after coding, for flowing forwarding module 2046
Carry out stream information forwarding output.
The function of the stream forwarding module 2046 is responsible for being flowed the stream issue data that stream memory module 2045 stores
Information forwarding output.
When it is implemented, the encoder complexity and coder resource consumption information that collect can be the following information：Compile
Code host processor resources occupation proportion, the single-level memory resource occupation ratio for encoding primary processor, encode the two of primary processor
Level memory resource occupation proportion, encoding stream output occupied bandwidth statistics, encoding stream image dimension information, encoding stream frame per second letter
Whether contain image B frame informations, coding complexity information etc. in breath, encoding stream.
Lower mask body introduction carries out the detailed process of audio frequency and video transcoding by multichannel audio frequency and video transcoding device of the present invention.
Foreground Web communication controls module 201 sends 2 major class orders to management configuration module 200：Run initial configuration life
Make, transcoding related command.
Wherein, operation initial configuration order concrete numerical value content includes：It is the external source device list of required service, outer
Connect the unique mark GUID of source device, the information importance hierarchical definition of external source device, producer OCX ID definition, channel
Label, capability set scope, the definition of external transcoding type, terminal initial data definition, the definition of access network primary data, control letter
Breath, transcoding requirement.
Transcoding related command is that transcoding starts, transcoding terminates.Specific instructions numerical value content includes：Unique mark of source device
Know GUID, the definition of external transcoding type.
When management configuration module 200 receives the operation initial configuration order that foreground Web communication controls module 201 sends
When information and transcoding relevant command information, by for the difference of operation initial configuration command information and transcoding relevant command information
Content carries out associative operation.Channel management module 2002 in management configuration module 200 is in processing operation initial configuration life
When making, initial configuration command context is integrated, and stored by MAP modes, is searched so that the later stage travels through.Channel
Management module 2002 is when handling transcoding related command, then the unique mark GUID of the source device in transcoding related command
And external transcoding type definition, transcoding channel command is improved, relative decoding capability set control module 2001 is issued to and is had
Body decodes link setup and source coding work, if being indicated as being the stream way of output in transcoding type definition, simultaneously orders transcoding channel
Order is issued to correlative coding capability set control module 2004 and starts specific coding channel, and waits decoding capability collection control mould to be received
The source coding data of block 2001.Solution/code capacity management module 2003 in management configuration module 200 is being responsible for processing
The coding/decoding ability dynamically recording of all channels of run mode.Decoding capability collection control module in management configuration module 200
2001 are responsible under the specific decoding activities task (decoding command information) for decoding channel for all channels that processing is currently running state
It is sent to audio/video decoding module 202.Code capacity collection control module 2004 in management configuration module 200 is being responsible for processing
The specific coding active task (coded command information) of the encoding channel of all channels of run mode is issued to audio/video coding mould
Block 204.
When audio/video decoding module 202 receive management configuration module 200 decoding command information (decoding task activity will
Ask) when, first by the incoming special decoding configuration module 2021 of decoding order, decoding channel is detailed corresponding to distribution, and according to factory
Family's information prepares to enable corresponding producer OCX decoder modules.Control will be carried out back by returning control information collection module 2022 in next step
Information instancesization create, and prepare dynamic collection audio-visual quality and return control information.After previous work is completed, it will be decoded by starting
Module 2023 carries out the operation of decoder module, including：Decode the foundation of channel, the reception of audio frequency and video Channel message, audio frequency and video report
The real-time decoding of text.In the process, by the key technology data in real-time collection decoding process, and key technology data are carried
Hand over to decoded state information summarizing module 2024 to enter collecting for row information, and timing 1 second by summary information, (decoding quality is believed
Breath) report audio-visual quality control module 203.If transcoding type is stream forwarding formula, need decoding data being sent to volume
Code device carries out transcoding information to connection module 2025, and by encoder to the active link setup audio/video coding module 204 of connection module 2025
Docking activity.If transcoding type is video wall, need decoding data being sent to video wall output module 2026, video wall output
Display data then according to output simulation mouth requirement, is sent into various types of display output ports by module 2026.In addition, decoding
During, supervise simultaneously carrying recorded decoding network state information in real time by decoded state information summarizing module 2024, and record is converged
Total information is sent to audio-visual quality control module 203, has supplied when dynamic adjusts picture quality as statistics foundation.
When audio/video coding module 204 receives the coded command information that management configuration module 200 issues, volume will be passed through
Code parameter configuration receiving module 2041 establishes transcoding channel list (encoding channel list), then by establishing encoding target numbering mould
Block 2042 enables correlative coding object instance, then passes through the stand by tone Video decoding module 202 of correlative coding container module 2043
Send corresponding audio frequency and video message data to be encoded.Corresponding audio frequency and video message to be encoded is sent when being connected to audio/video decoding module 202
After data, correlative coding container module 2043 is by according to the coding negotiation parameter required by coding parameter configuration receiving module 2041
Carry out transcoding message data coding work.Coding result is passed through according to the defined implementation requirements of encoding target numbering module 2042
Packet storage after stream memory module 2045 is encoded, and message is forwarded after being encoded by flowing forwarding module 2046
Output.In addition, in an encoding process, supervised in real time by encoding state information summarizing module 2044 and record encoding state letter
Breath, and record summary information (encoder complexity and coder resource consumption information) is sent to audio-visual quality control module 203,
For dynamic adjustment picture quality as statistics foundation.
When audio-visual quality control module 203 is connected to decoding quality information (the decoding net of the transmission of audio/video decoding module 202
Network state statistical information) and the encoder complexity sent of audio/video coding module 204 and coder resource consumption information (coding
Information performance takes statistics) after, the summary information for carrying out MAP forms by information storage module 2031 first stores, so
Post analysis judge module 2032 will carry out summary information analysis in real time by internal signal amount unlocking manner.Summary information includes：
(transcoding device compiles solution for decoding quality information, network transmission quality perception data, encoder complexity and coder resource consumption information
Code performance system adjusts perception data), and according to exclusive modeling statistical algorithm, judge whether to need to carry out audio frequency and video channel quality ginseng
Number adjustment.If making corresponding adjustment decision-making, starting configuration module 2034 can be informed by notification module 2033, related sound is regarded
Frequency Mass adjust- ment order is sent to management configuration module 200, after management configuration module 200 is connected to adjustable strategies, can uniformly be ordered
Order is integrated and order issues.Expiry notification module 2035 is responsible for processing data storage according to the order request of management configuration module 200
Return-to-zero, so that next transcoding cycle is normally carried out.
Fig. 3 is multichannel audio frequency and video transcoding device state transition graph of the present invention.Zero represents transcoding device state；Represents to turn
Code unit state transition trigger condition；◇ represents the state adjustment threshold decision situation of transcoding device in this condition.
Include the whole show state of device in multichannel audio frequency and video transcoding device state transition graph of the present invention：Free time etc.
Treat task 301, transcoding unified management 302, audio frequency and video transcoding 303, transcoding output 304, network quality information collect storage 305,
Encoder performance information storage 306, real-time transfer capability collect and analyzed 307, dynamic audio-visual quality adjustment 308.
Include State Transferring trigger condition in multichannel audio frequency and video transcoding device state transition graph of the present invention：Receive forwarding
Task 310, startup solution/encoding example 311, transcoding result output 312, network foundation information extraction 313, basis of coding information carry
Take 314, network quality problem data 315, coding performance problems data 316, collect information integration result of calculation 317, quality ginseng
Number adjustment result 318, adjustment quality notification 319, transcoding task is needed to terminate 320.
Include the state of transcoding device in this condition in multichannel audio frequency and video transcoding device state transition graph of the present invention
Adjust threshold decision situation：Judge adjustment threshold value 321.
The state of multichannel audio frequency and video transcoding device of the present invention is changed since the state of idle waiting task 301,
Multichannel audio frequency and video transcoding device state is in idle waiting state 301, when by multichannel audio frequency and video transcoding device
Controllers are submitted by the user interface mode of web modes or multichannel audio frequency and video transcoding device controllers pass through meter before
Command condition that task state is submitted is drawn when meeting, will meet to receive the State Transferring trigger condition of forwarding task 310, it is now to believe more
The state of road audio frequency and video transcoding device switchs to transcoding unified management 302.
Now multichannel audio frequency and video transcoding device will be consulted to require according to transcoding initial configuration information and transcoding, start
Solution/encoding example, if solution encoding example starts successfully, meet to start the State Transferring trigger condition of solution/encoding example 311, this
When conversion equipment state switch to audio frequency and video transcoding 303.
The activity of audio frequency and video transcoding 303 includes audio/video decoding and audio/video coding function, and this activity not only will be according to
Transcoding output target is different, sends corresponding audio-video signal to analog display device or to normal stream distributing device, works as satisfaction
Transcoding result exports 312 State Transferring trigger conditions, and now the state of multichannel audio frequency and video transcoding device switchs to transcoding output
304。
In addition, in the activity of audio frequency and video transcoding 303, most important task is also needed among solution coding overall process, in real time
Collection decoding quality information and encoder complexity and coder resource consumption information, and when meeting network foundation information extraction
During 313 State Transferring trigger condition, now the state of conversion equipment switchs to network quality information collection storage 305.And when satisfaction
During 314 State Transferring trigger condition of basis of coding information extraction, now the state of conversion equipment switchs to encoder performance information receipts
Collection storage 306.
When network quality information collects 305 state of storage, the network quality statistics in responsible collection, storage certain time length
Information, and collect as real-time transfer capability and analyze desired data format, make corresponding forward data and arrange, and will
Risk data carries out related extraction and makees table.When meeting 315 State Transferring trigger condition of network quality problem data, now turn
The state of changing device switchs to real-time transfer capability and collects and analyze 307.
When encoder performance information stores 306 state, the encoder performance in responsible collection, storage certain time length
Quality statistic information, and information format is anticipated and collects and analyze desired data format for real-time transfer capability, it is complete
Arranged into corresponding forward data, and risk data is subjected to related extraction and makees table.When meeting coding performance problems data 316
During State Transferring trigger condition, now the state of conversion equipment can similarly switch to real-time transfer capability and collect and analyze 307.
When real-time transfer capability collects and analyzes 307 state, it will network quality information collect storage 305 activity,
And the activity of encoder performance information storage 306 arranges, network quality information and coding after the preposition processing of extraction
Device performance information is unified to carry out laterally cutting data analysis and longitudinal direction brill data analysis, and finds wherein whether have exception, when
When meeting to collect information integration 317 State Transferring trigger condition of result of calculation, now the state of conversion equipment switchs to dynamic sound and regarded
Frequency Mass adjust- ment 308.
, will be according to finding on network quality information and coding in dynamic audio-visual quality adjusts 308 active states
The collection information integration result of calculation that device performance information is made, the global mass balance point of overall view is carried out, and make corresponding sound and regard
Frequency penetration quality dynamic optimisation strategy.And make the corresponding command request report, when meet mass parameter adjustment the State Transferring of result 318 touch
During clockwork spring part, now the state of conversion equipment switchs to adjust threshold decision situation judgement adjustment threshold value 321.
In judging to adjust threshold value 321, according to the sound that used customer satisfaction evaluation is collected in conversion equipment running
Video quality dynamic adjusted threshold threshold value, the audio-visual quality dynamic optimization made for dynamic audio-visual quality adjustment 308
Strategy carries out the threshold value judgement activity of necessary adjustment.When the satisfaction needs adjustment State Transferring trigger condition of quality notification 319
When, now the state of conversion equipment switchs to transcoding unified management 302.Carry out next stage audio frequency and video conversion overall process.
In addition, work as in the activity of audio frequency and video transcoding 303, when judgement meets that transcoding task terminates 320 State Transferring trigger condition,
Now the state of conversion equipment rotates back into idle waiting task 301.System mode is zero to the free time and in wait Task Switching
Stage.
It is required for by network, can faces often due to each due to the input of audio, video data and to flow way of output output
, there is the situation of network bandwidth fluctuation, if the fluctuating range of bandwidth causes the sound of some transcoding channels in itself in kind network reason
Video data can not normal transmission, will result in this transcoding channel audio-visual quality decline, often occur that sound continues absolutely
Continuous, video occur it is stagnant stop or mosaic occur, even obscure not identifiable situation completely, at this time require that the present invention is more
Channel audio frequency and video transcoding device carries out image synthesis quality assurance on the basis of based on Information Statistics parser, and to net
Corresponding controlling of quality processing is made in the unusual fluctuations of network bandwidth, and above-mentioned processing activity mainly needs audio-visual quality control module
In analysis judge module handled.
Fig. 4 is the specific work of the analysis judge module in a kind of audio-visual quality control module provided in an embodiment of the present invention
Make flow chart.As shown in figure 4, in analysis judge module 2032 data that handle include decoding quality information, encoder complexity and
Coder resource consumption information and network transmission quality data.Decoding quality information and the consumption of encoder complexity and coder resource
Information is received by the encoding and decoding resource perception component 400 in quality state monitoring 40, the network transmission quality data (biography of network 42
Defeated generation) perceived by the network quality perception component 401 in quality state monitoring 40.Then, encoding and decoding resource perception component 400
In the data input after perception being judged into 402 to threshold values with network quality perception component 401, judge that 402 judgements are produced through threshold values
Raw judged result, judged result are transferred to the decision controller 410 in Rate Control 41, and decision controller 410 is according to advance
The network transmission control decision strategy of setting, and current each transcoding channel quality condition, do to audio-video code stream input code flow
Go out policy-making adjustment, and audio-video code stream output code flow is adjusted correspondingly, adjustment information is sent to stream 411 Hes of encapsulation
Bit rate controller 412, to realize that bandwidth self-adaption adjusts.
Specifically, threshold values judges that 402 do manual work conduct：According to decoding quality information, encoder complexity and coder resource
Consumption information, and network transmission quality perception information, and pass through default audio-visual quality dynamic in transcoding device of the present invention
Threshold threshold is adjusted, carries out global audio-visual quality decision-making.Specific threshold values judges to include：Application weight according to this transcoding channel
The property wanted index, make the differentiation of quality control necessity；According to information source end network statistics characteristic and current information source coding negotiation parameter
Between relation, make coding negotiation parameter adjustment necessity and possibility and differentiate；If quality is due to coding primary processor
And associated storage buffer occupancy is too high causes, then can in other application importance of operation transcoding channel according to each self-channel,
Make and integrate quality control requirements differentiation.
The specific works of bit rate controller 412 are the high low values according to encoder quantization parameter, carry out specific audio frequency and video volume
Code work.Image Coding controls image encoded bandwidth and relationship between quality according to quantization parameter QP.The bigger Image Codings of QP
After compress more severe, i.e., the data volume totality occupied bandwidth after output image coding is lower, while image sharpness can reduce.Sound
Frequency coding uses fixed-bandwidth coded system, is currently to be consulted by audio protocols capability set, if necessary the appropriate sound of switching at runtime
Frequency agreement, solves the problems, such as audio quality and bandwidth relationship,
Stream encapsulation 411 specific works be：According to the requirement of network message encapsulation format, and according to each own coding of audio frequency and video after
Encapsulation of data protocol requirement, coded data is encapsulated among RTP messages, and by tunneling, indicates each RTP messages category
Property.
Above-mentioned all component belongs to analyze judge module 2032.
The process of audio-visual quality is adjusted using apparatus of the present invention dynamic is：When system detectio to network quality bandwidth occurs
, can be according to the quality collect statistics in a period of time during the mass parameter associated change such as fluctuation and codec hardware inadequate resource
Data, for user's transcoding channel application importance ranking, carry out reducing frame per second or adjust the processing of image resolution ratio, with this
The continuity of sound need to be ensured simultaneously.Adjusting the mechanism that video frame rate changes is：When detecting that network bandwidth is less than transcoding device
When prospective quality consults desired network bandwidth, then video frame rate is reduced to the 1/2 of original frame per second.Such as：Original setting video
When frame per second is 20 frames/second, system detectio is inadequate to bandwidth, and now system is notified that corresponding audio frequency and video information source end makes frame of video
Rate adjusts, and frame per second is reduced to 10 frames/second, and now such as detection bandwidth is still inadequate, then it is 5 frames/second that continuing, which reduces frame per second,.When system is sent out
Existing bandwidth is rendered abundant, and system is notified that audio frequency and video information source end raises frame per second, but the speed raised necessarily keeps slow
It is incremented by state, such as 11 frames/second can be first brought up to from 10 frames/second, 12 frames/second ... is until stable in a suitable networks bandwidth
Value near.In the case of codec hardware inadequate resource, multichannel audio frequency and video transcoding device of the present invention uses to be believed for B frames
The mode that breath does relevant treatment saves coder resource, such as：Close B frames coding and enable mode, this channel is only existed I frames, P
Frame coding information, it will so greatly save bandwidth and save Decoder Time complexity.It can use in addition, abandon B frame solutions
The mode of code, it is diplomatic to abandon B frame decoding processes by peculiar algorithm, more decoder resources are used for I frames and P
The decoding process of frame.In addition, if in the case of network bandwidth deficiency, have judge coded system that information source side uses for
MJPEG moving picture encoding modes, then this channel is made it carry out more rational image and compiled by enforcement capabilities negotiation mode
Code strategy, exports I frames and P frame coded image datas.During whole controlling of quality, for audio coding channel, the present invention
Multichannel audio frequency and video transcoding device is consulted using enforcement capabilities collection, selective activation G.728, the G.729 low bandwidth language such as voice
Sound coded system, voice coding bandwidth can not only be so substantially reduced, and can be in the case of low bandwidth to a greater extent
Ensure voice quality.When fluctuation or codec hardware resource anxiety occur for network, adjusted by audio-video code stream dynamic
After whole, although the video effect of some channels can decrease, but still can meet that sound is continuous, clear, image without flower screen, stagnant stop
Audio frequency and video totality encoding and decoding practical function target.
Compared with prior art, channel audio frequency and video transcoding device of the present invention has advantages below：
(1) by multichannel audio frequency and video transcoding device of the present invention can carry out multi-to-multi, multichannel, polymorphic type audio frequency and video
Transcoding, it is not necessary to stacked by more transcoding devices to realize, avoid the occurrence of that the R＆D cycle is long, and cost is too high, deployment is complicated
Etc. problems；
(2) audio-visual quality control module is employed so that when carrying out audio frequency and video transcoding, it can be considered that outside audio frequency and video
Network transmission state between the terminal of source device, and the encoding and decoding resource of transcoder such as use at the integration capability, can be right
The audio/video information of input carries out global quality control, can dynamically adjust the coding of the terminal of outside audio frequency and video source device
It is required that meet the practical application request of high-performance real-time transcoding.
Obviously, those skilled in the art should be understood that each module of the above-mentioned embodiment of the present invention or each step can be with
Realized with general computing device, they can be concentrated on single computing device, or are distributed in multiple computing devices
On the network formed, alternatively, they can be realized with the program code that computing device can perform, it is thus possible to by it
Store and performed in the storage device by computing device, and in some cases, can be to be held different from order herein
They, are either fabricated to each integrated circuit modules or will be multiple in them by the shown or described step of row respectively
Module or step are fabricated to single integrated circuit module to realize.So, the embodiment of the present invention is not restricted to any specific hard
Part and software combine.
The preferred embodiments of the present invention are the foregoing is only, are not intended to limit the invention, for the skill of this area
For art personnel, the embodiment of the present invention can have various modifications and variations.Within the spirit and principles of the invention, made
Any modification, equivalent substitution and improvements etc., should be included in the scope of the protection.
Claims (8)
- A kind of 1. multichannel audio frequency and video transcoding device, it is characterised in that including：Foreground Web page setup module, management configuration mould Block, audio/video decoding module, audio/video coding module and audio-visual quality control module；The foreground Web page setup module, for providing management and control service interface, and it is defeated by management and control service interface to receive user The operation initial configuration command information and transcoding relevant command information entered, and send to management configuration module；The management configuration module, the operation initial configuration order sent for receiving the foreground Web page setup module Information and transcoding relevant command information, generated according to operation initial configuration command information and transcoding relevant command information corresponding Command information or coded command information are decoded, receives the audio-visual quality adjustment order that audio-visual quality control module is sent, root The corresponding decoding command information of order generation or coded command information are adjusted according to audio-visual quality；Will decoding command information send to Audio/video decoding module, or coded command information is sent to audio/video coding module；The audio/video decoding module, the decoding command information sent for receiving the management configuration module, and external information source The audio, video data that equipment is sent, carries out the decoding process of audio, video data, and decoding data is sent into audio/video coding mould Block or ext nal network element；Decoding quality information is collected, and is sent to audio-visual quality control module；The audio/video coding module, the coded command information sent for receiving the management configuration module, and the sound regard The decoding data that frequency decoder module is sent, the coded treatment of audio, video data is carried out, coding information is sent to corresponding outer Portion's network element；Encoder complexity and coder resource consumption information are collected, and is sent to audio-visual quality control module；The audio-visual quality control module, for receiving network transmission quality perception information, the audio/video decoding module hair The encoder complexity and coder resource consumption information that the decoding quality information sent and the audio/video coding module are sent, according to Network transmission quality perception information, decoding quality information and encoder complexity and coder resource consumption information generate corresponding sound Video quality adjustment order, and send to management configuration module；The audio/video decoding module includes special decoding configuration module, returns control information collection module, starts decoder module, decoding Status information summarizing module, encoder are to connection module and video wall output module；The special decoding configuration module, the decoding command information sent for handling management configuration module, and distribute correspondingly Decoding channel it is detailed, and enable corresponding producer's OCX decoder modules；Described time control information collection module, created for returning control information instancesization, dynamic collection audio-visual quality returns control information；The startup decoder module, for decoding the reality of the foundation of channel, the reception of audio frequency and video Channel message and audio frequency and video message When decode；The decoded state information summarizing module, for carrying out back controlling collecting for information, summary information is reported into audio-visual quality Control module；The encoder is to connection module, for when transcoding type is stream forwarding formula, active link setup audio/video coding module, entering Row transcoding information butt joint activity；The video wall output module, for according to output simulation mouth requirement, decoding data to be sent into display output port.
- 2. multichannel audio frequency and video transcoding device as claimed in claim 1, it is characterised in that the operation initial configuration order Information includes：The external source device list of required service, the unique mark GUID of external source device, external source device Information importance hierarchical definition, producer OCX ID definition, channel label, transcoding capabilities collection scope, external transcoding type define, eventually Hold one of primary data definition, the definition of access network primary data, control information, transcoding requirement or multiple.
- 3. multichannel audio frequency and video transcoding device as claimed in claim 1, it is characterised in that the transcoding relevant command information bag Include unique mark GUID and the definition of external transcoding type of external source device.
- 4. multichannel audio frequency and video transcoding device as claimed in claim 1, it is characterised in that the decoding quality information includes code Whether flow in frame bandwidth statistics, code stream information source company-information, code stream image dimension information, code stream frame rate information, code stream containing figure As B frame informations, present frame I frames judge that information, present frame head P frames judge information, macro block traversal range information and decoding complex degree One of information is multiple.
- 5. multichannel audio frequency and video transcoding device as claimed in claim 1, it is characterised in that the encoder complexity and encoder Resource consumption information includes coding host processor resources occupation proportion, encodes the single-level memory resource occupation ratio of primary processor Example, the second-level storage resource occupation ratio of coding primary processor, encoding stream output occupied bandwidth statistics, encoding stream picture size Whether contain one of image B frame informations, coding complexity information or multiple in information, encoding stream frame per second information, encoding stream.
- 6. multichannel audio frequency and video transcoding device as claimed in claim 1, it is characterised in that the management configuration module includes solution Code capability set control module, channel management module, decode or encode Capacity Management module, code capacity collection control module；The decoding capability collection control module, for carrying out decoding link setup and source coding work；Processing is currently running the institute of state There is the decoding activities mission requirements of the decoding channel of channel, and decoding activities mission requirements is sent to audio/video decoding module；The channel management module, match somebody with somebody for integrating and storing the operation initialization that the foreground Web page setup module is sent Put command information；The transcoding phase command information sent according to the foreground Web page setup module, improves transcoding channel command, Transcoding channel command is sent to relative decoding capability set control module；The decoding or encoding Capacity Management module, coding or decoding capability for handling all channels for being currently running state move State information record；The code capacity collection control module, for receiving the source coding data of decoding capability collection control module, processing is The coded command information of the encoding channel of all channels of run mode, and coded command information is sent to audio/video coding mould Block.
- 7. multichannel audio frequency and video transcoding device as claimed in claim 1, it is characterised in that the audio/video coding module includes Coding parameter configuration receiving module, establish encoding target numbering module, correlative coding container module, encoding state information and collect mould Block, stream memory module and stream forwarding module；The coding parameter configures receiving module, for establishing encoding channel list；It is described to establish encoding target numbering module, for identifying coding parameter requirement, enable correlative coding object instance；The correlative coding container module, the corresponding audio frequency and video message number to be encoded sent for receiving audio/video decoding module According to, and carry out transcoding message data coding according to the coding negotiation parameter required by coding parameter configuration receiving module；The encoding state information summarizing module, for supervising and recording encoding state information, encoding state information is converged Always, and by summary information audio-visual quality control module is reported；The stream memory module, for message after coding to be stored；The stream forwarding module, for the stream issue data for flowing memory module storage to be carried out into stream information forwarding output.
- 8. multichannel audio frequency and video transcoding device as claimed in claim 1, it is characterised in that the audio-visual quality control module Including information storage module, analysis judge module, notification module, starting configuration module and expiry notification module；Described information storage module, sent for storing summary information, and by summary information to analysis judge module；The analysis judge module, unlocked for internal signal amount, carry out summary information analysis in real time and obtain corresponding sound to regard Frequency Mass adjust- ment order, corresponding audio-visual quality is adjusted into order and sent to notification module；The notification module, order is adjusted for receiving the corresponding audio-visual quality that the analysis judge module is sent, and will Corresponding audio-visual quality adjustment order is sent to starting configuration module；The starting configuration module, for the adjustment order of corresponding audio-visual quality to be sent into management configuration module；The expiry notification module, for according to management configuration module order request, processing data storage return-to-zero.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510183900.9A CN104768026B (en) | 2015-04-17 | 2015-04-17 | A kind of multichannel audio frequency and video transcoding device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510183900.9A CN104768026B (en) | 2015-04-17 | 2015-04-17 | A kind of multichannel audio frequency and video transcoding device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104768026A CN104768026A (en) | 2015-07-08 |
| CN104768026B true CN104768026B (en) | 2018-01-30 |
Family
ID=53649580
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510183900.9A Active CN104768026B (en) | 2015-04-17 | 2015-04-17 | A kind of multichannel audio frequency and video transcoding device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104768026B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105072507B (en) * | 2015-07-24 | 2019-01-25 | 南京信通科技有限责任公司 | A kind of transmission method and system of multi-medium data |
| CN106888400B (en) * | 2015-12-15 | 2019-05-10 | 中国电信股份有限公司 | A kind of method and system for realizing transcoding task schedule |
| CN105657542B (en) * | 2016-03-31 | 2018-10-19 | 深圳市茁壮网络股份有限公司 | A kind of mosaic service management platform and system |
| CN109479121B (en) * | 2017-03-14 | 2020-09-01 | 深圳力维智联技术有限公司 | Video monitoring system, client, signaling interaction server and control method |
| CN107566671B (en) * | 2017-10-12 | 2020-09-25 | 上海华客信息科技有限公司 | Network voice communication method and system, storage medium and electronic equipment |
| CN111182220A (en) * | 2020-01-09 | 2020-05-19 | 西安万像电子科技有限公司 | Image processing apparatus, remote device, and communication system |
| CN111541941B (en) * | 2020-05-07 | 2021-10-29 | 杭州小影创新科技股份有限公司 | Method for accelerating coding of multiple encoders at mobile terminal |
| CN111934823B (en) * | 2020-08-12 | 2022-08-02 | 中国联合网络通信集团有限公司 | Data transmission method, radio access network equipment and user plane functional entity |
| CN112311802B (en) * | 2020-11-05 | 2023-10-27 | 维沃移动通信有限公司 | Information transmission method and information transmission device |
| CN112511768B (en) * | 2020-11-27 | 2024-01-02 | 上海网达软件股份有限公司 | Multi-picture synthesis method, device, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1668109A (en) * | 2004-03-10 | 2005-09-14 | 浙江大学 | Adaptive video transcoding gateway having multiple transforming functions |
| JP2009089156A (en) * | 2007-10-01 | 2009-04-23 | Yamaha Corp | Distribution system and method |
| CN101873482A (en) * | 2010-07-02 | 2010-10-27 | 上海交通大学 | Real-time streaming media cluster transcoding system |
| CN102523435A (en) * | 2012-01-01 | 2012-06-27 | 洛阳普天通信科技有限公司 | Mobile high-definition video surveillance method and apparatus based on 3G network |
-
2015
- 2015-04-17 CN CN201510183900.9A patent/CN104768026B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1668109A (en) * | 2004-03-10 | 2005-09-14 | 浙江大学 | Adaptive video transcoding gateway having multiple transforming functions |
| JP2009089156A (en) * | 2007-10-01 | 2009-04-23 | Yamaha Corp | Distribution system and method |
| CN101873482A (en) * | 2010-07-02 | 2010-10-27 | 上海交通大学 | Real-time streaming media cluster transcoding system |
| CN102523435A (en) * | 2012-01-01 | 2012-06-27 | 洛阳普天通信科技有限公司 | Mobile high-definition video surveillance method and apparatus based on 3G network |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104768026A (en) | 2015-07-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104768026B (en) | A kind of multichannel audio frequency and video transcoding device | |
| JP3716144B2 (en) | Network data transcoding method and apparatus for multimedia data flow | |
| CN101119483B (en) | Source quality based video stream transmission velocity regulation means | |
| CN103067749B (en) | IPTV service quality monitoring method, device and video server | |
| CN105491337B (en) | Network Video Surveillance Device-General cut-in method and device based on SDK level of abstraction | |
| CN110493351B (en) | Video networking access method, device, equipment and storage medium | |
| CN104735470A (en) | Streaming media data transmission method and device | |
| CN103200425A (en) | Device and method of multimedia processing | |
| CN103533305B (en) | A kind of plugin-free universal video monitoring of B/S frameworks | |
| CN101917612A (en) | Streaming media video coding method and device | |
| CN101389020A (en) | Method for extending decoding capability of stream media playing device | |
| WO2022001559A1 (en) | Video encoding method and apparatus, electronic device and machine-readable storage medium | |
| CN102215381A (en) | Integrating device and method for integrating digital video monitoring systems | |
| CN109874027A (en) | A kind of low delay educational surgery demonstration live broadcasting method and its system | |
| WO2009155814A1 (en) | Method, device and system for evaluating video quality | |
| Filippou et al. | Multi-access edge computing: A comparative analysis of 5G system deployments and service consumption locality variants | |
| WO2023010992A1 (en) | Video coding method and apparatus, computer readable medium, and electronic device | |
| CN107453936A (en) | A kind of method and gateway device for diagnosing voice delay time | |
| CN112866713B (en) | Transcoding all-in-one machine system and transcoding method | |
| KR101322392B1 (en) | Method and apparatus for encoding and decoding of scalable codec | |
| CN110769179A (en) | Audio and video data stream processing method and system | |
| CN107529023A (en) | It is a kind of that there is signal mutually for the matrix device and output intent of function | |
| CN110248184A (en) | A kind of monitoring method for detecting abnormality and server based on view networking | |
| CN109802990A (en) | A kind of resource log reading/writing method and device reducing data redundancy | |
| CN202424763U (en) | Wireless ONU home gateway device based on EPON access |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |