CN108881957A - A kind of mixed method and device of multimedia file - Google Patents
A kind of mixed method and device of multimedia file Download PDFInfo
- Publication number
- CN108881957A CN108881957A CN201711066237.XA CN201711066237A CN108881957A CN 108881957 A CN108881957 A CN 108881957A CN 201711066237 A CN201711066237 A CN 201711066237A CN 108881957 A CN108881957 A CN 108881957A
- Authority
- CN
- China
- Prior art keywords
- data
- way
- multichannel
- source
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 59
- 230000006855 networking Effects 0.000 claims abstract description 79
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 44
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 44
- 238000004891 communication Methods 0.000 claims description 29
- 230000008569 process Effects 0.000 claims description 20
- 238000012545 processing Methods 0.000 claims description 16
- 238000004088 simulation Methods 0.000 claims description 12
- 238000006243 chemical reaction Methods 0.000 claims description 8
- 239000012634 fragment Substances 0.000 claims description 7
- 230000005540 biological transmission Effects 0.000 abstract description 13
- 238000003860 storage Methods 0.000 abstract description 9
- 238000005516 engineering process Methods 0.000 description 20
- 238000010586 diagram Methods 0.000 description 13
- 230000006870 function Effects 0.000 description 7
- 238000004590 computer program Methods 0.000 description 6
- 238000001514 detection method Methods 0.000 description 6
- 238000009826 distribution Methods 0.000 description 5
- RTZKZFJDLAIYFH-UHFFFAOYSA-N Diethyl ether Chemical compound CCOCC RTZKZFJDLAIYFH-UHFFFAOYSA-N 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 4
- 241001269238 Data Species 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000011144 upstream manufacturing Methods 0.000 description 2
- 241000700605 Viruses Species 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000002155 anti-virotic effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 125000004122 cyclic group Chemical group 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2368—Multiplexing of audio and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2389—Multiplex stream processing, e.g. multiplex stream encrypting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4341—Demultiplexing of audio and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Computer Security & Cryptography (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment of the invention provides a kind of mixed method of multimedia file and devices, are deployed with view networked server and multiple view networked terminals in depending on networking, the method includes：Multichannel source audio data, the multichannel source video data that view networked terminals are sent are received depending on networked server；Depending on networked server by the target audio data all the way of source audio Data Synthesis described in multichannel；Depending on networked server by the target video data all the way of source video Data Synthesis described in multichannel；The target audio data with the target video data all the way multimedia file will be synthesized all the way depending on networked server.When audio or video acquisition equipment is more, an audio-video document is generated, the quantity of audio-video document is greatly reduced, improves the simplicity of the management such as storage, transmission.
Description
Technical field
The present invention relates to view networking technology field, mixed method and a kind of more matchmakers more particularly to a kind of multimedia file
The mixing arrangement of body file.
Background technique
With the fast development of the network technology, life of the multimedia communications such as video conference, video teaching in user, work
Make, learn etc. is widely available.
In view networking, a view networked terminals access audio or video acquires equipment, generates an audio-video document, when
When audio or video acquisition equipment is more, the audio-video document of generation is more, and the management such as storage, transmission is relatively complicated.
Summary of the invention
In view of the above problems, it proposes the embodiment of the present invention and overcomes the above problem or at least partly in order to provide one kind
A kind of mixed method of the multimedia file to solve the above problems and a kind of corresponding mixing arrangement of multimedia file.
According to one aspect of the present invention, a kind of mixed method of multimedia file is provided, is deployed in depending on networking
Depending on networked server and multiple view networked terminals, the method includes：
Multichannel source audio data, the multichannel source video data that view networked terminals are sent are received depending on networked server；
Depending on networked server by the target audio data all the way of source audio Data Synthesis described in multichannel；
Depending on networked server by the target video data all the way of source video Data Synthesis described in multichannel；
The target audio data multimedia text will be synthesized with the target video data all the way all the way depending on networked server
Part.
Optionally, it is also deployed with view networking gateway in depending on networking, is disposed in IP network and broadcasts server a little, the method
Further include：
Depending on networked server by according to it is described view networking gateway configuration downstream communications link, by the multimedia file
It is sent to the view networking gateway, to carry out the protocol conversion depending on being networked to IP network and be sent to the vod server.
Optionally, the view networked server receives multichannel source audio data, multichannel source video that view networked terminals are sent
Data, including：
Receive the multichannel data packet that view networked terminals are sent；
Data Identification is read from the head information of the data packet；
When the Data Identification is preset audio identification, audio fragment is extracted from the data packet, and be accumulated as
Source audio data；
When the Data Identification is preset video identifier, video clip is extracted from the data packet, and be accumulated as
Source video data.
Optionally, the view networked server is by the target audio data all the way of source audio Data Synthesis described in multichannel, including：
Source audio data described in multichannel are decoded processing, obtain multichannel source analogue data；
Source analogue data described in multichannel is subjected to stereo process, obtains target simulation data all the way；
The target simulation data coded treatment will be carried out all the way, and obtain target audio data all the way.
Optionally, the view networked server is by the target video data all the way of source video Data Synthesis described in multichannel, including：
Source video data described in multichannel are decoded processing, obtain multichannel source image data；
Source image data described in multichannel is subjected to splicing, obtains destination image data all the way；
The destination image data coded treatment will be carried out all the way, and obtain target video data all the way.
Optionally, described the target audio data to be closed all the way with the target video data all the way depending on networked server
At multimedia file, including：
Calculate the audio Presentation Time Stamp of the target audio data all the way；
Calculate the video Presentation Time Stamp of the target video data all the way；
It, will the mesh all the way according to the size relation between the audio Presentation Time Stamp and the video Presentation Time Stamp
Audio data is marked to be written in multimedia file with the target video data all the way.
According to another aspect of the present invention, a kind of mixing arrangement of multimedia file is provided, is deployed in depending on networking
Depending on networked server and multiple view networked terminals, described device is located in view networked server, including：
Multi-medium data receiving module, multichannel source audio data, the multichannel source video sent for receiving view networked terminals
Data；
Target audio Data Synthesis module, for by the target audio data all the way of source audio Data Synthesis described in multichannel；
Target video data synthesis module, for by the target video data all the way of source video Data Synthesis described in multichannel；
Multimedia file synthesis module is used to the target audio data to close with the target video data all the way all the way
At multimedia file.
Optionally, it is also deployed with view networking gateway in depending on networking, is disposed in IP network and broadcasts server a little, described device
Further include：
Multimedia file sending module, for will lead to according to the downlink depending on networking gateway configuration depending on networked server
Believe link, the multimedia file is sent to the view networking gateway, it is concurrent depending on the protocol conversion that is networked to IP network to carry out
It send to the vod server.
Optionally, the multi-medium data receiving module includes：
Data packet receiving submodule, the multichannel data packet sent for receiving view networked terminals；
Data Identification reading submodule, for reading Data Identification from the head information of the data packet；
Source audio data accumulate submodule, are used for when the Data Identification is preset audio identification, from the data
Audio fragment is extracted in packet, and is accumulated as source audio data；
Source video data accumulate submodule, are used for when the Data Identification is preset video identifier, from the data
Video clip is extracted in packet, and is accumulated as source video data.
Optionally, the target audio Data Synthesis module includes：
Audio decoder submodule obtains multichannel source and simulates number for source audio data described in multichannel to be decoded processing
According to；
Stereo process submodule obtains target simulation all the way for source analogue data described in multichannel to be carried out stereo process
Data；
Audio coding submodule obtains target sound all the way for that the target simulation data will carry out coded treatment all the way
Frequency evidence.
Optionally, the target video data synthesis module includes：
Video decoding sub-module obtains multichannel source images number for source video data described in multichannel to be decoded processing
According to；
Splicing submodule obtains target image all the way for source image data described in multichannel to be carried out splicing
Data；
Video coding submodule obtains target all the way and regards for that the destination image data will carry out coded treatment all the way
Frequency evidence.
Optionally, the multimedia file synthesis module includes：
Audio Presentation Time Stamp computational submodule, the audio for calculating the target audio data all the way show the time
Stamp；
Video Presentation Time Stamp computational submodule, the video for calculating the target video data all the way show the time
Stamp；
Submodule is written in multimedia file, for according to the audio Presentation Time Stamp and the video Presentation Time Stamp it
Between size relation, will all the way the target audio data in the write-in multimedia file of the target video data all the way.
The embodiment of the present invention includes following advantages：
In the embodiment of the present invention, multichannel source audio data, the multichannel source that view networked terminals are sent are received depending on networked server
Video data, respectively source audio Data Synthesis described in multichannel all the way target audio data, by multichannel source video Data Synthesis all the way
Target video data, when audio or video acquisition equipment is more, generates an audio-video text to synthesize multimedia file
Part greatly reduces the quantity of audio-video document, improves the simplicity of the management such as storage, transmission.
Detailed description of the invention
Fig. 1 is a kind of networking schematic diagram of view networking of one embodiment of the invention；
Fig. 2 is a kind of hardware structural diagram of node server of one embodiment of the invention；
Fig. 3 is a kind of hardware structural diagram of access switch of one embodiment of the invention；
Fig. 4 is that a kind of Ethernet association of one embodiment of the invention turns the hardware structural diagram of gateway；
Fig. 5 is a kind of step flow chart of the mixed method of multimedia file of one embodiment of the invention；
Fig. 6 is the connection schematic diagram in a kind of view networked server and view networking of one embodiment of the invention；
Fig. 7 is the step flow chart of the mixed method of another multimedia file of one embodiment of the invention；
Fig. 8 is a kind of structural block diagram of the mixing arrangement of multimedia file of one embodiment of the invention.
Specific embodiment
In order to make the foregoing objectives, features and advantages of the present invention clearer and more comprehensible, with reference to the accompanying drawing and specific real
Applying mode, the present invention is described in further detail.
It is the important milestone of network Development depending on networking, is a real-time network, can be realized HD video real-time Transmission,
Push numerous Internet applications to HD video, high definition is face-to-face.
Real-time high-definition video switching technology is used depending on networking, it can be such as high in a network platform by required service
Clear video conference, Intellectualized monitoring analysis, emergency command, digital broadcast television, delay TV, the Web-based instruction, shows video monitoring
Field live streaming, VOD program request, TV Mail, individual character records (PVR), Intranet (manages) channel by oneself, intelligent video Broadcast Control, information publication
All be incorporated into a system platform etc. services such as tens of kinds of videos, voice, picture, text, communication, data, by TV or
Computer realizes that high-definition quality video plays.
Embodiment in order to enable those skilled in the art to better understand the present invention is introduced to depending on networking below：
Depending on networking, applied portion of techniques is as described below：
Network technology (Network Technology)
Traditional ethernet (Ethernet) is improved depending on the network technology innovation networked, with potential huge on network
Video flow.(Circuit is exchanged different from simple network packet packet switch (Packet Switching) or lattice network
Switching), Streaming demand is met using Packet Switching depending on networking technology.Has grouping depending on networking technology
Flexible, the simple and low price of exchange, is provided simultaneously with the quality and safety assurance of circuit switching, it is virtually electric to realize the whole network switch type
The seamless connection of road and data format.
Switching technology (Switching Technology)
Two advantages of asynchronous and packet switch that Ethernet is used depending on networking eliminate Ethernet under the premise of complete compatible and lack
It falls into, has the end-to-end seamless connection of the whole network, direct user terminal, directly carrying IP data packet.User data is in network-wide basis
It is not required to any format conversion.It is the more advanced form of Ethernet depending on networking, is a real-time exchange platform, can be realized at present mutually
The whole network large-scale high-definition realtime video transmission that networking cannot achieve pushes numerous network video applications to high Qinghua, unitizes.
Server technology (Server Technology)
It is different from traditional server, its Streaming Media depending on the server technology in networking and unified video platform
Transmission be built upon it is connection-oriented on the basis of, data-handling capacity is unrelated with flow, communication time, single network layer energy
Enough transmitted comprising signaling and data.For voice and video business, handled depending on networking and unified video platform Streaming Media
Complexity many simpler than data processing, efficiency substantially increase hundred times or more than traditional server.
Reservoir technology (Storage Technology)
The ultrahigh speed reservoir technology of unified video platform in order to adapt to the media content of vast capacity and super-flow and
Using state-of-the-art real time operating system, the programme information in server instruction is mapped to specific hard drive space, media
Content is no longer pass through server, and moment is directly delivered to user terminal, and user waits typical time less than 0.2 second.It optimizes
Sector distribution greatly reduces the mechanical movement of hard disc magnetic head tracking, and resource consumption only accounts for the 20% of the internet ad eundem IP, but
The concurrent flow greater than 3 times of traditional disk array is generated, overall efficiency promotes 10 times or more.
Network security technology (Network Security Technology)
Depending on the structural design networked by servicing independent licence system, equipment and the modes such as user data is completely isolated every time
The network security problem that puzzlement internet has thoroughly been eradicated from structure, does not need antivirus applet, firewall generally, has prevented black
The attack of visitor and virus, structural carefree secure network is provided for user.
It services innovative technology (Service Innovation Technology)
Business and transmission are fused together by unified video platform, whether single user, private user or a net
The sum total of network is all only primary automatic connection.User terminal, set-top box or PC are attached directly to unified video platform, obtain rich
The multimedia video service of rich colorful various forms.Unified video platform is traditional to substitute with table schema using " menu type "
Complicated applications programming, considerably less code, which can be used, can be realized complicated application, realize the new business innovation of " endless ".
Networking depending on networking is as described below：
It is a kind of central controlled network structure depending on networking, which can be Tree Network, Star network, ring network etc. class
Type, but centralized control node is needed to control whole network in network on this basis.
As shown in Figure 1, being divided into access net and Metropolitan Area Network (MAN) two parts depending on networking.
The equipment of access mesh portions can be mainly divided into 3 classes：Node server, access switch, terminal (including various machines
Top box, encoding board, memory etc.).Node server is connected with access switch, and access switch can be with multiple terminal phases
Even, and it can connect Ethernet.
Wherein, node server is the node that centralized control functions are played in access net, can control access switch and terminal.
Node server can directly be connected with access switch, can also directly be connected with terminal.
Similar, the equipment of metropolitan area mesh portions can also be divided into 3 classes：Metropolitan area server, node switch, node serve
Device.Metropolitan area server is connected with node switch, and node switch can be connected with multiple node servers.
Wherein, node server is the node server for accessing mesh portions, i.e. node server had both belonged to access wet end
Point, and belong to metropolitan area mesh portions.
Metropolitan area server is the node that centralized control functions are played in Metropolitan Area Network (MAN), can control node switch and node serve
Device.Metropolitan area server can be directly connected to node switch, can also be directly connected to node server.
It can be seen that be entirely a kind of central controlled network structure of layering depending on networking network, and node server and metropolitan area
The network controlled under server can be the various structures such as tree-shaped, star-like, cyclic annular.
Visually claim, access mesh portions can form unified video platform (part in virtual coil), and multiple unified videos are flat
Platform can form view networking；Each unified video platform can be interconnected by metropolitan area and wide area depending on networking.
Classify depending on networked devices
1.1 embodiment of the present invention can be mainly divided into 3 classes depending on the equipment in networking：Server, interchanger (including ether
Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).Depending on networking can be divided on the whole Metropolitan Area Network (MAN) (or
National net, World Wide Web etc.) and access net.
1.2 equipment for wherein accessing mesh portions can be mainly divided into 3 classes：Node server, access switch (including ether
Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).
The specific hardware structure of each access network equipment is：
Node server：
As shown in Fig. 2, mainly including Network Interface Module 201, switching engine module 202, CPU module 203, disk array
Module 204；
Wherein, Network Interface Module 201, the Bao Jun that CPU module 203, disk array module 204 are come in enter switching engine
Module 202；Switching engine module 202 look into the operation of address table 205 to the packet come in, to obtain the navigation information of packet；
And the packet is stored according to the navigation information of packet the queue of corresponding pack buffer 206；If the queue of pack buffer 206 is close
It is full, then it abandons；All pack buffer queues of 202 poll of switching engine mould, are forwarded if meeting the following conditions：1) port
It is less than to send caching；2) the queue package counting facility is greater than zero.Disk array module 204 mainly realizes the control to hard disk, including
The operation such as initialization, read-write to hard disk；CPU module 203 is mainly responsible between access switch, terminal (not shown)
Protocol processes, to address table 205 (including descending protocol packet address table, uplink protocol package address table, data packet addressed table)
Configuration, and, the configuration to disk array module 204.
Access switch：
As shown in figure 3, mainly including Network Interface Module (downstream network interface module 301, uplink network interface module
302), switching engine module 303 and CPU module 304；
Wherein, the packet (upstream data) that downstream network interface module 301 is come in enters packet detection module 305；Packet detection mould
Whether mesh way address (DA), source address (SA), type of data packet and the packet length of the detection packet of block 305 meet the requirements, if met,
It then distributes corresponding flow identifier (stream-id), and enters switching engine module 303, otherwise abandon；Uplink network interface mould
The packet (downlink data) that block 302 is come in enters switching engine module 303；The data packet that CPU module 204 is come in enters switching engine
Module 303；Switching engine module 303 look into the operation of address table 306 to the packet come in, to obtain the navigation information of packet；
If the packet into switching engine module 303 is that downstream network interface is gone toward uplink network interface, in conjunction with flow identifier
(stream-id) packet is stored in the queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full,
It abandons；If the packet into switching engine module 303 is not that downstream network interface is gone toward uplink network interface, according to packet
Navigation information is stored in the data packet queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full,
Then abandon.
All pack buffer queues of 303 poll of switching engine module, are divided to two kinds of situations in embodiments of the present invention：
If the queue is that downstream network interface is gone toward uplink network interface, meets the following conditions and be forwarded：1)
It is less than that the port sends caching；2) the queue package counting facility is greater than zero；3) token that rate control module generates is obtained；
If the queue is not that downstream network interface is gone toward uplink network interface, meets the following conditions and be forwarded：
1) it is less than to send caching for the port；2) the queue package counting facility is greater than zero.
Rate control module 208 is configured by CPU module 204, to all downlink networks in programmable interval
Interface generates token toward the pack buffer queue that uplink network interface is gone, to control the code rate of forwarded upstream.
CPU module 304 is mainly responsible for the protocol processes between node server, the configuration to address table 306, and,
Configuration to rate control module 308.
Ethernet association turns gateway：
As shown in figure 4, mainly including Network Interface Module (downstream network interface module 401, uplink network interface module
402), switching engine module 403, CPU module 404, packet detection module 405, rate control module 408, address table 406, Bao Huan
Storage 407 and MAC adding module 409, MAC removing module 410.
Wherein, the data packet that downstream network interface module 401 is come in enters packet detection module 405；Packet detection module 405 is examined
Ethernet mac DA, ethernet mac SA, Ethernet length or frame type, the view networking mesh way address of measured data packet
DA, whether meet the requirements depending on networking source address SA, depending on networking data Packet type and packet length, corresponding stream is distributed if meeting
Identifier (stream-id)；Then, MAC DA, MAC SA, length or frame type are subtracted by MAC removing module 410
(2byte), and enter corresponding receive and cache, otherwise abandon；
Downstream network interface module 401 detects the transmission caching of the port, according to the view of packet networking mesh if there is Bao Ze
Address D A knows the ethernet mac DA of corresponding terminal, adds the ethernet mac DA of terminal, Ethernet assists the MAC for turning gateway
SA, Ethernet length or frametype, and send.
The function that Ethernet association turns other modules in gateway is similar with access switch.
Terminal：
It mainly include Network Interface Module, Service Processing Module and CPU module；For example, set-top box mainly connects including network
Mouth mold block, video/audio encoding and decoding engine modules, CPU module；Encoding board mainly includes Network Interface Module, video encoding engine
Module, CPU module；Memory mainly includes Network Interface Module, CPU module and disk array module.
The equipment of 1.3 metropolitan area mesh portions can be mainly divided into 2 classes：Node server, node switch, metropolitan area server.
Wherein, node switch mainly includes Network Interface Module, switching engine module and CPU module；Metropolitan area server mainly includes
Network Interface Module, switching engine module and CPU module are constituted.
2, networking data package definition is regarded
2.1 access network data package definitions
The data packet of access net mainly includes following sections：Destination address (DA), source address (SA), reserve bytes,
payload(PDU)、CRC。
As shown in the table, the data packet for accessing net mainly includes following sections：
| DA | SA | Reserved | Payload | CRC |
Wherein：
Destination address (DA) is made of 8 bytes (byte), and first character section indicates type (such as the various associations of data packet
Discuss packet, multicast packet, unicast packet etc.), be up to 256 kinds of possibility, the second byte to the 6th byte is metropolitan area net address,
Seven, the 8th bytes are access net address；
Source address (SA) is also to be made of 8 bytes (byte), is defined identical as destination address (DA)；
Reserve bytes are made of 2 bytes；
The part payload has different length according to the type of different datagrams, is if it is various protocol packages
64 bytes are 32+1024=1056 bytes if it is single group unicast packets words, are not restricted to above 2 kinds certainly；
CRC is made of 4 bytes, and calculation method follows the Ethernet CRC algorithm of standard.
2.2 Metropolitan Area Network (MAN) packet definitions
The topology of Metropolitan Area Network (MAN) is pattern, may there is 2 kinds, connection even of more than two kinds, i.e. node switching between two equipment
It can all can exceed that 2 kinds between machine and node server, node switch and node switch, node switch and node server
Connection.But the metropolitan area net address of metropolitan area network equipment is uniquely, to close to accurately describe the connection between metropolitan area network equipment
System, introduces parameter in embodiments of the present invention：Label uniquely to describe a metropolitan area network equipment.
(Multi-Protocol Label Switch, multiprotocol label are handed over by the definition of label and MPLS in this specification
Change) label definition it is similar, it is assumed that between equipment A and equipment B there are two connection, then data packet from equipment A to equipment B just
There are 2 labels, data packet also there are 2 labels from equipment B to equipment A.Label is divided into label, outgoing label, it is assumed that data packet enters
The label (entering label) of equipment A is 0x0000, and the label (outgoing label) when this data packet leaves equipment A may reform into
0x0001.The networking process of Metropolitan Area Network (MAN) is to enter network process under centralized control, also means that address distribution, the label of Metropolitan Area Network (MAN)
Distribution be all to be dominated by metropolitan area server, node switch, node server be all passively execute, this point with
The label distribution of MPLS is different, and the distribution of the label of MPLS is the result that interchanger, server are negotiated mutually.
As shown in the table, the data packet of Metropolitan Area Network (MAN) mainly includes following sections：
| DA | SA | Reserved | Label | Payload | CRC |
That is destination address (DA), source address (SA), reserve bytes (Reserved), label, payload (PDU), CRC.Its
In, the format of label, which can refer to, such as gives a definition：Label is 32bit, wherein high 16bit retains, only with low 16bit, its position
Set is between the reserve bytes and payload of data packet.
Based on the above-mentioned characteristic of view networking, one of the core concepts of the embodiments of the present invention is proposed, it then follows regard the association of networking
View, view networked server by multichannel source audio data, multichannel source video Data Synthesis all the way target audio data, all the way target view
Frequency evidence, to synthesize multimedia file.
Referring to Fig. 5, a kind of step flow chart of the mixed method of multimedia file of one embodiment of the invention is shown,
This method can be applied in view networking, can specifically include following steps：
Step 501, multichannel source audio data, the multichannel source video number that view networked terminals are sent are received depending on networked server
According to.
As shown in fig. 6, being deployed with view networked server 601 and view networked terminals 602 in depending on networking 600.
In the concrete realization, regarding networked terminals 602 can be set-top box (SetTopBox, STB), commonly referred to as set-top box
Or box on machine, it is the equipment of connection a television set and outside source, it can change into the digital signal of compression in TV
Hold, and shows on a television set.
In general, view networked terminals 602 connect at least one acquisition equipment 603, for example, acquisition equipment 603 can wrap
Camera, microphone are included, for acquiring video data, audio data.
In embodiments of the present invention, at least source audio data, at least source video all the way all the way can be sent depending on networked terminals
Data are to regarding networked server.
In one embodiment of the invention, step 501 may include following sub-step：
Sub-step S11 receives the multichannel data packet that view networked terminals are sent.
Sub-step S12 reads Data Identification from the head information of the data packet.
Sub-step S13 extracts audio piece when the Data Identification is preset audio identification from the data packet
Section, and it is accumulated as source audio data.
Sub-step S14 extracts piece of video from the data packet when the Data Identification is preset video identifier
Section, and it is accumulated as source video data.
In view networking, if the data packet that view networked terminals are sent, it then follows the agreement depending on networking is packaged.For example, logical
Cross the data packet of 2000 specification packaged source video datas of following view networking protocol：
By the data packet for regarding 2001 specification packaged source audio datas of networking protocol as follows：
It, can be according to the agreement of view networking, from data depending on networked server after the data packet for receiving view networked terminals
It reads specified field number (such as the 0th field number), obtains Data Identification (such as 2000,2001), to know in head information in packet
The data packet is the data packet of source video data or the data packet of source audio data, thus from field number (such as 15- of response
526 field numbers, 15-46 field number) extraction source video data, source audio data.
Certainly, the recognition methods of above-mentioned video data, audio data is intended only as example, is implementing the embodiment of the present invention
When, the recognition methods of other video datas, audio data can be set according to the actual situation, for example, for abbreviation transmission operation,
Field number in the head information of data packet indicates video data, audio data, etc. using 0,1, the embodiment of the present invention to this not
It limits.In addition, those skilled in the art can also be according to actual needs using other other than above-mentioned judgement processing method
The recognition methods of video data, audio data, the embodiment of the present invention are also without restriction to this.
In transmission process, usually a complete source video data, source audio data are cut into depending on networked terminals more
A source video segment, source audio segment, then be encapsulated into data packet and be transferred to view networked server.
It therefore, is usually video clip, audio fragment depending on the data that networked server is extracted from data packet, accumulation is extracted
Multiple video clips, multiple audio fragments obtain complete source video data, source audio data.
Step 502, depending on networked server by the target audio data all the way of source audio Data Synthesis described in multichannel.
In the concrete realization, corresponding Video Decoder can be called depending on networked server, by multichannel source audio data into
Row decoding process obtains multichannel source analogue data, such as PCM (Pulse-code modulation, i.e. pulse code modulation) number
According to.
Multichannel source analogue data is subjected to stereo process, obtains target simulation data all the way.
Corresponding video encoder is called, target simulation data coded treatment will be carried out all the way, and obtain target audio all the way
Data, such as AAC (Advanced Audio Coding, Advanced Audio Coding) data.
Step 503, depending on networked server by the target video data all the way of source video Data Synthesis described in multichannel.
In the concrete realization, corresponding audio decoder can be called depending on networked server, by multichannel source video data into
Row decoding process obtains multichannel source image data, as (a kind of colour coding method, Y indicate brightness to yuv data, and U and V are indicated
Coloration).
The multiframe source image data of same time (is spliced into a frame mesh by multichannel source image data progress splicing
Logo image data), obtain destination image data all the way.
Corresponding audio coder is called, destination image data coded treatment will be carried out all the way, and obtain target video all the way
Data, such as a kind of H.264 data (compression of digital video format).
Step 504, it the target audio data will be synthesized all the way with the target video data all the way depending on networked server
Multimedia file.
Depending on networked server by multichannel source audio Data Synthesis target audio data all the way, by multichannel source video Data Synthesis
All the way after target video data, target audio data are subjected to being aligned for time shaft with target video data, and then synthesize more
Media file.
In one embodiment of the invention, step 504 may include following sub-step：
Sub-step S21 calculates the audio Presentation Time Stamp of the target audio data all the way.
In the concrete realization, audio Presentation Time Stamp belong to Presentation Time Stamp (presentation time stamp,
PTS)。
By taking AAC as an example, in a kind of calculation method, AAC coding after data, be carried out according to FRAME storage output,
Decoding is also the decoding of mono- FRAME of a FRAME.
The initial data of AAC has several kinds of formats, common are ADTS (Low Overhead Audio Transport
Multiplex) and LOAS (Low Overhead Audio Stream), ADTS and LOAS include a data head and FRAME number
According to.It checks marking head in a stream first, is partitioned into data head+FRAME data.Then according to data head format, number is parsed
According to head, frame_length and sample_rate information is taken out.
According to frame_count (quantity of current FRAME) and frame_length, sample_rate, Ji Keji
Calculate the PTS of this frame AAC FRAME.
Sub-step S22 calculates the video Presentation Time Stamp of the target video data all the way.
In the concrete realization, video Presentation Time Stamp also belongs to Presentation Time Stamp PTS.
For H.264, in a kind of calculation method, according to the IPB type of before and after frames, learn that the actual displayed of frame is suitable
Sequence, the frame per second and frame count frame_count that use front obtains in sps information can calculate PTS.
In another calculation method, inside the information of each frame (slice), all record has pic_order_cnt_
Lsb, display order of the present frame in this group (group).By this pic_order_cnt_lsb, can directly calculate
The PTS of present frame out.
Sub-step S23 will according to the size relation between the audio Presentation Time Stamp and the video Presentation Time Stamp
The target audio data are written in multimedia file with the target video data all the way all the way.
In the concrete realization, if audio Presentation Time Stamp is smaller than video Presentation Time Stamp, suspend target video number
According in write-in multimedia file, preferentially target audio data are written in multimedia file；If video Presentation Time Stamp compares sound
Frequency Presentation Time Stamp is small, then target audio data are written in multimedia file for pause, preferentially target video data is written more
In media file.
In the embodiment of the present invention, multichannel source audio data, the multichannel source that view networked terminals are sent are received depending on networked server
Video data, respectively source audio Data Synthesis described in multichannel all the way target audio data, by multichannel source video Data Synthesis all the way
Target video data, when audio or video acquisition equipment is more, generates an audio-video text to synthesize multimedia file
Part greatly reduces the quantity of audio-video document, improves the simplicity of the management such as storage, transmission.
Referring to Fig. 7, the step process of the mixed method of another multimedia file of one embodiment of the invention is shown
Figure, this method can be applied in view networking, can specifically include following steps：
Step 701, multichannel source audio data, the multichannel source video number that view networked terminals are sent are received depending on networked server
According to.
Step 702, depending on networked server by the target audio data all the way of source audio Data Synthesis described in multichannel.
Step 703, depending on networked server by the target video data all the way of source video Data Synthesis described in multichannel.
Step 704, it the target audio data will be synthesized all the way with the target video data all the way depending on networked server
Multimedia file.
Step 705, depending on networked server by according to it is described view networking gateway configuration downstream communications link, will be described more
Media file is sent to the view networking gateway, to carry out the protocol conversion depending on being networked to IP network and be sent to the order program service
Device.
In embodiments of the present invention, depending on networking in be also deployed with view networking gateway, IP (Internet Protocol,
The agreement interconnected between network) it disposes in net and broadcasts server a little.
Multimedia file is sent to view networking gateway depending on networked server, it will be carried out depending on being networked to depending on networking gateway
The protocol conversion of IP network so that the vod server for being located at IP network is readable, and then is forwarded to the vod server.
After vod server receives the multimedia file, storage in the database, provides a user the multimedia file
Order program service.
In this practical application, networking is regarded as the network with centralized control functions, including main control server and undernet
Equipment, which includes terminal, and one of the core idea depending on networking is, by notifying to exchange by main control server
Equipment is directed to when time downstream communications link of service matches table, and the table for being then based on the configuration carries out the transmission of data packet.
That is, including depending on the communication means in networking：
Main control server configuration is when time downstream communications link of service；
Work as time data packet of service for what source terminal was sent, is sent to target terminal (such as according to the downstream communications link
Depending on networking gateway).
In embodiments of the present invention, it configures when time downstream communications link of service includes：Notice is logical when time downlink of service
Believe that switching equipment involved in link matches table；
Furthermore, include according to downstream communications link transmission：Configured table is inquired, switching equipment is received to institute
Data packet is transmitted by corresponding port.
In the concrete realization, service includes unicast communication service and Multicast Communication Service.I.e. either cast communication is still
Unicast communication can realize the communication in view networking using the above-mentioned core idea with table-table.
As previously mentioned, view networking net includes access mesh portions, in access net, which is node server,
Undernet equipment includes access switch and terminal.
For the unicast communication service in access net, the main control server configuration is when time downlink communication chain of service
The step of road, may comprise steps of：
Sub-step S31, the service request protocol package that main control server is initiated according to source terminal are obtained when time downlink of service
Communication link information, downstream communications link information include participating in when time downlink of the main control server of service and access switch
Communication port information.
Sub-step S32, downstream communication ports information of the main control server according to control server, data packet inside it
The downlink port that setting is oriented to when time data packet of service in the table of location；And believe according to the downstream communication ports of access switch
Breath, to corresponding access switch sending port configuration order.
Sub-step S33, access switch according in port configuration command data packet addressed table inside it, setting when time
The downlink port that the data packet of service is oriented to.
For the Multicast Communication Service in access net, main control server obtains the downstream communications link letter when time service
The step of breath may include following sub-step：
Sub-step S41, main control server obtain the service request agreement for the application Multicast Communication Service that target terminal is initiated
It wraps, includes the access net address of service type information, service content information and target terminal in service request protocol package；Wherein,
It include service number in service content information；
Sub-step S42, main control server according to the service number in preset content-address mapping table, extraction source
The access net address of terminal.
Sub-step S43, main control server obtains the corresponding multicast address of source terminal, and distributes to target terminal；And according to
According to the access net address of service type information, source terminal and target terminal, the communication link information when time multicast services is obtained.
It should be noted that for simple description, therefore, it is stated as a series of action groups for embodiment of the method
It closes, but those skilled in the art should understand that, embodiment of that present invention are not limited by the describe sequence of actions, because according to
According to the embodiment of the present invention, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art also should
Know, the embodiments described in the specification are all preferred embodiments, and the related movement not necessarily present invention is implemented
Necessary to example.
Referring to Fig. 8, a kind of structural block diagram of the mixing arrangement of multimedia file of one embodiment of the invention is shown,
Depending on being deployed with view networked server and multiple view networked terminals in networking, described device is located in view networked server, specifically may be used
To include following module：
Multi-medium data receiving module 801, for receiving multichannel source audio data, the multichannel source view that view networked terminals are sent
Frequency evidence；
Target audio Data Synthesis module 802, for by the target audio data all the way of source audio Data Synthesis described in multichannel；
Target video data synthesis module 803, for by the target video data all the way of source video Data Synthesis described in multichannel；
Multimedia file synthesis module 804, being used for will the target audio data and all the way the target video number all the way
According to synthesis multimedia file.
In one embodiment of the invention, it is also deployed with view networking gateway in depending on networking, is disposed a little in IP network
Server is broadcast, described device further includes：
Multimedia file sending module, for will lead to according to the downlink depending on networking gateway configuration depending on networked server
Believe link, the multimedia file is sent to the view networking gateway, it is concurrent depending on the protocol conversion that is networked to IP network to carry out
It send to the vod server.
In one embodiment of the invention, the multi-medium data receiving module 801 includes：
Data packet receiving submodule, the multichannel data packet sent for receiving view networked terminals；
Data Identification reading submodule, for reading Data Identification from the head information of the data packet；
Source audio data accumulate submodule, are used for when the Data Identification is preset audio identification, from the data
Audio fragment is extracted in packet, and is accumulated as source audio data；
Source video data accumulate submodule, are used for when the Data Identification is preset video identifier, from the data
Video clip is extracted in packet, and is accumulated as source video data.
In one embodiment of the invention, the target audio Data Synthesis module 802 includes：
Audio decoder submodule obtains multichannel source and simulates number for source audio data described in multichannel to be decoded processing
According to；
Stereo process submodule obtains target simulation all the way for source analogue data described in multichannel to be carried out stereo process
Data；
Audio coding submodule obtains target sound all the way for that the target simulation data will carry out coded treatment all the way
Frequency evidence.
In one embodiment of the invention, the target video data synthesis module 803 includes：
Video decoding sub-module obtains multichannel source images number for source video data described in multichannel to be decoded processing
According to；
Splicing submodule obtains target image all the way for source image data described in multichannel to be carried out splicing
Data；
Video coding submodule obtains target all the way and regards for that the destination image data will carry out coded treatment all the way
Frequency evidence.
In one embodiment of the invention, the multimedia file synthesis module 804 includes：
Audio Presentation Time Stamp computational submodule, the audio for calculating the target audio data all the way show the time
Stamp；
Video Presentation Time Stamp computational submodule, the video for calculating the target video data all the way show the time
Stamp；
Submodule is written in multimedia file, for according to the audio Presentation Time Stamp and the video Presentation Time Stamp it
Between size relation, will all the way the target audio data in the write-in multimedia file of the target video data all the way.
For device embodiment, since it is basically similar to the method embodiment, related so being described relatively simple
Place illustrates referring to the part of embodiment of the method.
All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are with
The difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.
It should be understood by those skilled in the art that, the embodiment of the embodiment of the present invention can provide as method, apparatus or calculate
Machine program product.Therefore, the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine software and
The form of the embodiment of hardware aspect.Moreover, the embodiment of the present invention can be used one or more wherein include computer can
With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code
The form of the computer program product of implementation.
The embodiment of the present invention be referring to according to the method for the embodiment of the present invention, terminal device (system) and computer program
The flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructions
In each flow and/or block and flowchart and/or the block diagram in process and/or box combination.It can provide these
Computer program instructions are set to general purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminals
Standby processor is to generate a machine, so that being held by the processor of computer or other programmable data processing terminal devices
Capable instruction generates for realizing in one or more flows of the flowchart and/or one or more blocks of the block diagram
The device of specified function.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing terminal devices
In computer-readable memory operate in a specific manner, so that instruction stored in the computer readable memory generates packet
The manufacture of command device is included, which realizes in one side of one or more flows of the flowchart and/or block diagram
The function of being specified in frame or multiple boxes.
These computer program instructions can also be loaded into computer or other programmable data processing terminal devices, so that
Series of operation steps are executed on computer or other programmable terminal equipments to generate computer implemented processing, thus
The instruction executed on computer or other programmable terminal equipments is provided for realizing in one or more flows of the flowchart
And/or in one or more blocks of the block diagram specify function the step of.
Although the preferred embodiment of the embodiment of the present invention has been described, once a person skilled in the art knows bases
This creative concept, then additional changes and modifications can be made to these embodiments.So the following claims are intended to be interpreted as
Including preferred embodiment and fall into all change and modification of range of embodiment of the invention.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning
Covering non-exclusive inclusion, so that process, method, article or terminal device including a series of elements not only wrap
Those elements are included, but also including other elements that are not explicitly listed, or further includes for this process, method, article
Or the element that terminal device is intrinsic.In the absence of more restrictions, being wanted by what sentence "including a ..." limited
Element, it is not excluded that there is also other identical elements in process, method, article or the terminal device for including the element.
The mixing of the mixed method to a kind of multimedia file provided by the present invention and a kind of multimedia file fills above
It sets, is described in detail, used herein a specific example illustrates the principle and implementation of the invention, above
The explanation of embodiment is merely used to help understand method and its core concept of the invention；Meanwhile for the general skill of this field
Art personnel, according to the thought of the present invention, there will be changes in the specific implementation manner and application range, in conclusion this
Description should not be construed as limiting the invention.
Claims (10)
1. a kind of mixed method of multimedia file, which is characterized in that depending on networking in be deployed with view networked server with it is multiple
Depending on networked terminals, the method includes：
Multichannel source audio data, the multichannel source video data that view networked terminals are sent are received depending on networked server；
Depending on networked server by the target audio data all the way of source audio Data Synthesis described in multichannel；
Depending on networked server by the target video data all the way of source video Data Synthesis described in multichannel；
The target audio data with the target video data all the way multimedia file will be synthesized all the way depending on networked server.
2. the method according to claim 1, wherein view networking gateway is also deployed in depending on networking, in IP network
Server is broadcast a little in middle deployment, the method also includes：
Depending on networked server by according to the downstream communications link to the view networking gateway configuration, the multimedia file is sent
To the view networking gateway, to carry out the protocol conversion depending on being networked to IP network and be sent to the vod server.
3. method according to claim 1 or 2, which is characterized in that the view networked server receives view networked terminals hair
Multichannel source audio data, the multichannel source video data sent, including：
Receive the multichannel data packet that view networked terminals are sent；
Data Identification is read from the head information of the data packet；
When the Data Identification is preset audio identification, audio fragment is extracted from the data packet, and be accumulated as source sound
Frequency evidence；
When the Data Identification is preset video identifier, video clip is extracted from the data packet, and is accumulated as source view
Frequency evidence.
4. method according to claim 1 or 2, which is characterized in that the view networked server is by source audio described in multichannel
Data Synthesis target audio data all the way, including：
Source audio data described in multichannel are decoded processing, obtain multichannel source analogue data；
Source analogue data described in multichannel is subjected to stereo process, obtains target simulation data all the way；
The target simulation data coded treatment will be carried out all the way, and obtain target audio data all the way.
5. method according to claim 1 or 2, which is characterized in that the view networked server is by source video described in multichannel
Data Synthesis target video data all the way, including：
Source video data described in multichannel are decoded processing, obtain multichannel source image data；
Source image data described in multichannel is subjected to splicing, obtains destination image data all the way；
The destination image data coded treatment will be carried out all the way, and obtain target video data all the way.
6. method according to claim 1 or 2, which is characterized in that it is described will the target sound all the way depending on networked server
Frequency evidence synthesizes multimedia file with the target video data all the way, including：
Calculate the audio Presentation Time Stamp of the target audio data all the way；
Calculate the video Presentation Time Stamp of the target video data all the way；
It, will the target sound all the way according to the size relation between the audio Presentation Time Stamp and the video Presentation Time Stamp
Frequency is written in multimedia file according to the target video data all the way.
7. a kind of mixing arrangement of multimedia file, which is characterized in that depending on networking in be deployed with view networked server with it is multiple
Depending on networked terminals, described device is located in view networked server, including：
Multi-medium data receiving module, multichannel source audio data, the multichannel source video data sent for receiving view networked terminals；
Target audio Data Synthesis module, for by the target audio data all the way of source audio Data Synthesis described in multichannel；
Target video data synthesis module, for by the target video data all the way of source video Data Synthesis described in multichannel；
Multimedia file synthesis module, for will all the way the target audio data synthesized with the target video data all the way it is more
Media file.
8. device according to claim 7, which is characterized in that view networking gateway is also deployed in depending on networking, in IP network
Server is broadcast a little in middle deployment, and described device further includes：
Multimedia file sending module, will be according to the downlink communication chain to the view networking gateway configuration for regarding networked server
The multimedia file is sent to the view networking gateway by road, to carry out the protocol conversion depending on being networked to IP network and be sent to
The vod server.
9. device according to claim 7 or 8, which is characterized in that the multi-medium data receiving module includes：
Data packet receiving submodule, the multichannel data packet sent for receiving view networked terminals；
Data Identification reading submodule, for reading Data Identification from the head information of the data packet；
Source audio data accumulate submodule, are used for when the Data Identification is preset audio identification, from the data packet
Audio fragment is extracted, and is accumulated as source audio data；
Source video data accumulate submodule, are used for when the Data Identification is preset video identifier, from the data packet
Video clip is extracted, and is accumulated as source video data.
10. device according to claim 7 or 8, which is characterized in that the target audio Data Synthesis module includes：
Audio decoder submodule obtains multichannel source analogue data for source audio data described in multichannel to be decoded processing；
Stereo process submodule obtains target simulation data all the way for source analogue data described in multichannel to be carried out stereo process；
Audio coding submodule obtains target sound frequency all the way for that the target simulation data will carry out coded treatment all the way
According to.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711066237.XA CN108881957A (en) | 2017-11-02 | 2017-11-02 | A kind of mixed method and device of multimedia file |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711066237.XA CN108881957A (en) | 2017-11-02 | 2017-11-02 | A kind of mixed method and device of multimedia file |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108881957A true CN108881957A (en) | 2018-11-23 |
Family
ID=64325782
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711066237.XA Pending CN108881957A (en) | 2017-11-02 | 2017-11-02 | A kind of mixed method and device of multimedia file |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108881957A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109640056A (en) * | 2018-12-27 | 2019-04-16 | 深圳市有方科技股份有限公司 | A kind of USB camera monitoring system and its method based on Android platform |
| CN109640111A (en) * | 2019-01-29 | 2019-04-16 | 视联动力信息技术股份有限公司 | A kind of picture transmission method and device |
| CN110290143A (en) * | 2019-07-01 | 2019-09-27 | 新华智云科技有限公司 | Video online editing method, apparatus, electronic equipment and storage medium |
| CN111083396A (en) * | 2019-12-26 | 2020-04-28 | 北京奇艺世纪科技有限公司 | Video synthesis method and device, electronic equipment and computer-readable storage medium |
| CN111182258A (en) * | 2020-02-11 | 2020-05-19 | 视联动力信息技术股份有限公司 | Data transmission method and device for network conference |
| WO2020134791A1 (en) * | 2018-12-27 | 2020-07-02 | 广州华多网络科技有限公司 | Method and apparatus for mixing streaming media data, storage medium, and computer device |
| CN112866725A (en) * | 2021-01-14 | 2021-05-28 | 视联动力信息技术股份有限公司 | Live broadcast control method and device |
| CN116614490A (en) * | 2023-04-28 | 2023-08-18 | 广州市良策网络技术有限公司 | Cross-device data transmission method, device and computer readable storage medium |
| WO2023231585A1 (en) * | 2022-05-30 | 2023-12-07 | 荣耀终端有限公司 | Video capturing method and apparatus, device, and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150253974A1 (en) * | 2014-03-07 | 2015-09-10 | Sony Corporation | Control of large screen display using wireless portable computer interfacing with display controller |
| CN106161814A (en) * | 2015-03-24 | 2016-11-23 | 北京视联动力国际信息技术有限公司 | The sound mixing method of a kind of Multi-Party Conference and device |
| CN106162040A (en) * | 2015-03-30 | 2016-11-23 | 北京视联动力国际信息技术有限公司 | The method and apparatus that video conference accesses in many ways |
| CN106210764A (en) * | 2015-04-29 | 2016-12-07 | 北京视联动力国际信息技术有限公司 | The conjunction screen processing method of a kind of multichannel media stream and system |
| CN106550282A (en) * | 2015-09-17 | 2017-03-29 | 北京视联动力国际信息技术有限公司 | A kind of player method and system of video data |
| CN106782576A (en) * | 2017-02-15 | 2017-05-31 | 合网络技术（北京）有限公司 | audio mixing method and device |
| CN106791919A (en) * | 2016-12-05 | 2017-05-31 | 乐视控股（北京）有限公司 | Method for processing multimedia information, device and electronic equipment |
-
2017
- 2017-11-02 CN CN201711066237.XA patent/CN108881957A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150253974A1 (en) * | 2014-03-07 | 2015-09-10 | Sony Corporation | Control of large screen display using wireless portable computer interfacing with display controller |
| CN106161814A (en) * | 2015-03-24 | 2016-11-23 | 北京视联动力国际信息技术有限公司 | The sound mixing method of a kind of Multi-Party Conference and device |
| CN106162040A (en) * | 2015-03-30 | 2016-11-23 | 北京视联动力国际信息技术有限公司 | The method and apparatus that video conference accesses in many ways |
| CN106210764A (en) * | 2015-04-29 | 2016-12-07 | 北京视联动力国际信息技术有限公司 | The conjunction screen processing method of a kind of multichannel media stream and system |
| CN106550282A (en) * | 2015-09-17 | 2017-03-29 | 北京视联动力国际信息技术有限公司 | A kind of player method and system of video data |
| CN106791919A (en) * | 2016-12-05 | 2017-05-31 | 乐视控股（北京）有限公司 | Method for processing multimedia information, device and electronic equipment |
| CN106782576A (en) * | 2017-02-15 | 2017-05-31 | 合网络技术（北京）有限公司 | audio mixing method and device |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109640056A (en) * | 2018-12-27 | 2019-04-16 | 深圳市有方科技股份有限公司 | A kind of USB camera monitoring system and its method based on Android platform |
| WO2020134791A1 (en) * | 2018-12-27 | 2020-07-02 | 广州华多网络科技有限公司 | Method and apparatus for mixing streaming media data, storage medium, and computer device |
| CN109640111B (en) * | 2019-01-29 | 2021-02-02 | 视联动力信息技术股份有限公司 | Picture transmission method and device and readable medium |
| CN109640111A (en) * | 2019-01-29 | 2019-04-16 | 视联动力信息技术股份有限公司 | A kind of picture transmission method and device |
| CN110290143A (en) * | 2019-07-01 | 2019-09-27 | 新华智云科技有限公司 | Video online editing method, apparatus, electronic equipment and storage medium |
| CN110290143B (en) * | 2019-07-01 | 2021-12-03 | 新华智云科技有限公司 | Video online editing method and device, electronic equipment and storage medium |
| CN111083396A (en) * | 2019-12-26 | 2020-04-28 | 北京奇艺世纪科技有限公司 | Video synthesis method and device, electronic equipment and computer-readable storage medium |
| CN111182258A (en) * | 2020-02-11 | 2020-05-19 | 视联动力信息技术股份有限公司 | Data transmission method and device for network conference |
| CN111182258B (en) * | 2020-02-11 | 2022-12-23 | 视联动力信息技术股份有限公司 | Data transmission method and device for network conference |
| CN112866725A (en) * | 2021-01-14 | 2021-05-28 | 视联动力信息技术股份有限公司 | Live broadcast control method and device |
| WO2023231585A1 (en) * | 2022-05-30 | 2023-12-07 | 荣耀终端有限公司 | Video capturing method and apparatus, device, and storage medium |
| CN116614490A (en) * | 2023-04-28 | 2023-08-18 | 广州市良策网络技术有限公司 | Cross-device data transmission method, device and computer readable storage medium |
| CN116614490B (en) * | 2023-04-28 | 2023-12-26 | 广州市良策网络技术有限公司 | Cross-device data transmission method, device and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106549912B (en) | A kind of playback method and system of video data | |
| CN106550282B (en) | A kind of playback method and system of video data | |
| CN108881957A (en) | A kind of mixed method and device of multimedia file | |
| CN107979563B (en) | A kind of information processing method and device based on view networking | |
| CN108243173B (en) | A kind of RTMP video pushing method and device based on view networking | |
| CN108881927A (en) | A kind of video data synthetic method and device | |
| CN108243153A (en) | A kind of method and apparatus in the broadcasting TV programme in networking | |
| CN108063745B (en) | A kind of video call method and its system based on Android device | |
| CN109788232A (en) | A kind of summary of meeting recording method of video conference, device and system | |
| CN108965224A (en) | A kind of method and apparatus of video on demand | |
| CN108877820A (en) | A kind of audio data mixed method and device | |
| CN109302576A (en) | Meeting treating method and apparatus | |
| CN108881135A (en) | It is a kind of based on view networking information transferring method, device and system | |
| CN108307212B (en) | A kind of file order method and device | |
| CN109068089A (en) | A kind of conferencing data generation method and device | |
| CN108616487A (en) | Based on the sound mixing method and device regarding networking | |
| CN108632559A (en) | A kind of video data handling procedure and device | |
| CN110505204A (en) | A kind of immediate voice communication method, device, electronic equipment and readable storage medium storing program for executing | |
| CN109547731A (en) | A kind of methods of exhibiting and system of video conference | |
| CN110049346A (en) | A kind of method and system of net cast | |
| CN110072126A (en) | Data request method, association turn server and computer readable storage medium | |
| CN108881818A (en) | A kind of transmission method and device of video data | |
| CN108881819A (en) | A kind of transmission method and device of audio data | |
| CN109151610A (en) | A kind for the treatment of method and apparatus receiving web camera picture | |
| CN108630215A (en) | A kind of echo suppressing method and device based on regarding networking |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181123 |