CN110149305A - A kind of method and transfer server of the multi-party playing audio-video based on view networking - Google Patents
A kind of method and transfer server of the multi-party playing audio-video based on view networking Download PDFInfo
- Publication number
- CN110149305A CN110149305A CN201910257607.0A CN201910257607A CN110149305A CN 110149305 A CN110149305 A CN 110149305A CN 201910257607 A CN201910257607 A CN 201910257607A CN 110149305 A CN110149305 A CN 110149305A
- Authority
- CN
- China
- Prior art keywords
- video
- audio
- target
- server
- address
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/10—Architectures or entities
- H04L65/1063—Application servers providing network services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/765—Media network packet handling intermediate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Telephonic Communication Services (AREA)
Abstract
The embodiment of the present application provides the method and transfer server of a kind of multi-party playing audio-video based on view networking.The described method includes: transfer server receives audio-video call instruction；Original audio-video is transferred according to the audio-video call instruction；The original audio-video being deployed into is parsed, target audio-video and target audio are obtained；The target audio-video is respectively sent to the audio-video address of the view networked terminals and the video address of the conference dispatching terminal, and the target audio is sent to the audio address of the conference dispatching terminal, with described depending on being played simultaneously on networked terminals and the conference dispatching terminal.Solve while being broadcast live using conference dispatching system and depending on networked terminals/recorded broadcast video-see when, the problem of conference dispatching system side can not hear sound.
Description
Technical field
This application involves view networking technology fields, more particularly to a kind of side of multi-party playing audio-video based on view networking
Method and transfer server.
Background technique
Life, work with the fast development of view networking, based on video conference, video teaching for regarding networking etc. in user
Make, learn etc. is widely available.In practical applications, it often will appear a main meeting-place, multiple sub-venues while carrying out video
The case where meeting or a main subject hall, multiple points of classrooms carry out video teaching simultaneously.
The main conference dispatching system in networking is regarded as PAMIR conference dispatching system, applies conference dispatching system at the same time
Be broadcast live depending on networked terminals/recorded broadcast video-see when, can not hear sound in PAMIR conference dispatching system side.
Summary of the invention
In view of the above problems, it proposes the embodiment of the present application and overcomes the above problem or at least partly in order to provide one kind
The method of the multi-party playing audio-video based on view networking to solve the above problems and corresponding transfer server.
In a first aspect, the embodiment of the present application discloses a kind of method of multi-party playing audio-video based on view networking, it is described
Method includes:
Transfer server receives audio-video call instruction, and carrying in the audio-video call instruction includes conference dispatching terminal
Video address and audio address, and view networked terminals audio-video address；
The transfer server transfers original audio-video according to the audio-video call instruction；
The transfer server parses the original audio-video being deployed into, and obtains target audio-video and target audio；
The transfer server by the target audio-video be respectively sent to it is described view networked terminals audio-video address with
And the video address of the conference dispatching terminal, and with being sent to the audio of the conference dispatching terminal by the target audio
Location, with described depending on being played simultaneously on networked terminals and the conference dispatching terminal.
Optionally, the transfer server includes that association turns server and view networked server；
The audio-video call instruction is to regard networking clothes by the conference dispatching terminal and described be sent to depending on networked terminals
Be engaged in device, and by it is described view networked server be forwarded to it is described assist turn server；
The target audio-video is to turn server by the association to transfer, and will be sent to institute after target audio-video parsing
State view networked server.
Optionally, the transfer server parses the original audio-video being deployed into, and obtains target audio-video and mesh
Mark with phonetic symbols frequency, comprising:
The transfer server goes out target audio and target video from the target sound video extraction；
The target video is subjected to transcoding processing, obtains the target video of different code rates；
The target video of the different code rates is synthesized with the target audio respectively, obtains the target of different code rates
Audio-video.
Optionally, the target sound Video type information of the conference dispatching terminal is also carried in the audio-video call instruction
With the target sound Video type information of the view networked terminals；
The target video by the different code rates is synthesized with the target audio respectively, obtains different code rates
Target audio-video, comprising:
The transfer server is by the target of code rate corresponding to the target sound Video type information of the conference dispatching terminal
Video and target audio are synthesized to obtain the target audio-video of the conference dispatching terminal, by the target of the view networked terminals
The target video and target audio of code rate corresponding to audio-video type information are synthesized to obtain the target of the view networked terminals
Audio-video；
The transfer server by the target audio-video be respectively sent to it is described view networked terminals audio-video address with
And the video address of the conference dispatching terminal, comprising:
The transfer server regards the sound that the target audio-video depending on networked terminals is sent to the view networked terminals
The target audio-video of the conference dispatching terminal is sent to the video address of the conference dispatching terminal by frequency address.
Second aspect, the embodiment of the present application disclose a kind of transfer server, comprising: command reception module is used for transfer
Server receives audio-video call instruction, carry in the audio-video call instruction include conference dispatching terminal video address and
Audio address, and the audio-video address of view networked terminals；
Module is transferred, original audio-video is transferred according to the audio-video call instruction for the transfer server；
Parsing module parses the original audio-video being deployed into for the transfer server, obtains target sound view
Frequency and target audio；
The target audio-video is respectively sent to the view networked terminals for the transfer server by sending module
The video address of audio-video address and the conference dispatching terminal, and the target audio is sent to the conference dispatching end
The audio address at end, with described depending on being played simultaneously on networked terminals and the conference dispatching terminal.
Optionally, the transfer server includes that association turns server and view networked server；
The audio-video call instruction is to regard networking clothes by the conference dispatching terminal and described be sent to depending on networked terminals
Be engaged in device, and by it is described view networked server be forwarded to it is described assist turn server；
The target audio-video is to turn server by the association to transfer, and will be sent to institute after target audio-video parsing
State view networked server.
Optionally, the parsing module is specifically used for:
The transfer server goes out target audio and target video from the target sound video extraction；
The target video is subjected to transcoding processing, obtains the target video of different code rates；
The target video of the different code rates is synthesized with the target audio respectively, obtains the target of different code rates
Audio-video.
Optionally, the target sound Video type information of the conference dispatching terminal is also carried in the audio-video call instruction
With the target sound Video type information of the view networked terminals；
The target video by the different code rates is synthesized with the target audio respectively, obtains different code rates
Target audio-video, comprising:
The transfer server is by the target of code rate corresponding to the target sound Video type information of the conference dispatching terminal
Video and target audio are synthesized to obtain the target audio-video of the conference dispatching terminal, by the target of the view networked terminals
The target video and target audio of code rate corresponding to audio-video type information are synthesized to obtain the target of the view networked terminals
Audio-video；
The transfer server by the target audio-video be respectively sent to it is described view networked terminals audio-video address with
And the video address of the conference dispatching terminal, comprising:
The transfer server regards the sound that the target audio-video depending on networked terminals is sent to the view networked terminals
The target audio-video of the conference dispatching terminal is sent to the video address of the conference dispatching terminal by frequency address.
The third aspect, the embodiment of the present application also disclose a kind of computer equipment, including memory, processor and are stored in
On memory and the computer program that can run on a processor, the processor are realized above-mentioned when executing the computer program
Any the method for first aspect.
Fourth aspect, the embodiment of the present application also disclose a kind of computer readable storage medium, described computer-readable to deposit
Storage media is stored with the computer program for executing above-mentioned any the method for first aspect.
The method of multi-party playing audio-video provided by the embodiments of the present application based on view networking, firstly, transfer server connects
Radio reception video call instruction, carry in the audio-video call instruction include conference dispatching terminal video address and audio
Location, and the audio-video address of view networked terminals；The transfer server transfers original sound according to the audio-video call instruction
Video；Further, the transfer server parses the original audio-video being deployed into, and obtains target audio-video and target sound
Frequently；Finally, the transfer server by the target audio-video be respectively sent to it is described view networked terminals audio-video address with
And the video address of the conference dispatching terminal, and with being sent to the audio of the conference dispatching terminal by the target audio
Location, with described depending on being played simultaneously on networked terminals and the conference dispatching terminal.It solves while using conference dispatching system
Be broadcast live depending on networked terminals/recorded broadcast video-see when, the problem of conference dispatching system side can not hear sound.
Detailed description of the invention
Fig. 1 is a kind of networking schematic diagram of view networking provided by the embodiments of the present application；
Fig. 2 is a kind of hardware structural diagram of node server provided by the embodiments of the present application；
Fig. 3 is a kind of hardware structural diagram of access switch provided by the embodiments of the present application；
Fig. 4 is the hardware structural diagram that a kind of Ethernet association provided by the embodiments of the present application turns gateway；
Fig. 5 is the step flow chart of the method for the multi-party playing audio-video provided by the embodiments of the present application based on view networking；
Fig. 6 is one exemplary diagram of embodiment of the method provided by the embodiments of the present application；
Fig. 7 is the structural block diagram of transfer server provided by the embodiments of the present application.
Specific embodiment
In order to make the above objects, features, and advantages of the present application more apparent, with reference to the accompanying drawing and it is specific real
Applying mode, the present application will be further described in detail.
It is the important milestone of network Development depending on networking, is a real-time network, can be realized HD video real-time Transmission,
Push numerous Internet applications to HD video, high definition is face-to-face.
Real-time high-definition video switching technology is used depending on networking, it can be such as high in a network platform by required service
Clear video conference, Intellectualized monitoring analysis, emergency command, digital broadcast television, delay TV, the Web-based instruction, shows video monitoring
Field live streaming, VOD program request, TV Mail, individual character records (PVR), Intranet (manages) channel by oneself, intelligent video Broadcast Control, information publication
All be incorporated into a system platform etc. services such as tens of kinds of videos, voice, picture, text, communication, data, by TV or
Computer realizes that high-definition quality video plays.
To make those skilled in the art more fully understand the embodiment of the present application, it is introduced below to depending on networking:
Depending on networking, applied portion of techniques is as described below:
Network technology (Network Technology)
Traditional ethernet (Ethernet) is improved depending on the network technology innovation networked, with potential huge on network
Video flow.(Circuit is exchanged different from simple network packet exchange (Packet Switching) or lattice network
Switching), meet Streaming using network packet exchange depending on networking technology (to be translated into stream, stream, streaming, be one
Kind data transferring technique, becomes the data received the stream of one steady and continuous, continuously sends out, the sound for hearing user
Sound or the image seen are very steady, and user can start to carry out on the screen before entire data transmission is complete it is clear
Look at) demand.Have flexible, the simple and low price of packet switch depending on networking technology, is provided simultaneously with the quality and safety of circuit switching
Guarantee, realizes the seamless connection of the whole network switched virtual circuit and data format.
Switching technology (Switching Technology)
Two advantages of asynchronous and packet switch that Ethernet is used depending on networking eliminate Ethernet under the premise of complete compatible and lack
It falls into, has the end-to-end seamless connection of the whole network, direct user terminal, directly carrying IP data packet.User data is in network-wide basis
It is not required to any format conversion.It is the more advanced form of Ethernet depending on networking, is a real-time exchange platform, can be realized at present mutually
The whole network large-scale high-definition realtime video transmission that networking cannot achieve pushes numerous network video applications to high Qinghua, unitizes.
Server technology (Server Technology)
It is different from traditional server, its Streaming Media depending on the server technology in networking and unified video platform
Transmission be built upon it is connection-oriented on the basis of, data-handling capacity is unrelated with flow, communication time, single network layer energy
Enough transmitted comprising signaling and data.For voice and video business, handled depending on networking and unified video platform Streaming Media
Complexity many simpler than data processing, efficiency substantially increase hundred times or more than traditional server.
Reservoir technology (Storage Technology)
The ultrahigh speed reservoir technology of unified video platform in order to adapt to the media content of vast capacity and super-flow and
Using state-of-the-art real time operating system, the programme information in server instruction is mapped to specific hard drive space, media
Content is no longer pass through server, and moment is directly delivered to user terminal, and user waits typical time less than 0.2 second.It optimizes
Sector distribution greatly reduces the mechanical movement of hard disc magnetic head tracking, and resource consumption only accounts for the 20% of the internet ad eundem IP, but
The concurrent flow greater than 3 times of traditional disk array is generated, overall efficiency promotes 10 times or more.
Network security technology (Network Security Technology)
Depending on the structural design networked by servicing independent licence system, equipment and the modes such as user data is completely isolated every time
The network security problem that puzzlement internet has thoroughly been eradicated from structure, does not need antivirus applet, firewall generally, has prevented black
The attack of visitor and virus, structural carefree secure network is provided for user.
It services innovative technology (Service Innovation Technology)
Business and transmission are fused together by unified video platform, whether single user, private user or a net
The sum total of network is all only primary automatic connection.User terminal, set-top box or PC are attached directly to unified video platform, obtain rich
The multimedia video service of rich colorful various forms.Unified video platform is traditional to substitute with table schema using " menu type "
Complicated applications programming, considerably less code, which can be used, can be realized complicated application, realize the new business innovation of " endless ".
Networking depending on networking is as described below:
It is a kind of central controlled network structure depending on networking, which can be Tree Network, Star network, ring network etc. class
Type, but centralized control node is needed to control whole network in network on this basis.
As shown in Figure 1, being divided into access net and Metropolitan Area Network (MAN) two parts depending on networking.
The equipment of access mesh portions can be mainly divided into 3 classes: node server, access switch, terminal (including various machines
Top box, encoding board, memory etc.).Node server is connected with access switch, and access switch can be with multiple terminal phases
Even, and it can connect Ethernet.
Wherein, node server is the node that centralized control functions are played in access net, can control access switch and terminal.
Node server can directly be connected with access switch, can also directly be connected with terminal.
Similar, the equipment of metropolitan area mesh portions can also be divided into 3 classes: metropolitan area server, node switch, node serve
Device.Metropolitan area server is connected with node switch, and node switch can be connected with multiple node servers.
Wherein, node server is the node server for accessing mesh portions, i.e. node server had both belonged to access wet end
Point, and belong to metropolitan area mesh portions.
Metropolitan area server is the node that centralized control functions are played in Metropolitan Area Network (MAN), can control node switch and node serve
Device.Metropolitan area server can be directly connected to node switch, can also be directly connected to node server.
It can be seen that be entirely a kind of central controlled network structure of layering depending on networking network, and node server and metropolitan area
The network controlled under server can be the various structures such as tree-shaped, star-like, cyclic annular.
Visually claim, access mesh portions can form unified video platform (part in circle), and multiple unified video platforms can
To form view networking；Each unified video platform can be interconnected by metropolitan area and wide area depending on networking.
Classify depending on networked devices
1.1 the embodiment of the present application can be mainly divided into 3 classes: server depending on the equipment in networking, interchanger (including ether
Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).Depending on networking can be divided on the whole Metropolitan Area Network (MAN) (or
National net, World Wide Web etc.) and access net.
1.2 equipment for wherein accessing mesh portions can be mainly divided into 3 classes: node server, access switch (including ether
Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).
The specific hardware structure of each access network equipment are as follows:
Node server:
As shown in Fig. 2, mainly including Network Interface Module 201, switching engine module 202, CPU module 203, disk array
Module 204.
Wherein, Network Interface Module 201, the Bao Jun that CPU module 203, disk array module 204 are come in enter switching engine
Module 202；Switching engine module 202 look into the operation of address table 205 to the packet come in, to obtain the navigation information of packet；
And the packet is stored according to the navigation information of packet the queue of corresponding pack buffer 206；If the queue of pack buffer 206 is close
It is full, then it abandons；All pack buffer queues of 202 poll of switching engine mould, are forwarded: 1) port if meeting the following conditions
It is less than to send caching；2) the queue package counting facility is greater than zero.Disk array module 204 mainly realizes the control to hard disk, including
The operation such as initialization, read-write to hard disk；CPU module 203 is mainly responsible between access switch, terminal (not shown)
Protocol processes, to address table 205 (including descending protocol packet address table, uplink protocol package address table, data packet addressed table)
Configuration, and, the configuration to disk array module 204.
Access switch:
As shown in figure 3, mainly including Network Interface Module (downstream network interface module 301, uplink network interface module
302), switching engine module 303 and CPU module 304.
Wherein, the packet (upstream data) that downstream network interface module 301 is come in enters packet detection module 305；Packet detection mould
Whether destination address (DA), source address (SA), type of data packet and the packet length of the detection packet of block 305 meet the requirements, if met,
It then distributes corresponding flow identifier (stream-id), and enters switching engine module 303, otherwise abandon；Uplink network interface mould
The packet (downlink data) that block 302 is come in enters switching engine module 303；The data packet that CPU module 304 is come in enters switching engine
Module 303；Switching engine module 303 look into the operation of address table 306 to the packet come in, to obtain the navigation information of packet；
If the packet into switching engine module 303 is that downstream network interface is gone toward uplink network interface, in conjunction with flow identifier
(stream-id) packet is stored in the queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full,
It abandons；If the packet into switching engine module 303 is not that downstream network interface is gone toward uplink network interface, according to packet
Navigation information is stored in the data packet queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full,
Then abandon.
All pack buffer queues of 303 poll of switching engine module, are divided to two kinds of situations in the embodiment of the present application:
If the queue is that downstream network interface is gone toward uplink network interface, meets the following conditions and be forwarded: 1)
It is less than that the port sends caching；2) the queue package counting facility is greater than zero；3) token that rate control module generates is obtained.
If the queue is not that downstream network interface is gone toward uplink network interface, meets the following conditions and is forwarded:
1) it is less than to send caching for the port；2) the queue package counting facility is greater than zero.
Rate control module 208 is configured by CPU module 304, to all downlink networks in programmable interval
Interface generates token toward the pack buffer queue that uplink network interface is gone, to control the code rate of forwarded upstream.
CPU module 304 is mainly responsible for the protocol processes between node server, the configuration to address table 306, and,
Configuration to rate control module 308.
Ethernet association turns gateway:
As shown in figure 4, mainly including Network Interface Module (downstream network interface module 401, uplink network interface module
402), switching engine module 403, CPU module 404, packet detection module 405, rate control module 408, address table 406, Bao Huan
Storage 407 and MAC adding module 409, MAC removing module 410.
Wherein, the data packet that downstream network interface module 401 is come in enters packet detection module 405；Packet detection module 405 is examined
Ethernet mac DA, ethernet mac SA, Ethernet length or frame type, the view networking destination address of measured data packet
DA, whether meet the requirements depending on networking source address SA, depending on networking data Packet type and packet length, corresponding stream is distributed if meeting
Identifier (stream-id)；Then, MAC DA, MAC SA, length or frame type are subtracted by MAC removing module 410
(2byte), and enter corresponding receive and cache, otherwise abandon；
Downstream network interface module 401 detects the transmission caching of the port, if there is Bao Ze is according to the view of packet networking purpose
Address D A knows the ethernet mac DA of corresponding terminal, adds the ethernet mac DA of terminal, Ethernet assists the MAC for turning gateway
SA, Ethernet length or frame type, and send.
The function that Ethernet association turns other modules in gateway is similar with access switch.
Terminal:
It mainly include Network Interface Module, Service Processing Module and CPU module；For example, set-top box mainly connects including network
Mouth mold block, video/audio encoding and decoding engine modules, CPU module；Encoding board mainly includes Network Interface Module, video encoding engine
Module, CPU module；Memory mainly includes Network Interface Module, CPU module and disk array module.
The equipment of 1.3 metropolitan area mesh portions can be mainly divided into 3 classes: node server, node switch, metropolitan area server.
Wherein, node switch mainly includes Network Interface Module, switching engine module and CPU module；Metropolitan area server mainly includes
Network Interface Module, switching engine module and CPU module are constituted.
2, networking data package definition is regarded
2.1 access network data package definitions
Access net data packet mainly include following sections: destination address (DA), source address (SA), reserve bytes,
payload(PDU)、CRC。
As shown in the table, the data packet for accessing net mainly includes following sections:
| DA | SA | Reserved | Payload | CRC |
Destination address (DA) is made of 8 bytes (byte), and first character section indicates type (such as the various associations of data packet
Discuss packet, multicast packet, unicast packet etc.), be up to 256 kinds of possibility, the second byte to the 6th byte is metropolitan area net address,
Seven, the 8th bytes are access net address.
Source address (SA) is also to be made of 8 bytes (byte), is defined identical as destination address (DA).
Reserve bytes are made of 2 bytes.
The part payload has different length according to the type of different datagrams, if the type of datagram is various
Protocol package, then the length of the part payload is 64 bytes, if the type of datagram is single group unicast packets, payload
Partial length is 32+1024=1056 byte, is not restricted to above 2 kinds certainly.
CRC is made of 4 bytes, and calculation method follows the Ethernet CRC algorithm of standard.
2.2 Metropolitan Area Network (MAN) packet definitions
The topology of Metropolitan Area Network (MAN) is pattern, may there is 2 kinds, connection even of more than two kinds, i.e. node switching between two equipment
It can all can exceed that 2 kinds between machine and node server, node switch and node switch, node switch and node server
Connection.But the metropolitan area net address of metropolitan area network equipment is uniquely, to close to accurately describe the connection between metropolitan area network equipment
System, introduces parameter in the embodiment of the present application: label, uniquely to describe a metropolitan area network equipment.
In this specification label definition and multiprotocol label switching (Multi-Protocol Label Switch,
MPLS the definition of label) is similar, it is assumed that there are two connections between equipment A and equipment B, then data packet is from equipment A to equipment B
Just there are 2 labels, data packet also there are 2 labels from equipment B to equipment A.Label is divided into label, outgoing label, it is assumed that data packet into
The label (entering label) for entering equipment A is 0x0000, and the label (outgoing label) when this data packet leaves equipment A may reform into
0x0001.The networking process of Metropolitan Area Network (MAN) is to enter network process under centralized control, also means that address distribution, the label of Metropolitan Area Network (MAN)
Distribution be all to be dominated by metropolitan area server, node switch, node server be all passively execute, this point with
The label distribution of MPLS is different, and the distribution of the label of MPLS is the result that interchanger, server are negotiated mutually.
As shown in the table, the data packet of Metropolitan Area Network (MAN) mainly includes following sections:
| DA | SA | Reserved | Label | Payload | CRC |
That is destination address (DA), source address (SA), reserve bytes (Reserved), label, payload (PDU), CRC.Its
In, the format of label, which can refer to, such as gives a definition: label is 32bit, wherein high 16bit retains, only with low 16bit, its position
Set is between the reserve bytes and payload of data packet.
In view networking, watch that the audio-video address of live streaming parsing is identical depending on networked terminals, and the sound of conference dispatching terminal
Frequency and video are different address.Therefore in the prior art, it can not completely realize and utilize view networked terminals and conference dispatching terminal
Live streaming/recorded broadcast audio-video is watched simultaneously.
A kind of preferred implementation of the method for multi-party viewing audio-video provided by the embodiments of the present application based on view networking
Main body be transfer server.
Fig. 5 shows a kind of method of multi-party playing audio-video based on view networking provided by the embodiments of the present application, this is more
The method of square playing audio-video can be applied to transfer server, comprising the following steps:
Step 501: transfer server receives audio-video call instruction, and carrying in the audio-video call instruction includes meeting
The video address of dispatch terminal and audio address, and the audio-video address of view networked terminals.
In a kind of possible embodiment, the mesh of the conference dispatching terminal is also carried in the audio-video call instruction
The target sound video type of mark with phonetic symbols video type and the view networked terminals, the conference dispatching terminal iidentification and view networked terminals
Mark etc..But the application is not especially limited the information carried in the audio-video call instruction, all that transfer may make to take
Business device identifies and navigates to the information of the target audio-video of user's needs in the protection scope of the embodiment of the present application.
Step 502: the transfer server transfers original audio-video according to the audio-video call instruction.
In a kind of possible embodiment of the application, the target audio-video is the transfer server according to receiving
The audio-video mark carried in the audio-video call instruction, corresponds in table in preset mark address and searches and the sound
Target audio-video source front end address in the corresponding target device of video identifier, according to target audio-video source front end
What location was obtained to the request of target audio-video source front end.It should be noted that the mode of above-mentioned acquisition audio-video is only to show
Example, remaining can obtain the method for target audio-video in the protection model of the embodiment of the present application based on target audio-video call instruction
In enclosing.
Step 503: the transfer server parses the original audio-video being deployed into, and obtains target audio-video and mesh
Mark with phonetic symbols frequency.
In step 503, the transfer server goes out target audio and target video from the target sound video extraction；It will
The target video carries out transcoding processing, obtains the target video of different code rates；By the target video difference of the different code rates
It is synthesized with the target audio, obtains the target audio-video of different code rates.
Further, the transfer server is by code rate corresponding to the target sound Video type information of the conference dispatching terminal
Target video and target audio synthesized to obtain the target audio-video of the conference dispatching terminal, by the view networked terminals
Target sound Video type information corresponding to code rate target video and target audio synthesized to obtain the view networked terminals
Target audio-video.
Step 504: the transfer server regards the sound that the target audio-video is respectively sent to the view networked terminals
The video address of frequency address and the conference dispatching terminal, and the target audio is sent to the conference dispatching terminal
Audio address, with described depending on being played simultaneously on networked terminals and the conference dispatching terminal.
In a preferred embodiment, the target audio-video is respectively sent to the view by the transfer server
The video address of the audio-video address of networked terminals and the conference dispatching terminal, comprising: the transfer server will be described
The audio-video address of the view networked terminals is sent to depending on the target audio-video of networked terminals, by the mesh of the conference dispatching terminal
Mark with phonetic symbols video is sent to the video address of the conference dispatching terminal.
In a preferred embodiment, the transfer server includes that association turns server and view networked server；
The audio-video call instruction is to regard networking clothes by the conference dispatching terminal and described be sent to depending on networked terminals
Be engaged in device, and by it is described view networked server be forwarded to it is described assist turn server；
The target audio-video is to turn server by the association to transfer, and will be sent to institute after target audio-video parsing
State view networked server.
In the specific implementation, regarding networked terminals equipment can be set-top box (Set Top Box, STB), commonly referred to as set-top box
Or box on machine, it is the equipment of connection a television set and outside source, it can change into the digital signal of compression in TV
Hold, and shows on a television set.In general, set-top box can connect camera and microphone, for acquiring video counts
According to the multi-medium datas such as audio data, also can connect television set, for multimedias such as playing video data and audio datas
Data.
Therefore in practical application, user can be by some operations in menu (gtml) file, for example dial opposite end
Set-top box Subscriber Number, triggering view networked terminals generate control service request instruction, be sent to view networked server.
It can also include external interface depending on networked terminals equipment, as USB interface, HDMI_OUTx2 interface, HDMI_IN connect
Mouth, card agriculture head interface, RCA (Radio Corporation of American, RC interface) and AV interface etc..
It is existing for the method for the clearer explanation multi-party viewing audio-video provided by the embodiments of the present application based on view networking
It is illustrated based on Fig. 6:
Step 601: conference dispatching terminal sends the first call request message of target audio-video to view networked server, depending on connection
Network termination sends the second call request message of target audio-video to view networked server.
Step 602: extracting the end of the conference dispatching in first call request message of target audio-video depending on networked server
In video address, audio address and the target sound video type at end and second call request message of target audio-video
Audio-video address and target sound video type depending on networked terminals generate the target audio-video calling according to above- mentioned information and refer to
It enables.
Step 603: described the target audio-video call instruction is sent to association depending on networked server to turn server.
Step 604: the association turns server according to the target audio-video call instruction invocation target audio-video.
Step 605: the association turns server and exchanges the target audio-video used to be parsed, and obtains the mesh of view networked terminals
Mark with phonetic symbols video, the target audio-video of conference dispatching terminal, and parsing after target audio.
Step 606: it is described association turn server by after parsing target audio-video and target audio be sent to view the Internet services
Device.
Step 607: described that the target audio-video depending on networked terminals is sent to the view networking depending on networked server
The audio-video address of terminal, with being sent to the video of the conference dispatching terminal by the target audio-video of the conference dispatching terminal
Target audio after the parsing is sent to the audio address of the conference dispatching terminal by location.
Step 608: the view networked terminals and the conference dispatching terminal plays audio-video.
In step 608, the specific method depending on networked terminals and conference dispatching terminal plays audio-video can use existing
There is the method in technology, it is described depending on image encoder, image decoding can be respectively included in networked terminals and conference dispatching terminal
Device and audio coder, audio decoder etc..The embodiment of the present application is not specifically limited herein.
In conclusion being solved by the method for the multi-party viewing audio-video provided by the embodiments of the present application based on view networking
In view networking, while application conference dispatching system and being broadcast live depending on networked terminals/recorded broadcast video-see when, in conference dispatching
System side can not hear the problem of sound, and the user experience is improved.
It should be noted that for simple description, therefore, it is stated as a series of action groups for embodiment of the method
It closes, but those skilled in the art should understand that, the embodiment of the present application is not limited by the described action sequence, because according to
According to the embodiment of the present application, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art also should
Know, the embodiments described in the specification are all preferred embodiments, and related movement not necessarily the application is implemented
Necessary to example.
Based on the same technical idea, referring to Fig. 7, the structural frames of transfer server provided by the embodiments of the present application are shown
Figure, the device can be applied in view networking, can specifically include following module:
Command reception module 701 receives audio-video call instruction for transfer server, in the audio-video call instruction
Carry the video address including conference dispatching terminal and audio address, and the audio-video address of view networked terminals.
Module 702 is transferred, original audio-video is transferred according to the audio-video call instruction for the transfer server.
Parsing module 703 parses the original audio-video being deployed into for the transfer server, obtains target sound
Video and target audio.
The target audio-video is respectively sent to the view for the transfer server and networked eventually by sending module 704
The video address of the audio-video address at end and the conference dispatching terminal, and the target audio is sent to the meeting tune
Spend terminal audio address, with described depending on being played simultaneously on networked terminals and the conference dispatching terminal.
In a preferred embodiment, the transfer server includes that association turns server and view networked server；
The audio-video call instruction is to regard networking clothes by the conference dispatching terminal and described be sent to depending on networked terminals
Be engaged in device, and by it is described view networked server be forwarded to it is described assist turn server；
The target audio-video is to turn server by the association to transfer, and will be sent to institute after target audio-video parsing
State view networked server.
The parsing module 703 is specifically used for: the transfer server goes out target audio from the target sound video extraction
And target video；The target video is subjected to transcoding processing, obtains the target video of different code rates；By the different code rates
Target video is synthesized with the target audio respectively, obtains the target audio-video of different code rates.
The target sound Video type information of the conference dispatching terminal and described is also carried in the audio-video call instruction
Depending on the target sound Video type information of networked terminals；
The target video by the different code rates is synthesized with the target audio respectively, obtains different code rates
Target audio-video, comprising:
The transfer server is by the target of code rate corresponding to the target sound Video type information of the conference dispatching terminal
Video and target audio are synthesized to obtain the target audio-video of the conference dispatching terminal, by the target of the view networked terminals
The target video and target audio of code rate corresponding to audio-video type information are synthesized to obtain the target of the view networked terminals
Audio-video；
The transfer server by the target audio-video be respectively sent to it is described view networked terminals audio-video address with
And the video address of the conference dispatching terminal, comprising:
The transfer server regards the sound that the target audio-video depending on networked terminals is sent to the view networked terminals
The target audio-video of the conference dispatching terminal is sent to the video address of the conference dispatching terminal by frequency address.
For device embodiment, since it is basically similar to the method embodiment, related so being described relatively simple
Place illustrates referring to the part of embodiment of the method.
All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are with
The difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.
It should be understood by those skilled in the art that, the embodiments of the present application may be provided as method, apparatus or calculating
Machine program product.Therefore, the embodiment of the present application can be used complete hardware embodiment, complete software embodiment or combine software and
The form of the embodiment of hardware aspect.Moreover, the embodiment of the present application can be used one or more wherein include computer can
With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code
The form of the computer program product of implementation.
The embodiment of the present application is referring to according to the method for the embodiment of the present application, terminal device (system) and computer program
The flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructions
In each flow and/or block and flowchart and/or the block diagram in process and/or box combination.It can provide these
Computer program instructions are set to general purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminals
Standby processor is to generate a machine, so that being held by the processor of computer or other programmable data processing terminal devices
Capable instruction generates for realizing in one or more flows of the flowchart and/or one or more blocks of the block diagram
The device of specified function.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing terminal devices
In computer-readable memory operate in a specific manner, so that instruction stored in the computer readable memory generates packet
The manufacture of command device is included, which realizes in one side of one or more flows of the flowchart and/or block diagram
The function of being specified in frame or multiple boxes.
These computer program instructions can also be loaded into computer or other programmable data processing terminal devices, so that
Series of operation steps are executed on computer or other programmable terminal equipments to generate computer implemented processing, thus
The instruction executed on computer or other programmable terminal equipments is provided for realizing in one or more flows of the flowchart
And/or in one or more blocks of the block diagram specify function the step of.
Although preferred embodiments of the embodiments of the present application have been described, once a person skilled in the art knows bases
This creative concept, then additional changes and modifications can be made to these embodiments.So the following claims are intended to be interpreted as
Including preferred embodiment and all change and modification within the scope of the embodiments of the present application.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning
Covering non-exclusive inclusion, so that process, method, article or terminal device including a series of elements not only wrap
Those elements are included, but also including other elements that are not explicitly listed, or further includes for this process, method, article
Or the element that terminal device is intrinsic.In the absence of more restrictions, being wanted by what sentence "including a ..." limited
Element, it is not excluded that there is also other identical elements in process, method, article or the terminal device for including the element.
Above to a kind of video broadcasting method and streaming media server based on view networking provided herein.Carry out
It is discussed in detail, specific examples are used herein to illustrate the principle and implementation manner of the present application, above embodiments
Illustrate to be merely used to help understand the present processes and its core concept；At the same time, for those skilled in the art, according to
According to the thought of the application, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification
It should not be construed as the limitation to the application.
Claims (10)
1. a kind of method of the multi-party playing audio-video based on view networking, which is characterized in that the described method includes:
Transfer server receives audio-video call instruction, carries the view including conference dispatching terminal in the audio-video call instruction
Frequency address and audio address, and the audio-video address of view networked terminals；
The transfer server transfers original audio-video according to the audio-video call instruction；
The transfer server parses the original audio-video being deployed into, and obtains target audio-video and target audio；
The target audio-video is respectively sent to audio-video address and the institute of the view networked terminals by the transfer server
The video address of conference dispatching terminal is stated, and the target audio is sent to the audio address of the conference dispatching terminal, with
Described depending on being played simultaneously on networked terminals and the conference dispatching terminal.
2. the method as described in claim 1, which is characterized in that the transfer server includes that association turns server and view networking clothes
Business device；
The audio-video call instruction be by the conference dispatching terminal and it is described be sent to view networked server depending on networked terminals,
Again by it is described view networked server be forwarded to it is described assist turn server；
The target audio-video is to turn server by the association to transfer, and will be sent to the view after target audio-video parsing
Networked server.
3. the method as described in claim 1, which is characterized in that the transfer server carries out the original audio-video being deployed into
Parsing, obtains target audio-video and target audio, comprising:
The transfer server goes out target audio and target video from the target sound video extraction；
The target video is subjected to transcoding processing, obtains the target video of different code rates；
The target video of the different code rates is synthesized with the target audio respectively, obtains the target sound view of different code rates
Frequently.
4. method as claimed in claim 3, which is characterized in that also carry the conference dispatching in the audio-video call instruction
The target sound Video type information of the target sound Video type information of terminal and the view networked terminals；
The target video by the different code rates is synthesized with the target audio respectively, obtains the target of different code rates
Audio-video, comprising:
The transfer server is by the target video of code rate corresponding to the target sound Video type information of the conference dispatching terminal
It is synthesized to obtain the target audio-video of the conference dispatching terminal with target audio, the target sound of the view networked terminals is regarded
The target video and target audio of code rate corresponding to frequency type information are synthesized to obtain the target sound view of the view networked terminals
Frequently；
The target audio-video is respectively sent to audio-video address and the institute of the view networked terminals by the transfer server
State the video address of conference dispatching terminal, comprising:
The target audio-video depending on networked terminals is sent to the audio-video of the view networked terminals by the transfer server
The target audio-video of the conference dispatching terminal is sent to the video address of the conference dispatching terminal by location.
5. a kind of transfer server, which is characterized in that the transfer server includes:
Command reception module receives audio-video call instruction, carrying package in the audio-video call instruction for transfer server
Include video address and the audio address of conference dispatching terminal, and the audio-video address of view networked terminals；
Module is transferred, original audio-video is transferred according to the audio-video call instruction for the transfer server；
Parsing module parses the original audio-video being deployed into for the transfer server, obtain target audio-video and
Target audio；
Sending module regards the sound that the target audio-video is respectively sent to the view networked terminals for the transfer server
The video address of frequency address and the conference dispatching terminal, and the target audio is sent to the conference dispatching terminal
Audio address, with described depending on being played simultaneously on networked terminals and the conference dispatching terminal.
6. transfer server as claimed in claim 5, which is characterized in that the transfer server includes that association turns server and view
Networked server；
The audio-video call instruction be by the conference dispatching terminal and it is described be sent to view networked server depending on networked terminals,
Again by it is described view networked server be forwarded to it is described assist turn server；
The target audio-video is to turn server by the association to transfer, and will be sent to the view after target audio-video parsing
Networked server.
7. transfer server as claimed in claim 5, which is characterized in that the parsing module is specifically used for:
The transfer server goes out target audio and target video from the target sound video extraction；
The target video is subjected to transcoding processing, obtains the target video of different code rates；
The target video of the different code rates is synthesized with the target audio respectively, obtains the target sound view of different code rates
Frequently.
8. transfer server as claimed in claim 7, which is characterized in that also carry the meeting in the audio-video call instruction
Discuss the target sound Video type information of dispatch terminal and the target sound Video type information of the view networked terminals；
The target video by the different code rates is synthesized with the target audio respectively, obtains the target of different code rates
Audio-video, comprising:
The transfer server is by the target video of code rate corresponding to the target sound Video type information of the conference dispatching terminal
It is synthesized to obtain the target audio-video of the conference dispatching terminal with target audio, the target sound of the view networked terminals is regarded
The target video and target audio of code rate corresponding to frequency type information are synthesized to obtain the target sound view of the view networked terminals
Frequently；
The target audio-video is respectively sent to audio-video address and the institute of the view networked terminals by the transfer server
State the video address of conference dispatching terminal, comprising:
The target audio-video depending on networked terminals is sent to the audio-video of the view networked terminals by the transfer server
The target audio-video of the conference dispatching terminal is sent to the video address of the conference dispatching terminal by location.
9. a kind of computer equipment including memory, processor and stores the meter that can be run on a memory and on a processor
Calculation machine program, which is characterized in that the processor realizes any side of Claims 1-4 when executing the computer program
Method.
10. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has perform claim
It is required that the computer program of 1 to 4 any the method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910257607.0A CN110149305B (en) | 2019-04-01 | 2019-04-01 | Video network-based multi-party audio and video playing method and transfer server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910257607.0A CN110149305B (en) | 2019-04-01 | 2019-04-01 | Video network-based multi-party audio and video playing method and transfer server |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110149305A true CN110149305A (en) | 2019-08-20 |
| CN110149305B CN110149305B (en) | 2021-10-19 |
Family
ID=67589300
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910257607.0A Active CN110149305B (en) | 2019-04-01 | 2019-04-01 | Video network-based multi-party audio and video playing method and transfer server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110149305B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111083428A (en) * | 2019-12-27 | 2020-04-28 | 北京东土科技股份有限公司 | Audio and video data processing method and device, computer equipment and storage medium |
| CN111131760A (en) * | 2019-12-31 | 2020-05-08 | 视联动力信息技术股份有限公司 | Video recording method and device |
| CN112787830A (en) * | 2020-12-24 | 2021-05-11 | 世邦通信股份有限公司 | High-compatibility broadcasting system based on audio conference architecture and implementation method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104754366A (en) * | 2015-03-03 | 2015-07-01 | 腾讯科技（深圳）有限公司 | Audio and video file live broadcasting method, device and system |
| US9948891B1 (en) * | 2017-03-29 | 2018-04-17 | Ziiproow, Inc. | Conducting an audio or video conference call |
| CN108307212A (en) * | 2017-01-11 | 2018-07-20 | 北京视联动力国际信息技术有限公司 | A kind of file order method and device |
| CN108810444A (en) * | 2017-07-31 | 2018-11-13 | 北京视联动力国际信息技术有限公司 | Processing method, conference dispatching end and the association of video conference turn server |
| CN108881796A (en) * | 2017-12-27 | 2018-11-23 | 北京视联动力国际信息技术有限公司 | A kind of video data handling procedure and turn server depending on networking association |
-
2019
- 2019-04-01 CN CN201910257607.0A patent/CN110149305B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104754366A (en) * | 2015-03-03 | 2015-07-01 | 腾讯科技（深圳）有限公司 | Audio and video file live broadcasting method, device and system |
| CN108307212A (en) * | 2017-01-11 | 2018-07-20 | 北京视联动力国际信息技术有限公司 | A kind of file order method and device |
| US9948891B1 (en) * | 2017-03-29 | 2018-04-17 | Ziiproow, Inc. | Conducting an audio or video conference call |
| CN108810444A (en) * | 2017-07-31 | 2018-11-13 | 北京视联动力国际信息技术有限公司 | Processing method, conference dispatching end and the association of video conference turn server |
| CN108881796A (en) * | 2017-12-27 | 2018-11-23 | 北京视联动力国际信息技术有限公司 | A kind of video data handling procedure and turn server depending on networking association |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111083428A (en) * | 2019-12-27 | 2020-04-28 | 北京东土科技股份有限公司 | Audio and video data processing method and device, computer equipment and storage medium |
| CN111131760A (en) * | 2019-12-31 | 2020-05-08 | 视联动力信息技术股份有限公司 | Video recording method and device |
| CN112787830A (en) * | 2020-12-24 | 2021-05-11 | 世邦通信股份有限公司 | High-compatibility broadcasting system based on audio conference architecture and implementation method |
| CN112787830B (en) * | 2020-12-24 | 2023-10-13 | 世邦通信股份有限公司 | High-compatibility broadcasting system based on audio conference architecture |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110149305B (en) | 2021-10-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108063745B (en) | A kind of video call method and its system based on Android device | |
| CN109788232A (en) | A kind of summary of meeting recording method of video conference, device and system | |
| CN110267099A (en) | A kind of data transmission method and view networked terminals based on view networking | |
| CN109803111A (en) | A kind of method for watching after the meeting and device of video conference | |
| CN108810444A (en) | Processing method, conference dispatching end and the association of video conference turn server | |
| CN108881135A (en) | It is a kind of based on view networking information transferring method, device and system | |
| CN110049271A (en) | A kind of view networking conferencing information methods of exhibiting and device | |
| CN110460804A (en) | Conferencing data sending method, system, equipment and computer readable storage medium | |
| CN109547731A (en) | A kind of methods of exhibiting and system of video conference | |
| CN110049273A (en) | A kind of meeting method for recording and transfer server based on view networking | |
| CN110049346A (en) | A kind of method and system of net cast | |
| CN109151610A (en) | A kind for the treatment of method and apparatus receiving web camera picture | |
| CN110149305A (en) | A kind of method and transfer server of the multi-party playing audio-video based on view networking | |
| CN108881818A (en) | A kind of transmission method and device of video data | |
| CN109491783A (en) | A kind of acquisition methods and system of memory usage | |
| CN108966003A (en) | A kind of method and apparatus of TV data processing | |
| CN108989831A (en) | A kind of network REC method and apparatus of multi-code stream | |
| CN110445761A (en) | A kind of video drawing stream method and device | |
| CN110072154A (en) | A kind of group building method and transfer server based on view networking | |
| CN110278244A (en) | A kind of method of network entry and view networked terminals based on view networking | |
| CN110198384A (en) | A kind of means of communication and transfer server based on view networking | |
| CN110072139A (en) | A kind of sharing method and transfer server based on view networking | |
| CN110086773A (en) | A kind of processing method and system of audio, video data | |
| CN109889516A (en) | A kind of method for building up and device of session channel | |
| CN108574819A (en) | A kind of terminal device and a kind of method of video conference |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |