CN110417877A - A kind of processing method and processing device of audio-video business - Google Patents

A kind of processing method and processing device of audio-video business Download PDF

Info

Publication number
CN110417877A
CN110417877A CN201910647613.7A CN201910647613A CN110417877A CN 110417877 A CN110417877 A CN 110417877A CN 201910647613 A CN201910647613 A CN 201910647613A CN 110417877 A CN110417877 A CN 110417877A
Authority
CN
China
Prior art keywords
business
audio
video
web client
terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910647613.7A
Other languages
Chinese (zh)
Other versions
CN110417877B (en
Inventor
安玉
王晓辉
吴芳华
王艳辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Visionvera Information Technology Co Ltd
Original Assignee
Visionvera Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Visionvera Information Technology Co Ltd filed Critical Visionvera Information Technology Co Ltd
Priority to CN201910647613.7A priority Critical patent/CN110417877B/en
Publication of CN110417877A publication Critical patent/CN110417877A/en
Application granted granted Critical
Publication of CN110417877B publication Critical patent/CN110417877B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H04N21/25875—Management of end-user data involving end-user authentication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

The embodiment of the invention provides a kind of processing methods of audio-video business, device and storage medium, method is applied to any terminal in multiple terminals in audio-video operation system, web client and software terminal are installed in terminal, software terminal and streaming media server communicate to connect, web client and bridge service device communicate to connect, bridge service device and streaming media server communicate to connect view networked server, method includes: the audio-video business operation carried out in web client according to user, generate business parameters data, wherein, business parameters data includes user information；In response to audio-video business operation, software terminal is started by web client, and the software terminal being activated is logged in using user information；Business parameters data is sent to streaming media server via bridge service device, depending on networked server by web client；At least one the first audio/video flow data sent by software terminal receiving stream media server according to user information.To improve audio/video decoding speed.

Description

A kind of processing method and processing device of audio-video business
Technical field
The present invention relates to audio-video service technique field, more particularly to a kind of audio-video business processing method method with And device and a kind of computer readable storage medium.
Background technique
It is existing depending in intranet network generally using web client go to carry out the displaying of related audio-video business, management and Control, user can carry out video calling, live streaming or checking monitoring etc. and audio/video flow related service by web client, but It is that Web client is when coming out progress video calling, live streaming or checking monitoring, the browser committed memory space of Web client Greatly, bad situation is handled multichannel audio-video frequency.
Summary of the invention
In view of the above problems, it proposes the embodiment of the present invention and overcomes the above problem or at least partly in order to provide one kind A kind of processing method of the audio-video business to solve the above problems, a kind of processing unit of audio-video business, a kind of device and A kind of computer readable storage medium.
The embodiment of the present invention in a first aspect, provide a kind of processing method of audio-video business, the method is applied to sound Any terminal in multiple terminals in video service system is equipped with web client and software terminal in the terminal, described soft Terminal and streaming media server communicate to connect, and the web client and bridge service device communicate to connect, the bridge service device with The streaming media server communicates to connect view networked server, which comprises
The audio-video business operation carried out in the web client according to user generates business parameters data, wherein The business parameters data includes user information, and the user information is the user's letter currently logged in the web client Breath；
In response to the audio-video business operation, the software terminal is started by the web client, and use the use The software terminal that family information registration is activated；
Business parameters data is sent to the bridge service device by the web client, the bridge service device is used In the business parameters data is sent to the streaming media server depending on networked server via described；
Receive that the streaming media server sends according to the user information by the software terminal at least one first Audio/video flow data；Wherein, the first audio/video flow data are by pre-establishing communication path with the streaming media server The acquisition of at least one terminal, and it is sent to the streaming media server.
Optionally, in response to the audio-video business operation, the software terminal is started by the web client, and adopt The software terminal being activated is logged in the user information, comprising:
It is preset in the web client by web client triggering in response to the audio-video business operation Hyperlink；
According to the clicking operation that user carries out in the hyperlink, by the web client obtain with
The corresponding interface identifier of the hyperlink；
According to the interface identifier, start the software terminal, and it is described soft to use user information login to be activated Terminal.
Optionally, described to be connected with multiple view networked terminals depending on networked server: according to user in the web client The audio-video business operation of progress generates business parameters data, comprising:
According to the audio-video business operation, at least one view networking associated with the audio-video business operation is obtained Number；
Generate the first business parameters data for meeting Internet protocol；Wherein, include in first business parameters data The user information and view networking number；
Business parameters data is sent to the bridge service device by the web client, comprising:
First business parameters data is sent to the bridge service device, the bridge joint by the web client Server is used to being converted to first business parameters data into the second business parameters data for meeting view networking protocol, and by institute It states the second business parameters data and is sent to the view networked server；The view networked server joins for establishing with each view View connected network communication path between the corresponding view networked terminals of network No. code, and, for being based on second business parameters data, Establish the communication with the streaming media server；
The method also includes:
It is sent to the streaming media server by the second audio/video flow data that the software terminal acquires itself, it is described Streaming media server is used to the second audio/video flow data being sent to the view networked server, the view networked server For being based on the view connected network communication path, the second audio/video flow data are sent to the view networked terminals.
Optionally, the web client also with web server communicate to connect, it is described according to user in the web client Before the step of audio-video business operation of upper progress, generation business parameters data, the method also includes:
The first business message request is sent to the web server by the web client；Wherein, first industry Business message request includes multiple user identifiers；The web server is used to for the first business message request being sent to and institute Corresponding first web client of user identifier is stated, and is invited for receiving first web client for first business The confirmation signaling that information returns；It wherein, include terminal mark according to the terminal of first web client in the confirmation signaling Know；
The confirmation signaling that the web server returns is received by the web client；
The audio-video business operation carried out in the web client according to user generates business parameters data, comprising:
Start to operate according to the audio-video business that user carries out in the web client for the confirmation signaling, obtain The terminal iidentification in the confirmation signaling is taken, and generates the service parameter including the user information and the terminal iidentification Information；
In response to the audio-video business operation, the software terminal is started by the web client, and use the use The software terminal that family information registration is activated, comprising:
Start to operate in response to the audio-video business, the software terminal is started by the web client, and use institute It states user information and logs in the software terminal being activated；
Business parameters data is sent to the bridge service device by the web client, the bridge service device is used In the business parameters data is sent to the streaming media server, comprising:
Business parameters data is sent to the bridge service device by the web client, the bridge service device is used In the business parameters data is sent to the streaming media server, the streaming media server is for establishing and each end The first audio/video communication path of the corresponding terminal of mark is held, and for receiving based on first audio/video communication path and respectively The first audio/video flow data of the corresponding terminal acquisition of the terminal iidentification.
Optionally, the audio-video business operation carried out in the web client according to user generates service parameter Before the step of information, the method also includes:
The business sign on that the web server is sent is received by the web client；The service order is by Two web clients generate and send；It wherein, include the terminal for installing second web client in the business sign on Terminal iidentification；
The audio-video business operation carried out in the web client according to user generates business parameters data, comprising:
The business confirmation operation for the business sign on carried out in the web client according to user, is obtained The terminal iidentification of the business sign on is taken, and generates the business ginseng including the user information and the terminal iidentification Number information；
In response to the audio-video business operation, the software terminal is started by the web client, comprising:
In response to the business confirmation operation, the software terminal is started by the web client.
The second aspect of the present embodiment, provides a kind of processing unit of audio-video business, and described device is applied to video industry Any terminal in multiple terminals in business system, is equipped with web client and software terminal in the terminal, the software terminal with Streaming media server communication connection, the web client and bridge service device communicate to connect, and described device includes:
Business information generation module generates industry for the audio-video business operation that user carries out in the web client Business parameter information, wherein the business parameters data includes user information, wherein the user information is currently in the web The user information logged in client；
Software terminal starting module starts the soft end by the web client in response to the audio-video business operation End, and the software terminal being activated is logged in using the user information；
Parameter information sending module takes for business parameters data to be sent to the bridge joint by the web client Business device, the bridge service device are used to the business parameters data being sent to the streaming media server；
Video reception module is sent out for receiving the streaming media server by the software terminal according to the user information At least one sent the first audio/video flow data；Wherein, the first audio/video flow data are by pre- with the streaming media server At least one terminal acquisition of communication path is first established, and is sent to the streaming media server.
Optionally, the software terminal starting module includes:
Trigger module is triggered by the web client described for operating in response to the video traffic Preset dialog box in web client；
Interface determining module, the confirmation operation for being carried out in the dialog box according to user, passes through the web client End obtains the interface identifier with dialog box binding；
Starting module, for starting the software terminal according to the interface identifier；
Login module, for logging in the software terminal being activated using the user information.
Optionally, the multiple terminal and view networked server communication connection, the business information generation module include:
Number acquiring unit, for obtaining related to the audio-video business operation according to the audio-video business operation At least one view networking number of connection；
Business parameters data generation unit, for generating the first business parameters data for meeting Internet protocol；Wherein institute State in the first business parameters data includes the user information and view networking number；
The parameter information sending module is specifically used for first business parameters data through the web client It is sent to the bridge service device, the bridge service device meets view networking for being converted to first business parameters data Second business parameters data of agreement, and second business parameters data is sent to the view networked server；The view Networked server be used for establishes with it is each it is described view networking number it is corresponding regard networked terminals between view connected network communication path, with And for being based on second business parameters data, establish the communication with the streaming media server；
Described device further include:
Video sending module, the second audio/video flow data for being acquired itself by the software terminal are sent to described Streaming media server, the streaming media server are used to the second audio/video flow data being sent to the view the Internet services Device, the view networked server are used to be based on the view connected network communication path, and the second audio/video flow data are sent to institute State view networked terminals.
The third aspect of the embodiment of the present invention provides a kind of device, comprising: one or more processors；With
One or more machine readable medias of instruction are stored thereon with, are executed when by one or more of processors When, so that the processing method of audio-video business shown in described device execution.
The third aspect of the embodiment of the present invention provides a kind of computer readable storage medium, the computer program of storage So that processor executes the processing method of the audio-video business
The embodiment of the present invention includes following advantages:
In embodiments of the present invention, web client and software terminal are installed simultaneously at the terminal, according to user in web client The audio-video business operation that end carries out generates business parameters data, and the audio-video business in response to carrying out in web client is grasped Make, by the software terminal of web client starting installation, and the user information by logging in web client is gone to log in and is activated Software terminal, and then business parameters data is sent to streaming media server, streaming media server will pass through according to user information First audio/video flow data accessed by the communication path pre-established return to software terminal, and then terminal can pass through soft end End carries out video calling, live streaming or checking monitoring video.It realizes and audio-video business is managed and is controlled by web client System, and the reception of audio-video, decoding and broadcasting carry out on software terminal, to reduce web client to the occupancy of memory headroom.Again Since the user information by logging in web client logs in software terminal, so that the account between software terminal and web client It is unified, and then can reduce from progress audio-video business operation to the software terminal started by web client and receive the first sound Switching time between video stream data, and then realize the seamless switching between audio-video management and audio-video viewing.
Detailed description of the invention
Fig. 1 is a kind of networking schematic diagram of view networking of the invention；
Fig. 2 is a kind of hardware structural diagram of node server of the invention；
Fig. 3 is a kind of hardware structural diagram of access switch of the invention；
Fig. 4 is the hardware structural diagram that a kind of Ethernet association of the invention turns gateway；
Fig. 5 is a kind of applied environment figure of the processing method of audio-video business of the embodiment of the present invention；
Fig. 6 is a kind of flow diagram of the processing method of audio-video business of the embodiment of the present invention；
Fig. 7 is the flow diagram of step 602 in a kind of processing method of audio-video business of the embodiment of the present invention；
Fig. 8 is a kind of instance graph of the processing method of audio-video business of the embodiment of the present invention；
Fig. 9 is a kind of block diagram of the processing unit of audio-video business of the embodiment of the present invention.
Specific embodiment
In order to make the foregoing objectives, features and advantages of the present invention clearer and more comprehensible, with reference to the accompanying drawing and specific real Applying mode, the present invention is described in further detail.
It is the important milestone of network Development depending on networking, is a real-time network, can be realized HD video real-time Transmission, Push numerous Internet applications to HD video, high definition is face-to-face.
Real-time high-definition video switching technology is used depending on networking, it can be such as high in a network platform by required service Clear video traffic, Intellectualized monitoring analysis, emergency command, digital broadcast television, delay TV, the Web-based instruction, shows video monitoring Field live streaming, VOD program request, TV Mail, individual character records (PVR), Intranet (manages) channel by oneself, intelligent video Broadcast Control, information publication All be incorporated into a system platform etc. services such as tens of kinds of videos, voice, picture, text, communication, data, by TV or Computer realizes that high-definition quality video plays.
Embodiment in order to enable those skilled in the art to better understand the present invention is introduced to depending on networking below:
Depending on networking, applied portion of techniques is as described below:
Network technology (NetworkTechnology)
Traditional ethernet (Ethernet) is improved depending on the network technology innovation networked, with potential huge on network First video flow.It is exchanged different from simple network packet packet switch (Packet Switching) or lattice network (Circuit Switching) meets Streaming demand using Packet Switching depending on networking technology.Depending on skill of networking Art has flexible, the simple and low price of packet switch, is provided simultaneously with the quality and safety assurance of circuit switching, realizes the whole network friendship Change the seamless connection of formula virtual circuit and data format.
Switching technology (Switching Technology)
Two advantages of asynchronous and packet switch that Ethernet is used depending on networking eliminate Ethernet under the premise of complete compatible and lack It falls into, has the end-to-end seamless connection of the whole network, direct user terminal, directly carrying IP data packet.User data is in network-wide basis It is not required to any format conversion.It is the more advanced form of Ethernet depending on networking, is a real-time exchange platform, can be realized at present mutually The whole network large-scale high-definition realtime video transmission that networking cannot achieve pushes numerous network video applications to high Qinghua, unitizes.
Server technology (ServerTechnology)
It is different from traditional server, its Streaming Media depending on the server technology in networking and unified video platform Transmission be built upon it is connection-oriented on the basis of, data-handling capacity is unrelated with flow, communication time, single network layer energy Enough transmitted comprising signaling and data.For voice and video business, handled depending on networking and unified video platform Streaming Media Complexity many simpler than data processing, efficiency substantially increase hundred times or more than traditional server.
Reservoir technology (Storage Technology)
The ultrahigh speed reservoir technology of unified video platform in order to adapt to the media content of vast capacity and super-flow and Using state-of-the-art real time operating system, the programme information in server instruction is mapped to specific hard drive space, media Content is no longer pass through server, and moment is directly delivered to user terminal, and user waits typical time less than 0.2 second.It optimizes Sector distribution greatly reduces the mechanical movement of hard disc magnetic head tracking, and resource consumption only accounts for the 20% of the internet ad eundem IP, but The concurrent flow greater than 3 times of traditional disk array is generated, overall efficiency promotes 10 times or more.
Network security technology (Network Security Technology)
Depending on the structural design networked by servicing independent licence system, equipment and the modes such as user data is completely isolated every time The network security problem that puzzlement internet has thoroughly been eradicated from structure, does not need antivirus applet, firewall generally, has prevented black The attack of visitor and virus, structural carefree secure network is provided for user.
It services innovative technology (Service Innovation Technology)
Business and transmission are fused together by unified video platform, whether single user, private user or a net The sum total of network is all only primary automatic connection.User terminal, set-top box or PC are attached directly to unified video platform, obtain rich The multimedia video service of rich colorful various forms.Unified video platform is traditional to substitute with table schema using " menu type " Complicated applications programming, considerably less code, which can be used, can be realized complicated application, realize the new business innovation of " endless ".
Networking depending on networking is as described below:
It is a kind of central controlled network structure depending on networking, which can be Tree Network, Star network, ring network etc. class Type, but centralized control node is needed to control whole network in network on this basis.
As shown in Figure 1, being divided into access net and Metropolitan Area Network (MAN) two parts depending on networking.
The equipment of access mesh portions can be mainly divided into 3 classes: node server, access switch, terminal (including various machines Top box, encoding board, memory etc.).Node server is connected with access switch, and access switch can be with multiple terminal phases Even, and it can connect Ethernet.
Wherein, node server is the node that centralized control functions are played in access net, can control access switch and terminal. Node server can directly be connected with access switch, can also directly be connected with terminal.
Similar, the equipment of metropolitan area mesh portions can also be divided into 3 classes: metropolitan area server, node switch, node serve Device.Metropolitan area server is connected with node switch, and node switch can be connected with multiple node servers.
Wherein, node server is the node server for accessing mesh portions, i.e. node server had both belonged to access wet end Point, and belong to metropolitan area mesh portions.
Metropolitan area server is the node that centralized control functions are played in Metropolitan Area Network (MAN), can control node switch and node serve Device.Metropolitan area server can be directly connected to node switch, can also be directly connected to node server.
It can be seen that be entirely a kind of central controlled network structure of layering depending on networking network, and node server and metropolitan area The network controlled under server can be the various structures such as tree-shaped, star-like, cyclic annular.
Visually claim, access mesh portions can form unified video platform (part in virtual coil), and multiple unified videos are flat Platform can form view networking；Each unified video platform can be interconnected by metropolitan area and wide area depending on networking.
Classify depending on networked devices
1.1 embodiment of the present invention can be mainly divided into 3 classes: server depending on the equipment in networking, interchanger (including ether Net association turns gateway), terminal (including various set-top boxes, encoding board, memory etc.).Metropolitan Area Network (MAN) can be divided on the whole depending on networking (or national net, World Wide Web etc.) and access net.
1.2 equipment for wherein accessing mesh portions can be mainly divided into 3 classes: node server, access switch (including ether Net association turns gateway), terminal (including various set-top boxes, encoding board, memory etc.).
The specific hardware structure of each access network equipment are as follows:
Node server:
As shown in Fig. 2, mainly including Network Interface Module 201, switching engine module 202, CPU module 203, disk array Module 204；
Wherein, Network Interface Module 201, the Bao Jun that CPU module 203, disk array module 204 are come in enter switching engine Module 202；Switching engine module 202 look into the operation of address table 205 to the packet come in, to obtain the navigation information of packet； And the packet is stored according to the navigation information of packet the queue of corresponding pack buffer 206；If the queue of pack buffer 206 is close It is full, then it abandons；All pack buffer queues of 202 poll of switching engine module, are forwarded: 1) end if meeting the following conditions It is less than that mouth sends caching；2) the queue package counting facility is greater than zero.Disk array module 204 mainly realizes the control to hard disk, packet Include the operation such as initialization, read-write to hard disk；CPU module 203 be mainly responsible for access switch, terminal (not shown) it Between protocol processes, to address table 205 (including descending protocol packet address table, uplink protocol package address table, data packet addressed table) Configuration, and, the configuration to disk array module 204.
Access switch:
As shown in figure 3, mainly including Network Interface Module (downstream network interface module 301, uplink network interface module 302), switching engine module 303 and CPU module 304；
Wherein, the packet (upstream data) that downstream network interface module 301 is come in enters packet detection module 305；Packet detection mould Whether mesh way address (DA), source address (SA), type of data packet and the packet length of the detection packet of block 305 meet the requirements, if met, It then distributes corresponding flow identifier (stream-id), and enters switching engine module 303, otherwise abandon；Uplink network interface mould The packet (downlink data) that block 302 is come in enters switching engine module 303；The data packet that CPU module 304 is come in enters switching engine Module 303；Switching engine module 303 look into the operation of address table 306 to the packet come in, to obtain the navigation information of packet； If the packet into switching engine module 303 is that downstream network interface is gone toward uplink network interface, in conjunction with flow identifier (stream-id) packet is stored in the queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full, It abandons；If the packet into switching engine module 303 is not that downstream network interface is gone toward uplink network interface, according to packet Navigation information is stored in the data packet queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full, Then abandon.
All pack buffer queues of 303 poll of switching engine module, may include two kinds of situations:
If the queue is that downstream network interface is gone toward uplink network interface, meets the following conditions and be forwarded: 1) It is less than that the port sends caching；2) the queue package counting facility is greater than zero；3) token that rate control module generates is obtained；
If the queue is not that downstream network interface is gone toward uplink network interface, meets the following conditions and is forwarded: 1) it is less than to send caching for the port；2) the queue package counting facility is greater than zero.
Rate control module 308 is configured by CPU module 304, to all downlink networks in programmable interval Interface generates token toward the pack buffer queue that uplink network interface is gone, to control the code rate of forwarded upstream.
CPU module 304 is mainly responsible for the protocol processes between node server, the configuration to address table 306, and, Configuration to rate control module 308.
Ethernet association turns gateway:
As shown in figure 4, mainly including Network Interface Module (downstream network interface module 401, uplink network interface module 402), switching engine module 403, CPU module 404, packet detection module 405, rate control module 408, address table 406, Bao Huan Storage 407 and MAC adding module 409, MAC removing module 410.
Wherein, the data packet that downstream network interface module 401 is come in enters packet detection module 405；Packet detection module 405 is examined Ethernet mac DA, ethernet mac SA, Ethernet length or frame type, the view networking mesh way address of measured data packet DA, whether meet the requirements depending on networking source address SA, depending on networking data Packet type and packet length, corresponding stream is distributed if meeting Identifier (stream-id)；Then, MAC DA, MAC SA, length or frame type are subtracted by MAC removing module 410 (2byte), and enter corresponding receive and cache, otherwise abandon；
Downstream network interface module 401 detects the transmission caching of the port, according to the view of packet networking mesh if there is Bao Ze Address D A knows the ethernet mac DA of corresponding terminal, adds the ethernet mac DA of terminal, Ethernet assists the MAC for turning gateway SA, Ethernet length or frame type, and send.
The function that Ethernet association turns other modules in gateway is similar with access switch.
Terminal:
It mainly include Network Interface Module, Service Processing Module and CPU module；For example, set-top box mainly connects including network Mouth mold block, video/audio encoding and decoding engine modules, CPU module；Encoding board mainly includes Network Interface Module, video encoding engine Module, CPU module；Memory mainly includes Network Interface Module, CPU module and disk array module.
The equipment of 1.3 metropolitan area mesh portions can be mainly divided into 2 classes: node server, node switch, metropolitan area server. Wherein, node switch mainly includes Network Interface Module, switching engine module and CPU module；Metropolitan area server mainly includes Network Interface Module, switching engine module and CPU module are constituted.
2, networking data package definition is regarded
2.1 access network data package definitions
Access net data packet mainly include following sections: destination address (DA), source address (SA), reserve bytes, payload(PDU)、CRC。
As shown in the table, the data packet for accessing net mainly includes following sections:
DA SA Reserved Payload CRC
Wherein:
Destination address (DA) is made of 8 bytes (byte), and first character section indicates type (such as the various associations of data packet Discuss packet, multicast packet, unicast packet etc.), be up to 256 kinds of possibility, the second byte to the 6th byte is metropolitan area net address, Seven, the 8th bytes are access net address；
Source address (SA) is also to be made of 8 bytes (byte), is defined identical as destination address (DA)；
Reserve bytes are made of 2 bytes；
The part payload has different length according to the type of different datagrams, is if it is various protocol packages 64 bytes are 32+1024=1056 bytes if it is single group unicast packets words, are not restricted to above 2 kinds certainly；
CRC is made of 4 bytes, and calculation method follows the Ethernet CRC algorithm of standard.
2.2 Metropolitan Area Network (MAN) packet definitions
The topology of Metropolitan Area Network (MAN) is pattern, may there is 2 kinds, connection even of more than two kinds, i.e. node switching between two equipment It can all can exceed that 2 kinds between machine and node server, node switch and node switch, node switch and node server Connection.But the metropolitan area net address of metropolitan area network equipment is uniquely, to close to accurately describe the connection between metropolitan area network equipment System, introduces parameter in embodiments of the present invention: label, uniquely to describe a metropolitan area network equipment.
(Multi-Protocol Label Switch, multiprotocol label are handed over by the definition of label and MPLS in this specification Change) label definition it is similar, it is assumed that between equipment A and equipment B there are two connection, then data packet from equipment A to equipment B just There are 2 labels, data packet also there are 2 labels from equipment B to equipment A.Label is divided into label, outgoing label, it is assumed that data packet enters The label (entering label) of equipment A is 0x0000, and the label (outgoing label) when this data packet leaves equipment A may reform into 0x0001.The networking process of Metropolitan Area Network (MAN) is to enter network process under centralized control, also means that address distribution, the label of Metropolitan Area Network (MAN) Distribution be all to be dominated by metropolitan area server, node switch, node server be all passively execute, this point with The label distribution of MPLS is different, and the distribution of the label of MPLS is the result that interchanger, server are negotiated mutually.
As shown in the table, the data packet of Metropolitan Area Network (MAN) mainly includes following sections:
DA SA Reserved Label Payload CRC
That is destination address (DA), source address (SA), reserve bytes (Reserved), label, payload (PDU), CRC.Its In, the format of label, which can refer to, such as gives a definition: label is 32bit, wherein high 16bit retains, only with low 16bit, its position Set is between the reserve bytes and payload of data packet.
Based on the characteristic of above-mentioned view networking, one of core idea of the embodiment of the present application is proposed, it is enterprising in web client When row audio-video business operation, software terminal is started by web client, and using the user information logged in web client Software terminal is logged in, the audio/video flow data returned by software terminal receiving stream media server.
With reference to Fig. 5, communication environment applied by a kind of processing method of audio-video business of the embodiment of the present invention is shown Schematic diagram, in Fig. 5, it may include multiple ends in the audio-video operation system that the method, which is applied to audio-video operation system, End, streaming media server and bridge service device, are equipped with web client and software terminal at the terminal, wherein software terminal and stream matchmaker Body server communication, web client are communicated with bridge service device, the bridge service device and view networked server communication connection.
In the embodiment of the present invention, streaming media server, bridge service device and each terminal can network in view in advance It is registered in server, view networking service communication can be carried out.Streaming media server can be understood as providing sound for software terminal The server of Video service, bridge service device can be understood as providing the services such as audio-video management, operation for web client Server, and the bridge joint that can be undertaken between internet and view networking acts on.
Terminal in the embodiment of the present invention can be but be not limited to following equipment: smart phone, computer, notebook calculate Machine, tablet computer, Web TV etc..Web client and software terminal can be installed simultaneously on the terminal.
Wherein, web client can be understood as the client software of the dynamic page technology based on Web, also Referred to as web page program, in practice, user can access the Web client by browser, so log in the web client into Row audio-video business manages and controls.Software terminal can be understood as to be directly accessed or be accessed by streaming media server Depending on the multipad of networked server, software terminal can provide encoding and decoding to audio-video, video is presented, play audio, The service such as pull-up camera.
Refering to what is shown in Fig. 6, a kind of flow diagram of the processing method of audio-video business of the embodiment of the present invention is shown, This method can be applied in any one terminal in above-mentioned audio-video operation system, can specifically include following steps:
Step 601, the audio-video business operation carried out in the web client according to user generates service parameter letter Breath.
In the embodiment of the present invention, video traffic operation may include the business operation for carrying out video conference, transfer monitoring view The business operation of frequency, the business operation for watching live video, user can log in web client and carry out aforesaid operations, web client The above-mentioned audio-video business operation that end can be carried out according to user, generates business parameters data.It wherein, can in business parameters data To include the user information currently logged in the web client, in practice, business parameters data can also include other letters Breath, such as the address of terminal, web client port information, characterize the identification information of audio-video type of business, the present invention is implemented Example is it is not limited here.
Step 602, in response to the audio-video business operation, the software terminal is started by the web client, and adopt The software terminal being activated is logged in the user information.
In the embodiment of the present invention, when detecting that user carries out audio-video business operation in web client, web can be passed through Client triggers software terminal starting, after software terminal is activated, the then user information that will can log in web client automatically Incoming software terminal, to realize automated log on software terminal.Wherein, user information may include the information such as user name, user password.
When it is implemented, user when being registered on software terminal the registration user name that uses and log-in password can with its The username and password used in web client is consistent, to use when being started by web client and logging in software terminal Consistent user information, and then realize and successfully log in software terminal.
Step 603, business parameters data is sent to by the bridge service device, the bridge joint by the web client Server is used to the business parameters data being sent to the streaming media server depending on networked server via described.
In the embodiment of the present invention, the business parameters data that terminal generates is the information for meeting view networking protocol, and terminal can be with Business parameters data is sent to bridge service device by internet protocol-based, because bridge service device in advance view networked server in The bridge joint effect of network is realized in registration between internet and view networking, then bridge service device can be by the business parameters data After being converted to the business parameters data for meeting view networking protocol, it is sent to view networked server.
Because streaming media server is registered in depending on networked server in advance, then can be joined according to the business depending on networked server The type of business carried in number information, is sent to streaming media server for the business parameters data, so that streaming media server root Audio-video service is provided according to the business parameters data for terminal.Business parameters data is being sent to Streaming Media depending on networked server After server, streaming media server can provide the audio-video of internet protocol-based transmission according to business parameters data for terminal Stream service can watch audio-video using the Internet protocol generally used to meet software terminal.For example, can receive software terminal Video flowing is simultaneously transmitted to other signified software terminal in business parameters data or is mounted in other terminals by the video flowing of transmission Web client.
Step 604, the streaming media server is received by the software terminal to send at least according to the user information One the first audio/video flow data；Wherein, the first audio/video flow data are logical by pre-establishing with the streaming media server Believe at least one terminal acquisition in path, and is sent to the streaming media server.
It include that the user of software terminal believes in the embodiment of the present invention, in the business parameters data that is received by streaming media server Breath, then the object that streaming media server can determine that itself provides audio-video service according to user information is the software terminal, in turn, The audio/video flow that other terminals received are sent can be sent to software terminal, also can receive the sound view of software terminal transmission Frequency flows.
First audio/video flow data described in the present embodiment can be understood as the acquisition of other terminals and take to Streaming Media The first audio/video flow data that business device is sent, when it is implemented, streaming media server can be communicated with the foundation of multiple terminals in advance Path, the address of target terminal where the audio/video flow for needing to obtain can also be carried in business parameters data, and then Streaming Media Server can receive the first sound that target terminal is acquired and sent by communication path corresponding with the address of the target terminal Video stream data, and by the first audio/video flow data forwarding to the software terminal in this terminal.
Wherein, the first audio/video flow data can be the audio/video flow data for meeting Internet protocol, the sound view used Frequency transport protocol can be Real-time Transport Protocol and be also possible to RTSP agreement.When receiving the first audio/video flow data by software terminal, then User can watch video on software terminal, when to avoid by receiving the first audio/video flow data in web client, web visitor When family end decodes audio/video flow data, browser can occupy a large amount of memory, cause audio-video Caton, postpone serious ask Topic.
Also, Web client directly starts software terminal automatically by web client according to audio-video business operation, can be with Avoid carrying out after audio-video business starts operation, conventional use manually boots software terminal so that software terminal delay 30s or 40s starting and caused by audio/video flow receive delay the problem of.
The embodiment of the present invention, terminal are included in web according to the audio-video business operation carried out in web client, generation The business parameters data of the user information logged in client is started software terminal by web client, and is stepped on using user information Software terminal is recorded, and business parameters data is sent to streaming media server via bridge service device, depending on networked server, so that stream Media server can provide audio-video service according to user information for software terminal, and terminal then can be by soft end for having logged on End receives the first audio/video flow data that streaming media server is sent.
By adopting the above technical scheme, since web client can start in response to audio-video business operation and log in soft end End, and the first audio/video flow data are received by software terminal, and then realize the progress audio-video industry in the web client of terminal The information of business is shown, instruction issues and Service control, and the broadcasting of audio-video is carried out on software terminal, software terminal sufficiently is utilized It supports the video decoding of web client and plays, and then realize the load bridging of audio-video business at the terminal, reduce The browser EMS memory occupation of web client improves audio/video decoding efficiency.
In conjunction with above embodiments, in one embodiment, refering to what is shown in Fig. 7, showing the step process of step 602 Figure, step 602 may comprise steps of:
Step 6021, it in response to the audio-video business operation, is triggered by the web client in the web client Preset hyperlink on end.
In present embodiment, customized URL Protocol agreement can be written to the registration table of installation software terminal in advance And in the registration table of web client, and the URL Protocol agreement is written in the html file where web client, In this way, when web client carries out audio-video business operation, response pop-up hyperlink.
Step 6022, the clicking operation carried out in the hyperlink according to user, by the web client obtain with The corresponding interface identifier of the hyperlink.
In present embodiment, when user's clickable hyperlinks, then the URL of the hyperlink can be parsed by web client Protocol agreement, it is however generally that, URL Protocol agreement corresponds to an interface identifier of software terminal, it can be understood as be Include the interface identifier of software terminal in URL Protocol agreement, then can be determined according to the interface identifier to software terminal.
Step 6023, according to the interface identifier, start the software terminal, and be activated using user information login The software terminal.
Determine to interface identifier it is corresponding be software terminal after, then can determine the soft end where the URL Protocol agreement The registration table at end realizes that the starting to software terminal can also be by this when starting software terminal by the registration table of the software terminal User information is passed to software terminal by URL Protocol agreement, to realize the automated log on of software terminal.
When by adopting the above technical scheme, terminal can pop up hyperlink and click for user in response to audio-video business operation, To start software terminal, facilitate user when carrying out audio-video business, chooses whether starting software terminal viewing video, optimize user Experience.
It is in one embodiment, described to be connected with multiple view networked terminals depending on networked server in conjunction with above embodiments, Step 601 may comprise steps of:
Step 6011, it according to the audio-video business operation, obtains associated at least with the audio-video business operation One view networking number.
In present embodiment, the audio-video business that terminal carries out is also possible to the audio-video interacted with depending on networked terminals Business.Specifically, depending on the aurora series terminal that networked terminals can be but be not limited in view networking, aurora series terminal is Depending on being exclusively used in the equipment for carrying out the functions such as audio and video playing, acquisition in networking, the decoding to audio-video may be implemented and will decode Audio video transmission to display play out.In the present embodiment, user carries out audio-video business behaviour in web client When making, at least one view networking number of available user's typing or selection, wherein can be regarded depending on networking number with unique identification Networked terminals.
Step 6012, the first business parameters data for meeting Internet protocol is generated.
It wherein, include the user information and view networking number in first business parameters data.
Correspondingly, step 603 may comprise steps of:
First business parameters data is sent to the bridge service device, the bridge joint by the web client Server is used to being converted to first business parameters data into the second business parameters data for meeting view networking protocol, and by institute It states the second business parameters data and is sent to the view networked server；The view networked server joins for establishing with each view View connected network communication path between the corresponding view networked terminals of network No. code, and, for being based on second business parameters data, Establish the communication with the streaming media server.
In present embodiment, bridge service device can be used for the second business parameters data being sent to view networked server, It can be used for the view connected network communication path established between view networked terminals for the second service parameter letter depending on networked server, this Sample, can be with to provide audio-video service depending on networked terminals, wherein streaming media server can also be established with view networked server Communication path, to realize that this terminal is connected to view networked server by streaming media server, and then with regard networked terminals The interaction of audio-video business.
Correspondingly, the method can with the following steps are included:
Step 605, the Streaming Media is sent to by the second audio/video flow data that the software terminal acquires itself to take Business device, the streaming media server are used to the second audio/video flow data being sent to the view networked server, the view Networked server is used to be based on the view connected network communication path, and the second audio/video flow data are sent to the view and are networked eventually End.
In present embodiment, after software terminal logins successfully, the camera of terminal can be started, automatically by software terminal to adopt Collect video, and the second audio/video flow data of acquisition are sent to by streaming media server by software terminal, wherein the second audio-video Flow data is the audio/video flow data for meeting Internet protocol, and streaming media server can be used for this meeting Internet protocol Audio, video data is converted to the view networking data packet for meeting view networking protocol, and view networking data packet is passed through view connected network communication road Diameter is sent to view networked terminals.
Using the embodiment above, since the audio-video business operation by web client establishes and regards networked terminals Audio-video service interaction, and by software terminal and regard networked terminals carry out audio, video data transmission.And then realize terminal With the data interaction between view networked terminals.
In conjunction with above embodiments, in one embodiment, the web client is also communicated to connect with web server, In Before step 601, can with the following steps are included:
Step 600a sends the first business message request to the web server by the web client.
Wherein, the first business message request includes multiple user identifiers；The web server is used for described first Business message request is sent to the first web client corresponding with the user identifier, and for receiving first web client The confirmation signaling that end is returned for the first business message request；It wherein, include according to described first in the confirmation signaling The terminal iidentification of the terminal of web client.
In present embodiment, user can issue inviting for audio-video business to other terminals in web client, for example, In video conference, user can pass through web client and invite to other users sending meeting, and in live streaming, user can lead to Cross the live information that web terminal issues oneself.Specifically, user can select to invite participation audio-video industry in web client The user name of the target user of business, and then the first business message request is generated by web client, and by the first business invitation letter Breath is sent to web server.Wherein, the user that user identifier can be registered in web client with unique identification.
Wherein, the first business message request is the information for meeting Internet protocol, web server can be used for by this first Business message request is sent to the first web client (hereinafter referred to as target user) corresponding with user identifier.First web client The first business message request can be shown to facilitate user to confirm the first business message request by end, with When family confirms the first business message request, then confirmation signaling can be returned.
In practice, confirm that the terminal iidentification carried in signaling can be the end that unique identification installs first web client The address at end is also possible to the mark that unique identification logs in the user information of first web client.
Step 600b receives the confirmation signaling that the web server returns by the web client.
Correspondingly, step 601 may comprise steps of:
Step 6011 ', it is opened according to the audio-video business that user carries out in the web client for the confirmation signaling Begin to operate, obtain the terminal iidentification in the confirmation signaling, and generating includes the user information and the terminal iidentification Business parameters data.
Correspondingly, step 602 may comprise steps of:
Step 602 ', start to operate in response to the audio-video business, the soft end is started by the web client End, and the software terminal being activated is logged in using the user information.
In present embodiment, terminal obtains what target user fed back after issuing the first business message request to target user When confirming signaling, the audio-video business that can be carried out in web client for the confirmation signaling according to user starts to operate, Generate above-mentioned business parameters data, and, obtain user for confirmation signaling audio-video business start operation when, starting Software terminal.It wherein, may include the terminal iidentification for confirming signaling and being fed back in business parameters data.
Correspondingly, step 603 may comprise steps of:
Step 603 ', business parameters data is sent to by the bridge service device, the bridge joint by the web client Server is used to the business parameters data being sent to the streaming media server, the streaming media server for establish with First audio/video communication path of the corresponding terminal of each terminal iidentification, and for being based on first audio/video communication path Receive the first audio/video flow data that terminal corresponding with each terminal iidentification acquires.
In present embodiment, when terminal obtains the confirmation signaling of target user, according to user to the video of confirmation signaling Business starts to operate, and issues business parameters data to streaming media server, in order to which streaming media server is established and the terminal The first audio/video communication path of corresponding terminal is identified, in this way, streaming media server can be for this terminal and terminal iidentification Corresponding terminal provides audio-video service.When it is implemented, this terminal can then be sent out by software terminal receiving stream media server The video stream data for being acquired and being encoded by the corresponding terminal of terminal iidentification sent.
Using the embodiment above, terminal can issue business to target user and invite, and obtain target user for industry It is engaged under the confirmation signaling invited, which can star to the operation of confirmation signaling according to user, and receive by software terminal The audio/video flow that the terminal of target user is acquired and sent has been widened application scenarios of the terminal in audio-video business as a result, has been made Terminal is obtained when as audio-video business promoter, software terminal can be started by web client.
In conjunction with above embodiments, in one embodiment, the web client is also communicated to connect with web server, In Before step 601, can with the following steps are included:
Step 600 ', the business sign on that the web server is sent is received by the web client.
The service order is generated and sent by the second web client；It wherein, include installation in the business sign on The terminal iidentification of the terminal of second web client.
In present embodiment, for other users when logging in web client, which is referred to as the second web client End, the web client installed in this terminal also can receive being sent by the second web client via web server forwarding Business sign on, that is to say, that this web client may be used also in addition to it can send business need information to other target users To receive the business sign on from other users, to participate in audio-video business as invited party.
Wherein, business sign on may include the terminal iidentification of terminal where the second web client, which can To be the address mark of unique identification terminal, it is also possible to log in the mark of the user of the second web client, for example, User ID. When being User ID, then the terminal for installing the second web client can also carry out the reception of audio/video flow data using software terminal And transmission.
Correspondingly, step 601 may comprise steps of:
Step 6011 ", the business for the business sign on carried out in the web client according to user are true Recognize operation, obtain the terminal iidentification of the business sign on, and generating includes the user information and the terminal mark The business parameters data of knowledge.
Correspondingly, step 602 may comprise steps of:
Step 602 ', in response to the business confirmation operation, the software terminal is started by the web client.
In present embodiment, terminal can start software terminal according to user to the business confirmation operation of business sign on, And to streaming media server feedback traffic parameter information, so that streaming media server is established and this terminal according to business parameters data Communication path, and according to the terminal iidentification in business parameters data confirm this terminal and install the second web client terminal It is both sides' relationship of progress audio-video service interaction, and then the sound between the terminal of the second web client of this terminal and installation Video interactive provides service.
Using the embodiment above, since this terminal can also receive the business sign on from the second web client, And the software terminal can star according to business confirmation operation of the user to business sign on, and receive second by software terminal The audio/video flow that terminal where web client is acquired and sent has widened applied field of the terminal in audio-video business as a result, Scape, so that terminal in the invited party as audio-video business, also can start software terminal by web client.
As shown in figure 8, being the place of audio-video business that provides of concrete application scene of the present embodiment combination audio-video business The instance graph of reason method, the audio-video business are video conference business, completely be may comprise steps of:
The first step, Android mobile phone initiate operation according to the video conference that user A is carried out in web client, and generation meets The invitation information of Internet protocol, wherein invitation information includes the user identifier of user B.
Meeting message request is sent to the web client that user B is logged on iPhone by second step, web server.
Third step, for user B when confirming to invitation information, iPhone passes through web client to web services Device returns to confirmation signaling, and according to the confirmation operation, starts the software terminal B being mounted on apple by web client.Wherein, It include the User ID according to user B in the confirmation signaling；
4th step, Android mobile phone receives the confirmation signaling that web server returns by web client, and is directed in user A When confirmation signaling progress video conference starts operation, the software terminal being mounted in Android mobile phone is started by web client automatically A, and conference parameters information is sent to bridge service device, it include the User ID and user A of user B in the conference parameters information User ID.
Meeting parameter information is sent to view networked server, is sent to depending on networked server by the 5th step, bridge service device Pre-registered streaming media server, streaming media server are then established according to conference parameters information and soft end in Android mobile phone respectively Hold A between the first communication path, and with the second communication path on iPhone between software terminal B.
6th step, Android mobile phone are taken by the video stream that Android mobile phone is acquired and encoded by software terminal A to Streaming Media Be engaged in device, and by the video flowing that is sent by software terminal B of streaming media server reception iPhone, with realize video conference into Row.
It should be noted that for simple description, therefore, it is stated as a series of action groups for embodiment of the method It closes, but those skilled in the art should understand that, embodiment of that present invention are not limited by the describe sequence of actions, because according to According to the embodiment of the present invention, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art also should Know, the embodiments described in the specification are all preferred embodiments, and the related movement not necessarily present invention is implemented Necessary to example.
With reference to Fig. 9, a kind of block diagram of the processing unit of audio-video business of the embodiment of the present invention is shown, described device is answered For any terminal in multiple terminals in video service system, web client and software terminal, institute are installed in the terminal It states software terminal and streaming media server communicates to connect, the web client and bridge service device communicate to connect, described device packet It includes:
Business information generation module 901, it is raw for the audio-video business operation that user carries out in the web client At business parameters data, wherein the business parameters data includes user information, wherein the user information is currently in institute State the user information logged in web client；
Software terminal starting module 902, in response to the audio-video business operation, by described in web client starting Software terminal, and the software terminal being activated is logged in using the user information；
Parameter information sending module 903, for business parameters data to be sent to the bridge joint by the web client Server, the bridge service device are used to the business parameters data being sent to the streaming media server；
Video reception module 904 is believed for receiving the streaming media server by the software terminal according to the user Cease at least one the first audio/video flow data sent；Wherein, the first audio/video flow data by with the streaming media service Device pre-establishes at least one terminal acquisition of communication path, and is sent to the streaming media server.
Optionally, the software terminal starting module includes:
Trigger module is triggered by the web client described for operating in response to the video traffic Preset dialog box in web client；
Interface determining module, the confirmation operation for being carried out in the dialog box according to user, passes through the web client End obtains the interface identifier with dialog box binding；
Starting module, for starting the software terminal according to the interface identifier；
Login module, for logging in the software terminal being activated using the user information.
Optionally, it is described be connected with depending on networked server it is multiple depending on networked terminals: the business information generation module includes:
Number acquiring unit, for obtaining related to the audio-video business operation according to the audio-video business operation At least one view networking number of connection；
Business parameters data generation unit, for generating the first business parameters data for meeting Internet protocol；Wherein, institute State in the first business parameters data includes the user information and view networking number；
The parameter information sending module is specifically used for first business parameters data through the web client It is sent to the bridge service device, the bridge service device meets view networking for being converted to first business parameters data Second business parameters data of agreement, and second business parameters data is sent to the view networked server；The view Networked server be used for establishes with it is each it is described view networking number it is corresponding regard networked terminals between view connected network communication path, with And for being based on second business parameters data, establish the communication with the streaming media server；
Described device further include:
Video sending module, the second audio/video flow data for being acquired itself by the software terminal are sent to described Streaming media server, the streaming media server are used to the second audio/video flow data being sent to the view the Internet services Device, the view networked server are used to be based on the view connected network communication path, and the second audio/video flow data are sent to institute State view networked terminals.
Optionally, the web client is also communicated to connect with web server, described device further include:
Message request sending module takes for sending the first business message request by the web client to the web Business device；Wherein, the first business message request includes multiple user identifiers；The web server is used for first industry Business message request is sent to the first web client corresponding with the user identifier, and for receiving first web client The confirmation signaling returned for the first business message request；It wherein, include according to the first web in the confirmation signaling The terminal iidentification of the terminal of client；
Signaling receiving module is confirmed, for receiving the confirmation that the web server returns by the web client Signaling；
The business information generation module is specifically used for being directed to the confirmation letter in the web client according to user It enables the audio-video business carried out start to operate, obtains the terminal iidentification in the confirmation signaling, and generating includes the use The business parameters data of family information and the terminal iidentification；
The software terminal starting module passes through the web visitor specifically for starting to operate in response to the audio-video business Family end starts the software terminal, and the software terminal being activated is logged in using the user information；
The parameter information sending module, specifically for business parameters data is sent to institute by the web client Bridge service device is stated, the bridge service device is used to the business parameters data being sent to the streaming media server, described Streaming media server is used to establish the first audio/video communication path of terminal corresponding with each terminal iidentification, and is used to be based on First audio/video communication path receives the first audio-video fluxion that terminal corresponding with each terminal iidentification acquires According to.
Optionally, described device further include:
Business sign on receiving module, for receiving the business that the web server is sent by the web client Sign on；The service order is generated and sent by the second web client；It wherein, include peace in the business sign on Fill the terminal iidentification of the terminal of second web client；
The business information generation module, specifically for according to user carried out in the web client for described The business confirmation operation of business sign on obtains the terminal iidentification of the business sign on, and it includes described for generating The business parameters data of user information and the terminal iidentification；
The software terminal starting module is specifically used for opening in response to the business confirmation operation by the web client Move the software terminal.
For the processing device embodiment of audio-video business, due to the processing method embodiment of itself and audio-video business Substantially similar, so being described relatively simple, referring to the part explanation of the processing method embodiment of audio-video business in place of correlation .
The embodiment of the invention also provides a kind of devices, comprising:
One or more processors；With
One or more machine readable medias of instruction are stored thereon with, are executed when by one or more of processors When, so that described device executes the processing method of one or more audio-video business as described in the embodiments of the present invention.
The embodiment of the invention also provides the computer programs of a kind of computer readable storage medium, storage to handle Device executes the processing method of audio-video business as described in the embodiments of the present invention.
All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are with The difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.
It should be understood by those skilled in the art that, the embodiment of the embodiment of the present invention can provide as method, apparatus or calculate Machine program product.Therefore, the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine software and The form of the embodiment of hardware aspect.Moreover, the embodiment of the present invention can be used one or more wherein include computer can With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code The form of the computer program product of implementation.
The embodiment of the present invention be referring to according to the method for the embodiment of the present invention, terminal device (system) and computer program The flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructions In each flow and/or block and flowchart and/or the block diagram in process and/or box combination.It can provide these Computer program instructions are set to general purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminals Standby processor is to generate a machine, so that being held by the processor of computer or other programmable data processing terminal devices Capable instruction generates for realizing in one or more flows of the flowchart and/or one or more blocks of the block diagram The device of specified function.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing terminal devices In computer-readable memory operate in a specific manner, so that instruction stored in the computer readable memory generates packet The manufacture of command device is included, which realizes in one side of one or more flows of the flowchart and/or block diagram The function of being specified in frame or multiple boxes.
These computer program instructions can also be loaded into computer or other programmable data processing terminal devices, so that Series of operation steps are executed on computer or other programmable terminal equipments to generate computer implemented processing, thus The instruction executed on computer or other programmable terminal equipments is provided for realizing in one or more flows of the flowchart And/or in one or more blocks of the block diagram specify function the step of.
Although the preferred embodiment of the embodiment of the present invention has been described, once a person skilled in the art knows bases This creative concept, then additional changes and modifications can be made to these embodiments.So the following claims are intended to be interpreted as Including preferred embodiment and fall into all change and modification of range of embodiment of the invention.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning Covering non-exclusive inclusion, so that process, method, article or terminal device including a series of elements not only wrap Those elements are included, but also including other elements that are not explicitly listed, or further includes for this process, method, article Or the element that terminal device is intrinsic.In the absence of more restrictions, being wanted by what sentence "including a ..." limited Element, it is not excluded that there is also other identical elements in process, method, article or the terminal device for including the element.
The processing of a kind of processing method of audio-video business provided by the present invention, a kind of audio-video business is filled above Set, a kind of device and a kind of computer readable storage medium are described in detail, specific case used herein is to this hair Bright principle and embodiment is expounded, method of the invention that the above embodiments are only used to help understand and its Core concept；At the same time, for those skilled in the art, according to the thought of the present invention, in specific embodiment and application There will be changes in range, in conclusion the contents of this specification are not to be construed as limiting the invention.

Claims (10)

1. a kind of processing method of audio-video business, which is characterized in that the method is applied to more in audio-video operation system Any terminal in a terminal is equipped with web client and software terminal, the software terminal and streaming media server in the terminal Communication connection, the web client and bridge service device communicate to connect, and the bridge service device and the streaming media server are equal Communication connection view networked server, which comprises
The audio-video business operation carried out in the web client according to user generates business parameters data, wherein described Business parameters data includes user information, and the user information is the user information currently logged in the web client；
In response to the audio-video business operation, the software terminal is started by the web client, and believe using the user Breath logs in the software terminal being activated；
Business parameters data is sent to the bridge service device by the web client, the bridge service device is used for will The business parameters data is sent to the streaming media server depending on networked server via described；
At least one first sound view that the streaming media server is sent according to the user information is received by the software terminal Frequency flow data；Wherein, the first audio/video flow data are by pre-establishing communication path at least with the streaming media server One terminal acquisition, and it is sent to the streaming media server.
2. the method according to claim 1, wherein passing through the web in response to the audio-video business operation Software terminal described in client terminal start-up, and the software terminal being activated is logged in using the user information, comprising:
In response to the audio-video business operation, hyperlink preset in the web client is triggered by the web client It connects；
According to the clicking operation that user carries out in the hyperlink, obtained and the hyperlink pair by the web client The interface identifier answered；
According to the interface identifier, start the software terminal, and logs in the software terminal being activated using the user information.
3. the method according to claim 1, wherein described be connected with multiple view networkings eventually depending on networked server End: the audio-video business operation carried out in the web client according to user generates business parameters data, comprising:
According to the audio-video business operation, at least one view networking number associated with the audio-video business operation is obtained Code；
Generate the first business parameters data for meeting Internet protocol；It wherein, include described in first business parameters data User information and view networking number；
Business parameters data is sent to the bridge service device by the web client, comprising:
First business parameters data is sent to the bridge service device, the bridge service by the web client Device is used to be converted to first business parameters data the second business parameters data for meeting view networking protocol, and by described the Two business parameters datas are sent to the view networked server；The view networked server is for establishing and each view networking number View connected network communication path between the corresponding view networked terminals of code, and, for being based on second business parameters data, establish With the communication of the streaming media server；
The method also includes:
The streaming media server, the stream matchmaker are sent to by the second audio/video flow data that the software terminal acquires itself Body server is used to the second audio/video flow data being sent to the view networked server, described to be used for depending on networked server Based on the view connected network communication path, the second audio/video flow data are sent to the view networked terminals.
4. the method according to claim 1, wherein the web client also with web server communicate to connect, Before the step of audio-video business operation carried out in the web client according to user, generation business parameters data, The method also includes:
The first business message request is sent to the web server by the web client；Wherein, first business is invited Please information include multiple user identifiers；The web server is for the first business message request to be sent to and the use Family identifies corresponding first web client, and for receiving first web client for the first business message request The confirmation signaling of return；It wherein, include terminal iidentification according to the terminal of first web client in the confirmation signaling；
The confirmation signaling that the web server returns is received by the web client；
The audio-video business operation carried out in the web client according to user generates business parameters data, comprising:
Start to operate according to the audio-video business that user carries out in the web client for the confirmation signaling, obtains institute The terminal iidentification in confirmation signaling is stated, and generates the service parameter letter including the user information and the terminal iidentification Breath；
In response to the audio-video business operation, the software terminal is started by the web client, and believe using the user Breath logs in the software terminal being activated, comprising:
Start to operate in response to the audio-video business, the software terminal is started by the web client, and use the use The software terminal that family information registration is activated；
Business parameters data is sent to the bridge service device by the web client, the bridge service device is used for will The business parameters data is sent to the streaming media server, comprising:
Business parameters data is sent to the bridge service device by the web client, the bridge service device is used for will The business parameters data is sent to the streaming media server, and the streaming media server is for establishing and each terminal mark Know the first audio/video communication path of corresponding terminal, and for based on first audio/video communication path receive with it is each described The first audio/video flow data of the corresponding terminal acquisition of terminal iidentification.
5. according to the method described in claim 4, it is characterized in that, described carry out in the web client according to user Before the step of audio-video business operation, generation business parameters data, the method also includes:
The business sign on that the web server is sent is received by the web client；The service order is by second Web client generates and sends；It wherein, include the terminal for installing second web client in the business sign on Terminal iidentification；
The audio-video business operation carried out in the web client according to user generates business parameters data, comprising:
The business confirmation operation for the business sign on carried out in the web client according to user obtains institute The terminal iidentification of business sign on is stated, and generates the service parameter letter including the user information and the terminal iidentification Breath；
In response to the audio-video business operation, the software terminal is started by the web client, comprising:
In response to the business confirmation operation, the software terminal is started by the web client.
6. a kind of processing unit of audio-video business, which is characterized in that described device is applied to multiple in video service system Any terminal in terminal, web client and software terminal are equipped in the terminal, and the software terminal and streaming media server are logical Letter connection, the web client and bridge service device communicate to connect, and described device includes:
Business information generation module generates business ginseng for the audio-video business operation that user carries out in the web client Number information, wherein the business parameters data includes user information, wherein the user information is currently in the web client The user information logged on end；
Software terminal starting module starts the software terminal by the web client in response to the audio-video business operation, And the software terminal being activated is logged in using the user information；
Parameter information sending module, for business parameters data to be sent to the bridge service device by the web client, The bridge service device is used to the business parameters data being sent to the streaming media server；
Video reception module, for receiving what the streaming media server was sent according to the user information by the software terminal At least one first audio/video flow data；Wherein, the first audio/video flow data by building in advance with the streaming media server At least one terminal acquisition of vertical communication path, and it is sent to the streaming media server.
7. device according to claim 6, which is characterized in that the software terminal starting module includes:
Trigger module, for being operated in response to the video traffic, by web client triggering in the web visitor Preset dialog box on the end of family；
Interface determining module, the confirmation operation for being carried out in the dialog box according to user, is obtained by the web client Take the interface identifier with dialog box binding；
Starting module, for starting the software terminal according to the interface identifier；
Login module, for logging in the software terminal being activated using the user information.
8. device according to claim 6, which is characterized in that the multiple terminal and view networked server communication connection, The business information generation module includes:
Number acquiring unit, for obtaining associated with the audio-video business operation according to the audio-video business operation At least one view networking number；
Business parameters data generation unit, for generating the first business parameters data for meeting Internet protocol；Wherein described It include the user information and view networking number in one business parameters data；
The parameter information sending module is specifically used for sending first business parameters data by the web client To the bridge service device, the bridge service device meets view networking protocol for being converted to first business parameters data The second business parameters data, and second business parameters data is sent to the view networked server；The view networking Server be used for establishes with it is each it is described view networking number it is corresponding view networked terminals between view connected network communication path, and, use In being based on second business parameters data, the communication with the streaming media server is established；
Described device further include:
Video sending module, the second audio/video flow data for being acquired itself by the software terminal are sent to the stream matchmaker Body server, the streaming media server are used to the second audio/video flow data being sent to the view networked server, institute View networked server is stated to be used to that the second audio/video flow data to be sent to the view and are joined based on the view connected network communication path Network termination.
9. a kind of device characterized by comprising
One or more processors；With
One or more machine readable medias of instruction are stored thereon with, when being executed by one or more of processors, are made Obtain the processing method for one or more audio-video business that described device is executed as described in claim 1 to 5.
10. a kind of computer readable storage medium, which is characterized in that its computer program stored executes processor as weighed Benefit requires the processing method of 1 to 5 described in any item audio-video business.
CN201910647613.7A 2019-07-17 2019-07-17 Audio and video service processing method and device Active CN110417877B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910647613.7A CN110417877B (en) 2019-07-17 2019-07-17 Audio and video service processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910647613.7A CN110417877B (en) 2019-07-17 2019-07-17 Audio and video service processing method and device

Publications (2)

Publication Number Publication Date
CN110417877A true CN110417877A (en) 2019-11-05
CN110417877B CN110417877B (en) 2022-05-31

Family

ID=68361797

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910647613.7A Active CN110417877B (en) 2019-07-17 2019-07-17 Audio and video service processing method and device

Country Status (1)

Country Link
CN (1) CN110417877B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111064916A (en) * 2019-12-02 2020-04-24 视联动力信息技术股份有限公司 Video call method and device, electronic equipment and storage medium
CN111654713A (en) * 2020-04-20 2020-09-11 视联动力信息技术股份有限公司 Live broadcast interaction method and device
CN111726645A (en) * 2020-05-07 2020-09-29 视联动力信息技术股份有限公司 Live broadcast control method and device, electronic equipment and storage medium
CN111818395A (en) * 2020-05-29 2020-10-23 视联动力信息技术股份有限公司 Page display method and device, terminal equipment and storage medium
CN114640893A (en) * 2022-03-10 2022-06-17 京东科技信息技术有限公司 Method and device for connecting service end of real-time audio and video communication system

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102118504A (en) * 2011-02-28 2011-07-06 中兴通讯股份有限公司 Methods and devices for calling local applications by means of mobile terminal browser
CN102393857A (en) * 2011-11-01 2012-03-28 中兴通讯股份有限公司 Method and system for local call based on web page
CN103617055A (en) * 2013-11-20 2014-03-05 北京奇虎科技有限公司 Browser and method and device of starting applications in browser
CN104021039A (en) * 2014-05-30 2014-09-03 北京金山网络科技有限公司 Calling method for APP and browser
CN105897902A (en) * 2016-05-05 2016-08-24 北京思特奇信息技术股份有限公司 Method and system for starting local application by browser
CN106372250A (en) * 2016-09-23 2017-02-01 郑州云海信息技术有限公司 Parameter passing method and device capable of starting local application through URL protocol
CN106873961A (en) * 2016-07-27 2017-06-20 阿里巴巴集团控股有限公司 The method and device that APP is applied is waken up by mobile browser
CN108322461A (en) * 2018-01-31 2018-07-24 百度在线网络技术（北京）有限公司 Method, system, device, equipment and the medium of application program automated log on
CN109246135A (en) * 2018-10-19 2019-01-18 视联动力信息技术股份有限公司 A kind of acquisition methods and system of stream medium data
CN109743526A (en) * 2018-12-13 2019-05-10 视联动力信息技术股份有限公司 A kind of communication connection method for building up and system based on view networking

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102118504A (en) * 2011-02-28 2011-07-06 中兴通讯股份有限公司 Methods and devices for calling local applications by means of mobile terminal browser
CN102393857A (en) * 2011-11-01 2012-03-28 中兴通讯股份有限公司 Method and system for local call based on web page
CN103617055A (en) * 2013-11-20 2014-03-05 北京奇虎科技有限公司 Browser and method and device of starting applications in browser
CN104021039A (en) * 2014-05-30 2014-09-03 北京金山网络科技有限公司 Calling method for APP and browser
CN105897902A (en) * 2016-05-05 2016-08-24 北京思特奇信息技术股份有限公司 Method and system for starting local application by browser
CN106873961A (en) * 2016-07-27 2017-06-20 阿里巴巴集团控股有限公司 The method and device that APP is applied is waken up by mobile browser
US20190155668A1 (en) * 2016-07-27 2019-05-23 Alibaba Group Holding Limited Awakening an application by means of a mobile browser
EP3493057A1 (en) * 2016-07-27 2019-06-05 Alibaba Group Holding Limited Method and apparatus for awakening application by means of mobile browser
CN106372250A (en) * 2016-09-23 2017-02-01 郑州云海信息技术有限公司 Parameter passing method and device capable of starting local application through URL protocol
CN108322461A (en) * 2018-01-31 2018-07-24 百度在线网络技术（北京）有限公司 Method, system, device, equipment and the medium of application program automated log on
CN109246135A (en) * 2018-10-19 2019-01-18 视联动力信息技术股份有限公司 A kind of acquisition methods and system of stream medium data
CN109743526A (en) * 2018-12-13 2019-05-10 视联动力信息技术股份有限公司 A kind of communication connection method for building up and system based on view networking

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111064916A (en) * 2019-12-02 2020-04-24 视联动力信息技术股份有限公司 Video call method and device, electronic equipment and storage medium
CN111654713A (en) * 2020-04-20 2020-09-11 视联动力信息技术股份有限公司 Live broadcast interaction method and device
CN111726645A (en) * 2020-05-07 2020-09-29 视联动力信息技术股份有限公司 Live broadcast control method and device, electronic equipment and storage medium
CN111818395A (en) * 2020-05-29 2020-10-23 视联动力信息技术股份有限公司 Page display method and device, terminal equipment and storage medium
CN114640893A (en) * 2022-03-10 2022-06-17 京东科技信息技术有限公司 Method and device for connecting service end of real-time audio and video communication system

Also Published As

Publication number Publication date
CN110417877B (en) 2022-05-31

Similar Documents

Publication Publication Date Title
CN110417877A (en) A kind of processing method and processing device of audio-video business
CN107979760A (en) The inspection method and device of a kind of live video
CN107979736A (en) The inspection method and device of a kind of video conference
CN109167960A (en) A kind of processing method and system of video stream data
CN110113299A (en) Data transmission method, device, signal server and computer-readable medium
CN108810444A (en) Processing method, conference dispatching end and the association of video conference turn server
CN110049274A (en) Video conference recording system
CN110190973A (en) A kind of presence detection method and device
CN110392126A (en) A kind of communication means and device
CN110049271A (en) A kind of view networking conferencing information methods of exhibiting and device
CN110475125A (en) Video transcoding method and device
CN110062195A (en) A kind of video conference cut-in method and system
CN110049346A (en) A kind of method and system of net cast
CN108809922B (en) A kind of audio fault handling method, conference dispatching end and view networked terminals
CN108809921A (en) A kind of audio-frequency processing method regards networked server and regards networked terminals
CN110392226A (en) A kind of live streaming implementation method and device
CN108966018B (en) Video broadcasting method, device, electronic equipment and storage medium based on view networking
CN110049268A (en) A kind of videophone connection method and device
CN110138728A (en) A kind of sharing method and device of video data
CN109286775A (en) A kind of multi-person conference control method and system
CN110536178A (en) A kind of live-broadcast control method and system
CN108881791B (en) A kind of conference control method and Conference control device based on view networking
CN110445759A (en) A kind of electronic whiteboard sharing method and device
CN110278244A (en) A kind of method of network entry and view networked terminals based on view networking
CN110392275A (en) A kind of sharing method of presentation, device and view networking software terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant