CN110062191A

CN110062191A - A kind of multi-party group meeting method and server based on view networking

Info

Publication number: CN110062191A
Application number: CN201910310303.6A
Authority: CN
Inventors: 乔金龙; 幺学佳; 萧辉; 李学军
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2019-04-17
Filing date: 2019-04-17
Publication date: 2019-07-26
Anticipated expiration: 2039-04-17
Also published as: CN110062191B

Abstract

The embodiment of the present application discloses a kind of multi-party group meeting method and server based on view networking.The described method includes: session initiation protocol sip server receives the first membership request that view networked terminals are sent via transfer server and the second membership that conference terminal is sent is requested；Target meeting mark and the sip server IP are carried in the first membership request and second membership request；The first membership response is sent via the transfer server to the view networked terminals according to target meeting mark and the sip server IP, and sends the second membership response to the conference terminal；First data transmission channel of the first membership response for establishing between the view networked terminals, the second membership response is for establishing the second data transmission channel between the conference terminal.Realize view networked terminals and internet terminal between data interchange, not by protocol layer difference bring limit to, also not by group can number of objects limited.

Description

A kind of multi-party group meeting method and server based on view networking

Technical field

This application involves view networking technology fields, can method and service more particularly to a kind of multi-party group based on view networking Device.

Background technique

Life, work with the fast development of view networking, based on video conference, video teaching for regarding networking etc. in user Make, learn etc. is widely available.

It is a kind of equipment for operating in link layer depending on networked terminals equipment, data are also to use two layers in a network Network protocol is transmitted, that is, passes through V2V agreement (Visual network To Visual network, depending on being networked to view connection The agreement of net) it realizes in multiple videophone audio datas and video data transmission for regarding the high quality between networked devices.And Common video terminal equipment is then three layers of progress data interaction based on agreements such as TCP/UDP/IP in its network.

How to realize the business intercommunication between the above-mentioned terminal device based on different agreement, is a problem to be solved.

Summary of the invention

In view of the above problems, it proposes the embodiment of the present application and overcomes the above problem or at least partly in order to provide one kind The multi-party group based on view networking to solve the above problems can method and corresponding sip server.

In a first aspect, the embodiment of the present application discloses a kind of method of multi-party group meeting based on view networking, the method packet It includes:

Session initiation protocol sip server receive the first membership request that view networked terminals are sent via transfer server with The second membership request that conference terminal is sent；Wherein, target is carried in the first membership request and second membership request Meeting identification and the sip server IP；

According to target meeting mark and the sip server IP to the view networked terminals via the transfer service Device sends the first membership response, and sends the second membership response to the conference terminal；Wherein, the first membership response is used for The first data transmission channel between the view networked terminals is established, the second membership response is for establishing and the meeting Second data transmission channel between terminal.

Optionally, the transfer server includes turning server depending on networked server and association；

The first membership request is issued by the view networked terminals, by the view networked server, and by described After association turns server progress protocol conversion, it is sent to the sip server；

The first membership response is issued by the sip server, is turned server by the association and is carried out protocol conversion, again The view networked terminals are sent to depending on networked server by described.

Optionally, the first data transmission channel is used for transmission the mixed data flow that the sip server is sent, and/ Or the first data flow that the view networked terminals are sent via the transfer server；

Second data transmission channel is used for transmission the mixed data flow and/or institute that the sip server is sent State the second data flow of conference terminal transmission；

Wherein, the mixed data flow is that the sip server will receive first data flow and second number According to what is obtained after the mixed screen processing of stream audio mixing.

The first data transmission channel is used for transmission the mixed data flow and/or the view that the sip server is sent The first data flow that networked terminals are sent via the transfer server, comprising:

The first data transmission channel is used for transmission to be issued by the sip server, is turned server by the association and is carried out Protocol conversion, and pass through the mixed data flow that the view networked terminals are sent to depending on networked server；And/or

The first data transmission channel is used for transmission to be issued by the view networked terminals, by the view the Internet services Device, and first data flow that server carries out protocol conversion is turned by the association.

Second aspect, the embodiment of the present application disclose a kind of server, comprising:

Message reception module is received for session initiation protocol sip server and is sent out depending on networked terminals via transfer server The second membership request that the first membership request sent and conference terminal are sent；Wherein, the first membership request and described second Target meeting mark and the sip server IP are carried in membership request；

Message transmission module, for being networked eventually according to target meeting mark and the sip server IP to the view End sends the first membership response via the transfer server, and sends the second membership response to the conference terminal；Wherein, institute State first data transmission channel of the first membership response for establishing between the view networked terminals, the second membership response For establishing the second data transmission channel between the conference terminal.

The third aspect, the embodiment of the present application also disclose a kind of computer equipment, including memory, processor and are stored in On memory and the computer program that can run on a processor, the processor are realized above-mentioned when executing the computer program Any the method for first aspect.

Fourth aspect, the embodiment of the present application also disclose a kind of computer readable storage medium, described computer-readable to deposit Storage media is stored with the computer program for executing above-mentioned any the method for first aspect.

Multi-party group meeting method provided by the embodiments of the present application based on view networking, receives view networking eventually by sip server The second membership that the first membership request and conference terminal that end is sent via transfer server are sent is requested；Wherein, described first Target meeting mark and the sip server IP are carried in membership request and second membership request；According to the target meeting It assesses a bid for tender to know and sends the first membership response via the transfer server to the view networked terminals with the sip server IP, and The second membership response is sent to the conference terminal；Wherein, the first membership response is for establishing and the view networked terminals Between first data transmission channel, second membership response transmits for establishing the second data between the conference terminal Channel.To realize the data interchange between view networked terminals and internet terminal, do not limited to by protocol layer difference bring, Also not by group can number of objects limited, expanded view networking application.

Detailed description of the invention

Fig. 1 is a kind of networking schematic diagram of view networking provided by the embodiments of the present application；

Fig. 2 is a kind of hardware structural diagram of node server provided by the embodiments of the present application；

Fig. 3 is a kind of hardware structural diagram of access switch provided by the embodiments of the present application；

Fig. 4 is the hardware structural diagram that a kind of Ethernet association provided by the embodiments of the present application turns gateway；

Fig. 5 is system architecture diagram provided by the embodiments of the present application；

Fig. 6 is the step flow chart of the multi-party group meeting method provided by the embodiments of the present application based on view networking；

Fig. 7 is embodiment of the method flow chart provided by the embodiments of the present application；

Fig. 8 is one exemplary diagram of embodiment of the method provided by the embodiments of the present application；

Fig. 9 is the structural block diagram of server provided by the embodiments of the present application.

Specific embodiment

In order to make the above objects, features, and advantages of the present application more apparent, with reference to the accompanying drawing and it is specific real Applying mode, the present application will be further described in detail.

It is the important milestone of network Development depending on networking, is a real-time network, can be realized HD video real-time Transmission, Push numerous Internet applications to HD video, high definition is face-to-face.

Real-time high-definition video switching technology is used depending on networking, it can be such as high in a network platform by required service Clear video conference, Intellectualized monitoring analysis, emergency command, digital broadcast television, delay TV, the Web-based instruction, shows video monitoring Field live streaming, VOD program request, TV Mail, individual character records (PVR), Intranet (manages) channel by oneself, intelligent video Broadcast Control, information publication All be incorporated into a system platform etc. services such as tens of kinds of videos, voice, picture, text, communication, data, by TV or Computer realizes that high-definition quality video plays.

To make those skilled in the art more fully understand the embodiment of the present application, it is introduced below to depending on networking:

Depending on networking, applied portion of techniques is as described below:

Network technology (Network Technology)

Traditional ethernet (Ethernet) is improved depending on the network technology innovation networked, with potential huge on network Video flow.(Circuit is exchanged different from simple network packet exchange (Packet Switching) or lattice network Switching), meet Streaming using network packet exchange depending on networking technology (to be translated into stream, stream, streaming, be one Kind data transferring technique, becomes the data received the stream of one steady and continuous, continuously sends out, the sound for hearing user Sound or the image seen are very steady, and user can start to carry out on the screen before entire data transmission is complete it is clear Look at) demand.Have flexible, the simple and low price of packet switch depending on networking technology, is provided simultaneously with the quality and safety of circuit switching Guarantee, realizes the seamless connection of the whole network switched virtual circuit and data format.

Switching technology (Switching Technology)

Two advantages of asynchronous and packet switch that Ethernet is used depending on networking eliminate Ethernet under the premise of complete compatible and lack It falls into, has the end-to-end seamless connection of the whole network, direct user terminal, directly carrying IP data packet.User data is in network-wide basis It is not required to any format conversion.It is the more advanced form of Ethernet depending on networking, is a real-time exchange platform, can be realized at present mutually The whole network large-scale high-definition realtime video transmission that networking cannot achieve pushes numerous network video applications to high Qinghua, unitizes.

Server technology (Server Technology)

It is different from traditional server, its Streaming Media depending on the server technology in networking and unified video platform Transmission be built upon it is connection-oriented on the basis of, data-handling capacity is unrelated with flow, communication time, single network layer energy Enough transmitted comprising signaling and data.For voice and video business, handled depending on networking and unified video platform Streaming Media Complexity many simpler than data processing, efficiency substantially increase hundred times or more than traditional server.

Reservoir technology (Storage Technology)

The ultrahigh speed reservoir technology of unified video platform in order to adapt to the media content of vast capacity and super-flow and Using state-of-the-art real time operating system, the programme information in server instruction is mapped to specific hard drive space, media Content is no longer pass through server, and moment is directly delivered to user terminal, and user waits typical time less than 0.2 second.It optimizes Sector distribution greatly reduces the mechanical movement of hard disc magnetic head tracking, and resource consumption only accounts for the 20% of the internet ad eundem IP, but The concurrent flow greater than 3 times of traditional disk array is generated, overall efficiency promotes 10 times or more.

Network security technology (Network Security Technology)

Depending on the structural design networked by servicing independent licence system, equipment and the modes such as user data is completely isolated every time The network security problem that puzzlement internet has thoroughly been eradicated from structure, does not need antivirus applet, firewall generally, has prevented black The attack of visitor and virus, structural carefree secure network is provided for user.

It services innovative technology (Service Innovation Technology)

Business and transmission are fused together by unified video platform, whether single user, private user or a net The sum total of network is all only primary automatic connection.User terminal, set-top box or PC are attached directly to unified video platform, obtain rich The multimedia video service of rich colorful various forms.Unified video platform is traditional to substitute with table schema using " menu type " Complicated applications programming, considerably less code, which can be used, can be realized complicated application, realize the new business innovation of " endless ".

Networking depending on networking is as described below:

It is a kind of central controlled network structure depending on networking, which can be Tree Network, Star network, ring network etc. class Type, but centralized control node is needed to control whole network in network on this basis.

As shown in Figure 1, being divided into access net and Metropolitan Area Network (MAN) two parts depending on networking.

The equipment of access mesh portions can be mainly divided into 3 classes: node server, access switch, terminal (including various machines Top box, encoding board, memory etc.).Node server is connected with access switch, and access switch can be with multiple terminal phases Even, and it can connect Ethernet.

Wherein, node server is the node that centralized control functions are played in access net, can control access switch and terminal. Node server can directly be connected with access switch, can also directly be connected with terminal.

Similar, the equipment of metropolitan area mesh portions can also be divided into 3 classes: metropolitan area server, node switch, node serve Device.Metropolitan area server is connected with node switch, and node switch can be connected with multiple node servers.

Wherein, node server is the node server for accessing mesh portions, i.e. node server had both belonged to access wet end Point, and belong to metropolitan area mesh portions.

Metropolitan area server is the node that centralized control functions are played in Metropolitan Area Network (MAN), can control node switch and node serve Device.Metropolitan area server can be directly connected to node switch, can also be directly connected to node server.

It can be seen that be entirely a kind of central controlled network structure of layering depending on networking network, and node server and metropolitan area The network controlled under server can be the various structures such as tree-shaped, star-like, cyclic annular.

Visually claim, access mesh portions can form unified video platform (part in circle), and multiple unified video platforms can To form view networking；Each unified video platform can be interconnected by metropolitan area and wide area depending on networking.

Classify depending on networked devices

1.1 the embodiment of the present application can be mainly divided into 3 classes: server depending on the equipment in networking, interchanger (including ether Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).Depending on networking can be divided on the whole Metropolitan Area Network (MAN) (or National net, World Wide Web etc.) and access net.

1.2 equipment for wherein accessing mesh portions can be mainly divided into 3 classes: node server, access switch (including ether Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).

The specific hardware structure of each access network equipment are as follows:

Node server:

As shown in Fig. 2, mainly including Network Interface Module 201, switching engine module 202, CPU module 203, disk array Module 204.

Wherein, Network Interface Module 201, the Bao Jun that CPU module 203, disk array module 204 are come in enter switching engine Module 202；Switching engine module 202 look into the operation of address table 205 to the packet come in, to obtain the navigation information of packet； And the packet is stored according to the navigation information of packet the queue of corresponding pack buffer 206；If the queue of pack buffer 206 is close It is full, then it abandons；All pack buffer queues of 202 poll of switching engine mould, are forwarded: 1) port if meeting the following conditions It is less than to send caching；2) the queue package counting facility is greater than zero.Disk array module 204 mainly realizes the control to hard disk, including The operation such as initialization, read-write to hard disk；CPU module 203 is mainly responsible between access switch, terminal (not shown) Protocol processes, to address table 205 (including descending protocol packet address table, uplink protocol package address table, data packet addressed table) Configuration, and, the configuration to disk array module 204.

Access switch:

As shown in figure 3, mainly including Network Interface Module (downstream network interface module 301, uplink network interface module 302), switching engine module 303 and CPU module 304.

Wherein, the packet (upstream data) that downstream network interface module 301 is come in enters packet detection module 305；Packet detection mould Whether destination address (DA), source address (SA), type of data packet and the packet length of the detection packet of block 305 meet the requirements, if met, It then distributes corresponding flow identifier (stream-id), and enters switching engine module 303, otherwise abandon；Uplink network interface mould The packet (downlink data) that block 302 is come in enters switching engine module 303；The data packet that CPU module 304 is come in enters switching engine Module 303；Switching engine module 303 look into the operation of address table 306 to the packet come in, to obtain the navigation information of packet； If the packet into switching engine module 303 is that downstream network interface is gone toward uplink network interface, in conjunction with flow identifier (stream-id) packet is stored in the queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full, It abandons；If the packet into switching engine module 303 is not that downstream network interface is gone toward uplink network interface, according to packet Navigation information is stored in the data packet queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full, Then abandon.

All pack buffer queues of 303 poll of switching engine module, are divided to two kinds of situations in the embodiment of the present application:

If the queue is that downstream network interface is gone toward uplink network interface, meets the following conditions and be forwarded: 1) It is less than that the port sends caching；2) the queue package counting facility is greater than zero；3) token that rate control module generates is obtained.

If the queue is not that downstream network interface is gone toward uplink network interface, meets the following conditions and is forwarded: 1) it is less than to send caching for the port；2) the queue package counting facility is greater than zero.

Rate control module 208 is configured by CPU module 204, to all downlink networks in programmable interval Interface generates token toward the pack buffer queue that uplink network interface is gone, to control the code rate of forwarded upstream.

CPU module 304 is mainly responsible for the protocol processes between node server, the configuration to address table 306, and, Configuration to rate control module 308.

Ethernet association turns gateway:

As shown in figure 4, mainly including Network Interface Module (downstream network interface module 401, uplink network interface module 402), switching engine module 403, CPU module 404, packet detection module 405, rate control module 408, address table 406, Bao Huan Storage 407 and MAC adding module 409, MAC removing module 410.

Wherein, the data packet that downstream network interface module 401 is come in enters packet detection module 405；Packet detection module 405 is examined Ethernet mac DA, ethernet mac SA, Ethernet length or frame type, the view networking destination address of measured data packet DA, whether meet the requirements depending on networking source address SA, depending on networking data Packet type and packet length, corresponding stream is distributed if meeting Identifier (stream-id)；Then, MAC DA, MAC SA, length or frame type are subtracted by MAC removing module 410 (2byte), and enter corresponding receive and cache, otherwise abandon；

Downstream network interface module 401 detects the transmission caching of the port, if there is Bao Ze is according to the view of packet networking purpose Address D A knows the ethernet mac DA of corresponding terminal, adds the ethernet mac DA of terminal, Ethernet assists the MAC for turning gateway SA, Ethernet length or frame type, and send.

The function that Ethernet association turns other modules in gateway is similar with access switch.

Terminal:

It mainly include Network Interface Module, Service Processing Module and CPU module；For example, set-top box mainly connects including network Mouth mold block, video/audio encoding and decoding engine modules, CPU module；Encoding board mainly includes Network Interface Module, video encoding engine Module, CPU module；Memory mainly includes Network Interface Module, CPU module and disk array module.

The equipment of 1.3 metropolitan area mesh portions can be mainly divided into 3 classes: node server, node switch, metropolitan area server. Wherein, node switch mainly includes Network Interface Module, switching engine module and CPU module；Metropolitan area server mainly includes Network Interface Module, switching engine module and CPU module are constituted.

2, networking data package definition is regarded

2.1 access network data package definitions

Access net data packet mainly include following sections: destination address (DA), source address (SA), reserve bytes, payload(PDU)、CRC。

As shown in the table, the data packet for accessing net mainly includes following sections:

DA

SA

Reserved

Payload

CRC

Destination address (DA) is made of 8 bytes (byte), and first character section indicates type (such as the various associations of data packet Discuss packet, multicast packet, unicast packet etc.), be up to 256 kinds of possibility, the second byte to the 6th byte is metropolitan area net address, Seven, the 8th bytes are access net address.

Source address (SA) is also to be made of 8 bytes (byte), is defined identical as destination address (DA).

Reserve bytes are made of 2 bytes.

The part payload has different length according to the type of different datagrams, if the type of datagram is various Protocol package, then the length of the part payload is 64 bytes, if the type of datagram is single group unicast packets, payload Partial length is 32+1024=1056 byte, is not restricted to above 2 kinds certainly.

CRC is made of 4 bytes, and calculation method follows the Ethernet CRC algorithm of standard.

2.2 Metropolitan Area Network (MAN) packet definitions

The topology of Metropolitan Area Network (MAN) is pattern, may there is 2 kinds, connection even of more than two kinds, i.e. node switching between two equipment It can all can exceed that 2 kinds between machine and node server, node switch and node switch, node switch and node server Connection.But the metropolitan area net address of metropolitan area network equipment is uniquely, to close to accurately describe the connection between metropolitan area network equipment System, introduces parameter in the embodiment of the present application: label, uniquely to describe a metropolitan area network equipment.

In this specification label definition and multiprotocol label switching (Multi-Protocol Label Switch, MPLS the definition of label) is similar, it is assumed that there are two connections between equipment A and equipment B, then data packet is from equipment A to equipment B Just there are 2 labels, data packet also there are 2 labels from equipment B to equipment A.Label is divided into label, outgoing label, it is assumed that data packet into The label (entering label) for entering equipment A is 0x0000, and the label (outgoing label) when this data packet leaves equipment A may reform into 0x0001.The networking process of Metropolitan Area Network (MAN) is to enter network process under centralized control, also means that address distribution, the label of Metropolitan Area Network (MAN) Distribution be all to be dominated by metropolitan area server, node switch, node server be all passively execute, this point with The label distribution of MPLS is different, and the distribution of the label of MPLS is the result that interchanger, server are negotiated mutually.

As shown in the table, the data packet of Metropolitan Area Network (MAN) mainly includes following sections:

DA

SA

Reserved

Label

Payload

CRC

That is destination address (DA), source address (SA), reserve bytes (Reserved), label, payload (PDU), CRC.Its In, the format of label, which can refer to, such as gives a definition: label is 32bit, wherein high 16bit retains, only with low 16bit, its position Set is between the reserve bytes and payload of data packet.

It is communication protocol of the row in view networking depending on networking protocol, is mainly based upon the data link information of Layer 2 switch The agreement of function of exchange exploitation.

Session initiation Protocol (Session Initiation Protocol, SIP) is the signaling control association an of application layer View, for creating, modifying and discharging the session of one or more participants.These sessions can be Internet multimedia meeting View, IP phone or multimedia delivery.The participant of session can by multicast (multicast), netted unicast (unicast) or The mixture of the two is communicated.

Public network video conference uses the public IP address of internet as video micro-control unit (Microcontroller Unit, MCU) IP, and then the meeting created on MCU, mode described in this application are that terminal active call is added to public affairs The mode of net meeting.

Currently, the widespread development with view networking service in China regards connection interaction technique each depending on networking high definition Very important effect is played in a industry.Depending on networking using the state-of-the-art real-time high-definition video switching technology in the whole world, realize The whole network HD video real-time Transmission that current internet cannot achieve, by HD video meeting, video monitoring, remote training, Tens of kinds of videos, the languages such as Intellectualized monitoring analysis, emergency command, visual telephone, live broadcast, TV Mail and information publication The services such as sound, picture, text, communication and data are all incorporated into a system platform, realize high definition by multiple terminal equipment Quality video communication is interconnected in real time.

The embodiment of the present application is the technical solution that internet meeting is added in a kind of mode depending on networked terminals active call, SIP can both support video conference or support video monitoring, be a kind of convenience for the H323 agreement compared with traditional complexity Succinct agreement, so will use SIP often in practical application to support video conference.

It realizes in the prior art and assists carryover sequence to call by gateway SIP depending on the video conference terminal under networking protocol The video conference terminal of SIP is only limitted to the video conference function of the view networked terminals of the point-to-point calling SIP of view networking, most Two equipment can only be mostly supported to carry out meeting (carrying out calling connection for the SIP ID of other side).Multiple spot group can this high-level meeting Form is not yet realized.Therefore, it in order to carry out Multi-Party Conference, needs new to be added to SIP MCU clothes depending on networked terminals active call It is engaged in the meeting of device creation, converses with conference terminal in a meeting.

Fig. 5 shows a kind of applicable system architecture of the embodiment of the present application, as shown in figure 5, system includes that n view networking is whole End, view networking switches, view networked server, protocol conversion server (referred to as association turns server), to interconnect network switch, n a Conference terminal and MCU server.

The exchange route network equipment for directly passing through communication line depending on networked terminals establishes network company with depending on networked server It connects；And conference terminal networks to authorize to need to dispose to assist and turns server, it includes double netcard that the association, which turns server, and one end network interface card leads to It crosses the view networking switches to connect with described depending on networked server, other end network interface card passes through the interconnection network switch and institute State conference terminal connection.The view networked terminals are connect with described depending on networked server by switch device and cable.Pass through The above-mentioned network architecture establish view networked terminals and conference terminal and view networked server between connection, with this complete terminal with Depending on the inside and outside communication and data connection between networked server.

View networked server is accessed for conference terminal, needs to turn the medium that server is converted as intermediate protocol using association Realize the connection of terminal and server, specific implementation process can be with are as follows: every first allows the association to network to turn server all to exist It is registered in networked server, association turns sequence number (including device type and the equipment that the registration information of server turns server by assisting Identification information), downlink port number, the intrinsic informations such as mask section, the association not registered, which turns server, to network.Specific steps It is as follows:

Step 1: view networked server sends inquiry packet to its each port.

Step 2: association turn server receive inquiry packet after, to view networked server return comprising assist turn server series Number response bag.

Step 3: association corresponding with the sequence number is searched in Registry depending on networked server and turns server letter Breath, it is described association turn server info can specifically include association turn server physical address (Media Access Control, MAC) and the association turns the MAC Address of the conference terminal bound under server.

Step 4: view networked server Xiang Xiezhuan server sends the order that networks, and turns server comprising association in the order that networks Depending in networking address and association turn the MAC Address of server.

Step 5: association turns to return to response after server receives networking order, and association turns server and then accessed view networking.

Step 6: turn server to the association of networking depending on networked server timing and issue device status inquiries instruction, checking should Association turns whether server works normally.

Step 7: the conference terminal MAC Address and conference terminal that turn to bind under server will be assisted depending on networked server MAC Address and the view networking address to be allocated to conference terminal map, and all notify the association to turn server, and then conference terminal can It is networked with turning server by association.

After conference terminal accesses view networked server, conference terminal user can send request data to association and turn service Device, You Xiezhuan server carries out dissection process, and is issued instruction by network interface card one end of connection view networked server, then by regarding Networked server carries out vision signal and/or audio signal scheduling controlling, and vision signal and/or audio signal are sent back to association and turned Server has the network interface card of connection internet to be emitted to conference terminal user.

It can be used for being managed collectively the terminal after the authorization that networks depending on networked server.For example, view networked server It can safeguard that the terminal of all terminals enters netlist, terminal enters to have recorded number, title, addressable address of terminal etc. in netlist, depending on The terminal that networked server only enters configured networking in netlist to terminal carries out control scheduling.When initiating video conference business, The terminal which needs to attend a meeting can be entered to choose in netlist from terminal depending on networked server, which just only takes these terminals Business.

Fig. 6 show it is provided by the embodiments of the present application it is a kind of based on view networking multi-party group can method, this multi-party group understand Method can be applied to sip server.The following steps are included:

Step 601:SIP server receives the first membership request and meeting that view networked terminals are sent via transfer server The second membership request that terminal is sent；Wherein, target meeting is carried in the first membership request and second membership request Mark and the sip server IP.

Step 602: according to target meeting mark and the sip server IP to the view networked terminals via described Transfer server sends the first membership response, and sends the second membership response to the conference terminal；Wherein, first membership First data transmission channel of the response for establishing between the view networked terminals, second membership response for establishing and Second data transmission channel between the conference terminal.

In a kind of possible embodiment, the transfer server includes turning server depending on networked server and association；Institute Stating the first membership request is issued by the view networked terminals, turns server by the view networked server, and by the association After carrying out protocol conversion, it is sent to the sip server；The first membership response is issued by the sip server, by The association turns server and carries out protocol conversion, and is sent to the view networked terminals depending on networked server by described.

In a kind of possible embodiment, the first data transmission channel is used for transmission the sip server and sends Mixed data flow and/or first data flow that is sent via the transfer server of view networked terminals；Second number The mixed data flow that the sip server is sent is used for transmission according to transmission channel and/or the conference terminal is sent the Two data flows；Wherein, the mixed data flow is that the sip server will receive first data flow and second number According to what is obtained after the mixed screen processing of stream audio mixing.

In a kind of possible embodiment, the transfer server includes turning server depending on networked server and association；Institute It states first data transmission channel and is used for transmission and issued by the sip server, server is turned by the association and carries out protocol conversion, again By the mixed data flow for being sent to the view networked terminals depending on networked server；And/or the first data transmission is logical Road is used for transmission to be issued by the view networked terminals, by the view networked server, and is turned server by the association and is assisted Discuss first data flow of conversion.

In multi-party group meeting method provided by the embodiments of the present application based on view networking, several void are can be generated in a server Quasi- terminal, the channel of the corresponding calling of each virtual terminal, contain in the attribute of virtual terminal into SIP meeting Location.By view networking number translated at the meeting address of SIP, therefore view networked terminals can be represented depending on networking number, meeting is added Call channel.Further, it will be mapped one by one depending on the video conference address of networking number and SIP, completion regards networking number as SIP view Frequency calls the automatic conversion of address.

For regarding networked terminals active call and the internet meeting of SIP is added, depending on networked terminals as calling party.It is first First, it needs to create a meeting room on sip server, specifying meeting number is 101, the meeting being then then turned under a SIP Terminal is added in the meeting in the mode of calling address field input " 101@sip server IP ".Turn server in association again Virtual terminal is configured depending on networking number and the meeting address binding for needing to be added in virtual terminal arrangement shelves, in this way, when SIP takes After business device configures virtual terminal, the channel object of calling can be created that automatically to assist the meeting of being transferred to, when in view networked terminals Address of cache is carried out when incoming call number, after being converted into SIP call signaling depending on networking call signaling, is successfully accessed meeting Room.It can support that many terminals are similarly operated in this way, into the same SIP meeting, to realize multi-party group meeting.

It should be noted that channel is the abstract concept in call flow, it is equivalent to and transmits data in the duct.And channel Object is exactly that association turns call information and audio-video number that server virtual terminal needs a channel to send to sip server According to.

Since the vision signal and/or audio signal code rate and format of distinct device output are possible to disunity, need to lead to The coding module crossed in terminal carries out encoding and decoding processing: being processed into unified audio-video code rate source signal.Exist depending on networked terminals Receive view networked server send network flow after, processing is decoded to network flow, with obtain corresponding video and/or Audio, and then shown on depending on networked terminals.

It in one possible implementation, can be by this after the source signal that terminal transmission is received depending on networked server A little source signals are sent to multiplexer (Multiplexer, MUX) equipment, and the mixing of source signal is carried out by MUX equipment, obtains net Network stream, and view networked server is returned to by MUX equipment.For example, conference terminal can be by 2 tunnels in video conferencing system Input source is sent to view networked server, is mixed by sending this 2 road input source depending on networked server to MUX equipment, MUX is set It is standby that the network flow mixed is returned into view networked server, depending on networked server according to scheduling request by mixed network flow It issues.

There is lot of advantages using the mixing that MUX equipment carries out multichannel audio-video frequency, such as: according to dispatching requirement, carry out more Road audio-video MUX mixing, generates the transport stream (TS Transport Stream) of Polymera；Meeting place name is added to by support In network flow；According to dispatching requirement, the audio mixing of the conjunction screen and audio of video is carried out；There are MUX equipment many different interfaces to connect Radio reception video data, and can be mixed accordingly according to the demand of terminal, therefore the dynamic of mixed flow, conjunction screen stream is supported to cut It changes；The stream file format of equipment output can be configured to the formats such as TS file, mp4 (MPEG-4Part 14)；Close the video after shielding Code rate, resolution ratio can self-settinies；Support the parallel processing of multiple groups stream；The network flow of output and recording, which are spread, is defeated by each end End, to realize meeting viewing and network REC function.

In the specific implementation, regarding networked terminals equipment can be set-top box (Set Top Box, STB), commonly referred to as set-top box Or box on machine, it is the equipment of connection a television set and outside source, it can change into the digital signal of compression in TV Hold, and shows on a television set.In general, set-top box can connect camera and microphone, for acquiring video counts According to the multi-medium datas such as audio data, also can connect television set, for multimedias such as playing video data and audio datas Data.

Therefore in practical application, user can be by some operations in menu (gtml) file, for example dial opposite end Set-top box Subscriber Number, triggering view networked terminals generate control service request instruction, be sent to view networked server.

It can also include external interface depending on networked terminals equipment, as USB interface, HDMI_OUTx2 interface, HDMI_IN connect Mouth, card agriculture head interface, RCA (Radio Corporation of American, RC interface) and AV interface etc..

Fig. 7 shows the specific steps figure of multi-party group of meeting method provided by the embodiments of the present application, before carrying out membership request, Environment is first built, association is opened and turns server, configuration virtual terminal number and Session Initiation Protocol meeting address.Wherein, depending on networking module, mixed Sound, which mixes panel module, can control module, RTP encapsulation module and SIP association revolving die block belongs to association and turns server.

Calling each time is initiated by a terminal, and the transmission that channel carries out audio-video is then set up；Use view networking number The destination address of code calling is the meeting room address an of Session Initiation Protocol, needs for source address and destination address to be associated；Depending on connection Network No. code is the mark for the virtual terminal that association turns server；The virtual terminal that wherein association turns server will regard networking protocol and SIP Agreement is converted, and on the one hand to be shown view networking identity, on the other hand be needed to know which SIP meeting entered after protocol conversion View.

Step 701: view networked terminals send first to view networked server by the view networking number in call arrangement shelves Call request, and the audio/video flow of view networking protocol.

Step 702: the first call request and audio/video flow being forwarded to view networking module depending on networked server.

Step 703: since the communication between the internal module that association turns server calls engine using based on Yate Message mechanism, therefore, depending on networking module by the first call request be packaged into Yate type the second call request and sound regard Frequency stream is sent to SIP association revolving die block.

Step 704:SIP assists revolving die block that the second call request and audio/video flow are converted into the third call request under SIP, It is sent on SIP MCU server.

Step 705:SIP MCU server returns to the first call and turns to SIP association after receiving third call request Module.

Step 706:SIP assists revolving die root tuber to recognize the first invitation message according to first call, passes through Yate message, which is sent to, can control module.

First call is sent to view networking module simultaneously by step 707:SIP association revolving die block.

Step 708: sending the mixed panel module of activate message (Yate message) activation audio mixing after module starting can be controlled.

Step 709: depending on networking module after receiving the first call, the second calling for changing into view networking protocol is rung It answers, is sent to view networked server.

Step 710: view networked server forwards the second call to give view networked terminals.

Step 711: identical SIP meeting address, accessing conference are called on third party device, that is, conference terminal of docking.

It is the membership call flow for regarding networked terminals and conference terminal above.

Step 712:SIP MCU server formulates the span mode of display according to the demand of user, carries out to audio/video flow Mixed screen, obtains the first audio/video flow；Conference terminal is sent by the first audio/video flow.

First audio/video flow is likewise transmitted to the RTP encapsulation mould that SIP association turns server by step 713:SIP MCU server Block.

The first audio/video flow received is sent mixed screen mix module by step 714:RTP package module, the module from Module can be controlled and receive Yate and mix and shield instruction, mix screen mix module progress encoding and decoding, what generation can be watched normally depending on networked terminals Second audio/video flow.

Step 715: the second audio/video flow is sent view networking module by mixed screen mix module.

Step 716: same, SIP MCU server can do audio mixing to the audio/video flow of the conference terminal of membership and mix screen processing, Then it is separately sent on the conference terminal attended a meeting.

Step 717, step 718: after receiving the second audio/video flow depending on networking module, view networking protocol can be packaged into Third audio/video flow.

Step 719: sending view networked server for third audio/video flow depending on networking module.

Step 720: the third audio/video flow being forwarded on view networked terminals again depending on networked server.

It is above exactly to be added in the meeting of Session Initiation Protocol depending on networked terminals active call, and carried out with SIP conference terminal The process of multipoint conference.

For the clearer explanation multi-party group meeting method provided by the embodiments of the present application based on view networking, it is now based on Fig. 8 Carry out steps flow chart for example:

Step 801: configuration association turns server, and the virtual terminal for allowing association to turn server networks.

Step 802: view networked terminals actively initiate calling, and the view networked terminals number of input five sends the first calling Instruct view networked server.

Step 803: first call instruction being converted into the second call signaling depending on networked server, association is sent to and turns clothes Business device.

Step 804a: association turns to start to initiate the first registration to sip server after server receives second call signaling Request, to be registered on sip server.

Step 804b: simultaneously with step 804a, conference terminal also starts calling SIP server, sends the second registration request, To be registered on sip server.

Step 805:SIP server replys registration response to both sides, allows to register.

Step 806a: association turns server and sends the first access request to sip server.

Step 806b: conference terminal sends the second access request to sip server.

Step 807:SIP server replys access response message, starts to process.

Step 808ab:SIP server replys the first membership invitation message and response triggering message and turns server and meeting to association Terminal is discussed, representative association turns the access request message that server and conference terminal are sent and has been successfully processed.

Step 809ab: when association turn server virtual terminal and conference terminal receive the first membership invitation message and response After triggering message, confirmation signaling is replied to sip server.

Step 810: the first membership invitation message is changed into the second membership invitation message by the virtual terminal that association turns server, is sent out Give view networked server.

Step 811: the second membership invitation message being changed into third membership invitation message depending on networked server, is sent to view connection Network termination informs and enters meeting depending on networked terminals.

Step 812ab: after all entering meeting depending on networked terminals and conference terminal, start to turn service to association depending on networked server Device and view networked terminals send encoder open instructions.

Step 813,814: view networked terminals send the first audio/video flow and the of view networking protocol to view networked server Two audio/video flows.

Step 815ab: the first audio/video flow and the second audio/video flow are forwarded to association depending on networked server and turn server.

Step 816: association turns server and the first audio/video flow for including in agreement and the second audio/video flow is extracted envelope The audio/video flow for dressing up Real-time Transport Protocol is sent to sip server, and conference terminal also sends SIP service for the audio/video flow of itself Device.

The two-way audio/video flow received is carried out the mixed screen of audio mixing by step 817:SIP server.

Audio/video flow after the mixed screen of audio mixing is respectively sent to association and turns server and meeting end by step 818:SIP server End.

Step 819: association turns server after receiving the audio/video flow of RTP encapsulation, carries out the third that audio mixing is dressed up in deblocking 4th audio/video flow of audio/video flow and mixed screen, then carries out the encapsulation of view networking protocol.

Step 820: after association turns server encapsulation completion, by the third audio/video flow and the 4th audio/video flow hair after encapsulation It is sent to view networked server.

Step 821: being forwarded again depending on networked server and be sent to view networked terminals.

Step 822: can normally watch and listen conference content depending on networked terminals.

Step 823: after the conference is over, sending the first hang up instruction depending on networked terminals and give view networked server.

Step 824: the first hang up instruction being changed into the second hang up instruction depending on networked server, association is sent to and turns server.

Step 825: association turns server the second hang up instruction is changed into third to hang up signaling, is sent to sip server, meeting Terminal also sends the 4th hang up instruction to sip server.

Step 826:SIP server replys the first hangup response message respectively and turns server and conference terminal to association.

Step 827: association turns server after receiving the first hangup response message, changes into and hangs up depending on the second of networking protocol Response message gives view networked server.

Step 828: the second hangup response message being changed into third hangup response message depending on networked server, is sent to view connection Network termination.

Step 829: exiting meeting depending on networked terminals.

Step 830: sending encoder out code depending on networked server and turn server depending on networked terminals and association to close Video and audio coding.

In conclusion the multi-party admission method provided by the embodiments of the present application based on view networking, turning server by association will Depending on being converted depending on networking number with video conference address for networked terminals calling, so that can be added depending on networked terminals with active call Enter in the meeting created to sip server；And after call setup success, the audio, video data of itself can be sent to Sip server gets on, and shows mixed audio-video according to mixing request and plays back, meets user demand.

The embodiment of the present application, which solves, carries out view networked terminals and internet video conference terminal under SIP in the prior art The limitation of the calling of " point-to-point " having a single function, increase depending on networked terminals pass through calling SIP meeting number, active call to The function of meeting is added, view networking and conference terminal are met under user SIP in video conference docking mode under perfect SIP Multi-party group can demand.

It should be noted that the Session Initiation Protocol that the embodiment of the present application technical solution is applicable in is merely illustrative, other agreements are at this Within the protection scope for applying for technical solution disclosed in embodiment.

It should be noted that for simple description, therefore, it is stated as a series of action groups for embodiment of the method It closes, but those skilled in the art should understand that, the embodiment of the present application is not limited by the described action sequence, because according to According to the embodiment of the present application, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art also should Know, the embodiments described in the specification are all preferred embodiments, and related movement not necessarily the application is implemented Necessary to example.

Based on the same technical idea, referring to Fig. 9, the structural frames of sip server provided by the embodiments of the present application are shown Figure, the device can be applied in view networking, can specifically include following module:

Message reception module 901 receives view networked terminals via transfer server for session initiation protocol sip server The second membership request that the first membership request sent and conference terminal are sent；Wherein, first membership request and described the Target meeting mark and the sip server IP are carried in two membership request.

Message transmission module 902, for being networked according to target meeting mark and the sip server IP to the view Terminal sends the first membership response via the transfer server, and sends the second membership response to the conference terminal；Wherein, First data transmission channel of the first membership response for establishing between the view networked terminals, second membership are rung Applied to the second data transmission channel between foundation and the conference terminal.

For device embodiment, since it is basically similar to the method embodiment, related so being described relatively simple Place illustrates referring to the part of embodiment of the method.

All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are with The difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.

It should be understood by those skilled in the art that, the embodiments of the present application may be provided as method, apparatus or calculating Machine program product.Therefore, the embodiment of the present application can be used complete hardware embodiment, complete software embodiment or combine software and The form of the embodiment of hardware aspect.Moreover, the embodiment of the present application can be used one or more wherein include computer can With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code The form of the computer program product of implementation.

The embodiment of the present application is referring to according to the method for the embodiment of the present application, terminal device (system) and computer program The flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructions In each flow and/or block and flowchart and/or the block diagram in process and/or box combination.It can provide these Computer program instructions are set to general purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminals Standby processor is to generate a machine, so that being held by the processor of computer or other programmable data processing terminal devices Capable instruction generates for realizing in one or more flows of the flowchart and/or one or more blocks of the block diagram The device of specified function.

These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing terminal devices In computer-readable memory operate in a specific manner, so that instruction stored in the computer readable memory generates packet The manufacture of command device is included, which realizes in one side of one or more flows of the flowchart and/or block diagram The function of being specified in frame or multiple boxes.

These computer program instructions can also be loaded into computer or other programmable data processing terminal devices, so that Series of operation steps are executed on computer or other programmable terminal equipments to generate computer implemented processing, thus The instruction executed on computer or other programmable terminal equipments is provided for realizing in one or more flows of the flowchart And/or in one or more blocks of the block diagram specify function the step of.

Although preferred embodiments of the embodiments of the present application have been described, once a person skilled in the art knows bases This creative concept, then additional changes and modifications can be made to these embodiments.So the following claims are intended to be interpreted as Including preferred embodiment and all change and modification within the scope of the embodiments of the present application.

Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning Covering non-exclusive inclusion, so that process, method, article or terminal device including a series of elements not only wrap Those elements are included, but also including other elements that are not explicitly listed, or further includes for this process, method, article Or the element that terminal device is intrinsic.In the absence of more restrictions, being wanted by what sentence "including a ..." limited Element, it is not excluded that there is also other identical elements in process, method, article or the terminal device for including the element.

It above can method and server to a kind of multi-party group based on view networking provided herein.Detailed Jie is carried out It continues, specific examples are used herein to illustrate the principle and implementation manner of the present application, and the explanation of above embodiments is only It is to be used to help understand the method for this application and its core ideas；At the same time, for those skilled in the art, according to this Shen Thought please, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification should not manage Solution is the limitation to the application.

Claims

1. a kind of method of the multi-party group meeting based on view networking, which is characterized in that the described method includes:

Session initiation protocol sip server receives the first membership request and meeting that view networked terminals are sent via transfer server The second membership request that terminal is sent；Wherein, target meeting is carried in the first membership request and second membership request Mark and the sip server IP；

It is sent out to the view networked terminals via the transfer server according to target meeting mark and the sip server IP It send the first membership to respond, and sends the second membership response to the conference terminal；Wherein, the first membership response is for establishing With the first data transmission channel between the view networked terminals, the second membership response is for establishing and the conference terminal Between the second data transmission channel.

2. the method as described in claim 1, which is characterized in that the transfer server includes that view networked server and association turn clothes Business device；

The first membership request is issued by the view networked terminals, is turned by the view networked server, and by the association After server carries out protocol conversion, it is sent to the sip server；

The first membership response is issued by the sip server, is turned server by the association and is carried out protocol conversion, and passes through It is described to be sent to the view networked terminals depending on networked server.

3. the method as described in claim 1, which is characterized in that the first data transmission channel is used for transmission the SIP clothes The first data flow that the mixed data flow and/or the view networked terminals that business device is sent are sent via the transfer server；

Second data transmission channel is used for transmission the mixed data flow and/or the meeting that the sip server is sent Discuss the second data flow that terminal is sent；

Wherein, the mixed data flow is that the sip server will receive first data flow and second data flow It is obtained after the mixed screen processing of audio mixing.

4. method as claimed in claim 3, which is characterized in that the transfer server includes that view networked server and association turn clothes Business device；

The first data transmission channel is used for transmission the mixed data flow that the sip server is sent and/or view networking The first data flow that terminal is sent via the transfer server, comprising:

The first data transmission channel is used for transmission to be issued by the sip server, is turned server by the association and is carried out agreement Conversion, and pass through the mixed data flow that the view networked terminals are sent to depending on networked server；And/or

The first data transmission channel is used for transmission to be issued by the view networked terminals, by the view networked server, again First data flow that server carries out protocol conversion is turned by the association.

5. a kind of server, which is characterized in that the server includes:

Message reception module receives what view networked terminals were sent via transfer server for session initiation protocol sip server The second membership request that first membership request and conference terminal are sent；Wherein, the first membership request and second membership Target meeting mark and the sip server IP are carried in request；

Message transmission module, for being passed through according to target meeting mark and the sip server IP to the view networked terminals First membership response is sent by the transfer server, and sends the second membership response to the conference terminal；Wherein, described First data transmission channel of the one membership response for establishing between the view networked terminals, the second membership response are used for Establish the second data transmission channel between the conference terminal.

6. server as claimed in claim 5, which is characterized in that the transfer server includes that view networked server and association turn Server；

7. server as claimed in claim 5, which is characterized in that the first data transmission channel is used for transmission the SIP The first data flow that the mixed data flow and/or the view networked terminals that server is sent are sent via the transfer server；

8. server as claimed in claim 7, which is characterized in that the transfer server includes that view networked server and association turn Server；

9. a kind of computer equipment including memory, processor and stores the meter that can be run on a memory and on a processor Calculation machine program, which is characterized in that the processor realizes any side of Claims 1-4 when executing the computer program Method.

10. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has perform claim It is required that the computer program of 1 to 4 any the method.