CN105898187A - Method, device and system for implementation of remote communications - Google Patents

Abstract

The invention provides a method, device and system for implementation of remote communications. The method comprises the steps that an SIP server initiates a communication invitation; multiple client terminals receive the communication invitation, and a remote communication group is established; and the SIP server carries out sound mixing of voice information of the multiple client terminals and/or synthesizes video information of the multiple client terminals, and sends the information of each client terminal. The method, device and system for the implementation of the remote communications provided by the embodiment of the invention have the advantages that a CPU and a graphic processing capability of a common computer as well as powerful functions of a Windows system are fully used via an existing computer network; use of dedicated equipment is avoided; flexibility and expandability of the system are ensured; and hardware cost and the cost for development, running and maintenance of the system can be reduced as much as possible.

Description

The implementation method of a kind of telecommunication, Apparatus and system

Technical field

The present invention relates to the communications field, particularly relate to a kind of remote assistance realizes field, is concretely a kind of long-range Communication programming method, Apparatus and system.

Background technology

The independent network of the many employings of traditional long-distance communicating method, such as video conference mode, special conference terminal, meeting View server and conference control equipment, it is high that it builds the cost safeguarded, the cycle is long, and conference model is more single, and utilization rate of equipment and installations is not Height, is the most no longer the main flow of nowadays video conference mode.

The teleconference of the Internet model make use of existing network and PC, by disposing Conference server/Video service Device, it is achieved that the meeting/assist in functions of Based PC.Contrast traditional video conference mode, take full advantage of existing equipment and net Network, considerably reduces construction maintenance cost, and significantly improves the motility of business.But, current based on the Internet The conference system of pattern, more Based PC and the Internet are designed, and conventional communication networks fusion degree is poor, create substantially Separation；Further, the video conferencing system of the Internet model more focuses on functional completeness and the concordance of conference system, certain journey Imitate tradition conference model on degree, do not support the access of the telecommunications network communication equipments such as conventional analog telephone, the most do not support hands Machine, image the access of other equipment first-class.Further, when carrying out mini-session, cost is the highest.

Summary of the invention

The present invention proposes the implementation method of a kind of telecommunication, Apparatus and system, with realize low cost meeting link up and Easy remote assistance.

In order to achieve the above object, the embodiment of the present invention provides the implementation method of a kind of telecommunication, including: SIP service Device is initiated communication and is invited；Multiple client terminals accept described communication and invite, and set up telecommunication group；Described sip server is by institute The voice messaging stating multiple client terminal carries out audio mixing, and/or the video information of the plurality of client terminal is synthesized, and sends out Give each described client terminal.

In order to achieve the above object, what the embodiment of the present invention also provided for a kind of telecommunication realizes device, including: invite and send out Play module, invite for initiating communication to multiple client terminals；Message processing module, for by the language of the plurality of client terminal Message breath carries out audio mixing, and/or the video information of the plurality of client terminal is synthesized；Information sending module, being used for will Voice messaging after audio mixing and the video information after synthesis are sent to each described client terminal.

In order to achieve the above object, what the embodiment of the present invention also provided for a kind of telecommunication realizes system, including SIP service Device；What described sip server included above-mentioned telecommunication realizes device.

The implementation method of the telecommunication of the embodiment of the present invention, Apparatus and system, by existing computer network, fully Utilize CPU and the graphics capability of common computer, and the power of Windows system, it is to avoid use special equipment, While ensureing system flexibility and extensibility, reduce the exploitation of hardware cost and system as far as possible, run, safeguard into This.

Accompanying drawing explanation

In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing In having technology to describe, the required accompanying drawing used is briefly described, it should be apparent that, the accompanying drawing in describing below is only this Some embodiments of invention, for those skilled in the art, on the premise of not paying creative work, it is also possible to root Other accompanying drawing is obtained according to these accompanying drawings.

Fig. 1 is the networking schematic diagram realizing telecommunication of the embodiment of the present invention；

Fig. 2 is the process chart of the implementation method of the telecommunication of the embodiment of the present invention；

Fig. 3 is the concrete handling process schematic diagram of the implementation method of the telecommunication of the embodiment of the present invention；

Fig. 4 is the handling process schematic diagram of the voice messaging audio mixing of the embodiment of the present invention；

Fig. 5 is the handling process schematic diagram of the video information synthesis of the embodiment of the present invention；

Fig. 6 is the structural representation realizing device of the telecommunication of the embodiment of the present invention.

Detailed description of the invention

Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Describe, it is clear that described embodiment is only a part of embodiment of the present invention rather than whole embodiments wholely.Based on Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under not making creative work premise Embodiment, broadly falls into the scope of protection of the invention.

Session Initiation Protocol is the control protocol of an application layer, for controlling the establishment of session, revising and terminate.Session is permissible Being two sides or in many ways, SIP is not relevant for particular content and the medium type of session, it uses the client that IETF is widely used End/server mode.Similar with HTTP, Session Initiation Protocol uses message to carry out the communication between network.It is basic that RFC3261 specifies Sip message only have 6, be respectively INVITE BYE ACK CANCLE OPTION REGISTER message.The most former following On the basis of then, sip message can be extended.SIP has the strongest pardon, and it both can be used to set up various meeting Words, it is also possible to be used to transmit instant message and file.SIP has many excellent in terms of offer business flexible, convenient Point.

Based on above-mentioned Session Initiation Protocol principle, the present invention, based on Session Initiation Protocol, proposes a kind of easy long-distance communicating method, it may be assumed that Any one sip server end initiates calling, connects multiple terminal, voice is carried out audio mixing, and video splices, after processing Voice and video be sent to client terminal.The long-distance communicating method of this suggestion take full advantage of current computer CPU and The resource of GPU, to replace the computing capability needed for meeting/video server, (is usually no more than in miniature video conference model 8 sides) application in, dispense the hardware resource of independent meeting/video server etc, it is achieved the compression of cost.

Fig. 1 is the networking schematic diagram realizing telecommunication of the embodiment of the present invention.As shown in Figure 1, it is only necessary to by PC terminal Or mobile phone terminal is connected to sip server.Wherein, PC terminal connects with sip server by the way of wired or wireless Connect, to serve as Terminal Server Client；Mobile phone terminal is connected with sip server by WIFI or 4G network, to serve as Terminal Server Client； Sip server can be deployed in any one computer, it is provided that continuing of SIP calling.

Optionally, SIP photographic head may also connect to sip server, it is achieved camera function.Video resource after shooting also may be used To be sent to PC terminal or mobile phone terminal by sip server.

Optionally, some gateway devices can also be connected to sip server, such as Tandem Gateway and analog telephone network and close, So that communication network and simulation phone can be accessed respectively.

Fig. 2 is the process chart of the implementation method of the telecommunication of the embodiment of the present invention.As in figure 2 it is shown, include: step S101, sip server is initiated communication and is invited；Step S102, multiple client terminals accept described communication and invite, set up telecommunication Group；Step S103, the voice messaging of the plurality of client terminal is carried out audio mixing by described sip server, and/or by the plurality of The video information of client terminal synthesizes, and is sent to each described client terminal.

In step S101 of the present embodiment, sip server initiates speech communication invitation or video to described client terminal Communication is invited.In the present embodiment, client terminal includes computer terminal and mobile phone terminal.It is to say, in order to complete telecommunication, Should be the software being mounted with to support Session Initiation Protocol on computer terminal or mobile phone terminal, such as, install on computer terminal and support The application program of Session Initiation Protocol, installs the APP realizing Session Initiation Protocol on mobile phone terminal.Further, sip server is sent out to client terminal Sending INVITE, request client terminal to add communication to invite, INVITE can be with specific header field, such as BY- Info:conftype=free-conf, what expression was held is free meeting.

In step S102 of the present embodiment, multiple client terminals accept described communication and invite, and set up telecommunication group, tool Body is embodied as: after client terminal receives INVITE, if accepted, then returns OK response message, now sip server Receive client terminal accept message after, then send INFO-CreateConf/JoinConf message, telecommunication is set up in request The client terminal accepted the invitation also is joined in group by group.

In step S103 of the present embodiment, the voice messaging of the plurality of client terminal is carried out by described sip server Audio mixing, is divided into two following situations: when described client terminal is less than 4, and described sip server uses clamped algorithm to carry out Audio mixing；When described client terminal is more than 4, described sip server uses adaptive weighted algorithm to carry out audio mixing.Each client Terminal self can perform echo cancellor, and sip server end can perform audio mixing.It addition, smooth (stabilization) of voice is defeated to audio mixing The impact going out tonequality is very big, can be alleviated by buffering.

In step S103 of the present embodiment, the video information of the plurality of client terminal of described sip server is closed Become, mainly use H264 video coding technique, and the DirecxShow using Windows to carry realizes described video pictures Scaling and splicing.

It is implemented as: first video information is carried out coded treatment, and the present invention uses H264 to encode.H264 is current The Video coding of main flow, the operand needed for it encodes is much larger than the operand needed for decoding, carries out with specialized hardware traditionally Real-time coding, or use software to carry out non real-time coding, and use CPU to carry out software decode.But, along with CPU disposal ability Continuous lifting, universal cpu also has enough encoding and decoding calculation processing power.Current Intel Core series CPU is each Core can decode 264 videos of 1 road 1080P, and stronger CPU can support the real-time coding of 1 road 720P or 1080P.Currently have Some third-party storehouses, such as intel, utilize the hardware resource of video card, it is achieved the encoding and decoding of H264.When video card is not supported, make Computing is performed with CPU；When video card is supported, mainly utilizing video card resource, CPU takies extremely low.

Presently available Intel media SDK realizes H264 encoding and decoding, when CPU integrated graphics card is supported, can support 1 tunnel 1080P coding and 8 road 1080P decoding；When not supporting, according to CPU disposal ability, support 1 road 720P/1080P coding and 4 ~ 8 tunnels 720P/1080P decodes.For supporting low resolution equipment, while high definition coding (720P/1080P), encode 1 road QVGA The subcode stream of (320 * 240), pushes on demand.

Computer generally uses windows system, and windows carries the DirectX of different editions, and DirectShow is then An ingredient for DirectX.Utilize existing DirectShow, can realize efficiently the collection of audio frequency and video and broadcasting/ Display.Further, DirectShow may utilize video card resource, efficiently realizes scaling and the splicing of video pictures, and does not relies on spy Fixed CPU/ video card, is greatly saved CPU calculation resources.

DirectShow is the kit that computer system windows carries, and the present invention is just being dependent on existing this money Source, it is achieved the collection of video information, process and play.Its processing procedure includes scaling and the splicing of video pictures.In the present invention In embodiment, according to the difference of client terminal, carry out video scaling different with the mode of splicing.Such as, if computer eventually End, the video pictures of exportable 2*3 layout, if mobile phone terminal, the video pictures of exportable 3*2 layout.Selected is regarded Frequency display is on the optional position of output screen, it is achieved the combination in any superposition of multichannel picture or picture-in-picture function.

In embodiments of the present invention, use screen/window sharing as DirecxShow carry out video pictures scaling and The data source of splicing, say, that the sectional drawing that video information is screen/window sharing that client terminal transmits.And transmit sectional drawing, Video mode or pictorial manner can be used.

Video mode, will be regarded video source by sectional drawing, by H264 compression coding, be delivered by video channel.This side Method utilizes existing resource and passage, can direct viewing in ordinary video terminal；But owing to taking video channel, image quality damages Lose, and picture size may be excessive.

Pictorial manner, generally uses JPG compression.But JPG is relatively suitable for the compression of photo or image, when word is compressed, The sawtooth that word edge has, particularly evident during picture and text mixing.Another way is PNG lossless compress, is current network main flow Picture format, for the image quality of screen/window sharing, therefore preferential in the present invention program to use PNG be the compress mode of sectional drawing.

Further, video information and audio-frequency information are carried out network transmission, UDP can be used, it is possible to use Transmission Control Protocol Transmission, and in order to ensure reliability and the image quality of screen/window sharing, and ensureing reliability, the present invention program preferentially selects TCP Host-host protocol.

Fig. 3 is the concrete handling process schematic diagram of the implementation method of the telecommunication of the embodiment of the present invention.As it is shown on figure 3, This specific embodiment includes:

Step S1, sip server thinks client terminal 1, client terminal 2 ... client terminal N initiates remotely to invite.

Step S2, client terminal 1, client terminal 2 ... client terminal N accepts the invitation, return OK response.

Step S3, sip server receives the OK response of each client terminal, i.e. sets up telecommunication group, and will connect The client terminal invited joins in communication group.In this step, if a certain client terminal does not beam back OK response, SIP Server is then given tacit consent to this client terminal and is not accepted remotely to invite, and when it sets up telecommunication group, will not be added by this client terminal Enter wherein.

Step S4, sip server is by the local voice information collected, the voice messaging 1 of client terminal 1, client terminal 2 Voice messaging 2 ... the voice messaging N of client terminal N carries out audio mixing.

Step S5, sip server is by the local video information collected, the video information 1 of client terminal 1, client terminal 2 Video information 2 ... video information N of client terminal N synthesizes.

Step S6, the video information after the voice messaging after audio mixing and synthesis is sent to each client by sip server Terminal.

From above-described embodiment it can be seen that step S1, S3-S6 are sip server itself entirely is completed, say, that this Invention is by any one the computer deploying Session Initiation Protocol, and combines the existing CPU of computer and image processing tool, i.e. Easy telecommunication can be realized, such as, can realize easy miniature video meeting.

Concrete, in step S4 of above-described embodiment, the processing procedure that multiple voice messagings carry out audio mixing includes language The buffering of sound data, the audio mixing of speech data, the convergence of speech data and press passage and perform each side such as voice elimination.Such as figure Shown in 4, for the handling process schematic diagram of the voice messaging audio mixing of the embodiment of the present invention.

Step S41, buffers voice data.In this step, when the voice letter collecting local voice information, client terminal 1 Breath 1, the voice messaging 2 of client terminal 2 ... after the voice messaging N of client terminal N, buffer operation is first carried out, carries out voice Smooth, the output tonequality of effect of jitter to audio mixing to prevent voice.

Step S42, timing performs audio mixing.In this step, if there being new client terminal to join in telecommunication group, i.e. When having opened a new tunnel, automatically this passage is added audio mixing.

Step S43, performs voice by passage and eliminates and convergence.In this step, perform voice elimination by passage and refer to return Can be unlike including self voice messaging in voice messaging after the audio mixing of each client terminal.Such as, from client eventually The voice messaging of end 1, is sent to sip server end by voice channel 1, then the voice messaging after performing audio mixing send time Waiting, if being sent to client terminal 1 by voice channel 1, then can eliminate the voice messaging in the voice messaging after audio mixing 1。

In the present embodiment, voice messaging carries out the part of audio mixing to realize example code as follows:

// audio mixing inputs, and during new tunnel, automatically this passage is added audio mixing

int _AudioMix::putAudio(size_t channel, void *data, size_t size)

{

assert(channel < m_count);

assert(data);

assert(size);

if ( (channel >= m_count)

|| (NULL == data)

|| (size <= 0))

{

return -1;

}

// abandon the speech data made a speech by shielding

if (ar_spk_forbit == (m_right[channel] & ar_spk_mask))

{

return 0;

}

if (m_start[channel] < audio_start)

{

m_start[channel] += size;

}

return m_in[channel]->put(data, size);

}

// prepare speech data

void _AudioMix::prsAudio()

{

for (size_t i=0; i<m_count; i++)

{

m_size[i] = 0;

m_level[i] = 0;

if (ar_spk_forbit == (m_right[i] & ar_spk_mask))

{

continue;

}

if (m_start[i] < audio_start)

{

continue;

}

size_t ret = m_in[i]->get(m_data[i], frame_size);

if (ret < frame_size)

{

m_start[i] = 0;

continue;

}

m_level[i] = amplitude(m_data[i], frame_cap);

}

for (size_t i=0; i<first_select; ++i)

{

size_t index = 0;

for (size_t j=1; j<m_count; j++)

{

if (m_level[index] < m_level[j])

{

index = j;

}

}

if (m_level[index] <= 0)

{

break;

}

m_level[index] = 0;

m_size[index] = frame_size;

}

}

Concrete, in step S5 of above-described embodiment, by the local video information collected, the video information of client terminal 1 1, the video information 2 of client terminal 2 ... what video information N of client terminal N carried out synthesizing implement step such as Fig. 5 institute Show.

S51, draws local video resource.In this step, sectional drawing is carried out as this by the method for screen/window sharing Ground video resource, then by H264 compression coding, it is achieved the drafting to local video information.

S52, draws the video resource of the client terminal transmitted.Similar with to the process of local video information, by screen/ The method of window sharing carries out the sectional drawing video resource as client terminal 1-N, then by H264 compression coding, it is achieved to client The drafting of the video information of terminal.

S53, synthesizes video interception and carries out Video coding.After getting the video resource of client terminal, Utilize existing DirectShow to realize scaling and the splicing of video pictures, selected any video pictures is shown at cutout screen On the optional position of curtain, it is achieved the combination in any superposition of multichannel picture or picture-in-picture function.

In embodiments of the present invention, the partial code carrying out the screenshot capture of video and transmission is as follows:

void TfmMain::syncBrowser()

{

m_bmp->Width = cwb->Width;

m_bmp->Height = cwb->Height;

if (m_isDx)

{

BitBlt(m_bmp->Canvas->Handle, 0, 0, m_bmp->Width, m_bmp->Height, GetWindowDC(cwb->Handle), 0, 0, SRCCOPY);// screenshotss

}

else

{

PrintWindow(cwb->Handle, m_bmp->Canvas->Handle, 0);// cut window

}

m_png->Assign(m_bmp);

m_stream->Clear();

m_png->SaveToStream(m_stream);

When // hash value does not changes, it is assumed that picture does not changes, do not repeatedly transmit

size_t value = hash(m_stream->Memory, m_stream->Size);

if (value == m_hashValue)

{

return;

}

m_hashValue = value;

m_syncServer->sendData(m_stream->Memory, m_stream->Size);

}

In embodiments of the present invention, utilization is called the own DirecxShow of computer and is carried out scaling and the splicing of video pictures, Its interface routine example is as follows:

// display parameters

struct DispParam

{

size_t m_x;// upper left corner abscissa

size_t m_y;// upper left corner vertical coordinate

size_t m_w;// picture traverse

size_t m_h;// picture altitude

};

// video parameter

struct VideoParam

{

size_t m_width;// picture traverse

size_t m_height;// picture altitude

};

// input parameter

struct InParam

{

DispParam m_disp;

VideoParam m_video;

};

class VideoDisp

{

typedef vector <InParam *> VecInParam;

typedef vector <LPDIRECTDRAWSURFACE> VecSurface;

public:

VideoDisp(HWND hwnd);

~VideoDisp();

public:

void outParam ( DispParam &param);

bool setOutParam (const DispParam &param);

size_t inCount ();

void setInCount (size_t count);

bool inParam (size_t channel, DispParam &param);

bool setInParam (size_t channel, const DispParam &param);

public:

void clrImage (size_t channel);// remove image

void putImage (size_t channel, void *yuv420, size_t width, size_t height);// output image

size_t getImage (void *yuv420, size_t size, size_t &width, size_t &height);// obtain image

void updateDisplay ();// update display

private:

bool initDD ();// initialize DirectDraw

void freeDD ();// release DirectDraw

bool initOutImage ();// initialize output image

void freeOutImage ();// release output image

bool initInImage (size_t channel);// initialize input picture

void freeInImage (size_t channel);// release input picture

void initInParam (size_t count);// initialization input parameter

void freeInParam ();// release input parameter

bool putYuv (LPDIRECTDRAWSURFACE lpSurface, void *yuv420, size_t width, size_t height);// output YUV

bool getYuv (LPDIRECTDRAWSURFACE lpSurface, void *yuv420, size_t width, size_t height);// obtain YUV

bool composeImage (size_t channel);// composograph

private:

HWND m_hwnd;// forms handle

DispParam m_outParam;// output parameter

VecInParam m_inParam;// input parameter

LPDIRECTDRAW m_lpDD;// DirectDraw pointer to object

LPDIRECTDRAWSURFACE m_lpPrimary;// DirectDraw first type surface pointer

LPDIRECTDRAWSURFACE m_lpBackScr;// DirectDraw off-screen surfaces refers to Pin

VecSurface m_lpSurface;// DirectDraw channel surface refers to Pin

};

In the embodiment of the present invention, the partial code carrying out video pictures synthesis is as follows:

// video window

typedef struct VdoWnd

{

size_t m_channel;// channel number

size_t m_left;// the left side away from

size_t m_top;// top margin away from

size_t m_width;// width

size_t m_height;// highly

} VdoWnd;

// Video Composition

typedef struct VdoCmp

{

size_t m_count;// number of channels

VdoWnd m_wnd[mvc_sub];// video window

} VdoCmp;

int video_set_layout (const VdoCmp *param);// Splicing model is set

By above example, the present invention is when carrying out telecommunication, it is only necessary to by existing computer network, utilizes DirectShow function in the CPU of common computer and image processing apparatus, and Windows, dispense independent meeting/ The hardware devices such as video server, it is achieved that the compression of cost.

Fig. 6 is the structural representation realizing device of the telecommunication of the embodiment of the present invention.As shown in Figure 6, including: invite Initiation module 101, invites for initiating communication to multiple client terminals；Message processing module 102, for by the plurality of client The voice messaging of terminal carries out audio mixing, and/or the video information of the plurality of client terminal is synthesized；Information sending module 103, for the video information after the voice messaging after audio mixing and synthesis is sent to each described client terminal.

As further embodiment, described invitation initiation module 101 is invited for initiating communication to multiple client terminals Please, specifically include: initiate speech communication invitation to the plurality of client terminal or/and video communication is invited.

As further embodiment, described message processing module 102 includes speech signal analysis unit, specifically uses In: when described client terminal is less than 4, described sip server uses clamped algorithm to carry out audio mixing；When described client terminal During more than 4, described sip server uses adaptive weighted algorithm to carry out audio mixing.

As further embodiment, described message processing module 102 includes video information process unit, specifically uses In: use H264 Video coding, and use DirecxShow to realize scaling and the splicing of video pictures in described video information.

As further embodiment, it is described that described message processing module 102 is additionally operable to use DirecxShow to realize Voice messaging and the collection of video information and broadcasting.

What the embodiment of the present invention also provided for a kind of telecommunication realizes system, and it includes sip server, described SIP service What device included the telecommunication described in Fig. 6 realizes device.It is to say, sip server is be deployed with Session Initiation Protocol module any One PC, by call computer per se with image processing section and coded portion, be independent of distinctive CPU and video card, Easy telecommunication, the most small-sized video conference etc. can be realized.

The implementation method of the telecommunication of the embodiment of the present invention, Apparatus and system, by existing computer network, fully Utilize CPU and the graphics capability of common computer, and the power of Windows system, it is to avoid use special equipment, While ensureing system flexibility and extensibility, reduce the exploitation of hardware cost and system as far as possible, run, safeguard into This.

Those skilled in the art are it should be appreciated that embodiments of the invention can be provided as method, system or computer program Product.Therefore, the reality in terms of the present invention can use complete hardware embodiment, complete software implementation or combine software and hardware Execute the form of example.And, the present invention can use at one or more computers wherein including computer usable program code The upper computer program product implemented of usable storage medium (including but not limited to disk memory, CD-ROM, optical memory etc.) The form of product.

The present invention is with reference to method, equipment (system) and the flow process of computer program according to embodiments of the present invention Figure and/or block diagram describe.It should be understood that can the most first-class by computer program instructions flowchart and/or block diagram Flow process in journey and/or square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided Instruction arrives the processor of general purpose computer, special-purpose computer, Embedded Processor or other programmable data processing device to produce A raw machine so that the instruction performed by the processor of computer or other programmable data processing device is produced for real The device of the function specified in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame now.

These computer program instructions may be alternatively stored in and computer or other programmable data processing device can be guided with spy Determine in the computer-readable memory that mode works so that the instruction being stored in this computer-readable memory produces and includes referring to Make the manufacture of device, this command device realize at one flow process of flow chart or multiple flow process and/or one square frame of block diagram or The function specified in multiple square frames.

These computer program instructions also can be loaded in computer or other programmable data processing device so that at meter Perform sequence of operations step on calculation machine or other programmable devices to produce computer implemented process, thus at computer or The instruction performed on other programmable devices provides for realizing at one flow process of flow chart or multiple flow process and/or block diagram one The step of the function specified in individual square frame or multiple square frame.

The present invention applies specific embodiment principle and the embodiment of the present invention are set forth, above example Explanation be only intended to help to understand method and the core concept thereof of the present invention；Simultaneously for one of ordinary skill in the art, According to the thought of the present invention, the most all will change, in sum, in this specification Hold and should not be construed as limitation of the present invention.

Claims (10)

1. the implementation method of a telecommunication, it is characterised in that including:

Sip server is initiated communication and is invited；

Multiple client terminals accept described communication and invite, and set up telecommunication group；

The voice messaging of the plurality of client terminal is carried out audio mixing by described sip server, and/or by the plurality of client terminal Video information synthesize, be sent to each described client terminal.

The implementation method of telecommunication the most according to claim 1, it is characterised in that described sip server initiates communication Invite, including:

Sip server is initiated speech communication to described client terminal and is invited；Or/and

Sip server is initiated video communication to described client terminal and is invited.

The implementation method of telecommunication the most according to claim 1, it is characterised in that described sip server is by described many The voice messaging of individual client terminal carries out audio mixing, including:

When described client terminal is less than 4, described sip server uses clamped algorithm to carry out audio mixing；

When described client terminal is more than 4, described sip server uses adaptive weighted algorithm to carry out audio mixing.

The implementation method of telecommunication the most according to claim 1, it is characterised in that described sip server is the plurality of The video information of client terminal synthesizes, including:

Use H264 Video coding, and use DirecxShow to realize scaling and the spelling of video pictures in described video information Connect.

The implementation method of telecommunication the most according to claim 1, it is characterised in that use DirecxShow to realize described Voice messaging and the collection of video information and broadcasting.

6. a telecommunication realize device, it is characterised in that including:

Invite initiation module, invite for initiating communication to multiple client terminals；

Message processing module, for carrying out audio mixing by the voice messaging of the plurality of client terminal, and/or by the plurality of client The video information of terminal synthesizes；

Information sending module, for being sent to each described client by the video information after the voice messaging after audio mixing and synthesis Terminal.

Telecommunication the most according to claim 6 realize device, it is characterised in that described invitation initiation module for Multiple client terminals are initiated communication and are invited, and specifically include:

Speech communication invitation is initiated or/and video communication is invited to the plurality of client terminal.

Telecommunication the most according to claim 6 realize device, it is characterised in that described message processing module includes language Sound information process unit, specifically for:

When described client terminal is less than 4, described sip server uses clamped algorithm to carry out audio mixing；

When described client terminal is more than 4, described sip server uses adaptive weighted algorithm to carry out audio mixing.

Telecommunication the most according to claim 6 realize device, it is characterised in that described message processing module includes regarding Frequently information process unit, specifically for:

Use H264 Video coding, and use DirecxShow to realize scaling and the spelling of video pictures in described video information Connect.

Telecommunication the most according to claim 6 realize device, it is characterised in that described message processing module is also used Described voice messaging and the collection of video information and broadcasting is realized in using DirecxShow.