CN103297314A - Terminal, server and audio processing method - Google Patents
Terminal, server and audio processing method Download PDFInfo
- Publication number
- CN103297314A CN103297314A CN2012100442188A CN201210044218A CN103297314A CN 103297314 A CN103297314 A CN 103297314A CN 2012100442188 A CN2012100442188 A CN 2012100442188A CN 201210044218 A CN201210044218 A CN 201210044218A CN 103297314 A CN103297314 A CN 103297314A
- Authority
- CN
- China
- Prior art keywords
- terminal
- module
- voip
- server
- parameter information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Telephonic Communication Services (AREA)
Abstract
The invention provides a terminal, a server and an audio processing method. The terminal comprises an interface module and a VoIP module. The interface module is used for receiving control commands sent by a server corresponding to a called terminal when the terminal is used as the called terminal, and the control commands comprise parameter information of a VoIP module in a calling terminal; the VoIP module is used for obtaining the control command from the interface module when the terminal is used as the called terminal and resolving the parameter information in the control commands, and according to the parameter information, an RTP streaming media channel is built between the VoIP module and the VoIP module in the calling terminal. According to the terminal, the server and the audio processing method, key links which cause streaming media information delay or distortion, namely a streaming media data RTP transmission link between the terminal and the server, streaming media are directly transmitted in a thin client, and information transmission delay and distortion are avoided.
Description
Technical field
The present invention relates to the instant messaging technical field, relate in particular to a kind of terminal, server and audio-frequency processing method.
Background technology
(Instant Messaging, IM) software generally all has the networking telephone (VoIP) speech communication module, is used for the support voice communication function in instant messaging the most general in the present internet, applications.
When the IM application deployment when virtual desktop (or remote desktop), because of the restriction of its construction characteristic and solution, can have distortion and the time-delay situation of audio frequency aspect.
Under the current virtual desktop environment IM software audio frequency handling process as shown in Figure 1, user A at operating terminal thin-client (thin client1) by IM client (client) 1 software application in remote desktop or the virtual desktop runtime server (Server) 1.The operation of operating terminal upper keyboard and mouse is sent among the server S erver1 with operation IM software by virtual desktop host-host protocol such as independent computing architecture (ICA), video transmission protocol (PCoIP), independent computation environment simple protocol (SPICE), remote display protocol (RDP) etc.
Particularly, the audio frequency transmission mechanism of IM software under the virtual desktop environment comprises login process and calling procedure at present, wherein:
(1) login process:
As shown in Figure 1, user A is that thin client1 passes through the virtual desktop host-host protocol by peripheral hardware operations server Server1 such as keyboard, mouses at operating terminal 1, and starts the IM client1 application software on the Server1.After user's login, at first (Application Server, AS) soft switching server (Soft Switch, SS) ip address and port are obtained in registration to IM Client1 application software simultaneously to application server.To SS registration (the ip address of registration Server1, and media port number), the login process of user B on server2 is similar thereupon for the voip module that IM Client1 uses.
(2) calling procedure:
When user A will carry out voice or video conversation to user B, IM client 1 application software on the Server1 is used session initiation protocol (Session Initiation Protocol, SIP) to the SS request of making a call, after IM Client1 uses off-hook, SS uses making a call request to purpose side IM Client2, carries ip address, media port number and the medium type of IM1 Client application simultaneously.After IM Client2 uses off-hook, the ip address that the IM Client1 that carries when using SS to call out uses, media port number, and correct medium type, setting up the real-time transport protocol (rtp) medium with IM1 Client application is connected (under the situation that can not directly set up the RTP connection, may need media gateway to exchange), after setting up RTP and connecting, IM Client1 use with IM Client2 application between can carry out voice call.
When user A and user B carry out voice dialogue, the data that microphone collects are used (being deployed on the Server1) by virtual desktop host-host protocol such as RDP agreement etc. by the IM client 1 that thin client1 is sent on the Server1, the latter's voip module is encoded to Media Stream with data, is sent to SS successively by Real-time Transport Protocol then and finally sends to IM client 2 application (being deployed on the Server2).After the voip module that IM Client2 uses is decoded to Media Stream, be sent on the thin client2 by the virtual desktop host-host protocol equally, played back by the hardware on the thin client2, so user B can be known audio content.
In this process, the data that microphone or camera are collected are sent in the process of Server (comprising reverse procedure) data flow through repeatedly transmitting at thin client end by the virtual desktop host-host protocol, not only taken bandwidth, also can be because repeatedly forwarding and encoding-decoding process cause time-delay and the distortion of audio content.The business that this time-delay is had relatively high expectations for real-times such as voice or videos is fatal.Therefore be necessary further to optimize the system handles structure of present IM to satisfy the requirement of maximization removal time-delay and distortion.
Summary of the invention
The embodiment of the invention provides a kind of terminal, server and audio-frequency processing method, is applied in audio distortion and the latency issue that exists under virtual desktop or the remote desktop environment to solve present IM.
The embodiment of the invention provides a kind of terminal, and this terminal comprises interface module and the networking telephone (VoIP) module, wherein:
Described interface module is used for during as terminal called, receiving the control command that described terminal called corresponding server sends in described terminal, carries the parameter information of voip module in the calling terminal in the described control command;
Described voip module, be used in described terminal during as terminal called, obtain described control command from described interface module, parse the described parameter information that carries in the described control command, set up real-time transport protocol (rtp) Streaming Media passage according to the voip module in described parameter information and the described calling terminal.
Preferably, described voip module also for before obtaining described control command from described interface module, sends the status command that the described terminal of indication can be used to described interface module; Described interface module also is used for sending described status command to described terminal called corresponding server.
Preferably, described interface module also is used for during as calling terminal, receiving the initialization directive that described calling terminal corresponding server sends in described terminal; Described voip module also is used for obtaining described initialization directive from described interface module, carries out the media port initialization according to described initialization directive.
Preferably, described interface module is virtual USB device; Described voip module, concrete being used for read described virtual USB device, obtains described control command or initialization directive.
Preferably, described interface module is virtual USB device; Described voip module, concrete being used for writes described status command to described virtual USB device.
The embodiment of the invention also provides a kind of server, and this server comprises identification module and processing module, wherein:
Described identification module, being used for identifying the terminal corresponding with described server has interface module with described server interaction, then to described processing module triggering command;
Described processing module is used for the described triggering command according to described identification module transmission, when described terminal is calling terminal, obtains the parameter information of the networking telephone in the described calling terminal (VoIP) module; When described terminal is terminal called, send the parameter information of voip module in the described calling terminal that obtains to described terminal called.
Preferably, described processing module also is used for obtaining before the parameter information of described calling terminal voip module, sends initialization directive to described calling terminal.
Preferably, described processing module also before the parameter information for the described calling terminal voip module that sends acquisition to described terminal called, receives the status command that terminal called sends.
The embodiment of the invention provides a kind of audio-frequency processing method again, and this method comprises:
Terminal called receives the control command that described terminal called corresponding server sends, and resolves the parameter information of the networking telephone (VoIP) module in the calling terminal that described control command obtains to carry in the described control command;
Described terminal called is set up real-time transport protocol (rtp) Streaming Media passage according to the voip module in described parameter information and the described calling terminal.
Preferably, described terminal called receives before the control command of described terminal called corresponding server transmission, and described method also comprises:
Calling terminal receives the initialization directive that described calling terminal corresponding server sends, and described calling terminal carries out the media port initialization according to described initialization directive.
The embodiment of the invention has cancelled that to cause the key link of stream media information time-delay or distortion be the RTP transmission link of stream medium data between terminal and server, and with directly directly transmission between thin client of Streaming Media, has avoided time-delay and the distortion of information transmission.
Description of drawings
Fig. 1 is the professional schematic diagram of present IM processed voice and video media stream;
Fig. 2 is the Organization Chart of IM registering service of the present invention;
Fig. 3 is the Organization Chart of IM processed voice of the present invention and video media stream business;
Fig. 4 is the operation flow schematic diagram of IM processed voice of the present invention and video media stream.
Embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, hereinafter will be elaborated to embodiments of the invention by reference to the accompanying drawings.Need to prove that under the situation of not conflicting, the embodiment among the application and the feature among the embodiment be combination in any mutually.
The embodiment of the invention is in conjunction with the current virtual desktop system that generally uses, should be used as the adjustment on the framework to existing IM, adjust as follows: 1) integrated voip module and other module carried out decoupling zero among the IM Client, and voip module and IM Client use and self can be deployed on the different machines; 2) voice data of IM Client application no longer transmits between thin client and Server via virtual desktop host-host protocol (as ICA, PCoIP, SPICE, RDP etc.), that is stream medium data no longer transmits by Real-time Transport Protocol between IM client application (Server), but directly between thin client, transmit time-delay and the distortion of having avoided above-mentioned RDP transmission to cause by Real-time Transport Protocol.
The embodiment of the invention provides a kind of terminal, and this terminal comprises interface module and the networking telephone (VoIP) module, wherein:
Described interface module is used for during as terminal called, receiving the control command that described terminal called corresponding server sends in described terminal, carries the parameter information of voip module in the calling terminal in the described control command;
Described voip module, be used in described terminal during as terminal called, obtain described control command from described interface module, parse the described parameter information that carries in the described control command, set up real-time transport protocol (rtp) Streaming Media passage according to the voip module in described parameter information and the described calling terminal.
In addition, terminal called only waits under the upstate in shutdown not, just can receive control command such as link order that this terminal called corresponding server sends, therefore, described voip module, also for before obtaining described control command from described interface module, sending the status command that the described terminal of indication can be used to described interface module; Described interface module also is used for sending described status command to described terminal called corresponding server.
Certainly, calling terminal can be finished initialization procedure before the request of making a call, and therefore, described interface module also is used for during as calling terminal, receiving the initialization directive that described calling terminal corresponding server sends in described terminal; Described voip module also is used for obtaining described initialization directive from described interface module, carries out the media port initialization according to described initialization directive.
Wherein, described interface module can be virtual USB device; Above-mentioned terminal can be thin-client, thin-client 1 as shown in Figure 2.Described voip module, concrete being used for read described virtual USB device, obtains described control command or initialization directive; Perhaps, write described status command to described virtual USB device.
Corresponding with above-mentioned terminal, the embodiment of the invention also provides a kind of server, and this server comprises identification module and processing module, wherein:
Described identification module, being used for identifying the terminal corresponding with described server has interface module with described server interaction, then to described processing module triggering command;
Described processing module is used for the described triggering command according to described identification module transmission, when described terminal is calling terminal, obtains the parameter information of the networking telephone in the described calling terminal (VoIP) module; When described terminal is terminal called, send the parameter information of voip module in the described calling terminal that obtains to described terminal called.
In addition, described processing module also is used for obtaining before the parameter information of described calling terminal voip module, sends initialization directive to described calling terminal; Before perhaps sending the parameter information of voip module in the described calling terminal that obtains to described terminal called, receive the status command that terminal called sends.
Comprise the system of above-mentioned terminal and server as shown in Figures 2 and 3, Fig. 2 is the Organization Chart of IM registering service of the present invention, Fig. 3 is the Organization Chart of IM processed voice of the present invention and video media stream business, based on framework shown in Figure 3, finish the process of IM processed voice of the present invention and video media stream business as shown in Figure 4, this process comprises login process and calling procedure:
Login process:
S401, user A use thin client1, and the voip module that is deployed in this process on the thin client1 starts;
S402, user A are by virtual desktop host-host protocol login virtual desktop Server;
S403, voip module fictionalize a virtual USB equipment, and use virtual desktop host-host protocol (as ICA, PCoIP, RDP etc.) it is redirected on the Server.
S404, user A start virtual desktop Server and go up the IM Client program of installing, IM Client uses and at first logins application server (the Application Server of self, be called for short AS), from AS, obtain soft switching server (Soft Switch, abbreviation SS) ip address, port logins to SS;
S405, Thin client the end voip module read its virtual USB device always, receive the initialization directive of Server1 after, carry out the media port initialization.
Calling procedure:
S406, user A use the virtual desktop host-host protocol to control IM client1 on the Server by peripheral hardwares such as keyboard, mouses on thin client1, initiate the voice request to destination Mobile Station International ISDN Number;
S407, IM Client1 write initialization directive to virtual USB equipment, and the voip module on the thin client1 is resolved instruction, carries out the media port initialization;
S408, IM client1 use Session Initiation Protocol to the SS request of making a call; Carry the medium type of voip module ip address on the thin client1 and media port, support in the request, user A off-hook is finished user A and is called out;
S409, SS carry the medium type of ip address, port and the support of user A on thin client1 to the called subscriber B request of making a call in the request.Behind the user B off-hook, return the call request response to SS, finish media capability negotiation;
S410, IM client2 write connection (connect) instruction to virtual USB equipment, carry ip address, the port numbers of VoIP among the thin client1 and the medium type that consults in the instruction;
Voip module on S411, the thin client2 reads the USB device content, obtains the connect instruction, parses ip address, port numbers and the medium type of thin clinet1.Set up the rtp streaming media channel with the voip module (being the voip module on the thin client1) of user A.
SS and IM Client transmission be control signaling such as call request, call request response.
S412, when user A carries out voice dialogue, the voip module on the thin client1 is encoded to corresponding stream media format with voice or video data;
S413, stream media format data are sent on the thin client2 via the rtp streaming media channel by Real-time Transport Protocol;
After voip module on S414, the thin client2 is received Streaming Media message, be decoded as the corresponding audio data.The user just can receive these audio-frequency informations by peripheral hardware.
Complete, a basic new treatment mechanism of IM audio frequency that Here it is.For text message, still can be according to present processing mode.
Find out from above-mentioned, the present invention has cancelled that to cause the key link of stream media information time-delay or distortion be the RTP transmission link of stream medium data between operating terminal and server, and with directly directly transmission between thin client of Streaming Media, avoided time-delay and the distortion of information transmission.
In sum, embodiment of the invention difference with the prior art part is: 1) voip module integrated among the former IM client (comprise stream medium data codec unit such as audio frequency, Streaming Media input-output unit and to the SS registering unit) is separated, be deployed on the thin client, other whole modules especially Call Control Block still are deployed in the IM client application; 2) voip module that is deployed in thin client end fictionalizes a USB serial device, by the virtual desktop host-host protocol this virtual USB equipment is carried out remoting redirection to virtual desktop Server, the IM Client that runs on the Server uses and can read and write this virtual USB.Voip module and IM Client use and can carry out communication by the read-write to this USB device thus.IM Client uses by writing control command and parameter to this USB device, and parameter is passed to voip module, and the control voip module carries out initialization.Voip module is judged the control signaling that IM Client uses by the output character stream that reads this virtual USB equipment; 3) transmission of the Real-time Transport Protocol of stream medium data is no longer carried out between the IM client on the Server uses, but carries out between the voip module on the thin client; 4) (being voip module and other intermodules of IM on the thin client) transport stream media data no longer between Server and thin client, but control channel only; Something in common is: the user can be still on thin client by the virtual desktop host-host protocol carry out other operations that IM client uses as login, publish, calling, text message etc.
This shows that the embodiment of the invention can be avoided transmitting time-delay and the distortion that a large amount of stream medium datas cause by agreements such as RDP between thin client and Server, and framework is simple, easily realize, more do not relate to the additions and deletions of hardware.
One of ordinary skill in the art will appreciate that all or part of step in the said method can instruct related hardware to finish by program, said procedure can be stored in the computer-readable recording medium, as read-only memory, disk or CD etc.Alternatively, all or part of step of above-described embodiment also can use one or more integrated circuits to realize.Correspondingly, each the module/unit in above-described embodiment can adopt the form of hardware to realize, also can adopt the form of software function module to realize.The present invention is not restricted to the combination of the hardware and software of any particular form.
Above embodiment is only unrestricted in order to technical scheme of the present invention to be described, only with reference to preferred embodiment the present invention is had been described in detail.Those of ordinary skill in the art should be appreciated that and can make amendment or be equal to replacement technical scheme of the present invention, and do not break away from the spirit and scope of technical solution of the present invention, all should be encompassed in the middle of the claim scope of the present invention.
Claims (10)
1. a terminal is characterized in that, this terminal comprises interface module and the networking telephone (VoIP) module, wherein:
Described interface module is used for during as terminal called, receiving the control command that described terminal called corresponding server sends in described terminal, carries the parameter information of voip module in the calling terminal in the described control command;
Described voip module, be used in described terminal during as terminal called, obtain described control command from described interface module, parse the described parameter information that carries in the described control command, set up real-time transport protocol (rtp) Streaming Media passage according to the voip module in described parameter information and the described calling terminal.
2. terminal according to claim 1 is characterized in that:
Described voip module also for before obtaining described control command from described interface module, sends the status command that the described terminal of indication can be used to described interface module;
Described interface module also is used for sending described status command to described terminal called corresponding server.
3. terminal according to claim 1 is characterized in that:
Described interface module also is used for during as calling terminal, receiving the initialization directive that described calling terminal corresponding server sends in described terminal;
Described voip module also is used for obtaining described initialization directive from described interface module, carries out the media port initialization according to described initialization directive.
4. according to the described terminal of the arbitrary claim of claim 1-3, it is characterized in that:
Described interface module is virtual USB device;
Described voip module, concrete being used for read described virtual USB device, obtains described control command or initialization directive.
5. according to claim 2 or 3 described terminals, it is characterized in that:
Described interface module is virtual USB device;
Described voip module, concrete being used for writes described status command to described virtual USB device.
6. a server is characterized in that, this server comprises identification module and processing module, wherein:
Described identification module, being used for identifying the terminal corresponding with described server has interface module with described server interaction, then to described processing module triggering command;
Described processing module is used for the described triggering command according to described identification module transmission, when described terminal is calling terminal, obtains the parameter information of the networking telephone in the described calling terminal (VoIP) module; When described terminal is terminal called, send the parameter information of voip module in the described calling terminal that obtains to described terminal called.
7. server according to claim 6 is characterized in that:
Described processing module also is used for obtaining before the parameter information of described calling terminal voip module, sends initialization directive to described calling terminal.
8. server according to claim 6 is characterized in that:
Described processing module also before the parameter information for the described calling terminal voip module that sends acquisition to described terminal called, receives the status command that terminal called sends.
9. an audio-frequency processing method is characterized in that, this method comprises:
Terminal called receives the control command that described terminal called corresponding server sends, and resolves the parameter information of the networking telephone (VoIP) module in the calling terminal that described control command obtains to carry in the described control command;
Described terminal called is set up real-time transport protocol (rtp) Streaming Media passage according to the voip module in described parameter information and the described calling terminal.
10. method according to claim 9 is characterized in that:
Described terminal called receives before the control command of described terminal called corresponding server transmission, and described method also comprises:
Calling terminal receives the initialization directive that described calling terminal corresponding server sends, and described calling terminal carries out the media port initialization according to described initialization directive.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012100442188A CN103297314A (en) | 2012-02-24 | 2012-02-24 | Terminal, server and audio processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012100442188A CN103297314A (en) | 2012-02-24 | 2012-02-24 | Terminal, server and audio processing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103297314A true CN103297314A (en) | 2013-09-11 |
Family
ID=49097657
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012100442188A Pending CN103297314A (en) | 2012-02-24 | 2012-02-24 | Terminal, server and audio processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103297314A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040170180A1 (en) * | 2002-09-05 | 2004-09-02 | Siemens Aktiengesellschaft | Method for setting up a useful data link between terminals in a VoIP system |
| CN102308560A (en) * | 2011-07-18 | 2012-01-04 | 华为技术有限公司 | Transmission method and device of media stream data in cloud calculative system |
| CN102333124A (en) * | 2011-10-09 | 2012-01-25 | 华为技术有限公司 | Method and device for improving quality of audio or video transmission in cloud computing mode |
-
2012
- 2012-02-24 CN CN2012100442188A patent/CN103297314A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040170180A1 (en) * | 2002-09-05 | 2004-09-02 | Siemens Aktiengesellschaft | Method for setting up a useful data link between terminals in a VoIP system |
| CN102308560A (en) * | 2011-07-18 | 2012-01-04 | 华为技术有限公司 | Transmission method and device of media stream data in cloud calculative system |
| CN102333124A (en) * | 2011-10-09 | 2012-01-25 | 华为技术有限公司 | Method and device for improving quality of audio or video transmission in cloud computing mode |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9602553B2 (en) | Method, apparatus, and system for implementing VOIP call in cloud computing environment | |
| TWI440346B (en) | Open architecture based domain dependent real time multi-lingual communication service | |
| US7978216B2 (en) | Versatile conference adapter and method employing same | |
| RU2532729C2 (en) | Method and service node for accessing video part of voice and video call and method of adding video part to voice call | |
| US9021062B2 (en) | Sharing audio and video device on a client endpoint device between local use and hosted virtual desktop use | |
| US20150271445A1 (en) | Advanced real-time ip communication in a mobile terminal | |
| CN104365088A (en) | Multiple channel communication using multiple cameras | |
| US20140115051A1 (en) | Method and Apparatus for Transmitting Media Stream Data in Cloud Computing System | |
| CN109617990B (en) | Converged communication resource cloud sharing method and system | |
| EP2680618B1 (en) | Voip processing method and apparatus of mobile terminal in mobile communication system | |
| WO2018006678A1 (en) | Voice call method and apparatus | |
| CN113905023B (en) | Outbound system and method based on webpage instant messaging technology | |
| CN103684970B (en) | The transmission method of media data flow and thin terminal | |
| EP2025102B1 (en) | Techniques for message waiting indication support across different protocols | |
| CN103414867B (en) | Multimedia session control method, terminal and system | |
| US11070665B2 (en) | Voice over internet protocol processing method and related network device | |
| EP1264448B1 (en) | A packet network telecommunication system | |
| CN111654909B (en) | Communication method and system | |
| CN114979386A (en) | Applet voice communication method, device, electronic equipment and storage medium | |
| CN103297314A (en) | Terminal, server and audio processing method | |
| JP5410977B2 (en) | How to communicate between several terminals | |
| CN115426337B (en) | Online customer service system and method based on 5G message and VoLTE | |
| JP2011101246A (en) | Communication system, communication equipment, communication method and program | |
| CN208257918U (en) | Merge the mobile Internet voice platform system of public switched telephone network PSTN | |
| CN106453265B (en) | IP call scheduling method and system, IPPBX and server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20130911 |